Feature selection caused more overfitting2019 Community Moderator ElectionHow does SelectKBest() perform feature selection?Sklearn feature selection stopping criterion (SelectFromModel)Feature selection where adding features are deteriorating modelFeature reduction convenienceIntuitive interpretation of ratios between training set scores and validation set scoreswhy the RFE to select features is changing when the os or computer is changedOverfitting problem in modelFeature Scaling and normalization in cross-validation setReasons why training error can go up after more training?Manual feature engineering based on the output
How can I get through very long and very dry, but also very useful technical documents when learning a new tool?
Why not increase contact surface when reentering the atmosphere?
Trouble understanding the speech of overseas colleagues
What does "I’d sit this one out, Cap," imply or mean in the context?
Lay out the Carpet
How do scammers retract money, while you can’t?
Is HostGator storing my password in plaintext?
How many times can American Tourist re-enter UK in same 6 month period?
CREATE opcode: what does it really do?
Pole-zeros of a real-valued causal FIR system
How do we know the LHC results are robust?
Avoiding estate tax by giving multiple gifts
What is the opposite of 'gravitas'?
How did Arya survive the stabbing?
How do I extract a value from a time formatted value in excel?
Type int? vs type int
How can a function with a hole (removable discontinuity) equal a function with no hole?
System.debug(JSON.Serialize(o)) Not longer shows full string
India just shot down a satellite from the ground. At what altitude range is the resulting debris field?
How can I kill an app using Terminal?
What is paid subscription needed for in Mortal Kombat 11?
Risk of infection at the gym?
What Brexit proposals are on the table in the indicative votes on the 27th of March 2019?
Is there a good way to store credentials outside of a password manager?
Feature selection caused more overfitting
2019 Community Moderator ElectionHow does SelectKBest() perform feature selection?Sklearn feature selection stopping criterion (SelectFromModel)Feature selection where adding features are deteriorating modelFeature reduction convenienceIntuitive interpretation of ratios between training set scores and validation set scoreswhy the RFE to select features is changing when the os or computer is changedOverfitting problem in modelFeature Scaling and normalization in cross-validation setReasons why training error can go up after more training?Manual feature engineering based on the output
$begingroup$
What does it mean if I used selectfrommodel to select features and cross-validation score went up but the test set score went down even more compared to when I did not use feature selection?
Does this mean it's causing more overfitting? I thought feature selection is used to reduce overfitting.
machine-learning
asked 39 mins ago
edunlimitedunlimit
153
New contributor
edunlimit is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
$endgroup$
add a comment |
$begingroup$
What does it mean if I used selectfrommodel to select features and cross-validation score went up but the test set score went down even more compared to when I did not use feature selection?
Does this mean it's causing more overfitting? I thought feature selection is used to reduce overfitting.
machine-learning
asked 39 mins ago
edunlimitedunlimit
153
New contributor
edunlimit is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
$endgroup$
add a comment |
$begingroup$
What does it mean if I used selectfrommodel to select features and cross-validation score went up but the test set score went down even more compared to when I did not use feature selection?
Does this mean it's causing more overfitting? I thought feature selection is used to reduce overfitting.
machine-learning
asked 39 mins ago
edunlimitedunlimit
153
New contributor
edunlimit is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
$endgroup$
What does it mean if I used selectfrommodel to select features and cross-validation score went up but the test set score went down even more compared to when I did not use feature selection?
Does this mean it's causing more overfitting? I thought feature selection is used to reduce overfitting.
machine-learning
machine-learning
asked 39 mins ago
edunlimitedunlimit
153
New contributor
edunlimit is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
asked 39 mins ago
edunlimitedunlimit
153
New contributor
edunlimit is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
asked 39 mins ago
edunlimitedunlimit
153
New contributor
edunlimit is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
asked 39 mins ago
edunlimitedunlimit
153
asked 39 mins ago
edunlimitedunlimit
153
153
New contributor
edunlimit is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
New contributor
edunlimit is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
edunlimit is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
add a comment |
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function ()
return StackExchange.using("mathjaxEditing", function ()
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
);
);
, "mathjax-editing");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "557"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
edunlimit is a new contributor. Be nice, and check out our Code of Conduct.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f48115%2ffeature-selection-caused-more-overfitting%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
edunlimit is a new contributor. Be nice, and check out our Code of Conduct.
edunlimit is a new contributor. Be nice, and check out our Code of Conduct.
edunlimit is a new contributor. Be nice, and check out our Code of Conduct.
edunlimit is a new contributor. Be nice, and check out our Code of Conduct.
Thanks for contributing an answer to Data Science Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f48115%2ffeature-selection-caused-more-overfitting%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
