Given is the result of the model performance. Help me with this MCQ Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 23, 2019 at 23:30UTC (7:30pm US/Eastern) 2019 Moderator Election Q&A - Questionnaire 2019 Community Moderator Election ResultsPrediction in the training sample with randomforest in rComparing Non-deterministic Binary ClassifiersHelp training Back-propagation Neural Network With 150k training pairsWhat to do after selecting a model with cross-validation?To be useful, doesn't a test set often become a second dev set?Assigning a value to Y for regressionData Snooping, Information Leakage When Performing Feature NormalizationWhat to report in the build model, asses model and evaluate results steps of CRISP-DM?Hyper-parameter tuning when you don't have an access to the test dataDifference in model performance measures of train and test data sets
AppleTVs create a chatty alternate WiFi network
preposition before coffee
Most bit efficient text communication method?
macOS: Name for app shortcut screen found by pinching with thumb and three fingers
Google .dev domain strangely redirects to https
Why we try to capture variability?
What is the meaning of 'breadth' in breadth first search?
Why can't I install Tomboy in Ubuntu Mate 19.04?
How do I find out the mythology and history of my Fortress?
What makes a man succeed?
Does the Mueller report show a conspiracy between Russia and the Trump Campaign?
What is an "asse" in Elizabethan English?
Electrolysis of water: Which equations to use? (IB Chem)
Random body shuffle every night—can we still function?
How fail-safe is nr as stop bytes?
Sliceness of knots
What does 丫 mean? 丫是什么意思？
Would it be easier to apply for a UK visa if there is a host family to sponsor for you in going there?
Why is it faster to reheat something than it is to cook it?
Semigroups with no morphisms between them
How to report t statistic from R
Where is the Data Import Wizard Error Log
How often does castling occur in grandmaster games?
In musical terms, what properties are varied by the human voice to produce different words / syllables?
Given is the result of the model performance. Help me with this MCQ
Announcing the arrival of Valued Associate #679: Cesar Manara
Planned maintenance scheduled April 23, 2019 at 23:30UTC (7:30pm US/Eastern)
2019 Moderator Election Q&A - Questionnaire
2019 Community Moderator Election ResultsPrediction in the training sample with randomforest in rComparing Non-deterministic Binary ClassifiersHelp training Back-propagation Neural Network With 150k training pairsWhat to do after selecting a model with cross-validation?To be useful, doesn't a test set often become a second dev set?Assigning a value to Y for regressionData Snooping, Information Leakage When Performing Feature NormalizationWhat to report in the build model, asses model and evaluate results steps of CRISP-DM?Hyper-parameter tuning when you don't have an access to the test dataDifference in model performance measures of train and test data sets
$begingroup$
You also evaluate your model on the test set, and find the following:
Human-level performance 0.1%
Training set error 2.0%
Dev set error 2.1%
Test set error 7.0%
What does this mean? (Check the two best options.)
You have underfit to the dev set.
You should get a bigger test set.
You should try to get a bigger dev set.
You have overfit to the dev set.
machine-learning training
asked Oct 20 '18 at 14:33
Mihir ThakkarMihir Thakkar
11
$endgroup$
bumped to the homepage by Community♦ 34 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
add a comment |
$begingroup$
You also evaluate your model on the test set, and find the following:
Human-level performance 0.1%
Training set error 2.0%
Dev set error 2.1%
Test set error 7.0%
What does this mean? (Check the two best options.)
You have underfit to the dev set.
You should get a bigger test set.
You should try to get a bigger dev set.
You have overfit to the dev set.
machine-learning training
asked Oct 20 '18 at 14:33
Mihir ThakkarMihir Thakkar
11
$endgroup$
bumped to the homepage by Community♦ 34 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
add a comment |
$begingroup$
You also evaluate your model on the test set, and find the following:
Human-level performance 0.1%
Training set error 2.0%
Dev set error 2.1%
Test set error 7.0%
What does this mean? (Check the two best options.)
You have underfit to the dev set.
You should get a bigger test set.
You should try to get a bigger dev set.
You have overfit to the dev set.
machine-learning training
asked Oct 20 '18 at 14:33
Mihir ThakkarMihir Thakkar
11
$endgroup$
You also evaluate your model on the test set, and find the following:
Human-level performance 0.1%
Training set error 2.0%
Dev set error 2.1%
Test set error 7.0%
What does this mean? (Check the two best options.)
You have underfit to the dev set.
You should get a bigger test set.
You should try to get a bigger dev set.
You have overfit to the dev set.
machine-learning training
machine-learning training
asked Oct 20 '18 at 14:33
Mihir ThakkarMihir Thakkar
11
asked Oct 20 '18 at 14:33
Mihir ThakkarMihir Thakkar
11
asked Oct 20 '18 at 14:33
Mihir ThakkarMihir Thakkar
11
asked Oct 20 '18 at 14:33
Mihir ThakkarMihir Thakkar
11
asked Oct 20 '18 at 14:33
Mihir ThakkarMihir Thakkar
11
11
bumped to the homepage by Community♦ 34 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
bumped to the homepage by Community♦ 34 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
I think answer are options 3) and 4)
Clearly there seems to be overfiting towards dev set as the dev set error is low and almost equal to training set error.
And increasing the number of samples helps minimizing overfiting problem..
answered Oct 20 '18 at 15:18
jimmyjimmy
1012
$endgroup$
add a comment |
Your Answer
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "557"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f39971%2fgiven-is-the-result-of-the-model-performance-help-me-with-this-mcq%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
I think answer are options 3) and 4)
Clearly there seems to be overfiting towards dev set as the dev set error is low and almost equal to training set error.
And increasing the number of samples helps minimizing overfiting problem..
answered Oct 20 '18 at 15:18
jimmyjimmy
1012
$endgroup$
add a comment |
$begingroup$
I think answer are options 3) and 4)
Clearly there seems to be overfiting towards dev set as the dev set error is low and almost equal to training set error.
And increasing the number of samples helps minimizing overfiting problem..
answered Oct 20 '18 at 15:18
jimmyjimmy
1012
$endgroup$
add a comment |
$begingroup$
I think answer are options 3) and 4)
Clearly there seems to be overfiting towards dev set as the dev set error is low and almost equal to training set error.
And increasing the number of samples helps minimizing overfiting problem..
answered Oct 20 '18 at 15:18
jimmyjimmy
1012
$endgroup$
I think answer are options 3) and 4)
Clearly there seems to be overfiting towards dev set as the dev set error is low and almost equal to training set error.
And increasing the number of samples helps minimizing overfiting problem..
answered Oct 20 '18 at 15:18
jimmyjimmy
1012
answered Oct 20 '18 at 15:18
jimmyjimmy
1012
answered Oct 20 '18 at 15:18
jimmyjimmy
1012
answered Oct 20 '18 at 15:18
jimmyjimmy
1012
1012
add a comment |
add a comment |
Thanks for contributing an answer to Data Science Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f39971%2fgiven-is-the-result-of-the-model-performance-help-me-with-this-mcq%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
