How to evaluate RMSE with standard deviation Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern) 2019 Moderator Election Q&A - Questionnaire 2019 Community Moderator Election ResultsAdjusting predicted values based on average offsets from past predictionsExpanding Standard deviationRegression yields much smaller standard deviation and the mean is off, what could be wrong?Interpreting the Root Mean Squared Error (RMSE)!High RMSE and MAE and low MAPEDuring a regression task, I am getting low R^2 values, but elementwise difference between test set and prediction values is hugeMAD vs RMSE vs MAE vs MSLE vs R²: When to use which?How to start building a statistical regression analysis model with multiple categorical/discrete input variables of high dimension in PythonHow can causal inference be used with machine learning?
Did the new image of black hole confirm the general theory of relativity?
Is there a service that would inform me whenever a new direct route is scheduled from a given airport?
How do you clear the ApexPages.getMessages() collection in a test?
How do I automatically answer y in bash script?
Limit for e and 1/e
Classification of bundles, Postnikov towers, obstruction theory, local coefficients
Problem when applying foreach loop
3 doors, three guards, one stone
How can players take actions together that are impossible otherwise?
How can I make names more distinctive without making them longer?
How to politely respond to generic emails requesting a PhD/job in my lab? Without wasting too much time
Should you tell Jews they are breaking a commandment?
Working around an AWS network ACL rule limit
Can the prologue be the backstory of your main character?
Is there a documented rationale why the House Ways and Means chairman can demand tax info?
Why use gamma over alpha radiation?
What do you call the holes in a flute?
Windows 10: How to Lock (not sleep) laptop on lid close?
How to say that you spent the night with someone, you were only sleeping and nothing else?
Antler Helmet: Can it work?
Does a C shift expression have unsigned type? Why would Splint warn about a right-shift?
Notation for two qubit composite product state
Biased dice probability question
I'm having difficulty getting my players to do stuff in a sandbox campaign
How to evaluate RMSE with standard deviation
Announcing the arrival of Valued Associate #679: Cesar Manara
Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern)
2019 Moderator Election Q&A - Questionnaire
2019 Community Moderator Election ResultsAdjusting predicted values based on average offsets from past predictionsExpanding Standard deviationRegression yields much smaller standard deviation and the mean is off, what could be wrong?Interpreting the Root Mean Squared Error (RMSE)!High RMSE and MAE and low MAPEDuring a regression task, I am getting low R^2 values, but elementwise difference between test set and prediction values is hugeMAD vs RMSE vs MAE vs MSLE vs R²: When to use which?How to start building a statistical regression analysis model with multiple categorical/discrete input variables of high dimension in PythonHow can causal inference be used with machine learning?
$begingroup$
I have regression model, where target is between 0 to 1. standard deviation of target is 0.817 and RMSE of model on hold out is 0.52. I am wondering if this good model or not.
Any feedback will be useful
Thanks
regression statistics
asked Jul 5 '18 at 17:00
Kppatel PatelKppatel Patel
1063
$endgroup$
bumped to the homepage by Community♦ 37 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
add a comment |
$begingroup$
I have regression model, where target is between 0 to 1. standard deviation of target is 0.817 and RMSE of model on hold out is 0.52. I am wondering if this good model or not.
Any feedback will be useful
Thanks
regression statistics
asked Jul 5 '18 at 17:00
Kppatel PatelKppatel Patel
1063
$endgroup$
bumped to the homepage by Community♦ 37 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
$begingroup$
it is definitely not good, both the mean error and the spread are high. I would consider it good if both measures were around 0.1. But the answer also depends on your application.
$endgroup$
– pcko1
Jul 5 '18 at 17:11
add a comment |
$begingroup$
I have regression model, where target is between 0 to 1. standard deviation of target is 0.817 and RMSE of model on hold out is 0.52. I am wondering if this good model or not.
Any feedback will be useful
Thanks
regression statistics
asked Jul 5 '18 at 17:00
Kppatel PatelKppatel Patel
1063
$endgroup$
I have regression model, where target is between 0 to 1. standard deviation of target is 0.817 and RMSE of model on hold out is 0.52. I am wondering if this good model or not.
Any feedback will be useful
Thanks
regression statistics
regression statistics
asked Jul 5 '18 at 17:00
Kppatel PatelKppatel Patel
1063
asked Jul 5 '18 at 17:00
Kppatel PatelKppatel Patel
1063
asked Jul 5 '18 at 17:00
Kppatel PatelKppatel Patel
1063
asked Jul 5 '18 at 17:00
Kppatel PatelKppatel Patel
1063
asked Jul 5 '18 at 17:00
Kppatel PatelKppatel Patel
1063
1063
bumped to the homepage by Community♦ 37 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
bumped to the homepage by Community♦ 37 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
$begingroup$
it is definitely not good, both the mean error and the spread are high. I would consider it good if both measures were around 0.1. But the answer also depends on your application.
$endgroup$
– pcko1
Jul 5 '18 at 17:11
add a comment |
$begingroup$
it is definitely not good, both the mean error and the spread are high. I would consider it good if both measures were around 0.1. But the answer also depends on your application.
$endgroup$
– pcko1
Jul 5 '18 at 17:11
$begingroup$
it is definitely not good, both the mean error and the spread are high. I would consider it good if both measures were around 0.1. But the answer also depends on your application.
$endgroup$
– pcko1
Jul 5 '18 at 17:11
$begingroup$
it is definitely not good, both the mean error and the spread are high. I would consider it good if both measures were around 0.1. But the answer also depends on your application.
$endgroup$
– pcko1
Jul 5 '18 at 17:11
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
The residuals of your model seem to vary by a large extent (as denoted by RMSE, which is in the same units as the target). Without any context on the problem you are solving, it would be hard to decide whether the model is good or not. But, it does appear to be on the poorer side.
answered Jul 18 '18 at 9:56
SrikrishnaSrikrishna
1062
$endgroup$
add a comment |
Your Answer
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "557"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f34051%2fhow-to-evaluate-rmse-with-standard-deviation%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
The residuals of your model seem to vary by a large extent (as denoted by RMSE, which is in the same units as the target). Without any context on the problem you are solving, it would be hard to decide whether the model is good or not. But, it does appear to be on the poorer side.
answered Jul 18 '18 at 9:56
SrikrishnaSrikrishna
1062
$endgroup$
add a comment |
$begingroup$
The residuals of your model seem to vary by a large extent (as denoted by RMSE, which is in the same units as the target). Without any context on the problem you are solving, it would be hard to decide whether the model is good or not. But, it does appear to be on the poorer side.
answered Jul 18 '18 at 9:56
SrikrishnaSrikrishna
1062
$endgroup$
add a comment |
$begingroup$
The residuals of your model seem to vary by a large extent (as denoted by RMSE, which is in the same units as the target). Without any context on the problem you are solving, it would be hard to decide whether the model is good or not. But, it does appear to be on the poorer side.
answered Jul 18 '18 at 9:56
SrikrishnaSrikrishna
1062
$endgroup$
The residuals of your model seem to vary by a large extent (as denoted by RMSE, which is in the same units as the target). Without any context on the problem you are solving, it would be hard to decide whether the model is good or not. But, it does appear to be on the poorer side.
answered Jul 18 '18 at 9:56
SrikrishnaSrikrishna
1062
answered Jul 18 '18 at 9:56
SrikrishnaSrikrishna
1062
answered Jul 18 '18 at 9:56
SrikrishnaSrikrishna
1062
answered Jul 18 '18 at 9:56
SrikrishnaSrikrishna
1062
1062
add a comment |
add a comment |
Thanks for contributing an answer to Data Science Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f34051%2fhow-to-evaluate-rmse-with-standard-deviation%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
$begingroup$
it is definitely not good, both the mean error and the spread are high. I would consider it good if both measures were around 0.1. But the answer also depends on your application.
$endgroup$
– pcko1
Jul 5 '18 at 17:11