Multicolinearity & accurate weights of predictors2019 Community Moderator Election
How to write a macro that is braces sensitive?
How can bays and straits be determined in a procedurally generated map?
How does one intimidate enemies without having the capacity for violence?
Risk of getting Chronic Wasting Disease (CWD) in the United States?
How can I make my BBEG immortal short of making them a Lich or Vampire?
"You are your self first supporter", a more proper way to say it
What is the word for reserving something for yourself before others do?
String Manipulation Interpreter
Is a conference paper whose proceedings will be published in IEEE Xplore counted as a publication?
The use of multiple foreign keys on same column in SQL Server
Font hinting is lost in Chrome-like browsers (for some languages )
Test whether all array elements are factors of a number
What are these boxed doors outside store fronts in New York?
Do I have a twin with permutated remainders?
How do I create uniquely male characters?
Voyeurism but not really
How did the USSR manage to innovate in an environment characterized by government censorship and high bureaucracy?
Which models of the Boeing 737 are still in production?
Why are electrically insulating heatsinks so rare? Is it just cost?
Theorems that impeded progress
Characters won't fit in table
To string or not to string
Why "Having chlorophyll without photosynthesis is actually very dangerous" and "like living with a bomb"?
What do three bars across the stem of a note mean?
Multicolinearity & accurate weights of predictors
2019 Community Moderator Election
$begingroup$
Let’s suppose that the stock value of various companies is the target of my models.
I have some “internal” predictors e.g. yearly sales of each company, sum of salaries at each company etc.
I have some “external” predictors e.g. geographical position of each company (latitude & longitude), population in the area in which each company operates etc.
Therefore, each observation at my dataset is about the stock value of a company along with its internal and external predictors.
The purpose of my project is to understand how each of a company's internal predictors affect in a very specific way the stock value of the respective company.
In simpler words, I want to get some accurate weights for the internal predictors which show me how exactly they affect the stock value of the respective company.
However, because there is relatively high multicolinearity between some of the internal predictors as a result I am not really getting very accurate weights for each one of them.
There may also be between the internal and the external predictors but I do not consider this as a problem because I think that you should account for all external predictors when taking the weight of the internal predictors.
However, I am not sure that I have to put all the internal predictors at the same model together because for example I do not want the weight of the yearly sales of a company to be modified because of the presence of other internal predictors such as the sum of salaries at this company.
In this regard, I am starting to think that the best way to go is to have multiple different models where each one of them has to do with one internal predictors separately but at every case all the external predictors.
Does this make sense?
Do you have any better idea?
P.S.
I just found a post which is quite similar to my line of reasoning: https://www.researchgate.net/post/Is_building_separate_models_a_solution_to_multi-collinearity.
collinearity
asked Mar 7 at 9:51
Poete MauditPoete Maudit
416315
$endgroup$
bumped to the homepage by Community♦ 6 hours ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
add a comment |
$begingroup$
Let’s suppose that the stock value of various companies is the target of my models.
I have some “internal” predictors e.g. yearly sales of each company, sum of salaries at each company etc.
I have some “external” predictors e.g. geographical position of each company (latitude & longitude), population in the area in which each company operates etc.
Therefore, each observation at my dataset is about the stock value of a company along with its internal and external predictors.
The purpose of my project is to understand how each of a company's internal predictors affect in a very specific way the stock value of the respective company.
In simpler words, I want to get some accurate weights for the internal predictors which show me how exactly they affect the stock value of the respective company.
However, because there is relatively high multicolinearity between some of the internal predictors as a result I am not really getting very accurate weights for each one of them.
There may also be between the internal and the external predictors but I do not consider this as a problem because I think that you should account for all external predictors when taking the weight of the internal predictors.
However, I am not sure that I have to put all the internal predictors at the same model together because for example I do not want the weight of the yearly sales of a company to be modified because of the presence of other internal predictors such as the sum of salaries at this company.
In this regard, I am starting to think that the best way to go is to have multiple different models where each one of them has to do with one internal predictors separately but at every case all the external predictors.
Does this make sense?
Do you have any better idea?
P.S.
I just found a post which is quite similar to my line of reasoning: https://www.researchgate.net/post/Is_building_separate_models_a_solution_to_multi-collinearity.
collinearity
asked Mar 7 at 9:51
Poete MauditPoete Maudit
416315
$endgroup$
bumped to the homepage by Community♦ 6 hours ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
add a comment |
$begingroup$
Let’s suppose that the stock value of various companies is the target of my models.
I have some “internal” predictors e.g. yearly sales of each company, sum of salaries at each company etc.
I have some “external” predictors e.g. geographical position of each company (latitude & longitude), population in the area in which each company operates etc.
Therefore, each observation at my dataset is about the stock value of a company along with its internal and external predictors.
The purpose of my project is to understand how each of a company's internal predictors affect in a very specific way the stock value of the respective company.
In simpler words, I want to get some accurate weights for the internal predictors which show me how exactly they affect the stock value of the respective company.
However, because there is relatively high multicolinearity between some of the internal predictors as a result I am not really getting very accurate weights for each one of them.
There may also be between the internal and the external predictors but I do not consider this as a problem because I think that you should account for all external predictors when taking the weight of the internal predictors.
However, I am not sure that I have to put all the internal predictors at the same model together because for example I do not want the weight of the yearly sales of a company to be modified because of the presence of other internal predictors such as the sum of salaries at this company.
In this regard, I am starting to think that the best way to go is to have multiple different models where each one of them has to do with one internal predictors separately but at every case all the external predictors.
Does this make sense?
Do you have any better idea?
P.S.
I just found a post which is quite similar to my line of reasoning: https://www.researchgate.net/post/Is_building_separate_models_a_solution_to_multi-collinearity.
collinearity
asked Mar 7 at 9:51
Poete MauditPoete Maudit
416315
$endgroup$
Let’s suppose that the stock value of various companies is the target of my models.
I have some “internal” predictors e.g. yearly sales of each company, sum of salaries at each company etc.
I have some “external” predictors e.g. geographical position of each company (latitude & longitude), population in the area in which each company operates etc.
Therefore, each observation at my dataset is about the stock value of a company along with its internal and external predictors.
The purpose of my project is to understand how each of a company's internal predictors affect in a very specific way the stock value of the respective company.
In simpler words, I want to get some accurate weights for the internal predictors which show me how exactly they affect the stock value of the respective company.
However, because there is relatively high multicolinearity between some of the internal predictors as a result I am not really getting very accurate weights for each one of them.
There may also be between the internal and the external predictors but I do not consider this as a problem because I think that you should account for all external predictors when taking the weight of the internal predictors.
However, I am not sure that I have to put all the internal predictors at the same model together because for example I do not want the weight of the yearly sales of a company to be modified because of the presence of other internal predictors such as the sum of salaries at this company.
In this regard, I am starting to think that the best way to go is to have multiple different models where each one of them has to do with one internal predictors separately but at every case all the external predictors.
Does this make sense?
Do you have any better idea?
P.S.
I just found a post which is quite similar to my line of reasoning: https://www.researchgate.net/post/Is_building_separate_models_a_solution_to_multi-collinearity.
collinearity
collinearity
asked Mar 7 at 9:51
Poete MauditPoete Maudit
416315
asked Mar 7 at 9:51
Poete MauditPoete Maudit
416315
edited Mar 7 at 10:11
Poete Maudit
asked Mar 7 at 9:51
Poete MauditPoete Maudit
416315
asked Mar 7 at 9:51
Poete MauditPoete Maudit
416315
asked Mar 7 at 9:51
Poete MauditPoete Maudit
416315
416315
bumped to the homepage by Community♦ 6 hours ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
bumped to the homepage by Community♦ 6 hours ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
add a comment |
add a comment |
2 Answers
2
active
oldest
votes
$begingroup$
If you build separate models, you are making the internal predictors/features independent of each other. This will cause a lot of your internals predictors to get really high weights which would probably not be the case if you added them together in the same model. An obvious method is to remove correlated predictors and then see what weights you get.
answered Mar 7 at 15:07
Atif HassanAtif Hassan
1263
$endgroup$
add a comment |
$begingroup$
One way is use dimension reduction methods like pca to remove this.Or you could use regularization method like ridge.
answered Mar 7 at 15:55
nan hunan hu
113
$endgroup$
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
return StackExchange.using("mathjaxEditing", function ()
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
);
);
, "mathjax-editing");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "557"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f46851%2fmulticolinearity-accurate-weights-of-predictors%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
2 Answers
2
active
oldest
votes
2 Answers
2
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
If you build separate models, you are making the internal predictors/features independent of each other. This will cause a lot of your internals predictors to get really high weights which would probably not be the case if you added them together in the same model. An obvious method is to remove correlated predictors and then see what weights you get.
answered Mar 7 at 15:07
Atif HassanAtif Hassan
1263
$endgroup$
add a comment |
$begingroup$
If you build separate models, you are making the internal predictors/features independent of each other. This will cause a lot of your internals predictors to get really high weights which would probably not be the case if you added them together in the same model. An obvious method is to remove correlated predictors and then see what weights you get.
answered Mar 7 at 15:07
Atif HassanAtif Hassan
1263
$endgroup$
add a comment |
$begingroup$
If you build separate models, you are making the internal predictors/features independent of each other. This will cause a lot of your internals predictors to get really high weights which would probably not be the case if you added them together in the same model. An obvious method is to remove correlated predictors and then see what weights you get.
answered Mar 7 at 15:07
Atif HassanAtif Hassan
1263
$endgroup$
If you build separate models, you are making the internal predictors/features independent of each other. This will cause a lot of your internals predictors to get really high weights which would probably not be the case if you added them together in the same model. An obvious method is to remove correlated predictors and then see what weights you get.
answered Mar 7 at 15:07
Atif HassanAtif Hassan
1263
answered Mar 7 at 15:07
Atif HassanAtif Hassan
1263
answered Mar 7 at 15:07
Atif HassanAtif Hassan
1263
answered Mar 7 at 15:07
Atif HassanAtif Hassan
1263
1263
add a comment |
add a comment |
$begingroup$
One way is use dimension reduction methods like pca to remove this.Or you could use regularization method like ridge.
answered Mar 7 at 15:55
nan hunan hu
113
$endgroup$
add a comment |
$begingroup$
One way is use dimension reduction methods like pca to remove this.Or you could use regularization method like ridge.
answered Mar 7 at 15:55
nan hunan hu
113
$endgroup$
add a comment |
$begingroup$
One way is use dimension reduction methods like pca to remove this.Or you could use regularization method like ridge.
answered Mar 7 at 15:55
nan hunan hu
113
$endgroup$
One way is use dimension reduction methods like pca to remove this.Or you could use regularization method like ridge.
answered Mar 7 at 15:55
nan hunan hu
113
answered Mar 7 at 15:55
nan hunan hu
113
answered Mar 7 at 15:55
nan hunan hu
113
answered Mar 7 at 15:55
nan hunan hu
113
113
add a comment |
add a comment |
Thanks for contributing an answer to Data Science Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f46851%2fmulticolinearity-accurate-weights-of-predictors%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
