Hfrxdjt

Central Vacuuming: Is it worth it, and how does it compare to normal vacuuming?

The Nth Gryphon Number

How do I find out the mythology and history of my Fortress?

What are the discoveries that have been possible with the rejection of positivism?

Why is it faster to reheat something than it is to cook it?

Random body shuffle every night—can we still function?

Why we try to capture variability?

How does the math work when buying airline miles?

How did Fremen produce and carry enough thumpers to use Sandworms as de facto Ubers?

What would you call this weird metallic apparatus that allows you to lift people?

Where is the Data Import Wizard Error Log

What is the difference between a "ranged attack" and a "ranged weapon attack"?

macOS: Name for app shortcut screen found by pinching with thumb and three fingers

Why does it sometimes sound good to play a grace note as a lead in to a note in a melody?

How to pronounce 伝統色

Strange behavior of Object.defineProperty() in JavaScript

A letter with no particular backstory

What's the point of the test set?

Has negative voting ever been officially implemented in elections, or seriously proposed, or even studied?

Co-worker has annoying ringtone

How many time has Arya actually used Needle?

How often does castling occur in grandmaster games?

Is there hard evidence that the grant peer review system performs significantly better than random?

What order were files/directories output in dir?

Does encoding missing data with fixed values help in classification?

1

$begingroup$

I have a lot of missing values for some variables in my data (70-80%). I have seen some people deal with missing values this way: encode the variable with missing values as 0 or 1. Where 0 is the value is missing and 1 as non missing.

I want to know if that technique is of any use, because I don't see any valuable information algorithm would able to pick from such variables. Also I am thinking of imputing them using mice but the problem is that in future use, we may not be able to get those variables with missing data, so the train and test set will have different number of columns

classification missing-data

share|improve this question

edited 4 mins ago

jcezarms

535

asked Jun 21 '17 at 7:27

Dhruv MahajanDhruv Mahajan

1788

$endgroup$

add a comment | 

1

$begingroup$

I have a lot of missing values for some variables in my data (70-80%). I have seen some people deal with missing values this way: encode the variable with missing values as 0 or 1. Where 0 is the value is missing and 1 as non missing.

I want to know if that technique is of any use, because I don't see any valuable information algorithm would able to pick from such variables. Also I am thinking of imputing them using mice but the problem is that in future use, we may not be able to get those variables with missing data, so the train and test set will have different number of columns

classification missing-data

share|improve this question

edited 4 mins ago

jcezarms

535

asked Jun 21 '17 at 7:27

Dhruv MahajanDhruv Mahajan

1788

$endgroup$

add a comment | 

$begingroup$

I have a lot of missing values for some variables in my data (70-80%). I have seen some people deal with missing values this way: encode the variable with missing values as 0 or 1. Where 0 is the value is missing and 1 as non missing.

I want to know if that technique is of any use, because I don't see any valuable information algorithm would able to pick from such variables. Also I am thinking of imputing them using mice but the problem is that in future use, we may not be able to get those variables with missing data, so the train and test set will have different number of columns

classification missing-data

share|improve this question

edited 4 mins ago

jcezarms

535

asked Jun 21 '17 at 7:27

Dhruv MahajanDhruv Mahajan

1788

$endgroup$

share|improve this question

edited 4 mins ago

jcezarms

535

asked Jun 21 '17 at 7:27

Dhruv MahajanDhruv Mahajan

1788

share|improve this question

edited 4 mins ago

jcezarms

535

asked Jun 21 '17 at 7:27

Dhruv MahajanDhruv Mahajan

1788

edited 4 mins ago

jcezarms

535

edited 4 mins ago

jcezarms

535

asked Jun 21 '17 at 7:27

Dhruv MahajanDhruv Mahajan

1788

asked Jun 21 '17 at 7:27

Dhruv MahajanDhruv Mahajan

1788

1 Answer
1

active

oldest

votes

1

$begingroup$

You can treat the mere presence of any value as signal - hence the 0 or 1.

What help this would be to your project depends on your dataset.

share|improve this answer

edited Jun 22 '17 at 17:17

answered Jun 21 '17 at 11:36

Jindra LackoJindra Lacko

16117

$endgroup$

add a comment | 

Your Answer

StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "557"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);

draft saved

draft discarded

Sign up or log in

StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);

Sign up using Google

Sign up using Facebook

Sign up using Email and Password

Post as a guest

Name

Email

Required, but never shown

StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f19870%2fdoes-encoding-missing-data-with-fixed-values-help-in-classification%23new-answer', 'question_page');

);

Post as a guest

Name

Email

Required, but never shown

1

$begingroup$

You can treat the mere presence of any value as signal - hence the 0 or 1.

What help this would be to your project depends on your dataset.

share|improve this answer

edited Jun 22 '17 at 17:17

answered Jun 21 '17 at 11:36

Jindra LackoJindra Lacko

16117

$endgroup$

add a comment | 

1

$begingroup$

You can treat the mere presence of any value as signal - hence the 0 or 1.

What help this would be to your project depends on your dataset.

share|improve this answer

edited Jun 22 '17 at 17:17

answered Jun 21 '17 at 11:36

Jindra LackoJindra Lacko

16117

$endgroup$

add a comment | 

$begingroup$

You can treat the mere presence of any value as signal - hence the 0 or 1.

What help this would be to your project depends on your dataset.

share|improve this answer

edited Jun 22 '17 at 17:17

answered Jun 21 '17 at 11:36

Jindra LackoJindra Lacko

16117

$endgroup$

share|improve this answer

edited Jun 22 '17 at 17:17

answered Jun 21 '17 at 11:36

Jindra LackoJindra Lacko

16117

answered Jun 21 '17 at 11:36

Jindra LackoJindra Lacko

16117

answered Jun 21 '17 at 11:36

Jindra LackoJindra Lacko

16117