Combining Classifiers with different Precision and Recall values2019 Community Moderator ElectionMeasuring performance of different classifiers with different sample sizesWhy are precision and recall used in the F1 score, rather than precision and NPV?How to create an ensemble that gives precedence to a specific classifierIs recall more important than precision for mass mailings?Binary classification, precision-recall curve and thresholdsPrecision and Recall if not binarySelect two best classifier using F1-score,Recall and precisionHow to get accuracy, F1, precision and recall, for a keras model?Why am I getting such a low precision after performing oversampling and undersampling?Loss function minimizing by pushing precision and recall to 0
Freedom of speech and where it applies
Golf game boilerplate
Can a Gentile theist be saved?
Lightning Web Component - do I need to track changes for every single input field in a form
Can I use my Chinese passport to enter China after I acquired another citizenship?
Do all polymers contain either carbon or silicon?
Should my PhD thesis be submitted under my legal name?
Perfect riffle shuffles
Is there a problem with hiding "forgot password" until it's needed?
Lifted its hind leg on or lifted its hind leg towards?
Is exact Kanji stroke length important?
Is there a good way to store credentials outside of a password manager?
Hostile work environment after whistle-blowing on coworker and our boss. What do I do?
Installing PowerShell on 32-bit Kali OS fails
My boss asked me to take a one-day class, then signs it up as a day off
A workplace installs custom certificates on personal devices, can this be used to decrypt HTTPS traffic?
Could solar power be utilized and substitute coal in the 19th century?
Can the harmonic series explain the origin of the major scale?
What (else) happened July 1st 1858 in London?
Bob has never been a M before
Simple image editor tool to draw a simple box/rectangle in an existing image
Can the electrostatic force be infinite in magnitude?
Was the picture area of a CRT a parallelogram (instead of a true rectangle)?
How can I raise concerns with a new DM about XP splitting?
Combining Classifiers with different Precision and Recall values
2019 Community Moderator ElectionMeasuring performance of different classifiers with different sample sizesWhy are precision and recall used in the F1 score, rather than precision and NPV?How to create an ensemble that gives precedence to a specific classifierIs recall more important than precision for mass mailings?Binary classification, precision-recall curve and thresholdsPrecision and Recall if not binarySelect two best classifier using F1-score,Recall and precisionHow to get accuracy, F1, precision and recall, for a keras model?Why am I getting such a low precision after performing oversampling and undersampling?Loss function minimizing by pushing precision and recall to 0
$begingroup$
Suppose I have two binary classifiers, A and B. Both are trained on the same set of data, and produce predictions on a different (but same for both classifiers) set of data. The precision for A is high and the recall is low, whereas the precision for B is low and the recall is high. Is there a way to combine these two models where I can get the precision from one and recall from the other, or possibly use the metrics from one to improve those of the other?
For example, let's say these are the metrics:
A
Precision: 0.91
Recall: 0.35
B
Precision: 0.43
Recall: 0.90
As these are binary classifiers, my labels are 1 and 0, and my class of interesting is 1 (so the metrics above are for predicting 1s).
Let's say model A predicts 10 1s, and model B predicts 70 1s.
It is safe for me to say that of the 10 1s that model A has predicted, 9 are true positives.
It is also safe for me to say that of the 70 1s that model B has predicted, 60% are false positives, but the rest are 90% of the true positives in the dataset.
My question is, is there some method for me to combine these results so that I can obtain all 50 true positives from the dataset?
machine-learning classification ensemble
$endgroup$
add a comment |
$begingroup$
Suppose I have two binary classifiers, A and B. Both are trained on the same set of data, and produce predictions on a different (but same for both classifiers) set of data. The precision for A is high and the recall is low, whereas the precision for B is low and the recall is high. Is there a way to combine these two models where I can get the precision from one and recall from the other, or possibly use the metrics from one to improve those of the other?
For example, let's say these are the metrics:
A
Precision: 0.91
Recall: 0.35
B
Precision: 0.43
Recall: 0.90
As these are binary classifiers, my labels are 1 and 0, and my class of interesting is 1 (so the metrics above are for predicting 1s).
Let's say model A predicts 10 1s, and model B predicts 70 1s.
It is safe for me to say that of the 10 1s that model A has predicted, 9 are true positives.
It is also safe for me to say that of the 70 1s that model B has predicted, 60% are false positives, but the rest are 90% of the true positives in the dataset.
My question is, is there some method for me to combine these results so that I can obtain all 50 true positives from the dataset?
machine-learning classification ensemble
$endgroup$
add a comment |
$begingroup$
Suppose I have two binary classifiers, A and B. Both are trained on the same set of data, and produce predictions on a different (but same for both classifiers) set of data. The precision for A is high and the recall is low, whereas the precision for B is low and the recall is high. Is there a way to combine these two models where I can get the precision from one and recall from the other, or possibly use the metrics from one to improve those of the other?
For example, let's say these are the metrics:
A
Precision: 0.91
Recall: 0.35
B
Precision: 0.43
Recall: 0.90
As these are binary classifiers, my labels are 1 and 0, and my class of interesting is 1 (so the metrics above are for predicting 1s).
Let's say model A predicts 10 1s, and model B predicts 70 1s.
It is safe for me to say that of the 10 1s that model A has predicted, 9 are true positives.
It is also safe for me to say that of the 70 1s that model B has predicted, 60% are false positives, but the rest are 90% of the true positives in the dataset.
My question is, is there some method for me to combine these results so that I can obtain all 50 true positives from the dataset?
machine-learning classification ensemble
$endgroup$
Suppose I have two binary classifiers, A and B. Both are trained on the same set of data, and produce predictions on a different (but same for both classifiers) set of data. The precision for A is high and the recall is low, whereas the precision for B is low and the recall is high. Is there a way to combine these two models where I can get the precision from one and recall from the other, or possibly use the metrics from one to improve those of the other?
For example, let's say these are the metrics:
A
Precision: 0.91
Recall: 0.35
B
Precision: 0.43
Recall: 0.90
As these are binary classifiers, my labels are 1 and 0, and my class of interesting is 1 (so the metrics above are for predicting 1s).
Let's say model A predicts 10 1s, and model B predicts 70 1s.
It is safe for me to say that of the 10 1s that model A has predicted, 9 are true positives.
It is also safe for me to say that of the 70 1s that model B has predicted, 60% are false positives, but the rest are 90% of the true positives in the dataset.
My question is, is there some method for me to combine these results so that I can obtain all 50 true positives from the dataset?
machine-learning classification ensemble
machine-learning classification ensemble
edited 13 mins ago
user8115948
asked 30 mins ago
user8115948user8115948
11
11
add a comment |
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function ()
return StackExchange.using("mathjaxEditing", function ()
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
);
);
, "mathjax-editing");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "557"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f47990%2fcombining-classifiers-with-different-precision-and-recall-values%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Data Science Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f47990%2fcombining-classifiers-with-different-precision-and-recall-values%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown