Very low probability in naive Bayes classifier 12019 Community Moderator ElectionHow does the naive Bayes classifier handle missing data in training?Kaggle Titanic Survival Table an example of Naive Bayes?Predicting New Data with Naive BayesSPARK, ML: Naive Bayes classifier often assigns 1 as probability predictionHandling underflow in a Gaussian Naive Bayes classifierNaive Bayes Should generate prediction given missing features (scikit learn)Overfitting Naive BayesWhat Naive Bayes method is being used in this example?Can you reduce many Naive Bayes training samples to a few big ones?Very low probability in naive Bayes classifier

Do infinite dimensional systems make sense?

What's the point of deactivating Num Lock on login screens?

Can you really stack all of this on an Opportunity Attack?

What typically incentivizes a professor to change jobs to a lower ranking university?

Modeling an IP Address

Does detail obscure or enhance action?

dbcc cleantable batch size explanation

Maximum likelihood parameters deviate from posterior distributions

How to move a thin line with the black arrow in Illustrator?

expand `ifthenelse` immediately

Theorems that impeded progress

Arrow those variables!

Can a vampire attack twice with their claws using Multiattack?

Which country benefited the most from UN Security Council vetoes?

how to check a propriety using r studio

Why does Kotter return in Welcome Back Kotter?

Why is consensus so controversial in Britain?

Replacing matching entries in one column of a file by another column from a different file

"You are your self first supporter", a more proper way to say it

Why is Minecraft giving an OpenGL error?

If human space travel is limited by the G force vulnerability, is there a way to counter G forces?

Why are electrically insulating heatsinks so rare? Is it just cost?

Why do I get two different answers for this counting problem?

Why can't we play rap on piano?



Very low probability in naive Bayes classifier 1



2019 Community Moderator ElectionHow does the naive Bayes classifier handle missing data in training?Kaggle Titanic Survival Table an example of Naive Bayes?Predicting New Data with Naive BayesSPARK, ML: Naive Bayes classifier often assigns 1 as probability predictionHandling underflow in a Gaussian Naive Bayes classifierNaive Bayes Should generate prediction given missing features (scikit learn)Overfitting Naive BayesWhat Naive Bayes method is being used in this example?Can you reduce many Naive Bayes training samples to a few big ones?Very low probability in naive Bayes classifier










0












$begingroup$


I have some training data (TRAIN) and some test data (TEST). Each row of each table contains an observed class (X) and some columns of binary (Y). I'm using a Python script that is intended to predict the probability (Pr) of X given Y in the test data based on the training data. It uses a Bernoulli naive Bayes classifier. Here is my script:



https://stackoverflow.com/questions/55187516/look-up-bernoullinb-probability-in-dataframe



It works on the dummy data that is included with the script.



On the real data, I know from experience which class some of the Y columns are indicative of. My script however is giving probability predictions like "1" where I don't think that the class is correct and "6e-77" on correct classes.



Any advice on what I can try please?










share|improve this question







New contributor




R. Cox is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.







$endgroup$
















    0












    $begingroup$


    I have some training data (TRAIN) and some test data (TEST). Each row of each table contains an observed class (X) and some columns of binary (Y). I'm using a Python script that is intended to predict the probability (Pr) of X given Y in the test data based on the training data. It uses a Bernoulli naive Bayes classifier. Here is my script:



    https://stackoverflow.com/questions/55187516/look-up-bernoullinb-probability-in-dataframe



    It works on the dummy data that is included with the script.



    On the real data, I know from experience which class some of the Y columns are indicative of. My script however is giving probability predictions like "1" where I don't think that the class is correct and "6e-77" on correct classes.



    Any advice on what I can try please?










    share|improve this question







    New contributor




    R. Cox is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
    Check out our Code of Conduct.







    $endgroup$














      0












      0








      0





      $begingroup$


      I have some training data (TRAIN) and some test data (TEST). Each row of each table contains an observed class (X) and some columns of binary (Y). I'm using a Python script that is intended to predict the probability (Pr) of X given Y in the test data based on the training data. It uses a Bernoulli naive Bayes classifier. Here is my script:



      https://stackoverflow.com/questions/55187516/look-up-bernoullinb-probability-in-dataframe



      It works on the dummy data that is included with the script.



      On the real data, I know from experience which class some of the Y columns are indicative of. My script however is giving probability predictions like "1" where I don't think that the class is correct and "6e-77" on correct classes.



      Any advice on what I can try please?










      share|improve this question







      New contributor




      R. Cox is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.







      $endgroup$




      I have some training data (TRAIN) and some test data (TEST). Each row of each table contains an observed class (X) and some columns of binary (Y). I'm using a Python script that is intended to predict the probability (Pr) of X given Y in the test data based on the training data. It uses a Bernoulli naive Bayes classifier. Here is my script:



      https://stackoverflow.com/questions/55187516/look-up-bernoullinb-probability-in-dataframe



      It works on the dummy data that is included with the script.



      On the real data, I know from experience which class some of the Y columns are indicative of. My script however is giving probability predictions like "1" where I don't think that the class is correct and "6e-77" on correct classes.



      Any advice on what I can try please?







      machine-learning prediction probability naive-bayes-classifier






      share|improve this question







      New contributor




      R. Cox is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.











      share|improve this question







      New contributor




      R. Cox is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.









      share|improve this question




      share|improve this question






      New contributor




      R. Cox is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.









      asked 5 hours ago









      R. CoxR. Cox

      1




      1




      New contributor




      R. Cox is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.





      New contributor





      R. Cox is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.






      R. Cox is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.




















          0






          active

          oldest

          votes












          Your Answer





          StackExchange.ifUsing("editor", function ()
          return StackExchange.using("mathjaxEditing", function ()
          StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
          StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
          );
          );
          , "mathjax-editing");

          StackExchange.ready(function()
          var channelOptions =
          tags: "".split(" "),
          id: "557"
          ;
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function()
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled)
          StackExchange.using("snippets", function()
          createEditor();
          );

          else
          createEditor();

          );

          function createEditor()
          StackExchange.prepareEditor(
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: false,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: null,
          bindNavPrevention: true,
          postfix: "",
          imageUploader:
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          ,
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          );



          );






          R. Cox is a new contributor. Be nice, and check out our Code of Conduct.









          draft saved

          draft discarded


















          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f48701%2fvery-low-probability-in-naive-bayes-classifier-1%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown

























          0






          active

          oldest

          votes








          0






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes








          R. Cox is a new contributor. Be nice, and check out our Code of Conduct.









          draft saved

          draft discarded


















          R. Cox is a new contributor. Be nice, and check out our Code of Conduct.












          R. Cox is a new contributor. Be nice, and check out our Code of Conduct.











          R. Cox is a new contributor. Be nice, and check out our Code of Conduct.














          Thanks for contributing an answer to Data Science Stack Exchange!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid


          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.

          Use MathJax to format equations. MathJax reference.


          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f48701%2fvery-low-probability-in-naive-bayes-classifier-1%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown