Very low probability in naive Bayes classifier 12019 Community Moderator ElectionHow does the naive Bayes classifier handle missing data in training?Kaggle Titanic Survival Table an example of Naive Bayes?Predicting New Data with Naive BayesSPARK, ML: Naive Bayes classifier often assigns 1 as probability predictionHandling underflow in a Gaussian Naive Bayes classifierNaive Bayes Should generate prediction given missing features (scikit learn)Overfitting Naive BayesWhat Naive Bayes method is being used in this example?Can you reduce many Naive Bayes training samples to a few big ones?Very low probability in naive Bayes classifier

Do infinite dimensional systems make sense?

What's the point of deactivating Num Lock on login screens?

Can you really stack all of this on an Opportunity Attack?

What typically incentivizes a professor to change jobs to a lower ranking university?

Modeling an IP Address

Does detail obscure or enhance action?

dbcc cleantable batch size explanation

Maximum likelihood parameters deviate from posterior distributions

How to move a thin line with the black arrow in Illustrator?

expand `ifthenelse` immediately

Theorems that impeded progress

Arrow those variables!

Can a vampire attack twice with their claws using Multiattack?

Which country benefited the most from UN Security Council vetoes?

how to check a propriety using r studio

Why does Kotter return in Welcome Back Kotter?

Why is consensus so controversial in Britain?

Replacing matching entries in one column of a file by another column from a different file

"You are your self first supporter", a more proper way to say it

Why is Minecraft giving an OpenGL error?

If human space travel is limited by the G force vulnerability, is there a way to counter G forces?

Why are electrically insulating heatsinks so rare? Is it just cost?

Why do I get two different answers for this counting problem?

Why can't we play rap on piano?



Very low probability in naive Bayes classifier 1



2019 Community Moderator ElectionHow does the naive Bayes classifier handle missing data in training?Kaggle Titanic Survival Table an example of Naive Bayes?Predicting New Data with Naive BayesSPARK, ML: Naive Bayes classifier often assigns 1 as probability predictionHandling underflow in a Gaussian Naive Bayes classifierNaive Bayes Should generate prediction given missing features (scikit learn)Overfitting Naive BayesWhat Naive Bayes method is being used in this example?Can you reduce many Naive Bayes training samples to a few big ones?Very low probability in naive Bayes classifier










0












$begingroup$


I have some training data (TRAIN) and some test data (TEST). Each row of each table contains an observed class (X) and some columns of binary (Y). I'm using a Python script that is intended to predict the probability (Pr) of X given Y in the test data based on the training data. It uses a Bernoulli naive Bayes classifier. Here is my script:



https://stackoverflow.com/questions/55187516/look-up-bernoullinb-probability-in-dataframe



It works on the dummy data that is included with the script.



On the real data, I know from experience which class some of the Y columns are indicative of. My script however is giving probability predictions like "1" where I don't think that the class is correct and "6e-77" on correct classes.



Any advice on what I can try please?










share|improve this question







New contributor




R. Cox is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.







$endgroup$
















    0












    $begingroup$


    I have some training data (TRAIN) and some test data (TEST). Each row of each table contains an observed class (X) and some columns of binary (Y). I'm using a Python script that is intended to predict the probability (Pr) of X given Y in the test data based on the training data. It uses a Bernoulli naive Bayes classifier. Here is my script:



    https://stackoverflow.com/questions/55187516/look-up-bernoullinb-probability-in-dataframe



    It works on the dummy data that is included with the script.



    On the real data, I know from experience which class some of the Y columns are indicative of. My script however is giving probability predictions like "1" where I don't think that the class is correct and "6e-77" on correct classes.



    Any advice on what I can try please?










    share|improve this question







    New contributor




    R. Cox is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
    Check out our Code of Conduct.







    $endgroup$














      0












      0








      0





      $begingroup$


      I have some training data (TRAIN) and some test data (TEST). Each row of each table contains an observed class (X) and some columns of binary (Y). I'm using a Python script that is intended to predict the probability (Pr) of X given Y in the test data based on the training data. It uses a Bernoulli naive Bayes classifier. Here is my script:



      https://stackoverflow.com/questions/55187516/look-up-bernoullinb-probability-in-dataframe



      It works on the dummy data that is included with the script.



      On the real data, I know from experience which class some of the Y columns are indicative of. My script however is giving probability predictions like "1" where I don't think that the class is correct and "6e-77" on correct classes.



      Any advice on what I can try please?










      share|improve this question







      New contributor




      R. Cox is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.







      $endgroup$




      I have some training data (TRAIN) and some test data (TEST). Each row of each table contains an observed class (X) and some columns of binary (Y). I'm using a Python script that is intended to predict the probability (Pr) of X given Y in the test data based on the training data. It uses a Bernoulli naive Bayes classifier. Here is my script:



      https://stackoverflow.com/questions/55187516/look-up-bernoullinb-probability-in-dataframe



      It works on the dummy data that is included with the script.



      On the real data, I know from experience which class some of the Y columns are indicative of. My script however is giving probability predictions like "1" where I don't think that the class is correct and "6e-77" on correct classes.



      Any advice on what I can try please?







      machine-learning prediction probability naive-bayes-classifier






      share|improve this question







      New contributor




      R. Cox is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.











      share|improve this question







      New contributor




      R. Cox is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.









      share|improve this question




      share|improve this question






      New contributor




      R. Cox is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.









      asked 5 hours ago









      R. CoxR. Cox

      1




      1




      New contributor




      R. Cox is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.





      New contributor





      R. Cox is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.






      R. Cox is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.




















          0






          active

          oldest

          votes












          Your Answer





          StackExchange.ifUsing("editor", function ()
          return StackExchange.using("mathjaxEditing", function ()
          StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
          StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
          );
          );
          , "mathjax-editing");

          StackExchange.ready(function()
          var channelOptions =
          tags: "".split(" "),
          id: "557"
          ;
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function()
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled)
          StackExchange.using("snippets", function()
          createEditor();
          );

          else
          createEditor();

          );

          function createEditor()
          StackExchange.prepareEditor(
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: false,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: null,
          bindNavPrevention: true,
          postfix: "",
          imageUploader:
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          ,
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          );



          );






          R. Cox is a new contributor. Be nice, and check out our Code of Conduct.









          draft saved

          draft discarded


















          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f48701%2fvery-low-probability-in-naive-bayes-classifier-1%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown

























          0






          active

          oldest

          votes








          0






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes








          R. Cox is a new contributor. Be nice, and check out our Code of Conduct.









          draft saved

          draft discarded


















          R. Cox is a new contributor. Be nice, and check out our Code of Conduct.












          R. Cox is a new contributor. Be nice, and check out our Code of Conduct.











          R. Cox is a new contributor. Be nice, and check out our Code of Conduct.














          Thanks for contributing an answer to Data Science Stack Exchange!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid


          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.

          Use MathJax to format equations. MathJax reference.


          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f48701%2fvery-low-probability-in-naive-bayes-classifier-1%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          Ружовы пелікан Змест Знешні выгляд | Пашырэнне | Асаблівасці біялогіі | Літаратура | НавігацыяДагледжаная версіяправерана1 зменаДагледжаная версіяправерана1 змена/ 22697590 Сістэматыкана ВіківідахВыявына Вікісховішчы174693363011049382

          ValueError: Error when checking input: expected conv2d_13_input to have shape (3, 150, 150) but got array with shape (150, 150, 3)2019 Community Moderator ElectionError when checking : expected dense_1_input to have shape (None, 5) but got array with shape (200, 1)Error 'Expected 2D array, got 1D array instead:'ValueError: Error when checking input: expected lstm_41_input to have 3 dimensions, but got array with shape (40000,100)ValueError: Error when checking target: expected dense_1 to have shape (7,) but got array with shape (1,)ValueError: Error when checking target: expected dense_2 to have shape (1,) but got array with shape (0,)Keras exception: ValueError: Error when checking input: expected conv2d_1_input to have shape (150, 150, 3) but got array with shape (256, 256, 3)Steps taking too long to completewhen checking input: expected dense_1_input to have shape (13328,) but got array with shape (317,)ValueError: Error when checking target: expected dense_3 to have shape (None, 1) but got array with shape (7715, 40000)Keras exception: Error when checking input: expected dense_input to have shape (2,) but got array with shape (1,)

          Illegal assignment from SObject to ContactFetching String, Id from Map - Illegal Assignment Id to Field / ObjectError: Compile Error: Illegal assignment from String to BooleanError: List has no rows for assignment to SObjectError on Test Class - System.QueryException: List has no rows for assignment to SObjectRemote action problemDML requires SObject or SObject list type error“Illegal assignment from List to List”Test Class Fail: Batch Class: System.QueryException: List has no rows for assignment to SObjectMapping to a user'List has no rows for assignment to SObject' Mystery