Bayes factor vs P value Unicorn Meta Zoo #1: Why another podcast? Announcing the arrival of Valued Associate #679: Cesar ManaraWhen should I be worried about the Jeffreys-Lindley paradox in Bayesian model choice?Bayesian analysis and Lindley's paradox?Do Bayes factors require multiple comparison correction?When does it make sense to reject/accept an hypothesis?Why are 0.05 < p < 0.95 results called false positives?Marginal Likelihoods for Bayes Factors with Multiple Discrete HypothesisIs p-value essentially useless and dangerous to use?Are smaller p-values more convincing?Interpreting Granger Causality F-testBayes factor (B) vs p-values: sensitive (H0/H1) vs insensitive dataWald test and LRT arriving at different conclusionsCompute Bayesian Probability

How to not starve gigantic beasts

Is Electric Central Heating worth it if using Solar Panels?

Israeli soda type drink

Raising a bilingual kid. When should we introduce the majority language?

With indentation set to `0em`, when using a line break, there is still an indentation of a size of a space

As an international instructor, should I openly talk about my accent?

Are there moral objections to a life motivated purely by money? How to sway a person from this lifestyle?

I preordered a game on my Xbox while on the home screen of my friend's account. Which of us owns the game?

Is it acceptable to use working hours to read general interest books?

Expansion//Explosion and Siren Stormtamer

Does Feeblemind produce an ongoing magical effect that can be dispelled?

What’s with the clanks in Endgame?

Why did Israel vote against lifting the American embargo on Cuba?

"Rubric" as meaning "signature" or "personal mark" -- is this accepted usage?

"Whatever a Russian does, they end up making the Kalashnikov gun"? Are there any similar proverbs in English?

Holes in ElementMesh with ToElementMesh of ImplicitRegion

Could Neutrino technically as side-effect, incentivize centralization of the bitcoin network?

How to use @AuraEnabled base class method in Lightning Component?

Why isn't everyone flabbergasted about Bran's "gift"?

Multiple options vs single option UI

Multiple fireplaces in an apartment building?

Is Diceware more secure than a long passphrase?

How to get even lighting when using flash for group photos near wall?

How would this chord from "Rocket Man" be analyzed?



Bayes factor vs P value



Unicorn Meta Zoo #1: Why another podcast?
Announcing the arrival of Valued Associate #679: Cesar ManaraWhen should I be worried about the Jeffreys-Lindley paradox in Bayesian model choice?Bayesian analysis and Lindley's paradox?Do Bayes factors require multiple comparison correction?When does it make sense to reject/accept an hypothesis?Why are 0.05 < p < 0.95 results called false positives?Marginal Likelihoods for Bayes Factors with Multiple Discrete HypothesisIs p-value essentially useless and dangerous to use?Are smaller p-values more convincing?Interpreting Granger Causality F-testBayes factor (B) vs p-values: sensitive (H0/H1) vs insensitive dataWald test and LRT arriving at different conclusionsCompute Bayesian Probability



.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;








3












$begingroup$


I am trying to understand Bayes Factor (BF). I believe they are like likelihood ratio of 2 hypotheses. So if BF is 5, it means H1 is 5 times more likely than H0. And value of 3-10 indicates moderate evidence, while >10 indicates strong evidence.



However, for P-value, traditionally 0.05 is taken as cut-off. At this P value, H1/H0 likelihood should be 95/5 or 19.



So why a cut-off of >3 is taken for BF while a cut-off of >19 is taken for P values? These values are not anywhere close either.



I may be missing something very basic since I am a beginner in this area.










share|cite|improve this question











$endgroup$


















    3












    $begingroup$


    I am trying to understand Bayes Factor (BF). I believe they are like likelihood ratio of 2 hypotheses. So if BF is 5, it means H1 is 5 times more likely than H0. And value of 3-10 indicates moderate evidence, while >10 indicates strong evidence.



    However, for P-value, traditionally 0.05 is taken as cut-off. At this P value, H1/H0 likelihood should be 95/5 or 19.



    So why a cut-off of >3 is taken for BF while a cut-off of >19 is taken for P values? These values are not anywhere close either.



    I may be missing something very basic since I am a beginner in this area.










    share|cite|improve this question











    $endgroup$














      3












      3








      3





      $begingroup$


      I am trying to understand Bayes Factor (BF). I believe they are like likelihood ratio of 2 hypotheses. So if BF is 5, it means H1 is 5 times more likely than H0. And value of 3-10 indicates moderate evidence, while >10 indicates strong evidence.



      However, for P-value, traditionally 0.05 is taken as cut-off. At this P value, H1/H0 likelihood should be 95/5 or 19.



      So why a cut-off of >3 is taken for BF while a cut-off of >19 is taken for P values? These values are not anywhere close either.



      I may be missing something very basic since I am a beginner in this area.










      share|cite|improve this question











      $endgroup$




      I am trying to understand Bayes Factor (BF). I believe they are like likelihood ratio of 2 hypotheses. So if BF is 5, it means H1 is 5 times more likely than H0. And value of 3-10 indicates moderate evidence, while >10 indicates strong evidence.



      However, for P-value, traditionally 0.05 is taken as cut-off. At this P value, H1/H0 likelihood should be 95/5 or 19.



      So why a cut-off of >3 is taken for BF while a cut-off of >19 is taken for P values? These values are not anywhere close either.



      I may be missing something very basic since I am a beginner in this area.







      hypothesis-testing bayesian p-value






      share|cite|improve this question















      share|cite|improve this question













      share|cite|improve this question




      share|cite|improve this question








      edited 2 hours ago







      rnso

















      asked 3 hours ago









      rnsornso

      4,067103168




      4,067103168




















          2 Answers
          2






          active

          oldest

          votes


















          3












          $begingroup$

          A few things:



          The BF gives you evidence in favor of a hypothesis, while a frequentist hypothesis test gives you evidence against a (null) hypothesis. So it's kind of "apples to oranges."



          These two procedures, despite the difference in interpretations, may lead to different decisions. For example, a BF might reject while a frequentist hypothesis test doesn't, or vice versa. This problem is often referred to as the Jeffreys-Lindley's paradox. There have been many posts on this site about this; see e.g. here, and here.



          "At this P value, H1/H0 likelihood should be 95/5 or 19." No, this isn't true because, roughly $p(y mid H_1) neq 1- p(y mid H_0)$. Computing a p-value and performing a frequentist test, at a minimum, does not require you to have any idea about $p(y mid H_1)$. Also, p-values are often integrals/sums of densities/pmfs, while a BF doesn't integrate over the data sample space.






          share|cite|improve this answer











          $endgroup$












          • $begingroup$
            Thanks for your insight. However, if evidence in favor of a hypothesis is apple, I think evidence for alternate hypothesis can be inverted apple but not orange! Also, what would you say is approximate Bayes Factor value corresponding to P=0.05?
            $endgroup$
            – rnso
            1 hour ago



















          0












          $begingroup$

          The Bayes factor $B_01$ can be turned into a probability under equal weights as
          $$P_01=frac11+frac1large B_01$$but this does not make them comparable with a $p$-value since




          1. $P_01$ is a probability in the parameter space, not in the sampling space

          2. its value and range depend on the choice of the prior measure, they are thus relative rather than absolute

          3. both $B_01$ and $P_01$ contain a penalty for complexity (Occam's razor) by integrating out over the parameter space

          If you wish to consider a Bayesian equivalent to the $p$-value, the posterior predictive $p$-value (Meng, 1994) should be investigated
          $$Q_01=mathbb P(B_01(X)le B_01(x^textobs))$$
          where $x^textobs$ denotes the observation and $X$ is distributed from the posterior predictive
          $$Xsim int_Theta f(x|theta) pi(theta|x^textobs),textdtheta$$
          but this does not imply that the same "default" criteria for rejection and significance should apply to this object.






          share|cite|improve this answer









          $endgroup$













            Your Answer








            StackExchange.ready(function()
            var channelOptions =
            tags: "".split(" "),
            id: "65"
            ;
            initTagRenderer("".split(" "), "".split(" "), channelOptions);

            StackExchange.using("externalEditor", function()
            // Have to fire editor after snippets, if snippets enabled
            if (StackExchange.settings.snippets.snippetsEnabled)
            StackExchange.using("snippets", function()
            createEditor();
            );

            else
            createEditor();

            );

            function createEditor()
            StackExchange.prepareEditor(
            heartbeatType: 'answer',
            autoActivateHeartbeat: false,
            convertImagesToLinks: false,
            noModals: true,
            showLowRepImageUploadWarning: true,
            reputationToPostImages: null,
            bindNavPrevention: true,
            postfix: "",
            imageUploader:
            brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
            contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
            allowUrls: true
            ,
            onDemand: true,
            discardSelector: ".discard-answer"
            ,immediatelyShowMarkdownHelp:true
            );



            );













            draft saved

            draft discarded


















            StackExchange.ready(
            function ()
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f404933%2fbayes-factor-vs-p-value%23new-answer', 'question_page');

            );

            Post as a guest















            Required, but never shown

























            2 Answers
            2






            active

            oldest

            votes








            2 Answers
            2






            active

            oldest

            votes









            active

            oldest

            votes






            active

            oldest

            votes









            3












            $begingroup$

            A few things:



            The BF gives you evidence in favor of a hypothesis, while a frequentist hypothesis test gives you evidence against a (null) hypothesis. So it's kind of "apples to oranges."



            These two procedures, despite the difference in interpretations, may lead to different decisions. For example, a BF might reject while a frequentist hypothesis test doesn't, or vice versa. This problem is often referred to as the Jeffreys-Lindley's paradox. There have been many posts on this site about this; see e.g. here, and here.



            "At this P value, H1/H0 likelihood should be 95/5 or 19." No, this isn't true because, roughly $p(y mid H_1) neq 1- p(y mid H_0)$. Computing a p-value and performing a frequentist test, at a minimum, does not require you to have any idea about $p(y mid H_1)$. Also, p-values are often integrals/sums of densities/pmfs, while a BF doesn't integrate over the data sample space.






            share|cite|improve this answer











            $endgroup$












            • $begingroup$
              Thanks for your insight. However, if evidence in favor of a hypothesis is apple, I think evidence for alternate hypothesis can be inverted apple but not orange! Also, what would you say is approximate Bayes Factor value corresponding to P=0.05?
              $endgroup$
              – rnso
              1 hour ago
















            3












            $begingroup$

            A few things:



            The BF gives you evidence in favor of a hypothesis, while a frequentist hypothesis test gives you evidence against a (null) hypothesis. So it's kind of "apples to oranges."



            These two procedures, despite the difference in interpretations, may lead to different decisions. For example, a BF might reject while a frequentist hypothesis test doesn't, or vice versa. This problem is often referred to as the Jeffreys-Lindley's paradox. There have been many posts on this site about this; see e.g. here, and here.



            "At this P value, H1/H0 likelihood should be 95/5 or 19." No, this isn't true because, roughly $p(y mid H_1) neq 1- p(y mid H_0)$. Computing a p-value and performing a frequentist test, at a minimum, does not require you to have any idea about $p(y mid H_1)$. Also, p-values are often integrals/sums of densities/pmfs, while a BF doesn't integrate over the data sample space.






            share|cite|improve this answer











            $endgroup$












            • $begingroup$
              Thanks for your insight. However, if evidence in favor of a hypothesis is apple, I think evidence for alternate hypothesis can be inverted apple but not orange! Also, what would you say is approximate Bayes Factor value corresponding to P=0.05?
              $endgroup$
              – rnso
              1 hour ago














            3












            3








            3





            $begingroup$

            A few things:



            The BF gives you evidence in favor of a hypothesis, while a frequentist hypothesis test gives you evidence against a (null) hypothesis. So it's kind of "apples to oranges."



            These two procedures, despite the difference in interpretations, may lead to different decisions. For example, a BF might reject while a frequentist hypothesis test doesn't, or vice versa. This problem is often referred to as the Jeffreys-Lindley's paradox. There have been many posts on this site about this; see e.g. here, and here.



            "At this P value, H1/H0 likelihood should be 95/5 or 19." No, this isn't true because, roughly $p(y mid H_1) neq 1- p(y mid H_0)$. Computing a p-value and performing a frequentist test, at a minimum, does not require you to have any idea about $p(y mid H_1)$. Also, p-values are often integrals/sums of densities/pmfs, while a BF doesn't integrate over the data sample space.






            share|cite|improve this answer











            $endgroup$



            A few things:



            The BF gives you evidence in favor of a hypothesis, while a frequentist hypothesis test gives you evidence against a (null) hypothesis. So it's kind of "apples to oranges."



            These two procedures, despite the difference in interpretations, may lead to different decisions. For example, a BF might reject while a frequentist hypothesis test doesn't, or vice versa. This problem is often referred to as the Jeffreys-Lindley's paradox. There have been many posts on this site about this; see e.g. here, and here.



            "At this P value, H1/H0 likelihood should be 95/5 or 19." No, this isn't true because, roughly $p(y mid H_1) neq 1- p(y mid H_0)$. Computing a p-value and performing a frequentist test, at a minimum, does not require you to have any idea about $p(y mid H_1)$. Also, p-values are often integrals/sums of densities/pmfs, while a BF doesn't integrate over the data sample space.







            share|cite|improve this answer














            share|cite|improve this answer



            share|cite|improve this answer








            edited 21 mins ago









            Xi'an

            59.8k897369




            59.8k897369










            answered 2 hours ago









            TaylorTaylor

            12.7k21946




            12.7k21946











            • $begingroup$
              Thanks for your insight. However, if evidence in favor of a hypothesis is apple, I think evidence for alternate hypothesis can be inverted apple but not orange! Also, what would you say is approximate Bayes Factor value corresponding to P=0.05?
              $endgroup$
              – rnso
              1 hour ago

















            • $begingroup$
              Thanks for your insight. However, if evidence in favor of a hypothesis is apple, I think evidence for alternate hypothesis can be inverted apple but not orange! Also, what would you say is approximate Bayes Factor value corresponding to P=0.05?
              $endgroup$
              – rnso
              1 hour ago
















            $begingroup$
            Thanks for your insight. However, if evidence in favor of a hypothesis is apple, I think evidence for alternate hypothesis can be inverted apple but not orange! Also, what would you say is approximate Bayes Factor value corresponding to P=0.05?
            $endgroup$
            – rnso
            1 hour ago





            $begingroup$
            Thanks for your insight. However, if evidence in favor of a hypothesis is apple, I think evidence for alternate hypothesis can be inverted apple but not orange! Also, what would you say is approximate Bayes Factor value corresponding to P=0.05?
            $endgroup$
            – rnso
            1 hour ago














            0












            $begingroup$

            The Bayes factor $B_01$ can be turned into a probability under equal weights as
            $$P_01=frac11+frac1large B_01$$but this does not make them comparable with a $p$-value since




            1. $P_01$ is a probability in the parameter space, not in the sampling space

            2. its value and range depend on the choice of the prior measure, they are thus relative rather than absolute

            3. both $B_01$ and $P_01$ contain a penalty for complexity (Occam's razor) by integrating out over the parameter space

            If you wish to consider a Bayesian equivalent to the $p$-value, the posterior predictive $p$-value (Meng, 1994) should be investigated
            $$Q_01=mathbb P(B_01(X)le B_01(x^textobs))$$
            where $x^textobs$ denotes the observation and $X$ is distributed from the posterior predictive
            $$Xsim int_Theta f(x|theta) pi(theta|x^textobs),textdtheta$$
            but this does not imply that the same "default" criteria for rejection and significance should apply to this object.






            share|cite|improve this answer









            $endgroup$

















              0












              $begingroup$

              The Bayes factor $B_01$ can be turned into a probability under equal weights as
              $$P_01=frac11+frac1large B_01$$but this does not make them comparable with a $p$-value since




              1. $P_01$ is a probability in the parameter space, not in the sampling space

              2. its value and range depend on the choice of the prior measure, they are thus relative rather than absolute

              3. both $B_01$ and $P_01$ contain a penalty for complexity (Occam's razor) by integrating out over the parameter space

              If you wish to consider a Bayesian equivalent to the $p$-value, the posterior predictive $p$-value (Meng, 1994) should be investigated
              $$Q_01=mathbb P(B_01(X)le B_01(x^textobs))$$
              where $x^textobs$ denotes the observation and $X$ is distributed from the posterior predictive
              $$Xsim int_Theta f(x|theta) pi(theta|x^textobs),textdtheta$$
              but this does not imply that the same "default" criteria for rejection and significance should apply to this object.






              share|cite|improve this answer









              $endgroup$















                0












                0








                0





                $begingroup$

                The Bayes factor $B_01$ can be turned into a probability under equal weights as
                $$P_01=frac11+frac1large B_01$$but this does not make them comparable with a $p$-value since




                1. $P_01$ is a probability in the parameter space, not in the sampling space

                2. its value and range depend on the choice of the prior measure, they are thus relative rather than absolute

                3. both $B_01$ and $P_01$ contain a penalty for complexity (Occam's razor) by integrating out over the parameter space

                If you wish to consider a Bayesian equivalent to the $p$-value, the posterior predictive $p$-value (Meng, 1994) should be investigated
                $$Q_01=mathbb P(B_01(X)le B_01(x^textobs))$$
                where $x^textobs$ denotes the observation and $X$ is distributed from the posterior predictive
                $$Xsim int_Theta f(x|theta) pi(theta|x^textobs),textdtheta$$
                but this does not imply that the same "default" criteria for rejection and significance should apply to this object.






                share|cite|improve this answer









                $endgroup$



                The Bayes factor $B_01$ can be turned into a probability under equal weights as
                $$P_01=frac11+frac1large B_01$$but this does not make them comparable with a $p$-value since




                1. $P_01$ is a probability in the parameter space, not in the sampling space

                2. its value and range depend on the choice of the prior measure, they are thus relative rather than absolute

                3. both $B_01$ and $P_01$ contain a penalty for complexity (Occam's razor) by integrating out over the parameter space

                If you wish to consider a Bayesian equivalent to the $p$-value, the posterior predictive $p$-value (Meng, 1994) should be investigated
                $$Q_01=mathbb P(B_01(X)le B_01(x^textobs))$$
                where $x^textobs$ denotes the observation and $X$ is distributed from the posterior predictive
                $$Xsim int_Theta f(x|theta) pi(theta|x^textobs),textdtheta$$
                but this does not imply that the same "default" criteria for rejection and significance should apply to this object.







                share|cite|improve this answer












                share|cite|improve this answer



                share|cite|improve this answer










                answered 10 mins ago









                Xi'anXi'an

                59.8k897369




                59.8k897369



























                    draft saved

                    draft discarded
















































                    Thanks for contributing an answer to Cross Validated!


                    • Please be sure to answer the question. Provide details and share your research!

                    But avoid


                    • Asking for help, clarification, or responding to other answers.

                    • Making statements based on opinion; back them up with references or personal experience.

                    Use MathJax to format equations. MathJax reference.


                    To learn more, see our tips on writing great answers.




                    draft saved


                    draft discarded














                    StackExchange.ready(
                    function ()
                    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f404933%2fbayes-factor-vs-p-value%23new-answer', 'question_page');

                    );

                    Post as a guest















                    Required, but never shown





















































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown

































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown







                    Popular posts from this blog

                    ValueError: Error when checking input: expected conv2d_13_input to have shape (3, 150, 150) but got array with shape (150, 150, 3)2019 Community Moderator ElectionError when checking : expected dense_1_input to have shape (None, 5) but got array with shape (200, 1)Error 'Expected 2D array, got 1D array instead:'ValueError: Error when checking input: expected lstm_41_input to have 3 dimensions, but got array with shape (40000,100)ValueError: Error when checking target: expected dense_1 to have shape (7,) but got array with shape (1,)ValueError: Error when checking target: expected dense_2 to have shape (1,) but got array with shape (0,)Keras exception: ValueError: Error when checking input: expected conv2d_1_input to have shape (150, 150, 3) but got array with shape (256, 256, 3)Steps taking too long to completewhen checking input: expected dense_1_input to have shape (13328,) but got array with shape (317,)ValueError: Error when checking target: expected dense_3 to have shape (None, 1) but got array with shape (7715, 40000)Keras exception: Error when checking input: expected dense_input to have shape (2,) but got array with shape (1,)

                    Ружовы пелікан Змест Знешні выгляд | Пашырэнне | Асаблівасці біялогіі | Літаратура | НавігацыяДагледжаная версіяправерана1 зменаДагледжаная версіяправерана1 змена/ 22697590 Сістэматыкана ВіківідахВыявына Вікісховішчы174693363011049382

                    Illegal assignment from SObject to ContactFetching String, Id from Map - Illegal Assignment Id to Field / ObjectError: Compile Error: Illegal assignment from String to BooleanError: List has no rows for assignment to SObjectError on Test Class - System.QueryException: List has no rows for assignment to SObjectRemote action problemDML requires SObject or SObject list type error“Illegal assignment from List to List”Test Class Fail: Batch Class: System.QueryException: List has no rows for assignment to SObjectMapping to a user'List has no rows for assignment to SObject' Mystery