What is the 'Bayes' Theorem'

Bayes' theorem, named after 18th-century British mathematician Thomas Bayes, is a mathematical formula for determining conditional probability. The theorem provides a way to revise existing predictions or theories given new or additional evidence. In finance, Bayes' theorem can be used to rate the risk of lending money to potential borrowers.

The formula is as follows:

Bayes' theorem is also called Bayes' Rule or Bayes' Law.

BREAKING DOWN 'Bayes' Theorem'

Applications of the theorem are widespread and not limited to the financial realm. As an example, Bayes' theorem can be used to determine the accuracy of medical test results by taking into consideration how likely any given person is to have a disease and the general accuracy of the test.

Bayes' theorem gives the probability of an event based on information that is or may be related to that event. The formula can be used to see how the probability of an event occurring is affected by new information, supposing the new information is true. For example, say a single card is drawn from a complete deck of 52 cards. The probability that the card is a king is 4 divided by 52, which equals 1/13 or approximately 7.69%. Remember that there are 4 kings in the deck. Now, suppose it is revealed that the selected card is a face card. The probability the selected card is a king, given it is a face card, is 4 divided by 12, or approximately 33.3%, as there are 12 face cards in a deck.

Deriving Bayes' Theorem Formula

Bayes' theorem follows simply from the axioms of conditional probability. Conditional probability is the probability of an event given that another event occurred. For example, a simple probability question may be "What is the probability of Amazon.com, Inc., (AMZN) stock price falling?" Conditional probability takes this question a step further by asking "What is the probability of AMZN stock price falling given that the Dow Jones Industrial Average (DJIA) index fell earlier?"

The conditional probability of A given that B has happened can be expressed as:

P(A|B) = P(A and B) / P(B) = P(A∩B) / P(B)

If A is AMZN price falls and B is DJIA is already down, then the conditional probability expression reads as "the probability that AMZN drops given a DJIA decline is equal to the probability that AMZN price declines and DJIA declines over the probability of a decrease in the DJIA index.

then, P(A|B) = [P(A) x P(B|A)] / P(B).

Where P(A) and P(B) are the probabilities of A and B without regard to each other.

P(B|A) is the probability that B will occur given A is true.

Finally, P(A|B) is the conditional probability of A occurring given B is true.

The formula explains the relationship between the probability of the hypothesis before getting the evidence P(A) and the probability of the hypothesis after getting the evidence P(A|B), given a hypothesis A and evidence B.

As another example, imagine there is a drug test that is 98% accurate, meaning 98% of the time it shows a true positive result for someone using the drug and 98% of the time it shows a true negative result for nonusers of the drug. Next, assume 0.5% of people use the drug. If a person selected at random tests positive for the drug, the following calculation can be made to see whether the probability the person is actually a user of the drug.

(0.98 x 0.005) / [(0.98 x 0.005) + ((1 - 0.98) x (1 - 0.005))] = 0.0049 / (0.0049 + 0.0199) = 19.76%

Bayes' theorem shows that even if a person tested positive in this scenario, it is actually much more likely the person is not a user of the drug.

  1. Joint Probability

    A joint probability is a statistical measure that calculates ...
  2. Fisher's Separation Theorem

    The Fisher's separation theorem is a theory that holds that a ...
  3. Arrow's Impossibility Theorem

    Arrow's impossibility theorem is a social-choice paradox illustrating ...
  4. Coase Theorem

    The coase theorem is a legal and economic theory that affirms ...
  5. Irrelevance Proposition Theorem

    The irrelevance proposition theorem is a theory of corporate ...
  6. Mutual Fund Theorem

    The mutual fund theorem is an investing strategy using mutual ...
Related Articles
  1. Investing

    Most Common Probability Distributions

    In this article, we'll go over a few of the most popular probability distributions and show you how to calculate them.
  2. Insights

    What Increasing Tech Layoffs Mean For Silicon Valley (YHOO, ADSK)

    Find out the reasons for layoffs by Bay area tech companies in 2016. Learn which factors indicate that the regional job market is still strong.
  3. Investing

    Using The Price-To-Book Ratio To Evaluate Companies

    The Price-To-Book (P/B) ratio can be an easy way to determine a company's value, but it isn't magic!
  4. Investing

    Using DCF In Biotech Valuation

    Valuing firms in this sector can seem like a black art, but there is a systematic way to pin a price on potential.
  5. Investing

    Multivariate Models: The Monte Carlo Analysis

    This decision-making tool integrates the idea that every decision has an impact on overall risk.
  6. Investing

    Understanding and Playing the Dow Jones Industrial Average

    In this article, learn strategies for investing in this price-weighted index (Dow Jones Industrial Average) and how to interpret its movements.
  7. Personal Finance

    Top Credit Cards For The Ultra Rich

    Only a few people qualify for these elite cards. The question is, are the lush perks big bucks can buy you worth the cost?
  8. Personal Finance

    Best (And Worst) Places to Change Money In Vegas

    Skip the booths at the airport and find an ATM when you want to exchange currency. Or try to use your credit card. Another good source: casinos!
  9. Trading

    Using Options Tools To Trade Foreign-Exchange Spot

    Find out how delta, gamma, risk reversals and volatility can all help predict movements in the cash market.
  10. Personal Finance

    These Credit Cards Offer Extended Warranties

    Credit cards with extended warranties mean you get one automatically.
  1. What is Fisher's separation theorem?

    Named after American economist Irving Fisher, it stipulates that the goal of any firm is to increase its value to the fullest ... Read Answer >>
  2. What does the Dow Jones Industrial Average measure?

    The Dow Jones Industrial Average (DJIA) is a price-weighted index that measures the daily price movements of 30 large American ... Read Answer >>
Trading Center