Quantitative Methods - Common Probability Distributions

The topics in this section provide a number of the quantitative building blocks useful in analyzing and predicting random variables such as future sales and earnings, growth rates, market index returns and returns on individual asset classes and specific securities. All of these variables have uncertain outcomes; thus there is risk that any downside uncertainty can result in a surprising and material impact. By understanding the mechanics of probability distributions, such risks can be understood and analyzed, and measures taken to hedge or reduce their impact.

Probability Distribution
A probability distribution gathers together all possible outcomes of a random variable (i.e. any quantity for which more than one value is possible), and summarizes these outcomes by indicating the probability of each of them. While a probability distribution is often associated with the bell-shaped curve, recognize that such a curve is only indicative of one specific type of probability, the so-called normal probability distribution. The CFA curriculum does focus on normal distributions since they frequently apply to financial and investment variables, and are used in hypothesis testing. However, in real life, a probability distribution can take any shape, size and form.

Example: Probability Distribution
For example, say if we wanted to choose a day at random in the future to schedule an event, and we wanted to know the probability that this day would fall on a Sunday, as we will need to avoid scheduling it on a Sunday. With seven days in a week, the probability that a random day would happen to be a Sunday would be given by one-seventh or about 14.29%. Of course, the same 14.29% probability would be true for any of the other six days.

In this case, we would have a uniform probability distribution: the chances that our random day would fall on any particular day are the same, and the graph of our probability distribution would be a straight line.

Figure 2.8: Probability Distribution

Probability distributions can be simple to understand as in this example, or they can be very complex and require sophisticated techniques (e.g., option pricing models, Monte Carlo simulations) to help describe all possible outcomes.

Discrete Random Variables
Discrete random variables can take on a finite or countable number of possible outcomes. The previous example asking for a day of the week is an example of a discrete variable, since it can only take seven possible values. Monetary variables expressed in dollars and cents are always discrete, since money is rounded to the nearest $0.01. In other words, we may have a formula that suggests a stock worth $15.75 today will be $17.1675 after it grows 9%, but you can't give or receive three-quarters of a penny, so our formula would round the outcome of 9% growth to an amount of $17.17.

Continuous Random Variables
A continuous random variable has infinite possible outcomes. A rate of return (e.g. growth rate) is continuous:

  • a stock can grow by 9% next year or by 10%, and in between this range it could grow by 9.3%, 9.4%, 9.5%
  • in between 9.3% and 9.4% the rate could be 9.31%, 9.32%, 9.33%, and in between 9.32% and 9.33% it could grow 9.32478941%
  • clearly there is no end to how precise the outcomes could be broken down; thus it's described as a continuous variable.

Outcomes in Discrete vs. Continuous Variables
The rule of thumb is that a discrete variable can have all possibilities listed out, while a continuous variable must be expressed in terms of its upper and lower limits, and greater-than or less-than indicators. Of course, listing out a large set of possible outcomes (which is usually the case for money variables) is usually impractical - thus money variables will usually have outcomes expressed as if they were continuous.

Rates of return can theoretically range from -100% to positive infinity. Time is bound on the lower side by 0. Market price of a security will also have a lower limit of $0, while its upper limit will depend on the security - stocks have no upper limit (thus a stock price's outcome > $0), but bond prices are more complicated, bound by factors such as time-to-maturity and embedded call options. If a face value of a bond is $1,000, there's an upper limit (somewhere above $1,000) above which the price of the bond will not go, but pinpointing the upper value of that set is imprecise.

Probability Function
A probability function gives the probabilities that a random variable will take on a given list of specific values. For a discrete variable, if (x1, x2, x3, x4 ...) are the complete set of possible outcomes, p(x) indicates the chances that X will be equal to x. Each x in the list for a discrete variable will have a p(x). For a continuous variable, a probability function is expressed as f(x).

The two key properties of a probability function, p(x) (or f(x) for continuous), are the following:

  1. 0 < p(x) < 1, since probability must always be between 0 and 1.
  2. Add up all probabilities of all distinct possible outcomes of a random variable, and the sum must equal 1.

Determining whether a function satisfies the first property should be easy to spot since we know that probabilities always lie between 0 and 1. In other words, p(x) could never be 1.4 or -0.2. To illustrate the second property, say we are given a set of three possibilities for X: (1, 2, 3) and a set of three for Y: (6, 7, 8), and given the probability functions f(x) and g(y).

x f(x) y g(y)
1 0.31 6 0.32
2 0.43 7 0.40
3 0.26 8 0.23

For all possibilities of f(x), the sum is 0.31+0.43+0.26=1, so we know it is a valid probability function. For all possibilities of g(y), the sum is 0.32+0.40+0.23 = 0.95, which violates our second principle. Either the given probabilities for g(y) are wrong, or there is a fourth possibility for y where g(y) = 0.05. Either way it needs to sum to 1.

Probability Density Function
A probability density function (or pdf) describes a probability function in the case of a continuous random variable. Also known as simply the "density", a probability density function is denoted by "f(x)". Since a pdf refers to a continuous random variable, its probabilities would be expressed as ranges of variables rather than probabilities assigned to individual values as is done for a discrete variable. For example, if a stock has a 20% chance of a negative return, the pdf in its simplest terms could be expressed as:

x f(x)
< 0 0.2
> 0 0.8
Common Probability Distribution Calculations

Related Articles
  1. Fundamental Analysis

    Scenario Analysis Provides Glimpse Of Portfolio Potential

    This statistical method estimates how far a stock might fall in a worst-case scenario.
  2. Fundamental Analysis

    Find The Right Fit With Probability Distributions

    Discover a few of the most popular probability distributions and how to calculate them.
  3. Active Trading Fundamentals

    Bet Smarter With The Monte Carlo Simulation

    This technique can reduce uncertainty in estimating future outcomes.
  4. Options & Futures

    Multivariate Models: The Monte Carlo Analysis

    This decision-making tool integrates the idea that every decision has an impact on overall risk.
  5. Economics

    Understanding Regression

    Regression is a statistical analysis that attempts to predict the effect of one or more variables on another variable.
  6. Investing

    What's a Sensitivity Analysis?

    Sensitivity analysis is used in financial modeling to determine how one variable (the target variable) may be affected by changes in another variable (the input variable).
  7. Investing News

    Stock and Flow Variables Explained: A Closer Look at Apple

    The difference between stock and flow variables is an essential concept in finance and economics. We illustrate with financial statements from Apple Inc.
  8. Forex Education

    Financial Forecasting: The Bayesian Method

    This method can help refine probability estimates using an intuitive process.
  9. Financial Advisors

    Variable Annuities: The Pros and Cons

    Variable annuities are one of the most complicated financial instruments. Here is an in depth look at their pros and cons.
  10. Investing Basics

    What Are The Odds Of Scoring A Winning Trade?

    Just because you're on a winning streak doesn't mean you're a skilled trader. Find out why.
  1. Random Variable

    A variable whose value is unknown or a function that assigns ...
  2. Probability Density Function - ...

    A statistical measure that defines a probability distribution ...
  3. Probability Distribution

    A statistical function that describes all the possible values ...
  4. Sensitivity Analysis

    Sensitivity analysis is a technique used to determine how different ...
  5. Stochastic Modeling

    A method of financial modeling in which one or more variables ...
  6. Log-Normal Distribution

    A statistical distribution of random variables which have a normally ...
  1. What variables are most important when making a prediction through sensitivity analysis?

    Explore sensitivity analysis and how this method considers different variables to determine a course of action based on statistical ... Read Answer >>
  2. What is the difference between direct costs and variable costs?

    Learn about variable costs and direct costs, how direct costs and variable costs are classified and the differences between ... Read Answer >>
  3. What are the variables in variable costs?

    Learn about variable costs. Explore how and why these costs may fluctuate, as well as ways in which they may differ from ... Read Answer >>
  4. How are variable annuities regulated?

    Discover the various rules that the Securities and Exchange Commission (SEC) and the Financial Industry Regulatory Authority ... Read Answer >>
  5. Do production costs include all fixed and variable costs?

    Learn more about fixed and variable costs and how they affect production costs. Understanding how to graph these costs can ... Read Answer >>
  6. Which is wiser, rolling over my traditional IRA to variable annuity or vice versa? ...

    I am 46 years old. I have a traditional IRA and Variable Annuity. What will it cost me to roll either way? ... Read Answer >>
Hot Definitions
  1. Reverse Mortgage

    A type of mortgage in which a homeowner can borrow money against the value of his or her home. No repayment of the mortgage ...
  2. Labor Market

    The labor market refers to the supply and demand for labor, in which employees provide the supply and employers the demand. ...
  3. Demand Curve

    The demand curve is a graphical representation of the relationship between the price of a good or service and the quantity ...
  4. Goldilocks Economy

    An economy that is not so hot that it causes inflation, and not so cold that it causes a recession. This term is used to ...
  5. White Squire

    Very similar to a "white knight", but instead of purchasing a majority interest, the squire purchases a lesser interest in ...
  6. MACD Technical Indicator

    Moving Average Convergence Divergence (or MACD) is a trend-following momentum indicator that shows the relationship between ...
Trading Center