Quantitative Methods - Common Probability Distributions

The topics in this section provide a number of the quantitative building blocks useful in analyzing and predicting random variables such as future sales and earnings, growth rates, market index returns and returns on individual asset classes and specific securities. All of these variables have uncertain outcomes; thus there is risk that any downside uncertainty can result in a surprising and material impact. By understanding the mechanics of probability distributions, such risks can be understood and analyzed, and measures taken to hedge or reduce their impact.

Probability Distribution
A probability distribution gathers together all possible outcomes of a random variable (i.e. any quantity for which more than one value is possible), and summarizes these outcomes by indicating the probability of each of them. While a probability distribution is often associated with the bell-shaped curve, recognize that such a curve is only indicative of one specific type of probability, the so-called normal probability distribution. The CFA curriculum does focus on normal distributions since they frequently apply to financial and investment variables, and are used in hypothesis testing. However, in real life, a probability distribution can take any shape, size and form.

Example: Probability Distribution
For example, say if we wanted to choose a day at random in the future to schedule an event, and we wanted to know the probability that this day would fall on a Sunday, as we will need to avoid scheduling it on a Sunday. With seven days in a week, the probability that a random day would happen to be a Sunday would be given by one-seventh or about 14.29%. Of course, the same 14.29% probability would be true for any of the other six days.

In this case, we would have a uniform probability distribution: the chances that our random day would fall on any particular day are the same, and the graph of our probability distribution would be a straight line.

Figure 2.8: Probability Distribution

Probability distributions can be simple to understand as in this example, or they can be very complex and require sophisticated techniques (e.g., option pricing models, Monte Carlo simulations) to help describe all possible outcomes.

Discrete Random Variables
Discrete random variables can take on a finite or countable number of possible outcomes. The previous example asking for a day of the week is an example of a discrete variable, since it can only take seven possible values. Monetary variables expressed in dollars and cents are always discrete, since money is rounded to the nearest $0.01. In other words, we may have a formula that suggests a stock worth $15.75 today will be $17.1675 after it grows 9%, but you can't give or receive three-quarters of a penny, so our formula would round the outcome of 9% growth to an amount of $17.17.

Continuous Random Variables
A continuous random variable has infinite possible outcomes. A rate of return (e.g. growth rate) is continuous:

  • a stock can grow by 9% next year or by 10%, and in between this range it could grow by 9.3%, 9.4%, 9.5%
  • in between 9.3% and 9.4% the rate could be 9.31%, 9.32%, 9.33%, and in between 9.32% and 9.33% it could grow 9.32478941%
  • clearly there is no end to how precise the outcomes could be broken down; thus it's described as a continuous variable.

Outcomes in Discrete vs. Continuous Variables
The rule of thumb is that a discrete variable can have all possibilities listed out, while a continuous variable must be expressed in terms of its upper and lower limits, and greater-than or less-than indicators. Of course, listing out a large set of possible outcomes (which is usually the case for money variables) is usually impractical - thus money variables will usually have outcomes expressed as if they were continuous.

Rates of return can theoretically range from -100% to positive infinity. Time is bound on the lower side by 0. Market price of a security will also have a lower limit of $0, while its upper limit will depend on the security - stocks have no upper limit (thus a stock price's outcome > $0), but bond prices are more complicated, bound by factors such as time-to-maturity and embedded call options. If a face value of a bond is $1,000, there's an upper limit (somewhere above $1,000) above which the price of the bond will not go, but pinpointing the upper value of that set is imprecise.

Probability Function
A probability function gives the probabilities that a random variable will take on a given list of specific values. For a discrete variable, if (x1, x2, x3, x4 ...) are the complete set of possible outcomes, p(x) indicates the chances that X will be equal to x. Each x in the list for a discrete variable will have a p(x). For a continuous variable, a probability function is expressed as f(x).

The two key properties of a probability function, p(x) (or f(x) for continuous), are the following:

  1. 0 < p(x) < 1, since probability must always be between 0 and 1.
  2. Add up all probabilities of all distinct possible outcomes of a random variable, and the sum must equal 1.

Determining whether a function satisfies the first property should be easy to spot since we know that probabilities always lie between 0 and 1. In other words, p(x) could never be 1.4 or -0.2. To illustrate the second property, say we are given a set of three possibilities for X: (1, 2, 3) and a set of three for Y: (6, 7, 8), and given the probability functions f(x) and g(y).

x f(x) y g(y)
1 0.31 6 0.32
2 0.43 7 0.40
3 0.26 8 0.23

For all possibilities of f(x), the sum is 0.31+0.43+0.26=1, so we know it is a valid probability function. For all possibilities of g(y), the sum is 0.32+0.40+0.23 = 0.95, which violates our second principle. Either the given probabilities for g(y) are wrong, or there is a fourth possibility for y where g(y) = 0.05. Either way it needs to sum to 1.

Probability Density Function
A probability density function (or pdf) describes a probability function in the case of a continuous random variable. Also known as simply the "density", a probability density function is denoted by "f(x)". Since a pdf refers to a continuous random variable, its probabilities would be expressed as ranges of variables rather than probabilities assigned to individual values as is done for a discrete variable. For example, if a stock has a 20% chance of a negative return, the pdf in its simplest terms could be expressed as:

x f(x)
< 0 0.2
> 0 0.8
Common Probability Distribution Calculations


Related Articles
  1. Professionals

    Common Probability Distribution Calculations

    CFA Level 1 - Common Probability Distributions - Calculations
  2. Professionals

    Scenario / What-If Analysis

    We look at some ways that you can evaluate your project.
  3. Fundamental Analysis

    Scenario Analysis Provides Glimpse Of Portfolio Potential

    This statistical method estimates how far a stock might fall in a worst-case scenario.
  4. Fundamental Analysis

    Find The Right Fit With Probability Distributions

    Discover a few of the most popular probability distributions and how to calculate them.
  5. Professionals

    Basic Probability Concepts

    CFA Level 1 - Probability Concepts - Basics. Discusses randomness and various types of probabilities.
  6. Active Trading Fundamentals

    Bet Smarter With The Monte Carlo Simulation

    This technique can reduce uncertainty in estimating future outcomes.
  7. Professionals

    Common Probability Distribution Properties

    CFA Level 1 - Common Probability Distributions - Properties
  8. Options & Futures

    Multivariate Models: The Monte Carlo Analysis

    This decision-making tool integrates the idea that every decision has an impact on overall risk.
  9. Professionals

    Confidence Intervals

    CFA Level 1 - Common Probability Distributions - Confidence Intervals
  10. Economics

    Understanding Regression

    Regression is a statistical analysis that attempts to predict the effect of one or more variables on another variable.
RELATED TERMS
  1. Random Variable

    A variable whose value is unknown or a function that assigns ...
  2. Probability Density Function - ...

    A statistical measure that defines a probability distribution ...
  3. Sensitivity Analysis

    Sensitivity analysis is a technique used to determine how different ...
  4. Probability Distribution

    A statistical function that describes all the possible values ...
  5. Stochastic Modeling

    A method of financial modeling in which one or more variables ...
  6. Log-Normal Distribution

    A statistical distribution of random variables which have a normally ...
RELATED FAQS
  1. What variables are most important when making a prediction through sensitivity analysis?

    Explore sensitivity analysis and how this method considers different variables to determine a course of action based on statistical ... Read Answer >>
  2. What is the difference between direct costs and variable costs?

    Learn about variable costs and direct costs, how direct costs and variable costs are classified and the differences between ... Read Answer >>
  3. What are the variables in variable costs?

    Learn about variable costs. Explore how and why these costs may fluctuate, as well as ways in which they may differ from ... Read Answer >>
  4. Do production costs include all fixed and variable costs?

    Learn more about fixed and variable costs and how they affect production costs. Understanding how to graph these costs can ... Read Answer >>
  5. How are variable annuities regulated?

    Discover the various rules that the Securities and Exchange Commission (SEC) and the Financial Industry Regulatory Authority ... Read Answer >>
  6. How liquid are variable annuities?

    Understand whether variable annuities are liquid. Learn more about the two types of variable annuities and which is more ... Read Answer >>
Hot Definitions
  1. Law Of Demand

    A microeconomic law that states that, all other factors being equal, as the price of a good or service increases, consumer ...
  2. Cost Of Debt

    The effective rate that a company pays on its current debt. This can be measured in either before- or after-tax returns; ...
  3. Yield Curve

    A line that plots the interest rates, at a set point in time, of bonds having equal credit quality, but differing maturity ...
  4. Stop-Limit Order

    An order placed with a broker that combines the features of stop order with those of a limit order. A stop-limit order will ...
  5. Keynesian Economics

    An economic theory of total spending in the economy and its effects on output and inflation. Keynesian economics was developed ...
  6. Society for Worldwide Interbank Financial Telecommunications ...

    A member-owned cooperative that provides safe and secure financial transactions for its members. Established in 1973, the ...
Trading Center