What is 'Sample Selection Bias'

Sample selection bias is a type of bias caused by choosing non-random data for statistical analysis. The bias exists due to a flaw in the sample selection process, where a subset of the data is systematically excluded due to a particular attribute. The exclusion of the subset can influence the statistical significance of the test, or produce distorted results.

BREAKING DOWN 'Sample Selection Bias'

Survivorship bias is a common type of sample selection bias. For example, when back-testing an investment strategy on a large group of stocks, it may be convenient to look for securities that have data for the entire sample period. If we were going to test the strategy against 15 years worth of stock data, we might be inclined to look for stocks that have complete information for the entire 15-year period. However, eliminating a stock that stopped trading, or shortly left the market, would input a bias in our data sample. Since we only include stocks that lasted the 15-year period, our final results would be flawed, as these performed well enough to survive the market.

Hedge fund performance indexes are one example of sample selection bias subject to survivorship bias. Because hedge funds that don’t survive stop reporting their performance to index aggregators, resulting indices are naturally tilted to funds and strategies that remain, hence “survive.” This can be an issue with popular mutual fund reporting service as well.

Analysts can adjust to take account of these biases but may introduce news biases in the process.

RELATED TERMS
  1. Survivorship Bias

    Survivorship bias is the tendency to view the fund performance ...
  2. Attribute Bias

    Attribute bias is the tendency of stocks selected by a quantitative ...
  3. Look-Ahead Bias

    Look-ahead bias occurs when information or data is used in a ...
  4. Representative Sample

    A representative sample is a subset of a statistical population ...
  5. Dedicated Short Bias

    Dedicated short bias is a strategy where a hedge fund maintains ...
  6. Home Country Bias

    Home country bias refers to the tendency for investors to favor ...
Related Articles
  1. Investing

    Behavioral Bias: Cognitive Versus Emotional Bias in Investing

    We all have biases. The key to better investing is to identify those biases and create rules to minimize their effect on investing decisions.
  2. Investing

    Mutual Fund Returns: Not Always What They Appear

    Survivorship bias erases substandard performers, distorting overall mutual fund returns.
  3. Investing

    6 Cognitive Biases That Can Derail Your Portfolio

    Don't let these six cognitive biases result in poor decisions that can derail your portfolio.
  4. Investing

    5 Mental Mistakes That Affect Stock Analysts

    They know more about stocks than the average person, but analysts are still affected by biases. Find out what they are.
  5. Investing

    4 Biases That Can Make You A Bad Investor

    Find out how to spot these four biases, and start making more logical investing decisions.
  6. Financial Advisor

    Behavioral Finance: How Bias Can Hurt Investing

    Here are three cognitive biases from behavioral finance that investors would do well to be aware of to avoid making poor investment decisions.
  7. Investing

    4 Behavioral Biases And How To Avoid Them

    Here are four common common behavioral biases for traders and how to minimize their effects on your portoflio.
  8. Investing

    How to Use Stratified Random Sampling

    Stratified random sampling is a technique best used with a sample population easily broken into distinct subgroups. Samples are then taken from each subgroup based on the ratio of the subgroup’s ...
RELATED FAQS
  1. What are the disadvantages of using a simple random sample to approximate a larger ...

    Learn here what a simple random sample is, how researchers use it as a statistical tool and the disadvantages it carries ... Read Answer >>
  2. What are the advantages of using a simple random sample to study a larger population?

    Learn how simple random sampling works and what advantages it offers over other sampling methods when selecting a research ... Read Answer >>
  3. How do I calculate the standard error using Matlab?

    Learn how to calculate the standard error for a sample statistical measure, such as the sample mean, using standard Matlab ... Read Answer >>
  4. What's an example of stratified random sampling?

    Stratified random sampling divides a population into subgroups or strata, whereby the members in each of the stratum formed ... Read Answer >>
  5. What assumptions are made when conducting a t-test?

    Learn what a t-test is and discover the five standard assumptions made regarding the validity of sampling and data used in ... Read Answer >>
Trading Center