What is 'Sample Selection Bias'

Sample selection bias is a type of bias caused by choosing non-random data for statistical analysis. The bias exists due to a flaw in the sample selection process, where a subset of the data is systematically excluded due to a particular attribute. The exclusion of the subset can influence the statistical significance of the test, or produce distorted results.

BREAKING DOWN 'Sample Selection Bias'

Survivorship bias is a common type of sample selection bias. For example, when back-testing an investment strategy on a large group of stocks, it may be convenient to look for securities that have data for the entire sample period. If we were going to test the strategy against 15 years worth of stock data, we might be inclined to look for stocks that have complete information for the entire 15-year period. However, eliminating a stock that stopped trading, or shortly left the market, would input a bias in our data sample. Since we only include stocks that lasted the 15-year period, our final results would be flawed, as these performed well enough to survive the market.

Hedge fund performance indexes are one example of sample selection bias subject to survivorship bias. Because hedge funds that don’t survive stop reporting their performance to index aggregators, resulting indices are naturally tilted to funds and strategies that remain, hence “survive.” This can be an issue with popular mutual fund reporting service as well.

Analysts can adjust to take account of these biases but may introduce news biases in the process.

RELATED TERMS
  1. Bias

    Biases are human tendencies that affect our behavior and perspective, ...
  2. Survivorship Bias

    Survivorship bias is the tendency to view the fund performance ...
  3. Attribute Bias

    Attribute bias is the tendency of stocks selected by a quantitative ...
  4. Reverse Survivorship Bias

    Reverse survivorship bias describes a situation where low performers ...
  5. Representative Sample

    A representative sample is a subset of a statistical population ...
  6. Dedicated Short Bias

    Dedicated short bias is a strategy where a hedge fund maintains ...
Related Articles
  1. Investing

    Behavioral Bias: Cognitive Versus Emotional Bias in Investing

    We all have biases. The key to better investing is to identify those biases and create rules to minimize their effect on investing decisions.
  2. Investing

    Top Reasons Stock Indices Could Be Biased

    Do the owners of the large stock indices (McGraw Hill Financial, CME Group, and News Corp) have incentive to pick stocks to put in the index that are "shiny" as a marketing ploy? And if so, wouldn't ...
  3. Investing

    Mutual Fund Returns: Not Always What They Appear

    Survivorship bias erases substandard performers, distorting overall mutual fund returns.
  4. Investing

    4 Investing Biases You Should Avoid

    Don't let these four behavioral biases interfere with your investment strategy and financial success.
  5. Investing

    Is Your Wealth Advisor an Investment Vulcan?

    Research shows that investments managed by financial advisors perform better. Why?
  6. Small Business

    7 Ways Your Emotions Skew Your Business Decisions

    Important decisions such as making a key investment, increasing production or expanding into new lines are all clouded by human emotion. Can you stay cool under pressure?
  7. Investing

    Behavioral Finance and the 4 Stages of Bull and Bear Markets

    Step into the psychological aspect of investing. Just as investor behavior can be irrational during bull markets, bear market cycles may also exemplify unique cognitive biases.
  8. Financial Advisor

    How Your Investing Misbehavior Can Cost You

    These three common investing biases can hinder your investing strategy and prevent you from achieving satisfactory results.
RELATED FAQS
  1. When is it better to use systematic over simple random sampling?

    Learn when systematic sampling is better than simple random sampling, such as in the absence of data patterns and when there ... Read Answer >>
  2. How do I calculate the standard error using Matlab?

    Learn how to calculate the standard error for a sample statistical measure, such as the sample mean, using standard Matlab ... Read Answer >>
  3. What's an example of stratified random sampling?

    Stratified random sampling divides a population into subgroups or strata, whereby the members in each of the stratum formed ... Read Answer >>
  4. What assumptions are made when conducting a t-test?

    Learn what a t-test is and discover the five standard assumptions made regarding the validity of sampling and data used in ... Read Answer >>
  5. Can the Efficient Market Hypothesis explain economic bubbles?

    Learn about the nuanced relationship between the efficient market hypothesis and economic bubbles and the requirements and ... Read Answer >>
Trading Center