Overfitting

AAA

DEFINITION of 'Overfitting'

A modeling error which occurs when a function is too closely fit to a limited set of data points. Overfitting the model generally takes the form of making an overly complex model to explain idiosyncrasies in the data under study. In reality, the data being studied often has some degree of error or random noise within it. Thus attempting to make the model conform too closely to slightly inaccurate data can infect the model with substantial errors and reduce its predictive power.

INVESTOPEDIA EXPLAINS 'Overfitting'

Financial professionals must always be aware of the dangers of overfitting a model based on limited data. For instance, a common problem is using computer algorithms to search extensive databases of historical market data in order to find patterns. Given enough study, it is often possible to develop elaborate theorems which appear to predict things such as returns in the stock market with close accuracy. However, when applied to data outside of the sample, such theorems may likely prove to be merely an overfitting of a model to what were in reality just chance occurrences. In all cases, it is important to test a model against data which is outside of the sample used to develop it.

RELATED TERMS
  1. Stochastic Modeling

    A method of financial modeling in which one or more variables ...
  2. Multiple Linear Regression - MLR

    A statistical technique that uses several explanatory variables ...
  3. Regression

    A statistical measure that attempts to determine the strength ...
  4. Financial Modeling

    The process by which a firm constructs a financial representation ...
  5. Non-Sampling Error

    A statistical error caused by human error to which a specific ...
  6. Market Value

    The price an asset would fetch in the marketplace. Market value ...
Related Articles
  1. Mutual Funds & ETFs

    Build A Model Portfolio With Style Investing

  2. Fundamental Analysis

    Do-It-Yourself Analyst Predictions

  3. Options & Futures

    Multivariate Models: The Monte Carlo ...

  4. Professionals

    Style Matters In Financial Modeling

Hot Definitions
  1. Capitulation

    When investors give up any previous gains in stock price by selling equities in an effort to get out of the market and into ...
  2. Turkey

    Slang for an investment that yields disappointing results or turns out worse than expected. Failed business deals, securities ...
  3. Conduit Issuer

    An organization, usually a government agency, that issues municipal securities to raise capital for revenue-generating projects ...
  4. Financing Entity

    The party in a financing arrangement that provides money, property, or another asset to an intermediate entity or financed ...
  5. Hyperinflation

    Extremely rapid or out of control inflation. There is no precise numerical definition to hyperinflation. Hyperinflation is ...
  6. Gross Rate Of Return

    The total rate of return on an investment before the deduction of any fees or expenses. The gross rate of return is quoted ...
Trading Center