Overfitting

AAA

DEFINITION of 'Overfitting'

A modeling error which occurs when a function is too closely fit to a limited set of data points. Overfitting the model generally takes the form of making an overly complex model to explain idiosyncrasies in the data under study. In reality, the data being studied often has some degree of error or random noise within it. Thus attempting to make the model conform too closely to slightly inaccurate data can infect the model with substantial errors and reduce its predictive power.

INVESTOPEDIA EXPLAINS 'Overfitting'

Financial professionals must always be aware of the dangers of overfitting a model based on limited data. For instance, a common problem is using computer algorithms to search extensive databases of historical market data in order to find patterns. Given enough study, it is often possible to develop elaborate theorems which appear to predict things such as returns in the stock market with close accuracy. However, when applied to data outside of the sample, such theorems may likely prove to be merely an overfitting of a model to what were in reality just chance occurrences. In all cases, it is important to test a model against data which is outside of the sample used to develop it.

RELATED TERMS
  1. Regression

    A statistical measure that attempts to determine the strength ...
  2. Financial Modeling

    The process by which a firm constructs a financial representation ...
  3. Non-Sampling Error

    A statistical error caused by human error to which a specific ...
  4. Stochastic Modeling

    A method of financial modeling in which one or more variables ...
  5. Multiple Linear Regression - MLR

    A statistical technique that uses several explanatory variables ...
  6. Compound Annual Growth Rate - CAGR

    The year-over-year growth rate of an investment over a specified ...
Related Articles
  1. Build A Model Portfolio With Style Investing
    Mutual Funds & ETFs

    Build A Model Portfolio With Style Investing

  2. Do-It-Yourself Analyst Predictions
    Fundamental Analysis

    Do-It-Yourself Analyst Predictions

  3. Style Matters In Financial Modeling
    Professionals

    Style Matters In Financial Modeling

  4. Introduction To Stationary And Non-Stationary ...
    Active Trading

    Introduction To Stationary And Non-Stationary ...

comments powered by Disqus
Hot Definitions
  1. Elasticity

    A measure of a variable's sensitivity to a change in another variable. In economics, elasticity refers the degree to which ...
  2. Tangible Common Equity - TCE

    A measure of a company's capital, which is used to evaluate a financial institution's ability to deal with potential losses. ...
  3. Yield To Maturity (YTM)

    The rate of return anticipated on a bond if held until the maturity date. YTM is considered a long-term bond yield expressed ...
  4. Net Present Value Of Growth Opportunities - NPVGO

    A calculation of the net present value of all future cash flows involved with an additional acquisition, or potential acquisition. ...
  5. Gresham's Law

    A monetary principle stating that "bad money drives out good." In currency valuation, Gresham's Law states that if a new ...
  6. Limit-On-Open Order - LOO

    A type of limit order to buy or sell shares at the market open if the market price meets the limit condition. This type of ...
Trading Center