Overfitting

AAA

DEFINITION of 'Overfitting'

A modeling error which occurs when a function is too closely fit to a limited set of data points. Overfitting the model generally takes the form of making an overly complex model to explain idiosyncrasies in the data under study. In reality, the data being studied often has some degree of error or random noise within it. Thus attempting to make the model conform too closely to slightly inaccurate data can infect the model with substantial errors and reduce its predictive power.

INVESTOPEDIA EXPLAINS 'Overfitting'

Financial professionals must always be aware of the dangers of overfitting a model based on limited data. For instance, a common problem is using computer algorithms to search extensive databases of historical market data in order to find patterns. Given enough study, it is often possible to develop elaborate theorems which appear to predict things such as returns in the stock market with close accuracy. However, when applied to data outside of the sample, such theorems may likely prove to be merely an overfitting of a model to what were in reality just chance occurrences. In all cases, it is important to test a model against data which is outside of the sample used to develop it.

RELATED TERMS
  1. Stochastic Modeling

    A method of financial modeling in which one or more variables ...
  2. Financial Modeling

    The process by which a firm constructs a financial representation ...
  3. Non-Sampling Error

    A statistical error caused by human error to which a specific ...
  4. Multiple Linear Regression - MLR

    A statistical technique that uses several explanatory variables ...
  5. Regression

    A statistical measure that attempts to determine the strength ...
  6. Market Value

    The price an asset would fetch in the marketplace. Market value ...
Related Articles
  1. Mutual Funds & ETFs

    Build A Model Portfolio With Style Investing

    This sophisticated approach will add flair to your returns.
  2. Fundamental Analysis

    Do-It-Yourself Analyst Predictions

    Regular investors can build their own financial models using the mosaic theory.
  3. Professionals

    Style Matters In Financial Modeling

    If you're looking to get a job as an analyst, you'll need to know how to work it.
  4. Options & Futures

    Multivariate Models: The Monte Carlo Analysis

    This decision-making tool integrates the idea that every decision has an impact on overall risk.
  5. Active Trading

    Introduction To Stationary And Non-Stationary Processes

    What to know about stationary and non-stationary processes before you try to model or forecast.
  6. Technical Indicators

    What are the signs of a bear market rally?

    Read about some of the signs of a bear market rally, an unpredictable bull movement that takes place in the middle of a stronger downtrend.
  7. Fundamental Analysis

    Why are OTC (over-the-counter) transactions controversial?

    Learn more about over-the-counter transactions, and why OTC traders are considered riskier than traders working with larger market exchanges.
  8. Forex Education

    What's the difference between bid-ask spread and bid-ask bounce?

    Understand the difference between the bid-ask spread that determines the buy or sell price for a stock and a bid-ask bounce, a situational price volatility.
  9. Options & Futures

    How do you trade put options on E*TRADE?

    Learn all about put option trading at E*TRADE. Explore margin accounts and become familiar with the different types of option writing.
  10. Options & Futures

    Do you have to be an expert investor to trade put options?

    Learn about investing in put options and the associated risks. Explore how options can provide risk, which is precisely defined to predetermined limits.

You May Also Like

Hot Definitions
  1. Prospectus

    A formal legal document, which is required by and filed with the Securities and Exchange Commission, that provides details ...
  2. Treasury Bond - T-Bond

    A marketable, fixed-interest U.S. government debt security with a maturity of more than 10 years. Treasury bonds make interest ...
  3. Weight Of Ice, Snow Or Sleet Insurance

    Financial protection against damage caused to property by winter weather specifically, damage caused if a roof caves in because ...
  4. Weather Insurance

    A type of protection against a financial loss that may be incurred because of rain, snow, storms, wind, fog, undesirable ...
  5. Portfolio Turnover

    A measure of how frequently assets within a fund are bought and sold by the managers. Portfolio turnover is calculated by ...
  6. Commercial Paper

    An unsecured, short-term debt instrument issued by a corporation, typically for the financing of accounts receivable, inventories ...
Trading Center