Overfitting

AAA

DEFINITION of 'Overfitting'

A modeling error which occurs when a function is too closely fit to a limited set of data points. Overfitting the model generally takes the form of making an overly complex model to explain idiosyncrasies in the data under study. In reality, the data being studied often has some degree of error or random noise within it. Thus attempting to make the model conform too closely to slightly inaccurate data can infect the model with substantial errors and reduce its predictive power.

INVESTOPEDIA EXPLAINS 'Overfitting'

Financial professionals must always be aware of the dangers of overfitting a model based on limited data. For instance, a common problem is using computer algorithms to search extensive databases of historical market data in order to find patterns. Given enough study, it is often possible to develop elaborate theorems which appear to predict things such as returns in the stock market with close accuracy. However, when applied to data outside of the sample, such theorems may likely prove to be merely an overfitting of a model to what were in reality just chance occurrences. In all cases, it is important to test a model against data which is outside of the sample used to develop it.

RELATED TERMS
  1. Regression

    A statistical measure that attempts to determine the strength ...
  2. Financial Modeling

    The process by which a firm constructs a financial representation ...
  3. Non-Sampling Error

    A statistical error caused by human error to which a specific ...
  4. Stochastic Modeling

    A method of financial modeling in which one or more variables ...
  5. Multiple Linear Regression - MLR

    A statistical technique that uses several explanatory variables ...
  6. Market Value

    The price an asset would fetch in the marketplace. Market value ...
Related Articles
  1. Mutual Funds & ETFs

    Build A Model Portfolio With Style Investing

    This sophisticated approach will add flair to your returns.
  2. Fundamental Analysis

    Do-It-Yourself Analyst Predictions

    Regular investors can build their own financial models using the mosaic theory.
  3. Professionals

    Style Matters In Financial Modeling

    If you're looking to get a job as an analyst, you'll need to know how to work it.
  4. Active Trading

    Introduction To Stationary And Non-Stationary Processes

    What to know about stationary and non-stationary processes before you try to model or forecast.
  5. Options & Futures

    Multivariate Models: The Monte Carlo Analysis

    This decision-making tool integrates the idea that every decision has an impact on overall risk.
  6. Fundamental Analysis

    What is the first day of the first quarter?

    The first day of companies' fiscal years varies based on industry cycles. The timing is especially important because annual reports can have unexpected effects.
  7. Trading Strategies

    How do I use the dividend capture strategy?

    Learn how to implement the dividend capture strategy, an aggressive, income-focused stock trading strategy investors can use to increase equity profits.
  8. What's a Marketable Security?
    Active Trading

    What's a Marketable Security?

    Marketable securities are financial instruments that can be readily bought and sold in a public market. The key feature is the ease with which it can be sold and converted into cash. Usually, ...
  9. Stock Analysis

    Buyinb Facebook Stock, A Beginner's Guide

    This straightforward guide helps the novice investor feel more adept at buying a stock, such as Facebook (FB).
  10. Trading Strategies

    How do technical analysts interpret the Average Directional Index (ADI)?

    Learn what the average directional index is and why technical analysts look towards ADX indicators to measure the strength of price trends.

You May Also Like

Hot Definitions
  1. Christmas Island Dollar

    The former currency of Christmas Island, an Australian island in the Indian Ocean that was discovered on December 25, 1643. ...
  2. Santa Claus Rally

    A surge in the price of stocks that often occurs in the week between Christmas and New Year's Day. There are numerous explanations ...
  3. Commodity

    1. A basic good used in commerce that is interchangeable with other commodities of the same type. Commodities are most often ...
  4. Deferred Revenue

    Advance payments or unearned revenue, recorded on the recipient's balance sheet as a liability, until the services have been ...
  5. Multinational Corporation - MNC

    A corporation that has its facilities and other assets in at least one country other than its home country. Such companies ...
  6. SWOT Analysis

    A tool that identifies the strengths, weaknesses, opportunities and threats of an organization. Specifically, SWOT is a basic, ...
Trading Center