Overfitting

AAA

DEFINITION of 'Overfitting'

A modeling error which occurs when a function is too closely fit to a limited set of data points. Overfitting the model generally takes the form of making an overly complex model to explain idiosyncrasies in the data under study. In reality, the data being studied often has some degree of error or random noise within it. Thus attempting to make the model conform too closely to slightly inaccurate data can infect the model with substantial errors and reduce its predictive power.

INVESTOPEDIA EXPLAINS 'Overfitting'

Financial professionals must always be aware of the dangers of overfitting a model based on limited data. For instance, a common problem is using computer algorithms to search extensive databases of historical market data in order to find patterns. Given enough study, it is often possible to develop elaborate theorems which appear to predict things such as returns in the stock market with close accuracy. However, when applied to data outside of the sample, such theorems may likely prove to be merely an overfitting of a model to what were in reality just chance occurrences. In all cases, it is important to test a model against data which is outside of the sample used to develop it.

RELATED TERMS
  1. Stochastic Modeling

    A method of financial modeling in which one or more variables ...
  2. Financial Modeling

    The process by which a firm constructs a financial representation ...
  3. Non-Sampling Error

    A statistical error caused by human error to which a specific ...
  4. Multiple Linear Regression - MLR

    A statistical technique that uses several explanatory variables ...
  5. Regression

    A statistical measure that attempts to determine the strength ...
  6. Altman Z-Score

    The output of a credit-strength test that gauges a publicly traded ...
RELATED FAQS
  1. What dividend yield is typical for companies in the industrial sector?

    The average dividend yield of the industrial goods sector is approximately 1.71%. The industrial goods sector is a group ... Read Full Answer >>
  2. Which REITs pay the highest dividends?

    A real estate investment trust (REIT) is a financial security that trades like a stock on major market exchanges. However, ... Read Full Answer >>
  3. What is the difference between an Equity REIT and a Mortgage REIT?

    There are several types of real estate investments trusts (REITS) that investors can purchase, including equity REITS and ... Read Full Answer >>
  4. How does a lack of demand affect financial markets?

    A lack of demand affects financial markets by leading to lower prices. The function of financial markets is to constantly ... Read Full Answer >>
  5. What kinds of derivatives are types of forward commitments?

    A derivative is a type of security in which the price of the security is dependent on underlying assets. A derivative could ... Read Full Answer >>
  6. What does it mean to be long or short a derivative?

    A derivative is a type of security in which the price of the security is dependent on one or more underlying assets. A derivative ... Read Full Answer >>
Related Articles
  1. Mutual Funds & ETFs

    Build A Model Portfolio With Style Investing

    This sophisticated approach will add flair to your returns.
  2. Fundamental Analysis

    Do-It-Yourself Analyst Predictions

    Regular investors can build their own financial models using the mosaic theory.
  3. Options & Futures

    Multivariate Models: The Monte Carlo Analysis

    This decision-making tool integrates the idea that every decision has an impact on overall risk.
  4. Professionals

    Style Matters In Financial Modeling

    If you're looking to get a job as an analyst, you'll need to know how to work it.
  5. Active Trading

    Introduction To Stationary And Non-Stationary Processes

    What to know about stationary and non-stationary processes before you try to model or forecast.
  6. Fundamental Analysis

    What is a Representative Sample?

    In statistics, a representative sample accurately represents the make-up of various subgroups in an entire data pool.
  7. Economics

    When Global Economies Converge

    The Divergences in global economic look very much like an explanation for what happened last year, though market observers continue to tout about it.
  8. Fundamental Analysis

    How to Calculate a Turnover Ratio

    A turnover ratio measures a mutual fund’s level of trading activity in a given time period, usually a year.
  9. Investing

    Do Record Stock Highs Signal A Top?

    Despite higher rates, U.S. stocks have been posting new records in recent weeks, despite investor concerns about slowing U.S. corporate profit growth.
  10. Investing Basics

    Understanding Open-End Funds

    An open-end fund is a type of mutual fund that does not limit the amount of shares it issues, but issues as many shares as investors are willing to buy.

You May Also Like

Hot Definitions
  1. Fracking

    A slang term for hydraulic fracturing. Fracking refers to the procedure of creating fractures in rocks and rock formations ...
  2. Mixed Economic System

    An economic system that features characteristics of both capitalism and socialism.
  3. Net Worth

    The amount by which assets exceed liabilities. Net worth is a concept applicable to individuals and businesses as a key measure ...
  4. Stop-Loss Order

    An order placed with a broker to sell a security when it reaches a certain price. A stop-loss order is designed to limit ...
  5. Covered Call

    An options strategy whereby an investor holds a long position in an asset and writes (sells) call options on that same asset ...
  6. Butterfly Spread

    A neutral option strategy combining bull and bear spreads. Butterfly spreads use four option contracts with the same expiration ...
Trading Center