Overfitting

AAA

DEFINITION of 'Overfitting'

A modeling error which occurs when a function is too closely fit to a limited set of data points. Overfitting the model generally takes the form of making an overly complex model to explain idiosyncrasies in the data under study. In reality, the data being studied often has some degree of error or random noise within it. Thus attempting to make the model conform too closely to slightly inaccurate data can infect the model with substantial errors and reduce its predictive power.

BREAKING DOWN 'Overfitting'

Financial professionals must always be aware of the dangers of overfitting a model based on limited data. For instance, a common problem is using computer algorithms to search extensive databases of historical market data in order to find patterns. Given enough study, it is often possible to develop elaborate theorems which appear to predict things such as returns in the stock market with close accuracy. However, when applied to data outside of the sample, such theorems may likely prove to be merely an overfitting of a model to what were in reality just chance occurrences. In all cases, it is important to test a model against data which is outside of the sample used to develop it.

RELATED TERMS
  1. Stochastic Modeling

    A method of financial modeling in which one or more variables ...
  2. Financial Modeling

    The process by which a firm constructs a financial representation ...
  3. Non-Sampling Error

    A statistical error caused by human error to which a specific ...
  4. Multiple Linear Regression - MLR

    A statistical technique that uses several explanatory variables ...
  5. Regression

    A statistical measure that attempts to determine the strength ...
  6. Equity

    The value of an asset less the value of all liabilities on that ...
Related Articles
  1. Mutual Funds & ETFs

    Build A Model Portfolio With Style Investing

    This sophisticated approach will add flair to your returns.
  2. Fundamental Analysis

    Do-It-Yourself Analyst Predictions

    Regular investors can build their own financial models using the mosaic theory.
  3. Options & Futures

    Multivariate Models: The Monte Carlo Analysis

    This decision-making tool integrates the idea that every decision has an impact on overall risk.
  4. Professionals

    Style Matters In Financial Modeling

    If you're looking to get a job as an analyst, you'll need to know how to work it.
  5. Active Trading

    Introduction To Stationary And Non-Stationary Processes

    What to know about stationary and non-stationary processes before you try to model or forecast.
  6. Mutual Funds & ETFs

    ETF Analysis: Guggenheim Enhanced Short Dur

    Find out about the Guggenheim Enhanced Short Duration ETF, and learn detailed information about this fund that focuses on fixed-income securities.
  7. Mutual Funds & ETFs

    ETF Analysis: iShares Morningstar Small-Cap Value

    Find out about the Shares Morningstar Small-Cap Value ETF, and learn detailed information about this exchange-traded fund that focuses on small-cap equities.
  8. Mutual Funds & ETFs

    ETF Analysis: iShares MSCI KLD 400 Social

    Find out about the iShares MSCI KLD 400 Social exchange-traded fund, and learn detailed information about its characteristics, suitability and recommendations.
  9. Mutual Funds & ETFs

    ETF Analysis: iShares Agency Bond

    Find out about the iShares Agency Bond exchange-traded fund, and explore detailed analysis of the ETF that tracks U.S. government agency securities.
  10. Mutual Funds & ETFs

    ETF Analysis: PowerShares DWA SmallCap Momentum

    Find out about the PowerShares DWA SmallCap Momentum Portfolio ETF, and explore detailed analysis the fund's characteristics, suitability and recommendations.
RELATED FAQS
  1. Where do penny stocks trade?

    Generally, penny stocks are traded through the use of the Over the Counter Bulletin Board (OTCBB) and through pink sheets. ... Read Full Answer >>
  2. Where can I buy penny stocks?

    Some penny stocks, those using the definition of trading for less than $5 per share, are traded on regular exchanges such ... Read Full Answer >>
  3. How does the stock market react to changes in the Federal Funds Rate?

    The stock market reacts to changes in the federal funds rate in various ways depending on where it is in the business cycle. ... Read Full Answer >>
  4. What assumptions are made when conducting a t-test?

    The common assumptions made when doing a t-test include those regarding the scale of measurement, random sampling, normality ... Read Full Answer >>
  5. What are the requirements for being a Public Limited Company?

    The requirements for an entity to be considered a public limited company (PLC) include registration requirements, establishing ... Read Full Answer >>
  6. Is there a difference between financial spread betting and arbitrage?

    Financial spread betting is a type of speculation that involves a highly leveraged derivative product, whereas arbitrage ... Read Full Answer >>

You May Also Like

Hot Definitions
  1. Alligator Spread

    An unprofitable spread that occurs as a result of large commissions charged on the transaction, regardless of favorable market ...
  2. Tiger Cub Economies

    The four Southeast Asian economies of Indonesia, Malaysia, the Philippines and Thailand. Tiger cub economy indicates that ...
  3. Gorilla

    A company that dominates an industry without having a complete monopoly. A gorilla firm has large control of the pricing ...
  4. Elephants

    Slang for large institutions that have the funds to make high volumes trades. Due to the large volumes of stock that elephants ...
  5. Widow's Exemption

    In general terms, a widow's exemption refers to the amount that can be deducted from taxable income by a widow, thereby reducing ...
  6. Wedding Warrant

    A warrant that can only be exercised if the host asset, typically a bond or preferred stock, is surrendered. Until the call ...
Trading Center
×

You are using adblocking software

Want access to all of Investopedia? Add us to your “whitelist”
so you'll never miss a feature!