DEFINITION of 'Overfitting'

A modeling error which occurs when a function is too closely fit to a limited set of data points. Overfitting the model generally takes the form of making an overly complex model to explain idiosyncrasies in the data under study. In reality, the data being studied often has some degree of error or random noise within it. Thus attempting to make the model conform too closely to slightly inaccurate data can infect the model with substantial errors and reduce its predictive power.

BREAKING DOWN 'Overfitting'

Financial professionals must always be aware of the dangers of overfitting a model based on limited data. For instance, a common problem is using computer algorithms to search extensive databases of historical market data in order to find patterns. Given enough study, it is often possible to develop elaborate theorems which appear to predict things such as returns in the stock market with close accuracy. However, when applied to data outside of the sample, such theorems may likely prove to be merely an overfitting of a model to what were in reality just chance occurrences. In all cases, it is important to test a model against data which is outside of the sample used to develop it.

  1. Multiple Linear Regression - MLR

    A statistical technique that uses several explanatory variables ...
  2. Regression

    A statistical measure that attempts to determine the strength ...
  3. Non-Sampling Error

    A statistical error caused by human error to which a specific ...
  4. Stochastic Modeling

    A method of financial modeling in which one or more variables ...
  5. Financial Modeling

    The process by which a firm constructs a financial representation ...
  6. Qualitative Analysis

    Securities analysis that uses subjective judgment based on nonquantifiable ...
Related Articles
  1. Mutual Funds & ETFs

    Build A Model Portfolio With Style Investing

    This sophisticated approach will add flair to your returns.
  2. Fundamental Analysis

    Do-It-Yourself Analyst Predictions

    Regular investors can build their own financial models using the mosaic theory.
  3. Active Trading

    Introduction To Stationary And Non-Stationary Processes

    What to know about stationary and non-stationary processes before you try to model or forecast.
  4. Options & Futures

    Multivariate Models: The Monte Carlo Analysis

    This decision-making tool integrates the idea that every decision has an impact on overall risk.
  5. Professionals

    Style Matters In Financial Modeling

    If you're looking to get a job as an analyst, you'll need to know how to work it.
  6. Mutual Funds & ETFs

    Top 3 Muni California Mutual Funds

    Discover analyses of the top three California municipal bond mutual funds, and learn about their characteristics, historical performance and suitability.
  7. Investing

    How to Win More by Losing Less in Today’s Markets

    The further you fall, the harder it is to climb back up. It’s a universal truth that is painfully apparent in the investing world.
  8. Investing

    What is Descriptive Statistics?

    Descriptive statistics is the term applied to meaningful data analysis.
  9. Fundamental Analysis

    Value Investing Strategies in a Volatile Market

    Volatile markets are a scary time for uneducated investors, but value investors use volatile periods as an opportunity to buy stocks at a discount.
  10. Fundamental Analysis

    Create a Monte Carlo Simulation Using Excel

    How to apply the Monte Carlo Simulation principles to a game of dice using Microsoft Excel.
  1. Is Colombia an emerging market economy?

    Colombia meets the criteria of an emerging market economy. The South American country has a much lower gross domestic product, ... Read Full Answer >>
  2. Where do penny stocks trade?

    Generally, penny stocks are traded through the use of the Over the Counter Bulletin Board (OTCBB) and through pink sheets. ... Read Full Answer >>
  3. Where can I buy penny stocks?

    Some penny stocks, those using the definition of trading for less than $5 per share, are traded on regular exchanges such ... Read Full Answer >>
  4. How does the stock market react to changes in the Federal Funds Rate?

    The stock market reacts to changes in the federal funds rate in various ways depending on where it is in the business cycle. ... Read Full Answer >>
  5. What assumptions are made when conducting a t-test?

    The common assumptions made when doing a t-test include those regarding the scale of measurement, random sampling, normality ... Read Full Answer >>
  6. What are the requirements for being a Public Limited Company?

    The requirements for an entity to be considered a public limited company (PLC) include registration requirements, establishing ... Read Full Answer >>

You May Also Like

Hot Definitions
  1. Real Estate Investment Trust - REIT

    A REIT is a type of security that invests in real estate through property or mortgages and often trades on major exchanges ...
  2. Section 1231 Property

    A tax term relating to depreciable business property that has been held for over a year. Section 1231 property includes buildings, ...
  3. Term Deposit

    A deposit held at a financial institution that has a fixed term, and guarantees return of principal.
  4. Zero-Sum Game

    A situation in which one person’s gain is equivalent to another’s loss, so that the net change in wealth or benefit is zero. ...
  5. Capitalization Rate

    The rate of return on a real estate investment property based on the income that the property is expected to generate.
  6. Gross Profit

    A company's total revenue (equivalent to total sales) minus the cost of goods sold. Gross profit is the profit a company ...
Trading Center
You are using adblocking software

Want access to all of Investopedia? Add us to your “whitelist”
so you'll never miss a feature!