Overfitting

DEFINITION of 'Overfitting'

A modeling error which occurs when a function is too closely fit to a limited set of data points. Overfitting the model generally takes the form of making an overly complex model to explain idiosyncrasies in the data under study. In reality, the data being studied often has some degree of error or random noise within it. Thus attempting to make the model conform too closely to slightly inaccurate data can infect the model with substantial errors and reduce its predictive power.

BREAKING DOWN 'Overfitting'

Financial professionals must always be aware of the dangers of overfitting a model based on limited data. For instance, a common problem is using computer algorithms to search extensive databases of historical market data in order to find patterns. Given enough study, it is often possible to develop elaborate theorems which appear to predict things such as returns in the stock market with close accuracy. However, when applied to data outside of the sample, such theorems may likely prove to be merely an overfitting of a model to what were in reality just chance occurrences. In all cases, it is important to test a model against data which is outside of the sample used to develop it.

RELATED TERMS
  1. Financial Modeling

    The process by which a firm constructs a financial representation ...
  2. Stochastic Modeling

    A method of financial modeling in which one or more variables ...
  3. Non-Sampling Error

    A statistical error caused by human error to which a specific ...
  4. Multiple Linear Regression - MLR

    A statistical technique that uses several explanatory variables ...
  5. Regression

    A statistical measure that attempts to determine the strength ...
  6. Value Investing

    The strategy of selecting stocks that trade for less than their ...
Related Articles
  1. Mutual Funds & ETFs

    Build A Model Portfolio With Style Investing

    This sophisticated approach will add flair to your returns.
  2. Fundamental Analysis

    Do-It-Yourself Analyst Predictions

    Regular investors can build their own financial models using the mosaic theory.
  3. Options & Futures

    Multivariate Models: The Monte Carlo Analysis

    This decision-making tool integrates the idea that every decision has an impact on overall risk.
  4. Professionals

    Style Matters In Financial Modeling

    If you're looking to get a job as an analyst, you'll need to know how to work it.
  5. Active Trading

    Introduction To Stationary And Non-Stationary Processes

    What to know about stationary and non-stationary processes before you try to model or forecast.
  6. Stock Analysis

    Are U.S. Stocks Still the Place To Be in 2016?

    Understand why U.S. stocks are absolutely the place to be in 2016, even though the year has gotten off to an awful start for the market.
  7. Term

    Understanding Market Price and Its Changes

    An asset’s or service’s market price is the current price at which it can be bought and sold.
  8. Options & Futures

    What Does Quadruple Witching Mean?

    In a financial context, quadruple witching refers to the day on which contracts for stock index futures, index options, and single stock futures expire.
  9. Professionals

    Is A Stockbroker Career For You?

    Becoming a stockbroker requires a broad skill set and the willingness to put in long hours. But the rewards can be enormous.
  10. Investing Basics

    How to Pick A Stock

    The first step in picking stock is to determine your goals.
RELATED FAQS
  1. Do plane tickets get cheaper closer to the date of departure?

    The price of flights usually increases one month prior to the date of departure. Flights are usually cheapest between three ... Read Full Answer >>
  2. Is Colombia an emerging market economy?

    Colombia meets the criteria of an emerging market economy. The South American country has a much lower gross domestic product, ... Read Full Answer >>
  3. Where do penny stocks trade?

    Generally, penny stocks are traded through the use of the Over the Counter Bulletin Board (OTCBB) and through pink sheets. ... Read Full Answer >>
  4. Where can I buy penny stocks?

    Some penny stocks, those using the definition of trading for less than $5 per share, are traded on regular exchanges such ... Read Full Answer >>
  5. How does the stock market react to changes in the Federal Funds Rate?

    The stock market reacts to changes in the federal funds rate in various ways depending on where it is in the business cycle. ... Read Full Answer >>
  6. What assumptions are made when conducting a t-test?

    The common assumptions made when doing a t-test include those regarding the scale of measurement, random sampling, normality ... Read Full Answer >>
Hot Definitions
  1. Socially Responsible Investment - SRI

    An investment that is considered socially responsible because of the nature of the business the company conducts. Common ...
  2. Inverted Yield Curve

    An interest rate environment in which long-term debt instruments have a lower yield than short-term debt instruments of the ...
  3. Presidential Election Cycle (Theory)

    A theory developed by Yale Hirsch that states that U.S. stock markets are weakest in the year following the election of a ...
  4. Super Bowl Indicator

    An indicator based on the belief that a Super Bowl win for a team from the old AFL (AFC division) foretells a decline in ...
  5. Flight To Quality

    The action of investors moving their capital away from riskier investments to the safest possible investment vehicles. This ...
  6. Discouraged Worker

    A person who is eligible for employment and is able to work, but is currently unemployed and has not attempted to find employment ...
Trading Center