DEFINITION of 'Overfitting'

Overfitting is a modeling error which occurs when a function is too closely fit to a limited set of data points. Overfitting the model generally takes the form of making an overly complex model to explain idiosyncrasies in the data under study. In reality, the data often studied has some degree of error or random noise within it. Thus attempting to make the model conform too closely to slightly inaccurate data can infect the model with substantial errors and reduce its predictive power.

BREAKING DOWN 'Overfitting'

Financial professionals must always be aware of the dangers of overfitting a model based on limited data. For instance, a common problem is using computer algorithms to search extensive databases of historical market data in order to find patterns. Given enough study, it is often possible to develop elaborate theorems which appear to predict things such as returns in the stock market with close accuracy. However, when applied to data outside of the sample, such theorems may likely prove to be merely an overfitting of a model to what were in reality just chance occurrences. In all cases, it is important to test a model against data which is outside of the sample used to develop it.

  1. Model Risk

    Model risk occurs when a financial model used to measure a firm's ...
  2. Central Limit Theorem - CLT

    A statistical theory that states that given a sufficiently large ...
  3. Business Model

    A business model is a company's plan for generating revenues ...
  4. Non-Sampling Error

    A non-sampling error is an error that results during data collection, ...
  5. Predictive Modeling

    Predictive modeling is the process of using known results to ...
  6. Error Term

    A variable in a statistical and/or mathematical model, which ...
Related Articles
  1. Investing

    The Basics Of Business Forecasting

    Discover the methods behind financial forecasts and the risks inherent when we seek to predict the future.
  2. Investing

    3 Reasons Tracking Error Matters

    Discover three ways investors can use tracking error to measure performance for a mutual fund or ETF, whether indexed or actively managed.
  3. Trading

    How to Build A Forex Trading Model

    Forex trading markets work 24/7, providing ample opportunities to make profitable trades. How can you build a profitable forex trading model for yourself?
  4. Investing

    Understanding the Modigliani-Miller Theorem

    The Modigliani-Miller (M&M) theorem is used in financial and economic studies to analyze the value of a firm, such as a business or a corporation.
  5. Financial Advisor

    Advisor Fees: A Look At the Retainer Model

    Financial advisors may want to become familiar with new payment models sooner rather than later in order to proactively meet market demands.
  6. Tech

    How to Code Your Own Algo Trading Robot

    Ever wanted to become an algorithmic trader with the ability to code your own trading robot?
  7. Personal Finance

    Discounted cash flows or comparables: Which to use

    DCF and comparables models are widely used in equity valuation, and here we'll explain the pros and cons of each method.
  8. Investing

    Digging Into The Dividend Discount Model

    The DDM is one of the most foundational of financial theories, but it's only as good as its assumptions.
  9. Investing

    How to Choose the Best Stock Valuation Method

    Don't be overwhelmed by the many valuation techniques out there - knowing a few characteristics about a company will help you pick the best one.
  10. Tech

    Big Data in Financial Services Comes With Some Risks

    Big data is playing a larger role in finance but its application does not come without risks.
  1. What is a relative standard error?

    Find out how to distinguish between mean, standard deviation, standard error and relative standard error in statistical survey ... Read Answer >>
  2. What are the main principles of the Heckscher-Ohlin Model?

    Learn about the four main principles of the Heckscher-Olin model, and find out how the model describes patterns of commerce ... Read Answer >>
  3. What is the difference between financial forecasting and financial modeling?

    Understand the difference between financial forecasting and financial modeling, and learn why a company should conduct both ... Read Answer >>
  4. How do I calculate the standard error using Matlab?

    Learn how to calculate the standard error for a sample statistical measure, such as the sample mean, using standard Matlab ... Read Answer >>
  5. What is the average return on equity for a company in the electronics sector?

    Learn about the Black-Scholes option pricing model and the binomial options model, and understand the advantages of the binomial ... Read Answer >>
  6. How is the standard error used in trading?

    Understand how the standard error is used in statistics and what it measures. Learn how the standard error is used in trading ... Read Answer >>
Hot Definitions
  1. Entrepreneur

    An Entrepreneur is an individual who founds and runs a small business and assumes all the risk and reward of the venture. ...
  2. Money Market

    The money market is a segment of the financial market in which financial instruments with high liquidity and very short maturities ...
  3. Perfect Competition

    Pure or perfect competition is a theoretical market structure in which a number of criteria such as perfect information and ...
  4. Compound Interest

    Compound Interest is interest calculated on the initial principal and also on the accumulated interest of previous periods ...
  5. Income Statement

    A financial statement that measures a company's financial performance over a specific accounting period. Financial performance ...
  6. Leverage Ratio

    A leverage ratio is any one of several financial measurements that look at how much capital comes in the form of debt, or ...
Trading Center