DEFINITION of 'Overfitting'

Overfitting is a modeling error which occurs when a function is too closely fit to a limited set of data points. Overfitting the model generally takes the form of making an overly complex model to explain idiosyncrasies in the data under study. In reality, the data often studied has some degree of error or random noise within it. Thus attempting to make the model conform too closely to slightly inaccurate data can infect the model with substantial errors and reduce its predictive power.

BREAKING DOWN 'Overfitting'

Financial professionals must always be aware of the dangers of overfitting a model based on limited data. For instance, a common problem is using computer algorithms to search extensive databases of historical market data in order to find patterns. Given enough study, it is often possible to develop elaborate theorems which appear to predict things such as returns in the stock market with close accuracy. However, when applied to data outside of the sample, such theorems may likely prove to be merely an overfitting of a model to what were in reality just chance occurrences. In all cases, it is important to test a model against data which is outside of the sample used to develop it.

RELATED TERMS
  1. Model Risk

    Model risk occurs when a financial model used to measure a firm's ...
  2. Central Limit Theorem - CLT

    The Central Limit Theorem - CLT states that when samples from ...
  3. Error Term

    An error term is a variable in a statistical model, which is ...
  4. Standard Error

    Standard error is the standard deviation of a sample population.
  5. Non-Sampling Error

    A non-sampling error is an error that results during data collection, ...
  6. Sampling Error

    A sampling error is a statistical error that occurs when an analyst ...
Related Articles
  1. Investing

    Business forecasting: Understanding the basics

    Discover the methods behind financial forecasts and the risks inherent when we seek to predict the future.
  2. Investing

    Understanding the Modigliani-Miller Theorem

    The Modigliani-Miller (M&M) theorem is used in financial and economic studies to analyze the value of a firm, such as a business or a corporation.
  3. Trading

    How to Build A Forex Trading Model

    Forex trading markets work 24/7, providing ample opportunities to make profitable trades. How can you build a profitable forex trading model for yourself?
  4. Personal Finance

    Discounted cash flows or comparables: Which to use

    DCF and comparables models are widely used in equity valuation, and here we'll explain the pros and cons of each method.
  5. Investing

    Financial Forecasting: The Bayesian Method

    This method can help refine probability estimates using an intuitive process.
  6. Investing

    Digging Into The Dividend Discount Model

    The DDM is one of the most foundational of financial theories, but it's only as good as its assumptions.
  7. Personal Finance

    The Best Financial Modeling Courses for Investment Bankers

    Obtain information, both general and comparative, about the best available financial modeling courses for individuals pursuing a career in investment banking.
  8. Investing

    Style Matters In Financial Modeling

    If you're looking to get a job as an analyst, you'll need to know how to work it.
  9. Investing

    Calculating Tracking Error

    Tracking error is the difference between the return on a portfolio or fund, and the benchmark it is expected to mirror (or track).
  10. Investing

    How to choose the best stock valuation method

    There are many valuation methods available to investors, each with unique characteristics. Here, we'll explore the most common valuation methods – and when to use them.
RELATED FAQS
  1. What is a relative standard error?

    Find out how to distinguish between mean, standard deviation, standard error and relative standard error in statistical survey ... Read Answer >>
  2. What is the difference between financial forecasting and financial modeling?

    Understand the difference between financial forecasting and financial modeling, and learn why a company should conduct both ... Read Answer >>
  3. What is the difference between financial forecasting and financial modeling?

    Understand the difference between financial forecasting and financial modeling, and learn why a company should conduct both ... Read Answer >>
  4. How do I calculate the standard error using Matlab?

    Learn how to calculate the standard error for a sample statistical measure, such as the sample mean, using standard Matlab ... Read Answer >>
  5. What percentage of the population do you need in a representative sample?

    Learn about representative samples and how they are used in conjunction with other strategies to create useful data with ... Read Answer >>
  6. What are some examples of ways that sensitivity analysis can be used?

    Understand the concept of sensitivity analysis and learn about the wide variety of disciplines to which it can be applied. Read Answer >>
Hot Definitions
  1. Business Cycle

    The business cycle describes the rise and fall in production output of goods and services in an economy. Business cycles ...
  2. Futures Contract

    An agreement to buy or sell the underlying commodity or asset at a specific price at a future date.
  3. Yield Curve

    A yield curve is a line that plots the interest rates, at a set point in time, of bonds having equal credit quality, but ...
  4. Portfolio

    A portfolio is a grouping of financial assets such as stocks, bonds and cash equivalents, also their mutual, exchange-traded ...
  5. Gross Profit

    Gross profit is the profit a company makes after deducting the costs of making and selling its products, or the costs of ...
  6. Diversification

    Diversification is the strategy of investing in a variety of securities in order to lower the risk involved with putting ...
Trading Center