DEFINITION of 'Overfitting'

Overfitting is a modeling error which occurs when a function is too closely fit to a limited set of data points. Overfitting the model generally takes the form of making an overly complex model to explain idiosyncrasies in the data under study. In reality, the data often studied has some degree of error or random noise within it. Thus attempting to make the model conform too closely to slightly inaccurate data can infect the model with substantial errors and reduce its predictive power.

BREAKING DOWN 'Overfitting'

Financial professionals must always be aware of the dangers of overfitting a model based on limited data. For instance, a common problem is using computer algorithms to search extensive databases of historical market data in order to find patterns. Given enough study, it is often possible to develop elaborate theorems which appear to predict things such as returns in the stock market with close accuracy. However, when applied to data outside of the sample, such theorems may likely prove to be merely an overfitting of a model to what were in reality just chance occurrences. In all cases, it is important to test a model against data which is outside of the sample used to develop it.

RELATED TERMS
  1. Standard Error

    Standard error is the standard deviation of a sample population.
  2. Sampling Error

    A sampling error is a statistical error that occurs when an analyst ...
  3. Accounting Error

    An accounting error is an error in an accounting entry that was ...
  4. Business Model

    A business model is a company's plan for generating revenues ...
  5. Predictive Modeling

    Predictive modeling is the process of using known results to ...
  6. Error Resolution

    Error resolution is a procedure that allows consumers to dispute ...
Related Articles
  1. Tech

    Predictive Analytics Drives Return for Investors

    A new industry of predictive analysis has developed to make sense of big data and give investors real-time buy and sell recommendations based on the patterns forming in the data long before traditional ...
  2. Small Business

    Calculating (Small) Company Credit Risk

    Determining creditworthiness of smaller and medium-sized corporations isn't as easy as for larger companies, but these tips can help.
  3. Investing

    Understanding the Modigliani-Miller Theorem

    The Modigliani-Miller (M&M) theorem is used in financial and economic studies to analyze the value of a firm, such as a business or a corporation.
  4. Tech

    Coding Your Own Algo Trading Robot

    In order to be successful, it is important not just to follow a set of guidelines but also to understand how those guidelines — and the market — are working.
  5. Insights

    The Fed Model And Stock Valuation: What It Does And Does Not Tell Us

    Learn about this popular stock market valuation model and how accurate it has been over the years.
  6. Financial Advisor

    Advisor Fees: A Look At the Retainer Model

    Financial advisors may want to become familiar with new payment models sooner rather than later in order to proactively meet market demands.
  7. Personal Finance

    Discounted cash flows or comparables: Which to use

    DCF and comparables models are widely used in equity valuation, and here we'll explain the pros and cons of each method.
  8. Tech

    Big Data in Financial Services Comes With Some Risks

    Big data is playing a larger role in finance but its application does not come without risks.
  9. Personal Finance

    The Best Financial Modeling Courses for Investment Bankers

    Obtain information, both general and comparative, about the best available financial modeling courses for individuals pursuing a career in investment banking.
  10. Investing

    Style Matters In Financial Modeling

    If you're looking to get a job as an analyst, you'll need to know how to work it.
RELATED FAQS
  1. What is the difference between financial forecasting and financial modeling?

    Understand the difference between financial forecasting and financial modeling, and learn why a company should conduct both ... Read Answer >>
  2. What is the difference between financial forecasting and financial modeling?

    Understand the difference between financial forecasting and financial modeling, and learn why a company should conduct both ... Read Answer >>
  3. What percentage of the population do you need in a representative sample?

    Learn about representative samples and how they are used in conjunction with other strategies to create useful data with ... Read Answer >>
  4. What's the difference between a representative sample and a random sample?

    Explore the differences between representative samples and random samples, and discover how they are often used in tandem ... Read Answer >>
  5. When is it better to use systematic over simple random sampling?

    Learn when systematic sampling is better than simple random sampling, such as in the absence of data patterns and when there ... Read Answer >>
  6. What are the disadvantages of using a simple random sample to approximate a larger ...

    Learn here what a simple random sample is, how researchers use it as a statistical tool and the disadvantages it carries ... Read Answer >>
Trading Center