Overfitting

DEFINITION of 'Overfitting'

A modeling error which occurs when a function is too closely fit to a limited set of data points. Overfitting the model generally takes the form of making an overly complex model to explain idiosyncrasies in the data under study. In reality, the data being studied often has some degree of error or random noise within it. Thus attempting to make the model conform too closely to slightly inaccurate data can infect the model with substantial errors and reduce its predictive power.

BREAKING DOWN 'Overfitting'

Financial professionals must always be aware of the dangers of overfitting a model based on limited data. For instance, a common problem is using computer algorithms to search extensive databases of historical market data in order to find patterns. Given enough study, it is often possible to develop elaborate theorems which appear to predict things such as returns in the stock market with close accuracy. However, when applied to data outside of the sample, such theorems may likely prove to be merely an overfitting of a model to what were in reality just chance occurrences. In all cases, it is important to test a model against data which is outside of the sample used to develop it.

RELATED TERMS
  1. Model Risk

    A type of risk that occurs when a financial model used to measure ...
  2. Stochastic Modeling

    A method of financial modeling in which one or more variables ...
  3. Business Model

    The plan implemented by a company to generate revenue and make ...
  4. Error Term

    A variable in a statistical and/or mathematical model, which ...
  5. Hull–White Model

    A single-factor interest model used to price derivatives. The ...
  6. Financial Modeling

    The process by which a firm constructs a financial representation ...
Related Articles
  1. Investing

    Calculating (Small) Company Credit Risk

    Determining creditworthiness of smaller and medium-sized corporations isn't as easy as for larger companies, but these tips can help.
  2. Trading

    Build a Profitable Trading Model In 7 Easy Steps

    Trading models can provide a powerful tool for building profit. Traders can use and customize existing trading models or build an original model. This article provides seven steps to building ...
  3. Financial Advisor

    Predictive Analytics Drives Return for Investors

    A new industry of predictive analysis has developed to make sense of big data and give investors real-time buy and sell recommendations based on the patterns forming in the data long before traditional ...
  4. Investing

    What is a Business Model?

    Business model is the term for a company’s plan as to how it will earn revenue.
  5. Investing

    Understanding Financial Models

    A financial model is a representation of some aspects of a firm or given security. It uses historical numbers to create calculations that inform financial recommendations or predict future financial ...
  6. Markets

    Getting To Know Business Models

    Learning how to assess business models helps investors identify companies that are the best investments.
  7. Investing

    The Basics Of Business Forecasting

    Discover the methods behind financial forecasts and the risks inherent when we seek to predict the future.
  8. Markets

    How Do Professionals Forecast Crude Oil Prices?

    Discover how the future price of oil is predicted with a weighted combination of mathematical tools. Economists largely use five main models as their base.
  9. Trading

    How to Build A Forex Trading Model

    Forex trading markets work 24/7, providing ample opportunities to make profitable trades. How can you build a profitable forex trading model for yourself?
  10. Trading

    The Fed Model And Stock Valuation: What It Does And Does Not Tell Us

    Learn about this popular stock market valuation model and how accurate it has been over the years.
RELATED FAQS
  1. What is the average return on equity for a company in the electronics sector?

    Learn about the Black-Scholes option pricing model and the binomial options model, and understand the advantages of the binomial ... Read Answer >>
  2. What is the difference between financial forecasting and financial modelling?

    Understand the difference between financial forecasting and financial modeling, and learn why a company should conduct both ... Read Answer >>
  3. What are some examples of different types of business models in major industries?

    Learn what types of business models are currently being used in the marketplace as well as examples of models that work for ... Read Answer >>
  4. What is the point of developing a business model?

    Learn some of the benefits of developing a business model and how business models are used. Consider an example of business ... Read Answer >>
  5. What is a relative standard error?

    Find out how to distinguish between mean, standard deviation, standard error and relative standard error in statistical survey ... Read Answer >>
  6. What do you need to know to create a business model?

    Learn what a business model is, its importance and the primary elements that are needed in order to create a successful business ... Read Answer >>
Hot Definitions
  1. Duration

    A measure of the sensitivity of the price (the value of principal) of a fixed-income investment to a change in interest rates. ...
  2. Dove

    An economic policy advisor who promotes monetary policies that involve the maintenance of low interest rates, believing that ...
  3. Cyclical Stock

    An equity security whose price is affected by ups and downs in the overall economy. Cyclical stocks typically relate to companies ...
  4. Front Running

    The unethical practice of a broker trading an equity based on information from the analyst department before his or her clients ...
  5. After-Hours Trading - AHT

    Trading after regular trading hours on the major exchanges. The increasing popularity of electronic communication networks ...
  6. Omnibus Account

    An account between two futures merchants (brokers). It involves the transaction of individual accounts which are combined ...
Trading Center