Overfitting

DEFINITION of 'Overfitting'

A modeling error which occurs when a function is too closely fit to a limited set of data points. Overfitting the model generally takes the form of making an overly complex model to explain idiosyncrasies in the data under study. In reality, the data being studied often has some degree of error or random noise within it. Thus attempting to make the model conform too closely to slightly inaccurate data can infect the model with substantial errors and reduce its predictive power.

BREAKING DOWN 'Overfitting'

Financial professionals must always be aware of the dangers of overfitting a model based on limited data. For instance, a common problem is using computer algorithms to search extensive databases of historical market data in order to find patterns. Given enough study, it is often possible to develop elaborate theorems which appear to predict things such as returns in the stock market with close accuracy. However, when applied to data outside of the sample, such theorems may likely prove to be merely an overfitting of a model to what were in reality just chance occurrences. In all cases, it is important to test a model against data which is outside of the sample used to develop it.

RELATED TERMS
  1. Model Risk

    A type of risk that occurs when a financial model used to measure ...
  2. Stochastic Modeling

    A method of financial modeling in which one or more variables ...
  3. Business Model

    The plan implemented by a company to generate revenue and make ...
  4. Error Term

    A variable in a statistical and/or mathematical model, which ...
  5. Hull–White Model

    A single-factor interest model used to price derivatives. The ...
  6. Financial Modeling

    The process by which a firm constructs a financial representation ...
Related Articles
  1. Financial Advisor

    Predictive Analytics Drives Return for Investors

    A new industry of predictive analysis has developed to make sense of big data and give investors real-time buy and sell recommendations based on the patterns forming in the data long before traditional ...
  2. Investing

    What is a Business Model?

    Business model is the term for a company’s plan as to how it will earn revenue.
  3. Investing

    Understanding Financial Models

    A financial model is a representation of some aspects of a firm or given security. It uses historical numbers to create calculations that inform financial recommendations or predict future financial ...
  4. Investing

    The Basics Of Business Forecasting

    Discover the methods behind financial forecasts and the risks inherent when we seek to predict the future.
  5. Markets

    How Do Professionals Forecast Crude Oil Prices?

    Discover how the future price of oil is predicted with a weighted combination of mathematical tools. Economists largely use five main models as their base.
  6. Trading

    How to Build A Forex Trading Model

    Forex trading markets work 24/7, providing ample opportunities to make profitable trades. How can you build a profitable forex trading model for yourself?
  7. Trading

    How To Build A Forex Trading Model

    The forex market is volatile, but a forex trading model with clear, step-by-step rules based on a sound strategy can help decrease losing trades.
  8. Investing

    DCF Vs. Comparables: Which One To Use

    DCF and Comparables models are widely used in equity valuation. We explain the pros and cons of each method.
  9. Trading

    How Big Data Has Changed Finance

    The vast proliferation of data and increasing technological complexities continues to transform the way industries operate and compete.
  10. Managing Wealth

    The Best Financial Modeling Courses for Investment Bankers

    Obtain information, both general and comparative, about the best available financial modeling courses for individuals pursuing a career in investment banking.
RELATED FAQS
  1. What is the average return on equity for a company in the electronics sector?

    Learn about the Black-Scholes option pricing model and the binomial options model, and understand the advantages of the binomial ... Read Answer >>
  2. What is the difference between financial forecasting and financial modelling?

    Understand the difference between financial forecasting and financial modeling, and learn why a company should conduct both ... Read Answer >>
  3. What are some examples of different types of business models in major industries?

    Learn what types of business models are currently being used in the marketplace as well as examples of models that work for ... Read Answer >>
  4. What is the point of developing a business model?

    Learn some of the benefits of developing a business model and how business models are used. Consider an example of business ... Read Answer >>
  5. What is a relative standard error?

    Find out how to distinguish between mean, standard deviation, standard error and relative standard error in statistical survey ... Read Answer >>
  6. What do you need to know to create a business model?

    Learn what a business model is, its importance and the primary elements that are needed in order to create a successful business ... Read Answer >>
Hot Definitions
  1. Sell-Off

    The rapid selling of securities, such as stocks, bonds and commodities. The increase in supply leads to a decline in the ...
  2. Brazil, Russia, India And China - BRIC

    An acronym for the economies of Brazil, Russia, India and China combined. It has been speculated that by 2050 these four ...
  3. Brexit

    The Brexit, an abbreviation of "British exit" that mirrors the term Grexit, refers to the possibility of Britain's withdrawal ...
  4. Underweight

    1. A situation where a portfolio does not hold a sufficient amount of a particular security when compared to the security's ...
  5. Russell 3000 Index

    A market capitalization weighted equity index maintained by the Russell Investment Group that seeks to be a benchmark of ...
  6. Enterprise Value (EV)

    A measure of a company's value, often used as an alternative to straightforward market capitalization. Enterprise value is ...
Trading Center