Overfitting

DEFINITION of 'Overfitting'

A modeling error which occurs when a function is too closely fit to a limited set of data points. Overfitting the model generally takes the form of making an overly complex model to explain idiosyncrasies in the data under study. In reality, the data being studied often has some degree of error or random noise within it. Thus attempting to make the model conform too closely to slightly inaccurate data can infect the model with substantial errors and reduce its predictive power.

BREAKING DOWN 'Overfitting'

Financial professionals must always be aware of the dangers of overfitting a model based on limited data. For instance, a common problem is using computer algorithms to search extensive databases of historical market data in order to find patterns. Given enough study, it is often possible to develop elaborate theorems which appear to predict things such as returns in the stock market with close accuracy. However, when applied to data outside of the sample, such theorems may likely prove to be merely an overfitting of a model to what were in reality just chance occurrences. In all cases, it is important to test a model against data which is outside of the sample used to develop it.

RELATED TERMS
  1. Model Risk

    A type of risk that occurs when a financial model used to measure ...
  2. Coefficient of Determination

    A measure used in statistical model analysis to assess how well ...
  3. Stochastic Modeling

    A method of financial modeling in which one or more variables ...
  4. Business Model

    The plan implemented by a company to generate revenue and make ...
  5. Error Term

    A variable in a statistical and/or mathematical model, which ...
  6. Financial Modeling

    The process by which a firm constructs a financial representation ...
Related Articles
  1. Trading Systems & Software

    Build a Profitable Trading Model In 7 Easy Steps

    Trading models can provide a powerful tool for building profit. Traders can use and customize existing trading models or build an original model. This article provides seven steps to building ...
  2. Investing

    Predictive Analytics Drives Return for Investors

    A new industry of predictive analysis has developed to make sense of big data and give investors real-time buy and sell recommendations based on the patterns forming in the data long before traditional ...
  3. Economics

    What is a Business Model?

    Business model is the term for a company’s plan as to how it will earn revenue.
  4. Investing

    Understanding Financial Models

    A financial model is a representation of some aspects of a firm or given security. It uses historical numbers to create calculations that inform financial recommendations or predict future financial ...
  5. Personal Finance

    The Basics Of Business Forecasting

    Discover the methods behind financial forecasts and the risks inherent when we seek to predict the future.
  6. Forex Strategies

    How to Build A Forex Trading Model

    Forex trading markets work 24/7, providing ample opportunities to make profitable trades. How can you build a profitable forex trading model for yourself?
  7. Investing News

    How Do Professionals Forecast Crude Oil Prices?

    Discover how the future price of oil is predicted with a weighted combination of mathematical tools. Economists largely use five main models as their base.
  8. Professionals

    Sampling Considerations

    CFA Level 1 - Sampling Considerations
  9. Forex Strategies

    How To Build A Forex Trading Model

    The forex market is volatile, but a forex trading model with clear, step-by-step rules based on a sound strategy can help decrease losing trades.
  10. Active Trading Fundamentals

    How Big Data Has Changed Finance

    The vast proliferation of data and increasing technological complexities continues to transform the way industries operate and compete.
RELATED FAQS
  1. What is the average return on equity for a company in the electronics sector?

    Learn about the Black-Scholes option pricing model and the binomial options model, and understand the advantages of the binomial ... Read Answer >>
  2. What is the difference between financial forecasting and financial modelling?

    Understand the difference between financial forecasting and financial modeling, and learn why a company should conduct both ... Read Answer >>
  3. What are some examples of different types of business models in major industries?

    Learn what types of business models are currently being used in the marketplace as well as examples of models that work for ... Read Answer >>
  4. What is a relative standard error?

    Find out how to distinguish between mean, standard deviation, standard error and relative standard error in statistical survey ... Read Answer >>
  5. What is the point of developing a business model?

    Learn some of the benefits of developing a business model and how business models are used. Consider an example of business ... Read Answer >>
  6. What do you need to know to create a business model?

    Learn what a business model is, its importance and the primary elements that are needed in order to create a successful business ... Read Answer >>
Hot Definitions
  1. Law Of Demand

    A microeconomic law that states that, all other factors being equal, as the price of a good or service increases, consumer ...
  2. Cost Of Debt

    The effective rate that a company pays on its current debt. This can be measured in either before- or after-tax returns; ...
  3. Yield Curve

    A line that plots the interest rates, at a set point in time, of bonds having equal credit quality, but differing maturity ...
  4. Stop-Limit Order

    An order placed with a broker that combines the features of stop order with those of a limit order. A stop-limit order will ...
  5. Keynesian Economics

    An economic theory of total spending in the economy and its effects on output and inflation. Keynesian economics was developed ...
  6. Society for Worldwide Interbank Financial Telecommunications ...

    A member-owned cooperative that provides safe and secure financial transactions for its members. Established in 1973, the ...
Trading Center