Overfitting

DEFINITION of 'Overfitting'

A modeling error which occurs when a function is too closely fit to a limited set of data points. Overfitting the model generally takes the form of making an overly complex model to explain idiosyncrasies in the data under study. In reality, the data being studied often has some degree of error or random noise within it. Thus attempting to make the model conform too closely to slightly inaccurate data can infect the model with substantial errors and reduce its predictive power.

BREAKING DOWN 'Overfitting'

Financial professionals must always be aware of the dangers of overfitting a model based on limited data. For instance, a common problem is using computer algorithms to search extensive databases of historical market data in order to find patterns. Given enough study, it is often possible to develop elaborate theorems which appear to predict things such as returns in the stock market with close accuracy. However, when applied to data outside of the sample, such theorems may likely prove to be merely an overfitting of a model to what were in reality just chance occurrences. In all cases, it is important to test a model against data which is outside of the sample used to develop it.

RELATED TERMS
  1. Model Risk

    A type of risk that occurs when a financial model used to measure ...
  2. Coefficient of Determination

    A measure used in statistical model analysis to assess how well ...
  3. Stochastic Modeling

    A method of financial modeling in which one or more variables ...
  4. Business Model

    The plan implemented by a company to generate revenue and make ...
  5. Error Term

    A variable in a statistical and/or mathematical model, which ...
  6. Financial Modeling

    The process by which a firm constructs a financial representation ...
Related Articles
  1. Investing

    Predictive Analytics Drives Return for Investors

    A new industry of predictive analysis has developed to make sense of big data and give investors real-time buy and sell recommendations based on the patterns forming in the data long before traditional ...
  2. Economics

    What is a Business Model?

    Business model is the term for a company’s plan as to how it will earn revenue.
  3. Investing

    Understanding Financial Models

    A financial model is a representation of some aspects of a firm or given security. It uses historical numbers to create calculations that inform financial recommendations or predict future financial ...
  4. Personal Finance

    The Basics Of Business Forecasting

    Discover the methods behind financial forecasts and the risks inherent when we seek to predict the future.
  5. Forex Strategies

    How to Build A Forex Trading Model

    Forex trading markets work 24/7, providing ample opportunities to make profitable trades. How can you build a profitable forex trading model for yourself?
  6. Investing News

    How Do Professionals Forecast Crude Oil Prices?

    Discover how the future price of oil is predicted with a weighted combination of mathematical tools. Economists largely use five main models as their base.
  7. Forex Strategies

    How To Build A Forex Trading Model

    The forex market is volatile, but a forex trading model with clear, step-by-step rules based on a sound strategy can help decrease losing trades.
  8. Active Trading Fundamentals

    How Big Data Has Changed Finance

    The vast proliferation of data and increasing technological complexities continues to transform the way industries operate and compete.
  9. Professionals

    DCF Vs. Comparables: Which One To Use

    DCF and Comparables models are widely used in equity valuation. We explain the pros and cons of each method.
  10. Professionals

    The Best Financial Modeling Courses for Investment Bankers

    Obtain information, both general and comparative, about the best available financial modeling courses for individuals pursuing a career in investment banking.
RELATED FAQS
  1. What is the average return on equity for a company in the electronics sector?

    Learn about the Black-Scholes option pricing model and the binomial options model, and understand the advantages of the binomial ... Read Answer >>
  2. What is the difference between financial forecasting and financial modelling?

    Understand the difference between financial forecasting and financial modeling, and learn why a company should conduct both ... Read Answer >>
  3. What are some examples of different types of business models in major industries?

    Learn what types of business models are currently being used in the marketplace as well as examples of models that work for ... Read Answer >>
  4. What is a relative standard error?

    Find out how to distinguish between mean, standard deviation, standard error and relative standard error in statistical survey ... Read Answer >>
  5. What is the point of developing a business model?

    Learn some of the benefits of developing a business model and how business models are used. Consider an example of business ... Read Answer >>
  6. What do you need to know to create a business model?

    Learn what a business model is, its importance and the primary elements that are needed in order to create a successful business ... Read Answer >>
Hot Definitions
  1. Labor Market

    The labor market refers to the supply and demand for labor, in which employees provide the supply and employers the demand. ...
  2. Demand Curve

    The demand curve is a graphical representation of the relationship between the price of a good or service and the quantity ...
  3. Goldilocks Economy

    An economy that is not so hot that it causes inflation, and not so cold that it causes a recession. This term is used to ...
  4. White Squire

    Very similar to a "white knight", but instead of purchasing a majority interest, the squire purchases a lesser interest in ...
  5. MACD Technical Indicator

    Moving Average Convergence Divergence (or MACD) is a trend-following momentum indicator that shows the relationship between ...
  6. Over-The-Counter - OTC

    Over-The-Counter (or OTC) is a security traded in some context other than on a formal exchange such as the NYSE, TSX, AMEX, ...
Trading Center