Overfitting

Definition of 'Overfitting'


A modeling error which occurs when a function is too closely fit to a limited set of data points. Overfitting the model generally takes the form of making an overly complex model to explain idiosyncrasies in the data under study. In reality, the data being studied often has some degree of error or random noise within it. Thus attempting to make the model conform too closely to slightly inaccurate data can infect the model with substantial errors and reduce its predictive power.

Investopedia explains 'Overfitting'


Financial professionals must always be aware of the dangers of overfitting a model based on limited data. For instance, a common problem is using computer algorithms to search extensive databases of historical market data in order to find patterns. Given enough study, it is often possible to develop elaborate theorems which appear to predict things such as returns in the stock market with close accuracy. However, when applied to data outside of the sample, such theorems may likely prove to be merely an overfitting of a model to what were in reality just chance occurrences. In all cases, it is important to test a model against data which is outside of the sample used to develop it.



comments powered by Disqus
Hot Definitions
  1. Joint Venture - JV

    A business arrangement in which two or more parties agree to pool their resources for the purpose of accomplishing a specific task. This task can be a new project or any other business activity. In a joint venture (JV), each of the participants is responsible for profits, losses and costs associated with it.
  2. Aggregate Risk

    The exposure of a bank, financial institution, or any type of major investor to foreign exchange contracts - both spot and forward - from a single counterparty or client. Aggregate risk in forex may also be defined as the total exposure of an entity to changes or fluctuations in currency rates.
  3. Organic Growth

    The growth rate that a company can achieve by increasing output and enhancing sales. This excludes any profits or growth acquired from takeovers, acquisitions or mergers. Takeovers, acquisitions and mergers do not bring about profits generated within the company, and are therefore not considered organic.
  4. Family Limited Partnership - FLP

    A type of partnership designed to centralize family business or investment accounts. FLPs pool together a family's assets into one single family-owned business partnership that family members own shares of. FLPs are frequently used as an estate tax minimization strategy, as shares in the FLP can be transferred between generations, at lower taxation rates than would be applied to the partnership's holdings.
  5. Yield Burning

    The illegal practice of underwriters marking up the prices on bonds for the purpose of reducing the yield on the bond. This practice, referred to as "burning the yield," is done after the bond is placed in escrow for an investor who is awaiting repayment.
  6. Marginal Analysis

    An examination of the additional benefits of an activity compared to the additional costs of that activity. Companies use marginal analysis as a decision-making tool to help them maximize their profits. Individuals unconsciously use marginal analysis to make a host of everyday decisions. Marginal analysis is also widely used in microeconomics when analyzing how a complex system is affected by marginal manipulation of its comprising variables.
Trading Center