Overfitting

Definition of 'Overfitting'


A modeling error which occurs when a function is too closely fit to a limited set of data points. Overfitting the model generally takes the form of making an overly complex model to explain idiosyncrasies in the data under study. In reality, the data being studied often has some degree of error or random noise within it. Thus attempting to make the model conform too closely to slightly inaccurate data can infect the model with substantial errors and reduce its predictive power.

Investopedia explains 'Overfitting'


Financial professionals must always be aware of the dangers of overfitting a model based on limited data. For instance, a common problem is using computer algorithms to search extensive databases of historical market data in order to find patterns. Given enough study, it is often possible to develop elaborate theorems which appear to predict things such as returns in the stock market with close accuracy. However, when applied to data outside of the sample, such theorems may likely prove to be merely an overfitting of a model to what were in reality just chance occurrences. In all cases, it is important to test a model against data which is outside of the sample used to develop it.



comments powered by Disqus
Hot Definitions
  1. Leased Bank Guarantee

    A bank guarantee that is leased to a third party for a specific fee. The issuing bank will conduct due diligence on the creditworthiness of the customer looking to secure a bank guarantee, then lease a guarantee to that customer for a set amount of money and over a set period of time, typically less than two years.
  2. Degree Of Financial Leverage - DFL

    A ratio that measures the sensitivity of a company’s earnings per share (EPS) to fluctuations in its operating income, as a result of changes in its capital structure. Degree of Financial Leverage (DFL) measures the percentage change in EPS for a unit change in earnings before interest and taxes (EBIT).
  3. Jeff Bezos

    Self-made billionaire Jeff Bezos is famous for founding online retail giant Amazon.com.
  4. Re-fracking

    Re-fracking is the practice of returning to older wells that had been fracked in the recent past to capitalize on newer, more effective extraction technology. Re-fracking can be effective on especially tight oil deposits – where the shale products low yields – to extend their productivity.
  5. TIMP (acronym)

    'TIMP' is an acronym that stands for 'Turkey, Indonesia, Mexico and Philippines.' Similar to BRIC (Brazil, Russia, India and China), the acronym was coined by and investor/economist to group fast-growing emerging market economies in similar states of economic development.
  6. Pension Risk Transfer

    When a defined benefit pension provider offloads some or all of the plan’s risk – e.g.: retirement payment liabilities to former employee beneficiaries. The plan sponsor can do this by offering vested plan participants a lump-sum payment to voluntarily leave the plan, or by negotiating with an insurance company to take on the responsibility for paying benefits.
Trading Center