As pattern-seeking creatures, statistics have a peculiar hold on our minds. Quite a large number of decisions are undertaken on the basis of what statistics tell us. That is certainly true when it comes to government economic data and the blizzard of stats that come out every month; billions of dollars worth of value appears or vanishes on the basis of what these numbers say about the health, growth and direction of the economy, and the implications for company profits, interest rates and so on. (Can butter production help you predict the market's next move? Find out here. Read World's Wackiest Stock Indicators.)

TUTORIAL: Economic Indicators

Unfortunately, some of that faith seems to be misplaced. While great reliance is placed on government economic numbers and the financial media reports on them at length, in-depth discussions of how the numbers are created - and where the weaknesses may lie - is relatively rare. Unfortunately, those gaps are significant.

There are two different surveys that examine employment - the household survey and the payroll survey. While many seem to think that the larger sample size of the payroll survey makes it more accurate and reliable, from a statistical standpoint the household survey's design is more sound and the margin of error is usually better.

That said, the unemployment numbers give a few examples of the problems of government statistics. Starting during the 1960s, the methodology was changed to exclude discouraged workers - people who are out of work and have met with so little success in finding a new job that they have quit trying. This had the instant effect of lowering the unemployment number.

Inflation One of the Worst Examples
If readers want to find a "messy" stat, they need go no further than the inflation measures reported by the U.S. government. Generally speaking, the most important inflation measure is the Consumer Price Index (the CPI); as manufacturing becomes an increasingly smaller part of the U.S. economy, the Producer Price Index (PPI) becomes somewhat less relevant.

Inflation reporting used to be based on a fixed basket of goods, but that has changed with time. Substitution effects have infiltrated the measurement of inflation such that it is now assumed that when certain goods get expensive, consumers will substitute cheaper goods. Clearly, then, that understates inflation. Likewise, the weighting has been shifted from an arithmetic basis to a geometric basis, another change that helps to minimize the appearance of higher prices.

Last and not least is the impact of hedonics. The idea of hedonic adjustment is that at least some of the price difference between a good bought today and a good bought yesterday can be ascribed to significant quality improvements. Unfortunately, this is a highly subjective determination and one that does not always sync with reality.

There is a great deal of controversy about the "real" rate of inflation, and that argument goes far beyond the dispute over whether it is right to exclude energy and food from "core inflation." While many economists support the changes to the CPI as being more theoretically or mathematically sound, others see it is a blatant attempt to under-report inflation. Fortunately, the government still provides a lot of information calculated by the older methodologies, so diligent observers can piece together an alternative view of inflation if they so choose.

GDP - Growth May Not Be What You Think It Is
It would not be difficult to write thousands of words about the process of calculating Gross Domestic Product (GDP) and its drawbacks, and many have done so. In some respects GDP depends upon economic theories about how things should work as opposed to surveys indicating how they do work. Here are some of the "highlights" of the problems with GDP:

GDP and Gross Domestic Income (GDI) should be equal, but they never are and the discrepancy is not insignificant; moreover, IRS data generally fails to corroborate GDI data.

  • GDP figures include imputed growth; free checking is treated as imputed interest income and homeowners are calculated to receive imputed rental income
  • GDP ignores household work, volunteerism and the underground economy. There is an old joke that if you marry your housekeeper or handyman, you'll cause GDP to drop.
  • The deflation of GDP. The GDP deflator is an inflation measurement that is designed to translate nominal GDP into "real" GDP. Unfortunately, the composition has changed over time and the move from fixed-weighted inflation measures to chain-weighted has increased the risk that GDP is being overstated (because inflation is being understated).
  • Negative things are positive; the costs of crime and natural disaster are excluded, so crime and disaster are actually "positive" - more locks and prisons are positive, as are rebuilding efforts.

On top of all this, readers should remember another detail - Gross National Product (GNP) used to be the preferred method of measuring national wealth. Unfortunately, GNP punishes debtor nations (like the U.S.), so the change was made to GDP in 1991. (Find out what reports to watch in order to anticipate and react to market movements. Check out 4 Key Indicators That Move The Markets.)

Retail Sales - Turning Off the Volume
For a widely-followed statistic, the retail sales figure has a problem. Though the survey is fairly thorough (including 5,000 firms in the advanced survey and 12,000 in the final), it only tracks the dollar value of sales, not the changes in unit volume. Once again, then, here is another number whose validity is tied significantly to whatever metrics are used to represent inflation. Assume an inflation number that is too low and the retail sales figure will look too good.

TUTORIAL: Economics Basics

Deficit Accounting
Much is made of the high, and growing, U.S. deficit. The numbers may actually be worse than they seem. The U.S. government uses a form of cash accounting that includes Social Security surpluses as revenue and does not factor in accruals. Consequently, while the cash-basis deficit for 2010 was about $1.3 trillion, the same number calculated by GAAP accounting would be more on the order of $2.1 trillion - and far, far higher if one were to include credible actuarial assumptions for unfunded Social Security and Medicare/Medicaid liabilities.

U.S. Is Not Alone
The accuracy of reported economic data is a problem in virtually every country. Sometimes the drawbacks are honest issues related to statistics, data collection and interpretation. In other cases, countries engage in blatant manipulation to influence their obligations, manipulate markets (equity, bond and exchange) or influence capital flows.

In the case of the U.S., many economists will argue that the above-mentioned changes have firm footings in economics and statistics (for instance, when the U.S. switched to GDP almost every other major country was already using GDP). So it is hardly a universal opinion that the numbers cannot be trusted. That said, with so few people in the country being well versed in statistics and such large incentives for reporting the "right" numbers, readers and investors should probably ask more questions about the data and how it is calculated instead of putting their trust in the final figures.

Related Articles
  1. Fundamental Analysis

    The Evolution of Obamacare Since Its Inception

    Find out whether the Patient Protection and Affordable Care Act, also known as Obamacare, has lived up to its lofty projections from 2010.
  2. Investing News

    Market Outlook: No Bottom Until 2017?

    These investing pros are bearish on the market in 2016. Will there be a bottom in early 2017?
  3. Economics

    Negative Interest Rate Policy (NIRP)

    A negative interest rate policy is an unconventional monetary policy tool in which nominal target interest rates are set below zero.
  4. Stock Analysis

    The Biggest Risks of Investing in Lockheed Martin Stock (LMT)

    Learn about defense contractor, Lockheed Martin, its leadership within its industry, and how the company can stay on top as the defense landscape changes.
  5. Investing News

    Chipotle Served with Criminal Probe

    Chipotle's beat muted expectations and got a clear bill from the CDC, but it now appears that an investigation into its E.coli breakout has expanded.
  6. Investing News

    How China's Economy is Now Like America's

    China's economy could take the global economy down with it; why that might be good news in the grand scheme.
  7. Investing News

    A 2016 Outlook: What January 2009 Can Teach Us

    January 2009 and January 2016 were similar from an investment standpoint, but from a forward-looking perspective, they were very different.
  8. Investing Basics

    Consumer Confidence Index

    The Consumer Confidence Index is the result of a monthly survey of 5,000 U.S. households by the Conference Board that measures how optimistic or pessimistic consumers are about the economy's ...
  9. Economics

    Explaining Economic Indicators

    Investors use economic indicators to gauge investment opportunities and judge the overall health of an economy.
  10. Stock Analysis

    China Mobile: Just How Big is It? (CHL, CHU, CHA)

    The story behind China Mobile, the biggest company you might never have heard of.
  1. What are the advantages and disadvantages of using systematic sampling?

    As a statistical sampling method, systematic sampling is simpler and more straightforward than random sampling. It can also ... Read Full Answer >>
  2. What's the difference between microeconomics and macroeconomics?

    Microeconomics is generally the study of individuals and business decisions, macroeconomics looks at higher up country and ... Read Full Answer >>
  3. Is Russia a developed country?

    Though it once reigned alongside the United States as a world superpower, Russia is not classified as a developed country ... Read Full Answer >>
  4. Is North Korea a developed country?

    North Korea is one of the poorest and least developed countries in the world. It is far from a developed country. Because ... Read Full Answer >>
  5. Is Mexico a developed country?

    As of 2015, Mexico is not a developed country. However, it beats the majority of its peers in the developing world on most ... Read Full Answer >>
  6. Is China a developed country?

    Despite having the world's second-largest economy and third-largest military, China is still, as of 2015, not classified ... Read Full Answer >>
Hot Definitions
  1. Super Bowl Indicator

    An indicator based on the belief that a Super Bowl win for a team from the old AFL (AFC division) foretells a decline in ...
  2. Flight To Quality

    The action of investors moving their capital away from riskier investments to the safest possible investment vehicles. This ...
  3. Discouraged Worker

    A person who is eligible for employment and is able to work, but is currently unemployed and has not attempted to find employment ...
  4. Ponzimonium

    After Bernard Madoff's $65 billion Ponzi scheme was revealed, many new (smaller-scale) Ponzi schemers became exposed. Ponzimonium ...
  5. Quarterly Earnings Report

    A quarterly filing made by public companies to report their performance. Included in earnings reports are items such as net ...
Trading Center