Loading the player...

What does 'Statistically Significant' mean

Statistically significant is the likelihood that a relationship between two or more variables is caused by something other than random chance. Statistical hypothesis testing is used to determine whether the result of a data set is statistically significant. This test provides a p-value, representing the probability that random chance could explain the result; in general, a p-value of 5% or lower is considered to be statistically significant.

BREAKING DOWN 'Statistically Significant'

Specifically, a set of data becomes statistically significant when the set is large enough to accurately represent the phenomenon or population sample being studied. A data set is deemed to be statistically significant if the probability of the phenomenon being random is less than one out of every 20, which is why the p-value is set at 5%.

Statistically Significant Data in Theory

Suppose a person works for a company that produces running shoes. He needs to plan production for the number of shoes that his company should make in each size, for both men and for women. He doesn't want to base his production plans on the anecdotal evidence that men usually have bigger feet than women. He needs hard data to devise an accurate forecast. Therefore, he should look at a statistical study that shows the correlation between gender and foot size.

If the study's p-value was 2%, it would have a statistically significant result. He could then reasonably use the study's data to prepare his company's production plans, because the p-value indicates there is only a 2% chance that the connection between foot size and gender was the result of chance. On the other hand, if the p-value was 6%, it would not be reasonable to use the study as a basis for his production plans. So, if the study with the 2% p-value said that most men were found to have a shoe size between eight and 12, and women were found to have a shoe size between four and eight, he could confidently produce a majority of shoes in each one of those sizes, for each gender.

Statistically Significant Data in Practice

Often times, the idea of statistical significance is used in new drug trials for pharmaceutical companies. This is important for two reasons: The first is that the drug itself is tested for effectiveness, and the second is that it tells investors how successful the company is at releasing new products.

For example, Novo Nordisk, the pharmaceutical leader in diabetes medication, reported on June 2016, that there was a statistically significant reduction in type 1 diabetes when it tested its new insulin. The test consisted of 26 weeks of randomized therapy among diabetes patients, reduced type 1 diabetes and had a p-value of less than 5%, meaning that the reduction in diabetes was not due to random chance.

  1. Statistical Significance

    Statistical significance refers to a result that is not likely ...
  2. P-Value

    The level of marginal significance within a statistical hypothesis ...
  3. Random Factor Analysis

    Random factor analysis is a statistical technique to decipher ...
  4. Runs Test

    A runs test is a statistical technique to test the hypothesis ...
  5. Random Walk Index

    The Random Walk Index is a technical indicator that compares ...
  6. Simple Random Sample

    A subset of a statistical population in which each member of ...
Related Articles
  1. Investing

    Investing For The Global Diabetes Epidemic

    Sadly, diabetes is quickly becoming a global epidemic. Within these grim statistics, investors can find opportunities with the companies that are fighting this epidemic.
  2. Investing

    Roche Restructuring Shows Trouble in US Diabetes Biz

    Roche announced a reorganization and job cuts as the U.S. diabetes market continues to struggle.
  3. Insights

    Can Investors Trust Official Statistics?

    The official statistics in some countries need to be taken with a grain of salt. Find out why you should be skeptical.
  4. Financial Advisor

    Wealthy Men and Women Investors: 4 Key Differences

    Research validates that wealthy men and women invest differently. Here's why—the insights may help advisors better tailor their services to clients.
  5. Retirement

    5 Reasons to Leave Retirement Planning to Your Wife

    Wives live longer than their husbands, so their retirement stakes are higher. Luckily, certain qualities make women especially good at long-term planning
  6. Investing

    Roche Denies Reports It Plans to Exit Diabetes Business

    Roche denied a Bloomberg report claiming it plans to put its diabetes care unit on the block.
  7. Investing

    Novo Nordisk Q4 Net Below Street Expectations

    Though Novo Nordisk expects to enter sectors beyond diabetes, the results and future guidance failed to meet market expectations
  8. Financial Advisor

    Are Women's Portfolios Better Than Men's?

    A recent study found that women's portfolios tend to perform better than men's. This is likely because women are more averse to risk.
  9. Retirement

    Retirement Costs: Men vs. Women

    When it comes to the cost of living in retirement, men and women aren't equal after all.
  10. Retirement

    Why Women Retire with Less Money

    The gender gap plays a significant role in women's ability to put aside enough money for a comfortable retirement. How to fight back.
  1. What are the advantages of using a simple random sample to study a larger population?

    Learn how simple random sampling works and what advantages it offers over other sampling methods when selecting a research ... Read Answer >>
  2. What are the disadvantages of using a simple random sample to approximate a larger ...

    Learn what a simple random sample is, how researchers use it as a statistical tool and the disadvantages it carries when ... Read Answer >>
  3. What's An Example of Stratified Random Sampling?

    Stratified random sampling divides a population into subgroups or strata, whereby the members in each of the stratum formed ... Read Answer >>
  4. What Are Stratified Random Sampling's Pros & Cons?

    Stratified random sampling provides a more accurate sampling of a population, but can be disadvantageous when researchers ... Read Answer >>
  5. What are the advantages and disadvantages of using systematic sampling?

    Learn about the primary advantages and disadvantages of using a systematic sampling method when conducting research of a ... Read Answer >>
  6. What percentage of the population do you need in a representative sample?

    Learn about representative samples and how they are used in conjunction with other strategies to create useful data with ... Read Answer >>
Hot Definitions
  1. Net Present Value - NPV

    Net Present Value (NPV) is the difference between the present value of cash inflows and the present value of cash outflows ...
  2. Price-Earnings Ratio - P/E Ratio

    The Price-to-Earnings Ratio or P/E ratio is a ratio for valuing a company that measures its current share price relative ...
  3. Internal Rate of Return - IRR

    Internal Rate of Return (IRR) is a metric used in capital budgeting to estimate the profitability of potential investments.
  4. Limit Order

    An order placed with a brokerage to buy or sell a set number of shares at a specified price or better.
  5. Current Ratio

    The current ratio is a liquidity ratio that measures a company's ability to pay short-term and long-term obligations.
  6. Return on Investment (ROI)

    Return on Investment (ROI) is a performance measure used to evaluate the efficiency of an investment or compare the efficiency ...
Trading Center