Loading the player...

What is 'Statistically Significant'

Statistically significant is the likelihood that a relationship between two or more variables is caused by something other than chance. Statistical hypothesis testing is used to determine whether the result of a data set is statistically significant. This test provides a p-value, representing the probability that random chance could explain the result; in general, a p-value of 5% or lower is considered to be statistically significant.

BREAKING DOWN 'Statistically Significant'

Statistical significance is used to accept or reject the null hypothesis, which hypothesizes that there is no relationship between measured variables.  A data set is statistically significant when the set is large enough to accurately represent the phenomenon or population sample being studied. A data set is typically deemed to be statistically significant if the probability of the phenomenon being random is less than 1/20, resulting in a p-value of 5%. When the test result exceeds the p-value, the null hypothesis is accepted.  When the test result is less than the p-value, the null hypothesis is rejected.

Statistically Significant Data in Theory

Suppose Joe Sample works for a company that manufactures running shoes. For optimal production, he considers how many shoes should be made in each sex's size. Joe does not rely on anecdotal evidence that males have bigger sizes relative to females; he opts to use statistical study that shows the correlation between sex and foot size to make accurate forecasts. 

If the study's p-value was 2% (<5%), it would have a statistically significant result. The p-value indicates there is only a 2% chance that the connection between foot size and gender was the result of chance.  He could then reasonably use the study's data to prepare his company's production plans. On the other hand, if the p-value was 6% (>5%), it would not be reasonable to use the study as a basis for his production plans. So, if the study with the 2% p-value said that most men have shoe sizes between 8 and 12 and women have shoe sizes between 4 and 8, he could develop plans to produce most of the shoes in those sizes.

Statistically Significant Data in Practice

Often, the idea of statistical significance is used for new pharmaceutical drug trials, to test vaccines, and in the study of pathology. This is important for two reasons: The first is that the drug is tested for effectiveness, and the second is that it tells investors how successful the company is at releasing new products.

For example, Novo Nordisk, the pharmaceutical leader in diabetes medication, reported that there was a statistically significant reduction in type 1 diabetes when it tested its new insulin. The test consisted of 26 weeks of randomized therapy among diabetes patients; the result was a reduction in type 1 diabetes and a p-value of less than 5%, meaning that the reduction in diabetes was not due to random chance.

  1. Hypothesis Testing

    A process by which an analyst tests a statistical hypothesis. ...
  2. Alpha Risk

    Alpha risk is the risk in a statistical test of rejecting a null ...
  3. Two-Tailed Test

    A two-tailed test is a statistical test in which the critical ...
  4. Z-Test

    A z-test is a statistical test used to determine whether two ...
  5. Sample

    A sample is a smaller, manageable version of a larger group. ...
  6. P-Test

    A statistical method used to test one or more hypotheses within ...
Related Articles
  1. Investing

    Hypothesis testing in finance: Concept and examples

    When you're indecisive about an investment, the best way to keep a cool head might be test various hypotheses using the most relevant statistics.
  2. Insights

    Can Investors Trust Official Statistics?

    The official statistics in some countries need to be taken with a grain of salt. Find out why you should be skeptical.
  3. Investing

    How Statistical Arbitrage Can Lead to Profits

    Find out how statistical arbitrage is leveraged by traders and investors seeking profit by capitalizing on the relationship between price and liquidity.
  4. Investing

    Roche Denies Reports It Plans to Exit Diabetes Business

    Roche denied a Bloomberg report claiming it plans to put its diabetes care unit on the block.
  5. Investing

    Novo Nordisk Q4 Net Below Street Expectations

    Though Novo Nordisk expects to enter sectors beyond diabetes, the results and future guidance failed to meet market expectations
  6. Investing

    What Are The Odds Of Scoring A Winning Trade?

    Just because you're on a winning streak doesn't mean you're a skilled trader. Find out why.
  7. Investing

    Lexicon Diabetes Drug Shows Phase 2 Promise (LXRX)

    Lexicon Pharmaceuticals reported promising results from a Phase 2 trial of its type 1 diabetes drug, sotagliflozin.
  8. Investing

    Novo Nordisk Still One Of The Best Around

    Novo Nordisk is one of the best pharmaceutical companies in the world - and it's priced accordingly.
  9. Investing

    Is This Diabetes Stock a Better Bet Than MannKind? (MNKD, NVO)

    MannKind's (NASDAQ: MNKD) inhaled insulin, Afrezza, is incredibly intriguing, but Novo Nordisk's (NYSE: NVO) long-standing dominance in diabetes treatment and its research to develop insulin ...
  1. What assumptions are made when conducting a t-test?

    Learn what a t-test is and discover the five standard assumptions made regarding the validity of sampling and data used in ... Read Answer >>
  2. When is it better to use systematic over simple random sampling?

    Learn when systematic sampling is better than simple random sampling, such as in the absence of data patterns and when there ... Read Answer >>
  3. What are the pros and cons of stratified random sampling?

    Stratified random sampling provides a more accurate sampling of a population, but can be disadvantageous when researchers ... Read Answer >>
  4. What percentage of the population do you need in a representative sample?

    Learn about representative samples and how they are used in conjunction with other strategies to create useful data with ... Read Answer >>
  5. What's an example of stratified random sampling?

    Stratified random sampling divides a population into subgroups or strata, whereby the members in each of the stratum formed ... Read Answer >>
  6. Can your insurance company drug test you?

    Learn why drug companies conduct drug tests and how a lifestyle free of drugs and alcohol can save you big money on health ... Read Answer >>
Hot Definitions
  1. Yield Curve

    A yield curve is a line that plots the interest rates, at a set point in time, of bonds having equal credit quality, but ...
  2. Portfolio

    A portfolio is a grouping of financial assets such as stocks, bonds and cash equivalents, also their mutual, exchange-traded ...
  3. Gross Profit

    Gross profit is the profit a company makes after deducting the costs of making and selling its products, or the costs of ...
  4. Diversification

    Diversification is the strategy of investing in a variety of securities in order to lower the risk involved with putting ...
  5. Intrinsic Value

    Intrinsic value is the perceived or calculated value of a company, including tangible and intangible factors, and may differ ...
  6. Current Assets

    Current assets is a balance sheet item that represents the value of all assets that can reasonably expected to be converted ...
Trading Center