DEFINITION of 'Big Data'

Big data refers to the growth in the volume of structured and unstructured data, the speed at which it is created and collected, and the scope of how many data points are covered. Big data often comes from multiple sources and arrives in multiple formats.

BREAKING DOWN 'Big Data'

The increase in the amount of data available presents both opportunities and problems. In general, having more data on one’s customers (and potential customers) should allow companies to better tailor their products and marketing efforts in order to create the highest level of satisfaction and repeat business.

Companies that are able to collect large amount of data are provided with the opportunity to conduct deeper and richer analysis. This data can be collected from publicly shared comments on social networks and websites, voluntarily gathered from personal electronics and apps, through questionnaires, product purchases, and electronic check-ins. The presence of sensors and other inputs in smart devices allows for data to be gathered across a broad spectrum of situations and circumstances.

Challenges of Using Big Data

While better analysis is a positive, big data can also create overload and noise. Companies have to be able to handle larger volumes of data, all the while determining which data represents signals compared to noise. Determining what makes the data relevant becomes a key factor. Furthermore, the nature and format of the data can require special handling before it is acted upon. Structured data, consisting of numeric values, can be easily stored and sorted. Unstructured data, such as emails, videos, and text documents, may require more sophisticated techniques to be applied before it becomes useful.

Big data is most often stored in computer databases and is analyzed using software specifically designed to handle large, complex data sets. Many Software-as-a-Service (SaaS) companies specialize in managing this type of complex data. Data analysts look at the relationship between different types of data, such as demographic data and purchase history, to determine whether correlation exists. Businesses often use the assessment of big data by such experts turn it into actionable information. Such assessments may be done in-house within a company or externally by a third-party who focuses on processing big data into digestible formats.

Nearly every department in a company can utilize findings from data analysis, from human resources and technology to marketing and sales. The goal of big data is thus to increase the speed at which products get to market, to reduce the amount of time and resources required to gain market adoption, and to ensure that customers remain satisfied.

RELATED TERMS
  1. Data Mining

    Data mining is a a process used by companies to turn raw data ...
  2. Data Warehousing

    Data warehousing is the electronic storage of a large amount ...
  3. Data Migration

    Data migration is the process of moving stored digital information ...
  4. General Data Protection Regulation ...

    The General Data Protection Regulation (GDPR) sets guidelines ...
  5. Customer Relationship Management ...

    Customer relationship management (CRM) is a term for the principles, ...
  6. Variability

    Variability is the extent to which data points in a statistical ...
Related Articles
  1. Tech

    How Big Data Has Changed Finance

    The vast proliferation of data and increasing technological complexities continues to transform the way industries operate and compete.
  2. Tech

    How Big Data Has Changed Marketing

    Big data has enabled marketers to enhance their customer engagement and customer retention strategies by providing insight into behavior and thoughts.
  3. Tech

    Predictive Analytics Drives Return for Investors

    A new industry of predictive analysis has developed to make sense of big data and give investors real-time buy and sell recommendations based on the patterns forming in the data long before traditional ...
  4. Personal Finance

    Financial Data Analyst: Job Description & Average Salary

    Learn about the average salary for a financial data analyst position and the skills, education and experience employers require of candidates.
  5. Managing Wealth

    Data Integrity Analyst: Job Description & Average Salary

    Learn about the average salary of a data integrity analyst and the required skills, education and previous experience needed to fill this role.
  6. Tech

    Data Analyst: Career Path & Qualifications

    Explore becoming a data analyst, one of the hottest careers in the current economy; learn about the career paths and the qualifications you need to get hired.
  7. Tech

    Big Data Analysis: Modernizing Educational Methods

    Once a tool used to understand consumers, big data analysis is becoming a critical component in the creation of a modern, insight-rich educational system.
  8. Insights

    World Bank Data For Dummies

    Developing countries can't always afford to track the data crucial to setting the right economic policies and programs. That's where the World Bank steps in.
  9. Trading

    A Guide To Finding The Most Actively Traded Stocks

    Knowing the trading volume of a stock helps traders understand price movements and forecast future movements. This short guide helps investors locate actively traded data.
  10. Tech

    Blockchain Could Make You—Not Equifax—the Owner of Your Data

    All hype aside, blockchain technology is really good at one thing: taking out the middlemen. Leaky data brokers' days may be numbered.
RELATED FAQS
  1. What is the most important type of data used in business analytics?

    Consider what makes data useful in business analytics, and why companies should search for the types of data that provide ... Read Answer >>
  2. What are some common functions of business intelligence technologies?

    Understand the common functions of business intelligence technologies, and learn how business intelligence is used to increase ... Read Answer >>
  3. What impact does a higher non-farm payroll have on the forex market?

    The employment report, released by the Bureau of Labor Statistics, is an economic indicator that contains data on the employment ... Read Answer >>
  4. Where can I find historical stock/index quotes?

    Finding historical quotes on stocks and indices online has never been easier. Use Investopedia's historical data tool for ... Read Answer >>
  5. Is it better to use fundamental analysis, technical analysis or quantitative analysis ...

    Understand the difference between fundamental, technical and quantitative analysis, and how each measurement helps investors ... Read Answer >>
Hot Definitions
  1. Futures Contract

    An agreement to buy or sell the underlying commodity or asset at a specific price at a future date.
  2. Yield Curve

    A yield curve is a line that plots the interest rates, at a set point in time, of bonds having equal credit quality, but ...
  3. Portfolio

    A portfolio is a grouping of financial assets such as stocks, bonds and cash equivalents, also their mutual, exchange-traded ...
  4. Gross Profit

    Gross profit is the profit a company makes after deducting the costs of making and selling its products, or the costs of ...
  5. Diversification

    Diversification is the strategy of investing in a variety of securities in order to lower the risk involved with putting ...
  6. Intrinsic Value

    Intrinsic value is the perceived or calculated value of a company, including tangible and intangible factors, and may differ ...
Trading Center