Least Squares Method

What is the 'Least Squares Method'

The least squares method is a form of mathematical regression analysis that finds the line of best fit for a dataset, providing a visual demonstration of the relationship between the data points. Each point of data is representative of the relationship between a known independent variable and an unknown dependent variable.

BREAKING DOWN 'Least Squares Method'

The least squares method provides the overall rationale for the placement of the line of best fit among the data points being studied. The most common application of the least squares method, referred to as linear or ordinary, aims to create a straight line that minimizes the sum of the squares of the errors generated by the results of the associated equations, such as the squared residuals resulting from differences in the observed value and the value anticipated based on the model.

This method of regression analysis begins with a set of data points to be graphed. An analyst using the least squares method will be seeking a line of best fit that explains the potential relationship between an independent variable and a dependent variable. In regression analysis, dependent variables are designated on the vertical Y axis and independent variables are designated on the horizontal X axis. These designations will form the equation for the line of best fit, which is determined from the least squares method.

Example of Least Squares Method

For example, an analyst may want to test the relationship between a company’s stock returns and the index returns for which the stock is a component. In this example, the analyst seeks to test the dependence of the stock returns on the index returns. To do this, all of the returns are plotted on a chart. The index returns are then designated as the independent variable, and the stock returns are the dependent variable. The line of best fit provides the analyst, with coefficients explaining the level of dependence.

Line of Best Fit Equation

The line of best fit determined from the least squares method has an equation that tells the story of the relationship between the data points. Computer software models are used to determine the line of best fit equation, and these software models include a summary of outputs for analysis. The least squares method can be used for determining the line of best fit in any regression analysis. The coefficients and summary outputs explain the dependence of the variables being tested.

In contrast to a linear problem, a non-linear least squares problem has no closed solution and is generally solved by iteration. The earliest description of the least squares method was by Carl Friedrich Gauss in 1795.

RELATED TERMS
  1. Least Squares

    A statistical method used to determine a line of best fit by ...
  2. Sum Of Squares

    A statistical technique used in regression analysis. The sum ...
  3. Line Of Best Fit

    A straight line drawn through the center of a group of data points ...
  4. Residual Sum Of Squares - RSS

    A statistical technique used to measure the amount of variance ...
  5. Nonlinear Regression

    A form of regression analysis in which data is fit to a model ...
  6. Error Term

    A variable in a statistical and/or mathematical model, which ...
Related Articles
  1. Investing

    Regression Basics For Business Analysis

    This tool is easy to use and can provide valuable information on financial analysis and forecasting. Find out how.
  2. Trading

    Understand How Square Works before the IPO

    Square is reported to have filed for an IPO. For interested investors wondering how the company makes money, Investopedia takes a look at its business.
  3. Personal Finance

    Square Enters the Online Lending Space (SQ)

    Jack Dorsey's Square will expand services relating to Square Capital's cash advance service, becoming a key player in the traditional online lending space.
  4. Markets

    Understanding Regression

    Regression is a statistical analysis that attempts to predict the effect of one or more variables on another variable.
  5. Markets

    Square Beats on First Public Earnings Report (SQ, TWTR)

    With Square opting to withhold forward guidance, investors would do well to withhold some enthusiasm.
  6. Trading

    What is a Line Of Best Fit?

    A line of best fit is a straight line drawn through the center of a group of data points on a scatter plot.
  7. Markets

    Explaining Linear Relationships

    A linear relationship describes the proportionality between an independent variable and a dependent variable.
  8. Insights

    Why Amazon's Altruistic Move May Not Benefit Square (AMZN)

    Amazon is offering Square credit card readers to customers of its shuttered Amazon Local Register program. But, it may not move the needle much for Square.
  9. Personal Finance

    Why Square Stock Sank 7.5% Last Week (SQ, TWTR)

    While the revenue growth seems (for now) unlimited, the company is also spending quite a bit to strengthen its position in a highly competitive payments space
  10. Investing

    The Linear Regression Of Time and Price

    This investment strategy can help investors be successful by identifying price trends while eliminating human bias.
RELATED FAQS
  1. What are some of the more common types of regressions investors can use?

    Learn about the most common types of regressions investors use to model asset prices including linear regressions and multiple ... Read Answer >>
  2. How can I use a regression to see the correlation between prices and interest rates?

    Learn how to use linear regression to calculate the correlation between stock prices and interest rates by taking the square ... Read Answer >>
  3. What is the difference between linear regression and multiple regression?

    Learn the difference between linear regression and multiple regression and how multiple regression encompasses not only linear ... Read Answer >>
  4. How can I run linear regressions in MATLAB?

    Learn how to run linear regressions in MATLAB by loading data, specifying dependent and independent variables and using the ... Read Answer >>
  5. What variables are most important when making a prediction through sensitivity analysis?

    Explore sensitivity analysis and how this method considers different variables to determine a course of action based on statistical ... Read Answer >>
  6. How can I run linear and multiple regressions in Excel?

    Learn the steps involved in running a regression in Microsoft Excel: preparations, uploading data and using the regression ... Read Answer >>
Hot Definitions
  1. Duration

    A measure of the sensitivity of the price (the value of principal) of a fixed-income investment to a change in interest rates. ...
  2. Dove

    An economic policy advisor who promotes monetary policies that involve the maintenance of low interest rates, believing that ...
  3. Cyclical Stock

    An equity security whose price is affected by ups and downs in the overall economy. Cyclical stocks typically relate to companies ...
  4. Front Running

    The unethical practice of a broker trading an equity based on information from the analyst department before his or her clients ...
  5. After-Hours Trading - AHT

    Trading after regular trading hours on the major exchanges. The increasing popularity of electronic communication networks ...
  6. Omnibus Account

    An account between two futures merchants (brokers). It involves the transaction of individual accounts which are combined ...
Trading Center