On Deriving the Least Squares Estimates in Introductory Regression Courses

Abstract

Introductory regression books typically begin their derivation of the least squares matrix estimation formula by considering the simple linear regression model. We suggest beginning with the zero-intercept model which has advantages. We provide two examples of this approach, one of which is a new, non-calculus derivation using the Cauchy-Schwarz inequality.