Ordinary Least Squares Regression

Frank Acito
Additional contact information
Frank Acito: Indiana University

Chapter Chapter 6 in Predictive Analytics with KNIME, 2023, pp 105-124 from Springer

Abstract: Abstract This chapter discusses least squares regression, one of the most widely used analytics tools for building predictive models. The chapter begins by highlighting the reasons for the popularity of regression, including its logical, linear nature and its ease of programming. It emphasizes the flexibility of regression, as it can be applied to various types of problems, even those that may not initially seem suitable for linear regression. The section on multiple regression explores how to deal with various types of variables encountered in regression applications, such as nominal, ordinal, and continuous variables. It explains how to code nominal and ordinal variables using indicator variables for meaningful inclusion in regression. The chapter then delves into handling nonlinearity in regression, discussing how to detect and address it using polynomial models or variable transformations. Next, the chapter focuses on evaluating the predictive accuracy of regression models using metrics such as Mean Absolute Error (MAE), Root Mean Square Error (RMSE), and Mean Absolute Percentage Error (MAPE). To illustrate the concepts discussed, KNIME is used with a subset of the Ames, Iowa, housing price data. It demonstrates the use of ordinary least squares regression, stepwise regression, and LASSO (L1 regularization) for predictive modeling and compares their prediction accuracy on a test set.

Date: 2023
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:sprchp:978-3-031-45630-5_6

Ordering information: This item can be ordered from
http://www.springer.com/9783031456305

DOI: 10.1007/978-3-031-45630-5_6

Access Statistics for this chapter

More chapters in Springer Books from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().