6th Semester
MACHINE LEARNING
(BCS602)
Module – 3
Chapter 5: Regression Analysis
By,
Prof. Samatha R Swamy
ISE Department
Module – 3
Chapter 5: Regression Analysis
Module – 3
Chapter 5: Regression Analysis
• Introduces the basics of
Regression.
• Discusses concepts of linear
regression and non-linear
regression.
Textbook: Chapter 5 - 5.1 to 5.4
Module – 3
Chapter 5: Regression Analysis
5.1 Introduction to Regression
5.2 Introduction to Linearity,
Correlation, and Causation
5.3 Introduction to Linear Regression
5.4 Validation of Regression
Module – 3
Chapter 5: Learning Objectives
● Understand the basics of Regression Analysis.
● Introduce concepts of Correlation and Causation.
● Learn about Linear Regression and its Validation
Techniques.
Dept of Information Science & Engineering Prof. Samatha R Swamy 1
Chapter 5
5.1 What is Regression Analysis?
• A KIND OF SUPERVISORY LEARNING
• Y=F(X)
HERE, Y IS CALLED DEPENDENT VARIABLE AND X IS CALLED
INDEPENDENT VARIABLE.
Dept of Information Science & Engineering Prof. Samatha R S 2
Chapter 5
5.1 What is Regression Analysis?
Regression Analysis answers the following questions:
Dept of Information Science & Engineering Prof. Samatha R S 3
Chapter 5
5.1 What is Regression Analysis?
Dept of Information Science & Engineering Prof. Samatha R S 4
Chapter 5
5.2 Introduction to Correlation
CORRELATION BETWEEN TWO VARIABLES CAN BE FOUND
USING A SCATTER PLOT
Dept of Information Science & Engineering Prof. Samatha R S 5
Chapter 5
5.2 Introduction to Causation
1. CAUSATION IS ABOUT RELATIONSHIP BETWEEN TWO VARIABLES
AS X CAUSES Y.
THIS IS CALLED X IMPLIES B.
2. REGRESSION IS DIFFERENT FROM CAUSATION.
Dept of Information Science & Engineering Prof. Samatha R S 6
Chapter 5
Linear and Non-Linear
Relationships
Dept of Information Science & Engineering Prof. Samatha R S 6
Chapter 5
Types of Regression
Dept of Information Science & Engineering Prof. Samatha R S 7
Chapter 5
Limitations of Regression
Dept of Information Science & Engineering Prof. Samatha R S 8
Chapter 5
5.2 Multicollinearity
Dept of Information Science & Engineering Prof. Samatha R S 9
Chapter 5
Linear Regression
Dept of Information Science & Engineering Prof. Samatha R S 10
Chapter 5
Ordinary Least Square
Approach
Dept of Information Science & Engineering Prof. Samatha R S 11
Chapter 5
Linear Regression Model
Dept of Information Science & Engineering Prof. Samatha R S 12
Chapter 5
Linear Regression Example
Dept of Information Science & Engineering Prof. Samatha R S 13
Chapter 5
Linear Regression Example
Dept of Information Science & Engineering Prof. Samatha R S 14
Chapter 5
Linear Regression Example
Dept of Information Science & Engineering Prof. Samatha R S 15
Chapter 5
Linear Regression Example
Dept of Information Science & Engineering Prof. Samatha R S 16
Chapter 5
Linear Regression in
Matrix Form
Dept of Information Science & Engineering Prof. Samatha R S 17
Chapter 5
Linear Regression in
Matrix Form
Dept of Information Science & Engineering Prof. Samatha R S 18
Chapter 5
Linear Regression in Matrix
Form
Dept of Information Science & Engineering Prof. Samatha R S 19
Chapter 5
Inverse Matrix Form
Dept of Information Science & Engineering Prof. Samatha R S 20
Chapter 5
Validation of Regression
Methods
Dept of Information Science & Engineering Prof. Samatha R S 21
Chapter 5
Validation of Regression
Methods
Dept of Information Science & Engineering Prof. Samatha R S 22
Chapter 5
Validation of Regression
Methods
Dept of Information Science & Engineering Prof. Samatha R S 23
Chapter 5
Validation of Regression
Methods
Dept of Information Science & Engineering Prof. Samatha R S 24
Chapter 5
Validation of Regression
Methods
Dept of Information Science & Engineering Prof. Samatha R S 25
Chapter 5
Example
Dept of Information Science & Engineering Prof. Samatha R S 26
Chapter 5
Example
Dept of Information Science & Engineering Prof. Samatha R S 27
Chapter 5
Validation of Regression
Methods
COEFFICIENT OF DETERMINATION
Dept of Information Science & Engineering Prof. Samatha R S 28
Chapter 5
Summary
Dept of Information Science & Engineering Prof. Samatha R S 29
Thank You
Any Queries:
Mail - samathars.rvitm@rvei.edu.in
