Math Refresher for DS
Linear Algebra: Core Objects
Linear Algebra: Core Objects
Linear Algebra: Core Objects
Linear Algebra: Core Objects
What are Vectors?
What are Vectors?
What are Vectors?
Vector
Spaces
Vector Space: Definition
Vector Space: Definition
Property Meaning
1. Associativity of addition
2. Commutativity of addition
3. Identity element of addition
Identity element of scalar
4.
multiplication
5. Inverse element of addition
6. Compatibility of scalar multiplication
7.
Distributivity
8.
Operations with Vectors
Operations with Vectors
Operations with Vectors: Example
:
Operations with Vectors: Example
:
Operations with Vectors: Example
:
Vector Operations:
Geometrical Interpretation
Vectors: Geometrical Interpretation
2
Vectors: Geometrical Interpretation
2 4
Vectors: Geometrical Interpretation
-1 2 4
-1.5
Vectors: Geometrical Interpretation
2 4
Vectors: Geometrical Interpretation
2 4 6
Vectors: Geometrical Interpretation
2 4 6
Vectors: Geometrical Interpretation
2 4 6
Vectors: Geometrical Interpretation
2 4 6
Back to Vector Spaces
Operations with Vectors
satisfy axioms (1) (8)
(check it yourself)
Vector Spaces
Vector Spaces: Another Example
Vector Spaces: Another Example
Vector Spaces: Another Example
Vector Spaces: Another Example
Vector Spaces: Another Example
Inner Product
Inner Product
Dot Product
Dot Product
Dot Product
Euclidian Vector Space
Euclidian Vector Space
Euclidian Vector Space
Norms
Norm
Norm
Norm
Norm
Norm
Examples of Norms
Manhattan Norm
Manhattan Norm
Manhattan Norm
Euclidian Norm
Euclidian Norm
Euclidian Norm
Euclidian Norm
Other norms
Other norms
Other norms
Inner Product and Norms
Check yourself that this is
indeed a norm.
Inner Product and Norms
Check yourself that this is
indeed a norm.
Inner Product and Norms
Check yourself that this is
indeed a norm.
Inner Product and Norms
Check yourself that this is
indeed a norm.
Cauchy-Schwarz Inequality
Cauchy-Schwarz Inequality
Distance between Vectors
Distance between Vectors
Angles and
Orthogonality
Angle between Two Vectors
Angle between Two Vectors: Example
Angle between Two Vectors: Example
Angle between Two Vectors: Example
Orthogonality
Orthogonality
Orthogonality
Orthogonality
Orthogonal Projection
Orthogonal Projection
Orthogonal Projection
Orthogonal Projection
Orthogonal Projection
Orthogonal Projection
Orthogonal Projection
Orthogonal Projection
Orthogonal Projection
Orthogonal Projection
Orthogonal Projection: Example
Orthogonal Projection: Example
Orthogonal Projection: Example
Orthogonal Projection: Example
Hyperplanes
Hyperplanes
98
Hyperplanes
Hyperplanes
Image source: https://deepai.org/machine-learning-glossary-and-terms/hyperplane
Hyperplanes
Normal to a Hyperplane
Normal to a Hyperplane
ML Example: Linear Classifier
ML Example: Linear Classifier
ML Example: Linear Classifier
ML Example: Linear Classifier
To sum up
Math Refresher for DS
Last Time
Today
Back to
Vector Spaces
(Reminder) Vector Space: Definition
Property Meaning
1. Associativity of addition
2. Commutativity of addition
3. Identity element of addition
Identity element of scalar
4.
multiplication
5. Inverse element of addition
6. Compatibility of scalar multiplication
7.
Distributivity
8.
(Reminder) Examples of Vector Spaces
(Reminder) Examples of Vector Spaces
Vector
Subspaces
Vector Subspace
Vector Subspace
Vector Subspace
Vector Subspace
Vector Subspace
Vector Subspace
Vector Subspace
Vector Subspace: Examples
Vector Subspace: Examples
Vector Subspace: Examples
Vector Subspace: Examples
Vector Subspace: Examples
Vector Subspace: Examples
Vector Subspace: Examples
Vector Subspace: Examples
Vector Subspace: Examples
Vector Subspace: Examples
Vector Subspace: Examples
Vector Subspace: Examples
Vector Subspace: Examples
Linear
Combinations
29
Linear Combinations
Linear Combinations
Linear Combinations
Linear Combinations
Linear Combinations
Linear Combinations: Examples
Linear Combinations: Examples
Linear Combinations: Examples
Linear Combinations: Examples
Linear Combinations: Examples
Span
40
Span
,
Span
,
Span
,
Span
,
Span: Example 1
Span: Example 1
Span: Example 1
Span: Example 1
Span: Example 1
Span: Example 2
Span: Example 2
Span: Example 2
Span: Example 2
Span: Example 2
Span: Example 2
Generating Set
Generating Set
Linear
independence
58
Linear Combinations
Linear Combinations
Linear (In)dependence
Linear (In)dependence
Linear (In)dependence
Linear (In)dependence
Linear (In)dependence
Linear (In)dependence
Linear (In)dependence: Example 1
Linear (In)dependence: Example 1
Linear (In)dependence: Example 1
Linear (In)dependence: Example 1
Linear (In)dependence: Example 2
Linear (In)dependence: Example 2
Linear (In)dependence: Example 3
Linear (In)dependence: Example 3
Linear (In)dependence: Example 3
Linear (In)dependence: Example 3
Linear (In)dependence: Example 3
Linear (In)dependence: Example 3
Linear (In)dependence: Example 3
Linear (In)dependence: Example 3
Linear (In)dependence: Example 3
Linear (In)dependence: Example 3
Linear (In)dependence: Example 3
Linear (In)dependence: Example 3
Dimension of a Linear Space
Dimension of a Linear Space
Dimension: Example
Dimension: Example
Dimension: Example
Dimension: Example
Dimension: Example
Dimension: Example
Dimension: Another Example
Dimension: Another Example
Dimension: Another Example
Dimension: Another Example
Basis
97
Basis
Basis
Basis: Example
Basis: Example
Basis: Example
Basis: Example
Basis: Example
Basis: Example
Basis: Example
Basis: Example
Coordinates
Coordinates
Coordinates
Coordinates: Example
Coordinates: Example
4
Coordinates: Example
4
Coordinates: Example
4
Orthogonal Basis
Orthogonal Basis
Orthogonal Basis
Orthogonal Basis
Change of
Basis
119
Basis
Basis
Basis
Basis
Basis
Coordinate Change: Example
Coordinate Change: Example
Coordinate Change: Example
Coordinate Change: Example
Coordinate Change: General Case
Coordinate Change: General Case
Coordinate Change: General Case
Coordinate Change: General Case
Coordinate Change
Coordinate Change
Coordinate Change
Coordinate Change
Coordinate Change
Coordinate Change
Coordinate Change
Coordinate Change
Coordinate Change
Coordinate Change
Coordinate Change: Example
Coordinate Change: Example
Coordinate Change: Example
Coordinate Change: Example
Coordinate Change: Example
Coordinate Change
Coordinate Change
Matrices
A Matrix
A Matrix
Special Matrices
Special Matrices
Special Matrices
Special Matrices
Vectors vs Matrices
Operations
with
Matrices
Transpose of a Matrix
Transpose of a Matrix
Transpose of a Matrix: Example
Transpose of a Matrix: Example
Multiplying by a Scalar
Multiplying by a Scalar
Sum of Two Matrices
Sum of Two Matrices
Matrices Also Form a Vector Space!
Matrices Also Form a Vector Space!
Matrix Multiplication
Matrix Multiplication
Matrix Multiplication
Matrix Multiplication: Example
Matrix Multiplication: Example
Matrix Multiplication: Example
Coordinate Change: Matrix Notation
Coordinate Change: Matrix Notation
Coordinate Change: Matrix Notation
Coordinate Change: Example (again)
Coordinate Change: Example (again)
Coordinate Change: Example (again)
Coordinate Change: Example (again)
Coordinate Change: Example (again)
Coordinate Change: Example (again)
To Sum Up
Next Time
Math Refresher for DS
Last Time
Today
Matrices:
a small
review
A Matrix
Special Matrices
Basic Operations with Matrices
Basic Operations with Matrices
Matrix Multiplication
Matrix Multiplication
Matrix Multiplication
Matrix Multiplication
Matrix Multiplication
Matrix Multiplication
Matrix Multiplication
Transposing a Matrix
Transposing a Matrix
Linear
Transforms
Linear Transformation
Linear Transformation
Linear Transformation
Transformation
Source: Linear Transformations and Matrices
Transformation
Source: Linear Transformations and Matrices
Transformation: Examples
Source: Linear Transformations and Matrices
Linear Transformation
Linear Transformation
1.
2.
Linear Transformation
Linear Transformation
Linear Transformation
Linear Transformation
Linear Transformation
Linear Transformation
Linear Transformation
Example: Rotation
Example: Rotation
Example: Rotation
Example: Rotation
Example: Rotation
Example: Rotation
Example: Rotation
Example: Rotation
Example: Rotation
Linear Transformation
Linear Transformation
Common
Transforms
Identity Transformation
Identity Transformation
Stretching / Squeezing
Stretching / Squeezing
Projection on an Axis
Projection on an Axis
Rotation
Rotation
Combining
Transforms
Composition
Composition
Composition
Composition
Composition
Composition
Composition
Composition
Composition
Composition
Sum of Transforms
Sum of Transforms
Sum of Transforms
Sum of Transforms
Sum of Transforms
Sum of Transforms
Sum of Transforms
Sum of Transforms
Inverse
Transform
Inverse transform
Inverse transform
Inverse transform
Inverse transform
Inverse transform
Inverse transform
Inverse transform
Inverse of a Matrix
Inverse of a Matrix
Inverse of a Matrix
Determinant
Determinant
Determinant
Determinant
Determinant
Determinant
:
Computing Determinant
Computing Determinant
Computing Determinant
Computing Determinant
Computing Determinant
Computing Determinant
Computing Determinant
Computing Determinant
Some Properties of the Determinant
Finding
Inverse of a
Matrix
99
Gaussian Elimination
Gaussian Elimination
Gaussian Elimination
Gaussian Elimination
Gaussian Elimination
Gaussian Elimination
Gaussian Elimination
Gaussian Elimination
Gaussian Elimination
Rank
Column Space
Column Space
Rank
Rank
Rank: Examples
Rank: Examples
Rank: Examples
Rank: Examples
Column vs Row Rank
Column vs Row Rank
Column vs Row Rank
Column vs Row Rank
Rank
Rank
Rank
Rank
Rank: Examples
Rank: Examples
Rank: Examples
Rank: Examples
Rank: Examples
Infinitely many vectors are mapped into a zero vector.
Infinitely many vectors are mapped into a zero vector.
Only a zero vector is mapped into a zero vector.
Null space
Null space
Systems of
Linear
Equations
What is a SLE?
Solutions to SLE
1.
2.
3.
Solutions to SLE
1.
2.
3.
SLE: Matrix Notation
SLE: Matrix Notation
SLE: Matrix Notation
Number of Solutions
Number of Solutions
Number of Solutions
Number of Solutions
Number of Solutions
Solutions to SLE
1.
2.
3.
Solutions to SLE
1.
2.
3.
Solutions to SLE
1.
2.
3.
Number of Solutions
Number of Solutions
Number of Solutions
Number of Solutions
Number of Solutions
Solutions to SLE
1.
2.
3.
Gaussian
Elimination
154
Gaussian elimination
Gaussian elimination
Gaussian elimination
Gaussian Elimination
Gaussian Elimination
Gaussian Elimination
Gaussian Elimination
Gaussian Elimination
Gaussian Elimination
Homogeneous
SLE
164
Homogeneous SLE
Homogeneous SLE
Homogeneous SLE
Homogeneous SLE
Homogeneous SLE
Homogeneous SLE
Homogeneous SLE
Homogeneous SLE
Homogeneous SLE
To sum up
