[go: up one dir, main page]
Scribd
Upload
107 views15 pages

Independent Component Analysis: Bhagesh Bhutani (20) Chayan Sharma (21) Deepak

Uploaded by

user New

Independent Component Analysis (ICA) is a machine learning technique used to separate mixed signals into independent source signals. Unlike Principal Component Analysis (PCA) which focuses on maximizing variance, ICA focuses on independence. ICA can be used to solve cocktail party problems by taking mixed audio signals from microphones and decomposing them into the original independent source signals from individual speakers. ICA makes two key assumptions: 1) the independent components are statistically independent from each other, and 2) the independent components have non-Gaussian distributions. ICA differs from PCA in that it focuses on independence rather than orthogonality of components and can be applied to problems like speech enhancement, biomedical signal processing, and image processing.

Copyright:

© All Rights Reserved
Download as PPTX, PDF, TXT or read online from Scribd
Download as pptx, pdf, or txt

Independent Component Analysis: Bhagesh Bhutani (20) Chayan Sharma (21) Deepak

Uploaded by

user New
107 views15 pages
Independent Component Analysis (ICA) is a machine learning technique used to separate mixed signals into independent source signals. Unlike Principal Component Analysis (PCA) which focuses on maximizing variance, ICA focuses on independence. ICA can be used to solve cocktail party problems by taking mixed audio signals from microphones and decomposing them into the original independent source signals from individual speakers. ICA makes two key assumptions: 1) the independent components are statistically independent from each other, and 2) the independent components have non-Gaussian distributions. ICA differs from PCA in that it focuses on independence rather than orthogonality of components and can be applied to problems like speech enhancement, biomedical signal processing, and image processing.

Original Title

ML PPT (1)

Copyright

© © All Rights Reserved

Available Formats

PPTX, PDF, TXT or read online from Scribd

Did you find this document useful?

Is this content inappropriate?

Independent Component Analysis (ICA) is a machine learning technique used to separate mixed signals into independent source signals. Unlike Principal Component Analysis (PCA) which focuses on maximizing variance, ICA focuses on independence. ICA can be used to solve cocktail party problems by taking mixed audio signals from microphones and decomposing them into the original independent source signals from individual speakers. ICA makes two key assumptions: 1) the independent components are statistically independent from each other, and 2) the independent components have non-Gaussian distributions. ICA differs from PCA in that it focuses on independence rather than orthogonality of components and can be applied to problems like speech enhancement, biomedical signal processing, and image processing.

Copyright:

© All Rights Reserved
Download as PPTX, PDF, TXT or read online from Scribd
Download as pptx, pdf, or txt
107 views15 pages

Independent Component Analysis: Bhagesh Bhutani (20) Chayan Sharma (21) Deepak

Uploaded by

user New
Independent Component Analysis (ICA) is a machine learning technique used to separate mixed signals into independent source signals. Unlike Principal Component Analysis (PCA) which focuses on maximizing variance, ICA focuses on independence. ICA can be used to solve cocktail party problems by taking mixed audio signals from microphones and decomposing them into the original independent source signals from individual speakers. ICA makes two key assumptions: 1) the independent components are statistically independent from each other, and 2) the independent components have non-Gaussian distributions. ICA differs from PCA in that it focuses on independence rather than orthogonality of components and can be applied to problems like speech enhancement, biomedical signal processing, and image processing.

Copyright:

© All Rights Reserved
Download as PPTX, PDF, TXT or read online from Scribd
Download as pptx, pdf, or txt
You are on page 1/ 15

Independent Component

Analysis
Bhagesh Bhutani(20)
Chayan Sharma(21)
Deepak(22)
CSE-A (8 Semester)
th
What is ICA?

Independent Component Analysis (ICA) is a machine


learning technique to separate independent sources from a
mixed signal. Unlike principal component analysis which
focuses on maximizing the variance of the data points, the
independent component analysis focuses on independence,
i.e. independent components.
Cocktail-Party Problem

 Problem: To extract independent sources’ signals from a mixed


signal composed of the signals from those sources.
Given: Mixed signal from five different independent sources.
Aim: To decompose the mixed signal into independent sources:
• Source 1
• Source 2
• Source 3
• Source 4
• Source 5
Here, There is a party going into a room full of people. There is ‘n’ number of
speakers in that room and they are speaking simultaneously at the party. In the same
room, there are also ‘n’ number of microphones placed at different distances from
the speakers which are recording ‘n’ speakers’ voice signals. Hence, the number of
speakers is equal to the number must of microphones in the room.
Decomposing the mixed signal of each microphone’s recording into independent
source’s speech signal can be done by using the machine learning technique,
independent component analysis.
[ X1, X2, ….., Xn ] => [ Y1, Y2, ….., Yn ]
where, X1, X2, …, Xn are the original signals present in the mixed signal and Y1,
Y2, …, Yn are the new features and are independent components which are
independent of each other.
Assumptions of ICA

1. The independent components generated by the ICA are


assumed to be statistically independent of each other.
2. The independent components generated by the ICA must
have non-gaussian distribution.
Assumption 1

 Semantically, by statistically independent it means that


information about x does not give you information about y and vice
versa. Mathematically, this translates to,

p(x,y) represents the joint distribution of x and y. The non-Gaussian


assumption simply means the independent components have
distributions that are not Gaussian, meaning it doesn’t look like a bell
curve.
Assumption 2
 Non-Gaussianity of y is maximized when it is directly
proportional to one of the independent components. This allows us
to frame ICA as an optimization problem. For example,

Where we want to find the values of w_1 and w_2 that maximize the
kurtosis of a linear combination of our known input variables. These
optimal values of w_1 and w_2 will define an independent component.
Difference between PCA and ICA
Principal Component Analysis Independent Component Analysis
It reduces the dimensions to avoid the problem of It decomposes the mixed signal into its
overfitting. independent sources’ signals.
It deals with the Principal Components. It deals with the Independent Components.
It doesn’t focus on the issue of variance among the
It focuses on maximizing the variance.
data points.
It focuses on the mutual orthogonality property of It doesn’t focus on the mutual orthogonality of the
the principal components. components.
It doesn’t focus on the mutual independence of the It focuses on the mutual independence of the
components. components.
Applications of ICA
 Speech Enhancement: Known as speech enhancement, the concept of
de-noising sound signals to eliminate unnecessary noise can be
achieved by Independent Component Analysis for feature extraction. 
 Biomedical Signal Processing: When it comes to Biomedical Signal
Processing, medical equipment empowered with Independent
Component Analysis can enable doctors and physicians to detect
illnesses and identify any abnormalities related to medical sciences. 
 Image Processing:  ICA detangles two distinct, independent, and non-
Gaussian latent factors in a dataset that helps to put together an
improved quality of the image. 
Previous Year Question:
Study Guide

For notes:
We suggest you study from GFG:
Link:
ML | Independent Component Analysis – GeeksforGeeks
For Video lectures:
Link:
Independent Component Analysis (ICA) | Shawhin Talebi – YouTube
Q&A
THANK YOU!

You might also like