Signal processing

Signal processing is an electrical

engineering subfield that focuses on
analysing, modifying and
synthesizing signals such as sound,
images and biological
measurements. [1] Signal processing
techniques can be used to improve
transmission, storage efficiency and Signal transmission using electronic signal processing. Transducers
convert signals from other physical waveforms to electric current or
subjective quality and to also
voltage waveforms, which then are processed, transmitted as
emphasize or detect components of electromagnetic waves, received and converted by another
interest in a measured signal.[2] transducer to final form.

The signal on the left looks like noise, but the signal processing technique known as the Fourier transform
(right) shows that it contains five well defined frequency components.

Contents
History
Categories
Analog
Continuous time
Discrete time
Digital
Nonlinear
Statistical
Application fields
Typical devices
Mathematical methods applied
See also
References
Further reading
 External links

History
According to Alan V. Oppenheim and Ronald W. Schafer, the principles of signal processing can be
found in the classical numerical analysis techniques of the 17th century. Oppenheim and Schafer further
state that the digital refinement of these techniques can be found in the digital control systems of the
1940s and 1950s.[3]

In 1948, Claude Shannon wrote the influential paper "A Mathematical Theory of Communication" which
was published in the Bell System Technical Journal.[4] The paper laid the groundwork for later
development of information communication systems. Around the same time, methods of signal
transmission were being rapidly developed, as a new type of signal emerged called processing signals.[5]

Electronic signal processing was revolutionized by the MOSFET (metal-oxide-semiconductor field-effect

transistor, or MOS transistor),[6] which was originally invented by Mohamed M. Atalla and Dawon
Kahng in 1959.[7] MOS integrated circuit technology was the basis for the first single-chip
microprocessors and microcontrollers in the early 1970s,[8] and then the first single-chip digital signal
processor (DSP) in 1979.[9][10]

Categories

Analog
Analog signal processing is for signals that have not been digitized, as in legacy radio, telephone, radar,
and television systems. This involves linear electronic circuits as well as non-linear ones. The former are,
for instance, passive filters, active filters, additive mixers, integrators and delay lines. Non-linear circuits
include compandors, multiplicators (frequency mixers and voltage-controlled amplifiers), voltage-
controlled filters, voltage-controlled oscillators and phase-locked loops.

Continuous time
Continuous-time signal processing is for signals that vary with the change of continuous domain (without
considering some individual interrupted points).

The methods of signal processing include time domain, frequency domain, and complex frequency
domain. This technology mainly discusses the modeling of linear time-invariant continuous system,
integral of the system's zero-state response, setting up system function and the continuous time filtering
of deterministic signals

Discrete time
Discrete-time signal processing is for sampled signals, defined only at discrete points in time, and as such
are quantized in time, but not in magnitude.
Analog discrete-time signal processing is a technology based on electronic devices such as sample and
hold circuits, analog time-division multiplexers, analog delay lines and analog feedback shift registers.
This technology was a predecessor of digital signal processing (see below), and is still used in advanced
processing of gigahertz signals.

The concept of discrete-time signal processing also refers to a theoretical discipline that establishes a
mathematical basis for digital signal processing, without taking quantization error into consideration.

Digital
Digital signal processing is the processing of digitized discrete-time sampled signals. Processing is done
by general-purpose computers or by digital circuits such as ASICs, field-programmable gate arrays or
specialized digital signal processors (DSP chips). Typical arithmetical operations include fixed-point and
floating-point, real-valued and complex-valued, multiplication and addition. Other typical operations
supported by the hardware are circular buffers and lookup tables. Examples of algorithms are the fast
Fourier transform (FFT), finite impulse response (FIR) filter, Infinite impulse response (IIR) filter, and
adaptive filters such as the Wiener and Kalman filters.

Nonlinear
Nonlinear signal processing involves the analysis and processing of signals produced from nonlinear
systems and can be in the time, frequency, or spatio-temporal domains.[11][12] Nonlinear systems can
produce highly complex behaviors including bifurcations, chaos, harmonics, and subharmonics which
cannot be produced or analyzed using linear methods.

Statistical
Statistical signal processing is an approach which treats signals as stochastic processes, utilizing their
statistical properties to perform signal processing tasks.[13] Statistical techniques are widely used in
signal processing applications. For example, one can model the probability distribution of noise incurred
when photographing an image, and construct techniques based on this model to reduce the noise in the
resulting image.

Application fields
Audio signal processing – for electrical signals
representing sound, such as speech or music
Speech signal processing – for processing and
interpreting spoken words
Image processing – in digital cameras, computers and
various imaging systems
Video processing – for interpreting moving pictures
Wireless communication – waveform generations,
demodulation, filtering, equalization Seismic signal processing
Control systems
Array processing – for processing signals from arrays of
sensors
 Process control – a variety of signals are used, including the industry standard 4-20 mA
current loop
Seismology
Financial signal processing – analyzing financial data using signal processing techniques,
especially for prediction purposes.
Feature extraction, such as image understanding and speech recognition.
Quality improvement, such as noise reduction, image enhancement, and echo cancellation.
(Source coding), including audio compression, image compression, and video compression.
Genomics, Genomic signal processing[14]
In communication systems, signal processing may occur at:

OSI layer 1 in the seven layer OSI model, the Physical Layer (modulation, equalization,
multiplexing, etc.);
OSI layer 2, the Data Link Layer (Forward Error Correction);
OSI layer 6, the Presentation Layer (source coding, including analog-to-digital conversion
and signal compression).

Typical devices
Filters – for example analog (passive or active) or digital (FIR, IIR, frequency domain or
stochastic filters, etc.)
Samplers and analog-to-digital converters for signal acquisition and reconstruction, which
involves measuring a physical signal, storing or transferring it as digital signal, and possibly
later rebuilding the original signal or an approximation thereof.
Signal compressors
Digital signal processors (DSPs)

Mathematical methods applied

Differential equations[15]
Recurrence relation[16]
Transform theory
Time-frequency analysis – for processing non-stationary signals[17]
Spectral estimation – for determining the spectral content (i.e., the distribution of power over
frequency) of a time series[18]
Statistical signal processing – analyzing and extracting information from signals and noise
based on their stochastic properties
Linear time-invariant system theory, and transform theory
Polynomial signal processing – analysis of systems which relate input and output using
polynomials
System identification[11] and classification
Calculus
Complex analysis[19]
Vector spaces and Linear algebra[20]
Functional analysis[21]
Probability and stochastic processes[13]
 Detection theory
Estimation theory
Optimization[22]
Numerical methods
Time series
Data mining – for statistical analysis of relations between large quantities of variables (in
this context representing many physical signals), to extract previously unknown interesting
patterns

See also
Audio filter
Bounded variation
Digital image processing
Dynamic range compression, companding, limiting, and noise gating
Information theory
Non-local means
Reverberation

References
1. Sengupta, Nandini; Sahidullah, Md; Saha, Goutam (August 2016). "Lung sound
classification using cepstral-based statistical features". Computers in Biology and Medicine.
75 (1): 118–129. doi:10.1016/j.compbiomed.2016.05.013 (https://doi.org/10.1016%2Fj.com
pbiomed.2016.05.013). PMID 27286184 (https://pubmed.ncbi.nlm.nih.gov/27286184).
2. Alan V. Oppenheim and Ronald W. Schafer (1989). Discrete-Time Signal Processing.
Prentice Hall. p. 1. ISBN 0-13-216771-9.
3. Oppenheim, Alan V.; Schafer, Ronald W. (1975). Digital Signal Processing. Prentice Hall.
p. 5. ISBN 0-13-214635-5.
4. "A Mathematical Theory of Communication - CHM Revolution" (https://www.computerhistor
y.org/revolution/digital-logic/12/269/1331). Computer History. Retrieved 2019-05-13.
5. Fifty Years of Signal Processing. The IEEE Signal Processing Society. 1998.
6. Grant, Duncan Andrew; Gowar, John (1989). Power MOSFETS: theory and applications (htt
ps://books.google.com/books?id=ZiZTAAAAMAAJ). Wiley. p. 1. ISBN 9780471828679.
"The metal-oxide-semiconductor field-effect transistor (MOSFET) is the most commonly
used active device in the very large-scale integration of digital integrated circuits (VLSI).
During the 1970s these components revolutionized electronic signal processing, control
systems and computers."
7. "1960: Metal Oxide Semiconductor (MOS) Transistor Demonstrated" (https://www.computer
history.org/siliconengine/metal-oxide-semiconductor-mos-transistor-demonstrated/). The
Silicon Engine: A Timeline of Semiconductors in Computers. Computer History Museum.
Retrieved August 31, 2019.
8. Shirriff, Ken (30 August 2016). "The Surprising Story of the First Microprocessors" (https://s
pectrum.ieee.org/tech-history/silicon-revolution/the-surprising-story-of-the-first-microprocess
ors). IEEE Spectrum. Institute of Electrical and Electronics Engineers. 53 (9): 48–54.
doi:10.1109/MSPEC.2016.7551353 (https://doi.org/10.1109%2FMSPEC.2016.7551353).
Retrieved 13 October 2019.
 9. "1979: Single Chip Digital Signal Processor Introduced" (https://www.computerhistory.org/sili
conengine/single-chip-digital-signal-processor-introduced/). The Silicon Engine. Computer
History Museum. Retrieved 2019-05-13.
10. "DSPs: Back to the Future" (https://queue.acm.org/detail.cfm?id=984485). ACM Queue. 2
(1). April 16, 2004. Retrieved 14 October 2019.
11. Billings, S. A. (2013). Nonlinear System Identification: NARMAX Methods in the Time,
Frequency, and Spatio-Temporal Domains. Wiley. ISBN 978-1119943594.
12. Slawinska, J., Ourmazd, A., and Giannakis, D. (2018). "A New Approach to Signal
Processing of Spatiotemporal Data". 2018 IEEE Statistical Signal Processing Workshop
(SSP). IEEE Xplore. pp. 338–342. doi:10.1109/SSP.2018.8450704 (https://doi.org/10.110
9%2FSSP.2018.8450704). ISBN 978-1-5386-1571-3.
13. Scharf, Louis L. (1991). Statistical signal processing: detection, estimation, and time series
analysis. Boston: Addison–Wesley. ISBN 0-201-19038-9. OCLC 61160161 (https://www.wor
ldcat.org/oclc/61160161).
14. Anastassiou, D. (2001). "Genomic signal processing". IEEE Signal Processing Magazine.
IEEE. 18 (4): 8–20. doi:10.1109/79.939833 (https://doi.org/10.1109%2F79.939833).
15. Patrick Gaydecki (2004). Foundations of Digital Signal Processing: Theory, Algorithms and
Hardware Design (https://books.google.com/?id=6Qo7NvX3vz4C&pg=PA40&dq=%22differe
ntial+equations%22+%22signal+processing%22#v=snippet&q=%22differential%20equatio
n%22%20OR%20%22differential%20equations%22&f=false). IET. pp. 40–. ISBN 978-0-
85296-431-6.
16. Shlomo Engelberg (8 January 2008). Digital Signal Processing: An Experimental Approach
(https://books.google.com/books?id=z3CpcCHbtgIC). Springer Science & Business Media.
ISBN 978-1-84800-119-0.
17. Boashash, Boualem, ed. (2003). Time frequency signal analysis and processing a
comprehensive reference (1 ed.). Amsterdam: Elsevier. ISBN 0-08-044335-4.
18. Stoica, Petre; Moses, Randolph (2005). Spectral Analysis of Signals (http://user.it.uu.se/%7
Eps/SAS-new.pdf) (PDF). NJ: Prentice Hall.
19. Peter J. Schreier; Louis L. Scharf (4 February 2010). Statistical Signal Processing of
Complex-Valued Data: The Theory of Improper and Noncircular Signals (https://books.googl
e.com/books?id=HBaxLfDsAHoC&printsec=frontcover#v=onepage&q=%22complex%20ana
lysis%22&f=false). Cambridge University Press. ISBN 978-1-139-48762-7.
20. Max A. Little (13 August 2019). Machine Learning for Signal Processing: Data Science,
Algorithms, and Computational Statistics (https://books.google.com/books?id=ejGoDwAAQ
BAJ&printsec=frontcover#v=onepage&q=%22vector%20space%22&f=false). OUP Oxford.
ISBN 978-0-19-102431-3.
21. Steven B. Damelin; Willard Miller, Jr (2012). The Mathematics of Signal Processing (https://
books.google.com/books?id=MtPLYXQ9d9MC&printsec=frontcover#v=onepage&q=%22fun
ctional%20analysis%22&f=false). Cambridge University Press. ISBN 978-1-107-01322-3.
22. Daniel P. Palomar; Yonina C. Eldar (2010). Convex Optimization in Signal Processing and
Communications (https://books.google.com/books?id=UOpnvPJ151gC). Cambridge
University Press. ISBN 978-0-521-76222-9.

Further reading
P Stoica, R Moses (2005). Spectral Analysis of Signals (http://user.it.uu.se/%7Eps/SAS-ne
w.pdf) (PDF). NJ: Prentice Hall.
Kay, Steven M. (1993). Fundamentals of Statistical Signal Processing. Upper Saddle River,
New Jersey: Prentice Hall. ISBN 0-13-345711-7. OCLC 26504848 (https://www.worldcat.or
g/oclc/26504848).
 Papoulis, Athanasios (1991). Probability, Random Variables, and Stochastic Processes
(third ed.). McGraw-Hill. ISBN 0-07-100870-5.
Kainam Thomas Wong [1] (http://www.eie.polyu.edu.hk/~enktwong/): Statistical Signal
Processing lecture notes at the University of Waterloo, Canada.
Ali H. Sayed, Adaptive Filters, Wiley, NJ, 2008, ISBN 978-0-470-25388-5.
Thomas Kailath, Ali H. Sayed, and Babak Hassibi, Linear Estimation, Prentice-Hall, NJ,
2000, ISBN 978-0-13-022464-4.

External links
Signal Processing for Communications (http://www.sp4comm.org/) – free online textbook by
Paolo Prandoni and Martin Vetterli (2008)
Scientists and Engineers Guide to Digital Signal Processing (http://www.dspguide.com) –
free online textbook by Stephen Smith
Signal Processing Techniques for Determining Powerplant Characteristics (https://www.usb
r.gov/research/projects/detail.cfm?id=9962)
The IEEE Signal Processing Society (http://www.signalprocessingsociety.org/)
Bio-Medical Signal processing at a Glance (http://siliconmentor.blogspot.in/2015/03/bio-med
ical-signal-processing-at-glance.html)
IPython notebooks for Python for Signal Processing Book (https://github.com/unpingco/Pyth
on-for-Signal-Processing)

Retrieved from "https://en.wikipedia.org/w/index.php?title=Signal_processing&oldid=942499564"

This page was last edited on 25 February 2020, at 01:35 (UTC).

Text is available under the Creative Commons Attribution-ShareAlike License; additional terms may apply. By using
this site, you agree to the Terms of Use and Privacy Policy. Wikipedia® is a registered trademark of the Wikimedia
Foundation, Inc., a non-profit organization.