This document provides an overview of a fourth year course on multimedia for computer science and IT students. It covers topics such as text, audio, images, video, and media delivery. For audio, it discusses properties of sound, digital audio, audio compression techniques like ADPCM and MPEG, and audio editing using linear and non-linear editors. It also describes editing tools like normalization, reverb, compression, filtering, equalization and special effects.
This document provides an overview of a fourth year course on multimedia for computer science and IT students. It covers topics such as text, audio, images, video, and media delivery. For audio, it discusses properties of sound, digital audio, audio compression techniques like ADPCM and MPEG, and audio editing using linear and non-linear editors. It also describes editing tools like normalization, reverb, compression, filtering, equalization and special effects.
This document provides an overview of a fourth year course on multimedia for computer science and IT students. It covers topics such as text, audio, images, video, and media delivery. For audio, it discusses properties of sound, digital audio, audio compression techniques like ADPCM and MPEG, and audio editing using linear and non-linear editors. It also describes editing tools like normalization, reverb, compression, filtering, equalization and special effects.
This document provides an overview of a fourth year course on multimedia for computer science and IT students. It covers topics such as text, audio, images, video, and media delivery. For audio, it discusses properties of sound, digital audio, audio compression techniques like ADPCM and MPEG, and audio editing using linear and non-linear editors. It also describes editing tools like normalization, reverb, compression, filtering, equalization and special effects.
Chapter 3 Audio: Digital Audio – Audio Coding – Editing
Chapter 4 Image: Digital Cameras – Image Compression – Editing
Chapter 5,6 Video: Digital Video - Video Coding – Video Editing
Chapter 7 Media Delivery: Multimedia & Networks – QoS
Audio in Multimedia Identify the Differences in Sound in Various Media Audio in Multimedia Use of Audio in Multimedia
Content Sound
Ambient Sound Audio in Multimedia Use of Audio in Multimedia Some examples of content sound used in multimedia are:
Narration: Narration provides information about an
animation that is playing on the screen.
Testimonials: These could be auditory or video sound
tracks used in presentations or movies.
Voice-overs: These are used for short instructions, for
example,to navigate the multimedia application.
Music: Music may be used to communicate (as in a
song). Audio in Multimedia Use of Audio in Multimedia Ambient sound consists of an array of background and sound effects. These include:
Message reinforcement: The background sounds you
hear in real life can be used to reinforce the message that you wish to communicate.
Background music: Set the mood for the audience to
receive and process information by starting and ending a presentation with music.
Sound effects: Sound effects are used in presentations
to liven up the mood and add effects to your presentations. Audio in Multimedia Properties of Sound Audio in Multimedia Properties of Sound
Frequency
The difference in time between the formation of two crests is termed as the period.
The number of peaks that occur in one second is the frequency.
Audio in Multimedia Properties of Sound
Wavelength
Wavelength is the distance from the midpoint of one crest to the midpoint of the next crest. It is represented by the symbol lambda . Audio in Multimedia Properties of Sound Doppler effect
When the object making the sound is moving toward you, the frequency goes up due to the waves getting pushed more tightly together. The opposite happens when the object moves away from you and the pitch goes down. This is called the Doppler effect. Audio in Multimedia Properties of Sound
Bandwidth
Bandwidth is defined as the difference between the highest and the lowest frequency contained in a signal. Audio in Multimedia Properties of Sound Harmonics
The combinations of frequencies generated by an instrument are known as the
timbre. A timbre consists of a fundamental or main frequency and other minor frequencies known as overtones or harmonics Audio in Multimedia Digital Audio
Sampling
The audio input from a source is sampled several
thousand times per second. Each sample is a snapshot of the original signal at a particular time. Audio in Multimedia Digital Audio
Sampling Rate Sampling rate is an important factor in determining how accurately the digitized sound represents the original analog sound.
Digitization Digitization is the process of assigning a discrete value to each of the sampled values. It is performed by an Integrated Chip (IC) called an A to D Converter. Audio in Multimedia Digital Audio
Fidelity Fidelity is defined as the closeness of the recorded version to the original sound. In the case of digital speech, it depends upon the number of bits per sample and the sampling rate. Nyquist Theorem According to Nyquist theorem, a minimum of two samples (per cycle) is necessary to represent a given sound wave.
Sampling rate = 2 x Highest frequency.
Audio in Multimedia Sound Formats And Settings
Stereo vs. Mono recordings
Stereo recordings are made by recording on two
channels, and are lifelike and realistic. Mono sounds are less realistic, flat, and not as dramatic, but they have a smaller file size.
Stereo sounds require twice the space as compared to
mono recordings. Audio in Multimedia Sound Formats And Settings
Mono Recording:
File size = Sampling rate x duration of recording in seconds x (bits per sample/8) x 1
Stereo Recording:
File size = Sampling rate x duration of recording in seconds x (bits per sample/8) x 2 Audio in Multimedia Sound Formats And Settings
The Sound Quality of Digitized Sound
Audio in Multimedia Audio Compression
Compression in computer terms means reducing the
physical size of data such that it occupies less storage space and memory. An uncompressed audio signal of telephone quality (8-bit sampled at 8 kHz) leads to a bandwidth requirement of 64 Kbps and storage requirement of 8 KB to store one second of playback.
An uncompressed stereo audio signal of CD quality (16-bit sampled
at 44.1 kHz) leads to a bandwidth requirement of 44.1 kHz x 16 bits = 705.6 Kbps and storage requirement of 88.2 KB for one second of playback. Audio in Multimedia Audio Compression Compression Requirements Compressions in multimedia systems are subjected to certain constraints. These constraints are:
• The quality of the reproduced data should be adequate for
applications. • The complexity of the technique used should be minimal, to make a cost-effective compression technique. • The processing of the algorithm should not take too long. • Various audio data rates should be supported. Thus, depending on specific system conditions the data rates can be adjusted. •. The compression technique should be compatible with various reproduction systems. Audio in Multimedia Audio Compression
Schemes of Audio Compression
The most commonly used compression schemes for audio are:
MPEG stands for Motion Picture Experts Group. In 1987,
a very powerful algorithm was developed that was standardized as ISOMPEG Audio Layer-3. Using MPEG audio coding you can compress the original audio on a CD by a factor of 12 without losing the sound quality. Audio in Multimedia Audio Compression MPEG The family of audio coding schemes that achieve compression without losing the CD sound quality are: 1. MPEG Layer 1 (corresponds with 384 Kbps of data transferred to the player in case of a stereo signal) compression ratio is 1:4. 2. MPEG Layer 2 (corresponds with 256-192 Kbps of data transferred to the player in case of a stereo signal) compression ratio is 1:6-1:8. 3. MPEG Layer 3 (corresponds with 128-112 Kbps of data transferred to the player in case of a stereo signal) compression ratio is 1:10-1:12. Audio in Multimedia Audio Editing One can record or manipulate audio files using various audio editors.
You must have a sound card installed on your PC to edit stored or
recorded audio data.
After the audio has been recorded and stored, it has to be modified to improve the level of quality.
Some common audio editing software packages are:
Magix Music Maker,
WavePad, Dexster Audio Editor, GoldWave Digital Audio Editor,… etc Audio in Multimedia Audio Editing Linear editors Linear editors can handle one stereo, or mono, audio track at a time.
When saved, any cut material is lost unless a backup copy of the original has been kept.
Non-Linear editors Non-linear editors do not change the audio files being edited in any way, but instead create ‘Edit Decision Lists’ (EDLs).
They don’t play an audio file linearly from beginning to end; instead the files are played out of sequence – non-linearly – with edits performed by skipping instantly to the next section. Audio in Multimedia Audio Editing
Multitrack
You don't have to handle complex EDLs yourself, as the non-linear
editor presents itself, on screen, as if it were a multitrack tape recorder. The lists are managed by the editing software, and not by you. However, it is far more flexible than a physical multitrack tape recorder. Audio in Multimedia Audio Editing Audio processing
The most important processing options are:
Normalization. This standardizes the sound level of each item, although not necessarily the loudness.
Reverberation. Sometimes known as ‘artificial echo’, this will add a room (or hall) acoustic to your recording. This is most often used with music recording.
Compression. This reduces the range of volume between the quietest and loudest sound.
Noise reduction. These are 'companding' systems, where programme
aterial is compressed for recording but expanded back to its original dynamic range on playback. Audio in Multimedia Audio Editing Filters. These are useful for filtering out constant sounds as well as sound at the extreme ends of the frequency range.
Equalization. This is a sophisticated form of ‘tone’ control usually referred to
as 'EQ'. It can be used to brighten up muffled recordings, or to reduce sibilance from some interviewees.
