CN101479787B - Method for encoding and decoding object-based audio signal and apparatus thereof - Google Patents
Method for encoding and decoding object-based audio signal and apparatus thereof Download PDFInfo
- Publication number
- CN101479787B CN101479787B CN2007800242526A CN200780024252A CN101479787B CN 101479787 B CN101479787 B CN 101479787B CN 2007800242526 A CN2007800242526 A CN 2007800242526A CN 200780024252 A CN200780024252 A CN 200780024252A CN 101479787 B CN101479787 B CN 101479787B
- Authority
- CN
- China
- Prior art keywords
- signal
- information
- audio
- audio signal
- channel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Stereophonic System (AREA)
Abstract
Provided are an audio encoding method and apparatus and an audio decoding method and apparatus in which audio signals can be encoded or decoded so that sound images can be localized at any desired position for each object audio signal. The audio decoding method comprises extracting downmix signal and object-based side information from the audio signal; generating corrected downmix signal based on the information extracted from the downmix signal and the and object-based side information; processing the downmix signal based on the channel signal losing correlation; and generating multi-channel audio signal based on the processed downmix signal and the channel-based side information.
Description
Technical field
The present invention relates to a kind of audio coding method and device, and a kind of audio-frequency decoding method and device, wherein the acoustic image of each object audio signal can be located in the position of any hope.
Background technology
In general; In multi-channel audio coding and decoding technique; A plurality of sound channel signals of multi-channel signal are reduced audio mixing and are advanced in the minority sound channel signal, and transmission has the multi-channel signal with the as many sound channel of original multi-channel signal about the side information of original channel signal and recovery.
Object-based audio coding and decoding technique and multi-channel audio coding and decoding technique are advancing a plurality of sound source reduction audio mixings in the minority sound source signals, and the side information aspect of transmitting about original sound source is similar basically.Yet; In object-based audio coding and decoding technique, object signal, it is the fundamental element (the for example sound of musical instrument or people's voice) of sound channel signal; Be regarded as with multi-channel audio coding and decoding technique in sound channel signal identical, and also can be by coding/decoding.
In other words, in object-based audio coding and decoding technique, each object signal will be regarded as the main body (entities) of coding/decoding.In this; Object-based audio coding and decoding technique and multi-channel audio coding and decoding technique are distinguishing; This difference is that the multichannel audio coding/decoding is simple according to information between sound channel and by coding/decoding, and with irrelevant by the number of elements in the sound channel signal of coding/decoding.
Summary of the invention
Technical matters
The invention provides a kind of audio coding method and device, and a kind of audio-frequency decoding method and device, wherein can be to coding audio signal or decoding so that the acoustic image of each object audio signal can be located in the position of any hope.
Technical scheme
According to an aspect of the present invention, it provides a kind of audio-frequency decoding method, comprising: from sound signal, extract reduction audio signal and object-based side information, generate said reduction audio signal through at least one object signal of reduction audio mixing; Receiving control information; Generate parameter information according to said object-based side information and said control information; Generate side information according to said object-based side information and said control information based on sound channel; Handle said reduction audio signal according to said reduction audio signal and said parameter information, so that control the position or the level of said at least one object signal; With use reduction audio signal and said side information after the said processing to generate multi-channel audio signal based on sound channel.
According to another aspect of the present invention; It provides a kind of audio decoding apparatus; Comprise: demodulation multiplexer, it is configured to from sound signal, extract reduction audio signal and object-based side information, generates said reduction audio signal through at least one object signal of reduction audio mixing; Parametric converter, it is configured to receiving control information, generates parameter information according to said object-based side information and said control information, and generates the side information based on sound channel according to said object-based side information and said control information; Reduction audio mixing processor is used for handling said reduction audio signal according to said reduction audio signal and said parameter information, so that control the position or the level of said at least one object signal; And multi-channel decoder, it is configured to use reduction audio signal and said side information based on sound channel after the processing that is obtained by said reduction audio mixing processor to generate multi-channel audio signal.
According to another aspect of the present invention, it provides a kind of audio-frequency decoding method, comprising: from sound signal, extract reduction audio signal and object-based side information; Generate side information and one or more processing parameter according to object-based side information and the control information that is used to play up the reduction audio signal based on sound channel; Use the reduction audio signal and generate multi-channel audio signal based on the side information of sound channel; Use processing parameter to revise multi-channel audio signal.
According to another aspect of the present invention, it provides a kind of audio decoding apparatus, comprising: demodulation multiplexer is used for extracting reduction audio signal and object-based side information from sound signal; Parametric converter generates side information and one or more processing parameter based on sound channel according to object-based side information and the control information that is used to play up the reduction audio signal; Multi-channel decoder is used to use the reduction audio signal and generates multi-channel audio signal based on the side information of sound channel; And the sound channel processor, be used to use processing parameter to revise multi-channel audio signal.
According to another aspect of the present invention, it provides a kind of computer readable recording medium storing program for performing, wherein records a kind of audio-frequency decoding method, and this method comprises: from sound signal, extract reduction audio signal and object-based side information; Generate side information according to object-based side information and the control information that is used to play up the reduction audio signal based on sound channel; Use the sound channel signal of decorrelation to handle the reduction audio signal; And use the reduction audio signal after the processing that obtains through exchange and generate multi-channel audio signal based on the side information of sound channel.
According to another aspect of the present invention, it provides a kind of computer readable recording medium storing program for performing, wherein records a kind of audio-frequency decoding method, and this method comprises: from sound signal, extract reduction audio signal and object-based side information; Generate side information and one or more processing parameter according to object-based side information and the control information that is used to play up the reduction audio signal based on sound channel; Use the reduction audio signal and generate multi-channel audio signal based on the side information of sound channel; Use processing parameter to revise multi-channel audio signal.
Beneficial effect
A kind of audio coding method and device are provided, and a kind of audio-frequency decoding method and device, wherein can be to coding audio signal or decoding so that the acoustic image of each object audio signal can be located in the position of any hope.
Description of drawings
Through following detailed description and accompanying drawing, the present invention's easy to understand more that will become, accompanying drawing is exemplary, and it is not construed as limiting the invention, wherein:
Fig. 1 is the block scheme of typical object-based audio coding/decoding system;
Fig. 2 is the block scheme according to the audio decoding apparatus of first embodiment of the invention;
Fig. 3 is the block scheme according to the audio decoding apparatus of second embodiment of the invention;
Fig. 4 is used to explain amplitude difference and mistiming for the acoustic image location influence, and it is separate;
Fig. 5 is the functional arrangement about amplitude difference and the corresponding relation between the mistiming, and wherein this amplitude difference and mistiming are that acoustic image is positioned the precalculated position is needed;
Fig. 6 representes to comprise the form of the control data of harmonic information;
Fig. 7 is the block scheme according to the audio decoding apparatus of third embodiment of the invention;
Fig. 8 is the block scheme that can be applied to art reduction audio mixing gain (ADG) module in the audio decoding apparatus as shown in Figure 7;
Fig. 9 is the block scheme according to the audio decoding apparatus of fourth embodiment of the invention;
Figure 10 is the block scheme according to the audio decoding apparatus of fifth embodiment of the invention;
Figure 11 is the block scheme according to the audio decoding apparatus of sixth embodiment of the invention;
Figure 12 is the block scheme according to the audio decoding apparatus of seventh embodiment of the invention;
Figure 13 is the block scheme according to the audio decoding apparatus of eighth embodiment of the invention;
Figure 14 is used to explain that the audio decoding apparatus by shown in Figure 13 is used in the block diagram of the application of the three-dimensional of frame (3D) information;
Figure 15 is the block scheme according to the audio decoding apparatus of nineth embodiment of the invention;
Figure 16 is the block scheme according to the audio decoding apparatus of tenth embodiment of the invention;
Figure 17-the 19th is used to explain the block diagram of audio-frequency decoding method according to an embodiment of the invention;
Figure 20 is the block scheme of audio coding apparatus according to an embodiment of the invention.
The optimal mode of embodiment of the present invention
Specify the present invention referring now to accompanying drawing, represented exemplary embodiment of the present invention in the accompanying drawings.
Can be applied to object-based Audio Processing operation according to a kind of audio coding method of the present invention and device and a kind of audio-frequency decoding method with device, but the present invention is not limited to this.In other words, this audio coding method and device and audio-frequency decoding method and device also can be applied to the various signal processing operations outside the object-based Audio Processing operation.
Fig. 1 is the block scheme of typical object-based audio coding/decoding system.As a rule, the sound signal that inputs to object-based audio coding apparatus is not corresponding with the sound channel of multi-channel signal, and these sound signals are object signal independently.In this, object-based audio coding apparatus is different with the multi-channel audio coding device, and its difference is the sound channel signal of multi-channel audio coding device input multi-channel signal.
For instance; Be imported in the multi-channel audio coding device such as the left front sound channel signal of 5.1 sound channel signals and the sound channel signal the right front channels signal, yet the object audio signal of the little main body of the ratio sound channel signal such as people's voice or musical instrument sound (the for example sound of violin or piano) can be imported in the object-based audio coding apparatus.
Referring to Fig. 1, this object-based audio coding/decoding system comprises: object-based audio coding apparatus and object-based audio decoding apparatus.Object-based audio coding apparatus comprises object encoder 100, and object-based audio decoding apparatus comprises object decoder 111 and renderer 113.
Side information can comprise and indicates whether to carry out based on the audio coding/decoding of sound channel or the sign of object-based audio coding/decoding; Then, can confirm that the audio coding/decoding of carrying out based on sound channel still is to carry out object-based audio coding/decoding according to the sign of side information.Side information also can comprise envelope information about object signal, grouping information, repose period information and deferred message.Side information also can comprise simple crosscorrelation information between object level difference information, object, reduction audio mixing gain information, reduction upmixed channels level difference information and absolute object energy information.
Fig. 2 is the block scheme according to the audio decoding apparatus 120 of first embodiment of the invention.Referring to Fig. 2, this audio decoding apparatus 120 comprises: object decoder 121, renderer 123 and parametric converter 125.This audio decoding apparatus 120 also comprises the demodulation multiplexer (not shown), be used for extracting reduction audio signal and side information from the bit stream of input, and this demodulation multiplexer will be applied in all audio decoding apparatus according to other embodiments of the invention.
Object decoder 121 generates a plurality of object signal according to the reduction audio signal with by the amended side information that parametric converter 125 provides.Each of the object signal that renderer 123 will be generated by object decoder 121 is assigned to the precalculated position in the multichannel space, and confirms the level by the object signal of object decoder 121 generations according to control information.Parametric converter 125 generates amended side information through combination side information and control information.Then, parametric converter 125 is transferred to object decoder 121 with amended side information.
Object decoder 121 can be carried out adaptive decoding through the control information in the side information after the analysis modify.
For instance; If control information indicates first object signal and second object signal to be assigned to the identical position in the multichannel space; And has identical level; Then typical audio decoding apparatus first and second object signal of can decoding respectively then are arranged into them in the multichannel space through audio mixing/rendering operations.
On the other hand; Learn that first and second object signal are assigned to the same position in the multichannel space in the control information of object decoder 121 from amended side information of audio decoding apparatus 120; And having same level, is independent sound sources as first and second object signal.Thereby object decoder 121 is regarded first and second object signal as an independent sound source and first and second object signal of decoding, and not with they separately decodings.Like this, complexity of decoding has reduced.In addition, because the quantity of the sound source of need handling has reduced, the complexity of audio mixing/play up has also reduced.
Optional is, audio decoding apparatus 120 can be used in when first object signal and second object signal and be assigned to the same position in the multichannel space, but has this situation of varying level.In this case, audio decoding apparatus 120 is regarded as one first and second object signal of decoding with first and second object signal, and first and second object signal of not decoding respectively, and decoded first and second object signal are transferred to renderer 123.More particularly, the control information of object decoder 121 from amended side information obtains the information about the difference between the level of first and second object signal, and according to the information that obtains first and second object signal of decoding.Like this, even first and second object signal have varying level, also can first and second object signal be decoded as the single sound source.
Same optional is that object decoder 121 can be adjusted the level of the object signal that is generated by object decoder 121 according to control information.Then, the object signal of object decoder 121 decodable codes adjustment over level.Thereby renderer 123 need not adjusted the decoded object signal that is provided by object decoder 121, and as long as simply will be arranged in the multichannel space by the decoded object signal that object decoder 121 provides.In brief; Because object decoder 121 has been adjusted the level of the object signal that is generated by object decoder 121 according to control information; Renderer 123 can be easy to and will be arranged in the multichannel space by the object signal that object decoder 121 generates, and does not need the level of extra adjustment by the object signal of object decoder 121 generations.Therefore, can reduce the complexity of audio mixing/play up.
According to the embodiment of Fig. 2, the object decoder of audio decoding apparatus 120 can be through coming adaptive execution decode operation to the analysis of control information, thereby reduce the complexity of complexity of decoding and audio mixing/play up.Can use the combination of the said method of carrying out by audio decoding apparatus 120.
Fig. 3 is the block scheme according to the audio decoding apparatus 130 of second embodiment of the invention.Referring to Fig. 3, audio decoding apparatus 130 comprises object decoder 131 and renderer 133.This audio decoding apparatus 130 is characterised in that: it not only provides side information to object decoder 131, also offers renderer 133.
Even when the object signal that exists corresponding to repose period, audio decoding apparatus 130 also can effectively be carried out decode operation.For instance, second to the 4th object signal maybe be corresponding to the musical performance phase of instrument playing, and the repose period that first object signal possibly played corresponding to accompaniment.In this case, indicate in a plurality of object signal which can be included in the side information, and this side information can be provided for renderer 133 and object decoder 131 corresponding to the information of repose period.
On the other hand, audio decoding apparatus 130 transmission comprise indicates a plurality of target object to give renderer 133 corresponding to the side information of the information of repose period, then stops the object signal corresponding to repose period to get into the audio mixing/rendering operations by renderer 133 execution.Therefore, audio decoding apparatus 130 can stop the unnecessary increase of the complexity of audio mixing/play up.
Renderer 133 can use the audio mixing parameter information that is included in the control information to define the acoustic image of each object signal in the stereo scene.The audio mixing parameter information can only comprise amplitude information or comprise amplitude information and temporal information.The audio mixing parameter information not only influences the location of stereo sound image, also influences the psychoacoustic sensation of user for the spatial sound quality.
For instance; Through what generate through elutriation service time method and amplitude elutriation method more respectively; And two acoustic images that use 2 channel stereo loudspeakers to reproduce in same position; Can learn that amplitude elutriation method can realize the accurate location of acoustic image, and time elutriation method can provide the natural sound of the deep sense in space.Then, if renderer 133 only uses amplitude elutriation method in the multichannel space, to arrange object signal, renderer 133 can each acoustic image of accurate localization, but the deep sense of the sound when elutriation service time method can not be provided.According to the type of sound source, the user's accurate location of preference sound rather than deep sense of sound sometimes, vice versa.
Fig. 4 (a) and 4 (b) explain that intensity difference (amplitude difference) and mistiming are for the acoustic image location influence when using 2 channel stereo loudspeakers to come reproducing signal.Referring to Fig. 4 (a) and 4 (b),, an acoustic image is navigated to predetermined angular according to independently amplitude difference and mistiming mutually.For example, can use the amplitude difference of about 8dB, or the mistiming of the about 0.5ms that equates with the amplitude difference of 8dB is positioned at angle 20 with acoustic image.Therefore, even only provide amplitude difference as the audio mixing parameter information, also can be through amplitude difference being converted into the multiple sound that the mistiming obtains to have different attribute, wherein the mistiming is equal to amplitude difference between the acoustic image fixation phase.
Fig. 5 representes about acoustic image being positioned angle 10,20 and 30 needed amplitude differences and the function of corresponding relation between the mistiming.Function shown in Fig. 5 can obtain according to Fig. 4 (a) and 4 (b).Referring to Fig. 5, the comparison of multiple amplitude difference-mistiming can be provided to acoustic image is positioned the precalculated position.For example, the amplitude difference of supposing 8dB is provided as the audio mixing parameter information acoustic image is positioned at angle 20.According to function shown in Figure 5, also can use the combination of mistiming of amplitude difference and the 0.3ms of 3dB that acoustic image is positioned at angle 20.In this case, not only provide amplitude difference information also to provide time difference information, thereby strengthened spatial impression as the audio mixing parameter information.
Therefore, in order during audio mixing/rendering operations, to generate the sound of the attribute with user expectation, the audio mixing parameter information can be by suitable conversion, makes it possible to carry out the amplitude elutriation that is suitable for the user and any one in the time elutriation.That is to say that if the audio mixing parameter information only comprises amplitude difference information, but user expectation has the sound of the deep sense in space, this amplitude difference information can be converted into the time difference information that is equal to amplitude difference information with reference to psychoacoustic data.Optional is, if the user expects the accurate location of the sound and the acoustic image of the deep sense in space simultaneously, amplitude difference information can be converted into amplitude difference information and the combination that is equal to the time difference information of original amplitude information.Optional is; If the audio mixing parameter information only comprises time difference information; But the accurate location of user expectation acoustic image; This time difference information can be converted into the amplitude difference information that is equal to time difference information, maybe can be converted into the combination of amplitude difference information and time difference information, and this combination can be through accurate location that strengthens acoustic image and the preference that spatial impression satisfies the user.
Still optional is; If the audio mixing parameter information comprises amplitude difference information and time difference information; And the user selects the accurate location of acoustic image, and the combination of amplitude difference information and time difference information can be converted into the amplitude difference information of the combination that is equal to original amplitude difference information and time difference information.On the other hand; If the audio mixing parameter information comprises amplitude difference information and time difference information; And the enhancing of user expectation spatial impression, the combination of amplitude difference information and time difference information can be converted into the time difference information that is equal to amplitude difference information and original time difference information combination.Referring to Fig. 6, control information can comprise audio mixing about one or more object signal/play up information harmonic information.Harmonic information can comprise the Pitch Information about one or more object signal, fundamental frequency information and dominant frequency take a message in the breath at least one and the explanation of the frequency spectrum of each subband of each object signal and energy.
Because be the deficiency of sharpness of the renderer of unit executable operations with the subband, harmonic information can be used in processing object signal during rendering operations.
If this harmonic information comprises the Pitch Information about one or more object signal, can weaken or strengthen the gain that predetermined frequency area is adjusted each object signal through using comb filter or contrary comb filter.For instance, if in a plurality of object signal is a voice sound signal, these object signal can be used to Karaoke through only weakening voice sound signal.Optional is if harmonic information comprises the dominant frequency domain information about one or more object signal, then can carry out the processing that weakens or strengthen the dominant frequency territory.Still optional is, if harmonic information comprises the spectrum information about one or more object signal, and can be through carrying out not by the weakening of any subband boundary limitation or strengthening the gain of controlling each object signal.
Fig. 7 is the block scheme of audio decoding apparatus 140 in accordance with another embodiment of the present invention.Referring to Fig. 7, audio decoding apparatus 140 uses multi-channel decoders 141 to replace object decoder and renderer, and in object signal by proper arrangement decoding a plurality of object signal in back in the multichannel space.
Specifically, audio decoding apparatus 140 comprises multi-channel decoder 141 and parametric converter 145.Multi-channel decoder 141 generates multi-channel signal; The object signal of these multi-channel signals is arranged in the multichannel space according to reduction audio signal and spatial parameter information, and this spatial parameter information is the side information based on sound channel that is provided by parametric converter 145.Parametric converter 145 is analyzed by next side information and the control information of audio coding apparatus (not shown) transmission, and according to the parameter information of analyzing of the span as a result.More specifically, parametric converter 145 generates spatial parameter information through side information and control information, and this control information comprises that playback is provided with information and audio mixing information.That is to say that corresponding to one to two (OTT) box or two to three (TTT) box, parametric converter 145 is a spatial data to the combined transformation of side information and control information.
For instance; When the multi-channel signal that uses 5.1 channel loudspeaker playback systems to reproduce 10 object signal and obtain according to these 10 object signal; Typical object-based audio decoding apparatus generates the decoded signal that corresponds respectively to these 10 object signal according to reduction audio signal and side information; And through these 10 object signal proper arrangements are generated 5.1 sound channel signals in the multichannel space, then these object signal become and are suitable for 5.1 channel loudspeaker environment.Yet during 5.1 sound channel signals generated, the efficient that generates 10 object signal was very low, and the difference of this problem between the number of channels of the quantity of object signal and the multi-channel signal that will generate becomes more serious when increasing.
On the other hand, according to embodiment shown in Figure 7, audio decoding apparatus 140 generates the spatial parameter information that is suitable for 5.1 sound channel signals according to side information and control information, and spatial parameter information and reduction audio signal are offered multi-channel decoder 141.Then, multi-channel decoder 141 generates 5.1 sound channel signals according to spatial parameter information and reduction audio signal.In other words; When the number of channels that will export is 5.1 sound channels; Audio decoding apparatus 140 can be easy to generate 5.1 sound channel signals according to the reduction audio signal; And need not generate 10 object signal, then this audio decoding apparatus with respect to common audio decoding apparatus more efficient aspect the complexity.
When calculating the calculated amount required corresponding to the spatial parameter information of each OTT box and TTT box when after each object signal is decoded, carrying out the required calculated amount of audio mixing/rendering operations through analyzing the side information that come by the audio coding apparatus transmission and control information, this audio decoding apparatus 140 is more effective.
Come to join typical multichannel audio decoding device to a module that is used for span parameter information with control information through analyzing side information, can obtain this audio decoding apparatus 140, and can keep and the typical compatibility of multichannel audio decoding device.Same, audio decoding apparatus 140 can improve sound quality through the existing instrument that uses typical multi-channel decoding device, and such as the envelope shaping device, the subband time domain is handled (STP) instrument and decorrelator.Through foregoing, can infer that all advantages of typical multichannel audio coding/decoding method all can be applied to object-based audio-frequency decoding method easily.
The spatial parameter information that is transferred to multi-channel decoder 141 by parametric converter 145 can be compressed to be suitable for transmission.Optional is that spatial parameter information can have and the same form of data that is transmitted by typical multi-channel encoder device.That is to say that spatial parameter information can get into Hofmann decoding operation or pilot de code operations, and can be used as unpressed spatial cues data (space cue data) and be transferred to each module.Before a kind of being suitable for come the transmission space parameter information to give the multichannel audio decoding device through remote control; The back is a kind of also very convenient because do not need the multichannel audio decoding device the spatial cues data-switching of compression to the unpressed spatial cues data of in decode operation, using more easily.
Configuration according to the spatial parameter information of the analysis of side information and control information possibly cause reducing the delay between audio signal and the spatial parameter information.For fear of this point, can provide an extra impact damper to be used to reduce audio signal or be used for spatial parameter information, reduce audio signal like this and spatial parameter information can be synchronized with each other.Yet these methods are inconvenient, because extra impact damper need be provided.Optional is, side information can be transmitted before the reduction audio signal, and it has considered the delay between contingent reduction audio signal and the spatial parameter information.In this case, the spatial parameter information that obtains through combination side information and control information does not need can be easy to use by adjustment again.
If a plurality of object signal of reduction audio signal have varying level; Art reduction audio mixing gain (ADG) module of ability direct compensation reduction audio signal can be confirmed the associated level of object signal; And can use such as levels of channels difference information, the spatial cues data of (ICC) information of correlativity between sound channel and sound channel predictive coefficient (CPC) information and so on are assigned to the precalculated position in the multichannel space with each object signal.
For instance; If predetermine one signal of control information indication will be assigned to the precalculated position in the multichannel space; And the level of this object signal is higher than other object signal; Typical multi-channel decoder can calculate poor between the channel energies of reduction audio signal, and will reduce audio signal according to result calculated and be divided into some output channels.Yet, the volume that typical multi-channel decoder can not increase or reduce to reduce sound in the audio signal.In other words, typical multi-channel decoder simply will reduce audio signal and distribute to some output channels, and not increase or reduce to reduce the volume of sound in the audio signal.
Each precalculated position that is assigned in the multichannel space of a plurality of object signal that will be generated by object encoder according to control information also is relatively very simple.Yet, increase or the amplification that reduces the predetermine one signal needs special technique.In other words, if use the reduction audio signal that is generated by object encoder, the amplitude that reduces to reduce each object signal of audio signal is difficult.
Therefore, according to one embodiment of the invention, can use as shown in Figure 8 ADG module 147 to change the correlation magnitude of object signal according to control information.Any one amplitude of a plurality of object signal that in particular, can be through using the reduction audio signal that ADG module 147 increases or reduce to be transmitted by object encoder.Reduction audio signal by the 147 execution compensation of ADG module are obtained can be carried out multi-channel decoding.
If use the 147 suitable adjustment of ADG module to reduce the relative amplitude of the object signal of audio signal, then can use typical multi-channel decoder to carry out the object decoding.If the reduction audio signal that is generated by object encoder is monophony or stereophonic signal or has three or the multi-channel signal of multichannel more that this reduction audio signal can be handled by ADG module 147.If the reduction audio signal that is generated by object encoder has two or more sound channels; And need exist only in by the predetermine one signal that ADG module 147 is adjusted in the sound channel in the reduction audio signal; Then ADG module 147 can only be applied to comprising the sound channel of this predetermine one signal, rather than is applied to reduce all sound channels of audio signal.Reduction audio signal after being handled through said method by ADG module 147 can use typical multi-channel decoder to handle easily, and need not revise the structure of multi-channel decoder.
Even when the signal of final output is not the multi-channel signal that can be reproduced by multi-channel loudspeaker, but binaural signal, can use ADG module 147 to go to adjust the correlation magnitude of the object signal of final output signal.
As using substituting of ADG module 147, during the generation of a plurality of object signal, can comprise in the control information that appointment will be applied to the gain information of the yield value of each object signal.For this reason, revise the structure of typical multi-channel decoder possibly.Even need to revise the structure of existing multi-channel decoder, during decode operation, through yield value being applied to each object signal, and need not calculate ADG and each object signal of compensation, this method is reducing aspect the decoding complex degree still very easily.
Fig. 9 is the block scheme according to the audio decoding apparatus 150 of fourth embodiment of the invention.Referring to Fig. 9, audio decoding apparatus 150 is characterised in that the generation binaural signal.
Specifically, audio decoding apparatus 150 comprises multichannel ears demoder 151, the first parametric converters 157 and second parametric converter 159.
Second parametric converter 159 is analyzed side information and the control information that is provided by audio coding apparatus, and comes the configuration space parameter information according to analysis result.First parametric converter 157 is through increasing three-dimensional (3D) information, and for example a related transfer function (HRTF) parameter is given spatial parameter information, and disposing can be by the ears parameter information of multichannel ears demoder 151 uses.Multichannel ears demoder 151 generates virtual three-dimensional (3D) signal for the reduction audio signal through applying virtual 3D parameter information.
First parametric converter 157 and second parametric converter 159 can be replaced by an independent module; It is parameter transformation module 155; It receives side information, control information and HRTF parameter, and disposes the ears parameter information according to side information, control information and HRTF parameter.
As a rule; For the binaural signal of the reproduction of using headphone to generate to be used to the reduction audio signal that comprises 10 object signal, object signal must come to generate respectively 10 decoded signals corresponding to 10 object signal according to reduction audio signal and side information.Thereafter, renderer reference control signal is assigned to precalculated position in the multichannel space to be suitable for 5 channel loudspeaker environment with each of 10 object signal.Thereafter, renderer generates 5 sound channel signals that can use 5 channel loudspeakers to reproduce.Thereafter, renderer is applied to the HRTF parameter in 5 sound channel signals, thereby generates 2 sound channel signals.In brief, above-mentioned common audio-frequency decoding method comprises: reproduce 10 object signal, convert these 10 object signal into 5 sound channel signals, and generate 2 sound channel signals according to 5 sound channel signals, visible its efficient is very low.
On the other hand, audio decoding apparatus 150 can be easy to the binaural signal that generation can use headphone to reproduce according to object audio signal.In addition, audio decoding apparatus 150 comes the configuration space parameter information through the analysis to side information and control information, and uses typical multichannel ears demoder to generate binaural signal.Yet; Even if when it is equipped with integrated parametric converter; Audio decoding apparatus 150 still can use typical multichannel ears demoder; This parametric converter receives side information, control information and HRTF parameter, and disposes the ears parameter information according to side information, system information and HRTF parameter.
Figure 10 is the block scheme according to the audio decoding apparatus 160 of fifth embodiment of the invention.Referring to Figure 10, audio decoding apparatus 160 comprises reduction audio mixing processor 161, multi-channel decoder 163 and parametric converter 165.Reduction audio mixing processor 161 can be substituted by single module 167 with parametric converter 163.
If the reduction audio signal that is input in the audio decoding apparatus 160 is a stereophonic signal; Before this reduction audio signal is transfused to multi-channel decoder 163; This reduction audio signal can be used to handled by the reduction audio mixing that reduction audio mixing processor 161 is carried out; Because multi-channel decoder 163 can not be mapped to corresponding L channel and R channel with the component of reduction audio signal, wherein L channel is of multichannel, and R channel is multichannel another.Therefore; For the object signal that can will be categorized into L channel is transferred on the direction of R channel; The reduction audio signal that inputs to audio decoding apparatus 160 can be reduced the pre-service of audio mixing processor, and pretreated reduction audio signal can be transfused to multi-channel decoder 163.
Can be according to the pre-service of carrying out stereo reduction audio signal from side information with from the pretreatment information that control information obtains.
Figure 11 is the block scheme according to the audio decoding apparatus 170 of sixth embodiment of the invention.Referring to Figure 11, audio decoding apparatus 170 comprises multi-channel decoder 171, sound channel processor 173 and parametric converter 175.
The parameter information that parametric converter 175 generates the spatial parameter information that can be used by multi-channel decoder 171 and can be used by sound channel processor 173.Sound channel processor 173 is carried out the aftertreatment to the signal of being exported by multi-channel decoder 171.The example of the signal that multi-channel decoder 171 is exported comprises: stereophonic signal, ears stereophonic signal and multi-channel signal.
The example of the post-processing operation that sound channel processor 173 is performed comprises: revise or each sound channel or all sound channels of conversion output signal.For instance, if side information comprises the basic frequency information about the predetermine one signal, sound channel processor 173 can be removed harmonic component with reference to this basic frequency information from the predetermine one signal.The multichannel audio coding/decoding method maybe be efficient inadequately for karaoke OK system.Yet if be included in the side information about the basic frequency information of voice object, and the harmonic component of voice object signal is removed during aftertreatment, can realize high performance karaoke OK system through the embodiment that uses Figure 11.The embodiment of Figure 11 also can be applicable to the object signal except that the voice object signal.For instance, can use the embodiment of Figure 11 to remove the sound of being scheduled to musical instrument.Equally, can use the embodiment of Figure 11 to use and amplify predetermined harmonic component about the basic frequency information of object signal.
Figure 12 is the block scheme according to the audio decoding apparatus 210 of seventh embodiment of the invention.Referring to Figure 12, audio decoding apparatus 210 uses multi-channel decoder 213 to replace object decoder.
Particularly, audio decoding apparatus 210 comprises multi-channel decoder 213, code converter 215, renderer 217 and 3D information database 219.
Related transfer function (HRTF) can be used as a kind of 3D information and is used.HRTF is a kind of transition function, and it has described at an arbitrary position sound source and the transmission of the sound wave between the ear, and returns a value that changes according to the position of sound source and height.If use HRTF to come filtering not with the signal of directivity, this signal can be heard as from certain direction and reproduce.
When receiving incoming bit stream, audio decoding apparatus 210 uses the demodulation multiplexer (not shown) from incoming bit stream, to extract object-based reduction audio signal and object-based parameter information.Then, renderer 217 extracts the index data that is used for confirming a plurality of object audio signal position from control information, and from 3D information database 219, extracts (withdraw) and the corresponding 3D information of being extracted of index data out.
Specifically, not only level information can be comprised, the necessary index data of search 3D information can also be comprised by the audio decoding apparatus 210 employed audio mixing parameter informations that are included in the control information.The audio mixing parameter information also can comprise the temporal information about the mistiming between sound channel, positional information and one or more parameter that is obtained through appropriate combination level information and temporal information.
Can come the initial position of confirming object audio signal according to default audio mixing parameter information, and change the position through the 3D information of using corresponding to user's desired position to object audio signal subsequently.Optional is, if the user hopes only 3D effect to be applied to some object audio signal, the level information and the temporal information of not hoping to use the object audio signal of 3D effect about other user can be used as the audio mixing parameter information.
Figure 13 is the block scheme according to the audio decoding apparatus 220 of eighth embodiment of the invention.Referring to Figure 13, audio decoding apparatus 220 is different from audio decoding apparatus shown in Figure 12 210, and its difference is that code converter 225 transmits based on the side information of sound channel and 3D information discretely and gives multi-channel decoder 223.In other words; The code converter 225 of audio decoding apparatus 220 is from about obtaining the side information based on sound channel about M sound channel the object-based parameter information of N object signal; And transmission is given multi-channel decoder 223 based on the side information of sound channel and each the 3D information that is applied to N object signal, however code converter 215 transmission of audio decoding apparatus 210 comprise 3D information based on the side information of sound channel to multi-channel decoder 213.
Referring to Figure 14, can comprise a plurality of frame index based on the side information and the 3D information of sound channel.Therefore, multi-channel decoder 223 can come synchronous side information and 3D information based on sound channel based on the side information of sound channel and the frame index of 3D information with reference to each, and can use 3D information and give the frame corresponding to the bit stream of this 3D information.For example, the 3D information that has an index 2 can be applied to the beginning of the frame 2 with index 2.
Because side information and 3D information based on sound channel all comprise frame index, even 3D information is upgraded the temporary position based on the side information of sound channel that can confirm effectively also that 3D information will be applied to along with the time.In other words, code converter 225 comprises 3D information and based on a plurality of frame index in the side information of sound channel, thus multi-channel decoder 223 can be easily synchronously based on the side information and the 3D information of sound channel.
Reduction audio mixing processor 231, code converter 235, renderer 237 can be substituted by an independent module 239 with the 3D information database.
Figure 15 is the block scheme according to the audio decoding apparatus 230 of nineth embodiment of the invention.Referring to Figure 15, audio decoding apparatus 230 is different from audio decoding apparatus shown in Figure 13 220, and its difference is that audio decoding apparatus 230 further comprises reduction audio mixing processor 231.
Specifically, audio decoding apparatus 230 comprises code converter 235, renderer 237,3D information database 238, multi-channel decoder 233 and reduction audio mixing processor 231.Code converter 235, renderer 237,3D information database 238 is identical respectively with counterpart shown in Figure 13 with multi-channel decoder 233.Reduction audio mixing processor 231 stereo sound reduction audio signal is carried out pretreatment operation with the adjustment position.3D information database 238 can merge with renderer 237.Can also be provided for using desired effects gives audio decoding apparatus 230 for the module of reduction audio signal.
Figure 16 representes the block scheme according to the audio decoding apparatus 240 of tenth embodiment of the invention.Referring to Figure 16, audio decoding apparatus 240 is different from audio decoding apparatus shown in Figure 15 230, and its difference is that audio decoding apparatus 240 comprises multipoint control unit combiner 241.
That is to say that audio decoding apparatus 240 is the same with audio decoding apparatus 230, comprise reduction audio mixing processor 243, multi-channel decoder 244, code converter 245, renderer 247 and 3D information database 249.Multipoint control unit combiner 241 makes up by a plurality of bit streams that object-based coding obtained, thereby obtains single bit stream.For instance; When input is used for first bit stream of first sound signal and is used for second bit stream of second sound signal; Multipoint control unit combiner 241 extracts the first reduction audio signal from first bit stream; From second bit stream, extract the second reduction audio signal, and generate the 3rd reduction audio signal through making up the first and second reduction audio signal.In addition; Multipoint control unit combiner 241 extracts the first object-based side information from first bit stream; From second bit stream, extract the second object-based side information, and through making up the first object-based side information and the second object-based side information generates the 3rd object-based side information.Thereafter, multipoint control unit combiner 241 generates bit stream through making up the 3rd reduction audio signal and the 3rd object-based side information, and exports the bit stream that is generated.
Therefore, according to tenth embodiment of the invention, be compared to the coding or the situation of each object signal of decoding, even by the signal of two or more communication parties' transmission, it also can be processed effectively.
Multipoint control unit combiner 241 is in order to extract respectively from a plurality of bit streams a plurality of; And merge in the independent reduction audio signal with the corresponding reduction audio signal of different compression coding and decodings; These reduction audio signal need be converted into the signal in pulse code modulation (pcm) signal or the predetermined frequency area according to the compression coding and decoding type of reduction audio signal; PCM signal or possibly combine through the signal that obtained of conversion, the signal demand that is obtained through combination uses predetermined compression coding and decoding to change.In this case, whether be merged in the signal in PCM signal or the predetermined frequency area, may postpone according to the reduction audio signal.Yet this delay possibly can't correctly be estimated by decoded device.Therefore, this delay possibly be included in the bit stream and with bit stream and be transmitted.This postpones the quantity of the delay sampling of indication in the PCM signal or the quantity of the delay sampling in predetermined frequency area.
Compare with the quantity at the input signal of typical multichannel coding/decoding operating period (for example 5.1 sound channels or 7.1 sound channel coding/decodings operation) normal processing, the quantity of the input signal that need handle in object-based audio coding/decoding operating period is quite big sometimes.Therefore, object-based audio coding/decoding method needs higher bit rate than typical audio coding/decoding based on sound channel.Yet because object-based audio coding/decoding method comprises the processing of the object signal that the contrast sound channel signal is littler, it can use object-based audio coding/decoding method to generate dynamic output signal.
To come illustrated in detail audio coding method according to an embodiment of the invention referring to accompanying drawing 17-20 below.
In object-based audio coding method, object signal can be defined as the independent sound of expression, such as the mankind's the voice or the sound of musical instrument.Optional is; Sound with same characteristic features; Such as the sound that stringed musical instrument is arranged (for example violin, viola and violoncello), belong to the sound of same frequency band; Or can be combined in together, and define by identical object signal according to the sound that the direction and the angle of sound source is classified into identical category.Still optional is to use the combination of said method to define object signal.
A plurality of object signal can be used as reduction audio signal and side information and are transmitted.Between the startup stage of the information that will be transmitted, each energy or power of a plurality of object signal of reduction audio signal or reduction audio signal is carried out initial calculation to be used to detect the envelope of reduction audio signal.Result calculated can be used to the level ratio of connection object signal or reduction audio signal or calculating object signal.
Linear predictive coding (LPC) algorithm can be used to more low bit rate.Specifically, generate a plurality of LPC coefficients of the envelope of expression signal through signal analysis, and these LPC coefficients will be transmitted to replace the envelope information of transmission about signal.This method is efficiently aspect bit rate.Yet the LPC parameter is variant with the actual envelope of signal probably, and this method needs extra processing, such as error recovery.In brief, the method that relates to the envelope information of transmission signals can guarantee the high-quality of sound, but this needing to have caused the increase of information transmitted amount.On the other hand, relate to and use the method for LPC coefficient can reduce the information transmitted amount that needs, but need extra processing, such as error recovery, this will cause the reduction of sound quality.
According to one embodiment of present invention, can use the combination of these methods.In other words, can use energy or power or the index value of signal or, come the envelope of expression signal like the LPC coefficient corresponding to another value of the energy or the power of signal.
Envelope information about signal can be that unit obtains with time period or frequency band.Specifically, referring to Figure 17, be that the unit obtains with the frame about the envelope information of signal.Optional is; If signal is represented by the band structure that uses the bank of filters of organizing such as quadrature mirror filter (QMF); Envelope information about signal can be with frequency subband; It is than the frequency subband entity of fritter more that the group of frequency subband, or the group that frequency subband is separated is that unit obtains, frequency subband are separated.Still optional is, based on the method for frame, the use of the combination of the method for separating based on the method for frequency subband with based on frequency subband is also within protection scope of the present invention.
Still optional is; The low frequency component of supposing signal has the high fdrequency component more information than signal; Envelope information itself about the low frequency component of signal can be transmitted; Yet, can be worth by LPC coefficient or other about the envelope information of the high fdrequency component of signal and to represent, and transmission LPC coefficient or other value are to replace the envelope information about the high fdrequency component of signal.But the low frequency component of signal not necessarily just has more information than the high fdrequency component of signal.Therefore need be according to the actual conditions said method of applying in a flexible way.
According to one embodiment of the invention, will be transmitted corresponding to the envelope information or the index data of the part of signal (below be called major part), the part of this signal is on time/frequency axis, to show as major part.Optional is that the energy of the major part of expression signal and the value of power (for example LPC coefficient) can be transmitted, and do not transmit these values corresponding to the non-major part of signal.Still optional is, can transmit envelope information or index data corresponding to the major part of signal, and also can transmit energy or the value of power of the non-major part of expression signal.Still optional is, only transmits the information about the major part of signal, like this can be according to the non-major part of coming estimated signal about the information of the major part of signal.Still optional is to use the combination of said method.
For instance, referring to Figure 18,, but transmit about the information usage flag of signal four kinds of diverse ways for (a)-(d) if signal is divided into main period and non-main period.
In order to transmit a plurality of object signal of the combination that reduces audio signal and side information, as the part of decode operation, the reduction audio signal need be divided into a plurality of elements, for example, has considered the ratio of the level of object signal.For the independence between the element that guarantees to reduce audio signal, need extra execution decorrelation operation.
The sound channel signal that likens to the codec unit in the multichannel decoding method as the object signal of the codec unit in the object-based decoding method has more independence.In other words, sound channel signal comprises a plurality of object signal, so need be by decorrelation.In yet another aspect, be independently between the object signal, be easy to carry out channel separation so can use the characteristic of object signal and do not need the decorrelation operation.
Specifically, referring to Figure 19, object signal A, B and C are in turn as the main object on the frequency axis.In this case, need be according to object signal A, the level ratio of B and C and will reduce audio signal and be divided into a plurality of signals need not carried out decorrelation yet.Instead, about object signal A, the information of the main period of B and C will be transmitted, or yield value is applied to each object signal A, on each frequency component of B and C, thereby skip decorrelation.Therefore, it can reduce calculated amount, and can reduce the required bit rate of the necessary side information of decorrelation.
In brief; In order to skip decorrelation; Can be used as side information about the information of the frequency domain that comprises each object signal and be transmitted, this decorrelation is performed to guarantee dividing the independence between reduction a plurality of signals that audio signal was obtained by the ratio according to the object signal rate of reduction audio signal.Optional is; The different gains value be can use and main period and non-main period given; Therefore each object signal all shows as mainly in the main period, and each object signal all shows as not too mainly in the non-main period, and the information about main period can mainly be provided as side information.Still optional is, can be used as side information about the information of main period and is transmitted, and do not transmit not the information about non-main period.Still optional is, can be used as the combination of the said method that substitutes of decorrelation method.
The said method that substitutes as the decorrelation method can be applied to all signal objects, or only is applied to the object signal that some has the obvious discernible major cycle.Same, can frame be that unit is employed as the said method that substitutes of decorrelation method.
Below will describe the coding of the object audio signal of using residual signals in detail.
In general, in object-based audio coding/decoding method, a plurality of object signal are encoded, and coding result is transmitted as the combination that reduces audio signal and side information.Then, from the reduction audio signal, recover a plurality of object signal according to side information through decoding, and the object signal after recovering for example, is generated final sound channel signal according to control information by suitable audio mixing in user's request.Object-based audio coding/decoding method generally is devoted under the help of mixer, to change the output channels signal freely according to control signal.Yet no matter object-based audio coding/decoding method also can be used to generate according to the sound channel output of predefine mode control information.
For this reason, side information not only comprises the necessary information of a plurality of object signal of acquisition from the reduction audio signal, also comprises generating the necessary audio mixing parameter information of sound channel signal.Then, do not need the help of mixer just can generate final channel output signal.In this case, can use this residual error coding/decoding algorithm to improve sound quality.
Typical residual error coding/decoding method comprises the coding/decoding signal and signal behind the coding/decoding and the mistake between the original signal is carried out coding/decoding, just residual signals.During decode operation, the signal behind the coding is decoded, signal behind the while compensation coding and the mistake between the original signal, thus recover the signal identical as far as possible with original signal.Because the mistake between decoded signal and the original signal as a rule is inappreciable, it can reduce the amount of carrying out the necessary extraneous information of residual error coding/decoding.
If the output of the final sound channel of demoder has been determined, not only to be provided for generating the necessary audio mixing parameter information of final sound channel signal, also to provide residual coding information with as side information.In this case, it can improve sound quality.
Figure 20 is the block scheme of audio coding apparatus 310 according to an embodiment of the invention.With reference to Figure 20, audio coding apparatus 310 is characterised in that it has used residual signals.
Specifically, audio coding apparatus 310 comprises scrambler 311, demoder 313, the first mixers 315, the second mixers 319, totalizer 317 and bit stream maker 321.
The calculating of residual signals can be applied to all parts of signal, or only is applied to the low frequency part of signal.Optional is that the calculating of residual signals can be comprised based on frame in the main signal frequency-domain of frame by variable only being applied to.Still optional is to use the combination of said method.
Because comprise that the amount of side information of residual signals information is bigger than the amount of the side information that does not comprise residual signals information, the calculating of residual signals can only be applied to signal those directly influence parts of sound quality, thereby prevent the growth that bit rate is too much.But the computer-readable code of the present invention's service recorder on computer-readable medium realized.This computer readable recording medium storing program for performing can be the pen recorder of any kind, and data are stored with computer-readable mode therein.The example of computer readable recording medium storing program for performing comprises ROM, RAM, CD-ROM, disk, floppy disk, optical data memories and the carrier wave data transmission of the Internet (for example through).Computer readable recording medium storing program for performing can be assigned with through a plurality of computer systems that are connected on the network, so computer-readable code is written into wherein, and is performed with non-centralized system.Common those skilled in the art can be easy to construct and be used to realize functional programs of the present invention, code and code segment.
Industrial applicibility
As stated, according to the present invention, through benefiting from the advantage of object-based audio coding and coding/decoding method, the acoustic image of each object audio signal can be positioned.Then, it can provide more real sound through the reproduction of object audio signal.In addition, the present invention can be applied to interactive entertainment, and can provide more real pseudo-entity to experience to the user.
Although the present invention is described and explains with reference to its preferred embodiment, clearly those skilled in the art can make on the various ways with details on change, and do not break away from by defined spirit of the present invention of following claim or category.
Claims (11)
1. audio-frequency decoding method, it comprises:
From sound signal, extract reduction audio signal and object-based side information, generate said reduction audio signal through at least one object signal of reduction audio mixing;
Receiving control information;
Generate parameter information according to said object-based side information and said control information;
Generate side information according to said object-based side information and said control information based on sound channel;
Handle said reduction audio signal according to said reduction audio signal and said parameter information, so that control the position or the level of said at least one object signal; With
Reduction audio signal after use handling and said side information based on sound channel generate multi-channel audio signal,
Wherein, the reduction audio signal after said reduction audio signal and the said processing all is made up of L channel and R channel,
Wherein, Said object-based side information comprises envelope information or the index data corresponding to the part of main object signal; With the value of LPC (linear predictive coding) coefficient of representing non-main object signal, said main object signal and said non-main object signal are included in the object signal of said reduction audio signal.
2. audio-frequency decoding method as claimed in claim 1 wherein, handles that said reduction audio signal comprises that execution is handled the adjustment of the level of said reduction audio signal, acoustic image and at least one in increasing of effect.
3. audio-frequency decoding method as claimed in claim 1 wherein, is handled said reduction audio signal and further is included in the time domain or the said reduction audio signal of modification in frequency domain.
4. audio-frequency decoding method as claimed in claim 1, it comprises that further said multi-channel audio signal is carried out reverberation to be handled.
5. audio-frequency decoding method as claimed in claim 1 further comprises being increased in the said multi-channel audio signal by the prearranged signals that effect process obtained.
6. audio-frequency decoding method as claimed in claim 1; Wherein, said object-based side information comprises at least one in simple crosscorrelation information between object level difference information, object, reduction audio mixing gain information, reduction upmixed channels level difference information and the absolute object energy information.
7. audio decoding apparatus, it comprises:
Demodulation multiplexer, it is configured to from sound signal, extract reduction audio signal and object-based side information, generates said reduction audio signal through at least one object signal of reduction audio mixing;
Parametric converter, it is configured to receiving control information, generates parameter information according to said object-based side information and said control information, and generates the side information based on sound channel according to said object-based side information and said control information;
Reduction audio mixing processor is used for handling said reduction audio signal according to said reduction audio signal and said parameter information, so that control the position or the level of said at least one object signal; With
Multi-channel decoder, it is configured to use reduction audio signal and said side information based on sound channel after the processing that is obtained by said reduction audio mixing processor to generate multi-channel audio signal,
Wherein, the reduction audio signal after said reduction audio signal and the processing all is made up of L channel and R channel,
Wherein, Said object-based side information comprises envelope information or the index data corresponding to the part of main object signal; With the value of LPC (linear predictive coding) coefficient of representing non-main object signal, said main object signal and said non-main object signal are included in the object signal of said reduction audio signal.
8. audio decoding apparatus as claimed in claim 7, wherein, at least one among said reduction audio mixing processor increases level adjustment, acoustic image processing and the effect of reducing audio signal through execution handled said reduction audio signal.
9. audio decoding apparatus as claimed in claim 7, wherein, said reduction audio mixing processor is handled said reduction audio signal in time domain or in frequency domain.
10. audio decoding apparatus as claimed in claim 7, it further comprises the sound channel processor, is used for that said multi-channel audio signal is carried out reverberation and handles.
11. audio decoding apparatus as claimed in claim 7, it further comprises the sound channel processor, is used for being increased to said multi-channel audio signal by the prearranged signals that effect process obtained.
Applications Claiming Priority (15)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US84829306P | 2006-09-29 | 2006-09-29 | |
| US60/848,293 | 2006-09-29 | ||
| US82980006P | 2006-10-17 | 2006-10-17 | |
| US60/829,800 | 2006-10-17 | ||
| US86330306P | 2006-10-27 | 2006-10-27 | |
| US60/863,303 | 2006-10-27 | ||
| US86082306P | 2006-11-24 | 2006-11-24 | |
| US60/860,823 | 2006-11-24 | ||
| US88071407P | 2007-01-17 | 2007-01-17 | |
| US60/880,714 | 2007-01-17 | ||
| US88094207P | 2007-01-18 | 2007-01-18 | |
| US60/880,942 | 2007-01-18 | ||
| US94837307P | 2007-07-06 | 2007-07-06 | |
| US60/948,373 | 2007-07-06 | ||
| PCT/KR2007/004803 WO2008039043A1 (en) | 2006-09-29 | 2007-10-01 | Methods and apparatuses for encoding and decoding object-based audio signals |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101479787A CN101479787A (en) | 2009-07-08 |
| CN101479787B true CN101479787B (en) | 2012-12-26 |
Family
ID=40839594
Family Applications (4)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2007800238696A Active CN101479785B (en) | 2006-09-29 | 2007-10-01 | Method for encoding and decoding object-based audio signal and apparatus thereof |
| CN2007800241203A Active CN101484935B (en) | 2006-09-29 | 2007-10-01 | Methods and apparatuses for encoding and decoding object-based audio signals |
| CN2007800242333A Active CN101479786B (en) | 2006-09-29 | 2007-10-01 | Method for encoding and decoding object-based audio signal and apparatus thereof |
| CN2007800242526A Active CN101479787B (en) | 2006-09-29 | 2007-10-01 | Method for encoding and decoding object-based audio signal and apparatus thereof |
Family Applications Before (3)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2007800238696A Active CN101479785B (en) | 2006-09-29 | 2007-10-01 | Method for encoding and decoding object-based audio signal and apparatus thereof |
| CN2007800241203A Active CN101484935B (en) | 2006-09-29 | 2007-10-01 | Methods and apparatuses for encoding and decoding object-based audio signals |
| CN2007800242333A Active CN101479786B (en) | 2006-09-29 | 2007-10-01 | Method for encoding and decoding object-based audio signal and apparatus thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (4) | CN101479785B (en) |
Families Citing this family (28)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101710113B1 (en) | 2009-10-23 | 2017-02-27 | 삼성전자주식회사 | Apparatus and method for encoding/decoding using phase information and residual signal |
| CN105047206B (en) | 2010-01-06 | 2018-04-27 | Lg电子株式会社 | Handle the device and method thereof of audio signal |
| CN103890841B (en) * | 2011-11-01 | 2017-10-17 | 皇家飞利浦有限公司 | Audio object is coded and decoded |
| JP6133413B2 (en) * | 2012-06-14 | 2017-05-24 | ドルビー・インターナショナル・アーベー | Smooth configuration switching for multi-channel audio |
| TWI517142B (en) | 2012-07-02 | 2016-01-11 | Sony Corp | Audio decoding apparatus and method, audio coding apparatus and method, and program |
| CA2843226A1 (en) | 2012-07-02 | 2014-01-09 | Sony Corporation | Decoding device, decoding method, encoding device, encoding method, and program |
| CA2843263A1 (en) | 2012-07-02 | 2014-01-09 | Sony Corporation | Decoding device, decoding method, encoding device, encoding method, and program |
| KR20150032651A (en) | 2012-07-02 | 2015-03-27 | 소니 주식회사 | Decoding device and method, encoding device and method, and program |
| US9479886B2 (en) * | 2012-07-20 | 2016-10-25 | Qualcomm Incorporated | Scalable downmix design with feedback for object-based surround codec |
| US9761229B2 (en) | 2012-07-20 | 2017-09-12 | Qualcomm Incorporated | Systems, methods, apparatus, and computer-readable media for audio object clustering |
| AU2013301864B2 (en) | 2012-08-10 | 2016-04-14 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Apparatus and methods for adapting audio information in spatial audio object coding |
| RU2676242C1 (en) * | 2013-01-29 | 2018-12-26 | Фраунхофер-Гезелльшафт Цур Фердерунг Дер Ангевандтен Форшунг Е.Ф. | Decoder for formation of audio signal with improved frequency characteristic, decoding method, encoder for formation of encoded signal and encoding method using compact additional information for selection |
| TWI530941B (en) * | 2013-04-03 | 2016-04-21 | 杜比實驗室特許公司 | Methods and systems for interactive rendering of object based audio |
| RU2646344C2 (en) | 2013-07-31 | 2018-03-02 | Долби Лэборетериз Лайсенсинг Корпорейшн | Processing of spatially diffuse or large sound objects |
| WO2015038578A2 (en) * | 2013-09-12 | 2015-03-19 | Dolby Laboratories Licensing Corporation | System aspects of an audio codec |
| CN106104684A (en) * | 2014-01-13 | 2016-11-09 | 诺基亚技术有限公司 | Multi-channel audio signal grader |
| CA3042070C (en) * | 2014-04-25 | 2021-03-02 | Ntt Docomo, Inc. | Linear prediction coefficient conversion device and linear prediction coefficient conversion method |
| CN104036788B (en) * | 2014-05-29 | 2016-10-05 | 北京音之邦文化科技有限公司 | The acoustic fidelity identification method of audio file and device |
| US20160104263A1 (en) * | 2014-10-09 | 2016-04-14 | Media Tek Inc. | Method And Apparatus Of Latency Profiling Mechanism |
| SG11201706101RA (en) | 2015-02-02 | 2017-08-30 | Fraunhofer Ges Forschung | Apparatus and method for processing an encoded audio signal |
| JP6699564B2 (en) * | 2015-02-10 | 2020-05-27 | ソニー株式会社 | Transmission device, transmission method, reception device, and reception method |
| KR102373459B1 (en) * | 2015-06-24 | 2022-03-14 | 소니그룹주식회사 | Device and method for processing sound, and recording medium |
| CN117676451A (en) * | 2016-11-08 | 2024-03-08 | 弗劳恩霍夫应用研究促进协会 | Apparatus and method for encoding or decoding multi-channel signal using side gain and residual gain |
| EP3605531B1 (en) * | 2017-03-28 | 2024-08-21 | Sony Group Corporation | Information processing device, information processing method, and program |
| GB201808897D0 (en) * | 2018-05-31 | 2018-07-18 | Nokia Technologies Oy | Spatial audio parameters |
| KR102712458B1 (en) * | 2019-12-09 | 2024-10-04 | 삼성전자주식회사 | Audio outputting apparatus and method of controlling the audio outputting appratus |
| CN111292725B (en) * | 2020-02-28 | 2022-11-25 | 北京声智科技有限公司 | Voice decoding method and device |
| CN112351379B (en) * | 2020-10-28 | 2021-07-30 | 歌尔光学科技有限公司 | Control method of audio component and smart head mounted device |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| BRPI0304540B1 (en) * | 2002-04-22 | 2017-12-12 | Koninklijke Philips N. V | METHODS FOR CODING AN AUDIO SIGNAL, AND TO DECODE AN CODED AUDIO SIGN, ENCODER TO CODIFY AN AUDIO SIGN, CODIFIED AUDIO SIGN, STORAGE MEDIA, AND, DECODER TO DECOD A CODED AUDIO SIGN |
| US7395210B2 (en) * | 2002-11-21 | 2008-07-01 | Microsoft Corporation | Progressive to lossless embedded audio coder (PLEAC) with multiple factorization reversible transform |
| KR100682904B1 (en) * | 2004-12-01 | 2007-02-15 | 삼성전자주식회사 | Apparatus and method for processing multi-channel audio signal using spatial information |
-
2007
- 2007-10-01 CN CN2007800238696A patent/CN101479785B/en active Active
- 2007-10-01 CN CN2007800241203A patent/CN101484935B/en active Active
- 2007-10-01 CN CN2007800242333A patent/CN101479786B/en active Active
- 2007-10-01 CN CN2007800242526A patent/CN101479787B/en active Active
Non-Patent Citations (1)
| Title |
|---|
| ITU-T.Call for Proposals on Spatial Audio Object Coding.《Call for Proposals on Spatial Audio Object Coding》.2007,第1－20页. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101479786B (en) | 2012-10-17 |
| CN101479785B (en) | 2013-08-07 |
| CN101479786A (en) | 2009-07-08 |
| CN101484935A (en) | 2009-07-15 |
| CN101484935B (en) | 2013-07-17 |
| CN101479787A (en) | 2009-07-08 |
| CN101479785A (en) | 2009-07-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101479787B (en) | Method for encoding and decoding object-based audio signal and apparatus thereof | |
| CN101542595B (en) | For the method and apparatus of the object-based sound signal of Code And Decode | |
| US11343631B2 (en) | Compatible multi-channel coding/decoding | |
| KR101065704B1 (en) | Method and apparatus for encoding and decoding object based audio signals | |
| AU2008215232B2 (en) | Methods and apparatuses for encoding and decoding object-based audio signals | |
| JP5455647B2 (en) | Audio decoder | |
| JP4838361B2 (en) | Audio signal decoding method and apparatus | |
| JP5269039B2 (en) | Audio encoding and decoding | |
| RU2406166C2 (en) | Coding and decoding methods and devices based on objects of oriented audio signals | |
| JP4601669B2 (en) | Apparatus and method for generating a multi-channel signal or parameter data set | |
| CN101379554B (en) | Apparatus and method for encoding/decoding signal | |
| AU2005281937A1 (en) | Generation of a multichannel encoded signal and decoding of a multichannel encoded signal | |
| JP5173811B2 (en) | Audio signal decoding method and apparatus | |
| KR100763920B1 (en) | Method and apparatus for decoding an input signal obtained by compressing a multichannel signal into a mono or stereo signal into a binaural signal of two channels | |
| CN101385078A (en) | Method for encoding and decoding object-based audio signal and apparatus thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |