JP4907522B2 - Speech coding apparatus and speech coding method - Google Patents

Description

  The present invention relates to a speech encoding apparatus and speech encoding method, and more particularly to a speech encoding apparatus and speech encoding method for stereo speech.

  With the widening of the transmission band in mobile communication and IP communication and the diversification of services, the need for higher sound quality and higher presence in voice communication is increasing. For example, in the future, hands-free calls in videophone services, voice communications in videoconferencing, multipoint voice communications in which multiple speakers talk at the same time at multiple locations, and the ambient sound environment while maintaining a sense of reality Demand for voice communications that can be transmitted is expected to increase. In that case, it is desired to realize audio communication using stereo sound that has a sense of presence than a monaural signal and can recognize the utterance positions of a plurality of speakers. In order to realize such audio communication using stereo sound, it is essential to encode stereo sound.

  In addition, in voice data communication on an IP network, a voice coding system having a scalable configuration is desired for traffic control on the network and multicast communication. A scalable configuration refers to a configuration in which audio data can be decoded even from partial encoded data on the receiving side. The encoding process in the speech encoding method having a scalable configuration is hierarchized, and includes one corresponding to the core layer and one corresponding to the enhancement layer. Therefore, encoded data generated by the encoding process also includes encoded data of the core layer and encoded data of the enhancement layer.

  Even when stereo audio is encoded and transmitted, a scalable configuration between monaural and stereo (monaural-) that enables the reception side to select decoding of a stereo signal and decoding of a monaural signal using a part of the encoded data. A speech coding scheme having a stereo scalable configuration is desired.

As a speech coding method based on such a speech coding scheme, for example, prediction of a signal between channels (hereinafter sometimes abbreviated as “ch”) (prediction of a first channel signal to a second channel signal, or There is a method in which the prediction of the first channel signal from the second channel signal) is performed by pitch prediction between channels, that is, encoding is performed using the correlation between two channels (see Non-Patent Document 1).
Ramprashad, SA, “Stereophonic CELP coding using cross channel prediction”, Proc. IEEE Workshop on Speech Coding, pp.136-138, Sep. 2000

  However, in the above conventional speech coding method, when the correlation between both channels is small, sufficient prediction performance (prediction gain) cannot be obtained and coding efficiency may deteriorate.

  An object of the present invention is to provide a speech encoding apparatus and speech encoding method that can efficiently encode stereo speech even when the correlation between both channels is small.

The speech coding apparatus according to the present invention generates a monaural signal using the first channel signal and the second channel signal in a speech coding apparatus that encodes a stereo signal including a first channel signal and a second channel signal. Monaural signal generating means, selecting means for selecting one of the first channel signal and the second channel signal, encoding the generated monaural signal to obtain core layer encoded data, and selecting the selected channel signal encodes have a, encoding means for obtaining an extended layer encoded data corresponding to the core layer encoded data, said selection means, coding distortion for the first channel signal and the second channel signal, or, Based on the intra-channel correlation corresponding to the first channel signal and the second channel signal, the first channel signal One was selected for each frame of the Yaneru signal and the second channel signal, the encoding means, a configuration for encoding the monaural signal and the channel signal selected for each of the frame for each of the frames.

The speech encoding method of the present invention is a speech encoding method for encoding a stereo signal including a first channel signal and a second channel signal, and generates a monaural signal using the first channel signal and the second channel signal. a step of a selection step of selecting one of the first channel signal and the second channel signal, the obtained core layer encoded data generated monaural signal is encoded, and encodes the selected channel signal An encoding step of obtaining enhancement layer encoded data corresponding to the core layer encoded data , wherein the selecting step includes encoding distortion for the first channel signal and the second channel signal, or the first channel Signal and an intra-channel correlation corresponding to the second channel signal, Selecting one of the channel signal and the second channel signal for each frame, in the encoding step, to the monaural signal and the channel signal selected for each of the frames to be encoded for each said frame.

  According to the present invention, stereo audio can be efficiently encoded even when the correlation between a plurality of channel signals of a stereo signal is small.

  Hereinafter, embodiments of the present invention relating to speech coding having a monaural-stereo scalable configuration will be described in detail with reference to the accompanying drawings.

(Embodiment 1)
FIG. 1 is a block diagram showing a configuration of a speech encoding apparatus according to Embodiment 1 of the present invention. The speech coding apparatus 100 in FIG. 1 includes a core layer coding unit 102 that is a component corresponding to a scalable core layer, and an enhancement layer coding unit 104 that is a component corresponding to a scalable enhancement layer. . Hereinafter, description will be made on the assumption that each component operates in units of frames.

  The core layer encoding unit 102 includes a monaural signal generation unit 110 and a monaural signal encoding unit 112. The enhancement layer encoding unit 104 includes an encoding channel selection unit 120, a first channel encoding unit 122, a second channel encoding unit 124, and a switch unit 126.

In the core layer encoding unit 102, the monaural signal generation unit 110 includes a first channel input audio signal s_ch1 (n) and a second channel input audio signal s_ch2 (n) (where n = 0 to NF−1) included in the stereo input audio signal. ; NF is a frame length), a monaural signal s_mono (n) is generated based on the relationship shown in Expression (1), and is output to the monaural signal encoding unit 112. Here, the stereo signal described in the present embodiment includes two channel signals, that is, a first channel signal and a second channel signal.

  The monaural signal encoding unit 112 encodes the monaural signal s_mono (n) for each frame. Any encoding method may be used for encoding. The encoded data obtained by encoding the monaural signal s_mono (n) is output as core layer encoded data. More specifically, the core layer encoded data is multiplexed with enhancement layer encoded data and encoded channel selection information, which will be described later, and output from the speech encoding apparatus 100 as transmission encoded data.

  Also, the monaural signal encoding unit 112 decodes the monaural signal s_mono (n), and the monaural decoded audio signal obtained thereby is sent to the first channel encoding unit 122 and the second channel encoding unit 124 of the enhancement layer encoding unit 104. Output.

  In the enhancement layer coding unit 104, the coding channel selection unit 120 uses the first channel input speech signal s_ch1 (n) and the second channel input speech signal s_ch2 (n) to expand the first channel and the second channel. An optimum channel as a channel to be encoded in the layer is selected based on a predetermined selection criterion. The optimal channel is selected for each frame. Here, the predetermined selection criterion is a criterion for realizing enhancement layer coding with high efficiency or high sound quality (low coding distortion). The encoded channel selection unit 120 generates encoded channel selection information indicating the selected channel. The generated encoded channel selection information is output to the switch unit 126 and multiplexed with the core layer encoded data described above and enhancement layer encoded data described later.

  Note that the encoding channel selection unit 120 uses the codes in the first channel encoding unit 122 and the second channel encoding unit 124 instead of using the first input audio signal s_ch1 (n) and the second input audio signal s_ch2 (n). Any parameter or signal or encoding result (that is, first channel encoded data and second channel encoded data described later) obtained in the process of encoding may be used.

  The first channel encoding unit 122 encodes the first channel input audio signal for each frame using the first channel input audio signal and the monaural decoded audio signal, and outputs the first channel encoded data obtained thereby to the switch unit 126. .

  In addition, the first channel encoding unit 122 decodes the first channel encoded data to obtain a first channel decoded audio signal. However, in the present embodiment, the first channel decoded speech signal obtained by first channel encoder 122 is not shown.

  Second channel encoding section 124 encodes the second channel input audio signal for each frame using the second channel input audio signal and the monaural decoded audio signal, and outputs the second channel encoded data obtained thereby to switch section 126. .

  Further, the second channel encoding unit 124 decodes the second channel encoded data to obtain a second channel decoded audio signal. However, in the present embodiment, the second channel decoded speech signal obtained by the second channel encoding unit 124 is not shown.

  The switch unit 126 selectively outputs one of the first channel encoded data and the second channel encoded data for each frame in accordance with the encoded channel selection information. The encoded data to be output is the encoded data of the channel selected by the encoding channel selection unit 120. Therefore, when the selected channel is switched from the first channel to the second channel, or from the second channel to the first channel, the encoded data output from the switch unit 126 is also the first channel encoded data from the first channel encoded data. Switching to 2ch encoded data or switching from 2ch encoded data to 1st ch encoded data.

  Here, the combination of the monaural signal encoding unit 112, the first channel encoding unit 122, the second channel encoding unit 124, and the switch unit 126 described above is selected while encoding the monaural signal to obtain core layer encoded data. An encoding unit that encodes a channel signal to obtain enhancement layer encoded data corresponding to the core layer encoded data is configured.

  FIG. 2 shows a configuration of a speech decoding apparatus that can receive transmission decoded data output from speech encoding apparatus 100 as reception encoded data and decode it to obtain a monaural decoded speech signal and a stereo decoded speech signal. It is a block diagram. The speech decoding apparatus 150 in FIG. 2 includes a core layer decoding unit 152 that is a component corresponding to the core layer of the scalable configuration, and an enhancement layer decoding unit 154 that is a component corresponding to the enhancement layer of the scalable configuration.

  The core layer decoding unit 152 includes a monaural signal decoding unit 160. The monaural signal decoding unit 160 decodes the core layer encoded data included in the received received encoded data to obtain a monaural decoded audio signal sd_mono (n). The monaural decoded audio signal sd_mono (n) is output to the subsequent audio output unit (not shown), the first channel decoding unit 172, the second channel decoding unit 174, the first channel decoded signal generation unit 176, and the second channel decoded signal generation unit 178. Is done.

  The enhancement layer decoding unit 154 includes a switch unit 170, a first channel decoding unit 172, a second channel decoding unit 174, a first channel decoded signal generation unit 176, a second channel decoded signal generation unit 178, and switch units 180 and 182.

  The switch unit 170 refers to the encoded channel selection information included in the received encoded data, and outputs the enhancement layer encoded data included in the received encoded data to the decoding unit corresponding to the selected channel. Specifically, when the selected channel is the first channel, the enhancement layer encoded data is output to the first channel decoding unit 172, and when the selected channel is the second channel, the enhancement layer encoded data is The data is output to second channel decoding section 174.

  When the enhancement layer encoded data is input from the switch unit 170, the first channel decoding unit 172 uses the enhancement layer encoded data and the monaural decoded speech signal sd_mono (n) to generate the first channel decoded speech signal sd_ch1 (n). The first channel decoded audio signal sd_ch1 (n) is output to the switch unit 180 and the second channel decoded signal generation unit 178.

  When the enhancement layer encoded data is input from the switch unit 170, the second channel decoding unit 174 uses the enhancement layer encoded data and the monaural decoded speech signal sd_mono (n) to generate the second channel decoded speech signal sd_ch2 (n). The second channel decoded audio signal sd_ch2 (n) is output to the switch unit 182 and the first channel decoded signal generation unit 176.

When the second channel decoded speech signal sd_ch2 (n) is input from the second channel decoding unit 174, the first channel decoded signal generation unit 176 receives the second channel decoded speech signal sd_ch2 (n) input from the second channel decoding unit 174 and monaural. Using the decoded speech signal sd_mono (n), a first channel decoded speech signal sd_ch1 (n) is generated based on the relationship shown in the following equation (2). The generated first channel decoded audio signal sd_ch1 (n) is output to the switch unit 180.

When the first channel decoded speech signal sd_ch1 (n) is input from the first channel decoding unit 172, the second channel decoded signal generation unit 178 receives the first channel decoded speech signal sd_ch1 (n) and monaural input from the first channel decoding unit 172. Using the decoded audio signal sd_mono (n), a second channel decoded audio signal sd_ch2 (n) is generated based on the relationship shown in the following equation (3). The generated second channel decoded audio signal sd_ch2 (n) is output to the switch unit 182.

  The switch unit 180, according to the encoded channel selection information, the first channel decoded speech signal sd_ch1 (n) input from the first channel decoding unit 172 and the first channel decoded speech signal sd_ch1 (n) input from the first channel decoded signal generation unit 176. ) Is selectively output. Specifically, when the selected channel is the first channel, the first channel decoded speech signal sd_ch1 (n) input from the first channel decoding unit 172 is selected and output. On the other hand, when the selected channel is the second channel, the first channel decoded audio signal sd_ch1 (n) input from the first channel decoded signal generation unit 176 is selected and output.

  The switch unit 182 receives the second channel decoded speech signal sd_ch2 (n) input from the second channel decoding unit 174 and the second channel decoded speech signal sd_ch2 (n) input from the second channel decoded signal generation unit 178 according to the encoded channel selection information. ) Is selectively output. Specifically, when the selected channel is the first channel, the second channel decoded speech signal sd_ch2 (n) input from the second channel decoded signal generation unit 178 is selected and output. On the other hand, when the selected channel is the second channel, the second channel decoded speech signal sd_ch2 (n) input from the second channel decoding unit 174 is selected and output.

  The first channel decoded audio signal sd_ch1 (n) output from the switch unit 180 and the second channel decoded audio signal sd_ch2 (n) output from the switch unit 182 are the subsequent audio output units (not shown) as stereo decoded audio signals. Is output.

  As described above, according to the present embodiment, the monaural signal s_mono (n) generated from the first channel input audio signal s_ch1 (n) and the second channel input audio signal s_ch2 (n) is encoded to generate the core layer encoded data. And encoding the input audio signal (first channel input audio signal s_ch1 (n) or second channel input audio signal s_ch2 (n)) of the channel selected from the first channel and the second channel, thereby obtaining enhancement layer encoded data. Therefore, it is possible to avoid that the prediction performance (prediction gain) becomes insufficient when the correlation between the plurality of channels of the stereo signal is small, and it is possible to efficiently encode the stereo sound.

(Embodiment 2)
FIG. 3 is a block diagram showing the configuration of the speech coding apparatus according to Embodiment 2 of the present invention.

  Note that speech coding apparatus 200 in FIG. 3 has the same basic configuration as speech coding apparatus 100 described in the first embodiment. Therefore, the same reference numerals as those used in the first embodiment are given to the same components as those described in the first embodiment among the components described in the present embodiment, and the components are not described. Detailed description is omitted.

  Also, transmission encoded data output from speech coding apparatus 200 can be decoded by a speech decoding apparatus having the same basic configuration as speech decoding apparatus 150 described in the first embodiment.

  Speech coding apparatus 200 has core layer coding section 102 and enhancement layer coding section 202. The enhancement layer encoding unit 202 includes a first channel encoding unit 122, a second channel encoding unit 124, a switch unit 126, and an encoded channel selection unit 210.

  The encoding channel selection unit 210 includes a second channel decoded speech generation unit 212, a first channel decoded speech generation unit 214, a first distortion calculation unit 216, a second distortion calculation unit 218, and an encoding channel determination unit 220.

  The second channel decoded speech generation unit 212 uses the monaural decoded speech signal obtained by the monaural signal encoding unit 112 and the first channel decoded speech signal obtained by the first channel encoding unit 122, to the above equation (1). Based on the relationship shown, a second channel decoded speech signal is generated as a second channel estimation signal. The generated second channel decoded speech signal is output to first distortion calculation section 216.

  The first channel decoded speech generation unit 214 uses the monaural decoded speech signal obtained by the monaural signal encoding unit 112 and the second channel decoded speech signal obtained by the second channel encoding unit 124, to the above equation (1). Based on the relationship shown, a first channel decoded speech signal is generated as a first channel estimation signal. The generated first channel decoded speech signal is output to second distortion calculation section 218.

  The combination of the second channel decoded speech generation unit 212 and the first channel decoded speech generation unit 214 described above constitutes an estimated signal generation unit.

  The first distortion calculation unit 216 uses the first channel decoded speech signal obtained by the first channel coding unit 122 and the second channel decoded speech signal obtained by the second channel decoded speech generation unit 212 to perform the first coding distortion. calculate. The first coding distortion corresponds to coding distortion for two channels that occurs when the first channel is selected as a channel to be coded in the enhancement layer. The calculated first coding distortion is output to coding channel determining section 220.

  The second distortion calculation unit 218 uses the second channel decoded speech signal obtained by the second channel encoding unit 124 and the first channel decoded speech signal obtained by the first channel decoded speech generation unit 214 to perform the second coding distortion. calculate. The second coding distortion corresponds to coding distortion for two channels that occurs when the second channel is selected as a target channel for coding in the enhancement layer. The calculated second coding distortion is output to coding channel determining section 220.

Here, as a method for calculating the coding distortion (first coding distortion or second coding distortion) for two channels, for example, the following two methods may be mentioned. One is a corresponding input audio signal (first c) of the decoded audio signal (first channel decoded audio signal or second channel decoded audio signal) of each channel.
In this method, the average of the error power ratio (signal to coding distortion ratio) for two channels with respect to the h input voice signal or the second channel input voice signal) is obtained as coding distortion for two channels. The other is a method for obtaining the sum of the error power for two channels as the coding distortion for two channels.

  The combination of the first distortion calculation unit 216 and the second distortion calculation unit 218 described above constitutes a distortion calculation unit. Moreover, the combination of this distortion calculation part and the estimated signal generation part mentioned above comprises a calculation part.

  The coding channel determination unit 220 compares the first coding distortion value and the second coding distortion value with each other, and selects the first coding distortion and the second coding distortion having the smaller value. To do. The coding channel determination unit 220 selects a channel corresponding to the selected coding distortion as a target channel (coding channel) for coding in the enhancement layer, and sets coding channel selection information indicating the selected channel. Generate. More specifically, the coding channel determination unit 220 selects the first channel when the first coding distortion is smaller than the second coding distortion, and the second coding distortion is larger than the first coding distortion. If it is smaller, the second channel is selected. The generated encoded channel selection information is output to the switch unit 126 and multiplexed with the core layer encoded data and the enhancement layer encoded data.

  Thus, according to the present embodiment, since the magnitude of the coding distortion is used as the coding channel selection criterion, the coding distortion of the enhancement layer can be reduced, and stereo audio can be efficiently generated. Can be encoded.

  In the present embodiment, the ratio or sum of the error power of the decoded audio signal of each channel with respect to the corresponding input audio signal is calculated, and this calculation result is used as encoding distortion. You may use the encoding distortion obtained in the encoding process in the encoding part 122 and the 2ch encoding part 124. FIG. The encoding distortion may be a distortion with auditory weight.

(Embodiment 3)
FIG. 4 is a block diagram showing the configuration of the speech coding apparatus according to Embodiment 3 of the present invention. Note that speech coding apparatus 300 in FIG. 4 has the same basic configuration as speech coding apparatuses 100 and 200 described in the above-described embodiments. Therefore, among the components described in this embodiment, the same components as those described in the above embodiment are denoted by the same reference numerals as those used in the above embodiment, and the detailed description thereof is omitted. Description is omitted.

  Also, transmission encoded data output from speech coding apparatus 300 can be decoded by a speech decoding apparatus having the same basic configuration as speech decoding apparatus 150 described in the first embodiment.

  Speech encoding apparatus 300 includes core layer encoding section 102 and enhancement layer encoding section 302. The enhancement layer encoding unit 302 includes an encoding channel selection unit 310, a first channel encoding unit 312, a second channel encoding unit 314, and a switch unit 126.

  As illustrated in FIG. 5, the encoding channel selection unit 310 includes a first channel intra-channel correlation calculation unit 320, a second channel intra-channel correlation calculation unit 322, and an encoding channel determination unit 324.

  The first channel intra-channel correlation degree calculation unit 320 calculates the first channel intra-channel correlation degree cor1 using the normalized maximum autocorrelation coefficient value for the first channel input speech signal.

  The second channel intra-channel correlation calculation unit 322 calculates the intra-channel correlation degree cor2 of the second channel using the normalized maximum autocorrelation coefficient value for the second channel input speech signal.

  For calculating the intra-channel correlation for each channel, instead of using the normalized maximum autocorrelation coefficient value for the input speech signal of each channel, the pitch prediction gain value for the input speech signal of each channel is used, or the LPC ( Linear Prediction Coding) normalized maximum autocorrelation coefficient value and pitch prediction gain value for the prediction residual signal can be used.

  The encoded channel determination unit 324 compares the intra-channel correlations cor1 and cor2 with each other, and selects one having a higher value. The encoded channel determination unit 324 selects a channel corresponding to the selected intra-channel correlation as an encoded channel in the enhancement layer, and generates encoded channel selection information indicating the selected channel. More specifically, if the intra-channel correlation cor1 is higher than the intra-channel correlation cor2, the encoded channel determination unit 324 selects the first channel, and the intra-channel correlation cor2 is higher than the intra-channel correlation cor1. If so, select the second channel. The generated encoded channel selection information is output to the switch unit 126 and multiplexed with the core layer encoded data and the enhancement layer encoded data.

  The first channel encoding unit 312 and the second channel encoding unit 314 have the same internal configuration. Therefore, for simplification of description, one of the first channel encoding unit 312 and the second channel encoding unit 314 is indicated as “first channel encoding unit 330”, and the internal configuration thereof will be described with reference to FIG. To do. Note that “A” in “Ach” represents 1 or 2. Also, “B” used in the drawings and in the following description represents 1 or 2. However, when “A” is 1, “B” is 2, and when “A” is 2, “B” is 1.

  The Ach encoding unit 330 includes a switch unit 332, an Ach signal intra-channel prediction unit 334, subtracters 336 and 338, an Ach prediction residual signal encoding unit 340, and a Bch estimation signal generation unit 342.

  The switch unit 332 outputs the Ach decoded speech signal obtained by the Ach prediction residual signal encoding unit 340 or the Ach estimation signal obtained by the Bch encoding unit (not shown) as an encoding channel. According to the selection information, output to the Ach signal intra-channel prediction unit 334. Specifically, when the selected channel is the Ath channel, the Ach decoded speech signal is output to the Ach signal intra-channel prediction unit 334, and when the selected channel is the Bth channel, the Ach estimation is performed. The signal is output to the Ach signal intra-channel prediction unit 334.

ここで、Sin(n)はピッチ予測フィルタへの入力信号、Ｔはピッチ予測フィルタのラグ、ｇｐはピッチ予測フィルタのピッチ予測係数である。 The A-channel signal intra-channel prediction unit 334 performs intra-channel prediction of the A-th channel. The intra-channel prediction is a method for predicting a signal of the current frame from a signal of a past frame using the correlation of signals within the channel. As a result of the intra-channel prediction, an intra-channel prediction signal Sp (n) and an intra-channel prediction parameter quantization code are obtained. For example, when a primary pitch prediction filter is used, the intra-channel prediction signal Sp (n) is calculated by the following equation (4).

Here, Sin (n) is an input signal to the pitch prediction filter, T is a lag of the pitch prediction filter, and gp is a pitch prediction coefficient of the pitch prediction filter.

  The above-mentioned past frame signals are held in an intra-channel prediction buffer (an A-ch intra-channel prediction buffer) provided in the intra-Ach signal intra-channel prediction unit 334. The intra-Ach intra-channel prediction buffer is updated with the signal input from the switch unit 332 in order to predict the signal of the next frame. Details of the update of the intra-channel prediction buffer will be described later.

  The subtracter 336 subtracts the monaural decoded audio signal from the Ach input audio signal. The subtracter 338 subtracts the intra-channel prediction signal Sp (n) obtained by the intra-channel prediction in the Ach signal intra-channel prediction unit 334 from the signal obtained by the subtraction in the subtracter 336. The signal obtained by the subtraction in the subtracter 338, that is, the Ach prediction residual signal is output to the Ach prediction residual signal encoding unit 340.

  The Ach prediction residual signal encoding unit 340 encodes the Ach prediction residual signal using an arbitrary encoding method. By this encoding, prediction residual encoded data and the Ach decoded speech signal are obtained. The prediction residual encoded data is output as the Ach encoded data together with the intra-channel prediction parameter quantization code. The Ach decoded speech signal is output to the Bch estimated signal generation unit 342 and the switch unit 332.

  B-th channel estimation signal generation section 342 generates a B-th channel estimation signal from the A-channel decoded speech signal and monaural decoded speech signal as a B-channel decoded speech signal at the time of A-th channel coding. The generated Bch estimation signal is output to a switch unit (similar to the switch unit 332) of the Bch encoding unit (not shown).

  Next, the update operation of the intra-channel prediction buffer will be described. Here, taking as an example the case where the A-th channel is selected by the encoded channel selection unit 310, an example of the update operation of the intra-channel prediction buffer for the A-th channel will be described with reference to FIG. An example of the buffer update operation will be described with reference to FIG.

  In the operation example illustrated in FIG. 7, the Ach signal intra-channel prediction unit using the Ach decoded speech signal of the i-th frame (i is an arbitrary natural number) obtained by the Ath prediction residual signal encoding unit 340. The intra-Ach channel intra-channel prediction buffer 351 inside 334 is updated (ST101). The updated Ach intra-channel prediction buffer 351 is used for intra-channel prediction for the i + 1-th frame that is the next frame (ST102).

  In the operation example shown in FIG. 8, the i-th frame Bch estimation signal is generated using the i-th frame Ach decoded audio signal and the i-frame monaural decoded audio signal (ST201). The generated Bch estimation signal is output from Ach encoding section 330 to a Bch encoding section (not shown). Then, in the Bch encoding unit, the Bch estimation signal is output to the Bch signal intra-channel prediction unit (similar to the Ach signal intra-channel prediction unit 334) via the switch unit (similar to the switch unit 332). The The intra-Bch channel prediction buffer 352 provided in the intra-Bch signal intra-channel prediction unit is updated with the Bch estimation signal (ST202). The updated Bch intra-channel prediction buffer 352 is used for intra-channel prediction for the (i + 1) th frame (ST203).

  When the A-th channel is selected as the coding channel in a certain frame, the B-th channel encoding unit does not require any operation other than the update operation of the intra-B-channel prediction buffer 352. Signal encoding can be paused.

  As described above, according to the present embodiment, since the high intra-channel correlation is used as the selection criterion for the encoded channel, it is possible to encode a channel signal having a high intra-channel correlation. Encoding efficiency by intra prediction can be improved.

  Note that a component that performs inter-channel prediction can be added to the configuration of the speech encoding apparatus 300. In this case, instead of inputting the monaural decoded audio signal to the subtracter 336, the audio encoding device 300 performs inter-channel prediction that predicts the Ach audio signal using the monaural decoded audio signal, and the channel generated thereby A configuration in which the inter-prediction signal is input to the subtractor 336 can be employed.

(Embodiment 4)
FIG. 9 is a block diagram showing the configuration of the speech coding apparatus according to Embodiment 4 of the present invention.

  Note that speech encoding apparatus 400 in FIG. 9 has the same basic configuration as speech encoding apparatuses 100, 200, and 300 described in the above embodiments. Therefore, among the components described in this embodiment, the same components as those described in the above embodiment are denoted by the same reference numerals as those used in the above embodiment, and the detailed description thereof is omitted. Description is omitted.

  Also, transmission encoded data output from speech coding apparatus 400 can be decoded by a speech decoding apparatus having the same basic configuration as speech decoding apparatus 150 described in the first embodiment.

  Speech encoding apparatus 400 includes core layer encoding section 402 and enhancement layer encoding section 404. The core layer encoding unit 402 includes a monaural signal generation unit 110 and a monaural signal CELP (Code Excited Linear Prediction) encoding unit 410. The enhancement layer encoding unit 404 includes an encoding channel selection unit 310, a first ch CELP encoding unit 422, a second ch CELP encoding unit 424, and a switch unit 126.

  In the core layer encoding unit 402, the monaural signal CELP encoding unit 410 performs CELP encoding on the monaural signal generated by the monaural signal generation unit 110. The encoded data obtained by this encoding is output as core layer encoded data. In addition, a monaural driving sound source signal is obtained by this encoding. Further, the monaural signal CELP encoding unit 410 decodes the monaural signal and outputs a monaural decoded audio signal obtained thereby. The core layer encoded data is multiplexed with enhancement layer encoded data and encoded channel selection information. Also, the core layer encoded data, the monaural driving excitation signal, and the monaural decoded speech signal are output to the first ch CELP encoding unit 422 and the second ch CELP encoding unit 424.

  In enhancement layer encoding section 404, first ch CELP encoding section 422 and second ch CELP encoding section 424 have the same internal configuration. Therefore, for simplification of description, one of the first ch CELP encoding unit 422 and the second ch CELP encoding unit 424 is indicated as a “second Ach CELP encoding unit 430”, and the internal configuration thereof will be described with reference to FIG. To do. As described above, “A” of “Ach” represents 1 or 2, “B” used in the drawings and in the following description also represents 1 or 2, and when “A” is 1, “B” "Is 2, and when" A "is 2," B "is 1.

The Ach CELP encoding unit 430 includes an Ach LPC (Linear Prediction Coding) analysis unit 431, multipliers 432, 433, 434, 435, and 436, a switch unit 437, an Ach adaptive codebook 438, an Ach fixed codebook 439, and an addition. 440, synthesis filter 441, perceptual weighting unit 442, distortion minimizing unit 443, Ach decoding unit 444, Bch estimation signal generation unit 445, Ach LPC analysis unit 446, Ach LPC prediction residual signal generation unit 447 and subtractor 448.

  In the AchCELP encoding unit 430, the AchLPC analysis unit 431 performs LPC analysis on the Ach input speech signal, and quantizes the AchLPC parameters obtained thereby. The AchLPC analysis unit 431 uses the fact that the correlation between the AchLPC parameter and the LPC parameter for the monaural signal is generally high, and decodes the monaural signal quantized LPC parameter from the core layer encoded data when the LPC parameter is quantized. The difference component of the AchLPC parameter with respect to the decoded monaural signal quantization LPC parameter is quantized to obtain the AchLPC quantized code. The Ach LPC quantization code is output to the synthesis filter 441. The Ach LPC quantization code is output as Ach encoded data together with Ach drive excitation encoded data described later. By performing the quantization of the difference component, the quantization of the LPC parameters of the enhancement layer can be made efficient.

  In the AchCELP encoding unit 430, the Ach drive excitation code data is obtained by encoding the residual component of the Ach drive excitation signal with respect to the monaural drive excitation signal. This encoding is realized by sound source search in CELP encoding.

  That is, the AchCELP encoding unit 430 multiplies the adaptive excitation signal, the fixed excitation signal, and the monaural driving excitation signal by the corresponding gain, adds these excitation signals after gain multiplication, and obtains the result by addition. A closed-loop type sound source search (adaptive codebook search, fixed codebook search, and gain search) by distortion minimization is performed on the drive sound source signal. Then, the adaptive codebook index (adaptive excitation index), fixed codebook index (fixed excitation index), and the gain code for the adaptive excitation signal, fixed excitation signal, and monaural driving excitation signal are output as the Ach driving excitation encoded data. . While the coding of the core layer, the coding of the enhancement layer, and the selection of the coding channel are performed for each frame, the sound source search is performed for each subframe obtained by dividing the frame into a plurality of parts. Hereinafter, this configuration will be described more specifically.

  The synthesis filter 441 uses the AchLPC quantization code output from the AchLPC analysis unit 431 to perform synthesis by the LPC synthesis filter using the signal output from the adder 440 as a driving sound source. A synthesized signal obtained by this synthesis is output to the subtracter 448.

  The subtracter 448 calculates an error signal by subtracting the synthesized signal from the Ach input audio signal. The error signal is output to the auditory weighting unit 442. The error signal corresponds to coding distortion.

  The auditory weighting unit 442 performs auditory weighting on the coding distortion (that is, the error signal described above), and outputs the weighted coding distortion to the distortion minimizing unit 443.

  The distortion minimizing section 443 determines an adaptive codebook index and a fixed codebook index that minimize the coding distortion, fixes the adaptive codebook index to the Ach adaptive codebook 438, and fixes the fixed codebook index to the Ach. Each is output to the codebook 439. Further, the distortion minimizing unit 443 generates gains corresponding to these indexes, specifically, gains (adaptive codebook gain and fixed codebook gain) for each of an adaptive vector described later and a fixed vector described later, The adaptive codebook gain is output to multiplier 433, and the fixed codebook gain is output to multiplier 435.

  Also, the distortion minimizing unit 443 has a gain (first adjustment gain, second adjustment gain, and gain) for adjusting the gain between the monaural driving sound source signal, the adaptive vector after gain multiplication, and the fixed vector after gain multiplication. 3rd adjustment gain) is generated, and the first adjustment gain is output to the multiplier 432, the second adjustment gain is output to the multiplier 434, and the third adjustment gain is output to the multiplier 436. These adjustment gains are preferably generated so as to be related to each other. For example, when the inter-channel correlation between the first channel input audio signal and the second channel input audio signal is high, the contribution of the monaural driving sound source signal is the contribution of the adaptive vector after gain multiplication and the fixed vector after gain multiplication. Thus, three adjustment gains are generated so as to be relatively large. On the other hand, when the correlation between channels is low, the adjustments for the three driving sources are such that the contribution of the monaural driving sound source signal is relatively small relative to the contribution of the adaptive vector after gain multiplication and the fixed vector after gain multiplication. Gain is generated.

  Also, the distortion minimizing section 443 converts the adaptive codebook index, fixed codebook index, adaptive codebook gain code, fixed codebook gain code, and three gain adjustment gain codes into the Ach drive excitation code data Output as.

  The Ach adaptive codebook 438 stores the excitation vector of the driving excitation to the synthesis filter 441 generated in the past in the internal buffer. In addition, the Ach adaptive codebook 438 generates a vector for one subframe as an adaptive vector from the stored excitation vector. The generation of the adaptive vector is performed based on the adaptive codebook lag (pitch lag or pitch period) corresponding to the adaptive codebook index input from the distortion minimizing unit 443. The generated adaptation vector is output to the multiplier 433.

  The internal buffer of the Ach adaptive codebook 438 is updated by the signal output from the switch unit 437. Details of this update operation will be described later.

  Ach fixed codebook 439 outputs the excitation vector corresponding to the fixed codebook index output from distortion minimizing section 443 to multiplier 435 as a fixed vector.

  Multiplier 433 multiplies the adaptive vector output from A-th adaptive codebook 438 by the adaptive codebook gain, and outputs the adaptive vector after gain multiplication to multiplier 434.

  Multiplier 435 multiplies the fixed vector output from Ach fixed codebook 439 by a fixed codebook gain, and outputs the fixed vector after gain multiplication to multiplier 436.

  Multiplier 432 multiplies the monaural driving sound source signal by the first adjustment gain, and outputs the monaural driving sound source signal after gain multiplication to adder 440. Multiplier 434 multiplies the adaptive vector output from multiplier 433 by the second adjustment gain, and outputs the adaptive vector after gain multiplication to adder 440. Multiplier 436 multiplies the fixed vector output from multiplier 435 by the third adjustment gain, and outputs the fixed vector after gain multiplication to adder 440.

  The adder 440 adds the monaural driving sound source signal output from the multiplier 432, the adaptive vector output from the multiplier 434, and the fixed vector output from the multiplier 436, and switches the signal after the addition Output to the unit 437 and the synthesis filter 441.

The switch unit 437 outputs the signal output from the adder 440 or the signal output from the AchLPC prediction residual signal generation unit 447 to the Ach adaptive codebook 438 according to the encoding channel selection information. More specifically, when the selected channel is the Ath channel, the signal from the adder 440 is output to the Ach adaptive codebook 438, and when the selected channel is the Bth channel, the AchLPC prediction is performed. The signal from the residual signal generation unit 447 is the Ac
h is output to the adaptive codebook 438.

  The Ach decoding unit 444 decodes the Ach encoded data, and outputs the obtained Ach decoded speech signal to the Bch estimated signal generation unit 445.

  Bch estimated signal generation section 445 generates a Bch estimated signal as a Bch decoded speech signal at the time of Ach encoding, using the Ach decoded speech signal and the monaural decoded speech signal. The generated Bch estimation signal is output to a BchCELP encoding unit (not shown).

  The Ach LPC analysis unit 446 performs LPC analysis on the Ach estimation signal output from the Bch CELP encoding unit (not shown), and the obtained Ach LPC parameters are sent to the Ach LPC prediction residual signal generation unit 447. Output. Here, the Ach estimated speech output from the Bch CELP encoding unit is the Ach decoded speech generated when the Bch input speech signal is encoded (during the Bch encoding) in the Bch CELP encoding unit. Corresponds to the signal.

  The AchLPC prediction residual signal generation unit 447 generates an encoded LPC prediction residual signal for the Ach estimation signal using the AchLPC parameter output from the AchLPC analysis unit 446. The generated encoded LPC prediction residual signal is output to the switch unit 437.

  Next, the adaptive codebook update operation in the AchCELP encoding unit 430 and the BchCELP encoding unit (not shown) will be described. FIG. 11 is a flowchart showing an adaptive codebook update operation when the channel A is selected by the coding channel selection unit 310.

  The flow illustrated here includes CELP encoding processing (ST310) in the AchCELP encoding unit 430, adaptive codebook update processing (ST320) in the AchCELP encoding unit 430, and adaptive code in the BchCELP encoding unit. This is divided into a book update process (ST330). Step ST310 includes two steps ST311 and ST312, and step ST330 includes four steps ST331, ST332, ST333, and ST334.

  First, in step ST311, LPC analysis and quantization are performed by the Ach LPC analysis unit 431 of the Ach CELP encoding unit 430. The Ach adaptive codebook 438, the Ach fixed codebook 439, the multipliers 432, 433, 434, 435, 436, the adder 440, the synthesis filter 441, the subtractor 448, the perceptual weighting unit 442, and the distortion minimizing unit 443. A sound source search (adaptive codebook search, fixed codebook search, and gain search) is performed by a closed loop type sound source search unit that mainly includes (ST312).

  In step ST320, the internal buffer of the Ach adaptive codebook 438 is updated with the Ach drive excitation signal obtained by the excitation search described above.

  In step ST331, the Bch estimation signal generation section 445 of the AchCELP encoding section 430 generates a Bch estimation signal. The generated Bch estimation signal is sent from the AchCELP encoding unit 430 to the BchCELP encoding unit. In step ST332, an LPC analysis is performed on the Bch estimation signal by a BchLPC analysis unit (equivalent to the AchLPC analysis unit 446) (not shown) of the BchCELP encoding unit to obtain a BchLPC parameter.

  In step ST333, the Bch LPC parameter is used by the Bch LPC prediction residual signal generation unit (equivalent to the Ach LPC prediction residual signal generation unit 447) (not shown) of the Bch CELP encoding unit, and the Bch LPC estimation signal is An encoded LPC prediction residual signal is generated. This encoded LPC prediction residual signal is sent to a Bch adaptive codebook (not shown) (equivalent to the Ach adaptive codebook 438) via a switch (not shown) of the BchCELP encoding unit (equivalent to the switch unit 437). ) Is output. In step ST334, the internal buffer of the Bch adaptive codebook is updated with the encoded LPC prediction residual signal for the Bch estimation signal.

  Next, the adaptive codebook update operation will be described more specifically. Here, an example of the update operation of the internal buffer of the Ach adaptive codebook 438 will be described using the case where the Ath channel is selected by the coding channel selection unit 310 with reference to FIG. An example of the internal buffer update operation will be described with reference to FIG.

  In the operation example shown in FIG. 12, the internal buffer of the Ach adaptive codebook 438 is updated using the Ach drive excitation signal for the jth subframe in the ith frame obtained by the distortion minimizing section 443. (ST401). The updated Ach adaptive codebook 438 is used for sound source search for the j + 1-th subframe that is the next subframe (ST402).

  In the operation example shown in FIG. 13, the i-th frame Bch estimation signal is generated using i-th frame Ach decoded audio signal and i-frame monaural decoded audio signal (ST501). The generated Bch estimation signal is output from the AchCELP encoding unit 430 to the BchCELP encoding unit. Then, in the Bch LPC prediction residual signal generation unit of the Bch CELP encoding unit, a Bch encoded LPC prediction residual signal (encoded LPC prediction residual signal for the Bch estimation signal) 451 for the i-th frame is generated. (ST502). The Bch encoded LPC prediction residual signal 451 is output to the Bch adaptive codebook 452 via the switch unit of the Bch CELP encoding unit. Bch adaptive codebook 452 is updated by Bch encoded LPC prediction residual signal 451 (ST503). The updated Bch adaptive codebook 452 is used for sound source search for the (i + 1) th frame which is the next frame (ST504).

  When the Ath channel is selected as the encoding channel in a certain frame, the BchCELP encoding unit does not require any operation other than the update operation of the Bch adaptive codebook 452, and therefore the Bch input speech signal in that frame. Can be paused.

  As described above, according to the present embodiment, when speech encoding of each layer is performed based on the CELP encoding scheme, a channel signal having a high intra-channel correlation can be encoded. The encoding efficiency by prediction can be improved.

  In the present embodiment, the case where the coding channel selection unit 310 described in the third embodiment is used in the speech coding apparatus adopting the CELP coding method has been described as an example. The encoding channel selection unit 120 and the encoding channel selection unit 210 described in Embodiment 2 can be used instead of the encoding channel selection unit 310 or together with the encoding channel 310. Therefore, when the speech encoding of each layer is performed based on the CELP encoding method, the effects described in the above embodiments can be realized.

Also, other than the above-described ones can be used as selection criteria for the enhancement layer coding channel. For example, with respect to a certain frame, the adaptive codebook search of the AchCELP encoding unit 430 and the adaptive codebook search of the BchCELP encoding unit are respectively performed, and the resulting encoding distortion has a smaller value. The corresponding channel may be selected as the encoding channel.

  Moreover, the component which performs the prediction between channels can also be added to the structure of the audio | voice coding apparatus 400. FIG. In this case, the speech encoding apparatus 400 performs inter-channel prediction that predicts the first Ach decoded speech signal using the monaural drive excitation signal instead of directly multiplying the monaural drive excitation signal by the first adjustment gain. A configuration in which the inter-channel prediction signal generated thereby is multiplied by the first adjustment gain can be employed.

  The embodiments of the present invention have been described above. The speech encoding apparatus and speech decoding apparatus according to the above embodiments can be mounted on a wireless communication apparatus such as a wireless communication mobile station apparatus and a wireless communication base station apparatus used in a mobile communication system.

  Further, although cases have been described with the above embodiment as examples where the present invention is configured by hardware, the present invention can also be realized by software.

  Each functional block used in the description of the above embodiment is typically realized as an LSI which is an integrated circuit. These may be individually made into one chip, or may be made into one chip so as to include a part or all of them.

  The name used here is LSI, but it may also be called IC, system LSI, super LSI, or ultra LSI depending on the degree of integration.

  Further, the method of circuit integration is not limited to LSI's, and implementation using dedicated circuitry or general purpose processors is also possible. An FPGA (Field Programmable Gate Array) that can be programmed after manufacturing the LSI or a reconfigurable processor that can reconfigure the connection and setting of circuit cells inside the LSI may be used.

  Further, if integrated circuit technology comes out to replace LSI's as a result of the advancement of semiconductor technology or a derivative other technology, it is naturally also possible to carry out function block integration using this technology. Biotechnology can be applied.

  This specification is based on Japanese Patent Application No. 2005-132366 of April 28, 2005 application. All this content is included here.

  The present invention can be applied to the use of a communication apparatus in a mobile communication system or a packet communication system using the Internet protocol.

The block diagram which shows the structure of the audio | voice coding apparatus which concerns on Embodiment 1 of this invention. The block diagram which shows the structure of the speech decoding apparatus which concerns on Embodiment 1 of this invention. FIG. 3 is a block diagram showing the configuration of a speech encoding apparatus according to Embodiment 2 of the present invention. Block diagram showing the configuration of a speech encoding apparatus according to Embodiment 3 of the present invention. FIG. 9 is a block diagram showing a configuration of a coding channel selection unit according to Embodiment 3 of the present invention. The block diagram which shows the structure of the Ach encoding part which concerns on Embodiment 3 of this invention. The figure for demonstrating an example of the update operation | movement of the intra-channel prediction buffer of the Ath channel which concerns on Embodiment 3 of this invention. The figure for demonstrating an example of the update operation | movement of the intra channel prediction buffer of the B channel which concerns on Embodiment 3 of this invention. Block diagram showing the configuration of a speech encoding apparatus according to Embodiment 4 of the present invention. The block diagram which shows the structure of the AchCELP encoding part which concerns on Embodiment 4 of this invention. The flowchart which shows an example of the adaptive codebook update operation | movement which concerns on Embodiment 4 of this invention. The figure for demonstrating an example of the update operation | movement of the Ach adaptive codebook which concerns on Embodiment 4 of this invention. The figure for demonstrating an example of the update operation | movement of the Bch adaptive codebook which concerns on Embodiment 4 of this invention.

Claims (11)

In a speech encoding apparatus that encodes a stereo signal including a first channel signal and a second channel signal,
Monaural signal generating means for generating a monaural signal using the first channel signal and the second channel signal;
Selecting means for selecting one of the first channel signal and the second channel signal;
Encoding means for encoding the generated monaural signal to obtain core layer encoded data, and encoding the selected channel signal to obtain enhancement layer encoded data corresponding to the core layer encoded data;
I have a,
The selection means includes
Based on the coding distortion for the first channel signal and the second channel signal or the intra-channel correlation corresponding to the first channel signal and the second channel signal, the first channel signal and the second channel Select one of the signals for each frame,
The encoding means includes
Encoding the monaural signal and the channel signal selected for each frame for each frame;
Speech encoding device. Calculation means for calculating a first coding distortion that occurs when the first channel signal is selected and a second coding distortion that occurs when the second channel signal is selected, respectively. ,
The selection means includes
When the calculated first coding distortion is smaller than the calculated second coding distortion, the first channel signal is selected, and the calculated first coding distortion is calculated by the first code. The second channel signal is selected if the distortion is smaller than
The speech encoding apparatus according to claim 1. The encoding means includes
The first channel signal and the second channel signal are encoded to obtain first encoded data and second encoded data, respectively, and the selected channel is selected from the first encoded data and the second encoded data. A signal corresponding to the signal is output as the enhancement layer encoded data,
Using the monaural decoded signal obtained when the encoding means encodes the monaural signal and the first channel decoded signal obtained when the encoding means encodes the first channel signal, Generating a second channel estimation signal corresponding to the second channel signal, the monaural decoded signal, and a second channel decoded signal obtained when the encoding means encodes the second channel signal, Using estimated signal generating means for generating a first channel estimated signal corresponding to the first channel signal;
Calculating the first coding distortion based on an error of the first channel decoded signal with respect to the first channel signal and an error of the second channel estimation signal with respect to the second channel signal; Distortion calculating means for calculating the second coding distortion based on an error of the first channel estimation signal with respect to and an error of the second channel decoded signal with respect to the second channel signal;
The speech encoding apparatus according to claim 2, comprising: The selection means includes
Calculating means for calculating a first intra-channel correlation corresponding to the first channel signal and a second intra-channel correlation corresponding to the second channel signal;
When the calculated first intra-channel correlation is higher than the calculated second intra-channel correlation, the first channel signal is selected, and the calculated second intra-channel correlation is calculated in the first channel. When the degree of correlation is higher, the second channel signal is selected.
The speech encoding apparatus according to claim 1. The encoding means includes
When the first channel signal is selected by the selection unit, CELP (Code Excited Linear Prediction) encoding of the first channel signal is performed using a first adaptive codebook, and a CELP encoding result is used. Obtaining the enhancement layer encoded data and updating the first adaptive codebook using the CELP encoding result;
The speech encoding apparatus according to claim 1. The encoding means includes
Generating a second channel estimation signal corresponding to the second channel signal using the enhancement layer encoded data and a monaural decoded signal obtained when the monaural signal is encoded;
Updating a second adaptive codebook used in CELP coding of the second channel signal using an LPC (Linear Prediction Coding) prediction residual signal of the second channel estimation signal;
The speech encoding apparatus according to claim 5 . The selection means includes
Selecting the first channel signal in association with a frame having subframes;
The encoding means includes
Obtaining the enhancement layer encoded data of the frame while performing sound source search for each subframe for the monaural signal and the first channel signal selected in association with the frame;
The speech encoding apparatus according to claim 6 . The encoding means includes
Updating the first adaptive codebook in units of the subframe and updating the second adaptive codebook in units of the frame;
The speech encoding apparatus according to claim 7 .   A mobile station apparatus comprising the speech encoding apparatus according to claim 1.   A base station apparatus comprising the speech encoding apparatus according to claim 1. In a speech encoding method for encoding a stereo signal including a first channel signal and a second channel signal,
Generating a monaural signal using the first channel signal and the second channel signal;
A selection step of selecting one of the first channel signal and the second channel signal;
With obtaining the core layer encoded data generated monaural signal is encoded, the encoding step of obtaining an enhancement layer encoded data corresponding to the core layer encoded data by encoding the selected channel signal,
Including
In the selection step,
Based on the coding distortion for the first channel signal and the second channel signal or the intra-channel correlation corresponding to the first channel signal and the second channel signal, the first channel signal and the second channel Select one of the signals for each frame,
In the encoding step,
Encoding the monaural signal and the channel signal selected for each frame for each frame;
Speech encoding method.

Images