[go: up one dir, main page]

HK1224795B - Harmonic bandwidth extension of audio signals - Google Patents

Harmonic bandwidth extension of audio signals Download PDF

Info

Publication number
HK1224795B
HK1224795B HK16112741.9A HK16112741A HK1224795B HK 1224795 B HK1224795 B HK 1224795B HK 16112741 A HK16112741 A HK 16112741A HK 1224795 B HK1224795 B HK 1224795B
Authority
HK
Hong Kong
Prior art keywords
signal
low
frequency band
frequency
nonlinear processing
Prior art date
Application number
HK16112741.9A
Other languages
Chinese (zh)
Other versions
HK1224795A1 (en
Inventor
苏巴辛格哈.夏敏达.苏巴辛格哈
文卡特什.克里希南
芬卡特拉曼.S.阿提
维韦克.拉金德朗
Original Assignee
高通股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 高通股份有限公司 filed Critical 高通股份有限公司
Publication of HK1224795A1 publication Critical patent/HK1224795A1/en
Publication of HK1224795B publication Critical patent/HK1224795B/en

Links

Description

音频信号的谐波带宽扩展Harmonic bandwidth extension of audio signals

优先权主张Priority claim

本申请案主张2014年2月13日申请的美国临时申请案第61/939,585号和2015年2月9日申请的美国非临时申请案第14/617,524号的优先权,其标题都是“音频信号的谐波带宽扩展”,所述申请案的全部内容以引用的方式并入。This application claims priority to U.S. Provisional Application No. 61/939,585, filed on February 13, 2014, and U.S. Non-Provisional Application No. 14/617,524, filed on February 9, 2015, both entitled “Harmonic Bandwidth Extension of Audio Signals,” the entire contents of which are incorporated by reference.

技术领域Technical Field

本发明大体上涉及音频信号的谐波带宽扩展。The present invention generally relates to harmonic bandwidth extension of audio signals.

背景技术Background Art

技术的进步已产生更小且更强大的计算装置。举例来说,当前存在多种携带型个人计算装置,包括无线计算装置,例如携带型无线电话、个人数字助理(PDA)及传呼装置,其体积小,重量轻且易于由使用者携带。更具体而言,携带型无线电话(例如,蜂窝式电话及因特网协议(IP)电话)可经由无线网络传达语音及数据数据包。此外,许多此类无线电话包括并入于其中的其它类型的装置。举例来说,无线电话还可包括数字静态摄像机、数字视频摄像机、数字记录器及音频档案播放器。Advances in technology have resulted in smaller and more powerful computing devices. For example, there are currently a variety of portable personal computing devices, including wireless computing devices, such as portable wireless telephones, personal digital assistants (PDAs), and paging devices, that are small, lightweight, and easily carried by users. More specifically, portable wireless telephones (e.g., cellular telephones and Internet Protocol (IP) telephones) can communicate voice and data packets over wireless networks. In addition, many such wireless telephones include other types of devices incorporated therein. For example, a wireless telephone may also include a digital still camera, a digital video camera, a digital recorder, and an audio file player.

在传统电话系统(例如,公众交换电话网络(PSTN))中,信号带宽限于300赫兹(Hz)至3.4千赫兹(kHz)的频率范围。在宽带(WB)应用(例如,蜂窝式电话及因特网语音通信协议(VoIP))中,信号带宽可横跨50Hz至7kHz的频率范围。超宽带(SWB)译码技术支持扩展至大约16kHz的带宽。将信号带宽自3.4kHz下的窄频电话扩展至16kHz的SWB电话可改良信号重建构的质量、可懂度及逼真度。In traditional telephone systems, such as the Public Switched Telephone Network (PSTN), signal bandwidth is limited to a frequency range of 300 Hz to 3.4 kHz. In wideband (WB) applications, such as cellular telephony and Voice over Internet Protocol (VoIP), signal bandwidth can span a frequency range of 50 Hz to 7 kHz. Ultra-wideband (SWB) coding technology supports bandwidth extension to approximately 16 kHz. Extending the signal bandwidth from narrowband telephony at 3.4 kHz to SWB telephony at 16 kHz improves the quality, intelligibility, and fidelity of signal reconstruction.

SWB译码技术通常涉及编码及传输信号的较低频率部分(例如,50Hz至7kHz,还称为“低频带”)。举例来说,可使用滤波器参数和/或低频带激励信号表示低频带。为了改良译码效率,可能不完全编码及传输信号的较高频率部分(例如,7kHz至16kHz,也称为“高频带”)。接收器可利用信号模型化以产生合成高频带信号。在一些实施中,可将与高频带相关联的数据提供至接收器以协助高频带合成。此类数据可被称作“旁侧信息”,且可包括增益信息、线谱频率(LSF,也被称作线谱对(LSP))等。可通过比较高频带与源自低频带的合成高频带信号来产生旁侧信息。举例来说,合成高频带信号可基于低频带信号及非线性函数。单一非线性函数可用于针对具有相异特性的多个低频带信号产生合成高频带信号。对具有相异特性的信号应用相同的非线性函数可导致在某些情况下(例如,话音对音乐)产生低质量合成高频带信号。结果,合成高频带信号可与高频带信号弱相关。SWB coding technology generally relates to the lower frequency part (for example, 50Hz to 7kHz, also referred to as " low-frequency band ") of coding and transmission signal. For example, filter parameters and/or low-frequency band excitation signal can be used to represent low-frequency band. In order to improve decoding efficiency, the higher frequency part (for example, 7kHz to 16kHz, also referred to as " high-frequency band ") of coding and transmission signal may not be fully encoded. Receiver can utilize signal modeling to produce synthetic high-frequency band signal. In some implementations, the data associated with high-frequency band can be provided to receiver to assist high-frequency band synthesis. Such data can be referred to as " side information ", and can comprise gain information, line spectrum frequency (LSF, also referred to as line spectrum pair (LSP)) etc. Can produce side information by comparing high-frequency band and the synthetic high-frequency band signal that is derived from low-frequency band. For example, synthetic high-frequency band signal can be based on low-frequency band signal and nonlinear function. Single nonlinear function can be used for producing synthetic high-frequency band signal for a plurality of low-frequency band signals with different characteristics. Applying the same nonlinear function to signals with dissimilar characteristics may result in a low-quality synthesized high-band signal in some cases (eg, speech versus music). As a result, the synthesized high-band signal may be weakly correlated with the high-band signal.

发明内容Summary of the Invention

揭示用于音频信号的谐波带宽扩展的系统和方法。编码器可使用音频信号的低频带部分产生用于在解码器处重建构音频信号的高频带部分的信息(例如,调整参数)。举例来说,编码器可基于低频带部分的特性扩展音频信号的低频带部分。经扩展的低频带部分可具有大于低频带部分的带宽。编码器可基于经扩展的低频带部分及高频带部分确定调整参数。Disclosed are systems and methods for harmonic bandwidth extension of an audio signal. An encoder can use a low-frequency band portion of an audio signal to generate information (e.g., adjustment parameters) for reconstructing a high-frequency band portion of the audio signal at a decoder. For example, the encoder can extend the low-frequency band portion of the audio signal based on characteristics of the low-frequency band portion. The extended low-frequency band portion can have a bandwidth greater than the low-frequency band portion. The encoder can determine the adjustment parameters based on the extended low-frequency band portion and the high-frequency band portion.

编码器可使用选定非线性处理函数产生经扩展的低频带部分。可基于音频信号的低频带部分的特性自多个非线性处理函数选择所述非线性处理函数。音频信号可对应于特定音频帧或数据包。若低频带部分指示音频信号为强周期性的(例如,具有强谐波分量和/或对应于话音),则信号编码器可选择较高阶非线性函数。若低频带部分指示音频信号为强噪声的(例如,对应于音乐),则信号编码器可选择较低阶非线性函数。编码器可基于高频带与经扩展的低频带部分的比较确定调整参数。The encoder can use a selected nonlinear processing function to produce an extended low-frequency band portion. The nonlinear processing function can be selected from a plurality of nonlinear processing functions based on the characteristics of the low-frequency band portion of the audio signal. The audio signal can correspond to a specific audio frame or data packet. If the low-frequency band portion indicates that the audio signal is strongly periodic (e.g., has a strong harmonic component and/or corresponds to speech), the signal encoder can select a higher-order nonlinear function. If the low-frequency band portion indicates that the audio signal is strongly noisy (e.g., corresponding to music), the signal encoder can select a lower-order nonlinear function. The encoder can determine the adjustment parameter based on the comparison of the high-frequency band and the extended low-frequency band portion.

解码器可自编码器接收低频带数据及调整参数。解码器可基于低频带数据产生合成低频带信号。解码器可基于合成低频带信号及选定非线性处理函数产生合成扩展低频带部分。解码器可基于合成扩展低频带部分及调整参数产生合成高频带信号。可通过在解码器处组合合成低频带信号及合成高频带信号来产生输出信号。Decoder can receive low-frequency band data and adjustment parameters from encoder.Decoder can produce synthetic low-frequency band signal based on low-frequency band data.Decoder can produce synthetic extended low-frequency band part based on synthetic low-frequency band signal and selected nonlinear processing function.Decoder can produce synthetic high-frequency band signal based on synthetic extended low-frequency band part and adjustment parameters.Output signal can be produced by combining synthetic low-frequency band signal and synthetic high-frequency band signal at decoder place.

在特定实施例中,一种方法包括在装置处将输入音频信号分成至少低频带信号及高频带信号。低频带信号对应于低频带频率范围且高频带信号对应于高频带频率范围。所述方法还包括选择多个非线性处理函数中的非线性处理函数。所述方法进一步包括基于低频带信号及非线性处理函数产生第一扩展信号。所述方法还包括基于第一扩展信号、高频带信号或两者产生至少一个调整参数。In a specific embodiment, a method comprises dividing an input audio signal into at least a low-band signal and a high-band signal at a device. The low-band signal corresponds to the low-band frequency range and the high-band signal corresponds to the high-band frequency range. The method also comprises selecting a nonlinear processing function among a plurality of nonlinear processing functions. The method further comprises generating a first extended signal based on the low-band signal and the nonlinear processing function. The method also comprises generating at least one adjustment parameter based on the first extended signal, the high-band signal or both.

在另一特定实施例中,一种方法包括在装置处接收对应于输入音频信号的至少低频带信号的低频带数据。所述方法也包括解码低频带数据以产生合成低频带音频信号。所述方法进一步包括选择多个非线性处理函数中的非线性处理函数。所述方法还包括基于合成低频带音频信号及非线性处理函数产生合成高频带音频信号。In another specific embodiment, a method comprises receiving the low-frequency band data of at least the low-frequency band signal corresponding to the input audio signal at the device. Said method also comprises decoding the low-frequency band data to produce a synthetic low-frequency band audio signal. Said method further comprises selecting a non-linear processing function among a plurality of non-linear processing functions. Said method also comprises producing a synthetic high-frequency band audio signal based on the synthetic low-frequency band audio signal and the non-linear processing function.

在另一特定实施例中,一种装置包括存储器及处理器。所述处理器经配置以将输入音频信号分成至少低频带信号及高频带信号。低频带信号对应于低频带频率范围且高频带信号对应于高频带频率范围。所述处理器还经配置以选择多个非线性处理函数中的非线性处理函数。所述处理器经进一步配置以基于低频带信号及非线性处理函数产生第一扩展信号。所述处理器还经配置以基于第一扩展信号、高频带信号或两者产生至少一个调整参数。In another specific embodiment, a kind of device comprises memory and processor.Described processor is configured to divide input audio signal into at least low-frequency band signal and high-frequency band signal.Low-frequency band signal corresponds to low-frequency band frequency range and high-frequency band signal corresponds to high-frequency band frequency range.Described processor is also configured to select the nonlinear processing function in a plurality of nonlinear processing functions.Described processor is further configured to produce first extended signal based on low-frequency band signal and nonlinear processing function.Described processor is also configured to produce at least one adjustment parameter based on first extended signal, high-frequency band signal or both.

在另一特定实施例中,一种装置包括存储器及处理器。所述处理器经配置以接收对应于输入音频信号的至少低频带信号的低频带数据。所述处理器还经配置以解码低频带数据以产生合成低频带音频信号。所述处理器经进一步配置以选择多个非线性处理函数中的非线性处理函数。所述处理器还经配置以基于合成低频带音频信号及非线性处理函数产生合成高频带音频信号。In another specific embodiment, a kind of device comprises memory and processor.Described processor is configured to receive the low-frequency band data corresponding to at least the low-frequency band signal of input audio signal.Described processor is also configured to decode the low-frequency band data to produce synthetic low-frequency band audio signal.Described processor is further configured to select the nonlinear processing function in a plurality of nonlinear processing functions.Described processor is also configured to produce synthetic high-frequency band audio signal based on synthetic low-frequency band audio signal and nonlinear processing function.

在另一特定实施例中,计算机可读存储装置存储当由处理器执行时引起所述处理器执行包括将输入音频信号分成至少低频带信号及高频带信号的操作的指令。低频带信号对应于低频带频率范围且高频带信号对应于高频带频率范围。所述操作还包括选择多个非线性处理函数中的非线性处理函数。所述操作进一步包括基于低频带信号及非线性处理函数产生第一扩展信号。所述操作还包括基于第一扩展信号、高频带信号或两者产生至少一个调整参数。In another specific embodiment, the computer readable storage device stores an instruction that causes the processor to perform an operation that includes dividing the input audio signal into at least a low-frequency band signal and a high-frequency band signal when the processor performs the operation. The low-frequency band signal corresponds to the low-frequency band frequency range and the high-frequency band signal corresponds to the high-frequency band frequency range. The operation also includes selecting the nonlinear processing function in a plurality of nonlinear processing functions. The operation further includes producing a first extended signal based on the low-frequency band signal and the nonlinear processing function. The operation also includes producing at least one adjustment parameter based on the first extended signal, the high-frequency band signal or both.

在另一特定实施例中,计算机可读存储装置存储当由处理器执行时引起所述处理器执行包括接收对应于输入音频信号的至少低频带信号的低频带数据的操作的指令。所述操作还包括解码低频带数据以产生合成低频带音频信号。所述操作进一步包括选择多个非线性处理函数中的非线性处理函数。所述操作还包括基于合成低频带音频信号及非线性处理函数产生合成高频带音频信号。In another specific embodiment, the computer readable storage device stores an instruction that causes the processor to perform an operation that comprises receiving the low-frequency band data of at least the low-frequency band signal corresponding to the input audio signal when the processor is executed. The operation also comprises decoding the low-frequency band data to produce a synthetic low-frequency band audio signal. The operation further comprises the nonlinear processing function that selects a plurality of nonlinear processing functions. The operation also comprises producing a synthetic high-frequency band audio signal based on the synthetic low-frequency band audio signal and the nonlinear processing function.

由所揭示的实施例中的至少一者提供的特定优点可包括改良输出信号的合成高频带部分的质量。可通过使用基于低频带部分的音频特性自多个可用非线性处理函数选择的非线性函数产生合成高频带部分来改良输出信号的质量。选定非线性函数可改良在话音情况及非话音情况(例如,音乐)两者下编码器处的输入信号的高频带部分与解码器处的输出信号的合成高频带部分之间的相关性。本发明的其它方面、优点及特征将在审阅包括以下章节的申请案之后变得显而易见:【图式简单说明】、【实施方式】及【申请专利范围】。The specific advantage provided by at least one of the disclosed embodiments can comprise the quality of the synthetic high-frequency band portion of improved output signal.Can produce the synthetic high-frequency band portion and improve the quality of output signal from the nonlinear function of a plurality of available nonlinear processing functions selection by using the audio characteristic based on low-frequency band portion.Selected nonlinear function can improve the dependency between the synthetic high-frequency band portion of the input signal at encoder place and the output signal at decoder place under voice situation and non-voice situation (for example, music).Other aspects of the present invention, advantage and feature will become apparent after reviewing the application case that comprises following chapters and sections: [simple description of figures], [embodiment] and [claim].

附图说明BRIEF DESCRIPTION OF THE DRAWINGS

图1为说明可操作以执行音频信号的谐波带宽扩展的编码器系统的特定实施例的图;1 is a diagram illustrating a particular embodiment of an encoder system operable to perform harmonic bandwidth extension of an audio signal;

图2为可操作以执行音频信号的谐波带宽扩展的解码器系统的另一特定实施例的图;2 is a diagram of another particular embodiment of a decoder system operable to perform harmonic bandwidth extension of an audio signal;

图3为可操作以执行音频信号的谐波带宽扩展的系统的另一特定实施例的图;3 is a diagram of another particular embodiment of a system operable to perform harmonic bandwidth extension of an audio signal;

图4为说明执行音频信号的谐波带宽扩展的方法的特定实施例的流程图;4 is a flow chart illustrating a particular embodiment of a method of performing harmonic bandwidth extension of an audio signal;

图5为说明执行音频信号的谐波带宽扩展的方法的另一特定实施例的流程图;及FIG5 is a flow chart illustrating another particular embodiment of a method of performing harmonic bandwidth extension of an audio signal; and

图6为可操作以根据图1至5的系统及方法执行信号处理操作的无线装置的框图。6 is a block diagram of a wireless device operable to perform signal processing operations according to the systems and methods of FIGs. 1-5.

具体实施方式DETAILED DESCRIPTION

参看图1,展示可操作以执行音频信号的谐波带宽扩展的编码器系统的特定实施例的图,且将所述系统大体上标示为100。在特定实施例中,编码器系统100可集成至编码(或解码)系统或装置中(例如,无线电话或译码器/解码器(CODEC)中)。在其它实施例中,编码器系统100可集成至机顶盒、音乐播放器、视讯播放器、娱乐单元、导航装置、通信装置、个人数字助理(PDA)、固定位置数据单元或计算机中。1 , a diagram of a particular embodiment of an encoder system operable to perform harmonic bandwidth extension of an audio signal is shown and generally designated 100. In a particular embodiment, encoder system 100 may be integrated into an encoding (or decoding) system or device, such as a wireless telephone or a codec/decoder (CODEC). In other embodiments, encoder system 100 may be integrated into a set-top box, a music player, a video player, an entertainment unit, a navigation device, a communication device, a personal digital assistant (PDA), a fixed location data unit, or a computer.

应注意,在以下描述中,由图1的编码器系统100执行的各种功能经描述为由某些组件或模块执行。组件及模块的此划分仅为了说明目的且并不被认为是限制性的。在替代实施例中,由特定组件或模块执行的功能可在多个组件或模块中划分。此外,在替代实施例中,图1的两个或两个以上组件或模块可集成为单一组件或模块。可使用硬件(例如,场可编程门阵列(FPGA)装置、特殊应用集成电路(ASIC)、数字信号处理器(DSP)、控制器等)、软件(例如,可由处理器执行的指令)或其任何组合实施图1中所说明的每一组件或模块。It should be noted that in the following description, the various functions performed by the encoder system 100 of FIG. 1 are described as being performed by certain components or modules. This division of components and modules is for illustrative purposes only and is not to be considered limiting. In alternative embodiments, the functions performed by a particular component or module may be divided among multiple components or modules. Furthermore, in alternative embodiments, two or more components or modules of FIG. 1 may be integrated into a single component or module. Each component or module illustrated in FIG. 1 may be implemented using hardware (e.g., a field programmable gate array (FPGA) device, an application-specific integrated circuit (ASIC), a digital signal processor (DSP), a controller, etc.), software (e.g., instructions executable by a processor), or any combination thereof.

编码器系统100包括耦接至低频带编码器108的分析滤波器组110、谐波性估计器106、信号产生器112及参数估计器190。信号产生器112耦接至滤波器114及混频器116。信号产生器112可包括函数选择器180。The encoder system 100 includes an analysis filter bank 110 coupled to a lowband encoder 108, a harmonicity estimator 106, a signal generator 112, and a parameter estimator 190. The signal generator 112 is coupled to a filter 114 and a mixer 116. The signal generator 112 may include a function selector 180.

在操作期间,分析滤波器组110可接收输入音频信号102。举例来说,输入音频信号102可由麦克风或其它输入装置提供。输入音频信号102可包括话音、噪声、音乐或其组合。输入音频信号102可为超宽带(SWB)信号,其包括在大约50赫兹(Hz)至大约16千赫兹(kHz)的频率范围内的数据。分析滤波器组110可基于频率将输入音频信号102分成多个部分。举例来说,分析滤波器组110可将输入音频信号102分成至少低频带信号122及高频带信号124。在特定实施例中,分析滤波器组110可包括分析滤波器组的集合。分析滤波器组的所述集合可将输入音频信号102分成至少低频带信号122及高频带信号124。在特定实施例中,分析滤波器组110可产生两个以上输出。During operation, the analysis filter bank 110 may receive an input audio signal 102. For example, the input audio signal 102 may be provided by a microphone or other input device. The input audio signal 102 may include speech, noise, music, or a combination thereof. The input audio signal 102 may be an ultra-wideband (SWB) signal, which includes data within a frequency range of approximately 50 hertz (Hz) to approximately 16 kilohertz (kHz). The analysis filter bank 110 may separate the input audio signal 102 into a plurality of portions based on frequency. For example, the analysis filter bank 110 may separate the input audio signal 102 into at least a low-band signal 122 and a high-band signal 124. In a particular embodiment, the analysis filter bank 110 may include a set of analysis filter banks. The set of analysis filter banks may separate the input audio signal 102 into at least a low-band signal 122 and a high-band signal 124. In a particular embodiment, the analysis filter bank 110 may generate two or more outputs.

在图1的实例中,低频带信号122及高频带信号124占用非重迭频带。举例来说,低频带信号122及高频带信号124可分别占用50Hz至7kHz及7kHz至16kHz的非重迭频带。在替代实施例中,低频带信号122及高频带信号124可分别占用50Hz至8kHz及8kHz至16kHz的非重迭频带。在另一替代实施例中,低频带信号122及高频带信号124重迭(例如,分别为50Hz至8kHz及7kHz至16kHz),此情况可使分析滤波器组110的低通滤波器及高通滤波器具有平滑滚落,如此可简化设计且降低低通滤波器及高通滤波器的成本。使低频带信号122及高频带信号124重迭还可允许实现接收器处低频带及高频带信号的平滑混合,如此可产生较少可闻假影。In the example of Fig. 1, low-band signal 122 and high-band signal 124 occupy non-overlapping frequency bands. For example, low-band signal 122 and high-band signal 124 can occupy non-overlapping frequency bands of 50Hz to 7kHz and 7kHz to 16kHz respectively. In an alternative embodiment, low-band signal 122 and high-band signal 124 can occupy non-overlapping frequency bands of 50Hz to 8kHz and 8kHz to 16kHz respectively. In another alternative embodiment, low-band signal 122 and high-band signal 124 overlap (for example, 50Hz to 8kHz and 7kHz to 16kHz respectively), and this situation can make the low-pass filter and high-pass filter of analysis filter bank 110 have smooth roll-off, so can simplify design and reduce the cost of low-pass filter and high-pass filter. Making low-band signal 122 and high-band signal 124 overlap can also allow to realize the smooth mixing of low-band and high-band signal at receiver, so can produce less audible artifacts.

应注意,尽管图1的实例说明SWB信号的处理,但此仅为了说明目的且不应被认为是限制性的。在替代实施例中,输入音频信号102可为具有大约50Hz至大约8kHz的频率范围的宽带(WB)信号。在此实施例中,低频带信号122可对应于大约50Hz至大约6.4kHz的频率范围且高频带信号124可对应于大约6.4kHz至大约8kHz的频率范围。It should be noted that although the example of FIG1 illustrates the processing of SWB signals, this is for illustrative purposes only and should not be considered limiting. In an alternative embodiment, the input audio signal 102 may be a wideband (WB) signal having a frequency range of approximately 50 Hz to approximately 8 kHz. In this embodiment, the low-band signal 122 may correspond to a frequency range of approximately 50 Hz to approximately 6.4 kHz and the high-band signal 124 may correspond to a frequency range of approximately 6.4 kHz to approximately 8 kHz.

分析滤波器组110可将低频带信号122提供至低频带编码器108且可将高频带信号124提供至参数估计器190。如本文中所描述,参数估计器190可经配置以比较第一扩展信号182与高频带信号124以产生一或多个调整参数178。如本文中所描述,编码器系统100可基于低频带信号122及经选定非线性处理函数以产生第一扩展信号182。混频器116可经配置以通过使用噪声信号176调变第二扩展信号172来产生第一扩展信号182。滤波器114可经配置以通过将来自信号产生器112的第三扩展信号174滤波来产生第二扩展信号172。The analysis filter bank 110 can provide the low-band signal 122 to the low-band encoder 108 and can provide the high-band signal 124 to the parameter estimator 190. As described herein, the parameter estimator 190 can be configured to compare the first extended signal 182 with the high-band signal 124 to produce one or more adjustment parameters 178. As described herein, the encoder system 100 can be based on the low-band signal 122 and through selected nonlinear processing function to produce the first extended signal 182. The mixer 116 can be configured to produce the first extended signal 182 by using the noise signal 176 modulation second extended signal 172. The filter 114 can be configured to produce the second extended signal 172 by filtering the third extended signal 174 from the signal generator 112.

低频带编码器108可自分析滤波器组110接收低频带信号122且可产生低频带参数168。低频带参数168可指示低频带信号122的特性。低频带参数168可包括低频带信号122与频谱倾斜、音调增益、滞后、话音模式或其组合相关联的值。The low-band encoder 108 may receive the low-band signal 122 from the analysis filter bank 110 and may generate low-band parameters 168. The low-band parameters 168 may indicate characteristics of the low-band signal 122. The low-band parameters 168 may include values of the low-band signal 122 associated with spectral tilt, pitch gain, hysteresis, voice mode, or a combination thereof.

频谱倾斜可涉及通带上频谱包络的形状且可由经量化第一反射系数表示。对于有声声音,频谱能量可随递增频率减少,以使得第一反射系数为负且可能接近-1。无声声音可具有一频谱,所述频谱为平坦的以使得第一反射系数接近零,或在高频处具有更多能量以使得第一反射系数为正且可能接近+1。Spectral tilt may relate to the shape of the spectral envelope over the passband and may be represented by a quantized first reflection coefficient. For voiced sounds, the spectral energy may decrease with increasing frequency, such that the first reflection coefficient is negative and may be close to -1. Unvoiced sounds may have a spectrum that is flat, such that the first reflection coefficient is close to zero, or have more energy at high frequencies, such that the first reflection coefficient is positive and may be close to +1.

话音模式(还称为发声模式)可指示与低频带信号122相关联的音频帧是表示有声声音还是无声声音。话音模式参数可具有基于周期性(例如,零交叉、标准化自相关函数(NACF)、音调增益等)和/或音频帧的语音活动的一或多个测量结果(例如,此类测量结果与临限值之间的关系)的二进制值。在其它实施中,话音模式参数可具有一或多个其它状态来指示例如静寂或背景噪声的模式,或静寂与有声话音之间的转变。低频带编码器108可将低频带参数168提供至信号产生器112。The speech pattern parameter can have the binary value of one or more measurement results (for example, the relation between this type of measurement result and threshold value) of the speech activity based on periodicity (for example, zero crossing, standardization autocorrelation function (NACF), pitch gain etc.) and/or audio frame.In other implementations, the speech pattern parameter can have one or more other states to indicate the pattern of for example silence or background noise, or the transition between silence and the voiced speech.Low-band encoder 108 can provide low-band parameters 168 to signal generator 112.

在特定实施例中,信号产生器112可基于低频带参数168产生低频带信号122。举例来说,信号产生器112可包括本地解码器(或解码器仿真器)。本地解码器可在接收装置处模拟解码器的行为。举例来说,本地解码器可经配置以解碼低频带参数168以产生低频带信号122。在替代实施例中,信号产生器112可自分析滤波器组110接收低频带信号122。In a particular embodiment, the signal generator 112 may generate the low-band signal 122 based on the low-band parameters 168. For example, the signal generator 112 may include a local decoder (or decoder emulator). The local decoder may simulate the behavior of a decoder at the receiving device. For example, the local decoder may be configured to decode the low-band parameters 168 to generate the low-band signal 122. In an alternative embodiment, the signal generator 112 may receive the low-band signal 122 from the analysis filter bank 110.

函数选择器180可选择多个可用非线性处理函数118中的非线性处理函数。所述多个可用非线性处理函数118可包括绝对值函数、全波整流函数、半波整流函数、平方函数、立方函数、四幂函数(power of four function)、削波函数或其组合。The function selector 180 may select a nonlinear processing function from the plurality of available nonlinear processing functions 118. The plurality of available nonlinear processing functions 118 may include an absolute value function, a full-wave rectification function, a half-wave rectification function, a square function, a cubic function, a power of four function, a clipping function, or a combination thereof.

函数选择器180可基于低频带信号122的特性选择非线性处理函数。为了说明,函数选择器180可基于低频带参数168或低频带信号122确定特性值。噪声因子可指示对应于低频带信号122的音频帧的周期性。举例来说,噪声因子可对应于与低频带信号122相关联的音调增益、话音模式、频谱倾斜、NACF、零交叉或其组合。如果噪声因子满足第一噪声临限值,那么函数选择器180可选择第一非线性处理函数。举例来说,若噪声因子指示低频带信号122为强周期性的(例如,对应于话音),则函数选择器180可选择高阶幂函数(例如,四幂函数)。如果噪声因子满足第二噪声临限值,那么函数选择器180可选择第二非线性处理函数。举例来说,如果噪声因子指示低频带信号122并非为极周期性的或为类噪声的(例如,对应于音乐),那么函数选择器180可选择低阶幂函数(例如,平方函数)。Function selector 180 can select nonlinear processing function based on the characteristic of low-band signal 122. For illustration, function selector 180 can determine characteristic value based on low-band parameter 168 or low-band signal 122. Noise factor can indicate the periodicity of the audio frame corresponding to low-band signal 122. For example, noise factor can correspond to pitch gain, voice mode, spectrum tilt, NACF, zero crossing or its combination associated with low-band signal 122. If noise factor satisfies the first noise threshold, function selector 180 can select the first nonlinear processing function so. For example, if noise factor indicates that low-band signal 122 is strongly periodic (for example, corresponding to voice), function selector 180 can select high-order power function (for example, four power functions). If noise factor satisfies the second noise threshold, function selector 180 can select the second nonlinear processing function so. For example, if the noise factor indicates that the low-band signal 122 is not very periodic or is noise-like (eg, corresponding to music), the function selector 180 may select a low-order power function (eg, a square function).

在特定实施例中,函数选择器180可在逐音频帧基础上从多个可用非线性处理函数118选择非线性处理函数。此外,可针对输入音频信号102的连续帧选择不同的非线性处理函数。因此,函数选择器180可响应于确定与第一音频帧相关联的参数满足第一条件而选择多个非线性处理函数中的第一非线性处理函数,且可响应于确定与第二音频帧相关联的参数满足第二条件而选择多个非线性处理函数中的第二非线性处理函数。作为说明性实例,可在输入音频信号102在电话呼叫期间对应于话音时与在输入音频信号102在电话呼叫期间对应于保持音乐时应用不同的非线性处理函数。在特定实施例中,与帧相关联的参数为经选择以编码低频带信号的译码模式、帧的周期性、帧中非周期性噪声的量及对应于帧的频谱倾斜中的一者。In a particular embodiment, the function selector 180 may select a nonlinear processing function from a plurality of available nonlinear processing functions 118 on an audio frame-by-audio frame basis. Furthermore, different nonlinear processing functions may be selected for consecutive frames of the input audio signal 102. Thus, the function selector 180 may select a first nonlinear processing function from a plurality of nonlinear processing functions in response to determining that a parameter associated with a first audio frame satisfies a first condition, and may select a second nonlinear processing function from a plurality of nonlinear processing functions in response to determining that a parameter associated with a second audio frame satisfies a second condition. As an illustrative example, a different nonlinear processing function may be applied when the input audio signal 102 corresponds to speech during a phone call than when the input audio signal 102 corresponds to music on hold during a phone call. In a particular embodiment, the parameter associated with the frame is one of a coding mode selected to encode a low-band signal, the periodicity of the frame, the amount of non-periodic noise in the frame, and a spectral tilt corresponding to the frame.

信号产生器112可以谐波方式扩展低频带信号122的频谱以包括较高频率范围(例如,对应于高频带信号124的频率范围)。举例来说,信号产生器112可对低频带信号122进行增加取样。低频带信号122可经增加取样以减少应用选定非线性处理函数后的频叠。在特定实施例中,信号产生器112可按特定因子(例如,8)对低频带信号122进行增加取样。在特定实施例中,增加取样操作可包括对低频带信号122进行补零。信号产生器112可通过将选定非线性处理函数应用于经增加取样信号来产生第三扩展信号174。Signal generator 112 can expand the spectrum of low-band signal 122 in a harmonic manner to include higher frequency range (for example, corresponding to the frequency range of high-band signal 124).For example, signal generator 112 can increase sampling to low-band signal 122. Low-band signal 122 can be through increasing sampling to reduce the frequency overlap after the selected non-linear processing function of application. In a specific embodiment, signal generator 112 can be by specific factor (for example, 8) low-band signal 122 is increased sampling. In a specific embodiment, increasing the sampling operation can comprise that low-band signal 122 is carried out zero padding. Signal generator 112 can be by selected non-linear processing function being applied to produce the 3rd extended signal 174 through increasing the sampled signal.

滤波器114可从信号产生器112接收第三扩展信号174。滤波器114可通过对第三扩展信号174进行滤波来产生第二扩展信号172。举例来说,滤波器114可对第三扩展信号174进行减少取样以使得第二扩展信号172的频率范围(例如,7kHz至16kHz)对应于与高频带信号124相关联的频率范围。为了说明,滤波器114可将带通(例如,高通)滤波操作应用于第三扩展信号174以产生第二扩展信号172。在特定实施例中,滤波器114可将线性变换(例如,离散余弦变换(DCT))应用于第三扩展信号174且可选择对应于高频率范围(例如,7kHz至16kHz)的变换系数。滤波器114可将第二扩展信号172提供至混频器116。Filter 114 can receive the 3rd extended signal 174 from signal generator 112.Filter 114 can produce the second extended signal 172 by filtering the 3rd extended signal 174.For example, filter 114 can reduce sampling so that the frequency range of the second extended signal 172 (for example, 7kHz to 16kHz) corresponds to the frequency range associated with high-frequency band signal 124 to the 3rd extended signal 174.For illustration, filter 114 can be applied to the 3rd extended signal 174 to produce the second extended signal 172 with band-pass (for example, high-pass) filtering operation. In a particular embodiment, filter 114 can be applied to the 3rd extended signal 174 with linear conversion (for example, discrete cosine transform (DCT)) and can select the transform coefficient corresponding to high frequency range (for example, 7kHz to 16kHz).Filter 114 can provide the second extended signal 172 to mixer 116.

混频器116可组合第二扩展信号172及噪声信号176。混频器116可自噪声产生器(未展示)接收噪声信号176。噪声产生器可经配置以产生单位方差白色伪随机噪声信号。在特定实施例中,噪声信号176可不为白色且可具有随频率变化的功率密度。在特定实施例中,噪声产生器可经配置以将噪声信号176输出为确定性函数,所述函数可在接收装置的解码器处经复制。举例来说,噪声产生器可经配置以产生噪声信号176作为低频带参数168的确定性函数。The mixer 116 can combine the second spread signal 172 and the noise signal 176. The mixer 116 can receive the noise signal 176 from a noise generator (not shown). The noise generator can be configured to generate a unit variance white pseudo-random noise signal. In a specific embodiment, the noise signal 176 may not be white and may have a power density that varies with frequency. In a specific embodiment, the noise generator can be configured to output the noise signal 176 as a deterministic function that can be replicated at a decoder of a receiving device. For example, the noise generator can be configured to generate the noise signal 176 as a deterministic function of the low-band parameters 168.

混频器116可组合第一比例的噪声信号176及第二比例的第二扩展信号172。举例来说,混频器116可产生第一扩展信号182以具有类似于高频带信号124的谐波能量与噪声能量的比率的谐波能量与噪声能量的比率。混频器116可基于谐波性因子170确定第一比例及第二比例。举例来说,如果谐波性因子170指示高频带信号124与无声声音(例如,音乐或噪声)相关联,那么第一比例可高于第二比例。作为另一实例,如果谐波性因子170指示高频带信号124与有声话音相关联,则第二比例可高于第一比例。在特定实施例中,混频器116可自谐波性因子170确定第一比例(或第二比例)且可根据例如下式的等式导出第二比例(或第一比例):Frequency mixer 116 can combine the noise signal 176 of the first ratio and the second extended signal 172 of the second ratio.For example, frequency mixer 116 can produce the first extended signal 182 with the harmonic energy of the ratio that is similar to the harmonic energy of high frequency band signal 124 and noise energy and the ratio of noise energy.Frequency mixer 116 can determine the first ratio and the second ratio based on harmonic property factor 170.For example, if harmonic property factor 170 indicates that high frequency band signal 124 is associated with silent sound (for example, music or noise), the first ratio can be higher than the second ratio so.As another example, if harmonic property factor 170 indicates that high frequency band signal 124 is associated with voiced speech, the second ratio can be higher than the first ratio.In a particular embodiment, frequency mixer 116 can determine the first ratio (or the second ratio) from harmonic property factor 170 and can derive the second ratio (or the first ratio) according to the equation such as following formula:

(第一比例)2+(第二比例)2=1,(等式1)。(first ratio) 2 +(second ratio) 2 =1, (Equation 1).

替代地,混频器116可基于谐波性因子170自多个比例对选择对应比例对,其中预先计算比例对以满足恒定能量比率,例如等式(1)。第一比例的值的范围可为0.1至0.7且第二比例的值的范围可为0.7至1.0。Alternatively, mixer 116 may select a corresponding ratio pair from a plurality of ratio pairs based on harmonicity factor 170, where the ratio pairs are pre-calculated to satisfy a constant energy ratio, such as equation (1). The value of the first ratio may range from 0.1 to 0.7 and the value of the second ratio may range from 0.7 to 1.0.

谐波性估计器106可基于输入音频信号102的特性(例如,周期性)的估计确定谐波性因子170。在特定实施例中,谐波性估计器106可基于高频带信号124及低频带参数168中的至少一者产生谐波性因子170。举例来说,谐波性估计器106可基于由低频带参数168指示的低频带信号122的特性(例如,周期性)确定谐波性因子170。为了说明,谐波性估计器106可将与音调增益成比例的值指派至谐波性因子170。作为另一实例,谐波性估计器106可基于话音模式确定谐波性因子170。为了说明,谐波性因子170可响应于指示有声音频(例如,话音)的话音模式而具有第一值且可响应于指示无声音频(例如,音乐)的话音模式而具有第二值。The harmonicity estimator 106 may determine the harmonicity factor 170 based on an estimate of a characteristic (e.g., periodicity) of the input audio signal 102. In a particular embodiment, the harmonicity estimator 106 may generate the harmonicity factor 170 based on at least one of the high-band signal 124 and the low-band parameters 168. For example, the harmonicity estimator 106 may determine the harmonicity factor 170 based on a characteristic (e.g., periodicity) of the low-band signal 122 indicated by the low-band parameters 168. For illustration, the harmonicity estimator 106 may assign a value proportional to the pitch gain to the harmonicity factor 170. As another example, the harmonicity estimator 106 may determine the harmonicity factor 170 based on a speech mode. For illustration, the harmonicity factor 170 may have a first value in response to a speech mode indicating voiced audio (e.g., speech) and may have a second value in response to a speech mode indicating unvoiced audio (e.g., music).

作为另一实例,谐波性估计器106可基于高频带信号124的特性(例如,周期性)确定谐波性因子170。为了说明,谐波性估计器106可基于高频带信号124的自相关系数的最大值确定谐波性因子170,其中在包括一个音调滞后的延迟且不包括零样本的延迟的搜寻范围内执行自相关。在特定实施例中,谐波性估计器106可产生对应于高频带信号124的高频带滤波器参数且可基于高频带滤波器参数确定高频带信号124的特性。In one embodiment, harmonic estimator 106 can be used to determine harmonic factor 170 based on the characteristic (for example, periodicity) of high frequency band signal 124.For illustration, harmonic estimator 106 can be used to determine harmonic factor 170 based on the maximum value of the autocorrelation coefficient of high frequency band signal 124, wherein in the search range that comprises the delay of a tone lag and does not comprise the delay of zero sample, carry out autocorrelation.In a particular embodiment, harmonic estimator 106 can produce the high frequency band filter parameter corresponding to high frequency band signal 124 and can determine the characteristic of high frequency band signal 124 based on the high frequency band filter parameter.

在特定实施例中,谐波性估计器106可基于周期性的另一指示符(例如,音调增益)及临限值确定谐波性因子170。举例来说,如果由低频带参数168指示的音调增益满足第一临限值(例如,大于或等于0.5),那么谐波性估计器106可对高频带信号124执行自相关操作。作为另一实例,如果话音模式指示特定状态(例如,有声话音),那么谐波性估计器106可执行自相关操作。如果音调增益不满足第一临限值和/或若话音模式指示其它状态,那么谐波性因子170可具有默认值。In a particular embodiment, harmonicity estimator 106 can determine harmonicity factor 170 based on another indicator (for example, pitch gain) and threshold value of periodicity.For example, if the pitch gain indicated by low-frequency band parameter 168 satisfies the first threshold value (for example, being greater than or equal to 0.5), harmonicity estimator 106 can be carried out autocorrelation operation to high-frequency band signal 124 so.As another example, if the speech mode indicates a particular state (for example, voiced speech), harmonicity estimator 106 can be carried out autocorrelation operation so.If pitch gain does not satisfy the first threshold value and/or if the speech mode indicates other state, harmonicity factor 170 can have default value so.

谐波性估计器106可基于不同于周期性或除周期性之外的特性确定谐波性因子170。举例来说,谐波性因子针对具有大音调滞后的话音信号及具有小音调滞后的话音信号可具有不同值。在特定实施例中,谐波性估计器106可基于在基本频率的倍数下对高频带信号124的能量的测量相对于在其它频率分量下对高频带信号124的能量的测量来确定谐波性因子170。Harmonicity estimator 106 can be based on the characteristic determination harmonicity factor 170 that is different from periodicity or except periodicity.For example, harmonicity factor can have different values for the voice signal with large pitch lag and the voice signal with small pitch lag.In a particular embodiment, harmonicity estimator 106 can be based on the measurement of the energy of high frequency band signal 124 with respect to the measurement of the energy of high frequency band signal 124 under other frequency components to determine harmonicity factor 170 under the multiple of fundamental frequency.

谐波性估计器106可将谐波性因子170提供至混频器116。如本文中所描述,混频器116可基于谐波性因子170产生第一扩展信号182。混频器116可将第一扩展信号182提供至参数估计器190。The harmonicity estimator 106 may provide the harmonicity factors 170 to the mixer 116. As described herein, the mixer 116 may generate a first spread signal 182 based on the harmonicity factors 170. The mixer 116 may provide the first spread signal 182 to a parameter estimator 190.

参数估计器190可基于高频带信号124或第一扩展信号182中的至少一者产生调整参数178。举例来说,参数估计器190可基于高频带信号124与第一扩展信号182之间的关系(例如,两个信号的能量之间的差异或比率)产生调整参数178。在特定实施例中,调整参数178可对应于指示两个信号的能量之间的差异或比率的一或多个增益调整参数。在替代实施例中,调整参数178可对应于增益调整参数的经量化指数。在特定实施例中,调整参数178可包括指示高频带信号124的特性的高频带参数。在特定实施例中,参数估计器190可基于高频带信号124且不基于第一扩展信号182产生调整参数178。Parameter estimator 190 can produce adjustment parameter 178 based on at least one in high frequency band signal 124 or the first extended signal 182.For example, parameter estimator 190 can produce adjustment parameter 178 based on the relationship between high frequency band signal 124 and the first extended signal 182 (for example, the difference between the energy of two signals or the ratio).In a particular embodiment, adjustment parameter 178 can correspond to the difference between the energy of two signals of indication or one or more gain adjustment parameters of the ratio.In an alternate embodiment, adjustment parameter 178 can correspond to the quantized index of the gain adjustment parameter.In a particular embodiment, adjustment parameter 178 can comprise the high frequency band parameter of the characteristic of indication high frequency band signal 124.In a particular embodiment, parameter estimator 190 can be based on high frequency band signal 124 and not based on the first extended signal 182 to produce adjustment parameter 178.

参数估计器190可提供调整参数178且低频带编码器108可将低频带参数168提供至多任务器(MUX)。MUX可多任务调整参数178及低频带参数168以产生输出位串流。输出位串流可表示对应于输入音频信号102的经编码音频信号。举例来说,MUX可经配置以将调整参数178插入至输入音频信号102的经编码版本中以在输入音频信号102的再现期间实现增益调整。输出位串流可由传输器传输(例如,经由有线、无线或光学信道)和/或经存储。在接收装置处,可由解多任务器(DEMUX)、低频带解码器、高频带解码器及滤波器组执行反向操作以产生音频信号(例如,提供至扬声器或其它输出装置的输入音频信号102的重建构版本),如参看图2所描述。在特定实施例中,谐波性估计器106可将谐波性因子170提供至MUX,且MUX可将谐波性因子170包括在输出位串流中。Parameter estimator 190 can provide adjustment parameter 178 and low-band encoder 108 and low-band parameters 168 can be provided to multiplexer (MUX).MUX can multitask adjustment parameter 178 and low-band parameters 168 to produce output bit stream.Output bit stream can represent the encoded audio signal corresponding to input audio signal 102.For example, MUX can be configured to insert adjustment parameter 178 into the encoded version of input audio signal 102 to realize gain adjustment during the reproduction of input audio signal 102.Output bit stream can be transmitted (for example, via wired, wireless or optical channel) and/or through storage by transmitter.At receiving device place, can be performed reverse operation to produce audio signal (for example, be provided to the reconstruction version of input audio signal 102 of loudspeaker or other output device) by demultiplexer (DEMUX), low-band decoder, high-band decoder and filter bank, as described with reference to Fig. 2. In a particular embodiment, the harmonicity estimator 106 may provide the harmonicity factor 170 to the MUX, and the MUX may include the harmonicity factor 170 in the output bitstream.

编码器系统100在编码器处使用基于低频带信号122的特性选择的非线性处理函数产生合成高频带信号(例如,第一扩展信号182)。使用选定非线性处理函数可增加在有声状况及无声状况两者下合成高频带信号与高频带信号124之间的相关性。The encoder system 100 generates a synthetic high-band signal (e.g., a first extended signal 182) at the encoder using a nonlinear processing function selected based on the characteristics of the low-band signal 122. Using the selected nonlinear processing function can increase the correlation between the synthetic high-band signal and the high-band signal 124 under both the voiced and unvoiced conditions.

参看图2,展示可操作以执行音频信号的谐波带宽扩展的解码器系统的特定实施例,且将所述系统大体上标示为200。编码器系统100及解码器系统200可包括在单一装置或单独装置中。2, a particular embodiment of a decoder system operable to perform harmonic bandwidth extension of an audio signal is shown and generally designated 200. Encoder system 100 and decoder system 200 may be included in a single device or separate devices.

在特定实施例中,解码器系统200可集成至编码(或解码)系统或装置中(例如,无线电话或译码器/解码器(CODEC)中)。在其它实施例中,解码器系统200可集成至机顶盒、音乐播放器、视讯播放器、娱乐单元、导航装置、通信装置、个人数字助理(PDA)、固定位置数据单元或计算机中。In certain embodiments, the decoder system 200 may be integrated into an encoding (or decoding) system or device, such as a wireless phone or a codec/decoder (CODEC). In other embodiments, the decoder system 200 may be integrated into a set-top box, a music player, a video player, an entertainment unit, a navigation device, a communication device, a personal digital assistant (PDA), a fixed location data unit, or a computer.

应注意,在以下描述中,由图2的解码器系统200执行的各种功能经描述为由某些组件或模块执行。组件及模块的此划分仅为了说明目的且并不被认为是限制性的。在一替代实施例中,由特定组件或模块执行的功能可在多个组件或模块中划分。此外,在一替代实施例中,图2的两个或两个以上组件或模块可集成至单一组件或模块中。可使用硬件(例如,场可编程门阵列(FPGA)装置、特殊应用集成电路(ASIC)、数字信号处理器(DSP)、控制器等)、软件(例如,可由处理器执行的指令)或其任何组合实施图2中所说明的每一组件或模块。It should be noted that in the following description, various functions performed by the decoder system 200 of FIG. 2 are described as being performed by certain components or modules. This division of components and modules is for illustrative purposes only and is not to be considered limiting. In an alternative embodiment, the functions performed by a particular component or module may be divided among multiple components or modules. Furthermore, in an alternative embodiment, two or more components or modules of FIG. 2 may be integrated into a single component or module. Each component or module illustrated in FIG. 2 may be implemented using hardware (e.g., a field programmable gate array (FPGA) device, an application-specific integrated circuit (ASIC), a digital signal processor (DSP), a controller, etc.), software (e.g., instructions executable by a processor), or any combination thereof.

解码器系统200包括耦接至信号产生器112的低频带解码器208、滤波器114、混频器116、高频带信号产生器216及合成滤波器组210。The decoder system 200 includes a low-band decoder 208 coupled to the signal generator 112 , the filter 114 , the mixer 116 , a high-band signal generator 216 , and a synthesis filter bank 210 .

在操作期间,低频带解码器208可接收低频带数据268。低频带数据268可对应于由图1的编码器系统100产生的输出位串流。举例来说,在解码器系统200处的接收器可接收(例如,经由有线、无线或光学信道)输入位串流。输入位串流可对应于由编码器系统100产生的输出位串流。接收器可将输入位串流提供至解多任务器(DEMUX)。DEMUX可自输入位串流产生低频带数据268及调整参数。在特定实施例中,DEMUX可自输入位串流提取谐波性因子。DEMUX可将低频带数据268提供至低频带解码器208。During operation, low-band decoder 208 can receive low-band data 268. Low-band data 268 can correspond to the output bit stream produced by the encoder system 100 of Fig. 1. For example, a receiver at decoder system 200 can receive (for example, via wired, wireless or optical channel) input bit stream. The input bit stream can correspond to the output bit stream produced by encoder system 100. Receiver can provide the input bit stream to demultiplexer (DEMUX). DEMUX can produce low-band data 268 and adjustment parameters from the input bit stream. In a particular embodiment, DEMUX can extract harmonics factors from the input bit stream. DEMUX can provide low-band data 268 to low-band decoder 208.

低频带解码器208可自低频带数据268提取低频带参数。低频带参数可对应于图1的低频带参数168。低频带解码器208可基于所述低频带参数产生合成低频带信号222。合成低频带信号222可近似于图1的低频带信号122。The low-band decoder 208 may extract low-band parameters from the low-band data 268. The low-band parameters may correspond to the low-band parameters 168 of FIG1 . The low-band decoder 208 may generate a synthesized low-band signal 222 based on the low-band parameters. The synthesized low-band signal 222 may be similar to the low-band signal 122 of FIG1 .

信号产生器112可自低频带解码器208接收合成低频带信号222。信号产生器112可基于合成低频带信号222产生第三扩展信号274,如参看图1所描述。举例来说,函数选择器180可基于合成低频带信号222自多个可用非线性处理函数218选择非线性处理函数。信号产生器可扩展合成低频带信号222且可应用所选定非线性处理函数以产生第三扩展信号274。第三扩展信号274可近似于图1的第三扩展信号174。在特定实施例中,函数选择器180基于所接收的参数选择非线性处理函数。举例来说,解码器系统200可接收识别(例如,经由指数)特定非线性处理函数的参数,所述特定非线性处理函数由编码器系统(例如,编码器系统100)应用以编码特定音频帧或音频帧序列。可针对每一帧或当待使用的非线性处理函数改变时接收此参数。Signal generator 112 can receive synthetic low-band signal 222 from low-band decoder 208. Signal generator 112 can produce the third extended signal 274 based on synthetic low-band signal 222, as described with reference to FIG1. For example, function selector 180 can select nonlinear processing function from a plurality of available nonlinear processing functions 218 based on synthetic low-band signal 222. Signal generator can expand synthetic low-band signal 222 and can apply selected nonlinear processing function to produce the third extended signal 274. The third extended signal 274 can be similar to the third extended signal 174 of FIG1. In a particular embodiment, function selector 180 selects nonlinear processing function based on received parameter. For example, decoder system 200 can receive the parameter of identification (for example, via index) specific nonlinear processing function, and described specific nonlinear processing function is applied to encode specific audio frame or audio frame sequence by encoder system (for example, encoder system 100). This parameter can be received for each frame or when the nonlinear processing function to be used changes.

滤波器114可通过对第三扩展信号274进行滤波来产生第二扩展信号272,如参看图1所描述。第二扩展信号272可近似于图1的第二扩展信号172。The filter 114 may generate the second extended signal 272 by filtering the third extended signal 274, as described with reference to FIG 1. The second extended signal 272 may be similar to the second extended signal 172 of FIG 1 .

混频器116可经由基于谐波性因子270组合噪声信号276及第二扩展信号272来产生第一扩展信号282,如参看图2所描述。噪声信号276可近似于图1的噪声信号176且第一扩展信号282可近似于图1的第一扩展信号182。2 . Noise signal 276 may be similar to noise signal 176 of FIG. 1 and first extended signal 282 may be similar to first extended signal 182 of FIG.

谐波性解码器206可接收低频带数据268、调整参数178、所接收的谐波性因子(例如,参数)或其组合。举例来说,谐波性解码器206可自解码器系统200的DEMUX接收低频带数据268、调整参数178、所接收的谐波性因子或其组合。谐波性解码器206可基于低频带数据268、调整参数178、所接收的谐波性因子或其组合产生谐波性因子270。举例来说,谐波性解码器206可自低频带数据268提取低频带参数。作为另一实例,谐波性解码器206可自调整参数178提取高频带参数。谐波性解码器206可基于低频带参数、高频带参数或两者产生经计算的谐波性因子,如参看图1所描述。Harmonicity decoder 206 can receive low-band data 268, adjustment parameter 178, received harmonicity factor (e.g., parameter) or a combination thereof. For example, harmonicity decoder 206 can receive low-band data 268, adjustment parameter 178, received harmonicity factor or a combination thereof from the DEMUX of decoder system 200. Harmonicity decoder 206 can generate harmonicity factor 270 based on low-band data 268, adjustment parameter 178, received harmonicity factor or a combination thereof. For example, harmonicity decoder 206 can extract low-band parameters from low-band data 268. As another example, harmonicity decoder 206 can extract high-band parameters from adjustment parameter 178. Harmonicity decoder 206 can generate calculated harmonicity factor based on low-band parameters, high-band parameters or both, as described with reference to FIG.

谐波性解码器206可将谐波性因子270设定为经计算的谐波性因子或所接收的谐波性因子。在特定实施例中,谐波性解码器206可回应于侦测到所接收的谐波性因子中的错误而将谐波性因子270设定为经计算的谐波性因子。谐波性解码器206可回应于确定所接收的谐波性因子与经计算的谐波性因子之间的差异满足特定临限值而侦测错误。谐波性解码器206可将谐波性因子270提供至混频器116。混频器116可将第一扩展信号282提供至高频带信号产生器216。Harmonicity decoder 206 can be set to calculated harmonicity factor or received harmonicity factor with harmonicity factor 270.In a particular embodiment, harmonicity decoder 206 can be set to calculated harmonicity factor with harmonicity factor 270 in response to the error that detects in the received harmonicity factor.Harmonicity decoder 206 can be responded to and determine that the difference between received harmonicity factor and the calculated harmonicity factor satisfies specific threshold value and detects error.Harmonicity decoder 206 can be provided to frequency mixer 116 with harmonicity factor 270.Frequency mixer 116 can be provided to high frequency band signal generator 216 with first expansion signal 282.

高频带信号产生器216可基于调整参数178及第一扩展信号282中的至少一者产生合成高频带信号224。举例来说,高频带信号产生器216可将调整参数178应用于第一扩展信号282以产生合成高频带信号224。为了说明,高频带信号产生器216可按与调整参数178中的至少一者相关联的因子来按比例缩放第一扩展信号282。在特定实施例中,调整参数178中的一或多者可对应于增益调整参数。高频带信号产生器216可将增益调整参数应用于第一扩展信号282以产生合成高频带信号224。合成滤波器组210可接收合成高频带信号224及合成低频带信号222。输出音频信号278可由合成滤波器组210提供至扬声器(或其它输出装置)和/或经存储。High-frequency band signal generator 216 can produce synthetic high-frequency band signal 224 based on at least one in adjustment parameter 178 and the first extended signal 282.For example, high-frequency band signal generator 216 can apply adjustment parameter 178 to first extended signal 282 to produce synthetic high-frequency band signal 224.For illustration, high-frequency band signal generator 216 can come the first extended signal 282 in proportion by the factor associated with at least one in adjustment parameter 178.In a particular embodiment, one or more in adjustment parameter 178 can correspond to gain adjustment parameter.High-frequency band signal generator 216 can apply gain adjustment parameter to first extended signal 282 to produce synthetic high-frequency band signal 224.Composition filter group 210 can receive synthetic high-frequency band signal 224 and synthetic low-frequency band signal 222.Output audio signal 278 can be provided to loudspeaker (or other output device) and/or through storage by composition filter group 210.

解码器系统200可使用基于指示编码器处接收的输入信号的低频带部分的特性的低频带参数选择的非线性处理函数实现在解码器处产生合成高频带信号。使用选定非线性处理函数产生合成高频带信号可在有声状况及无声状况两者下改良合成高频带信号与输入信号的高频带部分之间的相关性。Decoder system 200 can use the non-linear processing function of the low-frequency band parameter selection of the characteristic of the low-frequency band part of the input signal that receives based on the indication encoder place to realize and produce synthetic high-frequency band signal at the decoder place.Use selected non-linear processing function to produce synthetic high-frequency band signal and can improve the dependency between the high-frequency band part of synthetic high-frequency band signal and the input signal under both voiced situation and silent situation.

参看图3,展示可操作以执行音频信号的谐波带宽扩展的系统的特定实施例,且将所述系统大体上标示为300。3 , a particular embodiment of a system operable to perform harmonic bandwidth extension of an audio signal is shown and generally designated 300 .

在特定实施例中,系统300(或其部分)可集成至编码(或解码)系统或装置中(例如,无线电话或译码器/解码器(CODEC)中)。在其它实施例中,系统300(或其部分)可集成至机顶盒、音乐播放器、视讯播放器、娱乐单元、导航装置、通信装置、个人数字助理(PDA)、固定位置数据单元或计算机中。In certain embodiments, system 300 (or portions thereof) may be integrated into an encoding (or decoding) system or device, such as a wireless telephone or a codec/decoder (CODEC). In other embodiments, system 300 (or portions thereof) may be integrated into a set-top box, a music player, a video player, an entertainment unit, a navigation device, a communication device, a personal digital assistant (PDA), a fixed location data unit, or a computer.

应注意,在以下描述中,由图3的系统300执行的各种功能经描述为由某些组件或模块执行。组件及模块的此划分仅为了说明目的且并不被认为系限制性的。在替代实施例中,由特定组件或模块执行的功能可在多个组件或模块中划分。此外,在替代实施例中,图3的两个或两个以上组件或模块可集成至单一组件或模块中。可使用硬件(例如,场可编程门阵列(FPGA)装置、特殊应用集成电路(ASIC)、数字信号处理器(DSP)、控制器等)、软件(例如,可由处理器执行的指令)或其任何组合实施图3中所说明的每一组件或模块。It should be noted that in the following description, the various functions performed by the system 300 of Figure 3 are described as being performed by certain components or modules. This division of components and modules is for illustrative purposes only and is not to be considered restrictive. In alternative embodiments, the functions performed by a particular component or module may be divided among multiple components or modules. In addition, in alternative embodiments, two or more components or modules of Figure 3 may be integrated into a single component or module. Each component or module illustrated in Figure 3 may be implemented using hardware (e.g., a field programmable gate array (FPGA) device, an application-specific integrated circuit (ASIC), a digital signal processor (DSP), a controller, etc.), software (e.g., instructions executable by a processor), or any combination thereof.

系统300包括分析滤波器组110、低频带编码器108、谐波性估计器106、参数估计器190及解码器系统200。System 300 includes analysis filterbank 110 , lowband encoder 108 , harmonicity estimator 106 , parameter estimator 190 , and decoder system 200 .

在操作期间,分析滤波器组110可接收输入音频信号102。分析滤波器组110可将输入音频信号102分成至少低频带信号122及高频带信号124。During operation, the analysis filterbank 110 may receive an input audio signal 102. The analysis filterbank 110 may separate the input audio signal 102 into at least a low-band signal 122 and a high-band signal 124.

低频带编码器108可自分析滤波器组110接收低频带信号122。低频带编码器108可基于低频带信号122确定低频带参数168,如参看图1所描述。低频带编码器108可将低频带参数168提供至解码器系统200。The lowband encoder 108 may receive the lowband signal 122 from the analysis filterbank 110. The lowband encoder 108 may determine lowband parameters 168 based on the lowband signal 122, as described with reference to FIG1. The lowband encoder 108 may provide the lowband parameters 168 to the decoder system 200.

谐波性估计器106可接收高频带信号124且可基于高频带信号124产生谐波性因子170。举例来说,谐波性估计器106可基于指示高频带信号124的特性的高频带参数产生谐波性因子170,如参看图1所描述。谐波性估计器106可将谐波性因子170提供至解码器系统200。The harmonicity estimator 106 may receive the high-band signal 124 and may generate a harmonicity factor 170 based on the high-band signal 124. For example, the harmonicity estimator 106 may generate the harmonicity factor 170 based on a high-band parameter indicating a characteristic of the high-band signal 124, as described with reference to FIG1 . The harmonicity estimator 106 may provide the harmonicity factor 170 to the decoder system 200.

参数估计器190可基于高频带信号124产生调整参数178。举例来说,调整参数178可对应于指示高频带信号124的特性的高频带参数。参数估计器190可将调整参数178提供至解码器系统200。解码器系统200可基于调整参数178、低频带参数168、谐波性因子170或其组合产生合成高频带信号224,如参看图2所描述。The parameter estimator 190 may generate adjustment parameters 178 based on the high-band signal 124. For example, the adjustment parameters 178 may correspond to high-band parameters indicating characteristics of the high-band signal 124. The parameter estimator 190 may provide the adjustment parameters 178 to the decoder system 200. The decoder system 200 may generate a synthesized high-band signal 224 based on the adjustment parameters 178, the low-band parameters 168, the harmonicity factors 170, or a combination thereof, as described with reference to FIG.

系统300使用基于合成低频带信号的特性而选择的非线性处理函数实现在解码器处产生高频带信号。系统300可基于高频带信号124且不基于低频带信号的扩展版本产生调整参数178。在特定实施例中,系统300可通过节省用于扩展输入音频信号102及将扩展信号与噪声信号混合的处理时间而比编码器系统100更快地产生调整参数178。System 300 uses the nonlinear processing function that selects based on the characteristic of synthetic low-frequency band signal and realizes and produces high-frequency band signal at the decoder place.System 300 can produce adjustment parameter 178 based on high-frequency band signal 124 and not based on the extended version of low-frequency band signal.In a specific embodiment, system 300 can be used for expanding input audio signal 102 and the processing time that extension signal is mixed with noise signal and produces adjustment parameter 178 faster than encoder system 100 by saving.

参看图4,展示执行音频信号的谐波带宽扩展的方法的特定实施例的流程图,且将所述方法大体上标示为400。可由图1的编码器系统100执行方法400。4, a flow chart of a particular embodiment of a method of performing harmonic bandwidth extension of an audio signal is shown and generally designated 400. The method 400 may be performed by the encoder system 100 of FIG.

方法400可包括在装置处将输入音频信号分成至少低频带信号及高频带信号(在402处)。低频带信号可对应于低频带频率范围且高频带信号可对应于高频带频率范围。举例来说,图1的分析滤波器组110可将输入音频信号102分成至少低频带信号122及高频带信号124,如参看图1所描述。低频带信号122可对应于低频带频率范围(例如,50赫兹(Hz)至7千赫兹(kHz))且高频带信号124可对应于高频带频率范围(例如,7kHz至16kHz)。Method 400 may include, at a device, separating an input audio signal into at least a low-band signal and a high-band signal (at 402). The low-band signal may correspond to a low-band frequency range and the high-band signal may correspond to a high-band frequency range. For example, the analysis filter bank 110 of FIG. 1 may separate the input audio signal 102 into at least a low-band signal 122 and a high-band signal 124, as described with reference to FIG. The low-band signal 122 may correspond to a low-band frequency range (e.g., 50 hertz (Hz) to 7 kilohertz (kHz)) and the high-band signal 124 may correspond to a high-band frequency range (e.g., 7 kHz to 16 kHz).

方法400还可包括选择多个非线性处理函数中的非线性处理函数(在404处)。举例来说,图1的函数选择器180可选择多个可用非线性处理函数118中的特定非线性处理函数,如参看图1所描述。The method 400 may also include selecting a nonlinear processing function from the plurality of nonlinear processing functions at 404. For example, the function selector 180 of FIG. 1 may select a particular nonlinear processing function from the plurality of available nonlinear processing functions 118, as described with reference to FIG.

方法400可进一步包括基于低频带信号及非线性处理函数产生第一扩展信号(在406处)。举例来说,图1的混频器116可基于低频带信号122及选定非线性处理函数产生第一扩展信号182,如参看图1所描述。Method 400 may further include generating a first extended signal based on the low-band signal and the nonlinear processing function at 406. For example, mixer 116 of FIG. 1 may generate first extended signal 182 based on low-band signal 122 and the selected nonlinear processing function, as described with reference to FIG.

方法400还可包括基于第一扩展信号或高频带信号中的至少一者产生至少一个调整参数(在408处)。举例来说,参数调整器190可基于第一扩展信号182或高频带信号124中的至少一者产生调整参数178,如参看图1所描述。Method 400 may also include generating at least one adjustment parameter based on at least one of the first extended signal or the high-band signal at 408. For example, parameter adjuster 190 may generate adjustment parameter 178 based on at least one of the first extended signal 182 or the high-band signal 124, as described with reference to FIG.

方法400可使用基于低频带信号122的特性选择的非线性处理函数实现在编码器处产生合成高频带信号(例如,第一扩展信号182)。使用选定非线性处理函数可增加在有声状况及无声状况两者下合成高频带信号与高频带信号124之间的相关性。Method 400 can use the non-linear processing function of characteristic selection based on low-frequency band signal 122 to realize and produce synthetic high-frequency band signal (for example, first extended signal 182) at encoder place.Use selected non-linear processing function to increase the correlation between synthetic high-frequency band signal and the high-frequency band signal 124 under voiced situation and silent situation.

在特定实施例中,图4的方法400可经由处理单元(例如,中央处理单元(CPU)、数字信号处理器(DSP)或控制器)的硬件(例如,场可编程门阵列(FPGA)装置、特殊应用集成电路(ASIC)等)或经由固件装置或其任何组合实施。作为一实例,可由执行指令的处理器(如关于图6所描述)执行图4的方法400。In certain embodiments, the method 400 of FIG. 4 may be implemented via hardware (e.g., a field programmable gate array (FPGA) device, an application specific integrated circuit (ASIC), etc.) of a processing unit (e.g., a central processing unit (CPU), a digital signal processor (DSP), or a controller) or via firmware, or any combination thereof. As an example, the method 400 of FIG. 4 may be performed by a processor executing instructions (as described with respect to FIG. 6 ).

参看图5,展示执行音频信号的谐波带宽扩展的方法的特定实施例的流程图,且将所述方法大体上标示为500。可由图2的解码器系统200执行方法500。5, a flow chart of a particular embodiment of a method of performing harmonic bandwidth extension of an audio signal is shown and generally designated 500. Method 500 may be performed by decoder system 200 of FIG.

方法500可包括在装置处接收对应于输入音频信号的至少低频带信号的低频带数据(在502处)。举例来说,解码器系统200的DEMUX可经由接收器接收输入位串流,如参看图2所描述。作为另一实例,低频带解码器208可接收低频带数据268,如参看图2所描述。The method 500 may include receiving, at a device, low-band data corresponding to at least a low-band signal of an input audio signal at 502. For example, a DEMUX of the decoder system 200 may receive an input bit stream via a receiver, as described with reference to FIG2. As another example, the low-band decoder 208 may receive the low-band data 268, as described with reference to FIG2.

方法500还可包括解码低频带数据以产生合成低频带音频信号(在504处)。举例来说,低频带解码器208可解码低频带数据268以产生合成低频带信号222,如参看图2所描述。The method 500 may also include decoding the low-band data to generate a synthesized low-band audio signal at 504. For example, the low-band decoder 208 may decode the low-band data 268 to generate the synthesized low-band signal 222, as described with reference to FIG.

方法500可进一步包括选择多个非线性处理函数中的非线性处理函数(在506处)。举例来说,函数选择器180可选择多个可用非线性处理函数118中的特定非线性处理函数,如参看图2所描述。The method 500 may further include selecting a nonlinear processing function from the plurality of nonlinear processing functions at 506. For example, the function selector 180 may select a particular nonlinear processing function from the plurality of available nonlinear processing functions 118, as described with reference to FIG.

方法500还可包括基于合成低频带音频信号及非线性处理函数产生合成高频带音频信号(在508处)。举例来说,高频带信号产生器216可基于合成低频带信号222及选定非线性处理函数产生合成高频带信号224,如参看图2所描述。Method 500 may also include generating a synthesized high-band audio signal based on the synthesized low-band audio signal and the nonlinear processing function at 508. For example, the high-band signal generator 216 may generate a synthesized high-band signal 224 based on the synthesized low-band signal 222 and the selected nonlinear processing function, as described with reference to FIG.

方法500可使用基于指示在编码器处接收的输入信号的低频带部分的特性的低频带参数选择的非线性处理函数实现在解码器处产生合成高频带信号。使用选定非线性处理函数产生合成高频带信号可改良在有声状况及无声状况两者下合成高频带信号与输入信号的高频带部分之间的相关性。Method 500 can use the non-linear processing function of the low-frequency band parameter selection of the characteristic of the low-frequency band part of the input signal that receives at the encoder place to realize and produce synthetic high-frequency band signal at the decoder place.Use selected non-linear processing function to produce synthetic high-frequency band signal and can improve the dependency between the high-frequency band part of synthetic high-frequency band signal and the input signal under voiced situation and silent situation.

在特定实施例中,图5的方法500可经由处理单元(例如,中央处理单元(CPU)、数字信号处理器(DSP)或控制器)的硬件(例如,场可编程门阵列(FPGA)装置、特殊应用集成电路(ASIC)等)或经由固件装置或其任何组合实施。作为一实例,可由执行指令的处理器(如关于图6所描述)执行图5的方法500。In certain embodiments, the method 500 of FIG5 may be implemented via hardware (e.g., a field programmable gate array (FPGA) device, an application specific integrated circuit (ASIC), etc.) of a processing unit (e.g., a central processing unit (CPU), a digital signal processor (DSP), or a controller) or via firmware, or any combination thereof. As an example, the method 500 of FIG5 may be performed by a processor executing instructions (as described with respect to FIG6 ).

参考图6,描绘无线通信装置的特定说明性实施例的框图,且将所述装置大体上标示为600。装置600包括耦接至存储器632的处理器610(例如,中央处理单元(CPU)、数字信号处理器(DSP)等)。存储器632可包括由处理器610执行的指令660。处理器610还可包括译码器/解码器(CODEC)634,如所展示。CODEC 634可执行本文中所揭示的方法及程序,例如图4的方法400、图5的方法500或两者,和/或指令660可由处理器610执行以执行本文中所揭示的方法及程序,例如图4的方法400、图5的方法500或两者。6 , a block diagram of a particular illustrative embodiment of a wireless communication device is depicted and generally designated 600. Device 600 includes a processor 610 (e.g., a central processing unit (CPU), a digital signal processor (DSP), etc.) coupled to a memory 632. Memory 632 may include instructions 660 executed by processor 610. Processor 610 may also include a coder/decoder (CODEC) 634, as shown. CODEC 634 may perform the methods and procedures disclosed herein, such as method 400 of FIG. 4 , method 500 of FIG. 5 , or both, and/or instructions 660 may be executed by processor 610 to perform the methods and procedures disclosed herein, such as method 400 of FIG. 4 , method 500 of FIG. 5 , or both.

CODEC 634可包括编码器690及解码器692。编码器690可包括分析滤波器组110、谐波性估计器106、低频带编码器108、混频器116、信号产生器112、滤波器114及参数估计器190中的一或多者,如所展示。解码器692可包括合成滤波器组210、谐波性解码器206、低频带解码器208、高频带信号产生器216、混频器116及滤波器114中的一或多者,如所展示。在替代实施例中,编码器690及解码器692可驻留在多个处理器内或其部分内。举例来说,装置600可包括多个处理器(例如,DSP及应用程序处理器),且编码器690及解码器692或其组件可包括在多个处理器中的一些或全部中。CODEC 634 may comprise an encoder 690 and a decoder 692. Encoder 690 may comprise one or more of analysis filter bank 110, harmonicity estimator 106, low-band encoder 108, mixer 116, signal generator 112, filter 114 and parameter estimator 190, as shown. Decoder 692 may comprise one or more of composite filter bank 210, harmonicity decoder 206, low-band decoder 208, high-band signal generator 216, mixer 116 and filter 114, as shown. In an alternative embodiment, encoder 690 and decoder 692 may reside in a plurality of processors or in its part. For example, device 600 may comprise a plurality of processors (e.g., DSP and application processor), and encoder 690 and decoder 692 or its components may be included in some or all of a plurality of processors.

可经由专用硬件(例如,电路)、经由执行指令以执行一或多个任务的处理器或其组合实施分析滤波器组110、谐波性估计器106、低频带编码器108、混频器116、信号产生器112、滤波器114、参数估计器190、合成滤波器组210、谐波性解码器206、低频带解码器208、高频带信号产生器216或其组合。作为实例,这些指令可存储在存储器装置中,例如随机访问存储器(RAM)、磁阻式随机访问存储器(MRAM)、自旋力矩转移MRAM(STT-MRAM)、闪存、只读存储器(ROM)、可编程只读存储器(PROM)、固态存储器、可抹除可编程只读存储器(EPROM)、电可抹除可编程只读存储器(EEPROM)、缓存器、硬盘、可移动磁盘或紧密光盘只读存储器(CD-ROM)。The analysis filterbank 110, the harmonicity estimator 106, the low-band encoder 108, the mixer 116, the signal generator 112, the filter 114, the parameter estimator 190, the synthesis filterbank 210, the harmonicity decoder 206, the low-band decoder 208, the high-band signal generator 216, or a combination thereof may be implemented via dedicated hardware (e.g., circuitry), via a processor executing instructions to perform one or more tasks, or a combination thereof. As an example, these instructions may be stored in a memory device such as a random access memory (RAM), a magnetoresistive random access memory (MRAM), a spin torque transfer MRAM (STT-MRAM), a flash memory, a read-only memory (ROM), a programmable read-only memory (PROM), a solid-state memory, an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a cache, a hard disk, a removable disk, or a compact disc read-only memory (CD-ROM).

图6还展示耦接至处理器610且耦接至显示器628的显示控制器626。扬声器636及麦克风638可耦接至装置600。举例来说,麦克风638可产生图1的输入音频信号102,且装置600可基于输入音频信号102产生用于传输至接收器的输出位串流,如参看图1所描述。举例来说,输出位串流可由传输器经由处理器610、无线控制器640及天线642传输。作为另一实例,扬声器636可用于输出由装置600根据由接收器接收(例如,经由无线控制器640及天线642)的输入位串流重建构的信号,如参看图2所描述。6 also shows a display controller 626 coupled to the processor 610 and to a display 628. A speaker 636 and a microphone 638 may be coupled to the device 600. For example, the microphone 638 may generate the input audio signal 102 of FIG. 1 , and the device 600 may generate an output bit stream for transmission to a receiver based on the input audio signal 102, as described with reference to FIG. 1 . For example, the output bit stream may be transmitted by a transmitter via the processor 610, the wireless controller 640, and the antenna 642. As another example, the speaker 636 may be used to output a signal reconstructed by the device 600 from the input bit stream received by the receiver (e.g., via the wireless controller 640 and the antenna 642), as described with reference to FIG.

在特定实施例中,处理器610、显示控制器626、存储器632及无线控制器640包括在系统级封装或系统单芯片装置(例如,行动台调制解调器(MSM))622中。在特定实施例中,输入装置630(例如,触摸屏和/或小键盘)及电力供应器644耦接至系统单芯片装置622。此外,在特定实施例中,如图6所说明,显示器628、输入装置630、扬声器636、麦克风638、天线642及电力供应器644在系统单芯片装置622的外部。显示器628、输入装置630、扬声器636、麦克风638、天线642及电力供应器644中的每一者可耦接至系统单芯片装置622的组件,例如接口或控制器。In a particular embodiment, the processor 610, display controller 626, memory 632, and wireless controller 640 are included in a system-in-package or system-on-a-chip device (e.g., a mobile station modem (MSM)) 622. In a particular embodiment, an input device 630 (e.g., a touch screen and/or keypad) and a power supply 644 are coupled to the system-on-a-chip device 622. Furthermore, in a particular embodiment, as illustrated in FIG6 , the display 628, input device 630, speaker 636, microphone 638, antenna 642, and power supply 644 are external to the system-on-a-chip device 622. Each of the display 628, input device 630, speaker 636, microphone 638, antenna 642, and power supply 644 can be coupled to a component of the system-on-a-chip device 622, such as an interface or controller.

结合所描述的实施例,第一装置可包括用于将输入音频信号分成至少低频带信号及高频带信号的装置,例如分析滤波器组110、经配置以分离音频信号的一或多个其它装置或电路,或其任何组合。低频带信号可对应于低频带频率范围且高频带信号可对应于高频带频率范围。所述装置还可包括用于选择多个非线性处理函数中的非线性处理函数的装置,例如函数选择器180、经配置以自多个非线性处理函数选择非线性处理函数的一或多个其它装置或电路,或其任何组合。所述装置可进一步包括用于基于低频带信号及非线性处理函数产生第一扩展信号的第一装置,例如混频器116、经配置以基于低频带信号及非线性处理函数产生信号的一或多个其它装置或电路,或其任何组合。所述装置还可包括用于基于第一扩展信号、高频带信号或两者产生至少一个调整参数的第二装置,例如参数估计器190、经配置以基于扩展信号和/或高频带信号产生至少一个调整参数的一或多个其它装置或电路,或其任何组合。In conjunction with described embodiment, first device may comprise the device for dividing input audio signal into at least low-band signal and high-band signal, for example analysis filter bank 110, one or more other devices or circuits configured to separate audio signal, or its any combination.Low-band signal may correspond to low-band frequency range and high-band signal may correspond to high-band frequency range.Described device may also comprise the device for selecting the nonlinear processing function in a plurality of nonlinear processing functions, for example function selector 180, one or more other devices or circuits configured to select nonlinear processing function from a plurality of nonlinear processing functions, or its any combination.Described device may further comprise the first device for generating the first extended signal based on low-band signal and nonlinear processing function, for example mixer 116, one or more other devices or circuits configured to generate signal based on low-band signal and nonlinear processing function, or its any combination.Described device may also comprise the second device for generating at least one adjustment parameter based on the first extended signal, high-band signal or both, for example parameter estimator 190, one or more other devices or circuits configured to generate at least one adjustment parameter based on extended signal and/or high-band signal, or its any combination.

结合所描述的实施例,第二装置可包括用于接收对应于输入音频信号的至少低频带信号的低频带数据的装置,例如解码器系统200的组件或耦接至解码器系统200的组件(例如,接收器)、经配置以接收对应于输入音频信号的低频带信号的低频带数据的一或多个其它装置或电路,或其任何组合。所述装置还可包括用于解码低频带数据以产生合成低频带音频信号的装置,例如低频带解码器208、经配置以解码低频带数据以产生合成低频带音频信号的一或多个其它装置或电路,或其任何组合。所述装置可进一步包括用于选择多个非线性处理函数中的非线性处理函数的装置,例如函数选择器180、经配置以选择多个非线性处理函数中的非线性处理函数的一或多个其它装置或电路,或其任何组合。所述装置还可包括用于基于合成低频带音频信号及非线性处理函数产生合成高频带音频信号的装置,例如高频带信号产生器216、经配置以基于合成低频带音频信号及非线性处理函数产生合成高频带音频信号的一或多个其它装置或电路,或其任何组合。In conjunction with described embodiment, second device may comprise the device for receiving the low-frequency band data of at least the low-frequency band signal corresponding to the input audio signal, for example the component of decoder system 200 or the component (for example being coupled to decoder system 200, receiver), be configured to receive one or more other devices or circuit of the low-frequency band data of the low-frequency band signal corresponding to the input audio signal, or its any combination.Described device may also comprise the device for decoding low-frequency band data to produce the synthetic low-frequency band audio signal, for example low-frequency band decoder 208, be configured to decode low-frequency band data to produce one or more other devices or circuit of synthetic low-frequency band audio signal, or its any combination.Described device may further comprise the device for selecting the nonlinear processing function in a plurality of nonlinear processing functions, for example function selector 180, be configured to select one or more other devices or circuit of the nonlinear processing function in a plurality of nonlinear processing functions, or its any combination. The device may also include a device for generating a synthetic high-band audio signal based on the synthetic low-band audio signal and the non-linear processing function, such as a high-band signal generator 216, one or more other devices or circuits configured to generate a synthetic high-band audio signal based on the synthetic low-band audio signal and the non-linear processing function, or any combination thereof.

熟悉此项技术者将进一步了解,结合本文中所揭示的实施例所描述的各种说明性逻辑块、配置、模块、电路及算法步骤可实施为电子硬件、由例如硬件处理器的处理装置执行的计算机软件,或两者的组合。上文大体在功能性方面描述各种说明性组件、块、配置、模块、电路及步骤。此功能性经实施为硬件还是可执行软件取决于特定应用及强加于整个系统上的设计约束。对于每一特定应用来说,熟习此项技术者可以变化的方式实施所描述的功能性,但不应将这些实施决策解释为导致脱离本发明的范围。Those skilled in the art will further appreciate that the various illustrative logical blocks, configurations, modules, circuits, and algorithm steps described in conjunction with the embodiments disclosed herein may be implemented as electronic hardware, computer software executed by a processing device such as a hardware processor, or a combination of both. Various illustrative components, blocks, configurations, modules, circuits, and steps are generally described above in terms of functionality. Whether this functionality is implemented as hardware or executable software depends on the specific application and the design constraints imposed on the overall system. For each specific application, those skilled in the art may implement the described functionality in varying ways, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.

结合本文中所揭示的实施例而描述的方法或算法的步骤可直接体现于硬件中、由处理器执行的软件模块中,或两者的组合中。软件模块可驻留于存储器装置中,例如随机访问存储器(RAM)、磁阻式随机访问存储器(MRAM)、自旋力矩转移MRAM(STT-MRAM)、闪存、只读存储器(ROM)、可编程只读存储器(PROM)、可抹除可编程只读存储器(EPROM)、电可抹除可编程只读存储器(EEPROM)、缓存器、硬盘、可移动磁盘或紧密光盘只读存储器(CD-ROM)。例示性存储器装置耦接至处理器,以使得处理器可自存储器装置读取信息及将信息写入至存储器装置。在替代方案中,存储器装置可与处理器成一体式。处理器及存储媒体可驻留于特殊应用集成电路(ASIC)中。ASIC可驻留于计算装置或用户终端机中。在替代方案中,处理器及存储媒体可作为离散组件驻留于计算装置或用户终端机中。The steps of the methods or algorithms described in conjunction with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of both. The software module may reside in a memory device, such as random access memory (RAM), magnetoresistive random access memory (MRAM), spin torque transfer MRAM (STT-MRAM), flash memory, read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), cache, hard disk, removable disk, or compact disc read-only memory (CD-ROM). Exemplary memory devices are coupled to the processor so that the processor can read information from and write information to the memory device. Alternatively, the memory device may be integral to the processor. The processor and storage medium may reside in an application-specific integrated circuit (ASIC). The ASIC may reside in a computing device or user terminal. Alternatively, the processor and storage medium may reside as discrete components in the computing device or user terminal.

提供所揭示的实施例的前述描述以使熟习此项技术者能够制作或使用所揭示的实施例。对于熟习此项技术者而言,这些实施例的各种修改将易于显而易见,且本文中所定义的原理可在不脱离本发明的范围的情况下应用于其它实施例。因此,本发明并不意欲限于本文中所展示的实施例,而应符合可能与如以下申请专利范围所定义的原理及新颖特征相一致的最广泛范畴。The foregoing description of the disclosed embodiments is provided to enable one skilled in the art to make or use the disclosed embodiments. Various modifications to these embodiments will be readily apparent to one skilled in the art, and the principles defined herein may be applied to other embodiments without departing from the scope of the invention. Therefore, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope possible consistent with the principles and novel features as defined by the following claims.

Claims (59)

1.一种用于音频信号的谐波带宽扩展的方法,其包含:1. A method for harmonic bandwidth extension of an audio signal, comprising: 在装置处,将输入音频信号分为至少低频带信号及高频带信号,所述低频带信号对应于低频带频率范围且所述高频带信号对应于高频带频率范围;At the device, the input audio signal is divided into at least a low-frequency band signal and a high-frequency band signal, wherein the low-frequency band signal corresponds to a low-frequency band frequency range and the high-frequency band signal corresponds to a high-frequency band frequency range. 确定低频带信号的特性;Determine the characteristics of low-frequency signals; 基于所述特性选择多个非线性处理函数中的非线性处理函数;Based on the aforementioned characteristics, a nonlinear processing function is selected from among multiple nonlinear processing functions; 基于所述低频带信号及所述非线性处理函数产生第一扩展信号;及A first extended signal is generated based on the low-frequency band signal and the nonlinear processing function; and 基于所述第一扩展信号、所述高频带信号或两者产生至少一个调整参数。At least one adjustment parameter is generated based on the first extended signal, the high-frequency band signal, or both. 2.根据权利要求1所述的方法,其中所述非线性处理函数是在所述装置处接收到所述输入音频信号之后选择的,其中所述第一扩展信号是经由混合噪声信号和第二扩展信号来产生,且其中所述至少一个调整参数是基于所述第一扩展信号及所述高频带信号确定。2. The method of claim 1, wherein the nonlinear processing function is selected after the input audio signal is received at the device, wherein the first extended signal is generated via a mixed noise signal and a second extended signal, and wherein the at least one adjustment parameter is determined based on the first extended signal and the high-frequency band signal. 3.根据权利要求2所述的方法,其中第一比例的所述噪声信号和第二比例的所述第二扩展信号经混合,且其中所述第一比例和所述第二比例是基于所述低频带信号、所述高频带信号或所述输入音频信号中的至少一者的谐波性确定。3. The method of claim 2, wherein the noise signal of the first proportion and the second extended signal of the second proportion are mixed, and wherein the first proportion and the second proportion are determined based on the harmonicity of at least one of the low-frequency signal, the high-frequency signal, or the input audio signal. 4.根据权利要求3所述的方法,其进一步包含:4. The method of claim 3, further comprising: 基于音频帧中所述输入音频信号的周期性的估计确定所述谐波性,The harmonicity is determined based on the estimation of the periodicity of the input audio signal in the audio frame. 其中所述非线性处理函数是响应于接收所述输入音频信号而选择的。The nonlinear processing function is selected in response to receiving the input audio signal. 5.根据权利要求2所述的方法,其进一步包含:5. The method of claim 2, further comprising: 经由对第三扩展信号进行滤波来产生所述第二扩展信号,其中所述第二扩展信号的带宽对应于所述高频带频率范围。The second extended signal is generated by filtering the third extended signal, wherein the bandwidth of the second extended signal corresponds to the high-frequency band range. 6.根据权利要求5所述的方法,其进一步包含:6. The method of claim 5, further comprising: 经由将所述非线性处理函数应用于所述低频带信号来产生所述第三扩展信号,其中所述非线性处理函数在逐帧基础上选择的。The third extended signal is generated by applying the nonlinear processing function to the low-frequency band signal, wherein the nonlinear processing function is selected on a frame-by-frame basis. 7.根据权利要求2所述的方法,其中所述第二扩展信号是经由将一线性变换应用于第三扩展信号及选择对应于所述高频带频率范围的变换系数来产生。7. The method of claim 2, wherein the second extended signal is generated by applying a linear transformation to the third extended signal and selecting transformation coefficients corresponding to the high-frequency band range. 8.根据权利要求7所述的方法,其中:8. The method according to claim 7, wherein: 所述非线性处理函数由函数选择器基于所述低频带信号的所述特性或所述低频带信号的所述特性的所确定值来选择的,及其中所述线性变换对应于离散余弦变换。The nonlinear processing function is selected by a function selector based on the characteristics of the low-frequency signal or a determined value of the characteristics of the low-frequency signal, wherein the linear transformation corresponds to the discrete cosine transform. 9.根据权利要求1所述的方法,其进一步包含:9. The method of claim 1, further comprising: 响应于确定所述至少一个调整参数满足第一条件而选择所述多个非线性处理函数中的第一非线性处理函数。In response to determining that the at least one adjustment parameter satisfies a first condition, a first nonlinear processing function is selected from the plurality of nonlinear processing functions. 10.根据权利要求1所述的方法,其中所述非线性处理函数是选自以下各者中:10. The method of claim 1, wherein the nonlinear processing function is selected from the following: 所述多个非线性处理函数中对应于低阶幂函数的第一非线性处理函数,及The first nonlinear processing function corresponding to the low-order power function among the plurality of nonlinear processing functions, and 所述多个非线性处理函数中对应于高阶幂函数的第二非线性处理函数。The second nonlinear processing function among the plurality of nonlinear processing functions corresponds to the higher-order power function. 11.根据权利要求1所述的方法,其进一步包含:11. The method of claim 1, further comprising: 使用分析滤波器组将所述输入音频信号分成至少所述低频带信号和所述高频带信号;及The input audio signal is divided into at least the low-frequency band signal and the high-frequency band signal using an analytical filter bank; and 确定与所述输入音频信号的帧相关联的参数,Determine the parameters associated with the frames of the input audio signal. 其中,所述特性是所述低频带信号的音频特性,其中,所述至少一个调整参数对应于与所述高频带信号相关联的至少一个增益调整参数,及Wherein, the characteristic is the audio characteristic of the low-frequency band signal, and the at least one adjustment parameter corresponds to at least one gain adjustment parameter associated with the high-frequency band signal, and 其中与所述帧相关联的所述参数包含经选择以编码所述低频带信号的译码模式、所述帧的周期性、所述帧中的非周期噪声的量或对应于所述帧的频谱倾斜中的一者。The parameters associated with the frame include one of the following: a decoding mode selected to encode the low-frequency band signal, the periodicity of the frame, the amount of non-periodic noise in the frame, or the spectral tilt corresponding to the frame. 12.一种用于音频信号的谐波带宽扩展的方法,其包含:12. A method for harmonic bandwidth extension of an audio signal, comprising: 在装置处,接收对应于输入音频信号的至少低频带信号的低频带数据;At the device, low-frequency data corresponding to at least a low-frequency signal of the input audio signal is received; 解码所述低频带数据以产生合成低频带音频信号;Decode the low-frequency data to generate a synthetic low-frequency audio signal; 确定所述低频带信号的特性;Determine the characteristics of the low-frequency band signal; 基于所述特性选择多个非线性处理函数中的非线性处理函数;及Based on the aforementioned characteristics, a nonlinear processing function is selected from among multiple nonlinear processing functions; and 基于所述合成低频带音频信号及所述非线性处理函数产生合成高频带音频信号。A synthesized high-frequency audio signal is generated based on the synthesized low-frequency audio signal and the nonlinear processing function. 13.根据权利要求12所述的方法,进一步包含经由组合所述合成低频带音频信号及所述合成高频带音频信号来产生输出音频信号,其中所述非线性处理函数是基于所述合成低频带音频信号选择的,且其中所述输出音频信号的第一带宽大于所述合成低频带音频信号的第二带宽。13. The method of claim 12, further comprising generating an output audio signal by combining the synthesized low-frequency audio signal and the synthesized high-frequency audio signal, wherein the nonlinear processing function is selected based on the synthesized low-frequency audio signal, and wherein a first bandwidth of the output audio signal is greater than a second bandwidth of the synthesized low-frequency audio signal. 14.根据权利要求12所述的方法,其进一步包含经由混合噪声信号及第二扩展信号来产生第一扩展信号,其中基于所述第一扩展信号及至少一个调整参数产生所述合成高频带音频信号,其中第一比例的所述第二扩展信号及第二比例的所述噪声信号经混合,且其中所述第一比例及所述第二比例是基于所接收的谐波性参数或所述低频带数据中的至少一者确定。14. The method of claim 12, further comprising generating a first extended signal via mixing a noise signal and a second extended signal, wherein the synthesized high-frequency audio signal is generated based on the first extended signal and at least one adjustment parameter, wherein a first proportion of the second extended signal and a second proportion of the noise signal are mixed, and wherein the first proportion and the second proportion are determined based on at least one of a received harmonic parameter or the low-frequency data. 15.根据权利要求12所述的方法,其中所述合成高频带音频信号是经由按与至少一个调整参数相关联的因子来按比例缩放第一扩展信号来产生。15. The method of claim 12, wherein the synthesized high-frequency band audio signal is generated by scaling a first extended signal by a factor associated with at least one adjustment parameter. 16.根据权利要求12所述的方法,其进一步包含基于第二扩展信号且基于第三扩展信号来产生第一扩展信号,其中所述第二扩展信号对应于高频带频率范围。16. The method of claim 12, further comprising generating a first extended signal based on a second extended signal and a third extended signal, wherein the second extended signal corresponds to a high-frequency band range. 17.根据权利要求12所述的方法,其进一步包括基于第二扩展信号产生第一扩展信号,其中所述第二扩展信号是经由:17. The method of claim 12, further comprising generating a first extended signal based on a second extended signal, wherein the second extended signal is generated via: 将线性变换应用于第三扩展信号来产生的,所述线性变换对应于离散余弦变换,且所述第三扩展信号基于所述合成低频带音频信号及所述非线性处理函数;及The third extended signal is generated by applying a linear transform to the discrete cosine transform, and the third extended signal is based on the synthesized low-frequency audio signal and the nonlinear processing function; and 选择对应于高频带频率范围的变换系数。Choose the transformation coefficients that correspond to the high-frequency band. 18.根据权利要求12所述的方法,其进一步包含基于在所述装置处在逐帧基础上接收的参数而选择所述非线性处理函数。18. The method of claim 12, further comprising selecting the nonlinear processing function based on parameters received at the device on a frame-by-frame basis. 19.根据权利要求12所述的方法,其中,在所述装置内执行所述接收、所述解码、所述确定、所述选择和所述产生,且其中所述装置包括移动通信装置。19. The method of claim 12, wherein the receiving, decoding, determining, selecting, and generating are performed within the apparatus, and wherein the apparatus includes a mobile communication device. 20.根据权利要求12所述的方法,其中,在固定位置数据单元内执行所述接收、所述解码、所述确定、所述选择和所述产生。20. The method of claim 12, wherein the receiving, decoding, determining, selecting, and generating are performed within a fixed-location data unit. 21.一种用于音频信号的谐波带宽扩展的设备,其包含:21. A device for harmonic bandwidth extension of an audio signal, comprising: 存储器,及Memory, and 处理器,其经配置以进行以下操作:A processor configured to perform the following operations: 将输入音频信号分成至少低频带信号及高频带信号,所述低频带信号对应于低频带频率范围且所述高频带信号对应于高频带频率范围;The input audio signal is divided into at least a low-frequency band signal and a high-frequency band signal, wherein the low-frequency band signal corresponds to a low-frequency band frequency range and the high-frequency band signal corresponds to a high-frequency band frequency range. 确定所述低频带信号的特性;Determine the characteristics of the low-frequency band signal; 基于所述特性选择多个非线性处理函数中的非线性处理函数;Based on the aforementioned characteristics, a nonlinear processing function is selected from among multiple nonlinear processing functions; 基于所述低频带信号及所述非线性处理函数产生第一扩展信号;及A first extended signal is generated based on the low-frequency band signal and the nonlinear processing function; and 基于所述第一扩展信号、所述高频带信号或两者产生至少一个调整参数。At least one adjustment parameter is generated based on the first extended signal, the high-frequency band signal, or both. 22.根据权利要求21所述的设备,其中所述非线性处理函数是在所述输入音频信号经分成至少所述低频带信号及所述高频带信号之后选择的,其中所述第一扩展信号是经由混合噪声信号及第二扩展信号来产生,且其中所述至少一个调整参数是基于所述第一扩展信号及所述高频带信号确定。22. The device of claim 21, wherein the nonlinear processing function is selected after the input audio signal is split into at least the low-frequency band signal and the high-frequency band signal, wherein the first extended signal is generated via a mixed noise signal and a second extended signal, and wherein the at least one adjustment parameter is determined based on the first extended signal and the high-frequency band signal. 23.根据权利要求22所述的设备,其中第一比例的所述噪声信号及第二比例的所述第二扩展信号经混合,且其中所述第一比例及所述第二比例是基于所述低频带信号、所述高频带信号或所述输入音频信号中的至少一者的谐波性确定。23. The device of claim 22, wherein the noise signal of the first proportion and the second extended signal of the second proportion are mixed, and wherein the first proportion and the second proportion are determined based on the harmonicity of at least one of the low-frequency signal, the high-frequency signal, or the input audio signal. 24.根据权利要求23所述的设备,其中所述处理器经进一步配置以基于音频帧中所述输入音频信号的周期性的估计确定所述谐波性。24. The device of claim 23, wherein the processor is further configured to determine the harmonicity based on an estimate of the periodicity of the input audio signal in an audio frame. 25.根据权利要求22所述的设备,其中所述处理器经进一步配置以经由对第三扩展信号进行滤波来产生所述第二扩展信号,且其中所述第二扩展信号的带宽对应于所述高频带频率范围。25. The apparatus of claim 22, wherein the processor is further configured to generate the second extended signal by filtering the third extended signal, and wherein the bandwidth of the second extended signal corresponds to the high-frequency band range. 26.根据权利要求25所述的设备,其中所述处理器经进一步配置以经由将所述非线性处理函数应用于所述低频带信号来产生所述第三扩展信号。26. The device of claim 25, wherein the processor is further configured to generate the third extended signal by applying the nonlinear processing function to the low-frequency band signal. 27.根据权利要求22所述的设备,其中所述输入音频信号系使用分析滤波器组分成至少所述低频带信号及所述高频带信号,且其中所述第二扩展信号是经由将线性变换应用于第三扩展信号且选择对应于所述高频带频率范围的变换系数来产生的,所述线性变换对应于离散余弦变换。27. The device of claim 22, wherein the input audio signal is divided into at least the low-frequency band signal and the high-frequency band signal using an analytical filter group, and wherein the second extended signal is generated by applying a linear transformation to the third extended signal and selecting transform coefficients corresponding to the frequency range of the high-frequency band, the linear transformation corresponding to the discrete cosine transform. 28.根据权利要求21所述的设备,其中所述处理器经进一步配置以确定与所述输入音频信号的帧相关联的参数,其中基于所述参数选择所述非线性处理函数,其中响应于确定所述参数满足第一条件而选择所述多个非线性处理函数中的第一非线性处理函数,且其中响应于确定所述参数满足第二条件而选择所述多个非线性处理函数中的第二非线性处理函数。28. The device of claim 21, wherein the processor is further configured to determine parameters associated with frames of the input audio signal, wherein the nonlinear processing function is selected based on the parameters, wherein a first nonlinear processing function of the plurality of nonlinear processing functions is selected in response to determining that the parameters satisfy a first condition, and wherein a second nonlinear processing function of the plurality of nonlinear processing functions is selected in response to determining that the parameters satisfy a second condition. 29.根据权利要求28所述的设备,其中与所述帧相关联的所述参数为经选择以编码所述低频带信号的写码模式、所述帧的周期性、所述帧中非周期性噪声的量及对应于所述帧的频谱倾斜中的一者。29. The device of claim 28, wherein the parameter associated with the frame is one of a coding mode selected to encode the low-frequency signal, the periodicity of the frame, the amount of non-periodic noise in the frame, and the spectral tilt corresponding to the frame. 30.根据权利要求21所述的设备,其中所述多个非线性处理函数包括低阶幂函数及高阶幂函数,且其中所述至少一个调整参数对应于与所述高频带信号相关联的至少一个增益调整参数。30. The device of claim 21, wherein the plurality of nonlinear processing functions include low-order power functions and high-order power functions, and wherein the at least one adjustment parameter corresponds to at least one gain adjustment parameter associated with the high-frequency band signal. 31.根据权利要求21所述的设备,其中所述处理器集成到编码器系统中。31. The device of claim 21, wherein the processor is integrated into the encoder system. 32.根据权利要求21所述的设备,进一步包括:32. The device according to claim 21, further comprising: 天线;以及Antenna; and 接收器,其耦合到所述天线且经配置以接收对应于所述输入音频信号的信号。A receiver coupled to the antenna and configured to receive a signal corresponding to the input audio signal. 33.根据权利要求32所述的设备,其中所述处理器、所述存储器、所述接收器和所述天线集成到移动通信装置。33. The device of claim 32, wherein the processor, the memory, the receiver, and the antenna are integrated into a mobile communication device. 34.根据权利要求32所述的设备,其中所述处理器、所述存储器、所述接收器和所述天线集成到固定位置数据单元。34. The device of claim 32, wherein the processor, the memory, the receiver, and the antenna are integrated into a fixed-position data unit. 35.一种用于音频信号的谐波带宽扩展的设备,其包含:35. A device for harmonic bandwidth extension of an audio signal, comprising: 存储器;及Memory; and 处理器,其经配置以进行以下操作:A processor configured to perform the following operations: 接收对应于输入音频信号的至少低频带信号的低频带数据;Receive low-frequency data corresponding to at least a low-frequency signal of the input audio signal; 解码所述低频带数据以产生合成低频带音频信号;Decode the low-frequency data to generate a synthetic low-frequency audio signal; 确定所述低频带信号的特性;Determine the characteristics of the low-frequency band signal; 基于所述特性选择多个非线性处理函数中的非线性处理函数;及Based on the aforementioned characteristics, a nonlinear processing function is selected from among multiple nonlinear processing functions; and 基于所述合成低频带音频信号及所述非线性处理函数产生合成高频带音频信号。A synthesized high-frequency audio signal is generated based on the synthesized low-frequency audio signal and the nonlinear processing function. 36.根据权利要求35所述的设备,其中所述处理器进一步经配置以经由组合所述合成低频带音频信号及所述合成高频带音频信号来产生输出音频信号,且其中所述输出音频信号的第一带宽大于所述合成低频带音频信号的第二带宽。36. The device of claim 35, wherein the processor is further configured to generate an output audio signal by combining the synthesized low-frequency audio signal and the synthesized high-frequency audio signal, and wherein a first bandwidth of the output audio signal is greater than a second bandwidth of the synthesized low-frequency audio signal. 37.根据权利要求35所述的设备,其中所述处理器经进一步配置以经由混合噪声信号及第二扩展信号来产生第一扩展信号,且其中基于所述第一扩展信号及至少一个调整参数产生所述合成高频带音频信号。37. The apparatus of claim 35, wherein the processor is further configured to generate a first extended signal via a mixed noise signal and a second extended signal, and wherein the synthesized high-frequency audio signal is generated based on the first extended signal and at least one adjustment parameter. 38.根据权利要求37所述的设备,其中第一比例的所述第二扩展信号及第二比例的所述噪声信号经混合,且其中所述第一比例及所述第二比例是基于所接收的谐波性参数或所述低频带数据中的至少一者确定。38. The device of claim 37, wherein the first proportion of the second extended signal and the second proportion of the noise signal are mixed, and wherein the first proportion and the second proportion are determined based on at least one of the received harmonic parameters or the low-frequency band data. 39.根据权利要求37所述的设备,其中所述合成高频带音频信号是经由按与所述至少一个调整参数相关联的因子来按比例缩放所述第一扩展信号来产生。39. The device of claim 37, wherein the synthesized high-frequency band audio signal is generated by scaling the first extended signal by a factor associated with the at least one adjustment parameter. 40.根据权利要求37所述的设备,其中所述处理器经进一步配置以经由对第三扩展信号进行滤波来产生所述第二扩展信号,且其中所述第二扩展信号对应于高频带频率范围。40. The device of claim 37, wherein the processor is further configured to generate the second extended signal by filtering the third extended signal, and wherein the second extended signal corresponds to a high-frequency band range. 41.根据权利要求37所述的设备,其中所述第二扩展信号是经由将线性变换应用于第三扩展信号及选择对应于高频带频率范围的变换系数来产生。41. The device of claim 37, wherein the second extended signal is generated by applying a linear transformation to the third extended signal and selecting transformation coefficients corresponding to the high-frequency band. 42.根据权利要求41所述的设备,其中所述线性变换对应于离散余弦变换。42. The device of claim 41, wherein the linear transformation corresponds to the discrete cosine transform. 43.根据权利要求41所述的设备,其中所述处理器经进一步配置以基于所述合成低频带音频信号及所述非线性处理函数产生所述第三扩展信号。43. The device of claim 41, wherein the processor is further configured to generate the third extended signal based on the synthesized low-frequency audio signal and the nonlinear processing function. 44.根据权利要求35所述的设备,其中所述处理器经进一步配置以基于所接收的参数或所述低频带数据选择所述非线性处理函数。44. The device of claim 35, wherein the processor is further configured to select the nonlinear processing function based on the received parameters or the low-frequency data. 45.根据权利要求35所述的设备,其中所述处理器集成到包括解码器系统的移动装置中。45. The device of claim 35, wherein the processor is integrated into a mobile device including a decoder system. 46.一种用于音频信号的谐波带宽扩展的设备,其包含:46. A device for harmonic bandwidth extension of an audio signal, comprising: 用于将输入音频信号分成至少低频带信号及高频带信号的装置,所述低频带信号对应于低频带频率范围且所述高频带信号对应于高频带频率范围;A device for dividing an input audio signal into at least a low-frequency band signal and a high-frequency band signal, wherein the low-frequency band signal corresponds to a low-frequency band frequency range and the high-frequency band signal corresponds to a high-frequency band frequency range; 用于确定所述低频带信号的特性的装置;A device for determining the characteristics of the low-frequency band signal; 用于基于所述特性选择多个非线性处理函数中的非线性处理函数的装置;A means for selecting a nonlinear processing function from a plurality of nonlinear processing functions based on the aforementioned characteristics; 用于基于所述低频带信号及所述非线性处理函数产生第一扩展信号的第一装置;及A first device for generating a first extended signal based on the low-frequency band signal and the nonlinear processing function; and 用于基于所述第一扩展信号、所述高频带信号或两者产生至少一个调整参数的第二装置。A second means for generating at least one adjustment parameter based on the first extended signal, the high-frequency band signal, or both. 47.根据权利要求46所述的设备,其中所述用于选择的装置经配置以在用于分离的所述装置处接收到所述输入音频信号之后选择所述非线性处理函数,其中所述第一扩展信号是经由混合噪声信号及第二扩展信号来产生,且其中所述至少一个调整参数是基于所述第一扩展信号及所述高频带信号确定。47. The device of claim 46, wherein the means for selection is configured to select the nonlinear processing function after receiving the input audio signal at the means for separation, wherein the first extended signal is generated via a mixed noise signal and a second extended signal, and wherein the at least one adjustment parameter is determined based on the first extended signal and the high-frequency band signal. 48.根据权利要求47所述的设备,其中第一比例的所述噪声信号及第二比例的所述第二扩展信号经混合,且其中所述第一比例及所述第二比例是基于所述低频带信号、所述高频带信号或所述输入音频信号中的至少一者的谐波性确定。48. The device of claim 47, wherein the noise signal of the first proportion and the second extended signal of the second proportion are mixed, and wherein the first proportion and the second proportion are determined based on the harmonicity of at least one of the low-frequency signal, the high-frequency signal, or the input audio signal. 49.根据权利要求46所述的设备,其中用于确定的装置、用于选择的装置、用于产生的所述第一装置和用于产生的所述第二装置集成到移动装置中。49. The device of claim 46, wherein the means for determining, the means for selecting, the first means for generating, and the second means for generating are integrated into the mobile device. 50.一种用于音频信号的谐波带宽扩展的设备,其包含:50. A device for harmonic bandwidth extension of an audio signal, comprising: 用于接收对应于输入音频信号的至少低频带信号的低频带数据的装置;A means for receiving low-frequency data corresponding to at least a low-frequency signal of an input audio signal; 用于解码所述低频带数据以产生合成低频带音频信号的装置;A means for decoding the low-frequency data to generate a synthetic low-frequency audio signal; 用于确定所述低频带信号的特性的装置;A device for determining the characteristics of the low-frequency band signal; 用于基于所述特性选择多个非线性处理函数中的非线性处理函数的装置;及A means for selecting a nonlinear processing function from a plurality of nonlinear processing functions based on the aforementioned characteristics; and 用于基于所述合成低频带音频信号及所述非线性处理函数产生合成高频带音频信号的装置。Apparatus for generating a synthesized high-frequency audio signal based on the synthesized low-frequency audio signal and the nonlinear processing function. 51.根据权利要求50所述的设备,其中所述低频带数据指示所述低频带信号的特性。51. The device of claim 50, wherein the low-frequency data indicates the characteristics of the low-frequency signal. 52.根据权利要求50所述的设备,其中所述合成高频带音频信号经由按与所述至少一个调整参数相关联的因子来按比例缩放第一扩展信号来产生。52. The apparatus of claim 50, wherein the synthesized high-frequency band audio signal is generated by scaling a first extended signal by a factor associated with the at least one adjustment parameter. 53.根据权利要求50所述的设备,其中用于确定的装置、用于选择的装置和用于产生的装置集成到通信移动装置中。53. The device of claim 50, wherein the means for determining, the means for selecting, and the means for generating are integrated into the communication mobile device. 54.根据权利要求50所述的设备,其中用于确定的装置、用于选择的装置和用于产生的装置集成到固定位置数据单元中。54. The device of claim 50, wherein the means for determining, the means for selecting, and the means for generating are integrated into a fixed-position data unit. 55.一种计算机可读存储装置,其存储当由处理器执行时引起所述处理器执行包含以下各者的操作的指令:55. A computer-readable storage device storing instructions that, when executed by a processor, cause the processor to perform operations comprising: 将输入音频信号分成至少低频带信号及高频带信号,所述低频带信号对应于低频带频率范围且所述高频带信号对应于高频带频率范围;The input audio signal is divided into at least a low-frequency band signal and a high-frequency band signal, wherein the low-frequency band signal corresponds to a low-frequency band frequency range and the high-frequency band signal corresponds to a high-frequency band frequency range. 确定所述低频带信号的特性;Determine the characteristics of the low-frequency band signal; 基于所述特性选择多个非线性处理函数中的非线性处理函数;Based on the aforementioned characteristics, a nonlinear processing function is selected from among multiple nonlinear processing functions; 基于所述低频带信号及所述非线性处理函数产生第一扩展信号;及A first extended signal is generated based on the low-frequency band signal and the nonlinear processing function; and 基于所述第一扩展信号、所述高频带信号或两者产生至少一个调整参数。At least one adjustment parameter is generated based on the first extended signal, the high-frequency band signal, or both. 56.根据权利要求55所述的计算机可读存储装置,其中所述非线性处理函数是在所述输入音频信号经分成至少所述低频带信号及所述高频带信号之后选择的,其中所述第一扩展信号是经由混合噪声信号及第二扩展信号来产生,且其中所述至少一个调整参数是基于所述第一扩展信号及所述高频带信号确定。56. The computer-readable storage device of claim 55, wherein the nonlinear processing function is selected after the input audio signal is split into at least the low-frequency band signal and the high-frequency band signal, wherein the first extended signal is generated via a mixed noise signal and a second extended signal, and wherein the at least one adjustment parameter is determined based on the first extended signal and the high-frequency band signal. 57.根据权利要求56所述的计算机可读存储装置,其中所述操作进一步包含:57. The computer-readable storage device of claim 56, wherein the operation further comprises: 经由对第三扩展信号进行滤波来产生所述第二扩展信号,其中所述第二扩展信号的带宽对应于所述高频带频率范围;及The second extended signal is generated by filtering the third extended signal, wherein the bandwidth of the second extended signal corresponds to the high-frequency band range; and 经由将所述非线性处理函数应用于所述低频带信号来产生所述第三扩展信号。The third extended signal is generated by applying the nonlinear processing function to the low-frequency signal. 58.一种计算机可读存储装置,其存储当由处理器执行时引起所述处理器执行包含以下各者的操作的指令:58. A computer-readable storage device storing instructions that, when executed by a processor, cause the processor to perform operations comprising: 接收对应于输入音频信号的至少低频带信号的低频带数据;Receive low-frequency data corresponding to at least a low-frequency signal of the input audio signal; 解码所述低频带数据以产生合成低频带音频信号;Decode the low-frequency data to generate a synthetic low-frequency audio signal; 确定所述低频带信号的特性;Determine the characteristics of the low-frequency band signal; 基于所述特性选择多个非线性处理函数中的非线性处理函数;及Based on the aforementioned characteristics, a nonlinear processing function is selected from among multiple nonlinear processing functions; and 基于所述合成低频带音频信号及所述非线性处理函数产生合成高频带音频信号。A synthesized high-frequency audio signal is generated based on the synthesized low-frequency audio signal and the nonlinear processing function. 59.根据权利要求58所述的计算机可读存储装置,其中所述操作进一步包含确定与所述输入音频信号的帧相关联的参数,其中基于所述参数选择所述非线性处理函数。59. The computer-readable storage device of claim 58, wherein the operation further comprises determining parameters associated with frames of the input audio signal, wherein the nonlinear processing function is selected based on the parameters.
HK16112741.9A 2014-02-13 2015-02-10 Harmonic bandwidth extension of audio signals HK1224795B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US61/939,585 2014-02-13
US14/617,524 2015-02-09

Publications (2)

Publication Number Publication Date
HK1224795A1 HK1224795A1 (en) 2017-08-25
HK1224795B true HK1224795B (en) 2020-08-14

Family

ID=

Similar Documents

Publication Publication Date Title
CN105981102B (en) Harmonic Bandwidth Extension of Audio Signals
CN106256000B (en) High frequency band excitation signal generation
KR101941755B1 (en) Estimation of mixing factors to generate high-band excitation signal
CN106463135B (en) Decoding of high-band signals using mismatched frequency ranges
US20150149157A1 (en) Frequency domain gain shape estimation
JP6258522B2 (en) Apparatus and method for switching coding technique in device
HK1224795B (en) Harmonic bandwidth extension of audio signals
HK1224795A1 (en) Harmonic bandwidth extension of audio signals
HK40027892B (en) High-band signal modeling
HK1220033B (en) Method and apparatus for signal processing
HK1219344B (en) Method and apparatus for signal processing
HK1227164B (en) High band excitation signal generation
HK1211377B (en) Systems and methods of performing filtering for gain determination