[go: up one dir, main page]

CN113971958A - Method and device for eliminating echo, audio and video terminal and conference terminal - Google Patents

Method and device for eliminating echo, audio and video terminal and conference terminal Download PDF

Info

Publication number
CN113971958A
CN113971958A CN202010716771.6A CN202010716771A CN113971958A CN 113971958 A CN113971958 A CN 113971958A CN 202010716771 A CN202010716771 A CN 202010716771A CN 113971958 A CN113971958 A CN 113971958A
Authority
CN
China
Prior art keywords
signal
microphone
echo
adaptive filtering
far
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010716771.6A
Other languages
Chinese (zh)
Other versions
CN113971958B (en
Inventor
杜秉聰
冯津伟
李新国
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Group Holding Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN202010716771.6A priority Critical patent/CN113971958B/en
Publication of CN113971958A publication Critical patent/CN113971958A/en
Application granted granted Critical
Publication of CN113971958B publication Critical patent/CN113971958B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208Noise filtering
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M9/00Arrangements for interconnection not involving centralised switching
    • H04M9/08Two-way loud-speaking telephone systems with means for conditioning the signal, e.g. for suppressing echoes for one or both directions of traffic
    • H04M9/082Two-way loud-speaking telephone systems with means for conditioning the signal, e.g. for suppressing echoes for one or both directions of traffic using echo cancellers
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208Noise filtering
    • G10L2021/02082Noise filtering the noise being echo, reverberation of the speech

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computational Linguistics (AREA)
  • Quality & Reliability (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Telephone Function (AREA)
  • Cable Transmission Systems, Equalization Of Radio And Reduction Of Echo (AREA)

Abstract

The embodiment of the application removes the estimated echo signal from the microphone signal collected by the call microphone through adaptive filtering processing by two stages of adaptive filtering processing, namely, the first stage takes a far-end signal as a reference signal, so that the effect of linear elimination is achieved; and in the second stage, the collected signal collected by the microphone and played by the loudspeaker is used as a reference signal, and the nonlinear distortion signal is subtracted from the microphone signal collected by the call microphone through nonlinear adaptive filtering processing, so that the nonlinear elimination effect is achieved. The device for eliminating the echo improves the problem of performance degradation caused by nonlinear distortion to echo elimination, and well improves the call quality.

Description

一种消除回声的方法及装置和音视频终端及会议终端A method and device for eliminating echo, audio and video terminal and conference terminal

技术领域technical field

本申请涉及但不限于电子技术领域,尤指一种消除回声的方法及装置和音视频终端及会议终端。The present application relates to, but is not limited to, the field of electronic technology, and more particularly, to a method and apparatus for eliminating echo, an audio-video terminal, and a conference terminal.

背景技术Background technique

在通话场景中,远端语音信号经过网路传输到近端设备,会透过扬声器播放出来,而麦克风会拾取扬声器播放的声音(这部分声音称为回声信号),使得回声信号再传回到远端设备,使得远端用户从扬声器中听到自己的声音,这样,大大降低了通话质量。In the call scenario, the far-end voice signal is transmitted to the near-end device through the network, and will be played through the speaker, and the microphone will pick up the sound played by the speaker (this part of the sound is called the echo signal), so that the echo signal is transmitted back to the The far-end device allows the far-end user to hear their own voice from the speaker, which greatly reduces the call quality.

相关技术中,为了消除回声,在通信过程中会将用于发送至扬声器的远端语音信号作为参考信号,对近端语音信号进行回声消除。In the related art, in order to cancel the echo, the far-end voice signal for sending to the speaker is used as a reference signal during the communication process, and the echo of the near-end voice signal is canceled.

由于扬声器与声学结构设计的不良,设备播放语音信号时容易产生非线性失真,而麦克风拾取到的这类非线性失真信号是作为参考信号的远端信号中不包含的,也就是说,相关技术中的回声消除方案是无法对这部分干扰信号进行处理的,非线性成份会残留下来,从而影响了通话质量。Due to the poor design of the loudspeaker and acoustic structure, nonlinear distortion is easily generated when the device plays the voice signal, and such nonlinear distortion signal picked up by the microphone is not included in the far-end signal used as the reference signal. That is to say, the related art The echo cancellation scheme in , cannot process this part of the interference signal, and the nonlinear components will remain, thus affecting the call quality.

发明内容SUMMARY OF THE INVENTION

本申请提供一种消除回声的方法及装置和音视频终端及会议终端,能够提升通话质量。The present application provides a method and device for eliminating echo, an audio and video terminal, and a conference terminal, which can improve call quality.

本发明实施例提供了一种消除回声的装置,包括:扬声器、通话麦克风、采集麦克风、第一处理模块、第二处理模块;其中,An embodiment of the present invention provides an echo cancellation device, including: a speaker, a microphone for a call, a microphone for collection, a first processing module, and a second processing module; wherein,

扬声器,设置为接收并播放来自远端的远端语音信号,产生回声信号;The loudspeaker is set to receive and play the far-end voice signal from the far-end to generate an echo signal;

采集麦克风,设置为采集扬声器播放的信号获得采集信号;Collect the microphone, and set it to collect the signal played by the speaker to obtain the collected signal;

通话麦克风,设置为拾取回声信号、近端人声信号以及噪音信号,得到麦克风信号;The call microphone is set to pick up the echo signal, the near-end vocal signal and the noise signal to obtain the microphone signal;

第一处理模块,设置为根据远端语音信号对麦克风信号进行自适应滤波处理;a first processing module, configured to perform adaptive filtering processing on the microphone signal according to the far-end voice signal;

第二处理模块,设置为根据采集信号,对自适应滤波处理后的中间信号进行非线性自适应滤波处理,生成回声消除后的语音信号。The second processing module is configured to perform nonlinear adaptive filtering processing on the intermediate signal after the adaptive filtering processing according to the collected signal, so as to generate a voice signal after echo cancellation.

在一种示例性实例中,所述第一处理模块包括:自适应滤波器、第一叠加器;其中,In an exemplary example, the first processing module includes: an adaptive filter, a first stacker; wherein,

自适应滤波器,设置为对输入的所述远端语音信号进行计算得到第一模拟回声信号;an adaptive filter, configured to calculate the inputted far-end voice signal to obtain a first analog echo signal;

第一叠加器,设置为对所述麦克风信号和第一模拟回声信号进行叠加处理,得到中间信号。The first superimator is configured to perform superposition processing on the microphone signal and the first analog echo signal to obtain an intermediate signal.

在一种示例性实例中,所述第二处理模块包括:非线性自适应滤波器、第二叠加器;其中,In an exemplary example, the second processing module includes: a nonlinear adaptive filter, a second stacker; wherein,

非线性自适应滤波器,设置为对输入的所述采集信号进行计算得到第二模拟回声信号;a nonlinear adaptive filter, configured to calculate the inputted collected signal to obtain a second analog echo signal;

第二叠加器,设置为对所述中间信号和第二模拟回声信号进行叠加处理,得到所述语音信号。The second stacker is configured to perform superposition processing on the intermediate signal and the second analog echo signal to obtain the voice signal.

在一种示例性实例中,所述采集麦克风设置在靠近所述扬声器的任意位置。In an illustrative example, the acquisition microphone is located anywhere near the speaker.

本申请实施例还提供一种音视频终端,包括上述任一项所述的消除回声的装置。Embodiments of the present application further provide an audio and video terminal, including the echo cancellation apparatus described in any one of the above.

本申请实施例又提供了一种消除回声的方法,包括:The embodiment of the present application further provides a method for eliminating echo, including:

根据远端语音信号产生回声信号;Generate an echo signal according to the far-end voice signal;

获取通话麦克风拾取的回声信号、近端人声信号以及噪音信号,得到麦克风信号;Acquire the echo signal, near-end vocal signal and noise signal picked up by the call microphone to obtain the microphone signal;

根据远端语音信号对麦克风信号进行自适应滤波处理,实现线性回声消除;Adaptive filtering is performed on the microphone signal according to the far-end voice signal to achieve linear echo cancellation;

获取利用采集麦克风采集的采集扬声器播放的采集信号;Obtain the acquisition signal played by the acquisition speaker collected by the acquisition microphone;

根据采集信号对自适应滤波处理后的信号进行非线性自适应滤波处理,生成回声消除后的语音信号,实现非线性回声消除。According to the acquired signal, nonlinear adaptive filtering is performed on the signal processed by the adaptive filtering to generate a voice signal after echo cancellation, so as to realize nonlinear echo cancellation.

在一种示例性实例中,所述根据远端语音信号对麦克风信号进行自适应滤波处理,包括:In an exemplary example, the adaptive filtering processing on the microphone signal according to the far-end speech signal includes:

对所述远端语音信号进行自适应滤波计算得到第一模拟回声信号;Adaptive filtering is performed on the far-end speech signal to obtain a first analog echo signal;

叠加所述麦克风信号和第一模拟回声信号,得到中间信号。The microphone signal and the first analog echo signal are superimposed to obtain an intermediate signal.

在一种示例性实例中,所述根据采集信号对自适应滤波处理后的信号进行非线性自适应滤波处理,包括:In an exemplary example, performing nonlinear adaptive filtering processing on the signal after adaptive filtering according to the acquired signal includes:

对所述采集信号进行非线性自适应滤波计算得到第二模拟回声信号;Performing nonlinear adaptive filtering calculation on the collected signal to obtain a second analog echo signal;

叠加所述中间信号和第二模拟回声信号,得到所述语音信号。The voice signal is obtained by superimposing the intermediate signal and the second analog echo signal.

本申请实施例还提供一种计算机可读存储介质,存储有计算机可执行指令,所述计算机可执行指令用于执行上述任一项所述的消除回声的方法。Embodiments of the present application further provide a computer-readable storage medium storing computer-executable instructions, where the computer-executable instructions are used to execute any of the echo cancellation methods described above.

本申请实施例还提供一种消除回声的设备,包括存储器和处理器,其中,存储器中存储有以下可被处理器执行的指令:用于执行上述任一项所述的消除回声的方法的步骤。An embodiment of the present application further provides an echo cancellation device, including a memory and a processor, wherein the memory stores the following instructions executable by the processor: for executing the steps of the echo cancellation method described in any of the above .

本申请实施例还提供了一种消除非线性回声的方法,包括:The embodiment of the present application also provides a method for eliminating nonlinear echo, including:

根据远端语音信号对麦克风信号进行自适应滤波处理;Perform adaptive filtering processing on the microphone signal according to the far-end voice signal;

根据采集到的扬声器播放的采集信号,对自适应滤波处理后的信号进行非线性自适应滤波处理,生成回声消除后的语音信号。According to the collected signal played by the collected loudspeaker, nonlinear adaptive filtering is performed on the signal after adaptive filtering to generate a voice signal after echo cancellation.

在一种示例性实例中,所述对麦克风信号进行自适应滤波处理,包括:In an exemplary example, the adaptive filtering process on the microphone signal includes:

对所述远端语音信号进行自适应滤波计算得到第一模拟回声信号;Adaptive filtering is performed on the far-end speech signal to obtain a first analog echo signal;

叠加所述麦克风信号和第一模拟回声信号,得到中间信号。The microphone signal and the first analog echo signal are superimposed to obtain an intermediate signal.

在一种示例性实例中,所述对自适应滤波处理后的信号进行非线性自适应滤波处理,包括:In an exemplary example, performing nonlinear adaptive filtering processing on the signal after adaptive filtering includes:

对所述采集信号进行非线性自适应滤波计算得到第二模拟回声信号;Performing nonlinear adaptive filtering calculation on the collected signal to obtain a second analog echo signal;

叠加所述中间信号和第二模拟回声信号,得到所述语音信号。The voice signal is obtained by superimposing the intermediate signal and the second analog echo signal.

在一种示例性实例中,所述对自适应滤波处理后的信号进行非线性自适应滤波处理之前,还包括:In an exemplary example, before performing the nonlinear adaptive filtering processing on the signal processed by the adaptive filtering, the method further includes:

通过设置在靠近所述扬声器的采集麦克风采集所述采集信号。The acquisition signal is acquired by a acquisition microphone disposed close to the speaker.

本申请实施例在提供了一种会议终端,包括:扬声器、通话麦克风、采集麦克风、自适应滤波器、非线性自适应滤波器、第一叠加器,以及第二叠加器;其中,An embodiment of the present application provides a conference terminal, including: a speaker, a microphone for a call, a microphone for acquisition, an adaptive filter, a nonlinear adaptive filter, a first superimposed, and a second superimposed; wherein,

扬声器,设置为播放来自远端会议终端的远端语音信号;A loudspeaker, set to play the far-end voice signal from the far-end conference terminal;

通话麦克风,设置为拾取回声信号、近端人声信号以及噪音信号,得到麦克风信号;The call microphone is set to pick up the echo signal, the near-end vocal signal and the noise signal to obtain the microphone signal;

自适应滤波器,设置为对输入的远端语音信号进行计算得到第一模拟回声信号;an adaptive filter, configured to calculate the input far-end voice signal to obtain a first analog echo signal;

第一叠加器,设置为对麦克风信号和第一模拟回声信号进行叠加处理,得到中间信号;a first stacker, configured to perform stacking processing on the microphone signal and the first analog echo signal to obtain an intermediate signal;

采集麦克风,设置为采集扬声器播放的信号,得到采集信号;Collect the microphone, set it to collect the signal played by the speaker, and obtain the collected signal;

非线性自适应滤波器,设置为对输入的采集信号进行计算得到第二模拟回声信号;The nonlinear adaptive filter is set to calculate the input acquisition signal to obtain the second analog echo signal;

第二叠加器,设置为对中间信号和第二模拟回声信号进行叠加处理,得到语音信号。The second stacker is configured to perform stacking processing on the intermediate signal and the second analog echo signal to obtain a speech signal.

本申请实施例通过两级自适应滤波处理有效地实现对回声的消除:第一级包括:以远端信号作为参考信号,经过自适应滤波处理从通话麦克风采集到的麦克风信号中去除估计到的回声信号,达到了线性消除的效果;第二级包括:以采集麦克风的采集到的扬声器播放的采集信号作为参考信号,经过非线性自适应滤波处理从通话麦克风采集到的麦克风信号中减去估计到的非线性失真信号,达到了非线性消除的效果。通过本申请消除回声的装置改善了非线性失真给回声消除带来的性能下降的问题,很好地提升了通话质量。The embodiment of the present application effectively implements echo cancellation through two-stage adaptive filtering processing: the first stage includes: taking the far-end signal as a reference signal, and removing the estimated value from the microphone signal collected by the talking microphone through adaptive filtering processing The echo signal achieves the effect of linear cancellation; the second stage includes: taking the acquisition signal played by the speaker collected by the acquisition microphone as the reference signal, and subtracting the estimated value from the microphone signal acquired by the call microphone through nonlinear adaptive filtering processing The obtained nonlinear distortion signal achieves the effect of nonlinear elimination. The apparatus for eliminating echo of the present application improves the problem of performance degradation caused by nonlinear distortion in echo cancellation, and greatly improves call quality.

本发明的其它特征和优点将在随后的说明书中阐述,并且,部分地从说明书中变得显而易见,或者通过实施本发明而了解。本发明的目的和其他优点可通过在说明书、权利要求书以及附图中所特别指出的结构来实现和获得。Other features and advantages of the present invention will be set forth in the description which follows, and in part will be apparent from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention may be realized and attained by the structure particularly pointed out in the description, claims and drawings.

附图说明Description of drawings

附图用来提供对本申请技术方案的进一步理解,并且构成说明书的一部分,与本申请的实施例一起用于解释本申请的技术方案,并不构成对本申请技术方案的限制。The accompanying drawings are used to provide a further understanding of the technical solutions of the present application, and constitute a part of the specification. They are used to explain the technical solutions of the present application together with the embodiments of the present application, and do not constitute a limitation on the technical solutions of the present application.

图1为本申请消除回声的方法的流程示意图;1 is a schematic flowchart of a method for eliminating echo in the present application;

图2为本申请自适应滤波处理的实施例的结构示意图;FIG. 2 is a schematic structural diagram of an embodiment of adaptive filtering processing of the present application;

图3为本申请非线性自适应滤波处理的实施例的结构示意图;FIG. 3 is a schematic structural diagram of an embodiment of nonlinear adaptive filtering processing of the present application;

图4为本申请消除回声的装置的组成结构示意图;FIG. 4 is a schematic diagram of the composition structure of the apparatus for eliminating echo of the present application;

图5为本申请消除回声的实施例的结构示意图;FIG. 5 is a schematic structural diagram of an embodiment of the application for echo cancellation;

图6为本申请会议终端的实施例的组成结构示意图。FIG. 6 is a schematic diagram of the composition and structure of an embodiment of a conference terminal of the present application.

具体实施方式Detailed ways

为使本申请的目的、技术方案和优点更加清楚明白,下文中将结合附图对本申请的实施例进行详细说明。需要说明的是,在不冲突的情况下,本申请中的实施例及实施例中的特征可以相互任意组合。In order to make the objectives, technical solutions and advantages of the present application clearer, the embodiments of the present application will be described in detail below with reference to the accompanying drawings. It should be noted that, the embodiments in the present application and the features in the embodiments may be arbitrarily combined with each other if there is no conflict.

在本申请一个典型的配置中,计算设备包括一个或多个处理器(CPU)、输入/输出接口、网络接口和内存。In a typical configuration of the present application, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

内存可能包括计算机可读介质中的非永久性存储器,随机存取存储器(RAM)和/或非易失性内存等形式,如只读存储器(ROM)或闪存(flash RAM)。内存是计算机可读介质的示例。Memory may include non-persistent memory in computer readable media, random access memory (RAM) and/or non-volatile memory in the form of, for example, read only memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.

计算机可读介质包括永久性和非永久性、可移动和非可移动媒体可以由任何方法或技术来实现信息存储。信息可以是计算机可读指令、数据结构、程序的模块或其他数据。计算机的存储介质的例子包括,但不限于相变内存(PRAM)、静态随机存取存储器(SRAM)、动态随机存取存储器(DRAM)、其他类型的随机存取存储器(RAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、快闪记忆体或其他内存技术、只读光盘只读存储器(CD-ROM)、数字多功能光盘(DVD)或其他光学存储、磁盒式磁带,磁带磁盘存储或其他磁性存储设备或任何其他非传输介质,可用于存储可以被计算设备访问的信息。按照本文中的界定,计算机可读介质不包括非暂存电脑可读媒体(transitory media),如调制的数据信号和载波。Computer-readable media includes both persistent and non-permanent, removable and non-removable media, and storage of information may be implemented by any method or technology. Information may be computer readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), Flash Memory or other memory technology, Compact Disc Read Only Memory (CD-ROM), Digital Versatile Disc (DVD) or other optical storage, Magnetic tape cartridges, magnetic tape disk storage or other magnetic storage devices or any other non-transmission medium that can be used to store information that can be accessed by a computing device. Computer-readable media, as defined herein, excludes non-transitory computer-readable media, such as modulated data signals and carrier waves.

在附图的流程图示出的步骤可以在诸如一组计算机可执行指令的计算机系统中执行。并且,虽然在流程图中示出了逻辑顺序,但是在某些情况下,可以以不同于此处的顺序执行所示出或描述的步骤。The steps shown in the flowcharts of the figures may be performed in a computer system, such as a set of computer-executable instructions. Also, although a logical order is shown in the flowcharts, in some cases the steps shown or described may be performed in an order different from that herein.

图1为本申请消除回声的方法的流程示意图,如图1所示,包括:FIG. 1 is a schematic flowchart of the method for eliminating echo of the present application, as shown in FIG. 1 , including:

步骤100:根据远端语音信号对麦克风信号进行自适应滤波处理。Step 100: Perform adaptive filtering processing on the microphone signal according to the far-end speech signal.

在一种示例性实例中,本步骤可以包括:In an illustrative example, this step may include:

对远端语音信号进行自适应滤波计算得到第一模拟回声信号;Adaptive filtering is performed on the far-end speech signal to obtain a first analog echo signal;

叠加麦克风信号和第一模拟回声信号,得到中间信号。Superimpose the microphone signal and the first analog echo signal to obtain an intermediate signal.

图2为本申请自适应滤波处理的实施例的结构示意图,如图2所示,远端语音信号x(n)为经过网路从远端设备传输到近端设备的信号;麦克风信号y(n)为近端输入通话麦克风的信号,麦克风信号y(n)包括近端人声信号、回声信号、噪音信号等;远端语音信号x(n)输入自适应滤波器,经过自适应滤波器的计算得到第一模拟回声信号,信号e(n)为经过自适应滤波处理后的信号,信号e(n)等于麦克风信号y(n)与第一模拟回声信号的差值。FIG. 2 is a schematic structural diagram of an embodiment of adaptive filtering processing of the present application. As shown in FIG. 2, the far-end voice signal x(n) is the signal transmitted from the far-end device to the near-end device through the network; the microphone signal y( n) is the signal of the near-end input call microphone, the microphone signal y(n) includes the near-end human voice signal, echo signal, noise signal, etc.; the far-end speech signal x(n) is input to the adaptive filter, after the adaptive filter The first analog echo signal is obtained by the calculation of , and the signal e(n) is the signal after adaptive filtering, and the signal e(n) is equal to the difference between the microphone signal y(n) and the first analog echo signal.

图2所示的自适应滤波处理中,利用远端信号作为参考信号,与麦克风采集到的麦克风信号进行自适应滤波处理估计出回声信号,最终从通话麦克风采集到的麦克风信号中减去估计到的回声信号,达到了线性消除的效果。In the adaptive filtering process shown in Figure 2, the far-end signal is used as a reference signal to perform adaptive filtering processing with the microphone signal collected by the microphone to estimate the echo signal, and finally the estimated echo signal is subtracted from the microphone signal collected by the call microphone. The echo signal has achieved the effect of linear cancellation.

步骤101:根据采集到的扬声器播放的采集信号,对自适应滤波处理后的信号进行非线性自适应滤波处理,生成回声消除后的语音信号。Step 101 : Perform nonlinear adaptive filtering processing on the signal after adaptive filtering according to the collected signal played by the collected speaker, to generate a voice signal after echo cancellation.

在一种示例性实例中,本步骤可以包括:In an illustrative example, this step may include:

对采集信号进行非线性自适应滤波计算得到第二模拟回声信号;Performing nonlinear adaptive filtering calculation on the acquired signal to obtain a second analog echo signal;

叠加中间信号和第二模拟回声信号,得到语音信号。A voice signal is obtained by superimposing the intermediate signal and the second analog echo signal.

图3为本申请非线性自适应滤波处理的实施例的结构示意图,如图3所示,信号e(n)为经过如图2所示的自适应滤波处理后的信号;采集信号r(n)为设置在靠近扬声器的任意位置的采集麦克风采集到的扬声器播放的信号;采集信号r(n)输入非线性自适应滤波器,经过非线性自适应滤波器的计算得到第二模拟回声信号;信号e′(n)为经过非线性自适应滤波处理后的信号即回声消除后的语音信号,信号e′(n)等于经过自适应滤波处理后的信号e(n)与第二模拟回声信号的差值。FIG. 3 is a schematic structural diagram of an embodiment of nonlinear adaptive filtering processing of the present application. As shown in FIG. 3 , the signal e(n) is the signal after the adaptive filtering processing as shown in FIG. 2 ; the collected signal r(n) ) is the signal played by the loudspeaker that the acquisition microphone at any position close to the loudspeaker collects; the acquisition signal r(n) is input to a nonlinear adaptive filter, and the second analog echo signal is obtained through the calculation of the nonlinear adaptive filter; The signal e'(n) is the signal processed by nonlinear adaptive filtering, that is, the voice signal after echo cancellation, and the signal e'(n) is equal to the signal e(n) processed by the adaptive filtering and the second analog echo signal difference value.

如果扬声器产生非线性成份,那么,经过如图2所示的自适应滤波处理后的信号e(n)中就会残留非线性失真的成分,此时,利用本申请实施例中的采集麦克风可以拾取到扬声器非线性成份的特性信号,如图3所示,将采集麦克风采集到的采集信号作为参考信号,与经过自适应滤波处理后的信号e(n)进行非线性自适应滤波处理估计非线性失真信号,最终从通话麦克风采集到的麦克风信号中减去估计到的非线性失真信号,达到了非线性消除的效果,改善了非线性失真给回声消除带来的性能下降的问题,更好地提升了通话质量。If the loudspeaker generates nonlinear components, the signal e(n) after adaptive filtering as shown in FIG. 2 will have residual nonlinear distortion components. At this time, the acquisition microphone in the embodiment of the present application can The characteristic signal of the nonlinear component of the speaker is picked up, as shown in Figure 3, the acquisition signal collected by the acquisition microphone is used as the reference signal, and the adaptive filtering signal e(n) is processed by nonlinear adaptive filtering to estimate the non-linearity. Linear distortion signal, and finally the estimated nonlinear distortion signal is subtracted from the microphone signal collected by the call microphone to achieve the effect of nonlinear cancellation, which improves the performance degradation caused by nonlinear distortion to echo cancellation, better improved call quality.

本申请消除回声的方法通过两级自适应滤波处理,即,首先,以远端信号作为参考信号,经过自适应滤波处理从通话麦克风采集到的麦克风信号中去除估计到的回声信号,达到了线性消除的效果;然后,以采集麦克风的采集到的扬声器播放的采集信号作为参考信号,经过非线性自适应滤波处理从通话麦克风采集到的麦克风信号中减去估计到的非线性失真信号,达到了非线性消除的效果。通过本申请消除回声的方法改善了非线性失真给回声消除带来的性能下降的问题,很好地提升了通话质量。The method for eliminating echo of the present application uses two-stage adaptive filtering processing, that is, first, taking the far-end signal as a reference signal, and removing the estimated echo signal from the microphone signal collected by the talking microphone through adaptive filtering processing to achieve linearity. Then, the acquisition signal played by the speaker collected by the acquisition microphone is used as the reference signal, and the estimated nonlinear distortion signal is subtracted from the microphone signal collected by the call microphone through nonlinear adaptive filtering processing. The effect of nonlinear elimination. The method for eliminating echo of the present application improves the problem of performance degradation caused by nonlinear distortion in echo cancellation, and greatly improves call quality.

本申请还提供一种计算机可读存储介质,存储有计算机可执行指令,所述计算机可执行指令用于执行上述任一项的消除回声的方法。The present application also provides a computer-readable storage medium storing computer-executable instructions, where the computer-executable instructions are used to execute any one of the echo cancellation methods described above.

本申请再提供一种消除回声的设备,包括存储器和处理器,其中,存储器中存储有以下可被处理器执行的指令:用于执行上任一项所述的消除回声的方法的步骤。The present application further provides an echo canceling device, including a memory and a processor, wherein the memory stores the following instructions executable by the processor: for executing the steps of the echo canceling method described in any one of the above.

本申请还提供了一种消除回声的方法,包括:The application also provides a method for eliminating echo, including:

根据远端语音信号产生回声信号;Generate an echo signal according to the far-end voice signal;

获取通话麦克风拾取的回声信号、近端人声信号以及噪音信号,得到麦克风信号;Acquire the echo signal, near-end vocal signal and noise signal picked up by the call microphone to obtain the microphone signal;

根据远端语音信号对麦克风信号进行自适应滤波处理,实现线性回声消除;Adaptive filtering is performed on the microphone signal according to the far-end voice signal to achieve linear echo cancellation;

获取采集麦克风采集的采集扬声器播放的采集信号;Obtain the acquisition signal played by the acquisition speaker collected by the acquisition microphone;

根据采集信号对自适应滤波处理后的中间信号进行非线性自适应滤波处理,生成回声消除后的语音信号,实现非线性回声消除。Non-linear adaptive filtering is performed on the intermediate signal after adaptive filtering according to the acquired signal to generate a voice signal after echo cancellation, so as to realize nonlinear echo cancellation.

在一种示例性示例中,根据远端语音信号对麦克风信号进行自适应滤波处理,包括:In an exemplary example, adaptive filtering processing is performed on the microphone signal according to the far-end speech signal, including:

对所述远端语音信号进行自适应滤波计算得到第一模拟回声信号;Adaptive filtering is performed on the far-end speech signal to obtain a first analog echo signal;

叠加所述麦克风信号和第一模拟回声信号,得到中间信号。The microphone signal and the first analog echo signal are superimposed to obtain an intermediate signal.

在一种示例性示例中,根据采集信号对自适应滤波处理后的信号进行非线性自适应滤波处理,包括:In an exemplary example, performing nonlinear adaptive filtering processing on the adaptive filtering signal according to the acquired signal, including:

对所述采集信号进行非线性自适应滤波计算得到第二模拟回声信号;Performing nonlinear adaptive filtering calculation on the collected signal to obtain a second analog echo signal;

叠加所述中间信号和第二模拟回声信号,得到所述语音信号。The voice signal is obtained by superimposing the intermediate signal and the second analog echo signal.

图4为本申请消除回声的装置的组成结构示意图,如图4所示,至少包括:扬声器、通话麦克风、采集麦克风、第一处理模块、第二处理模块;其中,FIG. 4 is a schematic structural diagram of the apparatus for eliminating echo of the present application. As shown in FIG. 4 , it at least includes: a speaker, a talking microphone, a collecting microphone, a first processing module, and a second processing module; wherein,

扬声器,设置为接收并播放来自远端的远端语音信号,产生回声信号;The loudspeaker is set to receive and play the far-end voice signal from the far-end to generate an echo signal;

采集麦克风,设置为采集扬声器播放的信号获得采集信号;Collect the microphone, and set it to collect the signal played by the speaker to obtain the collected signal;

通话麦克风,设置为拾取回声信号、近端人声信号以及噪音信号,得到麦克风信号;The call microphone is set to pick up the echo signal, the near-end vocal signal and the noise signal to obtain the microphone signal;

第一处理模块,设置为根据远端语音信号对麦克风信号进行自适应滤波处理;a first processing module, configured to perform adaptive filtering processing on the microphone signal according to the far-end voice signal;

第二处理模块,设置为根据采集到的采集信号,对自适应滤波处理后的中间信号进行非线性自适应滤波处理,生成回声消除后的语音信号。The second processing module is configured to perform nonlinear adaptive filtering processing on the intermediate signal processed by the adaptive filtering according to the acquired acquisition signal, so as to generate a voice signal after echo cancellation.

在一种示例性实例中,采集麦克风设置在靠近扬声器的任意位置。也就是说,扬声器与采集麦克风之间的距离小于扬声器与通话麦克风之间的距离。In one illustrative example, the acquisition microphone is positioned anywhere near the speaker. That is, the distance between the speaker and the acquisition microphone is smaller than the distance between the speaker and the call microphone.

在一种示例性实例中,如图2中所示,第一处理模块可以包括:自适应滤波器、第一叠加器;其中,In an exemplary example, as shown in FIG. 2 , the first processing module may include: an adaptive filter, a first stacker; wherein,

自适应滤波器,设置为对输入的远端语音信号进行计算得到第一模拟回声信号;an adaptive filter, configured to calculate the input far-end voice signal to obtain a first analog echo signal;

第一叠加器,设置为对麦克风信号和第一模拟回声信号进行叠加处理,得到中间信号。The first stacker is configured to perform stacking processing on the microphone signal and the first analog echo signal to obtain an intermediate signal.

在一种示例性实例中,如图3中所示,第二处理模块可以包括:非线性自适应滤波器、第二叠加器;其中,In an exemplary example, as shown in FIG. 3 , the second processing module may include: a nonlinear adaptive filter, a second stacker; wherein,

非线性自适应滤波器,设置为对输入的采集信号进行计算得到第二模拟回声信号;The nonlinear adaptive filter is set to calculate the input acquisition signal to obtain the second analog echo signal;

第二叠加器,设置为对中间信号和第二模拟回声信号进行叠加处理,得到语音信号。The second stacker is configured to perform stacking processing on the intermediate signal and the second analog echo signal to obtain a speech signal.

本申请消除回声的装置通过两级自适应滤波处理,即,第一级包括:以远端信号作为参考信号,经过自适应滤波处理从通话麦克风采集到的麦克风信号中去除估计到的回声信号,达到了线性消除的效果;第二级包括:以采集麦克风的采集到的扬声器播放的采集信号作为参考信号,经过非线性自适应滤波处理从通话麦克风采集到的麦克风信号中减去估计到的非线性失真信号,达到了非线性消除的效果。通过本申请消除回声的装置改善了非线性失真给回声消除带来的性能下降的问题,很好地提升了通话质量。The apparatus for eliminating echo of the present application uses two-stage adaptive filtering processing, that is, the first stage includes: taking the far-end signal as a reference signal, and removing the estimated echo signal from the microphone signal collected by the talking microphone through adaptive filtering processing, The effect of linear cancellation is achieved; the second stage includes: taking the acquisition signal played by the speaker collected by the acquisition microphone as the reference signal, and subtracting the estimated non-linear signal from the microphone signal acquired by the call microphone through nonlinear adaptive filtering processing. Linear distortion signal, to achieve the effect of nonlinear elimination. The apparatus for eliminating echo of the present application improves the problem of performance degradation caused by nonlinear distortion in echo cancellation, and greatly improves call quality.

图5为本申请消除回声的装置的实施例的结构示意图,如图5所示,本实施例中,远端语音信号x(n)输入近端设备的扬声器后产生回声信号,回声信号和近端人声信号以及噪音信号被近端设备的通话麦克风采集,得到麦克风信号y(n),同时,远端语音信号x(n)输入自适应滤波器,经过自适应滤波器的计算得到第一模拟回声信号x′(n);麦克风信号y(n)与第一模拟回声信号x(n)叠加后,得到减去估计到的回声信号的中间信号e(n);设置在靠近扬声器的采集麦克风拾取扬声器播放的非线性回声部分信号即采集信号r(n),采集信号r(n)输入非线性自适应滤波器,经过非线性自适应滤波器的计算得到第二模拟回声信号r′(n);中间信号e(n)与第二模拟回声信号r′(n)叠加后,得到减去非线性回声部分信号的语音信号e′(n)。通过本实施例,改善了非线性失真给回声消除带来的性能下降的问题,很好地提升了通话质量。FIG. 5 is a schematic structural diagram of an embodiment of the apparatus for eliminating echoes of the present application. As shown in FIG. 5 , in this embodiment, the far-end voice signal x(n) is input to the speaker of the near-end device to generate an echo signal, and the echo signal and the near-end device generate an echo signal. The end human voice signal and noise signal are collected by the call microphone of the near-end device, and the microphone signal y(n) is obtained. At the same time, the far-end voice signal x(n) is input to the adaptive filter, and the first The analog echo signal x'(n); after the microphone signal y(n) is superimposed with the first analog echo signal x ' (n), the intermediate signal e(n) minus the estimated echo signal is obtained; The acquisition microphone picks up the nonlinear echo signal played by the speaker, that is, the acquisition signal r(n), the acquisition signal r(n) is input to the nonlinear adaptive filter, and the second analog echo signal r' is obtained through the calculation of the nonlinear adaptive filter. (n): After the intermediate signal e(n) and the second analog echo signal r'(n) are superimposed, a speech signal e'(n) obtained by subtracting the nonlinear echo signal is obtained. Through this embodiment, the problem of performance degradation caused by nonlinear distortion to echo cancellation is improved, and the call quality is well improved.

本申请实施例还提供一种音视频终端,包括本申请图4所示的任一项消除回声的装置。The embodiment of the present application further provides an audio and video terminal, including any one of the echo cancellation apparatuses shown in FIG. 4 of the present application.

本申请实施例还提供一种会议终端,图6为本申请会议终端的实施例的组成结构示意图,如图6所示,会议终端至少包括:扬声器、通话麦克风、采集麦克风、自适应滤波器、非线性自适应滤波器、第一叠加器,以及第二叠加器;其中,An embodiment of the present application further provides a conference terminal. FIG. 6 is a schematic structural diagram of an embodiment of the conference terminal of the present application. As shown in FIG. 6 , the conference terminal at least includes: a speaker, a microphone for a call, a collection microphone, an adaptive filter, a a nonlinear adaptive filter, a first stacker, and a second stacker; wherein,

扬声器,设置为播放来自远端会议终端的远端语音信号;A loudspeaker, set to play the far-end voice signal from the far-end conference terminal;

通话麦克风,设置为拾取回声信号、近端人声信号以及噪音信号,得到麦克风信号;The call microphone is set to pick up the echo signal, the near-end vocal signal and the noise signal to obtain the microphone signal;

自适应滤波器,设置为对输入的远端语音信号进行计算得到第一模拟回声信号;an adaptive filter, configured to calculate the input far-end voice signal to obtain a first analog echo signal;

第一叠加器,设置为对麦克风信号和第一模拟回声信号进行叠加处理,得到中间信号;a first stacker, configured to perform stacking processing on the microphone signal and the first analog echo signal to obtain an intermediate signal;

采集麦克风,设置为采集扬声器播放的信号,得到采集信号;Collect the microphone, set it to collect the signal played by the speaker, and obtain the collected signal;

非线性自适应滤波器,设置为对输入的采集信号进行计算得到第二模拟回声信号;The nonlinear adaptive filter is set to calculate the input acquisition signal to obtain the second analog echo signal;

第二叠加器,设置为对中间信号和第二模拟回声信号进行叠加处理,得到语音信号。The second stacker is configured to perform stacking processing on the intermediate signal and the second analog echo signal to obtain a speech signal.

在一种示例性实例中,采集麦克风设置在靠近扬声器的任意位置。In one illustrative example, the acquisition microphone is located anywhere near the speaker.

本申请会议终端通过两级自适应滤波处理,即,第一级包括:以远端信号作为参考信号,经过自适应滤波处理从通话麦克风采集到的麦克风信号中去除估计到的回声信号,达到了线性消除的效果;第二级包括:以采集麦克风的采集到的扬声器播放的采集信号作为参考信号,经过非线性自适应滤波处理从通话麦克风采集到的麦克风信号中减去估计到的非线性失真信号,达到了非线性消除的效果。通过本申请会议终端改善了非线性失真给回声消除带来的性能下降的问题,很好地提升了会议通话质量。The conference terminal of the present application undergoes two-stage adaptive filtering processing, that is, the first stage includes: taking the far-end signal as a reference signal, and removing the estimated echo signal from the microphone signal collected by the talking microphone through adaptive filtering processing, to achieve The effect of linear cancellation; the second stage includes: taking the acquisition signal played by the speaker collected by the acquisition microphone as a reference signal, and subtracting the estimated nonlinear distortion from the microphone signal acquired by the call microphone through nonlinear adaptive filtering processing signal to achieve the effect of non-linear cancellation. Through the conference terminal of the present application, the problem of performance degradation caused by nonlinear distortion to echo cancellation is improved, and the quality of conference calls is well improved.

虽然本申请所揭露的实施方式如上,但所述的内容仅为便于理解本申请而采用的实施方式,并非用以限定本申请。任何本申请所属领域内的技术人员,在不脱离本申请所揭露的精神和范围的前提下,可以在实施的形式及细节上进行任何的修改与变化,但本申请的专利保护范围,仍须以所附的权利要求书所界定的范围为准。Although the embodiments disclosed in the present application are as above, the described contents are only the embodiments adopted to facilitate the understanding of the present application, and are not intended to limit the present application. Any person skilled in the art to which this application belongs, without departing from the spirit and scope disclosed in this application, can make any modifications and changes in the form and details of the implementation, but the scope of patent protection of this application must still be The scope defined by the appended claims shall prevail.

Claims (15)

1.一种消除回声的装置,包括:扬声器、通话麦克风、采集麦克风、第一处理模块、第二处理模块;其中,1. A device for eliminating echoes, comprising: a speaker, a call microphone, a collection microphone, a first processing module, and a second processing module; wherein, 扬声器,设置为接收并播放来自远端的远端语音信号,产生回声信号;The loudspeaker is set to receive and play the far-end voice signal from the far-end to generate an echo signal; 采集麦克风,设置为采集扬声器播放的信号获得采集信号;Collect the microphone, and set it to collect the signal played by the speaker to obtain the collected signal; 通话麦克风,设置为拾取回声信号、近端人声信号以及噪音信号,得到麦克风信号;The call microphone is set to pick up the echo signal, the near-end vocal signal and the noise signal to obtain the microphone signal; 第一处理模块,设置为根据远端语音信号对麦克风信号进行自适应滤波处理;a first processing module, configured to perform adaptive filtering processing on the microphone signal according to the far-end voice signal; 第二处理模块,设置为根据采集信号,对自适应滤波处理后的中间信号进行非线性自适应滤波处理,生成回声消除后的语音信号。The second processing module is configured to perform nonlinear adaptive filtering processing on the intermediate signal after the adaptive filtering processing according to the collected signal, so as to generate a voice signal after echo cancellation. 2.根据权利要求1所述的装置,其中,所述第一处理模块包括:自适应滤波器、第一叠加器;其中,2. The apparatus of claim 1, wherein the first processing module comprises: an adaptive filter, a first stacker; wherein, 自适应滤波器,设置为对输入的所述远端语音信号进行计算得到第一模拟回声信号;an adaptive filter, configured to calculate the inputted far-end voice signal to obtain a first analog echo signal; 第一叠加器,设置为对所述麦克风信号和第一模拟回声信号进行叠加处理,得到中间信号。The first superimator is configured to perform superposition processing on the microphone signal and the first analog echo signal to obtain an intermediate signal. 3.根据权利要求2所述的装置,其中,所述第二处理模块包括:非线性自适应滤波器、第二叠加器;其中,3. The apparatus according to claim 2, wherein the second processing module comprises: a nonlinear adaptive filter, a second stacker; wherein, 非线性自适应滤波器,设置为对输入的所述采集信号进行计算得到第二模拟回声信号;a nonlinear adaptive filter, configured to calculate the inputted collected signal to obtain a second analog echo signal; 第二叠加器,设置为对所述中间信号和第二模拟回声信号进行叠加处理,得到所述语音信号。The second stacker is configured to perform superposition processing on the intermediate signal and the second analog echo signal to obtain the voice signal. 4.根据权利要求1~3任一项所述的装置,其中,所述采集麦克风设置在靠近所述扬声器的任意位置。4. The apparatus according to any one of claims 1 to 3, wherein the acquisition microphone is arranged at any position close to the speaker. 5.一种音视频终端,包括权利要求1~3任一项所述的消除回声的装置。5. An audio and video terminal, comprising the echo cancellation device according to any one of claims 1 to 3. 6.一种消除回声的方法,包括:6. A method of eliminating echo, comprising: 根据远端语音信号产生回声信号;Generate an echo signal according to the far-end voice signal; 获取通话麦克风拾取的回声信号、近端人声信号以及噪音信号,得到麦克风信号;Acquire the echo signal, near-end vocal signal and noise signal picked up by the call microphone to obtain the microphone signal; 根据远端语音信号对麦克风信号进行自适应滤波处理,实现线性回声消除;Adaptive filtering is performed on the microphone signal according to the far-end voice signal to achieve linear echo cancellation; 获取利用采集麦克风采集的采集扬声器播放的采集信号;Obtain the acquisition signal played by the acquisition speaker collected by the acquisition microphone; 根据采集信号对自适应滤波处理后的信号进行非线性自适应滤波处理,生成回声消除后的语音信号,实现非线性回声消除。According to the acquired signal, nonlinear adaptive filtering is performed on the signal processed by the adaptive filtering to generate a voice signal after echo cancellation, so as to realize nonlinear echo cancellation. 7.根据权利要求6所述的方法,其中,所述根据远端语音信号对麦克风信号进行自适应滤波处理,包括:7. The method according to claim 6, wherein the adaptive filtering processing on the microphone signal according to the far-end speech signal comprises: 对所述远端语音信号进行自适应滤波计算得到第一模拟回声信号;Adaptive filtering is performed on the far-end speech signal to obtain a first analog echo signal; 叠加所述麦克风信号和第一模拟回声信号,得到中间信号。The microphone signal and the first analog echo signal are superimposed to obtain an intermediate signal. 8.根据权利要求7所述的方法,其中,所述根据采集信号对自适应滤波处理后的信号进行非线性自适应滤波处理,包括:8. The method according to claim 7, wherein, performing nonlinear adaptive filtering processing on the signal after adaptive filtering according to the acquired signal, comprising: 对所述采集信号进行非线性自适应滤波计算得到第二模拟回声信号;Performing nonlinear adaptive filtering calculation on the collected signal to obtain a second analog echo signal; 叠加所述中间信号和第二模拟回声信号,得到所述语音信号。The voice signal is obtained by superimposing the intermediate signal and the second analog echo signal. 9.一种消除非线性回声的方法,包括:9. A method of eliminating nonlinear echo, comprising: 根据远端语音信号对麦克风信号进行自适应滤波处理;Perform adaptive filtering processing on the microphone signal according to the far-end voice signal; 根据采集到的扬声器播放的采集信号,对自适应滤波处理后的信号进行非线性自适应滤波处理,生成回声消除后的语音信号。According to the collected signal played by the collected loudspeaker, nonlinear adaptive filtering is performed on the signal after adaptive filtering to generate a voice signal after echo cancellation. 10.根据权利要求9所述的方法,其中,所述对麦克风信号进行自适应滤波处理,包括:10. The method according to claim 9, wherein the adaptive filtering processing on the microphone signal comprises: 对所述远端语音信号进行自适应滤波计算得到第一模拟回声信号;Adaptive filtering is performed on the far-end speech signal to obtain a first analog echo signal; 叠加所述麦克风信号和第一模拟回声信号,得到中间信号。The microphone signal and the first analog echo signal are superimposed to obtain an intermediate signal. 11.根据权利要求10所述的方法,其中,所述对自适应滤波处理后的信号进行非线性自适应滤波处理,包括:11. The method according to claim 10, wherein the performing nonlinear adaptive filtering processing on the signal processed by the adaptive filtering comprises: 对所述采集信号进行非线性自适应滤波计算得到第二模拟回声信号;Performing nonlinear adaptive filtering calculation on the collected signal to obtain a second analog echo signal; 叠加所述中间信号和第二模拟回声信号,得到所述语音信号。The voice signal is obtained by superimposing the intermediate signal and the second analog echo signal. 12.根据权利要求9~11任一项所述的方法,所述对自适应滤波处理后的信号进行非线性自适应滤波处理之前,还包括:12. The method according to any one of claims 9 to 11, before performing the nonlinear adaptive filtering processing on the signal processed by the adaptive filtering, further comprising: 通过设置在靠近所述扬声器的采集麦克风采集所述采集信号。The acquisition signal is acquired by a acquisition microphone disposed close to the speaker. 13.一种计算机可读存储介质,存储有计算机可执行指令,所述计算机可执行指令用于执行权利要求6~权利要求8任一项所述的消除回声的方法。13 . A computer-readable storage medium storing computer-executable instructions, the computer-executable instructions being used to execute the echo cancellation method according to any one of claims 6 to 8 . 14.一种消除回声的设备,包括存储器和处理器,其中,存储器中存储有以下可被处理器执行的指令:用于执行权利要求6~权利要求8任一项所述的消除回声的方法的步骤。14. An echo cancellation device, comprising a memory and a processor, wherein the memory stores the following instructions executable by the processor: for executing the echo cancellation method according to any one of claims 6 to 8 A step of. 15.一种会议终端,包括:扬声器、通话麦克风、采集麦克风、自适应滤波器、非线性自适应滤波器、第一叠加器,以及第二叠加器;其中,15. A conference terminal, comprising: a speaker, a call microphone, a collection microphone, an adaptive filter, a non-linear adaptive filter, a first stacker, and a second stacker; wherein, 扬声器,设置为播放来自远端会议终端的远端语音信号;A loudspeaker, set to play the far-end voice signal from the far-end conference terminal; 通话麦克风,设置为拾取回声信号、近端人声信号以及噪音信号,得到麦克风信号;The call microphone is set to pick up the echo signal, the near-end vocal signal and the noise signal to obtain the microphone signal; 自适应滤波器,设置为对输入的远端语音信号进行计算得到第一模拟回声信号;an adaptive filter, configured to calculate the input far-end voice signal to obtain a first analog echo signal; 第一叠加器,设置为对麦克风信号和第一模拟回声信号进行叠加处理,得到中间信号;a first stacker, configured to perform stacking processing on the microphone signal and the first analog echo signal to obtain an intermediate signal; 采集麦克风,设置为采集扬声器播放的信号,得到采集信号;Collect the microphone, set it to collect the signal played by the speaker, and obtain the collected signal; 非线性自适应滤波器,设置为对输入的采集信号进行计算得到第二模拟回声信号;The nonlinear adaptive filter is set to calculate the input acquisition signal to obtain the second analog echo signal; 第二叠加器,设置为对中间信号和第二模拟回声信号进行叠加处理,得到语音信号。The second stacker is configured to perform stacking processing on the intermediate signal and the second analog echo signal to obtain a speech signal.
CN202010716771.6A 2020-07-23 2020-07-23 A method and device for eliminating echo, audio and video terminal and conference terminal Active CN113971958B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010716771.6A CN113971958B (en) 2020-07-23 2020-07-23 A method and device for eliminating echo, audio and video terminal and conference terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010716771.6A CN113971958B (en) 2020-07-23 2020-07-23 A method and device for eliminating echo, audio and video terminal and conference terminal

Publications (2)

Publication Number Publication Date
CN113971958A true CN113971958A (en) 2022-01-25
CN113971958B CN113971958B (en) 2025-06-13

Family

ID=79585290

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010716771.6A Active CN113971958B (en) 2020-07-23 2020-07-23 A method and device for eliminating echo, audio and video terminal and conference terminal

Country Status (1)

Country Link
CN (1) CN113971958B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115512712A (en) * 2022-03-22 2022-12-23 钉钉(中国)信息技术有限公司 Echo cancellation method, device and equipment

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003322501A (en) * 2002-04-30 2003-11-14 Japan Atom Energy Res Inst Duct roundness / straightness measurement system
CN104243732A (en) * 2013-06-05 2014-12-24 Dsp集团有限公司 Use of vibration sensor in acoustic echo cancellation
CN104519212A (en) * 2013-09-27 2015-04-15 华为技术有限公司 An echo cancellation method and apparatus
CN107005763A (en) * 2014-11-25 2017-08-01 美商楼氏电子有限公司 For non-linear and time-varying Echo cancellation reference microphone
CN108781241A (en) * 2016-01-14 2018-11-09 美商楼氏电子有限公司 Acoustic echo eliminates reference signal
US10154148B1 (en) * 2017-08-03 2018-12-11 Polycom, Inc. Audio echo cancellation with robust double-talk detection in a conferencing environment

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003322501A (en) * 2002-04-30 2003-11-14 Japan Atom Energy Res Inst Duct roundness / straightness measurement system
CN104243732A (en) * 2013-06-05 2014-12-24 Dsp集团有限公司 Use of vibration sensor in acoustic echo cancellation
CN104519212A (en) * 2013-09-27 2015-04-15 华为技术有限公司 An echo cancellation method and apparatus
CN107005763A (en) * 2014-11-25 2017-08-01 美商楼氏电子有限公司 For non-linear and time-varying Echo cancellation reference microphone
CN108781241A (en) * 2016-01-14 2018-11-09 美商楼氏电子有限公司 Acoustic echo eliminates reference signal
US10154148B1 (en) * 2017-08-03 2018-12-11 Polycom, Inc. Audio echo cancellation with robust double-talk detection in a conferencing environment

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115512712A (en) * 2022-03-22 2022-12-23 钉钉(中国)信息技术有限公司 Echo cancellation method, device and equipment

Also Published As

Publication number Publication date
CN113971958B (en) 2025-06-13

Similar Documents

Publication Publication Date Title
CN111951819B (en) Echo cancellation method, device and storage medium
CN111341336B (en) Echo cancellation method, device, terminal equipment and medium
EP3295681B1 (en) Acoustic echo cancelling system and method
CN108141502B (en) Method for reducing acoustic feedback in an acoustic system and audio signal processing device
CN110176244B (en) Echo cancellation method, device, storage medium and computer equipment
CN110956975B (en) Echo cancellation method and device
CN104427068B (en) A kind of audio communication method and device
CN111356058B (en) An echo cancellation method, device and smart speaker
US9349363B2 (en) Audio signal processing system and echo signal removing method thereof
JP2010028653A (en) Echo canceling apparatus, echo canceling method, its program, and recording medium
CN110431624B (en) Residual echo detection method, residual echo detection device, voice processing chip and electronic equipment
CN113744748A (en) Network model training method, echo cancellation method and device
CN112492112B (en) Echo eliminating method and device based on intercom system
CN112929506B (en) Audio signal processing method and device, computer storage medium and electronic equipment
CN109215672B (en) Method, device and equipment for processing sound information
CN111756906A (en) Echo suppression method and device for voice signal
CN113971958A (en) Method and device for eliminating echo, audio and video terminal and conference terminal
CN114866899B (en) Headset noise reduction method, headset device and computer readable storage medium
JP7495684B2 (en) Echo cancellation method, device and electronic device
CN118486317A (en) A nonlinear echo suppression method, device, electronic device and storage medium
CN115278464A (en) Echo cancellation method, device and communication equipment
CN109587362B (en) Method and device for echo suppression
JP2017191992A (en) Echo suppression device, method, program, and recording medium
US20160065743A1 (en) Stereo echo suppressing device, echo suppressing device, stereo echo suppressing method, and non transitory computer-readable recording medium storing stereo echo suppressing program
HK40050678A (en) Audio signal processing method and device, computer storage medium and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant