CN100524467C - Echo processing method for meeting TV system - Google Patents
Echo processing method for meeting TV system Download PDFInfo
- Publication number
- CN100524467C CN100524467C CNB2006101490287A CN200610149028A CN100524467C CN 100524467 C CN100524467 C CN 100524467C CN B2006101490287 A CNB2006101490287 A CN B2006101490287A CN 200610149028 A CN200610149028 A CN 200610149028A CN 100524467 C CN100524467 C CN 100524467C
- Authority
- CN
- China
- Prior art keywords
- state
- meeting
- place
- threshold values
- audio sampling
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 12
- 238000005070 sampling Methods 0.000 claims abstract description 53
- 241001269238 Data Species 0.000 claims description 12
- 238000002203 pretreatment Methods 0.000 claims description 7
- 238000006243 chemical reaction Methods 0.000 claims description 3
- 230000009466 transformation Effects 0.000 claims description 3
- 230000000694 effects Effects 0.000 abstract description 9
- 238000012545 processing Methods 0.000 abstract description 4
- 238000012805 post-processing Methods 0.000 abstract 1
- 238000007781 pre-processing Methods 0.000 abstract 1
- 230000001550 time effect Effects 0.000 abstract 1
- 238000010586 diagram Methods 0.000 description 7
- 238000006386 neutralization reaction Methods 0.000 description 7
- 101100328518 Caenorhabditis elegans cnt-1 gene Proteins 0.000 description 2
- 101150044602 Slc28a2 gene Proteins 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 2
- 238000000034 method Methods 0.000 description 2
Images
Landscapes
- Cable Transmission Systems, Equalization Of Radio And Reduction Of Echo (AREA)
Abstract
本发明提出一种会议电视系统的回声处理方法，包括如下步骤：A、根据音频采样数据进行状态判断，并转换到相应状态；B、根据预先设定的相应状态的音频处理方法，对音频进行处理。本发明通过判断会场的当前状态，并对音频采样数据的前处理和对回声抵消模块输出的后处理，达到更理想的回声抵消效果，在双方会场不同时发言的情况，能够有效地改善回声抵消的效果。
The present invention proposes an echo processing method for a video conferencing system, comprising the following steps: A, performing state judgment according to audio sampling data, and switching to a corresponding state; B, performing audio processing according to a preset corresponding state audio processing method deal with. The present invention achieves a more ideal echo cancellation effect by judging the current state of the meeting place, pre-processing the audio sampling data and post-processing the output of the echo cancellation module, and can effectively improve the echo cancellation when the two parties speak at different venues at the same time Effect.
Description
Technical field
The present invention relates to a kind of echo processing method of TV conference system, particularly to improvement with the echo neutralization effect that broadcasts as main TV conference system.
Background technology
In the application of TV conference system, much be main the application at present with the broadcast mode.Specifically be exactly a meeting-place speech, listen in other meeting-place.In this system, echo cancelltion is the problem of a more complicated, and it is subjected to all multifactor influences, the performance of acoustic echo cancellation adaptive algorithm for example, the acoustic characteristic in meeting-place or the like.Find following problem in concrete the application:
1, listening under the situation that the meeting-place microphone cuts out, part echo still can be heard in the speech meeting-place.
But 2, listen to the meeting-place microphone open do not have the speech situation under, the speech meeting-place hear bigger echo.
Its reason is, traditional acoustic echo cancellation adaptive algorithm can't be offset the echo in meeting-place under the excessive situation of sound incoming level signal fully, the echo that the meeting-place that causes making a speech can be listened greatlyyer.
Summary of the invention
Purpose of the present invention is exactly above two problems that are primarily aimed at prior art, proposes a kind of echo processing method of TV conference system.
For this reason, the echo processing method of TV conference system of the present invention comprises the steps: A, carries out the state judgement according to audio sampling data, and is transformed into corresponding state; B, according to the audio-frequency processing method of predefined corresponding state, audio frequency is handled.
Preferably, the present invention also comprises following feature:
State described in the described steps A comprises mute state, and promptly the absolute value of this meeting-place all audio sampling datas in the continuous time is all less than the situation of first threshold values; Among the step B under this state the disposal route to audio frequency be: aftertreatment is carried out in the output to echo cancellation module, replaces the output of echo cancellation module with quiet data.
State described in the described steps A comprises attenuation state, and promptly the absolute value of this meeting-place all audio sampling datas in the continuous time is all less than the situation of second threshold values; Among the step B under this state the disposal route to audio frequency be: pre-treatment is carried out in the input to echo cancellation module, and audio sampling data is decayed half, and then sends into echo cancellation module and handle.
The value of M1 is not make a speech when the both sides meeting-place, under the very quiet situation in this meeting-place, and the value of absolute value maximum in the A/D output valve.
The value of M2 M2 is when meeting-place, opposite end speech, and do not make a speech under the only reflective situation in this meeting-place, the value of absolute value maximum in the A/D output valve.
Described state also comprises floor status, promptly in the sampling time of regulation the absolute value of not every audio sampling data all less than first threshold values (M1) or all less than the situation of second threshold values (M2); Transformation rule between each state is: when the meeting-place is in mute state, if detect certain audio sampling data more than or equal to M2, then enter floor status; When the meeting-place is in mute state,, then enter attenuation state if detect certain audio sampling data more than or equal to M1 and less than M2; When the meeting-place is in attenuation state,, then enter floor status if detect certain audio sampling data more than or equal to M2; When the meeting-place is in attenuation state,, then enter mute state if detect 1 audio sampling data of N continuous less than M1; When the meeting-place is in floor status,, then enter mute state if detect 1 audio sampling data of N continuous less than M1; When the meeting-place is in floor status,, then enter attenuation state if detect 2 audio sampling datas of N continuous less than M2; When N1=N2, the meeting-place is in floor status, if detect 2 audio sampling datas of N continuous less than M2, satisfies 1 audio sampling data of N continuous so simultaneously less than M1, enters mute state this moment; Wherein:
N1=t1 * audio sample rate, N2=t2 * audio sample rate.
This pre-treatment scheme that can improve echo neutralization effect proposed by the invention, by judging the current state in meeting-place, and to the pre-treatment of audio sampling data and the aftertreatment that echo cancellation module is exported, reach better echo neutralization effect, the situation of speech simultaneously not in the both sides meeting-place can be improved the effect of echo cancelltion effectively.
Description of drawings
Fig. 1 is a general illustration of the present invention.
Fig. 2 is that embodiment of the invention state changes the process synoptic diagram.
Fig. 3 is an embodiment of the invention schematic flow sheet.
Fig. 4 is that embodiment of the invention state changes schematic flow sheet.
Fig. 5 is the treatment scheme synoptic diagram of the embodiment of the invention to state 1.
Fig. 6 is the treatment scheme synoptic diagram of the embodiment of the invention to state 2.
Fig. 7 is the treatment scheme synoptic diagram of the embodiment of the invention to state 3.
Embodiment
This programme according to the current state of judging the meeting-place, reaches desirable echo neutralization effect by the aftertreatment of audio sampling data being carried out pre-treatment and echo cancellation module is exported by the method for software.As shown in Figure 1, its A/D represents the analog-to-digital conversion module of audio sampling data.
Present embodiment is divided into following three kinds with the state in meeting-place, judges current conference site state and handles accordingly by software.
(1) state 1: mute state
When the absolute value of this meeting-place all audio sampling datas in continuous time t1 all under the situation less than M1, we think that this meeting-place is in mute state.This state normally the microphone in this meeting-place close or microphone open but do not have the speech and the very little situation of echo.Under this kind state, we carry out aftertreatment to the output of echo cancellation module, with the output of quiet data (referring to allow the D/A of opposite end export the data of " 0 ") replacement echo cancellation module, to reach extraordinary echo neutralization effect in the meeting-place, opposite end.
(2) state 2: attenuation state
When the absolute value of this meeting-place all audio sampling datas in continuous time t2 all under the situation less than M2, we think that this meeting-place is in attenuation state.This state normally microphone in this meeting-place is opened but is not had speech and the bigger situation of echo.Under this kind state, we carry out pre-treatment to the input of echo cancellation module, and audio sampling data is decayed half, and then send into echo cancellation module and handle, thereby obtain desirable echo neutralization effect in the meeting-place, opposite end.
(3) state 3: floor status
When the condition that requires in state 1 and the state 2 can not be satisfied in this meeting-place (absolute value of not every audio sampling data is all less than M1 or all less than M2 in the sampling time of regulation), we think that this meeting-place is in floor status.At this moment, we do not carry out special processing.
Below present embodiment is explained in more detail:
One, choosing of threshold values:
In the present embodiment, threshold values M1 and M2 choose the judgement that is related to current conference site state, thereby influence follow-up processing, and be therefore extremely important.
Audio sampling data has just to be had negatively, is greater than or less than certain threshold values in the present embodiment and is meant that all its absolute value is greater than or less than certain threshold values (other places explanation).
M1 in the present embodiment and M2 must satisfy following relation: 0＜M1＜M2.
The value of M1 is not make a speech when the both sides meeting-place, under the very quiet situation in this meeting-place, and the value of absolute value maximum in the A/D output valve.
The value of M2 is when meeting-place, opposite end speech, and do not make a speech under the only reflective situation in this meeting-place, the value of absolute value maximum in the A/D output valve.
Generally, in different meeting-place, the value of M1 and M2 is inequality.But it is general all in certain scope.Therefore we that these two threshold values are designed to program is variable, promptly, be set to different values by application program according to different meeting-place environment.
Two, the change of state: as shown in Figure 2---
1. when the meeting-place is in state 1,, then get the hang of 3 if detect certain audio sampling data more than or equal to M2.
2. when the meeting-place is in state 1,, then get the hang of 2 if detect certain audio sampling data more than or equal to M1 and less than M2.
3. when the meeting-place is in state 2,, then get the hang of 3 if detect certain audio sampling data more than or equal to M2.
4. when the meeting-place is in state 2,, then get the hang of 1 if detect 1 audio sampling data of N continuous less than M1.
5. when the meeting-place is in state 3,, then get the hang of 1 if detect 1 audio sampling data of N continuous less than M1.
6. when the meeting-place is in state 3,, then get the hang of 2 if detect 2 audio sampling datas of N continuous less than M2.
7. when N1=N2, the meeting-place is in state 3, if detect 2 audio sampling datas of N continuous less than M2, because N2=N1, and M1＜M2, so satisfy 1 audio sampling data of N continuous simultaneously less than M1, get the hang of 1 this moment.
Wherein:
N1=t1 * audio sample rate
N2=t2 * audio sample rate
For example we think that when all audio sampling data is all less than M1 in continuous 1 second be mute state, if audio sample rate is 8K, then N1 is 8000.The value of N2 in like manner.
Three, treatment scheme: shown in Fig. 3-7
Fig. 3 is the present embodiment schematic flow sheet.Wherein, T is an audio sampling data, and original state is set is state 3.After receiving audio sampling data T, relatively judge with threshold values more as calculated, and carry out state exchange according to judged result.Its transformation rule as mentioned above.Its flow path switch as shown in Figure 4.
After being transformed into arbitrary state, just handle by the tupe of this state.Fig. 5 is the treatment scheme synoptic diagram of present embodiment to state 1.Wherein, Cnt1, Cnt2 are integer variable (int), be used for counting, and to make the initial value of Cnt1 and Cnt2 are 0.Fig. 6 then is the treatment scheme synoptic diagram of present embodiment to state 2.Fig. 7 then is the treatment scheme synoptic diagram of present embodiment to state 3.
Processing scheme of the present invention can reach better echo neutralization effect by to the pre-treatment of audio sampling data and the aftertreatment that echo cancellation module is exported.
Claims (3)
1, a kind of echo processing method of TV conference system is characterized in that comprising the steps:
A, carry out state according to audio sampling data and judge, and be transformed into corresponding state;
B, according to the audio-frequency processing method of predefined corresponding state, audio frequency is handled;
Wherein:
State described in the described steps A comprises mute state, and promptly the absolute value of this meeting-place all audio sampling datas in continuous time t1 is all less than the situation of the first threshold values M1; Among the step B under this state the disposal route to audio frequency be: aftertreatment is carried out in the output to echo cancellation module, replaces the output of echo cancellation module with quiet data;
State described in the described steps A also comprises attenuation state, and promptly the absolute value of this meeting-place all audio sampling datas in continuous time t2 is all less than the situation of the second threshold values M2; Among the step B under this state the disposal route to audio frequency be: pre-treatment is carried out in the input to echo cancellation module, and audio sampling data is decayed half, and then sends into echo cancellation module and handle; 0＜M1＜M2 wherein;
State described in the described steps A also comprises floor status, promptly in the sampling time of regulation the absolute value of not every audio sampling data all less than the first threshold values M1 or all less than the situation of the second threshold values M2; Transformation rule between each state is:
When the meeting-place is in mute state,, then enter floor status if detect certain audio sampling data more than or equal to the second threshold values M2;
When the meeting-place is in mute state,, then enter attenuation state if detect certain audio sampling data more than or equal to the first threshold values M1 and less than the second threshold values M2;
When the meeting-place is in attenuation state,, then enter floor status if detect certain audio sampling data more than or equal to the second threshold values M2;
When the meeting-place is in attenuation state,, then enter mute state if detect 1 audio sampling data of N continuous less than the first threshold values M1;
When the meeting-place is in floor status,, then enter mute state if detect 1 audio sampling data of N continuous less than the first threshold values M1;
When the meeting-place is in floor status,, then enter attenuation state if detect 2 audio sampling datas of N continuous less than the second threshold values M2;
When the meeting-place was in floor status, if detect 2 audio sampling datas of N continuous less than the second threshold values M2,1 audio sampling data of N continuous satisfied N1=N2 simultaneously less than the first threshold values M1, entered mute state this moment;
Wherein:
N1=t1 * audio sample rate
N2=t2 * audio sample rate.
2, the echo processing method of TV conference system as claimed in claim 1, it is characterized in that: the value of the first threshold values M1 is not make a speech when the both sides meeting-place, under the very quiet situation in this meeting-place, the value of absolute value maximum in the analog-to-digital conversion module output valve of audio sampling data.
3, the echo processing method of TV conference system as claimed in claim 1 or 2, it is characterized in that: the value of the second threshold values M2 is when the speech of the other side meeting-place, do not make a speech under the only reflective situation in this meeting-place, the value of absolute value maximum in the analog-to-digital conversion module output valve of audio sampling data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2006101490287A CN100524467C (en) | 2006-07-17 | 2006-11-15 | Echo processing method for meeting TV system |
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200610061714.9 | 2006-07-17 | ||
| CN200610061714 | 2006-07-17 | ||
| CNB2006101490287A CN100524467C (en) | 2006-07-17 | 2006-11-15 | Echo processing method for meeting TV system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1987999A CN1987999A (en) | 2007-06-27 |
| CN100524467C true CN100524467C (en) | 2009-08-05 |
Family
ID=38184768
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2006101490287A Expired - Fee Related CN100524467C (en) | 2006-07-17 | 2006-11-15 | Echo processing method for meeting TV system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100524467C (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2009098974A1 (en) * | 2008-02-04 | 2009-08-13 | Nec Corporation | Voice mixing device and method, and multipoint conference server |
| CN108962257A (en) * | 2018-07-16 | 2018-12-07 | 安徽国通亿创科技股份有限公司 | A kind of online interaction live streaming echo cancellation system |
| CN113223546A (en) * | 2020-12-28 | 2021-08-06 | 南京愔宜智能科技有限公司 | Audio and video conference system and echo cancellation device for same |
| CN112688965B (en) * | 2021-03-11 | 2021-07-09 | 浙江华创视讯科技有限公司 | Conference audio sharing method and device, electronic equipment and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH07283859A (en) | 1994-04-08 | 1995-10-27 | Ricoh Co Ltd | Echo canceller |
| CN1249869A (en) * | 1997-01-31 | 2000-04-05 | 夸尔柯姆股份有限公司 | Method and apparatus for using state determination to control functional elements |
| CN1416639A (en) * | 2000-01-27 | 2003-05-07 | 高通股份有限公司 | Improved system and method for implementation of echo canceller |
| CN1505373A (en) * | 2002-11-27 | 2004-06-16 | 华为技术有限公司 | An echo canceller for teleconference service |
| CN1505894A (en) * | 2001-03-27 | 2004-06-16 | �����ɷ� | Network Echo Suppression in Mobile Stations |
| CN1780167A (en) * | 2004-11-24 | 2006-05-31 | 北京三星通信技术研究有限公司 | Convergent echo eliminator rapidly |
| CN1780165A (en) * | 2004-11-23 | 2006-05-31 | 华为技术有限公司 | Echo eliminator and elimination |
-
2006
- 2006-11-15 CN CNB2006101490287A patent/CN100524467C/en not_active Expired - Fee Related
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH07283859A (en) | 1994-04-08 | 1995-10-27 | Ricoh Co Ltd | Echo canceller |
| CN1249869A (en) * | 1997-01-31 | 2000-04-05 | 夸尔柯姆股份有限公司 | Method and apparatus for using state determination to control functional elements |
| CN1416639A (en) * | 2000-01-27 | 2003-05-07 | 高通股份有限公司 | Improved system and method for implementation of echo canceller |
| CN1505894A (en) * | 2001-03-27 | 2004-06-16 | �����ɷ� | Network Echo Suppression in Mobile Stations |
| CN1505373A (en) * | 2002-11-27 | 2004-06-16 | 华为技术有限公司 | An echo canceller for teleconference service |
| CN1780165A (en) * | 2004-11-23 | 2006-05-31 | 华为技术有限公司 | Echo eliminator and elimination |
| CN1780167A (en) * | 2004-11-24 | 2006-05-31 | 北京三星通信技术研究有限公司 | Convergent echo eliminator rapidly |
Non-Patent Citations (1)
| Title |
|---|
| 基于DSP的回声抵消器的设计与实现. 胡秀芳，郑泰胜，胡丙龙.广东工业大学学报，第19卷第1期. 2002 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN1987999A (en) | 2007-06-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI734176B (en) | Acoustic processor having low latency | |
| US9661145B2 (en) | Method for carrying out an audio conference, audio conference device, and method for switching between encoders | |
| US8644494B2 (en) | Echo canceler | |
| US20190156847A1 (en) | Transparent near-end user control over far-end speech enhancement processing | |
| CN110769352B (en) | Signal processing method and device and computer storage medium | |
| JP2012523720A (en) | Extended communication bridge | |
| CN101715013A (en) | Identifying and eliminating the source of background noise in multi-party teleconferences | |
| CN101478614A (en) | Method, apparatus and communication terminal for adaptively tuning volume | |
| EP1949552A1 (en) | Configuration of echo cancellation | |
| WO2014143582A1 (en) | Spatial comfort noise | |
| CN103141076B (en) | Echo control optimization | |
| US20130322655A1 (en) | Method and device for microphone selection | |
| US11205437B1 (en) | Acoustic echo cancellation control | |
| PL1745637T3 (en) | Conference terminal comprising echo reduction for a voice conferencing system | |
| CN109819129B (en) | Conference comfort noise mixing system and method based on sound evaluation | |
| CN100563287C (en) | A kind of sound mixing method of multi-path voice signal and device | |
| CN100524467C (en) | Echo processing method for meeting TV system | |
| WO2003094396A8 (en) | Discrete surround audio system for home and automotive listening | |
| CN107302640B (en) | Videoconference control system and its control method | |
| CN206977582U (en) | A kind of video conference echo cancellation system | |
| CN201294570Y (en) | Echo elimination device for teleconference system | |
| CN100508031C (en) | A Method for Recognizing and Eliminating the Echo Produced by Far-End Speech in SCDMA Mobile Phone | |
| AU2006252058B2 (en) | An audio system with varying time delay and method for processing audio signals | |
| CN107249116B (en) | Noise and echo cancellation device based on video conferencing | |
| CN202103682U (en) | Novel intelligent automatic mixer having keynote and complete-mute function |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C56 | Change in the name or address of the patentee | ||
| CP02 | Change in the address of a patent holder |
Address after: 518057, No. 5, building 504-506, building 2, 2 West West Road, Nanshan District high tech North District, Guangdong, Shenzhen Patentee after: Shenzhen Diweixin Software Technology Co.,Ltd. Address before: 518057 Shenzhen International Technological Innovation Research Institute, science and technology zone, Shenzhen hi tech Zone, Guangdong ten, block D, 404-409 Patentee before: Shenzhen Diweixin Software Technology Co.,Ltd. |
|
| CP02 | Change in the address of a patent holder | ||
| CP02 | Change in the address of a patent holder |
Address after: Room 1202, building 3, R & D building, No. 3, Fangda Plaza, No. 28, Gaofa West Road, Taoyuan community, Taoyuan Street, Nanshan District, Shenzhen City, Guangdong Province Patentee after: SHENZHEN DIWEIXIN SOFTWARE TECHNOLOGY Co.,Ltd. Address before: 518057, No. 5, building 504-506, building 2, 2 West West Road, Nanshan District high tech North District, Guangdong, Shenzhen Patentee before: SHENZHEN DIWEIXIN SOFTWARE TECHNOLOGY Co.,Ltd. |
|
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20090805 Termination date: 20211115 |