CN115866474A - Transparent transmission noise reduction control method and system of wireless earphone and wireless earphone - Google Patents
Transparent transmission noise reduction control method and system of wireless earphone and wireless earphone Download PDFInfo
- Publication number
- CN115866474A CN115866474A CN202211699380.3A CN202211699380A CN115866474A CN 115866474 A CN115866474 A CN 115866474A CN 202211699380 A CN202211699380 A CN 202211699380A CN 115866474 A CN115866474 A CN 115866474A
- Authority
- CN
- China
- Prior art keywords
- noise reduction
- audio signal
- wireless
- transparent transmission
- ear
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000009467 reduction Effects 0.000 title claims abstract description 118
- 230000005540 biological transmission Effects 0.000 title claims abstract description 80
- 238000000034 method Methods 0.000 title claims abstract description 43
- 230000005236 sound signal Effects 0.000 claims abstract description 141
- 230000002085 persistent effect Effects 0.000 claims 1
- 210000000883 ear external Anatomy 0.000 abstract description 9
- 238000005070 sampling Methods 0.000 description 15
- 238000006243 chemical reaction Methods 0.000 description 10
- 208000009205 Tinnitus Diseases 0.000 description 8
- 230000006870 function Effects 0.000 description 7
- 230000008569 process Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 238000001514 detection method Methods 0.000 description 5
- 238000001914 filtration Methods 0.000 description 5
- 238000004891 communication Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000007613 environmental effect Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000003595 spectral effect Effects 0.000 description 3
- 230000003044 adaptive effect Effects 0.000 description 2
- 230000002238 attenuated effect Effects 0.000 description 2
- 210000000613 ear canal Anatomy 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000010606 normalization Methods 0.000 description 2
- 101100072620 Streptomyces griseus ind2 gene Proteins 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 239000000872 buffer Substances 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000011946 reduction process Methods 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 230000001629 suppression Effects 0.000 description 1
- 230000002459 sustained effect Effects 0.000 description 1
- 238000004804 winding Methods 0.000 description 1
Images
Landscapes
- Circuit For Audible Band Transducer (AREA)
- Soundproofing, Sound Blocking, And Sound Damping (AREA)
Abstract
The disclosure relates to a transparent transmission noise reduction control method and system of a wireless earphone and the wireless earphone. The wireless earphone comprises an out-of-ear microphone, a loudspeaker, a transparent transmission module and an active noise reduction module. The transparent transmission noise reduction control method comprises the following steps: acquiring an ear-external audio signal acquired by the ear-external microphone; acquiring a wireless audio signal from another device played by the loudspeaker; determining a correlation parameter between the out-of-ear audio signal and the wireless audio signal; and switching the wireless earphone to start the transparent transmission module or the active noise reduction module based on the correlation parameter. By the control method, the working module of the earphone can be intelligently switched based on the correlation parameters between the wireless audio signals received through wireless connection and the audio signals received through the physical space and the out-of-ear microphone, so that a user does not need to take off the earphone, and the user experience is improved.
Description
Technical Field
The present disclosure relates to the field of earphones, and more particularly, to a transparent transmission noise reduction control method and system for a wireless earphone, and a wireless earphone.
Background
With the social progress and the improvement of the living standard of people, the earphone becomes an indispensable living article for people. Traditional wired earphones are connected with a wireless host (such as a smart phone, a notebook computer, a tablet computer and the like) through a wire, so that the actions of a wearer can be limited, and the traditional wired earphones are very inconvenient in sports occasions. At the same time, the winding and pulling of the earphone cord and the stethoscope effect all affect the user experience. The common Bluetooth headset cancels the connection between the headset and the wireless host, but the connection still exists between the left ear and the right ear. True wireless stereo headphones are produced at the same time.
The earphone with the active noise suppression function can enable a user to enjoy comfortable noise reduction experience in various noisy environments such as airports, subways, airplanes, restaurants and the like, and is increasingly widely accepted by markets and customers. The principle is to reduce the noise heard by the ear by actively emitting sound waves of opposite phase through the earphone to cancel the sound waves (feed-forward) or adding a feedback acoustic path to the sound path (feedback). In addition, in some scenes that need to receive signals such as external voice or external environmental noise, the earphone needs to have a transparent transmission function, so that a wearer of the earphone can better receive the external voice or the external environmental noise or various external alarm sounds.
However, when a user uses an earphone to talk with a person and the talker is at the user side (for example, when the user is wearing the earphone to participate in a video or audio conference, a person in the same room is speaking), if the user does not take off the earphone, the user can receive the talk through the earphone speaker and hear the talk sound of the same sound source through the physical space, and the time delay between the two is large, which seriously affects the user experience. Obviously, the existing earphones cannot solve the above problems.
Disclosure of Invention
The present disclosure is provided to solve the above-mentioned problems occurring in the prior art.
The disclosure needs a transparent transmission noise reduction control method for a wireless headset, which can receive a wireless audio signal through wireless connection and play the wireless audio signal through a headset speaker, and can intelligently switch a working module of the headset based on a correlation parameter between the wireless audio signal and an extra-aural audio signal when the extra-aural audio signal of the same sound source is received through an extra-aural microphone, and a user does not need to take off the headset, thereby improving user experience.
The first aspect of the present disclosure provides a transparent transmission noise reduction control method for a wireless headset, where the wireless headset includes an out-of-ear microphone, a speaker, a transparent transmission module, and an active noise reduction module, and the transparent transmission noise reduction control method includes: acquiring an ear-external audio signal acquired by the ear-external microphone; acquiring a wireless audio signal from another device played by the loudspeaker; determining a correlation parameter between the out-of-ear audio signal and the wireless audio signal; and based on the correlation parameter, switching the wireless earphone to open the transparent transmission module or the active noise reduction module.
A second aspect of the present disclosure provides a transparent transmission noise reduction control system for a wireless headset, the transparent transmission noise reduction control system including: a pass-through module configured to pass-through the wireless headset; an active noise reduction module configured to actively noise reduce the wireless headset; and a processor configured to execute the transparent transmission noise reduction control method according to the first aspect of the present disclosure and any one of the embodiments thereof.
A third aspect of the present disclosure provides a wireless headset including the transparent transmission noise reduction control system according to the second aspect of the present disclosure.
According to the transparent transmission noise reduction control method and system of the wireless earphone and the wireless earphone, when the wireless audio signal can be received through wireless connection and played through the earphone loudspeaker, and the extra-aural audio signal of the same sound source can be received through the extra-aural microphone, the working module of the earphone is intelligently switched based on the correlation parameter between the wireless audio signal and the extra-aural audio signal, a user does not need to take off the earphone, and user experience is improved.
Drawings
In the drawings, which are not necessarily drawn to scale, like reference numerals may describe similar components in different views. Like reference numerals having letter suffixes or different letter suffixes may represent different instances of similar components. The drawings illustrate various embodiments generally by way of example and not by way of limitation, and together with the description and claims serve to explain the disclosed embodiments. The same reference numbers will be used throughout the drawings to refer to the same or like parts, where appropriate. Such embodiments are illustrative, and are not intended to be exhaustive or exclusive embodiments of the present apparatus or method.
FIG. 1 illustrates a schematic diagram of the operation of an active noise reduction module according to an embodiment of the present disclosure;
FIG. 2 illustrates a schematic diagram of the operation of a pass-through module according to an embodiment of the present disclosure;
fig. 3 shows a flowchart of a transparent transmission noise reduction control method of a wireless headset according to an embodiment of the present disclosure; and
fig. 4 shows a block diagram of a configuration of a transparent transmission noise reduction control system of a wireless headset according to an embodiment of the present disclosure.
Detailed Description
In order to make the technical solutions of the present application better understood, the present application is described in detail below with reference to the accompanying drawings and the detailed description. The embodiments of the present application will be described in further detail with reference to the drawings and specific embodiments, but the present application is not limited thereto.
As used in this application, the terms "first," "second," and the like, do not denote any order, quantity, or importance, but rather are used to distinguish one element from another. The word "comprising" or "comprises", and the like, means that the element preceding the word covers the element listed after the word, and does not exclude the possibility that other elements are also covered. The order of steps shown by arrows in the drawings of the present application is merely an example, and does not mean that the steps are necessarily performed in the order shown by the arrows. If not otherwise indicated, the various steps may be combined or the order of execution reversed, and performed in a different order than indicated by the arrows, so long as the logical relationship of the various steps is not affected.
Herein, the wireless headset may include any one of an in-ear headset and a semi-in-ear headset. The wireless headset may include at least an out-of-ear microphone, a speaker, and a pass-through noise reduction control system 200 (which includes an active noise reduction module 210 and a pass-through module 220). The input of the feedforward active noise reduction filter of the active noise reduction module 210 is from the audio signal collected by the feedforward microphone, and the output of the feedforward active noise reduction filter is finally output to the speaker; the input of the feedforward transparent transmission filter of the transparent transmission module 220 is from the audio signal collected by the feedforward microphone, and the output of the feedforward transparent transmission filter is finally output to the loudspeaker; the wireless earphone receives a wireless audio signal of another wireless device through wireless connection and plays the wireless audio signal through the loudspeaker. The out-of-ear microphone may then collect an out-of-ear audio signal.
First, the working principle of the active noise reduction module 210 and the transparent transmission module 220 included in the wireless headset provided by the embodiment of the present disclosure will be described with reference to fig. 1 and fig. 2, respectively, where the active noise reduction module 210 is configured to perform active noise reduction control on the wireless headset, and the transparent transmission module 220 is configured to perform transparent transmission control on the wireless headset.
Fig. 1 shows a schematic diagram of an operating principle of an active noise reduction module of a wireless headset according to an embodiment of the present disclosure. As shown in fig. 1, in the active noise reduction module 210, the headphone implements the active noise reduction process through a feed-forward path and a feedback path. In some embodiments, in the feedforward path, the feedforward microphone 101a collects the ambient noise outside the earphone, and the ambient noise collected by the feedforward microphone 101a may include, in addition to the noise generated by the surrounding environment, an audio component leaked to the surrounding environment when the earphone speaker 107 plays the audio signal, and the audio component is a part of the ambient noise. The collected ambient noise is subjected to gain processing by an analog gain 102a and analog-to-digital conversion by a first analog-to-digital converter 103a, and then is transmitted to a first low-pass and down-sampling filter 104a. The first low pass and down sample filter 104a can reduce the filter sampling rate, thereby reducing power consumption and filter order, and further reducing the area of the noise reduction chip and reducing cost. Subsequently, the ambient noise signal passing through the first low-pass and down-sampling filter 104a is filtered by the feedforward active noise reduction filter 111 to perform noise reduction processing on the ambient noise collected by the feedforward microphone 101 a. The noise-reduced ambient signal is transmitted to the adder 109, and then is processed by digital-to-analog conversion of the digital-to-analog converter 106, and is played by the speaker 107. The feedforward filtered ambient noise played out by the speaker 107 and arriving in the ear creates air cancellation to achieve noise reduction.
In some embodiments, on the feedback path, the feedback microphone 101b collects in-ear noise including an audio echo signal generated when the audio signal is played and an in-ear residual signal after air cancellation at a position inside the earphone near the ear canal. The collected in-ear noise is subjected to gain processing by an analog gain 102b and analog-to-digital conversion by a second analog-to-digital converter 103b, and then transmitted to a second low-pass and down-sampling filter 104b. The second low pass and downsample filter 104b can reduce the filter sampling rate, thereby reducing power consumption and filter order, and further reducing the area of the noise reduction chip and reducing cost. Then, the in-ear noise signal passing through the second low-pass and down-sampling filter 104b is transmitted to the adder 110. The audio signal to be played 105 is an audio signal to be transmitted to the speaker 107 for playing, and on one hand, it is transmitted to the adder 109, and after being processed by the digital-to-analog conversion of the digital-to-analog converter 106, it is played by the speaker 107; on the other hand, it is transmitted to an echo filter 113, the echo filter 113 is used to cancel the audio echo signal generated after the audio signal to be broadcast 105 is played by the loudspeaker 107, and then the audio signal to be broadcast 105 filtered by the echo filter 113 is sent to the adder 110. The adder 110 integrates the in-ear noise processed by the second low-pass and down-sampling filter 104b and the audio signal processed by the echo filter 113, so that the noise signal in the feedback path is no longer affected by the audio echo signal. The summer 110 then transmits the integrated noise signal to the feedback active noise reduction filter 112 for filtering to achieve feedback noise reduction. The feedback-filtered noise signal is transmitted to the adder 109 through the limiter 108, and is played back through the speaker 107 after being subjected to digital-to-analog conversion processing by the digital-to-analog converter 106.
The above is a working principle of the earphone for active noise reduction based on the embodiment of the present disclosure, and the active noise reduction function of the earphone can be realized by filtering the noise on the feedforward path and the feedback path respectively and playing the noise on the speaker, so as to improve the noise reduction effect of the earphone and improve the listening experience of the user. In some embodiments of the present disclosure, in the active noise reduction module 210, the headphone implements the active noise reduction function through a feed-forward path.
Fig. 2 is a schematic diagram illustrating an operation principle of a transparent transmission module of a wireless headset according to an embodiment of the present disclosure. As shown in fig. 2, in the transparent transmission module 220, the earphone realizes the transparent transmission process through a feed-forward path and a feedback path. In some embodiments, the headset's feedforward microphone 101a picks up ambient sound outside the headset on the feedforward path. The collected ambient sound is subjected to gain processing by an analog gain 102a and analog-to-digital conversion by a first analog-to-digital converter 103a, and then is transmitted to a first low-pass and down-sampling filter 104a. The first low pass and downsample filter 104a can reduce the filter sampling rate, thereby reducing power consumption and filter order, and further reducing chip area to reduce cost. The ambient sound signal that passes through the first low pass and down sample filter 104a is then filtered by the feedforward pass filter 114 to simulate the ambient sound collected by the feedforward microphone 101 a. The ambient signal after the transparent transmission processing is transmitted to the adder 109, and then is processed by the digital-to-analog converter 106, and then is played by the speaker 107. The pass-through filtered ambient sound played through speaker 107 approximates the ambient sound when the user is not wearing the headset.
In some embodiments, in the feedback path, the feedback microphone 101b of the earphone collects in-ear noise including an audio echo signal generated when the audio signal is played and a residual signal after air cancellation at a position inside the earphone near the ear canal. The collected in-ear noise is subjected to gain processing by an analog gain 102b and analog-to-digital conversion by a second analog-to-digital converter 103b, and then transmitted to a second low-pass and down-sampling filter 104b. The second low pass and downsample filter 104b can reduce the filter sampling rate, thereby reducing power consumption and filter order, and further reducing chip area to reduce cost. Then, the in-ear noise signal passing through the second low-pass and down-sampling filter 104b is transmitted to the adder 110. The audio signal to be played 105 is an audio signal to be transmitted to the speaker 107 for playing, and on one hand, it is transmitted to the adder 109, and after being processed by the digital-to-analog conversion of the digital-to-analog converter 106, it is played by the speaker 107; on the other hand, it is transmitted to an echo filter 113, the echo filter 113 is used to cancel the audio echo signal generated after the audio signal to be broadcast 105 is played by the loudspeaker 107, and then the audio signal to be broadcast 105 filtered by the echo filter 113 is sent to the adder 110. The adder 110 integrates the in-ear noise processed by the second low-pass and down-sampling filter 104b and the audio signal processed by the echo filter 113, so that the noise signal in the feedback path is no longer affected by the audio echo signal. The summer 110 then transmits the integrated noise signal to the feedback pass-through filter 115 for filtering to achieve feedback noise reduction. The feedback-filtered noise signal may be transmitted to the adder 109 through the limiter 108, and played back through the speaker 107 after being processed by the digital-to-analog converter 106. In some embodiments, the digital-to-analog converter 106 includes up-sampling and filtering circuitry to operate the digital-to-analog conversion process at higher frequencies; for example, when the adder 109 operates at 384kHz, the digital-to-analog conversion process of the digital-to-analog converter 106 operates at 384 × 64=24.576 mhz.
The above is a working principle of transparent transmission to the earphone based on the embodiment of the present disclosure, and the transparent transmission function of the earphone can be realized by respectively simulating the environmental sound on the feedforward path and filtering the noise on the feedback path, so as to improve the listening effect of the earphone. In some embodiments of the present disclosure, in the pass-through module 220, the headset implements the pass-through process through a feed-forward path.
In the wireless headset of the present disclosure, the active noise reduction module 210 and the transparent transmission module 220 are configured to share a plurality of headset components, such as the feedforward microphone 101a, the feedback microphone 101b, the echo filter 113, and the like, and after switching to the corresponding module, the components contained in the module are connected accordingly. Of course, in some embodiments, the active noise reduction module 210 and the transparent transmission module 220 may have independent elements to make the two modules independent from each other, and the application is not limited thereto.
In some embodiments, the microphone may be a digital microphone, in which case the analog gain, first analog-to-digital converter of fig. 1 is not required. In addition, the feedforward active noise reduction filter, the feedback active noise reduction filter, the feedforward transparent filter and the feedback transparent filter can be self-adaptive or fixed filters, and can be in an IIR structure, an FIR structure or a filter structure formed by mixing the IIR and the FIR.
In addition, in the echo filter of the active noise reduction module and/or the transparent transmission module, the adaptive part is removed from the diagram for simplicity, and the echo filter obtained by the adaptive algorithm is not excluded.
Fig. 3 shows a flowchart of a transparent transmission noise reduction control method of a wireless headset according to an embodiment of the present disclosure. The transparent transmission noise reduction control method 300 is executed by the transparent transmission noise reduction control system 200 (see fig. 4) in the wireless headset, so that the headset is switched to turn on the transparent transmission module 220 and the active noise reduction module 210. In addition to the active noise reduction module 210 and the pass-through module 220, the transparent transmission noise reduction control system 200 further includes at least a processor 230, as shown in fig. 4. The processor 230 is configured to execute the transparent noise reduction control method shown in fig. 3.
As shown in fig. 3, the transparent transmission noise reduction control method 300 includes:
s310, acquiring an ear-external audio signal acquired by the ear-external microphone;
s320, acquiring a wireless audio signal from another device played by the loudspeaker;
s330, determining a correlation parameter between the out-of-ear audio signal and the wireless audio signal; and
s340, based on the correlation parameter, switching the wireless earphone to start the transparent transmission module or the active noise reduction module.
Next, the specific process of the transparent transmission noise reduction control method 300 provided by the present disclosure will be described in detail in conjunction with the above steps S310 to S340.
In step S310, an out-of-ear microphone may be provided as a component of the wireless headset to capture an out-of-ear audio signal and transmit the captured out-of-ear audio signal to the processor 230. For example, the out-of-ear audio signal is audio of a speech of any person in the same physical space when the user is participating in a video or audio conference, or audio of a speech of any person standing near the user, and also includes ambient sound in the physical space where the user is located.
In step S320, the processor 230 acquires a wireless audio signal from another wireless device and plays the wireless audio signal through a speaker. The wireless audio signal may be from the same audio source (i.e., the same speaker) as the off-ear audio signal collected by the off-ear microphone, or may be from a different audio source (i.e., a different speaker), and the determination is dependent on a correlation parameter (described below). It should be understood that the wireless device herein may be a cell phone, a tablet, a desktop, a router, etc. The wireless device and the headset can communicate wirelessly through bluetooth, wiFi, etc. The wireless device may obtain the wireless audio signal from a remote server.
Note that, the order of the steps S310 and S320 is not particularly limited, and both may be performed simultaneously or in a certain order.
In step S330, the processor 230 determines a correlation parameter between the two audio signals, i.e., the ear-external audio signal and the wireless audio signal, based on the ear-external audio signal and the wireless audio signal acquired in steps S310 and S320, so as to determine whether the two audio signals are from the same audio source.
Optionally, in an embodiment, before step S330, the transparent transmission noise reduction control method 100 further includes:
in step S350, the processor 230 determines whether the wireless audio signal contains continuous human speech content, and if so, determines a correlation parameter between the out-of-ear audio signal and the wireless audio signal.
"human speech content" refers to speech content related to human speech, such as speech content in an audio-video conference. In other words, the correlation detection is only performed if the processor 230 determines that the wireless audio signal from the other device contains sustained human-speaking audio. And if the wireless audio signal belongs to the audio frequency such as music played by the user and does not belong to the audio and video communication content with the outside personnel, the correlation detection is not carried out at the moment. In this way, on the one hand, the power consumption of the headset in this scenario can be reduced, and on the other hand, situations where incorrect or unnecessary switching is caused by misjudgment can also be avoided.
Here, the processor 230 recognizes the content in the wireless audio signal by a known technology (e.g., a speech recognition technology), which is not described herein.
Furthermore, the "continuous human voice signal" means that the time period containing the human voice signal exceeds a preset threshold, that is, the processor 230 determines that the wireless audio signal includes the human voice content only if the time period containing the human voice signal exceeds the preset threshold.
In one embodiment, the correlation parameter refers to a peak value of a cross-correlation value between the out-of-ear audio signal and the wireless audio signal, i.e., a maximum value among absolute values of a plurality of cross-correlation values. Accordingly, the correlation detection herein refers to detecting the similarity of the time domain waveforms of the two audio signals, i.e., the ear-to-ear audio signal and the wireless audio signal, or the similarity of the distribution of the components of the frequency spectrums of the two audio signals.
Specifically, the correlation parameter can be calculated by formula (1):
where corr1 is the cross-correlation value, outer is the extra-aural audio signal picked up by the extra-aural microphone, audio2 is the wireless audio signal from another device, N is the number of samples of the audio signal, and the correlation parameter may be the peak value of corr1, i.e. the maximum value of the absolute value of corr 1.
In other embodiments, the correlation parameter may be calculated by equations (2) and (3):
in this embodiment, the cross-correlation result is normalized by the intensity of the off-ear audio signal acquired by the off-ear microphone, and ps1 is the first power (intensity) of the off-ear audio signal used for intensity normalization.
In still other embodiments, the correlation parameter may be calculated by equations (4) and (5):
in this embodiment, the cross-correlation result is normalized by the strength of the off-ear audio signal captured by the off-ear microphone and the strength of the wireless audio signal from the other wireless device, ps2 being the second power (strength) of the wireless audio signal used for strength normalization.
Preferably, in some embodiments, the correlation parameter is a maximum value among absolute values of a plurality of cross-correlation values between the off-ear audio signal and the wireless audio signal except for a cross-correlation value whose time delay is smaller than a certain threshold (sixth threshold). For corr1 (l) (l =0,1,2, \8230N), when calculating the peak value of the correlation value, the number of time delay sampling points N corresponding to l less than the specific threshold value is removed 1 Calculating corr1 (l) only (l = N) 1 ,N 1 +1, \8230n) the peak of these correlation values, i.e. the maximum of the absolute values. The reason for this is as follows: a part of the wireless audio signal played by the earphone speaker leaks out through the earphone so as to be collected by the ear microphone, but because the speaker is close to the ear microphone, the audio signal collected by the ear microphone due to the leakage is relatively short in time delay, such as within 1 millisecond or several milliseconds, compared with the wireless audio signal; thus removing a small delay in the correlation valueCan reduce or eliminate the occurrence of erroneous determination due to leakage of the wireless audio signal, i.e., the wireless audio signal that is not actually from the voice of the person nearby is determined to be the sound of the person nearby speaking.
Optionally, in some embodiments, the correlation parameter may also be obtained by a frequency domain method. The method specifically comprises the following steps:
first, frequency domain coherence coefficients of the ear-external audio signal and the wireless audio signal are calculated based on formula (6) in the frequency domain,
wherein, C y1y2 (w) is the frequency domain coherence coefficient,. Phi y1y2 (w) cross-power spectral density, Φ, of the off-the-ear audio signal and the wireless audio signal y1y1 (w) is the power spectral density, Φ, of the off-the-ear audio signal y2y2 (w) is the power spectral density of the wireless audio signal, w is the digital angular frequency.
Secondly, according to the calculated frequency domain coherence coefficient, calculating correlation parameters of the out-of-ear audio signal and the wireless audio signal based on formula (7),
wherein, Γ is a correlation parameter, C y1y2 (w) is the frequency domain coherence factor, ind1 is the lower limit of the detection frequency range, such as 300Hz, and ind2 is the upper limit of the detection frequency range, such as 3KHz.
In step S340, the processor 230 starts switching to switch the wireless headset to turn on the transparent transmission module 220 or the active noise reduction module 210 based on the correlation parameter determined in step S330.
Specifically, the processor 230 compares the determined correlation parameter with a preset threshold value, and takes a corresponding switching manner based on the result of the comparison.
In some embodiments, when the correlation parameter is greater than or equal to a preset first threshold value while the wireless headset is in a state where the transparent transmission module 220 is turned off, the transparent transmission module 220 is turned on and the active noise reduction module 210 is kept turned off, while the wireless audio signal is cut off or attenuated. Specifically, when the active noise reduction module 210 is turned on (e.g., when the feedforward active noise reduction filter 111 is turned on), the active noise reduction module 210 is turned off (i.e., the feedforward active noise reduction filter 111 is turned off), and the pass-through module 220 is turned on (e.g., the feedforward pass-through filter 114 is turned on); if the active noise reduction module 210 is not turned on before the switch, the active noise reduction module 210 should be kept turned off after the switch. In this embodiment, the correlation parameter exceeds the preset first threshold, which indicates that it is likely that the wireless audio signal received by the user wirelessly from another device is caused by speaking into a speaker near or in the same room as the user, and the user receives the speaker's voice and its ambient sound wirelessly and also receives the speaker's voice and its ambient sound through the physical space. Meanwhile, when the transparent transmission module 220 is switched on, the playing of the wireless audio signal is stopped or the volume of the wireless audio signal is reduced. In this way, in the pass-through mode, only the sound outside the ear is listened to, and the interference of the played wireless audio signal is avoided or reduced.
Here, turning on the transparent transmission module 220 is performed by turning on the feedforward transparent transmission filter 114, that is, turning on the feedforward transparent transmission filter 114 means turning on the transparent transmission module 220. However, in some embodiments, the feedback path (i.e., feedback pass-through filter 115) may be open at this time, while in other embodiments, the feedback path (i.e., feedback pass-through filter 115) may be closed at this time. Similarly, turning on the active noise reduction module 210 is done by turning on the feedforward active noise reduction filter 111, i.e. turning on the feedforward active noise reduction filter 111 means turning on the active noise reduction module 210. However, in some embodiments, the feedback path (i.e., feedback active noise reduction filter 112) may be open at this time, while in other embodiments, the feedback path (i.e., feedback active noise reduction filter 112) may be closed at this time.
In another embodiment, when the wireless headset is in a state where the pass-through module 220 is turned off, and the correlation parameter is greater than or equal to a second preset threshold and the intensity of the out-of-ear audio signal is greater than or equal to a third threshold, the pass-through module 220 is turned on and the active noise reduction module 210 is kept turned off, and the wireless audio signal is cut off or attenuated. Specifically, when the active noise reduction module 210 is turned on (i.e., the feedforward active noise reduction filter 111 is turned on), the active noise reduction module 210 is turned off (i.e., the feedforward active noise reduction filter 111 is turned off), and the pass-through module 220 is turned on (i.e., the feedforward pass-through filter 114 is turned on); if the active noise reduction module 210 is not turned on before the switch, the active noise reduction module 210 should be kept turned off after the switch. In this embodiment, if the strength of the audio signal collected by the out-of-ear microphone is high, the audio signal (i.e. the out-of-ear audio signal) received by the user through the physical space is high, and the interference of this audio signal is high, so that it is very necessary to switch. This may be the case where the speaker of the wireless audio signal is not only within the same physical space from the user, but may be closer or speaking louder. Meanwhile, when the transparent transmission module 220 is switched on, the playing of the wireless audio signal is stopped or the volume of the wireless audio signal is reduced. In the transparent transmission mode, only the sound outside the ear is listened to, and the interference of the played wireless audio signal is avoided.
Additionally, in some embodiments, with the wireless headset in a state where the active noise reduction module 210 is off, when the correlation parameter is greater than or equal to a fourth threshold and the intensity of the out-of-ear audio signal is less than a fifth threshold, the active noise reduction module 210 is turned on and the pass-through module 220 is kept off. Specifically, when the pass-through module 220 is turned on (i.e., the feedforward pass-through filter 114 is turned on), the pass-through module 220 is turned off (i.e., the feedforward pass-through filter 114 is turned off), and the active noise reduction module 210 is turned on (i.e., the feedforward active noise reduction filter 111 is turned on); if the transparent transmission module 220 is not turned on before the switch, the transparent transmission module 220 should be kept turned off after the switch. In this embodiment, if the strength of the out-of-ear audio signal collected by the out-of-ear microphone is low, the audio signal received and heard by the user through the physical space is weak, and the interference of the audio signal is small. This may be the case if the speaker of the wireless audio signal is within the same physical space but may be a little further away from the user, e.g. 5m, 10m, etc. At this time, the active noise reduction module 210 is turned on, so that the audio sounds such as the aural and foreign voices heard by the user through the physical space and the ambient sounds can be further reduced, and the listening feeling of the user listening to the wireless audio signal can be improved.
It should be understood that the first threshold, the second threshold and the fourth threshold regarding the correlation parameter in the above embodiments may be the same. Of course, in some embodiments, the first threshold, the second threshold, and the fourth threshold may also be partially different or different values from each other.
Similarly, the third threshold and the fifth threshold regarding the out-of-ear audio signal strength in the above-described embodiments may be the same. Of course, in some embodiments, the third and fifth thresholds may also be different.
Through the transparent transmission noise reduction control method provided by the disclosure, the working module of the earphone can be intelligently switched based on the correlation parameter between the wireless audio signal from another device played by the earphone loudspeaker 107 and the off-ear audio signal collected by the off-ear microphone, so that a user does not need to take off the earphone, and the user experience is improved.
Further, after the working modes of the wireless headset are switched based on the steps S310 to S340, the transparent transmission noise reduction control method 300 further includes:
and S360, continuously judging the correlation parameter between the out-of-ear audio signal and the wireless audio signal, and when the correlation parameter is smaller than a preset seventh threshold value, closing the transparent transmission module 220 and recovering to the working mode before switching.
It will be appreciated that a correlation parameter less than the seventh threshold (which may be the same value as the first threshold or a different value) will likely mean that the person is speaking, and thereafter may be non-peripheral, but far-end, and therefore will switch off the feed-forward pass-through filter 114, resume the pre-switch mode, and receive the wireless audio signal through the earpiece speaker 107.
In the embodiment of the present disclosure, the ear microphone and the feedforward microphone 101a may be the same microphone, and the audio signal collected by the feedforward microphone 101a is the ear audio signal. The feedforward microphone 101a may also be a group of microphones consisting of a plurality of microphones. The feedforward microphone 101a is typically located at an extra-aural position and may be used to pick up ambient sounds outside the ear. The extra-aural microphone may be the same microphone as the feedforward microphone 101a, may also include other extra-aural microphones, such as an earphone and possibly other talking microphones, and may also be an extra-aural microphone or a part of an extra-aural microphone. Alternatively, in some embodiments, the extra-aural microphone may be a separate other microphone than the feedforward microphone 101a or the talking microphone.
In addition, during the switching process of the processor 230, the feedforward active noise reduction filter 111 and the feedforward transparent filter 114 operate simultaneously, and during the time T1 of the switching process, the outputs of the feedforward active noise reduction filter 111 and the feedforward transparent filter 114 are weighted and finally output to the speaker 107. For example, during time T1, the weight output by the feedforward active noise reduction filter 111 is decreased from 1 to 0, and the weight output by the feedforward pass-through filter 114 is increased from 0 to 1, so as to complete the switching process and turn off the feedforward active noise reduction filter 111. The change of the weight in the time T1 may be linear or other function curves, but needs to be monotonous. Of course, it may be configured in the form of a table.
In some embodiments, various RISC (reduced instruction set computer) processors IP, available from ARM corporation and the like, may be utilized to perform corresponding functions as the processor 230 of the control system of the present application, with embedded systems (such as, but not limited to, SOCs) being utilized to implement the processing of the off-the-ear audio signals and the wireless audio signals. Specifically, there are many modules on commercially available modules (IPs), such as, but not limited to, a memory (the memory may be a memory or an extension memory externally connected to the IP), various communication modules (e.g., bluetooth module), codecs, buffers, and so on. Other components such as an antenna, microphone, speaker, etc. may be attached to the chip. The interface may be used to externally connect a microphone for collecting audio signals. A user can implement various communication modules, codecs, and the steps of the method of the present application, etc. by constructing an ASIC (application specific integrated circuit) based on purchased IP or an autonomously developed module in order to reduce power consumption and cost. Note that "transparent transmission noise reduction control system" in the present application is intended to mean a system for operating a target device in which the control system is located, and may generally mean, for example, a chip such as an ASIC implemented based on an SOC, but is not limited thereto, and any hardware circuit, software-processor configuration, and firmware combining software and hardware, which can implement the control system, may be used to implement the control system. For example, the processing performed by the processor 230 may be implemented as executable instructions executed by a RISC processor, may be formed as different hardware circuit modules, or may be formed as firmware of a combination of soft and hard, which are not described herein.
Moreover, although exemplary embodiments have been described herein, the scope thereof includes any and all embodiments based on the present application with equivalent elements, modifications, omissions, combinations (e.g., of various embodiments across), adaptations or alterations. The elements of the claims are to be interpreted broadly based on the language employed in the claims and not limited to examples described in the present specification or during the prosecution of the application, which examples are to be construed as non-exclusive. It is intended, therefore, that the specification and examples be considered as exemplary only, with a true scope and spirit being indicated by the following claims and their full scope of equivalents.
The above description is intended to be illustrative and not restrictive. For example, the above-described examples (or one or more versions thereof) may be used in combination with each other. For example, other embodiments may be used by those of ordinary skill in the art upon reading the above description. In addition, in the above detailed description, various features may be grouped together to streamline the application. This should not be interpreted as an intention that features of an application that are not claimed are essential to any claim. Rather, subject matter of the present application can lie in less than all features of a particular application's embodiments. Thus, the claims are hereby incorporated into the detailed description as examples or embodiments, with each claim standing on its own as a separate embodiment, and it is contemplated that such embodiments can be combined with each other in various combinations or permutations. The scope of the invention should be determined with reference to the appended claims, along with the full scope of equivalents to which such claims are entitled.
The above embodiments are only exemplary embodiments of the present application, and are not intended to limit the present invention, the scope of which is defined by the claims. Various modifications and equivalents may be made by those skilled in the art within the spirit and scope of the present application and such modifications and equivalents should also be considered as falling within the scope of the present invention.
Claims (12)
1. A transparent transmission noise reduction control method of a wireless earphone is characterized in that the wireless earphone comprises an out-of-ear microphone, a loudspeaker, a transparent transmission module and an active noise reduction module, and the transparent transmission noise reduction control method comprises the following steps:
acquiring an out-of-ear audio signal acquired by the out-of-ear microphone;
acquiring a wireless audio signal from another device played by the loudspeaker;
determining a correlation parameter between the out-of-ear audio signal and the wireless audio signal; and
and switching the wireless earphone to start the transparent transmission module or the active noise reduction module based on the correlation parameter.
2. The transparent transmission noise reduction control method according to claim 1, further comprising:
determining whether the wireless audio signal contains persistent human speech content, and if so, determining a correlation parameter between the out-of-ear audio signal and the wireless audio signal.
3. The transparent transmission noise reduction control method according to claim 2, wherein switching the wireless headset to turn on the transparent transmission module or the active noise reduction module based on the correlation parameter comprises:
and under the condition that the wireless earphone is in a state that the transparent transmission module is closed, when the correlation parameter is greater than or equal to a first threshold value, the transparent transmission module is started, the active noise reduction module is kept closed, and meanwhile, the wireless audio signal is cut off or weakened.
4. The transparent transmission noise reduction control method according to claim 2, wherein switching the wireless headset to turn on the transparent transmission module or the active noise reduction module based on the correlation parameter comprises:
when the wireless earphone is in a state that the transparent transmission module is closed, and when the correlation parameter is greater than or equal to a second threshold value and the strength of the out-of-ear audio signal is greater than or equal to a third threshold value, the transparent transmission module is started and the active noise reduction module is kept closed, and meanwhile, the wireless audio signal is cut off or weakened.
5. The transparent transmission noise reduction control method according to claim 2, wherein switching the wireless headset to turn on the transparent transmission module or the active noise reduction module based on the correlation parameter comprises:
when the wireless earphone is in a state that the active noise reduction module is closed, when the correlation parameter is greater than or equal to a fourth threshold and the strength of the out-of-ear audio signal is less than a fifth threshold, the active noise reduction module is started and the transparent transmission module is kept closed.
6. The pass-through noise reduction control method according to any one of claims 2 to 5, wherein the correlation parameter is a maximum value among absolute values of a plurality of cross-correlation values between the out-of-ear audio signal and the wireless audio signal.
7. The pass-through noise reduction control method according to claim 6, wherein the correlation parameter is a maximum value among absolute values of a plurality of cross-correlation values between the out-of-ear audio signal and the wireless audio signal except for a cross-correlation value whose time delay is smaller than a sixth threshold value.
8. The transparent transmission noise reduction control method according to any one of claims 2 to 5, wherein the correlation parameter is calculated by a frequency domain method.
9. The transparent transmission noise reduction control method according to claim 3 or 4, further comprising:
and continuously judging the correlation parameter between the out-of-ear audio signal and the wireless audio signal, and when the correlation parameter is smaller than a seventh threshold value, closing the transparent transmission module and recovering to the working mode before switching.
10. A pass-through noise reduction control system of a wireless headset, the pass-through noise reduction control system comprising:
a pass-through module configured to pass-through the wireless headset;
an active noise reduction module configured to actively noise reduce the wireless headset; and
a processor configured to execute the pass-through noise reduction control method according to any one of claims 1 to 9.
11. A wireless headset comprising the transparent transmission noise reduction control system according to claim 10.
12. The wireless headset of claim 11, wherein the wireless headset comprises any one of an in-ear headset and a semi-in-ear headset.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211699380.3A CN115866474A (en) | 2022-12-28 | 2022-12-28 | Transparent transmission noise reduction control method and system of wireless earphone and wireless earphone |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211699380.3A CN115866474A (en) | 2022-12-28 | 2022-12-28 | Transparent transmission noise reduction control method and system of wireless earphone and wireless earphone |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115866474A true CN115866474A (en) | 2023-03-28 |
Family
ID=85655555
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211699380.3A Pending CN115866474A (en) | 2022-12-28 | 2022-12-28 | Transparent transmission noise reduction control method and system of wireless earphone and wireless earphone |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115866474A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116980798A (en) * | 2023-09-20 | 2023-10-31 | 彼赛芬科技(深圳)有限公司 | Permeation mode adjusting device of wireless earphone and wireless earphone |
-
2022
- 2022-12-28 CN CN202211699380.3A patent/CN115866474A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116980798A (en) * | 2023-09-20 | 2023-10-31 | 彼赛芬科技(深圳)有限公司 | Permeation mode adjusting device of wireless earphone and wireless earphone |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7098771B2 (en) | Audio signal processing for noise reduction | |
| CN111902866B (en) | Echo control in binaural adaptive noise cancellation system in headphones | |
| US10957301B2 (en) | Headset with active noise cancellation | |
| US9240195B2 (en) | Speech enhancing method and device, and denoising communication headphone enhancing method and device, and denoising communication headphones | |
| CN111464905A (en) | Hearing enhancement method and system based on intelligent wearable device and wearable device | |
| CN109195042B (en) | Low-power-consumption efficient noise reduction earphone and noise reduction system | |
| CN113630684B (en) | Earphone with active noise reduction function and noise reduction method thereof | |
| US20240080609A1 (en) | Systems, apparatus, and methods for acoustic transparency | |
| WO2011158506A1 (en) | Hearing aid, signal processing method and program | |
| CN111935584A (en) | Wind noise processing method and device for wireless earphone assembly and earphone | |
| CN111683319A (en) | Call pickup noise reduction method, earphone and storage medium | |
| KR20110107833A (en) | In-ear detection of acoustics for the earpiece | |
| CN110972018B (en) | Method and system for carrying out transparent transmission on earphone and earphone | |
| CN109218879A (en) | Headphone, method and computer-readable medium for headphone | |
| CN116193315A (en) | Switching control method and system of wireless earphone and wireless earphone | |
| US20090285422A1 (en) | Method for operating a hearing device and hearing device | |
| CN115866474A (en) | Transparent transmission noise reduction control method and system of wireless earphone and wireless earphone | |
| CN113645533B (en) | Active noise reduction earphone and noise reduction method thereof | |
| CN113038318B (en) | A kind of voice signal processing method and device | |
| WO2021129196A1 (en) | Voice signal processing method and device | |
| US20240312474A1 (en) | Environmental noise suppression method | |
| WO2021239254A1 (en) | A own voice detector of a hearing device | |
| US20250088793A1 (en) | Wearable audio devices with enhanced voice pickup | |
| US20250088794A1 (en) | Wearable audio devices with enhanced voice pickup | |
| US20240334125A1 (en) | Audio processing based on target signal-to-noise ratio |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |