CN120980400A - Wind noise reduction method, apparatus, and headphones for wireless headphone components - Google Patents

Abstract

This disclosure relates to a wind noise reduction method, apparatus, and earphone for a wireless earphone assembly, wherein the wireless earphone assembly includes a first earphone and a second earphone, the first earphone having a first microphone and the second earphone having a second microphone; the wind noise reduction method includes: acquiring a first audio signal and a second audio signal using the first microphone and the second microphone respectively; transmitting the first audio signal from the first earphone to the second earphone; detecting wind noise in the surrounding environment using the second earphone based on the first audio signal and the second audio signal; and, upon detection of wind noise, performing noise reduction processing on the wind noise by the wireless earphone assembly. This disclosure reduces the impact of wind noise on the earphone noise reduction system by detecting wind noise in the surrounding environment and performing timely noise reduction processing on the detected wind noise, thereby improving the noise reduction effect of the earphone and enhancing the user's listening experience.

Description

Wind noise reduction method, apparatus, and headphones for wireless headphone components

This application is a divisional application of Chinese invention patent application No. 202010870771.1, filed on August 26, 2020, entitled "Wind noise reduction method, apparatus and earphone for wireless earphone assembly".

Technical Field

This disclosure relates to the field of headphones, and more specifically, to a method, apparatus, and headphones for wind noise reduction in wireless headphone components.

Background Technology

With social progress and the improvement of people's living standards, headphones have become an indispensable part of daily life. For example, headphones with active noise cancellation allow users to enjoy a comfortable noise-canceling experience in various noisy environments such as airports, subways, airplanes, and restaurants; in scenarios where external speech or ambient noise needs to be received, pass-through headphones allow the wearer to better receive external speech or ambient noise. Wireless headphones are increasingly gaining widespread market and customer acceptance. However, when using the aforementioned wireless headphones (such as active noise-canceling headphones, pass-through headphones, or when the wearer is wearing wireless hearing aids), external wind noise can severely affect the noise cancellation effect of the wireless headphones (manifesting in active noise cancellation, pass-through, and hearing aid aspects), thus affecting the wearer's listening experience. Obviously, existing headphones cannot solve the above problems.

Summary of the Invention

This disclosure is provided to address the aforementioned problems existing in the prior art.

This disclosure provides a wind noise processing solution for wireless headphone assemblies. The solution utilizes the individual microphones on different earpieces of the wireless headphone assembly to collect audio signals, enabling convenient, rapid, and accurate detection of wind noise in the surrounding environment. The detected wind noise is then promptly processed for noise reduction, thereby reducing the impact of wind noise on the headphone noise reduction system, improving the noise reduction effect of the headphones, and enhancing the user's listening experience.

According to a first aspect of this disclosure, a wind noise reduction method for a wireless earphone assembly is provided, wherein the wireless earphone assembly includes a first earphone and a second earphone, the first earphone having a first microphone and the second earphone having a second microphone; the wind noise reduction method includes: acquiring a first audio signal and a second audio signal using the first microphone and the second microphone respectively; transmitting data of the first audio signal from the first earphone to the second earphone; detecting wind noise in the scene using the second earphone based on the first audio signal and the second audio signal; and, if wind noise is detected, performing noise reduction processing on the wind noise by the wireless earphone assembly.

The wind noise reduction method described above for wireless headphone components detects wind noise in the surrounding environment and performs timely noise reduction processing on the detected wind noise, thereby reducing the impact of wind noise on the headphone noise reduction system, improving the noise reduction effect of the headphones, and enhancing the user's listening experience.

According to a second aspect of this disclosure, a wind noise processing device for a wireless earphone assembly is provided, wherein the wireless earphone assembly includes a first earphone and a second earphone, the first earphone having a first microphone and the second earphone having a second microphone; the wind noise processing device includes: a signal acquisition unit configured to acquire a first audio signal and a second audio signal using the first microphone and the second microphone, respectively; a signal transmission unit configured to transmit data of the first audio signal to the second earphone using the first earphone; a wind noise detection unit configured to detect wind noise in a scene using the second earphone based on the first audio signal and the second audio signal; and a noise reduction processing unit configured to perform noise reduction processing on the wind noise using the wireless earphone assembly when wind noise is detected.

The aforementioned wind noise reduction device for wireless headphone components detects wind noise in the surrounding environment and performs timely noise reduction processing on the detected wind noise, thereby reducing the impact of wind noise on the headphone noise reduction system, improving the noise reduction effect of the headphones, and enhancing the user's listening experience.

According to a third aspect of this disclosure, an earphone is provided, the earphone including at least a memory and a processor, the memory storing computer-executable instructions, and the processor implementing the steps of the wind noise processing method provided in the first aspect of this disclosure when executing the computer-executable instructions in the memory.

The aforementioned headphones detect wind noise in the surrounding environment and promptly process the detected wind noise to reduce its impact on the headphone's noise cancellation system, thereby improving the headphone's noise cancellation effect and enhancing the user's listening experience.

Attached Figure Description

In drawings that are not necessarily drawn to scale, the same reference numerals may describe similar parts in different views. The same reference numerals with or without letter suffixes may indicate different instances of similar parts. The drawings illustrate various embodiments generally by way of example rather than limitation, and are used, together with the description and claims, to explain the disclosed embodiments. Where appropriate, the same reference numerals are used in all drawings to refer to the same or similar parts. Such embodiments are illustrative and not intended to be exhaustive or exclusive embodiments of the apparatus or method.

Figure 1 illustrates a schematic diagram of the noise reduction (including wind noise) process of a wireless earphone assembly according to an embodiment of the present disclosure;

Figure 2 shows a flowchart of a wind noise reduction method for a wireless headphone assembly according to an embodiment of the present disclosure;

Figure 3 illustrates a flowchart of the step of determining wind noise in a wind noise processing method for a wireless earphone assembly according to an embodiment of the present disclosure; and

Figure 4 shows a schematic diagram of a wind noise reduction apparatus for a wireless headphone assembly according to an embodiment of the present disclosure.

Detailed Implementation

To enable those skilled in the art to better understand the technical solutions of this disclosure, the disclosure will be described in detail below with reference to the accompanying drawings and specific embodiments. The embodiments of this disclosure will be further described in detail below with reference to the accompanying drawings and specific examples, but this is not intended to limit the disclosure. If there is no necessary sequential relationship between the various steps described herein, the order in which they are described as examples should not be considered a limitation. Those skilled in the art should understand that the order can be adjusted as long as it does not disrupt the logical coherence between them and render the entire process impossible.

Figure 1 illustrates a schematic diagram of a noise reduction (including wind noise) process for a wireless earphone assembly according to an embodiment of the present disclosure. As shown in Figure 1, in 100, the wireless earphone implements an active noise reduction process through a feedforward path and a feedback path. In some embodiments, on the feedforward path, an external earphone 101a collects ambient noise and wind noise outside the earphone, wherein the external earphone 101a includes at least one external earphone in the wireless earphone assembly. The ambient noise collected by the external earphone 101a may include, in addition to noise generated by the surrounding environment, audio components that leak into the surrounding environment when the earphone speaker plays an audio signal, and these audio components are considered part of the ambient noise. The collected wind noise and ambient noise are processed by gain processing of analog gain 102a and analog-to-digital conversion of first analog-to-digital converter 103a, and then transmitted to a first low-pass and downsampling filter 104a. The first low-pass and downsampling filter 104a can reduce the filter sampling rate, thereby reducing power consumption and reducing the filter order, thereby reducing the area of the noise reduction chip and reducing cost. Subsequently, the wind noise and ambient noise signals that have passed through the first low-pass and downsampling filter 104a are filtered by the feedforward filter 111 to reduce the wind noise and ambient noise collected by the external microphone 101a. The noise-reduced wind noise and ambient noise signals are transmitted to the adder 109, and then converted from digital to analog by the digital-to-analog converter 106 before being played by the speaker 107. The wind noise and ambient noise played by the speaker 107, after being filtered by the feedforward filter, cancels out the wind noise and ambient noise that reach the ear, thus achieving noise reduction.

In some embodiments, on the feedback path, the in-ear microphone 101b in the wireless earphone assembly collects in-ear noise near the ear canal inside the earphone. The in-ear noise includes audio echo signals generated during audio signal playback and residual in-ear signals after air cancellation. The collected in-ear noise is processed by the analog gain 102b and the analog-to-digital converter 103b, and then transmitted to the second low-pass and downsampling filter 104b. The second low-pass and downsampling filter 104b reduces the filter sampling rate, thereby reducing power consumption and the filter order, which in turn reduces the area of the noise reduction chip and lowers the cost. Subsequently, the in-ear noise signal after passing through the second low-pass and downsampling filter 104b is transmitted to the adder 110. The audio signal 105 to be played is the audio signal to be transmitted to the speaker 107 for playback. On one hand, it is transmitted to the adder 109, where it undergoes digital-to-analog conversion processing by the digital-to-analog converter 106 before being played by the speaker 107. On the other hand, it is transmitted to the echo filter 112, which cancels the audio echo signal generated after the audio signal 105 is played by the speaker 107. The audio signal 105 filtered by the echo filter 112 is then sent to the adder 110. The adder 110 integrates the in-ear noise processed by the second low-pass and downsampling filter 104b with the audio signal processed by the echo filter 112, thus eliminating the influence of the audio echo signal on the feedback path. The adder 110 then transmits the integrated noise signal to the feedback filter 113 for filtering to achieve feedback noise reduction. The noise signal after feedback filtering is transmitted to the adder 109 after being limited by the limiter 108. After being processed by the digital-to-analog converter 106, it is played by the speaker 107.

The above describes the working principle of the wireless earphone assembly for active noise cancellation against wind noise and environmental noise based on embodiments of this disclosure. By filtering undesirable noises (wind noise and environmental noise) on the feedforward and feedback paths respectively, the active noise cancellation function of the wireless earphone assembly can be realized, improving the noise cancellation effect of the earphone and enhancing the user's listening experience. When wind noise in the surrounding environment, collected by the external microphone, affects the noise cancellation system of the earphone, an active noise cancellation scheme is needed to detect wind noise in real time and conveniently, and to promptly process the detected wind noise for noise reduction. This allows for timely adaptive adjustments to the noise environment, which is mixed with wind noise and changes in real time, to achieve better noise cancellation.

It should be noted that in some embodiments, the wireless earphone assembly shown in FIG1 includes, but is not limited to, noise reduction, and may also include pass-through. For example, the feedforward filter 111 includes both a filter with noise reduction function and a filter with pass-through function. This allows the wireless earphone assembly to perform wind noise filtering while having noise reduction and pass-through functions. The feedforward filter 111, echo filter 112, and feedback filter 113 can be adaptive filters or fixed filters, and can be IIR structures, FIR structures, or a combination of both.

Figure 2 shows a flowchart of a wind noise reduction method for a wireless earphone assembly according to an embodiment of the present disclosure, wherein the wireless earphone assembly includes a first earphone and a second earphone, the first earphone having a first microphone and the second earphone having a second microphone.

As shown in Figure 2, the process begins at step 201, where a first microphone and a second microphone are used to acquire a first audio signal and a second audio signal, respectively. The first microphone may include one or more external microphones located on the second earphone, and the second microphone may include one or more external microphones located on the second earphone. The first audio signal acquired by the first microphone includes wind noise and ambient sounds (including environmental noise, external voices, and alarm sounds) in the scene where the first earphone is located. The second audio signal acquired by the second microphone includes wind noise and ambient sounds (including environmental noise, external voices, and alarm sounds) in the scene where the second earphone is located. This disclosure detects wind noise by comparing the differences between the first audio signal and the second audio signal. When there is a significant difference between the first audio signal and the second audio signal, it can be determined that wind noise exists in the scene; while when the first audio signal and the second audio signal are highly consistent, it can be determined that there is no wind noise in the scene. Since the first and second earpieces in the wireless earphone assembly are in the same environment, the ambient sounds collected by the first and second microphones are highly consistent. That is, the audio components of ambient noise, external voices, and alarm sounds in the first and second audio signals are almost identical. By comparing the differences between the first and second audio signals, the differences in sound other than ambient noise (mainly wind noise) between the first and second microphones can be detected. This wind noise difference is precisely caused by the presence of wind noise. Specifically, due to differences in the position of the first microphone on the first earpiece and the second microphone on the second earpiece, as well as the different call states and postures of the earphone wearers, the wind noise at the first microphone and the second microphone at the second microphone can differ significantly.

Therefore, after the first microphone and the second microphone collect the first audio signal and the second audio signal, in step 202, the first earphone sends the data of the first audio signal to the second earphone (note that the first earphone and the second earphone can be interchanged, that is, the second earphone can send the data of the second audio signal to the first earphone). In some embodiments, the various earphones in the wireless earphone assembly, including but not limited to the second earphone and the second earphone, can communicate wirelessly through a wireless connection, which includes one of Bluetooth connection, near-field electromagnetic induction, and wireless communication through the human body as a medium.

Next, after the second earphone receives the first audio signal sent by the first earphone, in step 203, the second earphone detects wind noise in the surrounding scene based on the first and second audio signals. As mentioned before, when there is a significant difference between the first and second audio signals, it can be determined that wind noise exists in the surrounding scene. Therefore, in some embodiments, the presence of wind noise is determined based on the cross-correlation processing or convolution operation of the first and second audio signals. By utilizing the above steps 201-203, the audio signal acquisition by the various microphones inherent on the different earphones of the wireless earphone assembly is fully utilized, making it convenient, fast, and accurate to detect wind noise in the surrounding scene.

In step 204, if wind noise is detected, the wireless earphone assembly performs noise reduction processing on the wind noise. In some embodiments, the wireless earphone assembly may be one of an in-ear headphone, a semi-in-ear headphone, or a wireless hearing aid; and the wireless earphone assembly may include a filter assembly (e.g., a feedforward filter 111) to perform noise reduction processing on the detected wind noise. Specifically, for a wireless earphone assembly with noise reduction function, the gain of the feedforward filter in the filter assembly may be reduced, or the feedforward noise reduction function may be turned off; for a wireless earphone assembly with pass-through function, the gain of the pass-through filter in the filter assembly may be reduced, or the pass-through function may be turned off, or a high-pass filter may be added before the pass-through filter to filter out wind noise; when the wireless earphone assembly is a wireless hearing aid, the gain of the wireless hearing aid may be reduced, or a high-pass filter may be added to the hearing aid audio channel to filter out wind noise. Further, when the earphone wearer is in a call state, wind noise may be present in the uplink voice of each earphone in the wireless earphone assembly. At this time, a high-pass filter may be set in the filter assembly to filter out wind noise.

The above process enables the external microphone to collect audio signals from the scene at any time (at fixed time intervals or irregular intervals), and to determine the wind noise in the scene based on the results of cross-correlation processing or convolution operation of multiple collected audio signals, so as to perform noise reduction processing on the detected wind noise in a timely manner.

In some embodiments, the presence of wind noise in the scene is determined based on the cross-correlation processing or convolution operation of the first audio signal and the second audio signal. The calculation and determination process can be performed in the time domain or in the frequency domain.

When performing cross-correlation or convolution operations in the time domain to determine whether wind noise exists in the scene, the specific steps may include those shown in Figure 3 (Figure 3 shows a flowchart of the steps for determining wind noise in a wind noise processing method for a wireless earphone assembly according to an embodiment of this disclosure). In step 301, the peak value of the absolute value of the cross-correlation or convolution operation based on the first audio signal and the second audio signal is first taken. The cross-correlation processing can be performed in segments, that is, the signal used for cross-correlation processing is segmented, and cross-correlation processing is performed once every certain period of time (e.g., 20 milliseconds). (The convolution operation can also be performed in segments.) Subsequently, in step 302, the peak value of the absolute value is normalized based on the energy of the first audio signal and/or the second audio signal. In step 303, the normalized peak value is compared with a first threshold. When the normalized peak value is less than the first threshold, it means that the correlation between the first audio signal and the second audio signal is low, and it can be determined that wind noise exists in the scene. By normalizing the peak value of the absolute value, the influence of the energy deviation of the audio signal on wind noise detection can be eliminated, thereby improving the robustness and accuracy of wind noise detection. Furthermore, this also simplifies the selection and setting of the first threshold (the same first threshold can be set for audio signals of different energies), thereby reducing the computational load.

In some embodiments, the absence of wind noise in the scene can be determined based on the energy of at least one of the first and second audio signals. For example, when the signal energy of the first audio signal is below a certain threshold, it indicates that there is almost no audio energy in the signal, meaning that there is no wind noise in the scene where the first headphones are located. Similarly, the absence of wind noise in the scene can also be determined by comparing the energy of the second audio signal, the sum of the energies of the first and second audio signals, with a corresponding threshold (when the energy is below the corresponding threshold). By using the magnitude of the audio signal energy value, when the energy value is too low, various difference calculations, cross-correlation calculations, and subsequent comparisons between the first and second audio signals can be conveniently and quickly determined, thus eliminating the need for such calculations. Only when the energy value is above the threshold is there a possibility of wind noise in the scene. In this case, cross-correlation processing or convolution operations are used to further determine the difference between the first and second audio signals, thereby verifying the presence of wind noise. By introducing a prerequisite determination based on whether the energy value of the audio signal reaches the threshold at which wind noise is possible, a significant amount of unnecessary difference calculation load can be saved, and the absence of wind noise can be determined more accurately when the energy value is below the threshold.

When performing cross-correlation or convolution operations in the frequency domain to determine whether wind noise exists in the scene, the specific steps may include:

First, the frequency domain coherence coefficients of the first and second audio signals are calculated based on formula (1) in the frequency domain.

(1)

in, For frequency domain coherence coefficients, Let be the cross power spectral density of the first audio signal and the second audio signal. The power spectral density of the first audio signal. The power spectral density of the second audio signal. This refers to the digital angular frequency.

Secondly, based on the calculated frequency domain coherence coefficient, the wind noise detection quantity of the first audio signal and the second audio signal is calculated according to formula (2).

(2)

in, For frequency domain coherence coefficients, This is the lower limit of the detection frequency range. This represents the upper limit of the detection frequency range;

Finally, the wind noise detection value is compared with a second threshold. When the wind noise detection value is less than the second threshold, it indicates that the correlation between the first audio signal and the second audio signal is low, thus confirming the presence of wind noise in the scene. In some embodiments, since the coherence coefficient is calculated in segments, the detection value can be smoothed over time before wind noise is determined to improve the accuracy of wind noise detection.

The present disclosure provides several methods for determining whether wind noise exists in a scene in both the time domain and the frequency domain. These methods can quickly, effectively, and accurately detect wind noise in a scene, and have the advantages of low computational cost and simple implementation device.

In some embodiments, before the first earphone sends the first audio signal to the second earphone, the first earphone can detect the low-frequency energy of the first audio signal (for example, a low-energy filter can be set, and the first audio signal retains the portion with lower signal energy after passing through the low-energy filter). If the low-frequency energy of the first audio signal is less than a third threshold, or if the proportion of the low-frequency energy to its total energy is less than a fourth threshold, the first earphone does not send the first audio signal to the second earphone. This is because wind noise is usually in the low-frequency range. When the low-frequency energy in the first audio signal is low, or when the proportion of the low-frequency energy to the total energy is low, it can be determined that the wind noise in the scene is almost non-existent. In this case, the first earphone can choose not to send the first audio signal to the second earphone to avoid unnecessary waste of communication resources and subsequent computing resources.

In some embodiments, the second earpiece can first send an indication signal to the first earpiece, indicating that the first earpiece can send first audio data to the second earpiece. Subsequently, the first earpiece responds to the indication signal from the second earpiece and sends the first audio signal to the second earpiece. If the first earpiece does not send the first audio signal to the second earpiece because the low-frequency energy of the first audio signal is below a third threshold or the proportion of low-frequency energy to its total energy is less than a fourth threshold, the second earpiece can determine whether wind noise exists in the scene based on the characteristics of the second audio signal. Specifically, the second earpiece detects the low-frequency energy of the second audio signal. If the low-frequency energy of the second audio signal is greater than a fifth threshold or the proportion of low-frequency energy to its total energy is greater than a sixth threshold, this means that wind noise is likely present in the second audio signal. In this case, the second earpiece can send an indication signal to the first earpiece, instructing the first earpiece to send the first audio signal to the second earpiece, so that the second earpiece can further determine whether wind noise exists in the scene based on the first and second audio signals.

The wind noise reduction method described above for wireless headphone components detects wind noise in the surrounding environment and performs timely noise reduction processing on the detected wind noise, thereby reducing the impact of wind noise on the headphone noise reduction system, improving the noise reduction effect of the headphones, and enhancing the user's listening experience.

Figure 4 shows a schematic diagram of a wind noise processing apparatus for a wireless earphone assembly according to an embodiment of the present disclosure, wherein the wireless earphone assembly includes a first earphone and a second earphone, the first earphone having a first microphone and the second earphone having a second microphone. As shown in Figure 4, the wind noise processing apparatus includes: a signal acquisition unit 401, a signal transmission unit 402, a wind noise detection unit 403, and a noise reduction processing unit 404; optionally and additionally, it also includes an energy detection unit 405. The signal acquisition unit 401 is configured such that the first microphone and the second microphone respectively acquire a first audio signal and a second audio signal; the signal transmission unit 402 is configured to transmit data of the first audio signal to the second earphone using the first earphone; the wind noise detection unit 403 is configured to detect wind noise in the scene using the second earphone based on the first audio signal and the second audio signal; and the noise reduction processing unit 404 is configured to perform noise reduction processing on the wind noise using the wireless earphone assembly when wind noise is detected. In some embodiments, the signal acquisition unit 401 and the noise reduction processing unit 404 can be configured on both the first and second earphones, while the signal transmission unit 402 can be configured on the first earphone, and the wind noise detection unit 403 can be configured on the second earphone. In some embodiments, the second earphone can also transmit the data of the second audio signal to the first earphone, while the first earphone performs the wind noise detection calculation. Accordingly, the signal transmission unit 402 can also be configured on the second earphone, and the wind noise detection unit 403 can be configured on the first earphone. In still other embodiments, the signal transmission unit 402 and the wind noise detection unit 403 can be configured on both the first and second earphones, thereby enabling flexible switching of the audio signal data transmitter used for wind noise detection.

In some embodiments, the wind noise detection unit 403 is further configured to: determine whether wind noise exists in the scene based on the cross-correlation processing or convolution operation of the first audio signal and the second audio signal;

In some embodiments, the wind noise detection unit 403 is configured to determine whether wind noise exists in the scene based on the cross-correlation processing or convolution operation of the first audio signal and the second audio signal. This further includes: taking the peak value of the absolute value of the cross-correlation or convolution operation; normalizing the peak value of the absolute value based on the energy of the first audio signal and/or the second audio signal; and comparing the normalized peak value with a first threshold. If the peak value is less than the first threshold, it is determined that wind noise exists in the scene.

In some embodiments, the wind noise detection unit 403 is configured to determine whether wind noise exists in the scene based on cross-correlation processing or convolution operation of the first audio signal and the second audio signal, further including:

The frequency domain coherence coefficients of the first and second audio signals are calculated based on formula (3) in the frequency domain.

(3)

in, For frequency domain coherence coefficients, Let be the cross power spectral density of the first audio signal and the second audio signal. The power spectral density of the first audio signal. The power spectral density of the second audio signal. Digital angular frequency;

The wind noise detection values of the first and second audio signals are calculated based on formula (4).

(4)

in, For frequency domain coherence coefficients, This is the lower limit of the detection frequency range. This represents the upper limit of the detection frequency range;

The wind noise detection value is compared with the second threshold. When the wind noise detection value is less than the second threshold, it is determined that there is wind noise in the scene.

In some embodiments, the energy detection unit 405 is configured to detect the low-frequency energy of the first audio signal using the first earphone before the signal transmitting unit transmits the first audio signal to the second earphone using the first earphone. If the low-frequency energy of the first audio signal is less than a third threshold or the proportion of the low-frequency energy to its total energy is less than a fourth threshold, the first earphone does not transmit the first audio signal to the second earphone.

In some embodiments, the signal transmitting unit 402 is configured to transmit a first audio signal to the second earphone in response to an indication signal from the second earphone; and when the first earphone and the second earphone are not transmitting audio signals to each other, the energy detection unit 405 is configured to detect the low-frequency energy of the second audio signal using the second earphone, and if the low-frequency energy of the second audio signal is greater than a fifth threshold or the proportion of the low-frequency energy to its total energy is greater than a sixth threshold, the signal transmitting unit 402 is configured to transmit an indication signal to the first earphone using the second earphone.

In some embodiments, the wireless earphone assembly is one of an in-ear earphone, a semi-in-ear earphone, or a wireless hearing aid; the wireless earphone assembly includes a filter assembly configured to perform noise reduction processing on detected wind noise; the first earphone and the second earphone communicate via a wireless connection, the wireless connection including one of Bluetooth connection, near-field electromagnetic induction, or wireless communication through the human body as a medium.

In some embodiments, the wind noise processing unit 404 is configured to perform at least one of the following steps when wind noise is detected: for a wireless headphone assembly with noise reduction function, reduce the gain of the feedforward noise reduction filter in the filter assembly, or turn off the feedforward noise reduction function; for a wireless headphone assembly with pass-through function, reduce the gain of the pass-through filter in the filter assembly, or turn off the pass-through function, or add a high-pass filter before the pass-through filter to filter out wind noise; when the wireless headphone assembly is a wireless hearing aid, reduce the gain of the wireless hearing aid, or add a high-pass filter in the hearing aid audio channel to filter out wind noise.

In some embodiments, the wind noise processing unit 404 is configured to: when wind noise exists in the uplink voice of each earpiece of the wireless earphone assembly, set a high-pass filter in the filter assembly to filter out the wind noise.

The aforementioned wind noise reduction device for wireless headphone components detects wind noise in the surrounding environment and performs timely noise reduction processing on the detected wind noise, thereby reducing the impact of wind noise on the headphone noise reduction system, improving the noise reduction effect of the headphones, and enhancing the user's listening experience.

This disclosure also provides an earphone that includes at least a memory and a processor. The memory stores computer-executable instructions, and the processor, when executing the computer-executable instructions in the memory, implements the steps of the method provided in the first aspect of this disclosure. Various units according to this disclosure can be implemented as computer-executable instructions executable by a processor to perform corresponding processing steps, and these computer-executable instructions can be stored in the memory. In some embodiments, the processor can be implemented as any of an FPGA, ASIC, DSP chip, SOC (System-on-a-Chip), MPU, etc. The processor can be communicatively coupled to the memory and configured to execute the computer-executable instructions stored therein. The memory can include read-only memory (ROM), flash memory, random access memory (RAM), dynamic random access memory (DRAM) such as synchronous DRAM (SDRAM) or Rambus DRAM, static memory (e.g., flash memory, static random access memory), etc., on which the computer-executable instructions are stored in any format. In some embodiments, the computer-executable instructions can be accessed by the processor, read from the ROM or any other suitable storage location, and loaded into the RAM for the processor to execute.

The aforementioned headphones detect wind noise in the surrounding environment and promptly process the detected wind noise to reduce its impact on the headphone's noise cancellation system, thereby improving the headphone's noise cancellation effect and enhancing the user's listening experience.

Furthermore, although exemplary embodiments have been described herein, their scope includes any and all embodiments based on this disclosure that have equivalent elements, modifications, omissions, combinations (e.g., schemes involving intersections of various embodiments), adaptations, or alterations. Elements in the claims will be interpreted broadly based on the language used in the claims and are not limited to the examples described in this specification or during the implementation of this application, and such examples will be interpreted as non-exclusive. Therefore, this specification and examples are intended to be considered illustrative only, and the true scope and spirit are indicated by the following claims and the full scope of their equivalents.

The above description is intended to be illustrative and not restrictive. For example, the above examples (or one or more of them) can be used in combination with each other. Other embodiments may be used by those skilled in the art upon reading the above description. Furthermore, in the above detailed description, various features may be grouped together to simplify this disclosure. This should not be construed as an intention that a disclosed feature, which is not claimed, is necessary for any claim. Rather, the subject matter of the invention may be less than all the features of a particular disclosed embodiment. Thus, the following claims are incorporated herein by reference as examples or embodiments, wherein each claim is independently considered as a separate embodiment, and these embodiments are contemplated as being possible in various combinations or arrangements. The scope of the invention should be determined by reference to the appended claims and the full scope of their equivalents.

Claims (11)

1. A wind noise processing method for a wireless headset assembly, the wireless headset assembly including a first headset having a first microphone and a second headset having a second microphone, the wireless headset assembly including one of an in-ear/semi-in-ear wireless headset having a through-transmission function and a wireless hearing aid, the first headset and the second headset of the wireless headset assembly communicating through a wireless connection, the wind noise processing method comprising:

collecting a first audio signal and a second audio signal respectively by using the first microphone and the second microphone;

The first earphone detects low-frequency energy of the first audio signal, and when the low-frequency energy of the first audio signal is greater than or equal to a third threshold value or the ratio of the low-frequency energy to the total energy of the low-frequency energy is greater than or equal to a fourth threshold value, the data of the first audio signal is transmitted to the second earphone through the wireless connection by using a signal transmitting unit configured on the first earphone, or when the first earphone receives an indication signal from the second earphone through the wireless connection, the data of the first audio signal is transmitted to the second earphone through the wireless connection by using the signal transmitting unit;

Detecting, by the second earphone, low frequency energy of the second audio signal when the first earphone and the second earphone are not transmitting data of the audio signal to each other, and transmitting, by the second earphone, the indication signal to the first earphone through the wireless connection when the low frequency energy of the second audio signal is greater than a fifth threshold or a ratio of the low frequency energy to a total energy thereof is greater than a sixth threshold;

Detecting, by the second earphone, whether or not wind noise is present in the scene based on a result of a cross-correlation process or a convolution operation of the second audio signal and the first audio signal received through the wireless connection, using a wind noise detection unit provided in the second earphone, and

The wireless earphone assembly includes a filter assembly, and in the case of detecting wind noise, the wireless earphone assembly performs noise reduction processing on the detected wind noise by using the filter assembly, including:

For in-ear/semi-in-ear wireless headphones with a transmission function, reducing the gain of a transmission filter in the filter assembly, or closing the transmission function, or adding a high-pass filter in front of the transmission filter to filter wind noise;

For wireless hearing aids, the gain of the wireless hearing aid is reduced, or a high-pass filter is added to the hearing aid audio channel to filter out wind noise.

2. The wind noise processing method of claim 1, wherein determining whether wind noise is present in the scene based on a cross-correlation process or convolution operation of the first audio signal and the second audio signal further comprises:

Taking the peak value of the absolute value of the operation value of the cross-correlation or convolution operation;

Normalizing the peak value of the absolute value based on the energy of the first audio signal and/or the second audio signal, and

And comparing the normalized peak value with a first threshold value, and determining that wind noise exists in the scene when the normalized peak value is smaller than the first threshold value.

3. The wind noise processing method of claim 1, wherein determining whether wind noise is present in the scene based on a cross-correlation process or convolution operation of the first audio signal and the second audio signal further comprises:

Calculating frequency domain coherence coefficients of the first audio signal and the second audio signal on the frequency domain based on formula (1),

(1)

Wherein, the Is the coherence coefficient of the frequency domain,For the cross-power spectral density of the first audio signal and the second audio signal,For the power spectral density of the first audio signal,For the power spectral density of the second audio signal,A digital angular frequency;

Calculating wind noise detection amounts of the first audio signal and the second audio signal based on formula (2),

(2)

Wherein, the Is the coherence coefficient of the frequency domain,In order to detect the lower end of the frequency range,Is the upper limit of the detection frequency range;

And comparing the wind noise detection amount with a second threshold value, and determining that wind noise exists in the scene when the wind noise detection amount is smaller than the second threshold value.

4. The wind noise processing method according to claim 1, wherein noise reduction processing of the detected wind noise with the filter assembly further comprises:

And when wind noise exists in the uplink voice of each earphone in the wireless earphone assembly, a high-pass filter is arranged in the filter assembly to filter the wind noise.

5. The wind noise processing method of claim 1, wherein the wireless connection comprises one of a bluetooth connection, a near field electromagnetic induction, and a wireless communication through a human body as a medium.

6. A wind noise processing apparatus for a wireless headset assembly, the wireless headset assembly including a first headset having a first microphone and a second headset having a second microphone, the wind noise processing apparatus comprising one of an in-ear/semi-in-ear wireless headset having a through-transmission function and a wireless hearing aid, the first headset and the second headset of the wireless headset assembly communicating through a wireless connection, the wind noise processing apparatus comprising:

a signal acquisition unit configured in the first earphone and the second earphone and configured to cause the first microphone and the second microphone to acquire a first audio signal and a second audio signal, respectively;

An energy detection unit configured to detect low frequency energy of the first audio signal by the first earphone, transmit data of the first audio signal to the second earphone via the wireless connection when the low frequency energy of the first audio signal is greater than or equal to a third threshold or a proportion of the low frequency energy to the total energy thereof is greater than or equal to a fourth threshold, transmit an indication signal to the first earphone via the wireless connection when the low frequency energy of the second audio signal is greater than or equal to a fifth threshold or a proportion of the low frequency energy to the total energy thereof is greater than or equal to a sixth threshold, and transmit an indication signal to the second earphone via the wireless connection when the low frequency energy of the second audio signal is greater than or equal to the fourth threshold;

a wind noise detection unit configured in the second earphone and configured to detect whether wind noise exists in the scene based on a result of a cross-correlation process or convolution operation of the second audio signal and the first audio signal received through the wireless connection, and

A noise reduction processing unit configured in the first earphone and the second earphone, wherein the noise reduction processing unit includes a filter component, and the noise reduction processing unit is configured to perform noise reduction processing on detected wind noise by using the filter component when the wind noise is detected, and includes:

For in-ear/semi-in-ear wireless headphones with a transmission function, reducing the gain of a transmission filter in the filter assembly, or closing the transmission function, or adding a high-pass filter in front of the transmission filter to filter wind noise;

For wireless hearing aids, the gain of the wireless hearing aid is reduced, or a high-pass filter is added to the hearing aid audio channel to filter out wind noise.

7. The wind noise processing apparatus of claim 6, wherein the wind noise detection unit configured to determine whether wind noise is present in the scene based on a cross-correlation process or convolution operation of the first audio signal and the second audio signal further comprises:

Taking the peak value of the absolute value of the operation value of the cross-correlation or convolution operation;

Normalizing the peak value of the absolute value based on the energy of the first audio signal and/or the second audio signal, and

And comparing the normalized peak value with a first threshold value, and determining that wind noise exists in the scene when the normalized peak value is smaller than the first threshold value.

8. The wind noise processing apparatus of claim 6, wherein the wind noise detection unit configured to determine whether wind noise is present in the scene based on a cross-correlation process or convolution operation of the first audio signal and the second audio signal further comprises:

Calculating frequency domain coherence coefficients of the first audio signal and the second audio signal on the frequency domain based on formula (1),

(1)

Wherein, the Is the coherence coefficient of the frequency domain,For the cross-power spectral density of the first audio signal and the second audio signal,For the power spectral density of the first audio signal,For the power spectral density of the second audio signal,A digital angular frequency;

Calculating wind noise detection amounts of the first audio signal and the second audio signal based on formula (2),

(2)

Wherein, the Is the coherence coefficient of the frequency domain,In order to detect the lower end of the frequency range,Is the upper limit of the detection frequency range;

And comparing the wind noise detection amount with a second threshold value, and determining that wind noise exists in the scene when the wind noise detection amount is smaller than the second threshold value.

9. The wind noise treatment device of claim 6, wherein the wireless connection comprises one of a bluetooth connection, near field electromagnetic induction, wireless communication through a human body as a medium.

10. The wind noise processing apparatus of claim 6, wherein the wind noise processing unit is configured to:

when wind noise exists in the uplink voice of each earphone of the wireless earphone assembly, a high-pass filter is arranged in the filter assembly to filter the wind noise.

11. A headset comprising at least a memory, a processor having stored thereon computer executable instructions which when executed on the memory implement the steps in the wind noise treatment method for a wireless headset assembly of any of claims 1-5.