CN119400147A - Side-tone-based noise reduction method, active noise reduction earphone and storage medium - Google Patents

Abstract

The application provides a noise reduction method based on side noise, an active noise reduction earphone and a storage medium, wherein the noise reduction method based on side noise is applied to a processor of the active noise reduction earphone, the active noise reduction earphone comprises a side noise channel and a feedback noise reduction channel, a feedback noise reduction filter is used for filtering feedback audio signals, the noise reduction method based on side noise comprises the steps of responding to the starting of the side noise channel and controlling the side noise channel to output collected side noise signals to the feedback noise reduction channel, and when the feedback noise reduction channel receives the side noise signals, controlling the feedback noise reduction channel to offset side noise components in the feedback audio signals based on the side noise signals, and controlling the feedback noise reduction filter to filter the feedback audio signals offset the side noise components. The method can reduce the talking sound felt by the user when the earphone actively makes noise reduction.

Description

Side-tone-based noise reduction method, active noise reduction earphone and storage medium

Technical Field

The application relates to the field of voice noise reduction, in particular to a noise reduction method based on side noise, an active noise reduction earphone and a storage medium.

Background

The active noise reduction earphone has a good noise reduction function, and can shield the sound outside the earphone to a certain extent.

When a person speaks, if the person cannot hear the voice of the person speaking in the speaking process, the voice of the person speaking can be actively improved, and under the condition of voice conversation by wearing the active noise reduction earphone, the person cannot hear the voice of the person speaking, so that the condition of overlarge voice of the person speaking can be caused, and the listening feeling of the person and the feeling of other persons at the position of the wearer during conversation can be influenced.

Currently, some active noise reduction headphones provide a side sound function, where side sound refers to a phenomenon that a speaker hears his own voice through a receiver during a phone call. The presence of the sidetone allows the speaker to perceive his own voice, thereby adjusting the volume and tone of the speech, providing a natural conversation experience. In the conversation process, the audio signal collected by the feedback noise reduction channel of the active noise reduction earphone may include a side sound signal component, so that when the feedback noise reduction channel filters, the side sound is counteracted based on the side sound signal component, and a wearer cannot hear the side sound.

Disclosure of Invention

In view of the above, the present application is directed to providing a side-tone-based noise reduction method, an active noise reduction earphone, and a storage medium, so that the earphone can make a user hear a speaking sound when actively reducing noise, thereby making a conversation more natural.

In a first aspect, an embodiment of the present application provides a noise reduction method based on side noise, which is applied to a processor of an active noise reduction earphone, wherein the active noise reduction earphone comprises a side noise channel and a feedback noise reduction channel, the side noise channel comprises a side noise microphone for collecting side noise signals, the feedback noise reduction channel comprises a feedback microphone and a feedback noise reduction filter, the feedback microphone is used for collecting feedback audio signals, the feedback noise reduction filter is used for filtering the feedback audio signals, the noise reduction method based on side noise comprises the steps of responding to the opening of the side noise channel, controlling the side noise channel to output the collected side noise signals to the feedback noise reduction channel, and controlling the feedback noise reduction channel to offset side noise components in the feedback audio signals based on the side noise signals when the feedback noise reduction channel receives the side noise signals, and controlling the feedback noise reduction filter to filter the feedback audio signals offset the side noise components.

In the embodiment of the application, the side sound channel is arranged in the earphone and is different from the feedback noise reduction channel, the side sound channel can collect side sound, so that a side sound signal which can be used for counteracting side sound components in feedback audio signals collected by the feedback noise reduction channel is obtained, the feedback audio signals finally output by the feedback noise reduction channel can not filter the side sound in the ear after counteracting the side sound components in the feedback audio signals, the side sound can be reserved, and a user can listen to the side sound and adjust the volume of speaking according to the side sound, so that a more natural conversation experience is provided.

In one embodiment, the method further comprises detecting whether a wearer of the active noise reduction earphone is in a target state, wherein the target state represents that the wearer is in a conversation process and/or speaking, and opening the side sound channel if the wearer is in the target state, before controlling the side sound channel to output the collected side sound signals to the feedback noise reduction channel, in response to opening the side sound channel.

The side-tone channel provides side-tone signals to the feedback noise reduction channel to cancel side-tone components in the feedback audio signal, and the cancellation of the side-tone components reduces the noise reduction effect without listening to the side-tone, thereby affecting the listening experience. Therefore, in the embodiment of the application, whether the wearer is in the target state of receiving the side sound in the speaking or talking process can be judged, and the side sound channel is opened again in the target state. Therefore, the wearer can hear the side sound in the target state, and the self speaking volume is adjusted, so that a more natural conversation effect is provided. And in the non-target state, the side sound channel is not opened, the side sound channel can not play side sound in the ear, and the in-ear environment noise can not be increased due to the side sound channel, so that the noise reduction effect is better.

In one embodiment, after the detecting whether the wearer of the active noise reduction earphone is in the target state, the method further includes closing the sidetone channel if the wearer is not in the target state.

In this embodiment, if the wearer is not in the target state, the wearer is represented not to need to listen to the side sound, in which case the side sound channel is closed, so that the feedback noise reduction channel can perform filtering better, and meanwhile, power consumption generated by the side sound channel is reduced.

In one embodiment, the side sound channel further comprises a plurality of functional modules, a side sound gain module and a plurality of filter circuits, the side sound microphone and the plurality of functional modules are connected in series, the opening of the side sound channel comprises enabling the side sound microphone and the plurality of functional modules to be in a working state, and the closing of the side sound channel comprises closing at least one of the side sound microphone and the plurality of functional modules.

In this embodiment, the sidetone circuit is implemented by a hardware circuit, and the sidetone channel is in a transmission path where the audio signal is played to the speaker, so that the processor is not required to process the sidetone audio signal through a software program, and then plays the processed sidetone signal through the speaker, thereby reducing the delay of the sidetone channel and improving the listening experience of the sidetone signal. And the hardware circuit has higher response speed and processing efficiency, effectively improves the efficiency of the side sound signal for gain and filtering processing, and can also reduce the time delay of the side sound signal for gain and filtering processing. The side sound microphone and each functional module in the side sound channel are connected in series, and the side sound signal can not be output after one of the side sound channels is closed, so that when the side sound channel is closed, part of the functional modules in the side sound channel can be closed, and therefore, when the side sound channel is opened, only part of the closed circuits are required to be opened, and all circuits are not required to be waited to be opened, the efficiency of opening the side sound channel is improved, and the time delay of processing the side sound signal is reduced.

In an embodiment, the side sound channel further comprises a side sound gain module and a plurality of filter circuits, the side sound microphone, the side sound gain module and the filter circuits are connected in series, the side sound gain module is arranged between the side sound microphone and the filter circuits, or the side sound gain module is arranged between any two filter circuits, the side sound microphone, the side sound gain module and the filter circuits are all in a working state, the side sound channel is opened, the side sound channel is closed, the side sound gain module is adjusted to be larger than or equal to a first preset value, the side sound channel is closed, the side sound gain module is adjusted to be smaller than or equal to a second preset value, or the side sound gain module is enabled to be 0, and the second preset value is smaller than the first preset value.

In the embodiment of the application, when the gain of the side sound gain module in the side sound channel is too small (smaller than the preset value) or is 0, the side sound channel cannot output the side sound signal capable of being used for counteracting the side sound component, thereby realizing the closing of the side sound channel. Correspondingly, when the gain of the side sound gain module is larger than a first preset value, the side sound channel can normally output side sound signals. In the embodiment, each module and circuit in the gain side sound channel are always in a working state, and the side sound channel can be opened and closed only by adjusting the gain, so that the modules and circuits do not need to wait for starting when switching between closing and opening, and the time delay is effectively reduced.

In an embodiment, the active noise reduction earphone further comprises an in-ear microphone, and the detecting of whether the wearer of the active noise reduction earphone is in a target state comprises the steps of acquiring in-ear audio signals acquired by the in-ear microphone, detecting voice activity of the wearer based on the difference between the in-ear audio signals and the side sound signals, and determining whether the wearer is in the target state in which the wearer is speaking according to the detection result of the voice activity detection of the wearer.

When a wearer speaks, vibration occurs in the ear, so that the in-ear audio signal generates a change in phase and/or amplitude, therefore, in the embodiment of the application, the in-ear audio signal can be collected and compared with the side sound signal, if the difference between the in-ear audio signal and the side sound signal is smaller, the wearer is characterized as speaking, if the difference is larger, the wearer is characterized as not speaking, and possibly other people except the wearer are speaking, therefore, whether the wearer is speaking or not can be judged based on the difference between the in-ear audio signal and the side sound signal, so that whether the wearer is in a target state can be determined, the side sound channel can be opened or closed more accurately, and the listening experience is improved.

In an embodiment, the active noise reduction earphone is in communication connection with the intelligent device, and the detecting of whether the wearer of the active noise reduction earphone is in a target state comprises receiving data and/or instructions transmitted by the intelligent device, and judging whether the wearer is in the target state in a conversation process based on the data and/or instructions transmitted by the intelligent device.

When a wearer uses the intelligent device to communicate with the earphone, data and/or instructions are transmitted between the earphone and the intelligent device, so that in the embodiment of the application, whether the wearer is in a target state in the communication process can be judged through the transmitted data and/or instructions, the accuracy of target state identification is improved, and the accuracy of opening or closing of the side sound channel is further improved.

In an embodiment, the side sound microphones comprise a plurality of side sound channels, and before the side sound channels are controlled to output the collected side sound signals to the feedback noise reduction channel, the method further comprises the steps of respectively obtaining side sound sub-signals collected by the side sound microphones, and carrying out beam forming processing on the side sound sub-signals in a preset direction to obtain the side sound signals, wherein the preset direction is used for representing the direction that the active noise reduction earphone points to the mouth of a wearer.

In the embodiment of the application, the side sound signals are obtained by carrying out beam forming on the side sound signals collected by the plurality of side sound microphones, and the beam forming direction is the direction that the active noise reduction earphone points to the mouth of the wearer, so that the side sound signals can more accurately represent the speaking sound of the wearer, and the accuracy of filtering based on the side sound signals is improved.

In an embodiment, the side sound channel further includes a side sound filter, the side sound filter includes a band-pass filter, a bandwidth range of the band-pass filter is a preset bandwidth range, the preset bandwidth range represents a bandwidth range where human voice is located, and the side sound signal is a signal filtered by the band-pass filter.

In the embodiment of the application, the bandwidth range of the band-pass filter is the bandwidth range of the voice, so that the band-pass filter can more accurately retain the voice, filter other noises in the side sound signal, and better cancel the side sound component in the feedback audio signal based on the side sound signal, so that a wearer can better hear the noises and provide better noise reduction effect.

In one embodiment, the side tone channel comprises a side tone filter, the side tone filter comprises an FIR self-adaptive filter, the method further comprises the steps of obtaining the side tone signal, converting the side tone signal into a frequency domain signal, conducting voice noise reduction on the side tone signal of a frequency domain to obtain a frequency domain gain vector, conducting time domain up-conversion on the frequency domain gain vector to obtain a time domain gain filter, wherein the time domain gain filter comprises filter coefficients for updating the FIR self-adaptive filter, and mapping the filter coefficients of the time domain gain filter to the filter coefficients of the FIR self-adaptive filter to update the filter coefficients of the FIR self-adaptive filter.

The filter coefficients of the FIR adaptive filter are adjusted according to the transformation of the environment in which the active noise reduction earphone is located, thereby providing a noise reduction effect more adaptive to the environment. In the embodiment of the application, the updated filter coefficient of the FIR self-adaptive filter is calculated by the processor, so that the filter coefficient of the filter after the updating of the filter coefficient calculated by the processor is not affected by the filtering of the side sound signal by the FIR self-adaptive filter, and the time delay generated when the filtering of the side sound component is carried out when the updated filter coefficient is calculated is effectively reduced.

In a second aspect, an embodiment of the present application provides an active noise reduction earphone, including a side sound channel including a side sound microphone for collecting side sound signals, a feedback noise reduction channel including a feedback microphone for collecting feedback audio signals and a feedback noise reduction filter for filtering the feedback audio signals, and a processor for performing the side sound based noise reduction method according to any one of the first aspect.

In a third aspect, an embodiment of the present application provides a readable storage medium having instructions stored therein, the instructions being executable by a processor to implement the side-tone based noise reduction method according to any one of the first aspects.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the embodiments of the present application will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and should not be considered as limiting the scope, and other related drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic structural diagram of an active noise reduction earphone according to an embodiment of the present application;

fig. 2 is a schematic diagram of a noise reduction channel of an active noise reduction earphone according to an embodiment of the present application;

FIG. 3 is a schematic diagram of a side tone filter according to an embodiment of the present application;

FIG. 4 is a flowchart of a method for side-tone based noise reduction according to an embodiment of the present application;

FIG. 5 is a schematic diagram showing updating of filter coefficients of an FIR adaptive filter according to an embodiment of the present application;

fig. 6 is a schematic diagram of a noise reduction device based on side noise according to an embodiment of the application.

The active noise reduction earphone 100, the processor 110, the side channel 120, the side microphone 121, the side filter 122, the side gain module 1221, the iir configurable filter 1222, the fir adaptive filter 1223, the feedback noise reduction channel 130, the feedback microphone 131, the feedback noise reduction filter 132, the feedforward active noise reduction channel 140, the feedforward microphone 141, the feedforward noise reduction filter 142, the speaker 150, the audio echo module 161, the adc 163, the low pass and downsampling filter 164, the limiter 165, the dac 170, the side channel control module 510, the feedback noise reduction channel control module 520, and the noise reduction control module 530 are illustrated.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present application more apparent, the present application will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the application.

Referring to fig. 1, fig. 1 is a schematic diagram of an active noise reduction earphone according to an embodiment of the application. The present application provides an active noise reduction earphone, which may be a semi-in-ear earphone, an open earphone, a headphone, without limitation. In the embodiment of the application, the active noise reduction earphone can be one of a left earphone or a right earphone, and also can comprise the left earphone and the earphone at the same time.

The active noise reduction earphone 100 may include a processor 110, a side-tone channel 120, a feedback noise reduction channel 130, and a speaker 150. In some embodiments of the application, the active noise reduction earphone 100 may also include a feedforward noise reduction channel 140.

The processor 110 is respectively connected to the side-tone channel 120 and the feedback noise reduction channel 130, and is configured to execute the side-tone based noise reduction method provided by the present application, and the side-tone based noise reduction method will be developed hereinafter and will not be repeated here.

In embodiments of the present application, the side-tone channel 120, the feedforward noise reduction channel 140, and the feedback noise reduction channel 130 may all be referred to as noise reduction channels. Referring to fig. 2, fig. 2 is a schematic diagram of a noise reduction channel according to an embodiment of the application.

The side sound channel 120 includes a side sound microphone 121 and a side sound filter 122, where the side sound microphone 121 is used to collect side sound signals, and the side sound filter 122 may filter and reduce noise on the side sound signals to obtain the side sound signals after the filtering and noise reduction process. The sidetone microphone 121 is arranged outside the earphone for collecting sound outside the ear, and in particular for collecting sound directed in the direction of the wearer's mouth.

In some embodiments of the present application, the side microphone 121 includes a plurality of side microphones (not shown in the figures), different side microphones 121 are disposed at different positions of the active noise reduction earphone 100, and the different side microphones 121 may collect side sub-signals respectively, so that the processor 110 may perform beamforming processing according to the side sub-signals collected by the different side microphones 121, to obtain the side sub-signals subjected to beamforming processing.

In the embodiment of the present application, the side sound channel 120 can collect side sound signals, output the side sound signals to the DAC (digital-to-analog converter) 170 after filtering, and be converted into module signals by the DAC 170 to be played by the speaker 150.

In an embodiment of the present application, after the sidetone filter 122 is connected to the sidetone microphone 121, referring to fig. 3, fig. 3 is a schematic diagram of a structure of the sidetone filter 122 according to an embodiment of the present application, the sidetone filter 122 includes a sidetone gain module 1221 and a plurality of filter circuits, where the plurality of filter circuits may include an IIR configurable filter 1222 circuit, an FIR adaptive filter 1223 circuit, and so on. The sidetone microphone 121, the sidetone gain module 1221, and the plurality of filter circuits are connected in series, and the sidetone gain module 1221 is disposed between the sidetone microphone 121 and the filter circuits, or the sidetone gain module 1221 is disposed between any two of the filter circuits. That is, the side tone gain module 1221 may be connected in series at any position in the side tone filter 122, without limitation.

The feedback noise reduction channel 130 comprises a feedback microphone 131 and a feedback noise reduction filter 132, wherein the feedback microphone 131 is arranged on the inner side of the earphone and is close to the position of the auditory canal when worn and is used for collecting sound in the ear, namely collecting feedback audio signals, the feedback noise reduction filter 132 can perform noise reduction filtering processing on the feedback audio signals collected by the feedback microphone 131 to obtain feedback audio signals for filtering the audio signals in the ear, the feedback audio signals are converted into analog signals through the DAC 170 and then are played by the loudspeaker 150, and the played feedback audio signals can offset noise in the ear so as to perform filtering.

For ease of understanding, the principles of operation of the feedback noise reduction channel 130 are described herein. The feedback noise reduction channel 130 is used for collecting audio signals in a cavity between the earphone and the auditory canal and generating corresponding feedback audio signals, so that the loudspeaker 150 plays the feedback audio signals, thereby canceling the audio signals in the cavity and realizing noise reduction. In addition to the noise, the audio signal includes the audio component to be played of the audio to be played, which is to be kept to be listened to by the user, so that the audio to be played can be sent to the feedback noise reduction channel 130 through the audio echo module 161, so that the audio component to be played in the feedback noise reduction signal is counteracted by the audio to be played, so that the audio to be played in the cavity will not be counteracted based on the feedback noise reduction signal, and the audio to be played is kept.

Similarly, in the embodiment of the present application, the side sound signal collected by the side sound channel 120 is converted into an analog signal by the DAC 170 and then played by the speaker 150, and the feedback audio signal collected by the feedback microphone 131 may include a component of the side sound signal, so that the feedback noise reduction channel 130 may cancel the side sound signal by the feedback audio signal, so that the user cannot hear the side sound signal. Based on this, in the embodiment of the present application, the side sound signal collected by the side sound channel 120 may be output to the audio echo module 161 and output to the feedback noise reduction channel 130 through the audio echo module 161, so as to cancel the side sound component in the feedback noise reduction signal, so that the feedback noise reduction channel 130 does not cancel the side sound signal in the cavity, and the side sound signal is retained and listened to by the user.

Accordingly, in an embodiment of the present application, the active noise reduction earphone 100 may further include a feedforward noise reduction channel 140, where the feedforward noise reduction channel 140 includes a feedforward microphone 141 and a feedforward noise reduction filter 142, and the feedforward microphone 141 is disposed outside the ear and is used for collecting the sound outside the ear of the wearer, and the feedforward noise reduction filter 142 is used for filtering the audio signal collected by the feedforward microphone 141. The audio signal may be feedforward noise reduced through the feedforward noise reduction channel 140, and the feedforward noise reduction may be implemented with reference to the prior art, and is not further developed herein. The noise reduction effect of the active noise reduction earphone 100 can be improved through the feedforward noise reduction channel 140.

In an embodiment of the present application, the feedforward noise reduction filter 142 and the feedback noise reduction filter 132 may be adaptive filters or fixed filters, may be IIR-structured filters, FIR-structured filters, or IIR-structured and FIR-structured filters.

In some embodiments of the present application, portions of feedforward microphone 141 and portions of sidetone microphone 121 may be multiplexed, without limitation. For example, the active noise reduction earphone 100 includes N1 feedforward microphones 141, where N2 feedforward microphones 141 may be configured as side-tone microphones 121, N2 and N1 are both positive integers, and N2 is less than N1.

In other embodiments of the present application, the feedforward microphone 141 and the sidetone microphone 121 may also be relatively independent, without limitation.

Note that the aforementioned side microphone 121, feedforward microphone 141 and feedback microphone 131 are different in terms of the positions and functions provided in the active noise reduction earphone 100, and the structure and type of the microphones used may be the same or different, and are not limited thereto.

In other embodiments of the present application where the side-tone microphone 121 is an analog microphone and the feedforward microphone 141 and the feedback microphone 131 are digital microphones, the side-tone gain module and ADC 163 may not be provided in the feedforward noise reduction channel 140 and the feedback noise reduction channel 130.

In addition, as shown in fig. 2, in each noise reduction channel, a side tone gain module, an ADC 163 (Analog to Digital Converter, an analog-to-digital converter), and a low-pass and down-sampling filter 164 may be included, and the side tone gain module of each noise reduction channel may amplify a signal collected by the channel and convert the amplified signal into a digital signal through the ADC 163, and perform low-pass and down-sampling processing through the low-pass and down-sampling filter 164. The sidetone gain module, ADC 163 and low pass and downsampling filter 164 may refer to the prior art and are not further developed herein.

In an embodiment of the present application, each of the side-tone channel 120, the feedforward noise reduction channel 140, and the feedback noise reduction channel 130 may include a limiter 165, or the limiter 165 may not be provided, and is not limited herein.

The sidetone needs to be heard by the wearer, the sidetone is played through the speaker 150 after being processed by the sidetone channel 120, and in a real scene, the voice uttered by the user may be heard by the user through transmission of physical space, so this requires that the voice uttered by the user and the sidetone are as synchronous as possible, otherwise an echo phenomenon may occur, which requires that the output of the sidetone is as low as possible compared with the time delay between the uttered voices of the user.

Thus, in the embodiment of the present application, the side microphone 121, the side filter 122 and other functional modules of the side channel 120 may be implemented by hardware circuits, such as an analog add-on module, an ADC, a low-pass and down-sampling filter, and a side filter, which are all implemented by corresponding circuits or devices. Compared with a software program, the hardware circuit has lower time delay, so that timeliness of outputting and playing side sound signals can be improved, and the side sound signals are synchronized with the voice of a user as much as possible.

Next, a description will be given of a side-tone based noise reduction method provided by an embodiment of the present application. The side-tone based noise reduction method may be implemented as a software program that is executed by the aforementioned processor 110. Referring to fig. 4, fig. 4 is a flowchart of a method for reducing noise based on side noise according to an embodiment of the application. The noise reduction method based on the side sound comprises the following steps:

S110, responding to the opening of the side sound channel, controlling the side sound channel to output the collected side sound signals to the feedback noise reduction channel.

In this embodiment, after the sidetone channel 120 is opened, the sidetone microphone 121 may collect sidetones, and the sidetones are processed by the sidetone filter 122 and other modules and played by the speaker 150, so that a wearer can hear the sidetones, and further the wearer can adjust the volume of speaking according to the sidetones.

After the side sound channel 120 is opened, the cavity between the earphone and the ear canal has side sound played by the speaker 150, and when the feedback noise reduction signal is filtered by collecting the feedback audio signal, the feedback noise reduction signal carries a side sound component, so that the feedback noise reduction signal filters the side sound in the cavity, and the side sound heard by the wearer is greatly attenuated by the feedback noise reduction, so as to reduce the hearing feeling of the side sound.

In a practical scenario, the listening of the side sound is not applicable to all scenarios, for example, listening to music, watching video, the wearer of the earphone is more willing to be immersed in the sound of listening to the corresponding audio of the music or video, and the interference of the external environmental sound is reduced as much as possible, so in the embodiment of the present application, the opening condition of the side sound channel 120 may be set.

In an embodiment of the present application, before S110, it may be detected whether the wearer of the active noise reduction earphone 100 is in a target state, and if the wearer is in the target state, the side sound channel 120 is opened. Conversely, if the wearer is not in the target state, the sidetone passage 120 is closed.

The sidetone is used to cause the wearer to hear the sound of his own speech, so that sidetone channel 120 may be opened while the wearer is speaking, and correspondingly, the target state may be indicative that the wearer is speaking.

Similarly, the situation where the wearer is speaking is often the wearer is in the process of talking, and thus the target state may also be indicative of the wearer being in the process of talking. In embodiments of the present application, the call process includes, but is not limited to, dial-up calls, voice functions of various types of applications, online conferences, etc., without limitation.

Therefore, by judging whether the wearer is in the target state, the device can be started when the wearer needs to listen to the side sound, and a more natural conversation effect is provided, and the device is closed under the condition of no need of listening, so that the situation that the in-ear environmental noise is increased due to the fact that the side sound channel plays the side sound in the ear is reduced, and meanwhile, the situation that the side sound channel 120 is opened by mistake can be effectively reduced. In addition, in the case of closing the side tone channel 120, power consumption of the side tone channel 120 can be reduced.

The active noise reduction earphone 100 further includes an in-ear microphone, which may be multiplexed with the feedback microphone 131 or independent of each other. In one embodiment of the application, detecting whether the wearer is in a target state may include acquiring an in-ear audio signal acquired by an in-ear microphone, detecting voice activity of the wearer based on a difference between the in-ear audio signal and a side sound signal, and determining whether the wearer is in a target state of speaking according to a detection result of the voice activity detection of the wearer.

When the wearer speaks, the ear canal of the wearer vibrates, so that the phase and/or amplitude of the in-ear audio signal changes, and therefore, the in-ear audio signal can be collected, whether the in-ear audio signal matches with the side sound signal in phase and/or amplitude (such as that the similarity or the difference meets the preset requirement) is judged, and whether the user speaks is further judged.

Therefore, in the embodiment of the application, the voice activity of the wearer can be detected based on the difference between the in-ear audio signal and the side sound signal, for example, the difference can be that the in-ear audio signal and the side sound signal are calculated to be subjected to correlation processing to obtain the correlation of the two signals, or the dot multiplication processing is performed to obtain the dot multiplication result of the two signals, so as to determine the difference based on the correlation or the dot multiplication result, and then whether the wearer speaks is judged. It is also possible to determine whether the difference in phase and/or amplitude between the side tone signal and the in-ear audio signal is less than a preset threshold value, thereby determining whether the wearer speaks. In addition, the neural network model may be used to detect the voice activity of the wearer. The specific manner of voice activity detection may use existing techniques and is not expanded herein.

It should be distinguished that, unlike the voice activity detection object in the prior art, the present application performs voice activity detection for the wearer, but not for others, so in the embodiment of the present application, the correlation (or the difference) between the in-ear audio signal and the side-tone signal is used to perform voice detection to determine whether the wearer speaks.

Based on the detection result of the detection of the voice activity of the wearer, it is determined that the difference between the in-ear audio signal and the side sound signal is smaller than a set threshold, and it is determined that the in-ear audio signal and the side sound signal coincide, the high probability is that the wearer is speaking, and the side sound channel 120 may be opened at this time. Otherwise, if the difference between the in-ear audio signal and the side sound signal is greater than the preset threshold, the difference between the in-ear audio signal and the side sound signal is larger, and the collected side sound signal has a high probability of being the sound of other people or other sound sources at the position of the wearer, so that it can be determined that the user does not speak and the side sound channel 120 is closed.

The active noise reduction earphone 100 is in communication connection with the intelligent device to play control instructions, audio data, etc. sent by the intelligent device, and in an embodiment of the present application, detecting whether the wearer is in a target state may include receiving data and/or instructions transmitted by the intelligent device, and determining whether the wearer is in a target state in a conversation process based on the data and/or instructions transmitted by the intelligent device.

In an embodiment of the present application, the instruction transmitted by the smart device may include an instruction for instructing transmission of audio data of a call, and after receiving the instruction, the earphone determines a target state in a call process, so as to open the sidetone channel 120.

The data transmitted by the intelligent device can be call data, audio data and the like. The difference between the audio data of the call and the audio data such as music may refer to definition of the audio data, so in other embodiments of the present application, it may also be to detect the type of the transmitted data, and if the transmitted data is the audio data of the call, determine the target state in the call process, so as to open the sidetone channel 120.

As shown in fig. 2, the side gain module, the ADC 163, the low-pass and downsampling filter 164 and the limiter 165 of the side channel 120 are respectively different functional modules of the side channel 120, and the side microphone 121 and the functional modules are connected in series, and if the side channel 120 needs to be opened, the side microphone 121 and the functional modules need to be in a working state. Thus, opening the sidetone channel 120 includes placing the sidetone microphone 121, each of the plurality of functional modules, in an operative state.

Whereas if either of the side-tone microphone 121 and the functional modules is in a closed state, the side-tone channel 120 will not be operated, and thus, in the embodiment of the present application, closing the side-tone channel 120 includes closing at least one of the side-tone microphone 121 and the functional modules, that is, closing at least one of the side-tone microphone 121, the side-tone gain module, the ADC 163, the low-pass and downsampling filter 164 and the limiter 165.

In this way, the control logic can be simplified, and when the sidetone channel 120 needs to be opened, only the sidetone microphone 121 or part of the functional modules need to be controlled to be opened, and all the modules do not need to be opened again, so that the efficiency of opening the sidetone channel 120 is effectively improved, and the time delay is reduced.

In an embodiment of the present application, the side-tone channel 120 includes a side-tone gain module 1221, and the side-tone gain module 1221 is configured to amplify the side-tone signal. The side tone gain module 1221 may be a side tone gain module as shown in fig. 2. As shown in fig. 2, the sidetone channel 120 includes a low-pass and downsampling filter and a sidetone filter 122, as shown in fig. 3, the sidetone filter 122 includes an IIR configurable filter 1222 and an FIR adaptive filter 1223, that is, the sidetone channel 120 includes a plurality of filter circuits, in which a gain module is typically configured, in an embodiment of the present application, the sidetone gain module 1221 may be a gain module before or after or during the low-pass and downsampling filter module and the sidetone filter 122, that is, the sidetone gain module 1221 is disposed between the sidetone microphone 121 and the filter circuits, or the sidetone gain module 1221 is disposed between any two filter circuits.

In an embodiment in which the sidetone microphone 121, the sidetone gain module 1221 and the filter circuits are all in operation, opening the sidetone channel 120 includes adjusting the gain of the sidetone gain module 1221 to be greater than or equal to a first predetermined value. Conversely, closing the sidetone channel 120 includes adjusting the gain of the sidetone gain module 1221 to be less than or equal to the second preset value, or, making the gain of the sidetone gain module 0. Wherein the second preset value is smaller than the first preset value.

In this embodiment, the gain of the side sound gain module 1221 is made to be greater than or equal to the first preset value, so that the side sound channel 120 can normally output the side sound signal, and the gain of the side sound gain module 1221 is made to be less than or equal to the second preset value or 0, so that the side sound gain module 1221 cannot output the side sound signal that can be used to cancel the side sound component, thereby, the opening and closing of the side sound channel 120 can also be achieved.

In this embodiment, the opening and closing of the side tone channel 120 are achieved by adjusting the gain, and during the closing period, each device of the side tone channel 120 is still in an operating state, so that it is unnecessary to wait for the opening of each device, and the time delay of opening the side tone channel 120 is reduced.

In some embodiments of the present application, the side microphone 121 is an external microphone, which may collect other sounds except the speaking sound of the wearer, so in embodiments of the present application, a plurality of side microphones 121 may be disposed on the active noise reduction earphone 100, and before S110, the side microphone 121 may acquire the side sound signals collected by each side microphone 121, and perform beamforming processing in a preset direction on each side sound signal to obtain the side sound signal.

In this embodiment, the preset direction is used to represent the direction in which the active noise reduction earphone 100 points to the mouth of the wearer, and the beamforming processing is performed based on the preset direction, so that the side sound signal can represent the speaking sound of the wearer, thereby improving the accuracy of the side sound signal, and further improving the accuracy of canceling the side sound component based on the side sound signal. And, the side tone channel 120 may be enabled to provide a more accurate side tone to the wearer, reducing the likelihood of the wearer hearing noise.

In some embodiments of the present application, the preset direction may be an angle range representing the mouth of the wearer obtained through experiments performed by a large number of volunteers, or may be a direction/angle configured by the wearer according to the situation of the wearer, which is not limited herein.

As mentioned above, other noise may exist in the sound collected by the microphone outside the ear, so in other embodiments of the present application, a band-pass filter (implemented by a circuit) may be further disposed in the side-tone channel 120 or the side-tone filter 122, where the bandwidth range of the band-pass filter is a preset bandwidth range, and the preset bandwidth range characterizes the bandwidth range where the voice is located, so as to filter the side-tone signal based on the band-pass filter, so as to preserve the sound in the preset bandwidth range in the side-tone signal, thereby preserving the voice of the side-tone signal, filtering other noise, and improving the accuracy of the side-tone signal.

The preset bandwidth range may be a known human voice range, such as 300Hz to 3.5KHz, or may be obtained by testing a volunteer, or may be obtained by configuring a wearer according to his own speaking habit (such as different male voices and female voices, different voice size ranges of speaking voices of people with different habits, etc.), which is not limited herein.

S120, controlling the feedback noise reduction channel to counteract the side sound component in the feedback audio signal based on the side sound signal under the condition that the feedback noise reduction channel receives the side sound signal.

In this embodiment, the audio echo module 161 may output the side sound signal to the feedback noise reduction channel 130 to cancel the side sound component in the feedback audio signal collected by the feedback noise reduction channel 130, so that the feedback audio signal output by the feedback noise reduction channel 130 does not include the side sound component, and then the side sound cannot be cancelled and reduced, so that the wearer can hear the side sound.

The above procedure may refer to the working principles of the existing audio echo module 161 and the feedback noise reduction channel 130, and will not be expanded here.

And S130, controlling a feedback noise reduction filter to filter the feedback audio signal of the side noise component.

In this embodiment, the feedback noise reduction filter 132 may output the feedback audio signal with the side noise component cancelled to the DAC 170 after being processed by the feedback filter, and the feedback audio signal is converted into an analog signal by the DAC 170 and finally output and played by the speaker 150, so as to cancel the noise and implement feedback noise reduction. Reference is made in particular to the principle of feedback noise reduction, which is not extended here.

As previously mentioned, the playing of the sidetone requires a low delay so that the sound of the wearer speaking and the sidetone can be synchronously heard by the wearer, otherwise echo may occur. Thus, in the embodiment of the present application, the side tone channel 120 (including the side tone filter 122) is implemented by hardware, and the side tone filter 122 includes the FIR adaptive filter 1223, and the FIR adaptive filter 1223 needs to adjust its own filter coefficient according to the environment, thereby providing the noise reduction effect adapted to the environment.

In an embodiment of the present application, the processor 110 may further calculate filter coefficients of the FIR adaptive filter 1223 to be iteratively updated and update the FIR adaptive filter 1223, where the process may include obtaining a side tone signal, converting the side tone signal to a frequency domain signal, performing voice noise reduction on the side tone signal of the frequency domain to obtain a frequency domain gain vector, performing time domain up-conversion on the frequency domain gain vector to obtain a time domain gain filter, where the time domain gain filter includes filter coefficients updated for a filter of the FIR adaptive filter 1223 circuit, and mapping the filter coefficients of the time domain gain filter to the filter coefficients of the FIR adaptive filter 1223 to update the filter coefficients of the FIR adaptive filter 1223.

In this embodiment, as shown in fig. 5, on one hand, the side sound channel 120 is implemented by a hardware circuit, so that the time delay of collecting, processing and sending side sound signals is effectively reduced, and the synchronism with the speaking sound of the user is improved. On the other hand, the processor 110 calculates the updated filter coefficient of the FIR adaptive filter 1223, and the FIR adaptive filter 1223 itself does not need to perform calculation of the filter coefficient, so that the noise reduction function of the FIR adaptive filter 1223 and the filter coefficient updating function are independent from each other, do not affect each other, and avoid power consumption generated by the mutual effect when the two are executed by the same device.

In this embodiment, the acquired side tone signal may be the side tone signal output from the low pass and downsampling filter 164 of the side tone channel 120 (or the side tone signal input to the side tone filter 122). The side tone signal is a time domain signal, and may be converted into a frequency domain signal using fourier transform, short-time fourier transform, or the like.

The manner of voice noise reduction on the side tone signal in the frequency domain can refer to the prior art, such as frequency spectrum subtraction, wiener filtering, minimum mean square error short time spectrum amplitude estimation, self-adaptive noise elimination, deep learning method and the like, and is not expanded here. During voice noise reduction, the frequency domain signal (side tone signal of the frequency domain) is multiplied by the frequency domain gain vector to obtain a noise reduction result, where the frequency domain gain vector is calculated by the frequency domain signal and the various modes provided above, that is, the frequency domain gain vector is an intermediate result of the voice noise reduction process, and is not a noise reduction result.

The frequency domain gain vector is then converted in the time domain into data in the time domain, e.g., an inverse fourier transform may be used, and in the present application, the time domain gain vector may be referred to as a time domain gain filter, which also includes filter coefficients that update the filter of the FIR adaptive filter 1223 circuit.

Finally, the filter coefficients of the time domain gain filter are mapped to the FIR adaptive filter 1223, and the corresponding filter coefficients in the FIR adaptive filter 1223 are adjusted to update the FIR adaptive filter 1223.

In some embodiments of the present application, after the side tone signal is acquired, the side tone signal may be further subjected to low pass and downsampling to reduce the sampling rate, thereby improving the efficiency of calculating the updated filter coefficients. Accordingly, when the time domain gain filter is obtained, the time domain gain filter is up-sampled so that the sampling rate of the time domain gain filter matches the FIR adaptive filter 1223.

Based on the same inventive concept, the embodiment of the present application further provides a noise reduction device based on side noise, which can be applied to the processor 110 of the active noise reduction earphone 100.

Referring to fig. 6, fig. 6 is a schematic diagram of a noise reduction device based on side noise according to an embodiment of the application. The side-tone based noise reduction apparatus includes a side-tone channel control module 510, a feedback noise reduction channel control module 520, and a noise reduction module.

And the side sound channel control module 510 is configured to control the side sound channel 120 to output the collected side sound signal to the feedback noise reduction channel 130 in response to the opening of the side sound channel 120.

And a feedback noise reduction channel control module 520, configured to control the feedback noise reduction channel 130 to cancel a side sound component in the feedback audio signal based on the side sound signal, when the feedback noise reduction channel 130 receives the side sound signal.

The noise reduction control module 530 is configured to control the feedback noise reduction filter 132 to filter the feedback audio signal that cancels the side-tone component.

In one embodiment, the side channel control module 510 is configured to detect whether a wearer of the active noise reduction earphone 100 is in a target state, where the target state indicates that the wearer is in a conversation process and/or speaking, and if the wearer is in the target state, open the side channel 120.

In one embodiment, the side channel control module 510 is configured to close the side channel 120 if the wearer is not in the target state.

In one embodiment, the side sound channel 120 further includes a plurality of functional modules, a side sound gain module 1221 and a plurality of filter circuits, the side sound microphone 121 and a plurality of the functional modules are connected in series, and the side sound channel control module 510 is specifically configured to make the side sound microphone 121 and each of the plurality of functional modules in an operating state, so as to open the side sound channel 120, and close at least one of the side sound microphone 121 and the plurality of functional modules, so as to close the side sound channel 120.

In an embodiment, the sidetone channel 120 further includes a sidetone gain module 1221 and a plurality of filter circuits, where the sidetone microphone 121, the sidetone gain module 1221 and the plurality of filter circuits are connected in series, and the sidetone gain module 1221 is disposed between the sidetone microphone 121 and the filter circuits, or the sidetone gain module 1221 is disposed between any two of the filter circuits, and the sidetone microphone 121, the sidetone gain module 1221 and each of the filter circuits are all in a working state. The sidetone channel control module 510 is specifically configured to adjust the gain of the sidetone gain module 1221 to be greater than or equal to a first preset value to open the sidetone channel 120, and adjust the gain of the sidetone gain module 1221 to be less than or equal to a second preset value, or make the gain of the sidetone gain module be 0 to close the sidetone channel 120, where the second preset value is less than the first preset value.

In an embodiment, the active noise reduction earphone 100 further includes an in-ear microphone, and the sidetone channel control module 510 is configured to obtain an in-ear audio signal collected by the in-ear microphone, detect voice activity of the wearer based on a difference between the in-ear audio signal and the sidetone signal, and determine whether the wearer is in a target state of speaking according to a detection result of the voice activity detection of the wearer.

In an embodiment, the active noise reduction earphone 100 is in communication connection with an intelligent device, the sidetone channel control module 510 is configured to receive data and/or instructions transmitted by the intelligent device, and determine whether the target state of the call process is in based on the data and/or instructions transmitted by the intelligent device.

In an embodiment, the side-tone microphones 121 include a plurality of side-tone channel control modules 510 configured to respectively obtain side-tone sub-signals collected by the side-tone microphones 121, and perform beam forming processing on each of the side-tone sub-signals in a preset direction to obtain the side-tone signal, where the preset direction is used to indicate that the active noise reduction earphone 100 points to the direction of the mouth of the wearer.

In one embodiment, the sidetone channel 120 includes a sidetone filter 122, the sidetone filter 122 includes an FIR adaptive filter 1223, the sidetone channel control module 510 is further configured to obtain the sidetone signal, convert the sidetone signal into a frequency domain signal, perform speech noise reduction on the frequency domain sidetone signal to obtain a frequency domain gain vector, perform time domain up-conversion on the frequency domain gain vector to obtain a time domain gain filter, where the time domain gain filter includes filter coefficients for updating a filter of the FIR adaptive filter 1223 circuit, and map the filter coefficients of the time domain gain filter to the filter coefficients of the FIR adaptive filter 1223 to update the filter coefficients of the FIR adaptive filter 1223.

Based on the same inventive concept, the embodiments of the present application also provide a readable storage medium having instructions stored therein, the instructions being executable by the one or more processors 110 to implement the side-tone based noise reduction method as provided in the above embodiments.

The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a DVD (digital videodisc, digital versatile disk)), or a semiconductor medium (e.g., an SSD (Solid state disk) STATE DISK), or the like.

The side-tone based noise reduction method, if implemented in the form of a software functional module and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present application. The storage medium includes various media capable of storing program codes such as a U disk, a mobile hard disk, a ROM, a RAM, a magnetic disk or an optical disk.

In the embodiments provided in the present application, it should be understood that the disclosed method may be implemented in other manners as well. The functional modules in the embodiments of the present application may be integrated together to form a single part, or the functional modules may exist alone, or two or more modules may be integrated to form a single part.

The above embodiments can be freely combined without conflict, and the combined embodiments are covered in the protection scope of the present application.

The above detailed description of embodiments of the application provided in the accompanying drawings is not intended to limit the scope of the application as claimed, but is merely representative of selected embodiments of the application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.

It should be noted that like reference numerals and letters refer to like items in the following figures, and thus once an item is defined in one figure, no further definition or explanation thereof is necessary in the following figures.

In the description of the present application, it should also be noted that, unless explicitly specified and limited otherwise, the term "connected" is to be construed broadly, and for example, it may be a fixed connection, a removable connection, or an integral connection, it may be an electrical connection, it may be a direct connection, it may be an indirect connection through an intermediary, or it may be a communication between two elements. The specific meaning of the above terms in the present application will be understood in specific cases by those of ordinary skill in the art.

The above description is only an example of the present application and is not intended to limit the scope of the present application, and various modifications and variations will be apparent to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims (12)

1. A noise reduction method based on sidetone, characterized in that it is applied to a processor of an active noise reduction headset, the active noise reduction headset comprises a sidetone channel and a feedback noise reduction channel, the sidetone channel comprises a sidetone microphone for collecting sidetone signals; the feedback noise reduction channel comprises a feedback microphone and a feedback noise reduction filter, the feedback microphone is used to collect feedback audio signals, and the feedback noise reduction filter is used to filter the feedback audio signals; The sidetone-based noise reduction method comprises: In response to the sidetone channel being turned on, controlling the sidetone channel to output the collected sidetone signal to the feedback noise reduction channel; When the feedback noise reduction channel receives the sidetone signal, controlling the feedback noise reduction channel to cancel the sidetone component in the feedback audio signal based on the sidetone signal; The feedback noise reduction filter is controlled to filter the feedback audio signal that cancels the sidetone component. 2. The sidetone-based noise reduction method according to claim 1, characterized in that in response to the opening of the sidetone channel, the sidetone channel is controlled to output the collected sidetone signal to the feedback noise reduction channel, and the method further comprises: Detecting whether the wearer of the active noise reduction headset is in a target state, wherein the target state indicates that the wearer is in a call and/or is speaking; If the wearer is in the target state, the sidetone channel is turned on. 3. The sidetone-based noise reduction method according to claim 2, characterized in that after detecting whether the wearer of the active noise reduction headset is in the target state, the method further comprises: If the wearer is not in the target state, the sidetone channel is turned off. 4. The sidetone-based noise reduction method according to claim 3, characterized in that the sidetone channel further comprises a plurality of functional modules, a sidetone gain module and a plurality of filter circuits; the sidetone microphone and the plurality of the functional modules are connected in series; The opening of the sidetone channel comprises: making the sidetone microphone and each of the plurality of functional modules in a working state; The closing of the sidetone channel includes: closing the sidetone microphone and at least one of the plurality of functional modules. 5. The sidetone-based noise reduction method according to claim 3, characterized in that the sidetone channel further comprises a sidetone gain module and a plurality of filter circuits; the sidetone microphone, the sidetone gain module and the plurality of filter circuits are connected in series, and the sidetone gain module is arranged between the sidetone microphone and the filter circuit, or the sidetone gain module is arranged between any two of the filter circuits; The sidetone microphone, the sidetone gain module and each filter circuit are all in working state; The opening of the sidetone channel includes: adjusting the gain of the sidetone gain module to be greater than or equal to a first preset value; Closing the sidetone channel includes: adjusting the gain of the sidetone gain module to be less than or equal to a second preset value, or making the gain of the sidetone gain module 0; the second preset value is less than the first preset value. 6. The sidetone-based noise reduction method according to claim 2, wherein the active noise reduction headset further comprises an in-ear microphone, and the step of detecting whether the wearer of the active noise reduction headset is in a target state comprises: Acquire an in-ear audio signal collected by the in-ear microphone; Performing wearer voice activity detection based on the difference between the in-ear audio signal and the sidetone signal; It is determined whether the wearer is in a target state of speaking according to a detection result of the wearer's voice activity detection. 7. The sidetone-based noise reduction method according to claim 2, wherein the active noise reduction headset is communicatively connected to a smart device; The detecting whether the wearer of the active noise reduction headset is in a target state includes: Receiving data and/or instructions transmitted by the smart device; Based on the data and/or instructions transmitted by the smart device, it is determined whether the call process is in the target state. 8. The sidetone-based noise reduction method according to claim 1, wherein the sidetone microphones include a plurality of sidetone microphones, and before the sidetone channel is controlled to output the collected sidetone signal to the feedback noise reduction channel, the method further comprises: Respectively acquiring the sidetone sub-signals collected by the sidetone microphones; A beamforming process is performed on each of the sidetone sub-signals in a preset direction to obtain the sidetone signal, wherein the preset direction is used to represent the direction in which the active noise reduction headset points to the wearer's mouth. 9. The sidetone-based noise reduction method according to claim 1, characterized in that the sidetone channel further comprises a sidetone filter, the sidetone filter comprises a bandpass filter, the bandwidth range of the bandpass filter is a preset bandwidth range, and the preset bandwidth range represents the bandwidth range of human voice; The sidetone signal is a signal filtered by the bandpass filter. 10. The sidetone-based noise reduction method according to any one of claims 1 to 9, characterized in that the sidetone channel includes a sidetone filter, the sidetone filter includes a FIR adaptive filter, and the method further includes: Acquiring the sidetone signal; Converting the sidetone signal into a frequency domain signal; Perform speech noise reduction on the sidetone signal in the frequency domain to obtain a frequency domain gain vector; Converting the frequency domain gain vector in the time domain to obtain a time domain gain filter; the time domain gain filter includes filter coefficients for updating the FIR adaptive filter; The filter coefficients of the time domain gain filter are mapped to the filter coefficients of the FIR adaptive filter to update the filter coefficients of the FIR adaptive filter. 11. An active noise reduction headset, comprising: A sidetone channel, including a sidetone microphone for collecting a sidetone signal; A feedback noise reduction channel, comprising a feedback microphone and a feedback noise reduction filter, wherein the feedback microphone is used to collect a feedback audio signal, and the feedback noise reduction filter is used to filter the feedback audio signal; A processor, configured to execute the sidetone-based noise reduction method according to any one of claims 1 to 10. 12. A readable storage medium, characterized in that the readable storage medium stores instructions, and the instructions can be executed by a processor to implement the sidetone-based noise reduction method according to any one of claims 1 to 10.