CN113507662B - Noise reduction processing method, apparatus, device, storage medium, and program - Google Patents
Noise reduction processing method, apparatus, device, storage medium, and program Download PDFInfo
- Publication number
- CN113507662B CN113507662B CN202110724510.3A CN202110724510A CN113507662B CN 113507662 B CN113507662 B CN 113507662B CN 202110724510 A CN202110724510 A CN 202110724510A CN 113507662 B CN113507662 B CN 113507662B
- Authority
- CN
- China
- Prior art keywords
- noise signal
- noise
- signal
- noise reduction
- earphone
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
- H04R1/1083—Reduction of ambient noise
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
- G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
- G10K11/1785—Methods, e.g. algorithms; Devices
- G10K11/17853—Methods, e.g. algorithms; Devices of the filter
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
- G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
- G10K11/1787—General system configurations
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K2210/00—Details of active noise control [ANC] covered by G10K11/178 but not provided for in any of its subgroups
- G10K2210/10—Applications
- G10K2210/108—Communication systems, e.g. where useful sound is kept and noise is cancelled
- G10K2210/1081—Earphones, e.g. for telephones, ear protectors or headsets
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K2210/00—Details of active noise control [ANC] covered by G10K11/178 but not provided for in any of its subgroups
- G10K2210/30—Means
- G10K2210/301—Computational
- G10K2210/3028—Filtering, e.g. Kalman filters or special analogue or digital filters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2460/00—Details of hearing devices, i.e. of ear- or headphones covered by H04R1/10 or H04R5/033 but not provided for in any of their subgroups, or of hearing aids covered by H04R25/00 but not provided for in any of its subgroups
- H04R2460/01—Hearing devices using active noise cancellation
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Soundproofing, Sound Blocking, And Sound Damping (AREA)
Abstract
The present application provides a noise reduction processing method, apparatus, device, storage medium, and program, the method including: the method comprises the steps of acquiring a first noise signal acquired by acquiring noise in an external environment of the auricle through a first microphone, acquiring a third noise signal acquired by acquiring noise in an internal environment of the auricle through a second microphone, determining a second noise signal according to the third noise signal, determining whether the oral cavity of a user wearing the noise reduction earphone vibrates or not according to the first noise signal and the second noise signal, controlling a feedback filter to stop working if the oral cavity of the user wearing the noise reduction earphone vibrates, and performing noise reduction processing on the noise reduction earphone through a feedforward filter. In the process, the feedback filter is controlled to stop working under the condition that the oral cavity of the user vibrates, so that the problem of reduction of the mixed noise reduction performance caused by the vibration of the oral cavity is solved.
Description
Technical Field
The present disclosure relates to the field of data processing technologies, and in particular, to a noise reduction processing method, apparatus, device, storage medium, and program.
Background
With the social progress and the improvement of the living standard of people, the earphone becomes an indispensable living article for people. The active noise reduction earphone has an active noise suppression function, and the working principle is as follows: the method comprises the steps of monitoring a noise signal in real time by using a microphone, generating a noise elimination signal with the phase opposite to that of the monitored noise signal in an earphone, and playing the noise elimination signal to human ears through a loudspeaker. Therefore, the noise signal and the noise eliminating signal are offset, so that the user can not hear the noise basically, and the purpose of noise reduction is achieved.
The active noise reduction earphone can be divided into a feedforward noise reduction earphone, a feedback noise reduction earphone and a mixed noise reduction earphone according to a system control mode. A first microphone is arranged outside the auricle of the hybrid noise reduction earphone, and a second microphone and a loudspeaker are arranged inside the auricle. The working principle of hybrid noise reduction is as follows: noise in the external environment of the auricle is collected through the first microphone, and noise reduction processing is carried out on collected noise signals through the feedforward filter. Under the influence of various factors, a residual noise signal may exist after the noise signal is subjected to noise reduction processing by the feedforward filter, so that the noise in the internal environment of the auricle can be collected by the second microphone, and the residual noise signal is further subjected to noise reduction processing by the feedback filter. The mixed noise reduction earphone can improve the noise reduction effect by adopting the secondary noise reduction treatment of feedforward control and feedback control.
However, in some scenarios, when the user wears headphones to eat, speak, and the like, a behavior that causes mouth vibration, the mouth vibration may cause the performance of the above-described hybrid noise reduction to be degraded.
Disclosure of Invention
The embodiment of the application provides a noise reduction processing method, a noise reduction processing device, noise reduction processing equipment, a storage medium and a program, and aims to solve the problem that when a user wears a noise reduction earphone to carry out oral vibration behavior, the mixed noise reduction performance is reduced.
In a first aspect, the present application provides a noise reduction processing method, applied to a noise reduction earphone, where a first microphone is disposed outside an auricle of the noise reduction earphone, and a second microphone is disposed inside the auricle of the noise reduction earphone, where the method includes:
acquiring a first noise signal acquired by acquiring noise in an external environment of an auricle through the first microphone;
acquiring a third noise signal acquired by acquiring noise in the internal environment of the auricle through the second microphone, and determining a second noise signal according to the third noise signal;
determining whether the mouth of a user wearing the noise reduction earphone vibrates according to the first noise signal and the second noise signal;
and if the oral cavity of the user wearing the noise reduction earphone is determined to vibrate, controlling a feedback filter to stop working, and carrying out noise reduction treatment on the noise reduction earphone by using a feedforward filter.
In one possible implementation, determining whether the mouth of the user wearing the noise reduction earphone vibrates according to the first noise signal and the second noise signal includes:
determining a relationship parameter between the first noise signal and the second noise signal;
and determining whether the oral cavity of the user wearing the noise reduction earphone vibrates or not according to the relation parameter.
In a possible implementation, the relationship parameter includes one or more of the following:
a correlation coefficient between the first noise signal and the second noise signal;
an energy of a difference between the first noise signal and the second noise signal;
a difference between an energy of the first noise signal and an energy of the second noise signal.
In one possible implementation, determining whether the mouth of the user wearing the noise reduction earphone vibrates according to the relationship parameter includes:
determining that the oral cavity of the user wearing the noise reduction earphone vibrates if the relation parameter satisfies one or more of the following conditions:
a correlation coefficient between the first noise signal and the second noise signal is less than or equal to a first threshold;
an energy of a difference between the first noise signal and the second noise signal is greater than or equal to a second threshold;
a difference between the energy of the first noise signal and the energy of the second noise signal is less than or equal to a third threshold.
In one possible implementation, determining a relationship parameter between the first noise signal and the second noise signal includes:
respectively down-sampling the first noise signal and the second noise signal to a target frequency band, wherein the target frequency band is a frequency band corresponding to oral cavity vibration;
and determining the relation parameter according to the first noise signal and the second noise signal after down sampling.
In a possible implementation manner, a speaker is further disposed in an auricle of the noise reduction earphone, and a second noise signal is determined according to the third noise signal, including:
acquiring a fourth noise signal input to the loudspeaker;
determining the second noise signal according to the third noise signal and the fourth noise signal.
In one possible implementation, determining the second noise signal according to the third noise signal and the fourth noise signal includes:
performing signal estimation processing on the fourth noise signal through an estimation transfer function corresponding to a second transmission path to obtain an estimated noise signal; wherein the second transmission path is a transmission path from the speaker to the second microphone;
and obtaining the second noise signal according to the third noise signal and the estimated noise signal.
In one possible implementation manner, a speaker is further disposed in an auricle of the noise reduction headphone, and the noise reduction headphone is subjected to noise reduction processing by using a feedforward filter, including:
filtering the first noise signal through the feedforward filter to obtain a first filtered signal;
and playing the first filtering signal through the loudspeaker to realize the noise reduction treatment of the noise reduction earphone.
In one possible implementation manner, after determining whether the mouth of the user wearing the noise reduction earphone vibrates according to the first noise signal and the second noise signal, the method further includes:
and if the fact that the oral cavity of the user wearing the noise reduction earphone does not vibrate is determined, the noise reduction earphone is subjected to noise reduction processing by utilizing the feedforward filter and the feedback filter.
In one possible implementation manner, a speaker is further disposed in an auricle of the noise reduction headphone, and the noise reduction headphone is subjected to noise reduction processing by using the feedforward filter and the feedback filter, including:
filtering the first noise signal through the feedforward filter to obtain a first filtered signal;
filtering the second noise signal through the feedback filter to obtain a second filtered signal;
superposing the first filtering signal and the second filtering signal to obtain a third filtering signal;
and playing the third filtering signal through the loudspeaker to realize the noise reduction treatment of the noise reduction earphone.
In a second aspect, the present application provides a noise reduction processing apparatus, which is applied to a noise reduction earphone, a first microphone is disposed outside an auricle of the noise reduction earphone, a second microphone is disposed inside the auricle of the noise reduction earphone, and the apparatus includes:
the acquisition module is used for acquiring a first noise signal acquired by acquiring noise in an external environment of an auricle through the first microphone;
the first determining module is used for acquiring a third noise signal acquired by collecting noise in the internal environment of the auricle through the second microphone and determining a second noise signal according to the third noise signal;
a second determining module, configured to determine whether an oral cavity of a user wearing the noise reduction earphone vibrates according to the first noise signal and the second noise signal;
and the processing module is used for controlling the feedback filter to stop working if the oral cavity of the user wearing the noise reduction earphone is determined to vibrate, and performing noise reduction processing on the noise reduction earphone by using the feedforward filter.
In a possible implementation manner, the second determining module is specifically configured to:
determining a relationship parameter between the first noise signal and the second noise signal;
and determining whether the oral cavity of the user wearing the noise reduction earphone vibrates or not according to the relation parameters.
In a possible implementation, the relationship parameter includes one or more of the following:
a correlation coefficient between the first noise signal and the second noise signal;
an energy of a difference between the first noise signal and the second noise signal;
a difference between an energy of the first noise signal and an energy of the second noise signal.
In a possible implementation manner, the second determining module is specifically configured to:
determining that the oral cavity of the user wearing the noise reduction earphone vibrates if the relation parameter satisfies one or more of the following conditions:
a correlation coefficient between the first noise signal and the second noise signal is less than or equal to a first threshold;
an energy of a difference between the first noise signal and the second noise signal is greater than or equal to a second threshold;
a difference between the energy of the first noise signal and the energy of the second noise signal is less than a third threshold.
In a possible implementation manner, the second determining module is specifically configured to:
respectively down-sampling the first noise signal and the second noise signal to a target frequency band, wherein the target frequency band is a frequency band corresponding to oral cavity vibration;
and determining the relation parameter according to the first noise signal and the second noise signal after down sampling.
In a possible implementation manner, a speaker is further disposed in an auricle of the noise reduction earphone, and the first determining module is specifically configured to:
acquiring a fourth noise signal input to the speaker;
determining the second noise signal based on the third noise signal and the fourth noise signal.
In a possible implementation manner, the first determining module is specifically configured to:
performing signal estimation processing on the fourth noise signal through an estimation transfer function corresponding to a second transmission path to obtain an estimated noise signal; wherein the second transmission path is a transmission path from the speaker to the second microphone;
and obtaining the second noise signal according to the third noise signal and the estimated noise signal.
In a possible implementation manner, a speaker is further disposed in an auricle of the noise reduction earphone, and the processing module is specifically configured to:
filtering the first noise signal through the feedforward filter to obtain a first filtered signal;
and playing the first filtering signal through the loudspeaker to realize the noise reduction treatment of the noise reduction earphone.
In a possible implementation manner, the processing module is further configured to:
and if the fact that the oral cavity of the user wearing the noise reduction earphone does not vibrate is determined, the noise reduction earphone is subjected to noise reduction processing by utilizing the feedforward filter and the feedback filter.
In a possible implementation manner, a speaker is further disposed in an auricle of the noise reduction earphone, and the processing module is specifically configured to:
filtering the first noise signal through the feedforward filter to obtain a first filtered signal;
filtering the second noise signal through the feedback filter to obtain a second filtered signal;
superposing the first filtering signal and the second filtering signal to obtain a third filtering signal;
and playing the third filtering signal through the loudspeaker to realize the noise reduction processing of the noise reduction earphone.
In a third aspect, the present application provides an electronic device, comprising: a memory for storing a computer program and a processor for executing the computer program to implement the method according to any of the first aspect.
In a fourth aspect, the present application provides a computer-readable storage medium, comprising: a computer program implementing the method according to any one of the first aspect when executed by a processor.
In a fifth aspect, the present application provides a computer program product comprising: a computer program implementing the method according to any one of the first aspect when executed by a processor.
The present application provides a noise reduction processing method, apparatus, device, storage medium, and program, the method including: the method comprises the steps of acquiring a first noise signal acquired by acquiring noise in an external environment of an auricle through a first microphone, acquiring a third noise signal acquired by acquiring noise in an internal environment of the auricle through a second microphone, determining a second noise signal according to the third noise signal, determining whether an oral cavity of a user wearing the noise reduction earphone vibrates or not according to the first noise signal and the second noise signal, controlling a feedback filter to stop working under the condition that the oral cavity of the user wearing the noise reduction earphone vibrates, and performing noise reduction processing on the noise reduction earphone by using a feedforward filter. In the process, the feedback filter is controlled to stop working under the condition that the oral cavity of the user vibrates, so that the problem of reduction of the mixed noise reduction performance caused by the vibration of the oral cavity is solved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without inventive exercise.
Fig. 1 is a schematic diagram of an active noise reduction principle provided in an embodiment of the present application;
fig. 2 is a schematic diagram of a hybrid noise reduction headphone according to an embodiment of the present application;
fig. 3 is a schematic diagram illustrating a principle of a hybrid noise reduction process according to an embodiment of the present application;
FIG. 4 is a schematic view of an oral cavity vibration scenario provided by an embodiment of the present application;
fig. 5 is a schematic flowchart of a noise reduction processing method according to an embodiment of the present application;
FIG. 6 is a schematic diagram of a process for detecting oral cavity vibrations according to an embodiment of the present application;
fig. 7 is a schematic flowchart of another noise reduction processing method according to an embodiment of the present application;
fig. 8 is a schematic diagram illustrating a noise reduction processing principle based on vibration detection according to an embodiment of the present application;
fig. 9 is a schematic structural diagram of a noise reduction processing apparatus according to an embodiment of the present application;
fig. 10 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terms "first," "second," "third," "fourth," and the like in the description and in the claims of the present application and in the above-described drawings (if any) are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
In order to facilitate understanding of the technical solution of the present application, first, the working principle of active noise reduction is described with reference to fig. 1.
Fig. 1 is a schematic diagram of an active noise reduction principle provided in an embodiment of the present application. As shown in fig. 1, a reference noise signal, a noise canceling signal and a residual noise signal are illustrated in fig. 1. The reference noise signal may be a raw noise signal collected by the microphone in an environment outside the headset. The noise canceling signal may be a noise signal generated internally in the headset that is the same amplitude and opposite in phase to the reference noise signal. The noise-canceling signal is played through a loudspeaker in the earphone, so that the noise-canceling signal and the reference noise signal can be cancelled, and a residual noise signal is remained. Therefore, the user wearing the earphone can not hear the noise basically, thereby achieving the purpose of noise reduction.
It can be understood that when full noise reduction is implemented, the residual noise should be 0, but in practical implementation, due to the limitations of equipment and technology, the noise cannot be completely eliminated, and therefore a certain residual noise signal may exist. The smaller the residual noise signal, the better the noise reduction.
The active noise reduction earphones can be classified into feedforward noise reduction earphones, feedback noise reduction earphones and hybrid noise reduction earphones according to a system control mode. The noise reduction processing method provided by the application mainly relates to a hybrid noise reduction earphone. The structure of the hybrid noise reduction earphone and the operation principle of hybrid noise reduction will be described with reference to fig. 2 and 3.
Fig. 2 is a schematic diagram of a hybrid noise reduction headphone according to an embodiment of the present application. As shown in fig. 2, a first microphone is disposed outside an auricle of the hybrid noise reduction earphone, and a second microphone and a speaker are disposed inside the auricle. The first microphone may capture noise in the environment outside the pinna. The second microphone may pick up noise in the environment inside the pinna. Meanwhile, a processing chip (not shown) may be further disposed inside the noise reduction earphone, and a noise cancellation signal may be generated according to the noise signal collected by the first microphone and the noise signal collected by the second microphone. The speaker can play the noise-canceling signal, thereby realizing the noise reduction effect.
Fig. 3 is a schematic diagram illustrating a principle of hybrid noise reduction processing according to an embodiment of the present application. As shown in fig. 3, noise in the external environment of the auricle is collected by the first microphone, and the collected noise signal is subjected to noise reduction processing by the feedforward filter. Under the influence of various factors, a residual noise signal may exist after the noise signal is subjected to noise reduction processing by the feedforward filter, so that the noise in the internal environment of the auricle can be collected by the second microphone, and the residual noise signal is further subjected to noise reduction processing by the feedback filter. The mixed noise reduction earphone can improve the noise reduction effect by adopting the secondary noise reduction treatment of feedforward control and feedback control. In fig. 3, P (z) simulates the acoustic response of the first transmission path from the first microphone to the second microphone.
In practical applications, when a user wears the earphones to eat, speak, and the like, which causes oral vibration, the oral vibration may cause the performance of the above-mentioned hybrid noise reduction to be reduced. The inventors have analyzed the above-described problems, and the reason why the hybrid noise reduction performance is reduced will be described below with reference to fig. 4.
Fig. 4 is a schematic diagram of an oral cavity vibration scene according to an embodiment of the present application. When a user wears the earphone to eat, speak and the like, and the behaviors of causing oral cavity vibration are similar, the second microphone is close to the oral cavity of the user and can be influenced by the oral cavity vibration, so that a noise signal acquired by the second microphone becomes large, but actually, noise in the earphone is not obvious. Because the noise signal collected by the second microphone is no longer accurate, the result of performing noise reduction processing on the residual noise signal by using the feedback filter is no longer accurate, and thus, the performance of hybrid noise reduction is reduced.
In order to solve the technical problems, the present application provides the following technical concepts: whether the oral cavity of a user wearing the noise reduction earphone vibrates or not can be determined by analyzing the noise signal input to the feedforward filter and the noise signal input to the feedback filter, the feedback filter is controlled to stop working when the oral cavity of the user wearing the noise reduction earphone vibrates, and the noise reduction earphone is subjected to noise reduction by the feedforward filter. Thus, the problem of the reduction of noise reduction performance due to the influence of oral cavity vibration can be avoided.
The technical solution of the present application will be described in detail below with specific examples. These several specific embodiments may be combined with each other below, and details of the same or similar concepts or processes may not be repeated in some embodiments.
The noise reduction processing method provided by the embodiment of the application can be applied to noise reduction earphones. A first microphone is arranged outside the auricle of the noise reduction earphone, and a second microphone and a loudspeaker are arranged inside the auricle of the noise reduction earphone. The noise reduction earphone is also internally provided with a processing chip for executing the noise reduction processing method provided by the application. In an actual implementation process, besides the processing chip, a processor, a microprocessor, and other components may be further provided to implement the noise reduction processing method provided in the embodiment of the present application.
Fig. 5 is a schematic flowchart of a noise reduction processing method according to an embodiment of the present application. As shown in fig. 5, the method of the present embodiment includes:
s501: a first noise signal acquired by a first microphone through collecting noise in an environment outside an auricle is acquired.
Wherein the first noise signal is the noise signal input to the feedforward filter. In some scenarios, the first noise signal may also be referred to as a reference noise signal and the first microphone may also be referred to as a reference microphone or a feedforward microphone.
S502: and acquiring a third noise signal acquired by acquiring the noise in the internal environment of the auricle through a second microphone, and determining a second noise signal according to the third noise signal.
Wherein the second noise signal is a noise signal input to the feedback filter. The second microphone may also be referred to as an error microphone or a feedback microphone.
In the process of hybrid noise reduction, after noise reduction processing is performed on the first noise signal by using a feedforward filter, some residual noise signals inevitably enter auricles under the influence of various factors.
In this embodiment, in the case where no oral vibration occurs, the second noise signal is a residual noise signal after the first noise signal passes through the first transmission path, and the first transmission path is a transmission path from the first microphone to the second microphone. In this case, the second noise signal has strong correlation with the first noise signal.
Under the condition that the oral cavity vibrates, the second noise signal is a signal obtained by superposing a residual noise signal and an oral cavity vibration signal after the first noise signal passes through the first transmission path. In this case, the energy of the second noise signal becomes high, and the correlation of the second noise signal with the first noise signal decreases.
In one possible implementation, the second noise signal may be obtained as follows: and acquiring a third noise signal acquired by acquiring the noise in the internal environment of the auricle through a second microphone, and determining a second noise signal according to the third noise signal. Wherein the third noise signal is the noise signal that is really heard by the ear of the user, i.e. the third noise signal is the final result of the hybrid noise reduction.
In another possible implementation, a fourth noise signal input to the speaker may be obtained. A second noise signal is determined from the third noise signal and the fourth noise signal. The fourth noise signal may also be referred to as a noise cancellation signal, and the fourth noise signal may be obtained by superimposing the filtered signal output by the feedforward filter and the filtered signal output by the feedback filter. Optionally, performing signal estimation processing on the fourth noise signal through an estimation transfer function corresponding to the second transmission path to obtain an estimated noise signal; and estimating to obtain a second noise signal according to the third noise signal and the estimated noise signal.
S503: and determining whether the oral cavity of the user wearing the noise reduction earphone vibrates according to the first noise signal and the second noise signal.
In this embodiment, the first noise signal is a noise signal input to the feedforward filter, and the second noise signal is a noise signal input to the feedback filter. Whether the mouth of the user wearing the noise reduction earphone vibrates or not can be determined by analyzing the relation between the first noise signal and the second noise signal. For example, a relationship parameter between the first noise signal and the second noise signal may be determined, from which it is determined whether the mouth of the user wearing the noise reduction headphone transmits vibrations.
In the hybrid noise reduction process, the input of the feedforward filter is a first noise signal acquired by a first microphone for collecting noise in the environment outside the auricle. The input of the feedback filter is a second noise signal estimated according to the noise signal collected by the second microphone.
In the process of implementing the present application, the inventor finds that the first microphone is not affected by oral vibration, and the second microphone is easily affected by oral vibration, so that the first noise signal and the second noise signal can present the following relationship:
(1) When there is no oral vibration, the input signal of the feedforward filter (i.e., the first noise signal) and the input signal of the feedback filter (i.e., the second noise signal) are approximated within the effective bandwidth, and the correlation is relatively high. When the mouth vibration occurs, the input signal (i.e., the second noise signal) of the feedback filter becomes abnormal under the influence of the mouth vibration, and the correlation between the two becomes low.
(2) When there is no oral vibration, the energy of the difference between the input signal of the feedforward filter (i.e., the first noise signal) and the input signal of the feedback filter (i.e., the second noise signal) will be relatively small. When the oral cavity vibration occurs, the energy of the difference between the input signal of the feedforward filter (i.e., the first noise signal) and the input signal of the feedback filter (i.e., the second noise signal) is large.
(3) When the oral cavity vibration occurs, the energy of the input signal (i.e. the second noise signal) of the feedback filter is much larger than that of the input signal (i.e. the first noise signal) of the feedforward filter, i.e. the difference between the energy of the first noise signal and the energy of the second noise signal is small.
Based on the above analysis, in this embodiment, the relationship parameter may include one or more of the following: a correlation coefficient between the first noise signal and the second noise signal, an energy of a difference between the first noise signal and the second noise signal, a difference between an energy of the first noise signal and an energy of the second noise signal.
Optionally, if the relationship parameter satisfies one or more of the following conditions, it is determined that the oral cavity of the user wearing the noise reduction earphone vibrates:
condition 1: a correlation coefficient between the first noise signal and the second noise signal is less than or equal to a first threshold;
condition 2: an energy of a difference between the first noise signal and the second noise signal is greater than or equal to a second threshold;
condition 3: a difference between the energy of the first noise signal and the energy of the second noise signal is less than or equal to a third threshold.
S504: and if the oral cavity of the user wearing the noise reduction earphone is determined to vibrate, controlling a feedback filter to stop working, and carrying out noise reduction treatment on the noise reduction earphone by using a feedforward filter.
Specifically, in the case where it is determined that the oral cavity of the user vibrates, the feedback filter may be controlled to stop operating, that is, the feedback filter does not perform the noise reduction processing on the second noise signal. In this way, the noise reduction processing is performed on the first noise signal only by using the feedforward filter, thereby avoiding the problem of the reduction in noise reduction performance due to the influence of the oral vibration.
In this embodiment, the process of performing noise reduction processing on the noise reduction headphone by using the feedforward filter may include: filtering the first noise signal through the feedforward filter to obtain a first filtered signal; and playing the first filtering signal through the loudspeaker so as to realize the noise reduction treatment of the noise reduction earphone.
The noise reduction processing method provided by the embodiment comprises the following steps: the method comprises the steps of acquiring a first noise signal acquired by acquiring noise in an external environment of an auricle through a first microphone, acquiring a third noise signal acquired by acquiring noise in an internal environment of the auricle through a second microphone, determining a second noise signal according to the third noise signal, determining whether an oral cavity of a user wearing the noise reduction earphone vibrates or not according to the first noise signal and the second noise signal, controlling a feedback filter to stop working under the condition that the oral cavity of the user wearing the noise reduction earphone vibrates, and performing noise reduction processing on the noise reduction earphone by using a feedforward filter. In the process, the feedback filter is controlled to stop working under the condition that the oral cavity of the user vibrates, so that the problem of reduction of the mixed noise reduction performance caused by the vibration of the oral cavity is solved.
On the basis of the above-mentioned embodiment, how to detect whether the mouth of the user vibrates is described below with reference to a specific example.
Fig. 6 is a schematic diagram of a process for detecting oral cavity vibration according to an embodiment of the present application. As shown in fig. 6, the present embodiment may include:
(1) And respectively downsampling the first noise signal and the second noise signal to a target frequency band, wherein the target frequency band is a frequency band corresponding to oral cavity vibration.
Illustratively, as shown in FIG. 6, assume that the first noise signal is x 1 (n) the second noise signal is x 2 (n) of (a). The ANC system has an operating frequency of 384kHz, and the first noise signal x can be generated because the oral cavity vibration mainly affects the low frequency band 1 (n) and a second noise signal x 2 (n) down-sampled to a low frequency band, for example 8kHz.
(2) A correlation coefficient between the first noise signal and the second noise signal is calculated.
As shown in fig. 6, the first noise signal x may be processed 1 (n) and a second noise signal x 2 (n) performing framing processing, and calculating a first noise signal x according to the framing result 1 (n) and a second noise signal x 2 (n) correlation coefficient between (n).
For example, the correlation coefficient corrcoef can be calculated by using the following formula:
wherein, cov (x) 1 (n)，x 2 (n)) is a first noise signal x 1 (n) and a second noise signal x 2 Covariance of (n), var (x) 1 (n)) is the first noise signal x 1 Variance of (n), var (x) 2 (n)) is the second noise signal x 2 The variance of (n).
Optionally, after the correlation coefficient is obtained through calculation, smoothing may be performed according to the correlation coefficient of each frame. And the accuracy of the correlation coefficient is improved.
(3) The energy of the difference between the first noise signal and the second noise signal is calculated.
Illustratively, as shown in FIG. 6, a first noise signal x is first calculated 1 (n) and a second noise signal x 2 (n) difference x between 1 (n)-x 2 (n) the energy Delta Power of the difference can then be calculated using the following equation.
Delta_Power(n)＝a(x 1 (n)-x 2 (n)) 2 +(1-a)Delta_Power(n-1)
Where a is a smoothing coefficient.
(4) A difference between the energy of the first noise signal and the energy of the second noise signal is calculated.
For example, the difference Power _ Delta between the energy of the first noise signal and the energy of the second noise signal may be calculated using the following formula:
Power_Delta(n)＝x 1 _power(n)-x 2 _power(n)
wherein x is 1 Denoted power (n) denotes the first noise signal x 1 Energy of (n), x 2 And _power (n) represents the energy of the second noise signal.
Alternatively, the first noise signal x may be calculated using the following formula 1 (n) smoothing the power of the first noise signal x 1 Energy of (n):
x 1 _power(n)＝βx 1 (n) 2 +(1-β)x 1 _power(n-1)
the second noise signal x may be calculated using the following formula 2 (n) smoothing the power of the first noise signal as a second noise signal x 2 Energy of (n):
x 2 _power(n)＝βx 2 (n) 2 +(1-β)x 2 _power(n-1)
wherein β is a smoothing coefficient.
(5) And determining whether the oral cavity of the user wearing the noise reduction earphone vibrates according to a correlation coefficient between the first noise signal and the second noise signal, the energy of the difference between the first noise signal and the second noise signal, and the difference between the energy of the first noise signal and the energy of the second noise signal.
Illustratively, it is determined that the oral cavity of the user wearing the noise reduction headphones vibrates if the correlation coefficient corrcoef between the first noise signal and the second noise signal is less than or equal to a first threshold, the energy Delta _ Power of the difference between the first noise signal and the second noise signal is greater than or equal to a second threshold, and the difference Power _ Delta between the energy of the first noise signal and the energy of the second noise signal is less than a third threshold, otherwise, it is determined that the oral cavity of the user wearing the noise reduction headphones does not vibrate.
In this embodiment, whether the oral cavity of the user wearing the noise reduction earphone vibrates or not is determined according to the correlation coefficient between the first noise signal and the second noise signal, the energy of the difference between the first noise signal and the second noise signal, and the difference between the energy of the first noise signal and the energy of the second noise signal, so that the accuracy of the oral cavity vibration detection result is ensured.
On the basis of any of the above embodiments, the following describes the technical solution of the present application in more detail with reference to a more specific embodiment.
Fig. 7 is a schematic flowchart of another noise reduction processing method according to an embodiment of the present application. Fig. 8 is a schematic diagram of a noise reduction processing principle based on vibration detection according to an embodiment of the present application. As shown in fig. 7 and 8, the method of the present embodiment includes:
s701: and acquiring a first noise signal acquired by acquiring noise in the external environment of the auricle through the first microphone.
S702: and acquiring a third noise signal acquired by acquiring the noise in the internal environment of the auricle through the second microphone.
S703: acquiring a fourth noise signal input to the speaker.
S704: and performing signal estimation processing on the fourth noise signal through an estimation transfer function corresponding to a second transmission path to obtain an estimated noise signal, and obtaining a second noise signal according to the third noise signal and the estimated noise signal, wherein the second transmission path is a transmission path from the loudspeaker to the second microphone.
This is illustrated below with reference to fig. 8. In fig. 8, a (z) denotes a feedforward filter, and C (z) denotes a feedback filter. P (z) is a transfer function corresponding to the first transmission path. The first transmission path is a transmission path from the first microphone to the second microphone. S (z) is a transfer function corresponding to the second transmission path. The second transmission path is a transmission path from the speaker to the second microphone.
Referring to FIG. 8, the first noise signal is x 1 (n) in the formula (I). First noise signal x 1 (n) the signal after passing through the first transmission path is a desired noise signal d (n).
With continued reference to FIG. 8, the second noise signal is x 2 (n), the third noise signal is e (n), and the fourth noise signal is y (n). The third noise signal e (n) is collected by the second microphone. The fourth noise signal y (n) may be derived from the outputs of the feedforward filter a (z) and the feedback filter C (z). That is, the feedforward filter A (z) is applied to the first noise signal x 1 (n) the filtered signal after filtering, and a feedback filter C (z) for the second noise signal x 2 And (n) performing superposition processing on the filtered signal after filtering processing to obtain a fourth noise signal y (n). After the fourth noise signal y (n) passes through the second transmission path, the result of the superposition with the desired noise signal d (n) is the third noise signal e (n).
Assuming that S _ est (z) is an estimated transfer function corresponding to the second transmission path, the fourth noise signal y (n) is estimated by using S _ est (z) to obtain an estimated noise signal, and the estimated noise signal and the third noise signal e (n) are subjected to superposition processing to obtain a second noise signal x 2 (n)。
S705: and determining whether the oral cavity of the user wearing the noise reduction earphone vibrates according to the first noise signal and the second noise signal.
Referring to fig. 8, vibration detection may be performed based on the first noise signal and the second noise signal to determine whether the user's mouth is vibrated before the first noise signal is input to the feedforward filter and the second noise signal is input to the feedback filter. The method for detecting vibration can be referred to the detailed description of the foregoing embodiments, and is not repeated herein.
If it is determined that the mouth of the user wearing the noise reduction earphone vibrates, S706 is performed.
If it is determined that the mouth of the user wearing the noise reduction headphone is not vibrated, S707 is executed.
S706: and controlling the feedback filter to stop working, and performing noise reduction processing on the noise reduction earphone by using the feedforward filter.
Specifically, the feedback filter is turned off, that is, the feedback filter does not perform filtering processing on the second noise signal. Filtering the first noise signal through a feedforward filter to obtain a first filtered signal; and playing the first filtering signal through a loudspeaker to realize the noise reduction treatment of the noise reduction earphone.
S707: and carrying out noise reduction processing on the noise reduction earphone by utilizing a feedforward filter and a feedback filter.
Specifically, both the feedforward filter and the feedback filter are controlled to operate. Filtering the first noise signal through a feedforward filter to obtain a first filtered signal; filtering the second noise signal through a feedback filter to obtain a second filtered signal; superposing the first filtering signal and the second filtering signal to obtain a third filtering signal; and playing the third filtering signal through a loudspeaker to realize the noise reduction treatment of the noise reduction earphone.
According to the noise reduction processing method provided by the embodiment, whether the oral cavity of the user vibrates or not can be accurately identified according to the first noise signal acquired by the first microphone, the third noise signal acquired by the second microphone and the fourth noise signal input to the loudspeaker. And, under the condition that the user's oral cavity takes place the vibration, control feedback filter stop work to the problem of the mixed noise reduction performance reduction that has avoided because oral cavity vibration leads to.
Fig. 9 is a schematic structural diagram of a noise reduction processing apparatus according to an embodiment of the present application. The means may be in the form of software and/or hardware. Illustratively, the apparatus may be a processor, a microprocessor, a processing chip, a chip module, or the like. The device can be applied to a noise reduction earphone, a first microphone is arranged outside the auricle of the noise reduction earphone, and a second microphone is arranged inside the auricle of the noise reduction earphone.
As shown in fig. 9, the noise reduction processing apparatus 900 provided in this embodiment may include: an acquisition module 901, a first determination module 902, a second determination module 903, and a processing module 904.
The acquiring module 901 is configured to acquire a first noise signal obtained by acquiring noise in an external environment of an auricle through the first microphone;
a first determining module 902, configured to acquire a third noise signal obtained by collecting noise in an internal environment of an auricle through the second microphone, and determine a second noise signal according to the third noise signal;
a second determining module 903, configured to determine whether the mouth of the user wearing the noise reduction earphone vibrates according to the first noise signal and the second noise signal;
and the processing module 904 is configured to control the feedback filter to stop working if it is determined that the oral cavity of the user wearing the noise reduction earphone vibrates, and perform noise reduction processing on the noise reduction earphone by using the feedforward filter.
In a possible implementation manner, the second determining module 903 is specifically configured to:
determining a relationship parameter between the first noise signal and the second noise signal;
and determining whether the oral cavity of the user wearing the noise reduction earphone vibrates or not according to the relation parameters.
In a possible implementation, the relationship parameter includes one or more of the following:
a correlation coefficient between the first noise signal and the second noise signal;
an energy of a difference between the first noise signal and the second noise signal;
a difference between an energy of the first noise signal and an energy of the second noise signal.
In a possible implementation manner, the second determining module 903 is specifically configured to:
determining that the oral cavity of the user wearing the noise reduction earphone vibrates if the relation parameter satisfies one or more of the following conditions:
a correlation coefficient between the first noise signal and the second noise signal is less than or equal to a first threshold;
an energy of a difference between the first noise signal and the second noise signal is greater than or equal to a second threshold;
a difference between the energy of the first noise signal and the energy of the second noise signal is less than a third threshold.
In a possible implementation manner, the second determining module 903 is specifically configured to:
respectively down-sampling the first noise signal and the second noise signal to a target frequency band, wherein the target frequency band is a frequency band corresponding to oral cavity vibration;
and determining the relation parameter according to the first noise signal and the second noise signal after down sampling.
In a possible implementation manner, the first determining module 902 is specifically configured to:
acquiring a fourth noise signal input to the loudspeaker;
determining the second noise signal based on the third noise signal and the fourth noise signal.
In a possible implementation manner, a speaker is further disposed in an auricle of the noise reduction earphone, and the first determining module 902 is specifically configured to:
performing signal estimation processing on the fourth noise signal through an estimation transfer function corresponding to a second transmission path to obtain an estimated noise signal; wherein the second transmission path is a transmission path from the speaker to the second microphone;
and obtaining the second noise signal according to the third noise signal and the estimated noise signal.
In a possible implementation manner, a speaker is further disposed in an auricle of the noise reduction earphone, and the processing module 904 is specifically configured to:
filtering the first noise signal through the feedforward filter to obtain a first filtered signal;
and playing the first filtering signal through the loudspeaker to realize the noise reduction treatment of the noise reduction earphone.
In a possible implementation manner, the processing module 904 is further configured to:
and if the fact that the oral cavity of the user wearing the noise reduction earphone does not send vibration is determined, the noise reduction earphone is subjected to noise reduction processing by utilizing the feedforward filter and the feedback filter.
In a possible implementation manner, a speaker is further disposed in an auricle of the noise reduction earphone, and the processing module 904 is specifically configured to:
filtering the first noise signal through the feedforward filter to obtain a first filtered signal;
filtering the second noise signal through the feedback filter to obtain a second filtered signal;
superposing the first filtering signal and the second filtering signal to obtain a third filtering signal;
and playing the third filtering signal through the loudspeaker to realize the noise reduction treatment of the noise reduction earphone.
The noise reduction processing apparatus provided in this embodiment may be configured to execute the noise reduction processing method provided in any of the above method embodiments, and the implementation principle and the technical effect are similar, which are not described herein again.
Fig. 10 is a schematic structural diagram of an electronic device according to an embodiment of the present application. The electronic device can be a noise reduction earphone, or a processing chip or a chip module set arranged in the noise reduction earphone, and the like. As shown in fig. 10, the electronic device 1000 provided in this embodiment includes: a processor 1001 and a memory 1002.
A memory 1002 for storing a computer program; a processor 1001 configured to execute a computer program stored in a memory to implement one or more steps of the noise reduction processing method in the foregoing embodiments. Specifically, reference may be made to the related descriptions in the foregoing method embodiments, which have similar implementation principles and technical effects, and this embodiment is not described herein again.
Alternatively, the memory 1002 may be separate or integrated with the processor 1001.
When the memory 1002 is a separate device from the processor 1001, the electronic device 1000 may further include: a bus 1003 for connecting the memory 1002 and the processor 1001.
The embodiment of the present application further provides a noise reduction earphone, including: a first microphone, a second microphone, a loudspeaker, and an electronic device as shown in fig. 10. The first microphone is arranged outside the auricle of the noise reduction earphone, and the second microphone and the loudspeaker are arranged inside the auricle of the noise reduction earphone. The electronic device may perform the noise reduction processing method in any of the above method embodiments, and the implementation principle and technical effect are similar, which are not described herein again.
An embodiment of the present application further provides a computer-readable storage medium, where the computer-readable storage medium includes a computer program, and the computer program is configured to implement one or more steps in the noise reduction processing method in any of the above method embodiments, and the implementation principle and the technical effect are similar, and are not described herein again.
An embodiment of the present application further provides a chip, including: the noise reduction processing method includes a memory and a processor, where the memory stores a computer program, and the processor runs the computer program to execute one or more steps in the noise reduction processing method in any one of the above method embodiments, and the implementation principle and the technical effect are similar, and are not described herein again.
An embodiment of the present application further provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, the computer program implements one or more steps in the noise reduction processing method in any of the above method embodiments, and the implementation principle and the technical effect are similar, and details are not described here.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the modules is only one logical functional division, and other divisions may be realized in practice, for example, a plurality of modules may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or modules, and may be in an electrical, mechanical or other form.
The modules described as separate parts may or may not be physically separate, and parts displayed as modules may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment.
In addition, functional modules in the embodiments of the present application may be integrated into one processing unit, or each module may exist alone physically, or two or more modules are integrated into one unit. The unit formed by the modules can be realized in a hardware mode, and can also be realized in a mode of hardware and a software functional unit.
The integrated module implemented in the form of a software functional module may be stored in a computer-readable storage medium. The software functional module is stored in a storage medium and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device) or a processor (in english: processor) to execute some steps of the methods described in the embodiments of the present application.
It should be understood that the Processor may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of a method disclosed in the incorporated application may be directly implemented by a hardware processor, or may be implemented by a combination of hardware and software modules in the processor.
The memory may comprise a high-speed RAM memory, and may further comprise a non-volatile storage NVM, such as at least one disk memory, and may also be a usb disk, a removable hard disk, a read-only memory, a magnetic or optical disk, etc.
The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, an Extended ISA (EISA) bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, the buses in the figures of the present application are not limited to only one bus or one type of bus.
The storage medium may be implemented by any type or combination of volatile and non-volatile memory devices, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks. A storage media may be any available media that can be accessed by a general purpose or special purpose computer.
An exemplary storage medium is coupled to the processor such the processor can read information from, and write information to, the storage medium. Of course, the storage medium may also be integral to the processor. The processor and the storage medium may reside in an Application Specific Integrated Circuits (ASIC). Of course, the processor and the storage medium may reside as discrete components in an electronic device or host device.
Those of ordinary skill in the art will understand that: all or a portion of the steps of implementing the above-described method embodiments may be performed by hardware associated with program instructions. The program may be stored in a computer-readable storage medium. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.
Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.
Claims (22)
1. A noise reduction processing method is applied to a noise reduction earphone, a first microphone is arranged outside an auricle of the noise reduction earphone, a second microphone is arranged inside the auricle of the noise reduction earphone, and the method comprises the following steps:
acquiring a first noise signal acquired by acquiring noise in an external environment of an auricle through the first microphone;
acquiring a third noise signal acquired by acquiring noise in the internal environment of the auricle through the second microphone, and determining a second noise signal according to the third noise signal;
determining whether the mouth of a user wearing the noise reduction earphone vibrates according to the first noise signal and the second noise signal;
and if the oral cavity of the user wearing the noise reduction earphone is determined to vibrate, controlling a feedback filter to stop working, and carrying out noise reduction treatment on the noise reduction earphone by using a feedforward filter.
2. The method of claim 1, wherein determining whether the mouth of the user wearing the noise reduction headphones vibrates based on the first noise signal and the second noise signal comprises:
determining a relationship parameter between the first noise signal and the second noise signal;
and determining whether the oral cavity of the user wearing the noise reduction earphone vibrates or not according to the relation parameters.
3. The method of claim 2, wherein the relationship parameters include one or more of:
a correlation coefficient between the first noise signal and the second noise signal;
an energy of a difference between the first noise signal and the second noise signal;
a difference between an energy of the first noise signal and an energy of the second noise signal.
4. The method of claim 3, wherein determining whether the mouth of the user wearing the noise reduction earphone vibrates according to the relationship parameter comprises:
if the relation parameter meets one or more of the following conditions, determining that the oral cavity of the user wearing the noise reduction earphone vibrates:
a correlation coefficient between the first noise signal and the second noise signal is less than or equal to a first threshold;
an energy of a difference between the first noise signal and the second noise signal is greater than or equal to a second threshold;
a difference between the energy of the first noise signal and the energy of the second noise signal is less than or equal to a third threshold.
5. The method of any one of claims 2 to 4, wherein determining a relationship parameter between the first noise signal and the second noise signal comprises:
respectively down-sampling the first noise signal and the second noise signal to a target frequency band, wherein the target frequency band is a frequency band corresponding to oral cavity vibration;
and determining the relation parameter according to the first noise signal and the second noise signal after down sampling.
6. The method according to any one of claims 1 to 5, wherein a speaker is further disposed in the pinna of the noise reduction headphone, and determining a second noise signal from the third noise signal comprises:
acquiring a fourth noise signal input to the loudspeaker;
determining the second noise signal based on the third noise signal and the fourth noise signal.
7. The method of claim 6, wherein determining the second noise signal based on the third noise signal and the fourth noise signal comprises:
performing signal estimation processing on the fourth noise signal through an estimation transfer function corresponding to a second transmission path to obtain an estimation noise signal; wherein the second transmission path is a transmission path from the speaker to the second microphone;
and obtaining the second noise signal according to the third noise signal and the estimated noise signal.
8. The method according to any one of claims 1 to 7, wherein a speaker is further disposed in the pinna of the noise reduction headphone, and the noise reduction headphone is subjected to noise reduction processing by using a feedforward filter, including:
filtering the first noise signal through the feedforward filter to obtain a first filtered signal;
and playing the first filtering signal through the loudspeaker to realize the noise reduction treatment of the noise reduction earphone.
9. The method of any of claims 1 to 8, wherein after determining whether the mouth of the user wearing the noise reduction earphone is vibrating based on the first noise signal and the second noise signal, further comprising:
and if the fact that the oral cavity of the user wearing the noise reduction earphone does not vibrate is determined, the noise reduction earphone is subjected to noise reduction processing by utilizing the feedforward filter and the feedback filter.
10. The method of claim 9, wherein a speaker is further disposed in the pinna of the noise reduction headphone, and the noise reduction headphone is noise-reduced by the feedforward filter and the feedback filter, comprising:
filtering the first noise signal through the feedforward filter to obtain a first filtered signal;
filtering the second noise signal through the feedback filter to obtain a second filtered signal;
superposing the first filtering signal and the second filtering signal to obtain a third filtering signal;
and playing the third filtering signal through the loudspeaker to realize the noise reduction treatment of the noise reduction earphone.
11. The utility model provides a noise reduction processing apparatus, its characterized in that is applied to the earphone of making an uproar, it is provided with first microphone to fall outside the auricle of earphone of making an uproar, it is provided with the second microphone to fall in the auricle of earphone of making an uproar, the device includes:
the acquisition module is used for acquiring a first noise signal acquired by acquiring noise in an external environment of an auricle through the first microphone;
the first determining module is used for acquiring a third noise signal acquired by collecting noise in the internal environment of the auricle through the second microphone and determining a second noise signal according to the third noise signal;
a second determining module, configured to determine whether an oral cavity of a user wearing the noise reduction earphone vibrates according to the first noise signal and the second noise signal;
and the processing module is used for controlling the feedback filter to stop working if the oral cavity of the user wearing the noise reduction earphone is determined to vibrate, and carrying out noise reduction processing on the noise reduction earphone by utilizing the feedforward filter.
12. The apparatus of claim 11, wherein the second determining module is specifically configured to:
determining a relationship parameter between the first noise signal and the second noise signal;
and determining whether the oral cavity of the user wearing the noise reduction earphone vibrates or not according to the relation parameters.
13. The apparatus of claim 12, wherein the relationship parameters comprise one or more of:
a correlation coefficient between the first noise signal and the second noise signal;
an energy of a difference between the first noise signal and the second noise signal;
a difference between an energy of the first noise signal and an energy of the second noise signal.
14. The apparatus of claim 13, wherein the second determining module is specifically configured to:
determining that the oral cavity of the user wearing the noise reduction earphone vibrates if the relation parameter satisfies one or more of the following conditions:
a correlation coefficient between the first noise signal and the second noise signal is less than or equal to a first threshold;
an energy of a difference between the first noise signal and the second noise signal is greater than or equal to a second threshold;
a difference between the energy of the first noise signal and the energy of the second noise signal is less than a third threshold.
15. The apparatus according to any one of claims 12 to 14, wherein the second determining module is specifically configured to:
respectively down-sampling the first noise signal and the second noise signal to a target frequency band, wherein the target frequency band is a frequency band corresponding to oral cavity vibration;
and determining the relation parameter according to the first noise signal and the second noise signal after down sampling.
16. The apparatus according to any one of claims 11 to 15, wherein a speaker is further disposed in a pinna of the noise reduction earphone, and the first determining module is specifically configured to:
acquiring a fourth noise signal input to the speaker;
determining the second noise signal based on the third noise signal and the fourth noise signal.
17. The apparatus of claim 16, wherein the first determining module is specifically configured to:
performing signal estimation processing on the fourth noise signal through an estimation transfer function corresponding to a second transmission path to obtain an estimated noise signal; wherein the second transmission path is a transmission path from the speaker to the second microphone;
and obtaining the second noise signal according to the third noise signal and the estimated noise signal.
18. The apparatus according to any one of claims 11 to 17, wherein a speaker is further disposed in an auricle of the noise reduction earphone, and the processing module is specifically configured to:
filtering the first noise signal through the feedforward filter to obtain a first filtered signal;
and playing the first filtering signal through the loudspeaker to realize the noise reduction treatment of the noise reduction earphone.
19. The apparatus of any of claims 11 to 18, wherein the processing module is further configured to:
and if the oral cavity of the user wearing the noise reduction earphone is determined not to vibrate, performing noise reduction processing on the noise reduction earphone by using the feedforward filter and the feedback filter.
20. The apparatus according to claim 19, wherein a speaker is further disposed in an auricle of the noise reduction earphone, and the processing module is specifically configured to:
filtering the first noise signal through the feedforward filter to obtain a first filtered signal;
filtering the second noise signal through the feedback filter to obtain a second filtered signal;
superposing the first filtering signal and the second filtering signal to obtain a third filtering signal;
and playing the third filtering signal through the loudspeaker to realize the noise reduction treatment of the noise reduction earphone.
21. An electronic device, comprising: a memory for storing a computer program and a processor for executing the computer program to implement the method of any one of claims 1 to 10.
22. A computer-readable storage medium, comprising: computer program which, when executed by a processor, implements the method of any one of claims 1 to 10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110724510.3A CN113507662B (en) | 2021-06-29 | 2021-06-29 | Noise reduction processing method, apparatus, device, storage medium, and program |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110724510.3A CN113507662B (en) | 2021-06-29 | 2021-06-29 | Noise reduction processing method, apparatus, device, storage medium, and program |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113507662A CN113507662A (en) | 2021-10-15 |
| CN113507662B true CN113507662B (en) | 2023-01-10 |
Family
ID=78011299
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110724510.3A Active CN113507662B (en) | 2021-06-29 | 2021-06-29 | Noise reduction processing method, apparatus, device, storage medium, and program |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113507662B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113920975B (en) * | 2021-11-26 | 2023-06-09 | 歌尔科技有限公司 | Noise reduction parameter setting method and device, earphone equipment and storage medium |
| CN114071309B (en) * | 2021-12-20 | 2023-08-25 | 歌尔科技有限公司 | Headphone Noise Reduction Method, Device, Equipment, and Computer-Readable Storage Medium |
| CN114866899B (en) * | 2022-05-05 | 2024-10-15 | 重庆物奇微电子有限公司 | Headset noise reduction method, headset device and computer readable storage medium |
| CN115278438B (en) * | 2022-07-27 | 2024-08-27 | 北京爱德发科技有限公司 | Noise reduction earphones, noise reduction method and device, storage medium and processor |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105247885A (en) * | 2012-11-02 | 2016-01-13 | 伯斯有限公司 | Providing ambient naturalness in ANR headphones |
| CN105825846A (en) * | 2009-04-28 | 2016-08-03 | 伯斯有限公司 | ANR signal processing enhancement |
| CN105916087A (en) * | 2015-02-24 | 2016-08-31 | 奥迪康有限公司 | A hearing device comprising an anti-feedback power down detector |
| CN107533838A (en) * | 2015-03-13 | 2018-01-02 | 伯斯有限公司 | Sensed using the voice of multiple microphones |
| CN112788466A (en) * | 2021-02-07 | 2021-05-11 | 恒玄科技(上海)股份有限公司 | Filter parameter configuration method of active noise reduction earphone and active noise reduction earphone |
| CN113873378A (en) * | 2020-06-30 | 2021-12-31 | 华为技术有限公司 | Earphone noise processing method and device and earphone |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4506873B2 (en) * | 2008-05-08 | 2010-07-21 | ソニー株式会社 | Signal processing apparatus and signal processing method |
| EP3481085B1 (en) * | 2017-11-01 | 2020-09-09 | Oticon A/s | A feedback detector and a hearing device comprising a feedback detector |
| US20210013889A1 (en) * | 2019-07-12 | 2021-01-14 | Sanjole Inc. | System and method for correcting phase noise in a communication system |
| CN112562626B (en) * | 2020-11-30 | 2021-08-31 | 深圳百灵声学有限公司 | Design method of hybrid noise reduction filter, noise reduction method, system and electronic equipment |
-
2021
- 2021-06-29 CN CN202110724510.3A patent/CN113507662B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105825846A (en) * | 2009-04-28 | 2016-08-03 | 伯斯有限公司 | ANR signal processing enhancement |
| CN105247885A (en) * | 2012-11-02 | 2016-01-13 | 伯斯有限公司 | Providing ambient naturalness in ANR headphones |
| CN105916087A (en) * | 2015-02-24 | 2016-08-31 | 奥迪康有限公司 | A hearing device comprising an anti-feedback power down detector |
| CN107533838A (en) * | 2015-03-13 | 2018-01-02 | 伯斯有限公司 | Sensed using the voice of multiple microphones |
| CN113873378A (en) * | 2020-06-30 | 2021-12-31 | 华为技术有限公司 | Earphone noise processing method and device and earphone |
| CN112788466A (en) * | 2021-02-07 | 2021-05-11 | 恒玄科技(上海)股份有限公司 | Filter parameter configuration method of active noise reduction earphone and active noise reduction earphone |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113507662A (en) | 2021-10-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113507662B (en) | Noise reduction processing method, apparatus, device, storage medium, and program | |
| CN111988690B (en) | Earphone wearing state detection method and device and earphone | |
| EP2882170A1 (en) | Audio information processing method and apparatus | |
| JP5493611B2 (en) | Information processing apparatus, information processing method, and program | |
| CN112087701B (en) | Speaker emulation of microphone for wind detection | |
| CN113643682B (en) | Noise reduction method, chip module and equipment | |
| CN109348322A (en) | A kind of radix saposhnikoviae method for de-noising, feed-forward noise reduction system, earphone and storage medium | |
| CN113473294B (en) | Coefficient determination method and device | |
| CN111971975A (en) | Active noise reduction method, system, electronic equipment and chip | |
| CN112565981A (en) | Howling suppression method, howling suppression device, hearing aid, and storage medium | |
| CN115474121A (en) | Active noise reduction method, device, chip, earphone and storage medium | |
| CN112055278B (en) | Deep learning noise reduction device integrated with in-ear microphone and out-of-ear microphone | |
| CN113242491B (en) | Noise reduction processing method, apparatus, device, storage medium, and program | |
| WO2017045512A1 (en) | Voice recognition method and apparatus, terminal, and voice recognition device | |
| CN113923556B (en) | Noise reduction processing method, device, equipment, storage medium and program | |
| CN113488016B (en) | Coefficient determination method and device | |
| CN116312622A (en) | Abnormal sound detection method, device and system | |
| CN114255732A (en) | Active noise reduction method and device, computer readable storage medium and electronic device | |
| CN114333752A (en) | A noise signal processing method, system, hybrid noise reduction earphone and storage medium | |
| US20240078994A1 (en) | Active damping of resonant canal modes | |
| CN110798767A (en) | Feedback type noise reduction circuit in earphone, noise reduction method, electronic device, and computer-readable storage medium | |
| CN114866899B (en) | Headset noise reduction method, headset device and computer readable storage medium | |
| US12148413B2 (en) | Computational architecture for active noise reduction device | |
| EP4156720A1 (en) | Method and system for measuring and tracking ear characteristics | |
| CN114697782B (en) | Headphone wind noise recognition method, device and headphone |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |