CN116390005A - Wireless multi-microphone hearing aid method, hearing aid, and computer-readable storage medium - Google Patents
Wireless multi-microphone hearing aid method, hearing aid, and computer-readable storage medium Download PDFInfo
- Publication number
- CN116390005A CN116390005A CN202211648535.0A CN202211648535A CN116390005A CN 116390005 A CN116390005 A CN 116390005A CN 202211648535 A CN202211648535 A CN 202211648535A CN 116390005 A CN116390005 A CN 116390005A
- Authority
- CN
- China
- Prior art keywords
- signal
- hearing aid
- microphone
- beam signal
- wireless multi
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 55
- 238000001228 spectrum Methods 0.000 claims abstract description 7
- 230000001133 acceleration Effects 0.000 claims description 9
- 239000011159 matrix material Substances 0.000 claims description 6
- 238000005457 optimization Methods 0.000 claims description 3
- 238000004891 communication Methods 0.000 abstract description 9
- 230000008569 process Effects 0.000 abstract description 6
- 238000010586 diagram Methods 0.000 description 12
- 230000001629 suppression Effects 0.000 description 10
- 230000005236 sound signal Effects 0.000 description 6
- 238000004590 computer program Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000009499 grossing Methods 0.000 description 3
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 108091006146 Channels Proteins 0.000 description 1
- 206010011878 Deafness Diseases 0.000 description 1
- 101001120757 Streptococcus pyogenes serotype M49 (strain NZ131) Oleate hydratase Proteins 0.000 description 1
- 230000032683 aging Effects 0.000 description 1
- 229940083712 aldosterone antagonist Drugs 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000010370 hearing loss Effects 0.000 description 1
- 231100000888 hearing loss Toxicity 0.000 description 1
- 208000016354 hearing loss disease Diseases 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000033764 rhythmic process Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
- H04R25/50—Customised settings for obtaining desired overall acoustical characteristics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2225/00—Details of deaf aids covered by H04R25/00, not provided for in any of its subgroups
- H04R2225/43—Signal processing in hearing aids to enhance the speech intelligibility
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Neurosurgery (AREA)
- Otolaryngology (AREA)
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
The application provides a wireless multi-microphone hearing aid method, a hearing aid and a computer readable storage medium. The wireless multi-microphone hearing aid method comprises the following steps: acquiring a plurality of beam signals in different target directions; carrying out noise spectrum estimation on each beam signal to obtain output energy of each beam signal; determining the signal-to-noise ratio of each beam signal according to the output energy of each beam signal; and outputting the beam signal with the maximum signal-to-noise ratio through the earphone. Through the mode, the hearing aid carries out voice enhancement by adopting the method of multipath beams, and selects beam signals by utilizing the optimal signal-to-noise ratio criterion, so that voice enhancement is realized, the pick-up problem in the process of multi-person communication and in a noisy environment like a restaurant can be solved, and a hearing aid wearer can have good experience.
Description
Technical Field
The present application relates to the field of sound processing technology, and in particular, to a wireless multi-microphone hearing aid method, a hearing aid, and a computer readable storage medium.
Background
With the increasing aging, the hearing loss problem is getting more attention. Hearing aids are the most widespread way to solve hearing problems, and hearing aid performance is also becoming more and more interesting. The conventional hearing aid mainly includes: microphones (microphones for picking up sound), amplifiers (signal processing sections running sound processing algorithms including echo cancellation, beam forming, dynamic gain adjustment, crossover compression, noise reduction, etc.), receivers (loudspeakers, acoustic signals after the processing are played). The traditional hearing aid can effectively ensure the quality of sound in a simple and quiet scene, the modern life rhythm is faster, and the requirements of people on the quality of communication are higher and higher. However, in many living and working environments, sound pick-up is greatly affected by communication distance, white-out and ambient noise, which presents a great challenge for conventional hearing aids.
In life and work, a scene of communication of a plurality of people and a noisy environment exist, for example, in a restaurant, the surrounding environment is noisy, if the noise is not processed cleanly, the traditional hearing aid can easily amplify the surrounding noise synchronously, so that discomfort is generated to a wearer of the hearing aid; the exclusive OR has overlarge noise suppression, generates distortion to the target voice and influences the intelligibility. In meeting scenes, the traditional hearing aid is difficult to pick up in a long distance, so that a hearing aid wearer loses effective information, interference of other people talking beside the hearing aid wearer can easily occur in the talking process, and communication of the hearing aid wearer is further affected. In the environment of multi-person communication, the hearing aid wearer can accurately acquire and express information to obtain smooth and pleasant communication, which is a difficult problem to be solved by the hearing aid at present.
Disclosure of Invention
The application provides a wireless multi-microphone hearing aid method, a hearing aid and a computer readable storage medium.
The application provides a wireless multi-microphone hearing aid method, which comprises the following steps:
acquiring a plurality of beam signals in different target directions;
performing noise spectrum estimation on each beam signal to obtain output energy of each beam signal;
determining the signal-to-noise ratio of each beam signal according to the output energy of each beam signal;
and outputting the beam signal with the maximum signal-to-noise ratio through the earphone.
Wherein said determining the signal-to-noise ratio of each beam signal according to the output energy of said each beam signal comprises:
acquiring output energy of each beam signal in a preset time period;
acquiring the signal-to-noise ratio of each wave beam signal at each moment in the preset time period;
and calculating the average value of the signal to noise ratio of each beam signal in the preset time period according to the signal to noise ratio of each beam signal at each moment.
The outputting the beam signal with the maximum signal-to-noise ratio through the earphone comprises the following steps:
acquiring a beam signal with the maximum signal-to-noise ratio at each moment in a preset time period, and recording the hit number of each beam signal with the maximum signal-to-noise ratio at a certain moment;
and outputting the beam signal with the highest hit frequency in the preset time period through the earphone.
The acquiring the plurality of beam signals in different target directions comprises the following steps:
collecting a plurality of beam signals in different beam directions by using uniformly distributed microphones, wherein the beam direction of each beam signal is the direction of the corresponding microphone;
each beam signal is voice enhanced using differential array super-steering beamforming.
Wherein the voice enhancement of each beam signal using differential array super-steering beamforming comprises:
calculating a noise cross-correlation matrix based on the angular frequency of the beam signal and the radius of the microphone array;
and solving the optimization problem of the beam signal voice enhancement by using the noise cross-correlation matrix, and obtaining the beam coefficient after the beam signal voice enhancement.
After the acquiring the plurality of beam signals in different target directions, the wireless multi-microphone hearing aid method further comprises the following steps:
acquiring a microphone in the current direction of the beam signal;
acquiring the phase difference between the current direction microphone and the diagonal microphone;
acquiring the directional gain of the beam signal according to a preset gain value and the phase difference;
and suppressing the sidelobe signal output of the beam signal by using the directional gain.
When the phase difference is within a preset angle range, the preset gain value is a preset value; and when the phase difference is out of the preset angle range, the preset gain value is smaller than the preset value.
The wireless multi-microphone hearing aid method further comprises the following steps:
acquiring a direction state acquired by an acceleration sensor of the microphone array board;
when the direction state is a horizontal state, a mode is selected according to the maximum signal-to-noise ratio, and a voice signal is output through the earphone;
outputting a voice signal through the earphone according to the wearing mode when the direction state is a vertical state; the wearing mode is to output beam signals of the speaking direction of a user wearing the microphone array board through headphones.
After the direction state acquired by the acceleration sensor of the microphone array board is acquired, the wireless multi-microphone hearing aid method further comprises the following steps:
when the direction state is a horizontal state, selecting a beam signal in a fixed direction according to a user instruction and outputting the beam signal through the earphone.
The application also provides a hearing aid comprising a processor and a memory, the memory having stored therein program data, the processor being adapted to execute the program data to implement a wireless multi-microphone hearing aid method as described above.
The present application also provides a computer readable storage medium for storing program data which, when executed by a processor, is configured to implement the wireless multi-microphone hearing aid method described above.
The beneficial effects of this application are: the hearing aid acquires a plurality of beam signals in different target directions; carrying out noise spectrum estimation on each beam signal to obtain output energy of each beam signal; determining the signal-to-noise ratio of each beam signal according to the output energy of each beam signal; and outputting the beam signal with the maximum signal-to-noise ratio through the earphone. Through the mode, the hearing aid carries out voice enhancement by adopting the method of multipath beams, and selects beam signals by utilizing the optimal signal-to-noise ratio criterion, so that voice enhancement is realized, the pick-up problem in the process of multi-person communication and in a noisy environment like a restaurant can be solved, and a hearing aid wearer can have good experience.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art. Wherein:
fig. 1 is a schematic view of the structure of an embodiment of a hearing aid provided in the present application;
fig. 2 is a schematic structural diagram of an embodiment of a microphone array board provided in the present application;
FIG. 3 is a flow chart of an embodiment of a wireless multi-microphone hearing aid method provided by the present application;
FIG. 4 is a schematic view of an omnidirectional pickup of a microphone array plate provided by the application;
FIG. 5 is a diagram of a super-directive beam provided herein;
fig. 6 is a schematic workflow diagram of a sidelobe suppression module provided herein;
FIG. 7 is a schematic illustration of band suppression provided herein;
FIG. 8 is a schematic diagram of a workflow provided herein for selecting an optimal beam signal;
FIG. 9 is a schematic flow chart diagram of another embodiment of a wireless multi-microphone hearing aid method provided herein;
fig. 10 is a schematic view of the structure of another embodiment of the hearing aid provided in the present application;
fig. 11 is a schematic structural diagram of an embodiment of a computer readable storage medium provided in the present application.
Detailed Description
The following description of the technical solutions in the embodiments of the present application will be made clearly and completely with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are within the scope of the present disclosure.
In order to solve the above problems, the present application provides a wireless multi-microphone hearing aid method and device, which can enable a hearing aid wearer to effectively communicate in a complex sound field. The invention designs a wireless multi-microphone hearing aid device, which mainly comprises: charging bin, microphone array board, earphone. Referring specifically to fig. 1, fig. 1 is a schematic structural diagram of an embodiment of a hearing aid provided in the present application.
As shown in fig. 1, the hearing aid of the present application mainly includes: charging bin, microphone array board, earphone. The earphone and the microphone array board can be placed in the storehouse that charges, and sound signal is gathered by the microphone array board, evenly distributed 4 qxcomm technology microphones on the board, built-in digital signal processor for handle sound signal, built-in wireless device on the microphone board simultaneously, can send the sound signal after handling to the earphone, and the earphone is used for playing the sound after handling.
Further, please continue to refer to fig. 2, fig. 2 is a schematic structural diagram of an embodiment of a microphone array board provided in the present application. The microphone array board of the present application as shown in fig. 2 mainly includes a four-microphone uniform circular array 101 for picking up sound signals; a digital signal processor 102 running signal processing algorithms including echo cancellation, beamforming, noise reduction, automatic gain control, band compression, etc.; the wireless transmission device 103 transmits the enhanced sound to the earphone, and the earphone wearer acquires the sound.
Based on the hearing aids shown in fig. 1 and fig. 2, the present application further provides a wireless multi-microphone hearing aid method based on the hearing aids, and referring specifically to fig. 3, fig. 3 is a schematic flow chart of an embodiment of the wireless multi-microphone hearing aid method provided in the present application.
Specifically, as shown in fig. 3, the wireless multi-microphone hearing aid method in the embodiment of the application specifically includes the following steps:
step S11: a number of beam signals of different target directions are acquired.
In the embodiment of the present application, the microphone signal acquired by the hearing aid is X (n) = [ X 1 (n),x 2 (n),x 3 (n),x 4 (n)] T Where n represents the sampling time instant and T represents the transpose. The frequency domain is represented as X (f) = [ X 1 (f),x 2 (f),x 3 (f),x 4 (f)] T Where f represents a frequency bin.
In a complex sound environment, the beam forming technology can effectively enhance target voice, and in order to effectively pick up sound signals, the application adopts the multi-beam technology to enhance voice. Referring specifically to fig. 4, fig. 4 is a schematic diagram illustrating omnidirectional pickup of a microphone array board according to the present application.
As shown in fig. 4, when the microphone array board is placed on a table, in order to enable 360 ° omnidirectional pickup, the system designs 4 evenly distributed beams to pick up, each beam being spaced by 90 °, and the direction of each beam being the direction in which the microphone is located. In beam forming, the differential array has good frequency invariant characteristics, and the size is smaller and is widely adopted, so that the hearing aid of the embodiment of the application utilizes differential array super-directional beam forming to carry out voice enhancement.
Specifically, the super-directive beam (Superdirective Beamformer) can obtain better directivity using a scattered noise field using a minimum variance distortion-free response (MVDR) criterion. The goal of MVDR is to solve the following optimization problem:
wherein W represents a beam coefficient, R xx Represents a noise cross-correlation matrix, theta is a target direction, d θ Is a steering vector for the direction of the object,
the Lagrangian multiplier method can be used for obtaining the optimal solution of the above formula
Assuming that the noise field is a diffuse noise field, i.e. the noise comes from all directions, the noise cross correlation matrix becomes
Where ω is the angular frequency, δ is the radius of the microphone array, and c is the propagation velocity of the sound. The super-directional beam coefficient becomes +.>
Voice enhancement of the beam signal is achieved.
Fig. 5 is a diagram of a super-directional beam provided in the present application, where the target direction of one beam signal is 0 degrees, and the target directions of the other three beam signals are 90 degrees, 180 degrees, and 270 degrees, respectively.
Further, as can be seen from the super-directional beam pattern shown in fig. 5, there are a plurality of side lobes in the opposite direction of the target direction of each beam signal, and the presence of the side lobes may result in insufficient suppression capability of the beam signal to interference.
Therefore, in order to eliminate the side lobe and obtain a better enhancement effect, the present application proposes a side lobe suppression module with a constant beam width, and referring specifically to fig. 6, fig. 6 is a schematic workflow diagram of the side lobe suppression module provided in the present application.
As shown in fig. 6, the specific workflow of the sidelobe suppression module is mainly divided into four steps: step 201, obtaining a four-microphone sound signal; step 202, selecting a microphone in the current direction and a diagonal microphone to calculate a phase difference; step 203, obtaining a directional gain according to the preset gain value and the phase difference; step 204 applies the target gain to the current beam output suppression result.
Wherein the phase difference between the two channels is expressed as
θ is the phase, and when the phase difference Δθ (f, n) is within a set angle range, the angle gain G d (f, n) =1, in other angular ranges, the angular gain G d (f,n)<1 is used to suppress interference.
Specifically, the angular gain G d (f, n) is determined at different time-frequency points by the phase difference delta theta (f, n) of the time-frequency points, so the angle gain can be expressed as a function of the phase difference, G d (Δθ (f, n)). The angle gain is a set of preset coefficients so that signals in the target angle can completely pass through, and signals outside the angle are effectively restrained.
Further, in this application, as shown in fig. 7, the hearing aid divides the angle into a pass band (-90 °), a transition band (-120 ° -90 °,90 ° -120 °), and a suppression band (-180 ° -120 °,120 ° -180 °). The phase difference calculation formula of the set angle in the reference frequency band is as follows:
the calculation formula of other frequency bands is as follows:
according to the above formula, the corresponding phase difference threshold can be calculated to set the angle gain coefficient. The same angular gain factor is used for the 4 sets of beams so that each set of beams can be enhanced.
Step S12: and carrying out noise spectrum estimation on each beam signal to obtain the output energy of each beam signal.
Step S13: the signal-to-noise ratio of each beam signal is determined in accordance with the output energy of each beam signal.
In the embodiment of the application, the hearing aid acquires the output energy of each beam signal in a preset time period; acquiring the signal-to-noise ratio of each wave beam signal at each moment in the preset time period; and calculating the average value of the signal to noise ratio of each beam signal in the preset time period according to the signal to noise ratio of each beam signal at each moment.
In another embodiment, the hearing aid acquires a beam signal with a maximum signal-to-noise ratio at each moment in a preset time period, and records the hit number of each beam signal with the maximum signal-to-noise ratio at a certain moment; and outputting the beam signal with the highest hit frequency in the preset time period through the earphone.
Step S14: and outputting the beam signal with the maximum signal-to-noise ratio through the earphone.
In the embodiment of the application, in order to enable clear pickup, the hearing aid selects and outputs an optimal beam signal from the beams in 4 directions. The optimal beam SIGNAL is obtained by determining a SIGNAL-to-NOISE RATIO (SNR) of each directional beam SIGNAL, i.e., selecting a beam SIGNAL with the largest SNR as a final output.
Specifically, the step of selecting the optimal beam signal is as shown in fig. 8: step 301, acquiring four paths of beam output signals; step 302, estimating a noise spectrum, which is needed to be performed on each frequency point of each path of beam result, and can be performed by using a statistical method MCRA or NN; step 303, calculating the output signal-to-noise ratio, calculating the output energy of the wave beam, and finally, taking the average value of the specific frequency band to represent the signal-to-noise ratio of the current frame; step 304 counts the optimal snr direction within the time T, and outputs the direction with the largest number of hits, so as to achieve the smoothing effect.
It should be noted that, in other embodiments, the hearing aid may also use calculating the signal-to-noise ratio average value of the output signals of each beam in the time T range, and then select the optimal signal-to-noise ratio direction according to the signal-to-noise ratio average value, which may also achieve the smoothing effect.
In a specific embodiment, the hearing aid calculates the signal-to-noise ratio for the frequency band below 3kHz, and the 4-way beam result may calculate 4 signal-to-noise ratio results. The signal to noise ratio calculation can be performed for smoothing for a certain period of time, so that the output angle can have certain stability, the characteristic is important, and the switching of beam directions caused by impact noise in a noisy environment such as a restaurant is avoided. By adopting the multi-beam enhancement method, if a current presenter walks around a desk, the beams can be switched in real time, and the change of sound loudness is less than 1dB. In comparison with a unidirectional microphone, clear sound can be obtained without manually switching directions.
In the present application, the hearing aid acquires several beam signals of different target directions; carrying out noise spectrum estimation on each beam signal to obtain output energy of each beam signal; determining the signal-to-noise ratio of each beam signal according to the output energy of each beam signal; and outputting the beam signal with the maximum signal-to-noise ratio through the earphone. Through the mode, the hearing aid carries out voice enhancement by adopting the method of multipath beams, and selects beam signals by utilizing the optimal signal-to-noise ratio criterion, so that voice enhancement is realized, the pick-up problem in the process of multi-person communication and in a noisy environment like a restaurant can be solved, and a hearing aid wearer can have good experience.
In this application, in addition to the pick-up mode described above, the hearing aid is referred to as a fixed angle mode and a wearing mode. The working principle of the fixed angle mode is described as follows:
the hearing aid is switched by a switch on the microphone plate, which switches the output to any beam of interest for pick-up. In some situations, such as team conversations, the beam direction of maximum signal to noise ratio may not be the direction of interest to the hearing aid wearer, and the user may switch to a fixed angle mode instead of letting the system track the direction of maximum signal to noise ratio, so that the hearing aid wearer may communicate without interference.
The following description is made with reference to fig. 9 for further describing the operating principle of the wearing mode, where fig. 9 is a schematic flow chart of another embodiment of the wireless multi-microphone hearing aid method provided in the present application.
Specifically, as shown in fig. 9, the wireless multi-microphone hearing aid method in the embodiment of the application specifically includes the following steps:
step S21: the direction state acquired by the acceleration sensor of the microphone array board is acquired.
In the embodiment of the application, the microphone array board is internally provided with an acceleration sensor for judging the state of the microphone array.
The microphone array board is also internally provided with a micro-USB interface, so that media equipment such as televisions, conference sets and the like can be connected, and a wearer of the hearing aid can be helped to use the media equipment smoothly.
Step S22: when the direction state is a horizontal state, a mode is selected according to the maximum signal-to-noise ratio, and a voice signal is output through the earphone.
In the embodiment of the application, when the microphone array board is horizontally placed on a table, the horizontal state of the microphone array board can be timely obtained through the acceleration sensor so as to switch to the maximum signal-to-noise ratio selection mode.
In another embodiment, when the microphone array board is laid flat on a table, the user can also switch the hearing aid from the maximum signal-to-noise ratio selection mode to the fixed angle mode by inputting instructions, i.e. the voice signal for selecting the fixed direction is output through the earphone according to the instructions of the user.
Step S23: outputting a voice signal through the earphone according to the wearing mode when the direction state is a vertical state; the wearing mode is to output beam signals of the speaking direction of a user wearing the microphone array board through the earphone.
In this application embodiment, the microphone array board can hang and use on clothes collarband or neck, and this kind of mode of use is mainly used in removing or other scenes, and the audiphone person who wants to talk with only one, then the array board just can wear in counterpart's clothes collarband department, and acceleration sensor just can detect the vertical state of array board at this moment, will export the wave beam initiative and switch to the direction of speaker's mouth.
It will be appreciated by those skilled in the art that in the above-described method of the specific embodiments, the written order of steps is not meant to imply a strict order of execution but rather should be construed according to the function and possibly inherent logic of the steps.
According to the wireless multi-microphone hearing-aid method and the hearing aid, voice enhancement is performed by adopting a multi-path beam method, and the beam and side lobe suppression module can ensure that interference in a non-target direction can be effectively suppressed; the plane mode, the fixed angle mode and the wearing mode are designed, whether the microphone array board is horizontally placed or vertically placed can be judged through the acceleration sensor, so that the plane mode and the wearing mode are switched, the sound in the concerned direction can be picked up through setting the manual key to the fixed angle mode, and the hearing aid wearer can be effectively guaranteed to communicate in a multi-person or noisy environment through the design of multiple modes; meanwhile, the microphone array board can also be connected to media equipment such as televisions, conference sets and the like, so that a wearer can use the media equipment more conveniently.
In order to implement the wireless multi-microphone hearing aid method of the above embodiment, the present application further proposes a hearing aid, and specifically referring to fig. 10, fig. 10 is a schematic structural diagram of an embodiment of the hearing aid provided in the present application.
The hearing aid 300 of the present embodiment comprises a memory 31 and a processor 32, wherein the memory 31 and the processor 32 are coupled.
The memory 31 is used for storing program data, and the processor 32 is used for executing the program data to implement the wireless multi-microphone hearing aid method according to the above embodiment.
In the present embodiment, the processor 32 may also be referred to as a CPU (Central Processing Unit ). The processor 32 may be an integrated circuit chip having signal processing capabilities. The processor 32 may also be a general purpose processor, a digital signal processor (DSP, digital Signal Process), an application specific integrated circuit (ASIC, application Specific Integrated Circuit), a field programmable gate array (FPGA, field Programmable Gate Array) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components. The general purpose processor may be a microprocessor or the processor 32 may be any conventional processor or the like.
In order to implement the wireless multi-microphone hearing aid method of the above embodiment, the present application further provides a computer readable storage medium, as shown in fig. 11, where the computer readable storage medium 400 is used to store program data 41, and the program data 41, when executed by a processor, is used to implement the wireless multi-microphone hearing aid method according to the above embodiment.
The present application also provides a computer program product, wherein the computer program product comprises a computer program operable to cause a computer to perform a wireless multi-microphone hearing aid method according to an embodiment of the present application. The computer program product may be a software installation package.
The wireless multi-microphone hearing aid method according to the embodiments of the present application may be stored in a device, such as a computer readable storage medium, when implemented in the form of a software functional unit and sold or used as a stand-alone product. Based on such understanding, the technical solution of the present application may be embodied essentially or in part or all or part of the technical solution contributing to the prior art, or in the form of a software product stored in a storage medium, including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor (processor) to perform all or part of the steps of the methods according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The foregoing description is only of embodiments of the present application, and is not intended to limit the scope of the patent application, and all equivalent structures or equivalent processes using the descriptions and the contents of the present application or other related technical fields are included in the scope of the patent application.
Claims (11)
1. A wireless multi-microphone hearing aid method, comprising:
acquiring a plurality of beam signals in different target directions;
performing noise spectrum estimation on each beam signal to obtain output energy of each beam signal;
determining the signal-to-noise ratio of each beam signal according to the output energy of each beam signal;
and outputting the beam signal with the maximum signal-to-noise ratio through the earphone.
2. The wireless multi-microphone hearing aid method of claim 1, wherein,
said determining the signal-to-noise ratio of each beam signal in accordance with the output energy of said each beam signal, comprising:
acquiring output energy of each beam signal in a preset time period;
acquiring the signal-to-noise ratio of each wave beam signal at each moment in the preset time period;
and calculating the average value of the signal to noise ratio of each beam signal in the preset time period according to the signal to noise ratio of each beam signal at each moment.
3. The wireless multi-microphone hearing aid method of claim 1, wherein,
the outputting the beam signal with the maximum signal-to-noise ratio through the earphone comprises the following steps:
acquiring a beam signal with the maximum signal-to-noise ratio at each moment in a preset time period, and recording the hit number of each beam signal with the maximum signal-to-noise ratio at a certain moment;
and outputting the beam signal with the highest hit frequency in the preset time period through the earphone.
4. The wireless multi-microphone hearing aid method of claim 1, wherein,
the acquiring the plurality of beam signals in different target directions comprises:
collecting a plurality of beam signals in different beam directions by using uniformly distributed microphones, wherein the beam direction of each beam signal is the direction of the corresponding microphone;
each beam signal is voice enhanced using differential array super-steering beamforming.
5. The wireless multi-microphone hearing aid method of claim 4, wherein,
the voice enhancement of each beam signal using differential array super-steering beamforming includes:
calculating a noise cross-correlation matrix based on the angular frequency of the beam signal and the radius of the microphone array;
and solving the optimization problem of the beam signal voice enhancement by using the noise cross-correlation matrix, and obtaining the beam coefficient after the beam signal voice enhancement.
6. The wireless multi-microphone hearing aid method of claim 1, wherein,
after the plurality of beam signals in different target directions are acquired, the wireless multi-microphone hearing aid method further comprises the following steps:
acquiring a microphone in the current direction of the beam signal;
acquiring the phase difference between the current direction microphone and the diagonal microphone;
acquiring the directional gain of the beam signal according to a preset gain value and the phase difference;
and suppressing the sidelobe signal output of the beam signal by using the directional gain.
7. The wireless multi-microphone hearing aid method of claim 6, wherein,
when the phase difference is within a preset angle range, the preset gain value is a preset value; and when the phase difference is out of the preset angle range, the preset gain value is smaller than the preset value.
8. The wireless multi-microphone hearing aid method of claim 1, wherein,
the wireless multi-microphone hearing aid method further comprises the following steps:
acquiring a direction state acquired by an acceleration sensor of the microphone array board;
when the direction state is a horizontal state, a mode is selected according to the maximum signal-to-noise ratio, and a voice signal is output through the earphone;
outputting a voice signal through the earphone according to the wearing mode when the direction state is a vertical state; the wearing mode is to output beam signals of the speaking direction of a user wearing the microphone array board through headphones.
9. The wireless multi-microphone hearing aid method of claim 8, wherein,
after the direction state acquired by the acceleration sensor of the microphone array board is acquired, the wireless multi-microphone hearing aid method further comprises the following steps:
when the direction state is a horizontal state, selecting a beam signal in a fixed direction according to a user instruction and outputting the beam signal through the earphone.
10. A hearing aid comprising a processor and a memory, the memory having stored therein program data, the processor being adapted to execute the program data to implement the wireless multi-microphone hearing aid method according to any of claims 1-9.
11. A computer readable storage medium for storing program data which, when executed by a processor, is adapted to carry out the wireless multi-microphone hearing aid method of any of claims 1-9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211648535.0A CN116390005A (en) | 2022-12-21 | 2022-12-21 | Wireless multi-microphone hearing aid method, hearing aid, and computer-readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211648535.0A CN116390005A (en) | 2022-12-21 | 2022-12-21 | Wireless multi-microphone hearing aid method, hearing aid, and computer-readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116390005A true CN116390005A (en) | 2023-07-04 |
Family
ID=86964379
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211648535.0A Pending CN116390005A (en) | 2022-12-21 | 2022-12-21 | Wireless multi-microphone hearing aid method, hearing aid, and computer-readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116390005A (en) |
-
2022
- 2022-12-21 CN CN202211648535.0A patent/CN116390005A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI713844B (en) | Method and integrated circuit for voice processing | |
| CN110447073B (en) | Audio signal processing for noise reduction | |
| CN104424953B (en) | Audio signal processing method and device | |
| US9282411B2 (en) | Beamforming in hearing aids | |
| US7983907B2 (en) | Headset for separation of speech signals in a noisy environment | |
| EP2088802B1 (en) | Method of estimating weighting function of audio signals in a hearing aid | |
| US8903108B2 (en) | Near-field null and beamforming | |
| US9020163B2 (en) | Near-field null and beamforming | |
| US20070253574A1 (en) | Method and apparatus for selectively extracting components of an input signal | |
| TW200951942A (en) | Speech enhancement using multiple microphones on multiple devices | |
| CN110169083B (en) | System for controlling with beam forming | |
| TWI825471B (en) | Conference terminal and feedback suppression method | |
| WO2021129197A1 (en) | Voice signal processing method and apparatus | |
| CN113163152A (en) | Multi-dimensional sound pickup and noise reduction method, video teleconference system and computer storage medium | |
| CN116390005A (en) | Wireless multi-microphone hearing aid method, hearing aid, and computer-readable storage medium | |
| US20250048043A1 (en) | Ear-worn device with neural network-based noise modification and/or spatial focusing | |
| US20250211925A1 (en) | Signal processing method and acoustic system | |
| US20250220363A1 (en) | Signal processing method and acoustic system | |
| WO2025034671A1 (en) | Ear-worn device with neural network-based noise modification and/or spatial focusing | |
| CN114333888A (en) | Multi-beam joint noise reduction method and device based on white noise gain control | |
| CN119110189A (en) | Signal processing method, array microphone device, computer device, storage medium and program product | |
| CN117376757A (en) | Sound pickup method, processor, electronic device, and computer storage medium | |
| GB2606176A (en) | Apparatus, methods and computer programs for controlling audibility of sound sources | |
| CN115810362A (en) | Conference terminal and feedback suppression method | |
| CN118972742A (en) | Signal processing method and acoustic system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |