CN103024629B - Processing signals - Google Patents
Processing signals Download PDFInfo
- Publication number
- CN103024629B CN103024629B CN201210377115.3A CN201210377115A CN103024629B CN 103024629 B CN103024629 B CN 103024629B CN 201210377115 A CN201210377115 A CN 201210377115A CN 103024629 B CN103024629 B CN 103024629B
- Authority
- CN
- China
- Prior art keywords
- signal
- mobile device
- arrival direction
- motion
- interference
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000033001 locomotion Effects 0.000 claims abstract description 98
- 238000000034 method Methods 0.000 claims abstract description 38
- 230000005236 sound signal Effects 0.000 claims description 99
- 238000007493 shaping process Methods 0.000 claims description 29
- 230000008569 process Effects 0.000 claims description 21
- 230000008859 change Effects 0.000 claims description 12
- 230000001629 suppression Effects 0.000 claims description 5
- 230000001133 acceleration Effects 0.000 claims description 3
- 238000004590 computer program Methods 0.000 abstract description 5
- 230000003068 static effect Effects 0.000 description 7
- 238000010606 normalization Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 239000012141 concentrate Substances 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000002349 favourable effect Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000003044 adaptive effect Effects 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 238000004378 air conditioning Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 239000011469 building brick Substances 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
Landscapes
- Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
Mobile device, method and computer program product for processing signals at the mobile device. The signals are received at a plurality of signal sensors of the mobile device. Motion of the mobile device is sensed and the received signals are processed using beamforming means at the mobile device, in dependence upon their direction of arrival at the plurality of signal sensors and in dependence upon the sensed motion of the mobile device.
Description
Technical field
The present invention relates to process signal.In particular it relates to using beam-shaper process signal.
Background technology
Equipment can have the input link that may be used to from surrounding receive sent signal.For example, equipment can be with
With may be used to from surrounding receive audio signal such as the audio input component of mike.For example, the Mike of user equipment
Wind can receive main audio signal（Voice of the Tathagata from user）And other audio signals.Described other audio signals may
It is the interference tones signal received at the mike of equipment, and can receives from interference source or can around carry on the back
Scape noise or mike itself noise.Interference tones signal may bother the main audio signal received at equipment.Institute
Received audio signal can be used for many different purposes by the equipment of stating.For example, the audio signal for receiving be from
In the case of the voice signal that family receives, during the voice signal can be processed for communication event by equipment, for example, lead to
Cross another user-dependent another equipment being sent to voice signal via network with communication event.Or, or additionally,
The audio signal for receiving can be used for other purposes, as is known in the art.
In other examples, equipment can have for receiving other types of sending signal（As radar signal, sonar are believed
Number, aerial signal, radio wave, microwave and common wide signal or narrow band signal）Receiving member.For these other types
Sending signal be likely to occur identical situation, main signal and the interference signal at receiving member are received whereby.Below
Description is mainly relatively to provide with the reception audio signal at equipment, but same principle will be suitable for receiving it at equipment
The sending signal of its type, such as above-mentioned common wide signal, common narrow band signal, radar signal, Sonar Signal, aerial signal,
Radio wave and microwave.
In order to improve the audio signal for receiving（For example, the voice signal for calling for receiving from user）Matter
Amount, needs the interference tones signal for suppressing to be received at the mike of user equipment（For example, background noise and from interference tones
The interference tones signal that source receives）.
Stereophony microphone that multiple mikes work as single audio input component and other microphone arrays make
With becoming more common.Multiple mikes are used at equipment so that except believing from the audio frequency received by single mike
Number extract information outside can also use the spatial information extracted from the audio signal for receiving.When using these equipment
When, a kind of method for suppressing interference tones signal is that beam-shaper is applied to into the audio frequency that received by multiple mikes
Signal.Beam shaping is by concentrating the audio signal received by microphone array to strengthen in Mike using signal processing
The process of the particular audio signal from one or more required directions received at wind array.For simplicity, we
Only have a case that single required direction being described herein, but when there is multiple concern directions, same procedure will be suitable for.
Beam shaping is the angle by estimating to be received at mike required audio signal first（So-called arrival direction
(" DOA ") information）To realize.Adaptive beamforming device locates the audio frequency that the multiple mikes of reason are received using DOA information
Signal applies high-gain and along other sides along the direction that required audio signal is received by mike whereby to form " wave beam "
To applying low gain.
Although beam-shaper will attempt to suppress the unwanted audio signal from unwanted direction, mike
Quantity and the shapes and sizes of microphone array will limit the effect of beam-shaper, and thus while unwanted sound
Frequency signal is suppressed, but still can may hear.Can receive according to processing from single mike in the apparatus
To audio signal mode further processing the output of beam-shaper, for example, for as a part for communication event
It is transferred to another equipment.For example, the output of beam-shaper can be supplied to as input signal the echo in equipment to disappear
Except processing stage stage, automatic growth control (AGC) and at least one of single channel lower noise stage.
Beam-shaper can be controlled to concentrate on the specific direction for expecting to receive main audio signal.For example, may be used
With the ad-hoc location being positioned over microphone array on table, and user can generally sit ad-hoc location on the table, so that
It is intended to approximately uniform arrival direction from the voice signal of user（" main arrival direction "）Reach microphone array.Wave beam
Former can be controlled so as to towards this main arrival direction, and the language from user received at microphone array is concentrated on whereby
Message number, and greater attenuation level is applied to the audio signal from other directions received at microphone array.Ripple
Beam shaper can adaptively change its focussing direction, preferably to match the arrival of main audio signal during use
Direction, but this possibly calculates complicated process and adaptive generation and can take.Therefore, ripple formed before the use
Correctly in advance control can be favourable to main arrival direction to shape device.
The content of the invention
In recent years, the size of electronic building brick, weight and cost are decreased, so that being embodied as many equipment now
Mobile device is feasible.Mobile device can have be implemented on wherein with receive audio signal mike.For example, mobile electricity
Words, notebook computer, panel computer and other mobile devices can be carried by user, and can be implemented for receiving audio frequency letter
Number mike.As described above, the enforcement of multiple mikes makes it possible for beam-forming method.Inventor has realized
Arrive, beam-shaper implemented in a mobile device by for favourable, but correct control enforcement wave beam in a mobile device into
Shape device there may be problem, because mobile device is inherently intended to movement.Specifically, inventor is it has been realized that work as
When mobile device is moved, adjust and the beam-shaper coefficient of audio signal is applied to by for useful by beam-shaper.With
This mode, even if when mobile device is moved, the beam pattern of beam-shaper can also concentrate what is received by mike（It is many
It is individual）Main audio signal.In in order to be used for mobile device, beam-forming method be preferably able to equipment moved it is any when
Wait and follow the trail of new situation.
Inventor is also realized that, can implement motion sensor in mobile device, and the motion sensor can be to
The motion of sensing movement equipment.For example, gyroscope and accelerometer can in a mobile device be implemented, with the rotation of sensing movement equipment
Turn and linear movement.Output from motion sensor can be used by beam-shaper adjust beam-shaper coefficient with
The motion of mobile device is considered, so that beam-shaper is concentrated on when mobile device is moved（It is multiple）Main audio is believed
Number.This allows beam-shaper to be implemented in mobile device with successful forms.Smart phone and panel computer computer are usual
The example of the mobile device with gyroscope, accelerometer and multiple mikes.In addition, may have more notebook computers in future
Equipped with similar hardware.
According to the first aspect of the invention, there is provided a kind of mobile device, including：Multiple signals for receiving signal are passed
Sensor；Beam shaping component, it is used to the direction depending on the plurality of signal transducer of signal arrival process what is received
Signal；Motion sensor component, it is used for the motion of sensing movement equipment and for by the motion for sensing of mobile device
Instruction is supplied to beam shaping component, wherein the beam shaping component is arranged to the fortune for sensing depending on mobile device
Dynamic indicates to process the signal for receiving.
The signal can be audio signal, and signal transducer could be for the mike of reception audio signal.
The signal may instead be the sending signal of any other type, such as common wide signal, common narrow band signal, radar letter
Number, Sonar Signal, aerial signal, radio wave and microwave.
Advantageously, because beam shaping component using the motion for sensing of mobile device instruction, beam shaping
It is towards mainly that component can precisely control the beam pattern of beam shaping component when mobile device is moved（Or " institute
Need "）Signal, voice signal of the Tathagata from user.
The signal can include：I () respectively has at least one main arrival direction at least at multiple signal transducers
One main signal, and (ii) at multiple signal transducers have each interference arrival direction interference signal.In addition, wave beam
Formed parts can include beam pattern is applied to the component of the signal for receiving, with whereby will it is higher suppression level be applied to
The interference arrival direction signal for receiving rather than the signal received with least one main arrival direction.
Beam shaping component may be configured to be interfered with to follow the trail of using the instruction of the motion for sensing of mobile device
Up to direction, and correspondingly adjust beam-shaper coefficient（And change beam pattern whereby）, to suppress whereby at signal transducer
With the interference signal for disturbing arrival direction to receive.Similarly, beam shaping component may be configured to use mobile device
The instruction of the motion for sensing correspondingly adjusts beam-shaper coefficient following the trail of at least one main arrival direction（And whereby
Change beam pattern）, to strengthen at least one master respectively received with least one main arrival direction at signal transducer whereby
Want signal.
In gyroscope and accelerometer that motion sensor component can include for the motion of sensing movement equipment at least
One.Gyroscope can be used for the rotary motion of sensing movement equipment, and accelerometer can be used for the acceleration of sensing movement equipment.
When equipment is moved, for example, when mobile device user carries mobile device when walking, believed using gyroscope and accelerometer
The arrival direction for ceasing to follow the trail of interference source can aid in beam shaping component decay is applied to by multiple signals more quickly
The audio signal that sensor is received from interference source.The motion for sensing from the mobile device of motion sensor component is indicated
It is particularly useful for static interference source is followed the trail of when mobile device is moved, but equally has for non-static interference source is followed the trail of
With because the motion of mobile device can be indicated explain by the motion for sensing, non-static interference source is followed the trail of in simplification whereby
The task of motion.
According to the second aspect of the invention, there is provided a kind of method of the process signal at mobile device, methods described bag
Include：Signal is received at multiple signal transducers of mobile device；The motion of sensing movement equipment；Use with mobile device
Beam shaping component, arrival direction depending on signal at multiple signal transducers simultaneously depends on sensing for mobile device
Move to process the signal for receiving.
According to the third aspect of the present invention, there is provided a kind of to connect at multiple signal transducers of mobile device for processing
The computer program of the signal for receiving, the computer program is recorded in non-transitory computer-readable media simultaneously
And perform following steps when being configured on the processor for be implemented in mobile device：Connect from the motion sensing component of mobile device
Receive the instruction of the motion for sensing of mobile device；With implement beam shaping component, with depending on signal in multiple sensings
Arrival direction at device and depend on mobile device the motion for sensing instruction processing the signal for receiving.
Description of the drawings
For a better understanding of the present invention and show the present invention how can be made to put into practice, will be referred to by example now
The following drawings, in accompanying drawing：
Fig. 1 illustrates the schematic diagram of the mobile device according to preferred embodiment；
Fig. 2 illustrates the system according to preferred embodiment；
Fig. 3 illustrates the functional-block diagram of the mobile device according to preferred embodiment；
Fig. 4 is the flow chart of the process of the process audio signal according to preferred embodiment；With
Fig. 5 illustrates that the figure how estimated in one embodiment up to directional information.
Specific embodiment
Only the preferred embodiments of the present invention will be described by example now.Embodiment described below is related to signal for sound
The situation of frequency signal.However, other embodiments are related to signal for other types of sending signal（Such as common wide signal, common
Narrow band signal, radar signal, Sonar Signal, aerial signal, radio wave and microwave）Situation.
In the following examples of the present invention, following technology is described：Using motion sensor come by the motion of mobile device
Instruction is supplied to beam-shaper, so that adjusting beam-shaper coefficient based on the motion of mobile device.This permits
Even if perhaps beam-shaper is implemented in a mobile device and contributes to beam-shaper and also focus on when mobile device is moved
Required audio signal.
With reference first to Fig. 1, Fig. 1 illustrates the schematic diagram of mobile device 102.Mobile device 102 is portable set.Movement sets
Standby 102 include CPU 104, for receiving the microphone array 106 of audio signal, for the motion of sensing movement equipment 102
Motion sensor 108, the speaker 110 for exports audio signal, for the user of mobile device 102 export vision data
The display 112 such as screen and the memorizer 114 for data storage be connected to CPU 104.
With reference now to Fig. 2, Fig. 2 illustrates the example context 200 that mobile device 102 is worked in.
The microphone array 106 of mobile device receives the audio signal from environment 200.For example, as shown in Fig. 2 Mike
Wind array 106 receives the audio signal from user 202（D is designated as in Fig. 21）, from the audio signal of another user 204
（D is designated as in Fig. 22）, from the audio signal of fan 206（D is designated as in Fig. 23）It is anti-from wall 208 with from user 202
The audio signal being emitted back towards（D is designated as in Fig. 24）.It should be apparent to those skilled in the art that microphone array 106 can connect
Receive other audio signals different from the signal shown in Fig. 2.Under the scene shown in Fig. 2, the audio signal from user 202 is
Required video signal, and all other video signal received at microphone array 106 is interference tones signal.At other
In embodiment, the more than one audio signal received at microphone array 106 can be considered that " required " audio frequency is believed
Number, but for simplicity, embodiment described herein in, only exist a required audio signal（It is from user
202 audio signal）, and other audio signals are considered as interference.Fig. 2 illustrates that interference source is another user 204, fan
206 and from the reflection of wall 208.Other undesired noise signal sources can include such as air conditioning system and just play music
Equipment.
When processing it after audio signal is received at microphone array 106, identify（It is multiple）It is required
Audio signal.During processing, required audio signal is recognized based on the detection of similar phonetic feature, and determines main loudspeaker
Principal direction.In fig. 2, main loudspeaker（User 202）It is illustrated as from principal direction d1Reach the required audio frequency letter of microphone array 106
Number source.
With reference now to Fig. 3, Fig. 3 illustrates that the function of mobile device 102 is represented.Microphone array 106 includes multiple mikes
3021、3022With 3023.Mobile device 102 also includes beam-shaper 304.Beam-shaper 304 can be embodied in and be implemented in
In software on CPU 104, or it is implemented in the hardware in mobile device 102.Each mike in microphone array 106
Output be couple to beam-shaper 304 each input.Beam-shaper 304 has can be applied to the audio frequency letter for receiving
Number beam pattern.Beam-shaper 304 can be adapted and change beam pattern whereby.It will be apparent to those skilled in the art that needing
It is multiple to be input into implement beam shaping.Microphone array 106 is shown to have in figure 3 three mikes（3021、3022With
3023）, it will be understood that, this number of mike is merely illustrative and limits never in any form.
Beam-shaper 304 includes the audio signal for receiving and processing mike from microphone array 106
Process component.For example, beam-shaper 304 can include that speech activity detector (VAD) and DOA estimate block.At work, ripple
Beam shaper 304 confirms the property of the audio signal received by microphone array 106, and estimates block inspection based on by VDA and DOA
The detection of the quality of the similar voice for measuring, it is determined that（It is multiple）One or more principal directions of main loudspeaker.In showing shown in Fig. 2
In example, the direction (d of the audio signal received from user 2021) it is confirmed as principal direction.Beam-shaper 304 is believed using DOA
Breath processes audio signal by forming wave beam, and the wave beam is wanting signal along receiving at microphone array 106
Principal direction (d1) direction have high-gain and to any other signal source direction（For example, d1、d2And d3）With low increasing
Benefit.Although above description beam-shaper 304 can determine any number of principal direction, determined by principal direction number
The attribute of beam-shaper is affected, for example, for a large amount of principal directions, beam-shaper 304 will be than only determining single main formula
To situation, from other at microphone array（It is not intended to）The signal that direction receives applies less decay.Beam-shaper
304 output is by further process component of the offer to mobile device 102 in the form of pending individual channel.Such as will be to this
Art personnel are it is readily apparent that the output of beam-shaper 304 can in many different forms be used for mobile device 102
In.For example, the output of beam-shaper 304 can serve as of the communication event that user 202 is participated in using mobile device 102
Point.
The output of beam-shaper 304 can undergo further signal processing（For example, automatic growth control and noise press down
System）.The details of such further signal processing is beyond the scope of this invention, and therefore does not provide further signal processing herein
Details, but it will be appreciated by those skilled in the art that the side of the output of beam-shaper 304 can be processed in mobile device 102
Formula.
As shown in figure 3, the output of motion sensor 108 is provided to beam-shaper 304（For example, using CPU 104）.
The motion of the sensing movement equipment 102 of motion sensor 108.The motion of mobile device 102 will affect to be connect at microphone array 106
Receive the direction of audio signal, and therefore by the audio signal for affecting beam-shaper 304 to be applied to and receiving with by audio frequency
Signal is correctly focused in principal direction（For example, d1）Beam pattern.Beam-shaper 304 can be used from mobile device 102
Sensing motion motion sensor 108 instruction, correspondingly to adjust the beam-shaper coefficient of beam-shaper 304.
A kind of method for controlling beam-shaper 304（For example, for the purpose of the motion for detecting for compensating mobile device 102）For
Using direction Normalization Technique.Direction Normalization Technique can be related in the audio signal received at beam-shaper 304
Including regular noise, to adjust the beam-shaper coefficient of beam-shaper 304, adjusting whereby should by beam-shaper 304
For with the suppression being specific to up to the audio signal of directional information at microphone array 106.For example, beam-shaper
304 can be by including the arrival direction corresponding to the direction for matching interference tones signal in the audio signal for receiving（Example
Such as, from direction d2、d3And d4）Higher level regular noise changing the audio signal for receiving, wherein being subsequently based on
Amended audio signal is calculating the filter coefficient of beam-shaper 304.When mobile device 102 is moved, carry out autokinesis
The signal of sensor 108 may be used to follow the trail of the arrival direction of interference tones signal（For example, from direction d2、d3And d4）, so that
Regular noise is correctly included in the audio signal for receiving, so that the beam shaping when mobile device 102 is moved
The beam-shaper coefficient of device 304 is correctly adjusted to suppress interference tones signal whereby.Motion sensor 108 can be carried out
It is any sensor of the motion for sensing movement equipment, such as gyroscope and/or accelerometer or known in the art any
Other types of motion sensor.When mobile device 102 is moved, motion sensor may be used to determine the side of mobile device 102
Position and movement, to follow the trail of audio signal source（For example, primary audio source 202 and interference tones source 204,206 and 208）Arrival side
To.
With reference to Fig. 4, a kind of method of the process audio signal according to preferred embodiment will now be described.In step S402,
The mike of microphone array 106（3021、3022With 3023）Place receives audio signal.The audio signal is from such as Fig. 2 institutes
User 202, user 204, fan 206 and the wall 208 for showing is received.Can also be in the mike of microphone array 106（3021、
3022With 3023）Place receives other interference tones signals（Such as background noise）.By each mike of microphone array 106
（3021、3022With 3023）The audio signal for receiving is passed to beam-shaper 304.
In step S404, the motion of the sensing movement equipment 102 of motion sensor 108.Can be using motion sensor 108
The orientation of detection mobile device 102 and movement.The instruction of the motion for sensing of mobile device 102 is by from motion sensor 108
Beam-shaper 304 is provided.
In step S406, beam-shaper 304 processes the mike from microphone array 106（3021、3022With 3023）Connect
The audio signal for receiving, so that beam-shaper coefficient to be applied to whereby the audio signal for receiving.Beam-shaper coefficient is retouched
The decay of the function as the angle that audio signal is received at microphone array 106 is stated, the decay will be by beam-shaper
304 applied audio signals.Based on such as being referred to by the input from motion sensor 108 received in beam-shaper 304
The motion of the mobile device 102 for showing changes whereby its beam pattern adjusting beam-shaper 304.Beam-shaper 304 can be chased after
Arrival direction of the track from the audio signal of particular source.For example, beam-shaper 304 is followed the trail of from primary audio source（For example, use
Family 202）Required audio signal arrival direction（" main arrival direction "）, and beam-shaper coefficient is adjusted to concentrate principal direction
Audio signal.The instruction of the motion of mobile device 102 is by beam-shaper 304 using following the trail of main arrival direction.For example, such as
Fruit user 202 is static and mobile device 102 is moved, then may be used to follow the trail of main arrival side from the signal of motion sensor 108
To.Even if user 202 is not static and mobile device 102 is moved, also may be used to by from chasing after from the signal of motion sensor 108
Track calculates and removes the motion of mobile device 102 to simplify the tracking of main arrival direction.This simplification can cause tracing process more
Hurry up, more effectively, computation complexity is lower and consumes less power.
Beam-shaper 304 can also be followed the trail of from interference tones source（For example, user 204, fan 206 and wall 208）
Interference tones signal arrival direction（" interference arrival direction "）, and beam-shaper coefficient is adjusted with by higher attenuation level
It is applied to the interference tones signal received from interference arrival direction.The motion of mobile device 102 is indicated by beam-shaper 304
Arrival direction is disturbed using following the trail of.For example, if interference source is static, mobile device 102 is moved, then from motion-sensing
The signal of device 108 may be used to follow the trail of corresponding interference arrival direction.Even if interference source is not static and mobile device 102 is moved, come
The signal of autokinesis sensor 108 also may be used to the motion by removing mobile device 102 from tracing computation to simplify interference
The tracking of arrival direction.This simplification can cause tracing process faster, more effectively, computation complexity is lower and consumes less
Power.
It will be appreciated by those skilled in the art that may be used to follow the trail of the arrival direction of main audio signal and by microphone array
106 advance control is compensating the technology of main audio signal.In order to compensate beam-shaper to guarantee interference tones signal
Decay, it is possible to use the normalized method in direction as described above.In direction normalization method, by the sound for receiving
Frequency signal includes the regular noise corresponding to interference arrival direction to change the audio signal for receiving, adjustment beam shaping
Device 304 is changing whereby beam-shaper coefficient.It is subsequently based on amended audio signal to calculate beam-shaper coefficient, with
So that the beam-shaper coefficient indicates that beam-shaper 304 should be applied to higher attenuation level in microphone array 106
Sentence the audio signal that interference arrival direction is received.By the motion that mobile device 102 is followed the trail of with motion sensor 108, side
Can correctly be included in the audio signal for receiving to the regular noise used in Normalization Technique, even if with whereby
Unwanted audio signal is also set correctly to decay when mobile device 102 is moved.Direction normalization is only beam-shaper 304
The example that unwanted audio signal how can be made adaptively to decay when mobile device 102 is by movement, and at this
Other technologies for accomplishing this can be used in the other embodiments of invention.
When mobile device 102 is moved, by using motion sensor（For example, gyroscope and accelerometer）Information, wave beam
Former 304 can predict how mobile relative to mobile device 102 itself the main source in environment 200 and interference source be（That is, chase after
Track is main and interference source）.
For beam shaping, it is known that the arrival direction of interference source is with along the interference tones signal from the interference source
It is favourable that direction applies decay.Embodiments of the invention allow to be based on motion sensor（For example, gyroscope and accelerometer）Letter
Cease and change beam-shaper coefficient without the need for following the trail of the extra tracking activity of the beam-shaper 304 for changing required.Therefore
Simplify tracking.In addition, relative to main audio signal（For example, input power source）For, the wave beam of beam-shaper 304 into
The change of shape device coefficient may cause to bother/distortion to main audio signal, and from motion sensor（For example, gyroscope
And accelerometer）Information use potentially contribute to beam-shaper 304 response mobile device 102 motion adjust wave beam rapidly
Former coefficient, so that reducing bothering/distortion by what beam-shaper 304 caused main audio signal.One
In individual example, beam-shaper 304 is minimum variance undistorted response (MVDR) beam-shaper, and it is made in microphone array
Row 106 are sentenced（It is multiple）What main arrival direction was received（It is multiple）Under the distortionless restriction of main audio signal minimize wave beam into
The energy of the output of shape device 304.MVDR beam-shapers are to be used from motion sensor by control microphone array in advance
108 information is compensating the example of only main loudspeaker.MVDR beam-shapers will subsequently must adapt to any change of interference source.
If with for example above-mentioned direction normalization Combination of Methods, then whole beam patterns of beam-shaper can be corrected implicitly
（By changing beam-shaper coefficient）, to compensate all known required or unwanted sources.
It is more fully described referring now to Fig. 5 and performed by beam-shaper 304 to determine the arrival direction of audio signal
（For example, main arrival direction or interference arrival direction）Arrival direction (DOA) estimate operation.
DOA information is received by estimating the multiple mikes in microphone array 106 by beam-shaper 304
Time delay between audio signal（For example, using bearing calibration）And using the multiple mikes with regard to microphone array 106
3021、3022With 3023The priori of position estimate audio signal source estimating.
As an example, Fig. 5 illustrates the Mike for receiving audio signal on two independent input channels from primary audio source 202
The mike 302 of wind array 1061With 3022.In order to make it easy to understand, Fig. 5 illustrates point source 202, its medium wave is from source 202 with circular fortune
It is dynamic to blaze abroad.This be in real-life situation, but equation described below is assumed in mike 3021With 3022Place connects
Receive the audio signal for receiving as plane wave.When point source 202 and mike 3021With 3022From " away from enough " when, this
It is assumed that good assume.In the case where plane wave assumes, it is possible to use equation (1) is estimating the mike in distance of separation d
3021With 3022The audio signal arrival direction at place：
(1)
WhereinvFor the speed of sound, andIt is the audio signal arrival mike 302 from interference source 2041With 3022
Time between difference, i.e. time delay.It is known parameters for microphone array 106 apart from d, and the speed of soundv
For known（About 340 ms-1）.Time delayIt is obtained as maximizing in mike 3021With 3022Output at receive
The time lag of the cross-correlation between the main audio signal for arriving.Subsequently can be found out corresponding to this using equation given above (1)
The angle of time delayθ.Characteristics of speech sounds can be detected in the audio signal received with the delay of maximum cross-correlation, to determine
（It is multiple）One or more principal directions of main loudspeaker.
It will be appreciated that, the cross-correlation of signal calculated is the common technology of field of signal processing, and will not carry out herein more detailed
Thin description.
In above-mentioned example embodiment, microphone array 106 is mike（3021、3022With 3023）One-dimensional array, its
Beam-shaper 304 is allowed to distinguish with one-dimensional（For example, along trunnion axis）In the audio signal that arrives of different angular acceptances.Substituting
In embodiment, microphone array 106 can be the two-dimentional or three-dimensional microphone array of mike, and it will allow beam-shaper
304 distinguish with respectively in two dimension or three-dimensional（For example, along level, vertical and depth axle）In different angular acceptances arrive audio frequency letter
Number.
As described above, beam-shaper 304 can be embodied in the software performed on CPU 104, or it is implemented in movement
In the hardware of equipment 102.When beam-shaper 304 is implemented in software, it can be by being recorded in non-transitory computer
Computer program on readable media is provided, and the computer program is configured to be implemented in mobile device 102
CPU 104 on when perform the function of beam-shaper as above 304.
Although above-described embodiment is related to receive a required audio signal (d from unique user 2021) microphone array
106, it will be understood that, microphone array 106 can be received from multiple users（For example, in videoconference）Audio frequency letter
Number, the audio signal can all be considered required audio signal.In such a scenario, the audio signal wanted in multiple sources
Reach microphone array 106.
In addition, although be particularly shown and described the present invention by reference to preferred embodiment, but those skilled in the art
It will be understood that, each of form and details can be carried out in the case of without departing from the scope of the invention being defined by the appended claims
Plant and change.
Claims (8)
1. a kind of mobile device (102), including：
Multiple signal transducers (302), it is used to receive signal, wherein the signal is audio signal, and the signal is passed
Sensor (302) is the mike for receiving the audio signal；
Beam shaping component (304), it is used to depend on the signal for receiving at the plurality of signal transducer (302) place
Arrival direction processing the signal for receiving；
Motion sensor component (108), it is used to sense the motion of the mobile device (102) and for the beam shaping
Component (304) provides the instruction of the motion for sensing of the mobile device (102),
Wherein described beam shaping component (304) is arranged to the fortune for sensing depending on the mobile device (102)
The dynamic instruction is processing the signal for receiving；Wherein described signal packet is included：I () is in the plurality of signal transducer
(302) place respectively has at least one main signal of at least one main arrival direction, and (ii) is in the plurality of signal transducer
(302) place has the interference signal of each interference arrival direction,
Wherein described beam shaping component (304) includes beam-shaper coefficient is applied to the structure of the signal for receiving
Part, so that higher suppression level is applied to the signal that receives of interference arrival direction rather than with described at least one whereby
The signal that individual main arrival direction is received, wherein the beam shaping component (304) is configured to use the mobile device
(102) instruction of the motion for sensing following the trail of the interference arrival direction, by the letter for receiving
Number include the regular noise corresponding to the interference arrival direction followed the trail of to change the signal for receiving, and based on repairing
The signal for receiving after changing calculating the beam-shaper coefficient, to suppress whereby in the signal transducer
(302) interference signal that the interference arrival direction is received is sentenced.
2. mobile device (102) as claimed in claim 1, wherein the beam shaping component (304) is configured to use institute
The instruction of the motion for sensing of mobile device (102) is stated following the trail of described at least one main arrival direction, and phase
Should the ground adjustment beam-shaper coefficient, with strengthen whereby the signal transducer (302) sentence it is described each at least one
At least one main signal that individual main arrival direction is received.
3. mobile device (102) as claimed in claim 1, wherein the motion sensor component (108) is included for sensing
At least one of gyroscope and accelerometer of the motion of the mobile device (102).
4. mobile device (102) as claimed in claim 1, wherein the motion of the sensing mobile device (102) includes
Below at least one：I () senses the rotary motion of the mobile device (102) using gyroscope, and (ii) uses accelerometer sense
Survey the acceleration of the mobile device (102).
5. mobile device (102) as claimed in claim 1, wherein the signal is in signals below：I () audio frequency is believed
Number, (ii) common wide signal, (iii) common narrow band signal, (iv) radar signal, (v) Sonar Signal, (vi) aerial signal,
(vii) radio wave and (viii) microwave.
6. in the method for mobile device (102) place process signal, methods described includes one kind：
The signal is received at multiple signal transducers (302) place of the mobile device (102), wherein the signal is audio frequency
Signal, and the signal transducer (302) is the mike for receiving the audio signal；
Sense the motion of the mobile device (102) and the finger of the motion for sensing of the mobile device (102) is provided
Show；With
Beam shaping component (304) is used at the mobile device (102) place, depending on the signal for receiving described many
The arrival direction at individual signal transducer (302) place simultaneously depends on the motion for sensing of the mobile device (102) locating
The signal received described in reason；
Wherein described signal packet is included：I () respectively has at least one main arrival direction at least at multiple signal transducers (302) place
One main signal, and (ii) is in interference signal of multiple signal transducers (302) place with each interference arrival direction,
The signal received described in wherein described process includes signal application of the beam shaping component (304) to the reception
Beamformer coefficient so that higher suppression level is applied to the signal that receives of interference arrival direction rather than
With the signal that described at least one main arrival direction is received, wherein the beam shaping component (304) is configured to use institute
The instruction of the motion for sensing of mobile device (102) is stated following the trail of the interference arrival direction, by described
The signal for receiving includes the regular noise corresponding to the interference arrival direction followed the trail of to change the letter for receiving
Number, and the beam-shaper coefficient is calculated based on the amended signal for receiving, to suppress whereby in the letter
Number sensor (302) sentences the interference signal that the interference arrival direction is received.
7. method as claimed in claim 6, wherein the step of motion of the sensing mobile device (102) includes
At least one of following steps：I () senses the rotary motion of the mobile device (102) using gyroscope, and (ii) is used
Accelerometer senses the acceleration of the mobile device (102).
8. a kind of mobile device (102), including：
The motion for sensing of the mobile device (102) is received from the motion sensing component (108) of the mobile device (102)
Instruction component；With
Implement beam shaping component (304), passed with the multiple signals depending on the signal for receiving in the mobile device (102)
The instruction of the arrival direction at sensor (302) place and the motion for sensing for depending on the mobile device (102) comes
The component of the signal received described in processing, wherein the signal is audio signal, and the signal transducer (302) is use
In the mike for receiving the audio signal,
Wherein described signal packet is included：I () respectively has at least one main arrival direction at least at multiple signal transducers (302) place
One main signal, and (ii) is in interference signal of multiple signal transducers (302) place with each interference arrival direction,
The signal received described in wherein described process includes signal application of the beam shaping component (304) to the reception
Beamformer coefficient so that higher suppression level is applied to the signal that receives of interference arrival direction rather than
With the signal that described at least one main arrival direction is received, wherein the beam shaping component (304) is configured to use institute
The instruction of the motion for sensing of mobile device (102) is stated following the trail of the interference arrival direction, by described
The signal for receiving includes the regular noise corresponding to the interference arrival direction followed the trail of to change the letter for receiving
Number, and the beam-shaper coefficient is calculated based on the amended signal for receiving, to suppress whereby in the letter
Number sensor (302) sentences the interference signal that the interference arrival direction is received.
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| GB1116848.1A GB2495131A (en) | 2011-09-30 | 2011-09-30 | A mobile device includes a received-signal beamformer that adapts to motion of the mobile device |
| GB1116848.1 | 2011-09-30 | ||
| US13/307,852 US8981994B2 (en) | 2011-09-30 | 2011-11-30 | Processing signals |
| US13/307852 | 2011-11-30 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103024629A CN103024629A (en) | 2013-04-03 |
| CN103024629B true CN103024629B (en) | 2017-04-12 |
Family
ID=47178284
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210377115.3A Active CN103024629B (en) | 2011-09-30 | 2012-10-08 | Processing signals |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103024629B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2015048070A1 (en) * | 2013-09-24 | 2015-04-02 | Analog Devices, Inc. | Time-frequency directional processing of audio signals |
| EP2911149B1 (en) * | 2014-02-19 | 2019-04-17 | Nokia Technologies OY | Determination of an operational directive based at least in part on a spatial audio property |
| WO2016063587A1 (en) * | 2014-10-20 | 2016-04-28 | ソニー株式会社 | Voice processing system |
| CN113643682B (en) * | 2021-10-13 | 2022-07-15 | 展讯通信（上海）有限公司 | Noise reduction method, chip module and equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1835416A (en) * | 2005-03-17 | 2006-09-20 | 富士通株式会社 | Method and apparatus for direction-of-arrival tracking |
| CN101278596A (en) * | 2005-09-30 | 2008-10-01 | 史克尔海德科技公司 | Directional audio capturing |
| CN101828410A (en) * | 2007-10-16 | 2010-09-08 | 峰力公司 | Method and system for wireless hearing aids |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006333069A (en) * | 2005-05-26 | 2006-12-07 | Hitachi Ltd | Antenna control apparatus for mobile body and antenna control method |
| JP4799443B2 (en) * | 2007-02-21 | 2011-10-26 | 株式会社東芝 | Sound receiving device and method |
| US8150063B2 (en) * | 2008-11-25 | 2012-04-03 | Apple Inc. | Stabilizing directional audio input from a moving microphone array |
-
2012
- 2012-10-08 CN CN201210377115.3A patent/CN103024629B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1835416A (en) * | 2005-03-17 | 2006-09-20 | 富士通株式会社 | Method and apparatus for direction-of-arrival tracking |
| CN101278596A (en) * | 2005-09-30 | 2008-10-01 | 史克尔海德科技公司 | Directional audio capturing |
| CN101828410A (en) * | 2007-10-16 | 2010-09-08 | 峰力公司 | Method and system for wireless hearing aids |
Non-Patent Citations (1)
| Title |
|---|
| Goldberg, Jason，Pérez-Neira, A.Lagunas, Miguel Angel.Joint direction一of-arrival and array shape tracking for multiple moving targets.《Acoustics, Speech, and Signal Processing, 1997. ICASSP-97., 1997 IEEE International Conference on 》.1997, * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103024629A (en) | 2013-04-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8981994B2 (en) | Processing signals | |
| US10979805B2 (en) | Microphone array auto-directive adaptive wideband beamforming using orientation information from MEMS sensors | |
| EP3833041B1 (en) | Earphone signal processing method and system, and earphone | |
| US8903108B2 (en) | Near-field null and beamforming | |
| US9031257B2 (en) | Processing signals | |
| US9020163B2 (en) | Near-field null and beamforming | |
| CN102324237B (en) | Microphone-array speech-beam forming method as well as speech-signal processing device and system | |
| US8965546B2 (en) | Systems, methods, and apparatus for enhanced acoustic imaging | |
| CN105451151B (en) | A kind of method and device of processing voice signal | |
| CN103117064B (en) | Method and equipment for processing signals | |
| US8204247B2 (en) | Position-independent microphone system | |
| JP2022538401A (en) | Headset Microphone Array Noise Reduction Method, Apparatus, Headset and TWS Headset | |
| EP2320676A1 (en) | Method, communication device and communication system for controlling sound focusing | |
| US8615392B1 (en) | Systems and methods for producing an acoustic field having a target spatial pattern | |
| KR20130084298A (en) | Systems, methods, apparatus, and computer-readable media for far-field multi-source tracking and separation | |
| KR20130116271A (en) | Three-dimensional sound capturing and reproducing with multi-microphones | |
| US20160165338A1 (en) | Directional audio recording system | |
| CN103024629B (en) | Processing signals | |
| JP3341815B2 (en) | Receiving state detection method and apparatus | |
| US20200068301A1 (en) | Sound processing apparatus and sound processing method thereof | |
| CN114023307B (en) | Sound signal processing method, speech recognition method, electronic device and storage medium | |
| CN115515038A (en) | Beamforming method, device and equipment | |
| EP2599330B1 (en) | Systems, methods, and apparatus for enhanced creation of an acoustic image in space | |
| JP2002031674A (en) | Sounding body directivity correction method and apparatus | |
| The et al. | A Separation of Speech Sources Based on Dual MVDR Beamformer |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20200407 Address after: Redmond, Washington, USA Patentee after: MICROSOFT TECHNOLOGY LICENSING, LLC Address before: Ai Erlandubailin Patentee before: Skype |
|
| TR01 | Transfer of patent right |