CN118574050A - Audio processing method and device, ear wearing equipment and storage medium - Google Patents
Audio processing method and device, ear wearing equipment and storage medium Download PDFInfo
- Publication number
- CN118574050A CN118574050A CN202310183579.9A CN202310183579A CN118574050A CN 118574050 A CN118574050 A CN 118574050A CN 202310183579 A CN202310183579 A CN 202310183579A CN 118574050 A CN118574050 A CN 118574050A
- Authority
- CN
- China
- Prior art keywords
- ear
- signal
- sound signal
- output
- ear canal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
- H04R1/1041—Mechanical or electronic switches, or control elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2201/00—Details of transducers, loudspeakers or microphones covered by H04R1/00 but not provided for in any of its subgroups
- H04R2201/10—Details of earpieces, attachments therefor, earphones or monophonic headphones covered by H04R1/10 but not provided for in any of its subgroups
- H04R2201/105—Manufacture of mono- or stereophonic headphone components
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Headphones And Earphones (AREA)
Abstract
The disclosure relates to an audio processing method and device, ear wearing equipment and storage medium. The audio processing method comprises the following steps: acquiring an environment sound signal and an ear canal sound signal through the ear wearing equipment under the condition that the ear wearing equipment is in a working state; and adjusting the acoustic signal output by the ear wearing device based on the environmental acoustic signal and the ear canal acoustic signal. The embodiment of the disclosure can improve the hearing sensitivity.
Description
Technical Field
The disclosure relates to the field of headphones, and in particular relates to an audio processing method and device, ear wearing equipment and a storage medium.
Background
Along with the progress of scientific technology, ear wearing equipment such as earphones become indispensable electronic equipment in people's daily life, can carry out initiative or passive adjustment to earphone in order to improve tone quality experience and adaptation individuation hearing to factors such as different wearing states, different user's ear canal shapes and different user's hearing loss condition.
However, due to the acoustic masking effect, external noise can severely affect the user's listening experience. For example, under the interference of external noise, a user cannot hear music, and only can manually adjust the volume, so that the operation is inconvenient; for another example, when interference of noise in different frequency bands in the environment increases, the frequency response of music heard by the user changes, so that three frequencies are unbalanced and the sound quality is deteriorated.
Disclosure of Invention
In order to overcome the problems in the related art, the present disclosure provides an audio processing method and apparatus, ear wearing device, and storage medium, which can improve the hearing sensitivity.
According to a first aspect of embodiments of the present disclosure, there is provided an audio processing method, including:
acquiring an environment sound signal and an ear canal sound signal through the ear wearing equipment under the condition that the ear wearing equipment is in a working state;
and adjusting the acoustic signal output by the ear wearing device based on the environmental acoustic signal and the ear canal acoustic signal.
In some embodiments, the adjusting the acoustic signal output by the ear worn device based on the ambient sound signal and the ear canal sound signal includes:
determining a correlation coefficient between the ambient sound signal and the ear canal sound signal when the ear wearing device is in a wearing state;
adjusting the output configuration of the ear wearing device when the signal value of the ear canal sound signal is greater than a signal threshold and the correlation coefficient is greater than a coefficient threshold;
outputting the acoustic signal based on the adjusted output configuration.
In some embodiments, the adjusting the output configuration of the ear worn device comprises:
acquiring a sound frequency band, in which the correlation coefficient between the auditory canal sound signal and the environmental sound signal is larger than the coefficient threshold;
comparing the sound amplitude corresponding to the sound frequency band with a standard amplitude to obtain an output parameter;
the output configuration is adjusted based on the output parameters.
In some embodiments, comparing the sound amplitude corresponding to the sound frequency band with a standard amplitude to obtain an output parameter includes:
And acquiring the output parameter corresponding to the difference value based on the difference value between the sound amplitude value and the standard amplitude value.
In some embodiments, the output parameters include at least one of:
An output gain; an output frequency; and outputting the volume.
In some embodiments, the adjusting the output configuration of the ear worn device if the signal value of the ear canal sound signal is greater than a signal threshold and the correlation coefficient is greater than a coefficient threshold comprises:
acquiring a duration for which the ear canal sound signal is greater than the signal threshold and the correlation coefficient is greater than the coefficient threshold, if the signal value of the ear canal sound signal is greater than the signal threshold and the correlation coefficient is greater than the coefficient threshold;
in the event that the duration is greater than a time threshold, an adjustment of the output configuration is initiated.
In some embodiments, the method further comprises:
directly adopting the output configuration to output the acoustic signal under the condition that the signal value of the auditory canal acoustic signal is smaller than or equal to the signal threshold value;
Or directly outputting the acoustic signal using the output configuration in case the correlation coefficient is less than or equal to the coefficient threshold.
In some embodiments, the method further comprises:
Outputting a wearing state of the ear wearing device based on the correlation coefficient between the environmental sound signal and the ear canal sound signal.
In some embodiments, the acquiring, by the ear worn device, the ambient sound signal and the ear canal sound signal includes:
Acquiring the ambient sound signal through an ambient microphone module in the ear-worn device;
Acquiring the ear canal sound signal through an ear canal microphone module in the ear wearing device;
wherein the ambient microphone module comprises: a talk microphone module and/or a feed-forward microphone module;
the ear canal microphone module includes: bone conduction microphone module and/or feedback microphone module.
In some embodiments, the method further comprises:
and stopping adjusting the acoustic signal of the ear wearing device when an end instruction for adjusting the acoustic signal is detected.
According to a second aspect of the embodiments of the present disclosure, there is provided an information processing apparatus including at least:
The device comprises an acquisition module, a control module and a control module, wherein the acquisition module is configured to acquire an environment sound signal and an ear canal sound signal through the ear wearing equipment under the condition that the ear wearing equipment is in a working state;
A first adjustment module configured to adjust an acoustic signal output by the ear worn device based on the ambient sound signal and the ear canal sound signal.
According to a third aspect of embodiments of the present disclosure, there is provided an ear-worn device comprising at least:
A processor;
a memory for storing processor-executable instructions;
Wherein the processor is configured to perform the audio processing method as described in the first aspect above.
According to a fourth aspect of embodiments of the present disclosure, there is provided a storage medium comprising:
The instructions in the storage medium, when executed by a processor of the ear-worn device, enable the ear-worn device to perform the audio processing method as described in the first aspect above.
The technical scheme provided by the embodiment of the disclosure can comprise the following beneficial effects:
In the embodiment of the disclosure, under the condition that ear wearing equipment is in a working state, acquiring an environment sound signal and an ear canal sound signal through the ear wearing equipment; and adjusting the acoustic signal output by the ear wearing device based on the environmental acoustic signal and the ear canal acoustic signal. That is, on the one hand, the output sound signal can be actively adjusted through the acquired environment sound signal and the ear canal sound signal, and manual operation of a user is not needed, so that the ear wearing device is more intelligent; on the other hand, because the ear wearing equipment can adjust the output sound signal based on the environment sound signal, the sound signal can be adjusted in the self-adaptive environment noise in different noise environments, the output sound signal is matched with the environment noise, the consistency of listening experience under different noise environments is ensured, and the listening sensitivity is improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure.
Fig. 1 is a flow chart diagram one of an audio processing method according to an exemplary embodiment.
Fig. 2 is a flow chart diagram two of an audio processing method according to an exemplary embodiment.
Fig. 3 is a flow chart diagram three of an audio processing method according to an exemplary embodiment.
Fig. 4 is a block diagram of an audio processing apparatus according to an exemplary embodiment.
Fig. 5 is a block diagram of a mobile terminal according to an exemplary embodiment.
Detailed Description
Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples are not representative of all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present disclosure as detailed in the accompanying claims.
The embodiment of the disclosure provides an audio processing method which can be applied to a scene that external noise interferes with an acoustic signal output by ear wearing equipment so as to influence hearing sensitivity. For example, in a scene where sound quality is deteriorated when music is listened to by ear-worn devices in a noisy environment such as a subway, a bus, or the like. For example, the method is used in a scene of audio/video conversation through ear wearing equipment in a noisy environment such as an outdoor square, a station and the like.
Fig. 1 is a flow chart diagram one of an audio processing method according to an exemplary embodiment. As shown in fig. 1, the ear-worn device performs the audio processing method including the steps of:
s101, under the condition that ear wearing equipment is in a working state, acquiring an environment sound signal and an auditory canal sound signal through the ear wearing equipment;
s102, adjusting the sound signal output by the ear wearing equipment based on the environment sound signal and the auditory canal sound signal.
In the disclosed embodiments, the ear-worn device may include a headset or an in-ear headset; the ear worn device may also include a wired earphone or a truly wireless stereo (True Wireless Stereo, TWS) earphone, as embodiments of the present disclosure are not limited.
In step S101, during acquisition of an ear canal sound signal, the ear wearing device is worn while the ear wearing device is located at an ear position, not placed at a headphone case or other positions. The ear-worn device is in an operational state, indicating that an output module (audio output module or talk module) of the ear-worn device is in an on state, at which time a downstream end of the ear-worn device may be outputting an acoustic signal, e.g., the ear-worn device is playing music or talking.
In the disclosed embodiments, the ear-worn device has a plurality of microphone modules through which ambient sound signals and ear canal sound signals can be collected. Wherein the plurality of microphone modules may include an ambient microphone module and an ear canal microphone module. Here, when the ear wearing device is detected to be in an operating state, the environment microphone module and the ear canal microphone module are turned on to monitor the ear canal sound signal in the ear and the environment sound signal in the external environment, respectively.
In some embodiments, acquiring, by the ear worn device, an ambient sound signal and an ear canal sound signal includes:
Acquiring the ambient sound signal through an ambient microphone module in the ear-worn device;
Acquiring the ear canal sound signal through an ear canal microphone module in the ear wearing device;
wherein the ambient microphone module comprises: a talk microphone module and/or a feed-forward microphone module;
the ear canal microphone module includes: bone conduction microphone module and/or feedback microphone module.
The environmental microphone module can be used for collecting environmental sound signals in the external environment. The environmental microphone module may be positioned away from the ear and speaker to enable more accurate acquisition of the environmental microphone module.
The ear canal microphone module can be used for collecting ear canal sound signals in ears, and can be arranged at positions close to the ear canal and far away from a loudspeaker, so that the collection of the ear canal microphone module is more accurate.
It should be noted that, in the case where the ear wearing device is in an operating state, the ear has not only the ear canal sound signal but also the audio signal. Wherein the ear canal sound signal is formed by noise in the external environment, and the audio signal may include music or a conversation output by the ear wearing device.
In the embodiment of the disclosure, in the process of acquiring the environmental sound signal, the ear wearing device may acquire the environmental sound signal through the conversation microphone module, may acquire the environmental sound signal through the feedforward microphone module, and may also acquire the environmental sound signal through the conversation microphone module and the feedforward microphone module together.
It should be noted that, the ear-worn device may selectively turn on at least one microphone module of the conversation microphone module and the feedforward microphone module to obtain the ambient sound signal, and the embodiments of the present disclosure are not limited.
In the embodiment of the disclosure, in the process of acquiring the ear canal sound signal, the ear wearing device may acquire the ear canal sound signal through the bone conduction microphone module, may also acquire the ear canal sound signal through the feedback microphone module, and may also acquire the ear canal sound signal through the bone conduction microphone module and the feedback microphone module together.
It should be noted that, the ear-worn device may selectively turn on at least one microphone module of the conversation microphone module and the feedforward microphone module to obtain the ambient sound signal, and the embodiments of the present disclosure are not limited.
In step S102, after the environmental sound signal and the ear canal sound signal are acquired, the sound signal output by the ear wearing device may be adjusted based on the environmental sound signal and the ear canal sound signal. The method comprises the steps of adjusting the output configuration of the ear wearing equipment, and outputting the sound signal according to the adjusted output configuration.
That is, the embodiments of the present disclosure no longer adjust the output configuration by only the in-ear canal sound signal and the output audio signal, but adjust the output configuration based on the ambient sound signal and the in-ear canal sound signal together.
The influence of noise in the external environment on the ear can be obtained more accurately by comparing the environmental sound signal with the ear canal sound signal, and then the output configuration is adjusted based on the influence so as to be able to improve the hearing.
In an embodiment of the disclosure, adjusting the acoustic signal output by the ear wearing device based on the environmental acoustic signal and the ear canal acoustic signal may include: adjusting the acoustic signal output by the ear wearing device under the condition that the correlation coefficient of the environment acoustic signal and the ear channel acoustic signal is larger than the coefficient threshold value; may further comprise: adjusting the acoustic signal output by the ear wearing device when the signal value of the environmental acoustic signal is greater than the noise threshold and the signal value of the ear canal acoustic signal is greater than the signal threshold; may further comprise: and adjusting the acoustic signal output by the ear wearing device under the condition that the signal value of the acoustic signal of the auditory canal is larger than the signal threshold value and the correlation coefficient is larger than the coefficient threshold value.
In the embodiment of the disclosure, when ear wearing equipment is in a working state, acquiring an environment sound signal and an ear canal sound signal through the ear wearing equipment; and adjusting the acoustic signal output by the ear wearing device based on the environmental acoustic signal and the ear canal acoustic signal. That is, on the one hand, the output sound signal can be actively adjusted through the acquired environment sound signal and the ear canal sound signal, and manual operation of a user is not needed, so that the ear wearing device is more intelligent; on the other hand, because the ear wearing equipment can adjust the output sound signal based on the environment sound signal, the sound signal can be adjusted in the self-adaptive environment noise in different noise environments, the output sound signal is matched with the environment noise, the consistency of listening experience under different noise environments is ensured, and the listening sensitivity is improved.
In some embodiments, as shown in fig. 2, the adjusting the output configuration of the ear worn device based on the environmental sound signal and the ear canal sound signal, that is, step S102 may further include the steps of:
S1021, determining a correlation coefficient between the environment sound signal and the ear canal sound signal when the ear wearing device is in a wearing state;
S1022, adjusting the output configuration of the ear wearing device when the signal value of the auditory canal sound signal is larger than a signal threshold value and the correlation coefficient is larger than a coefficient threshold value;
s1023, adjusting the acoustic signal based on the adjusted output configuration.
In the embodiment of the disclosure, the signal value of the auditory canal sound signal is larger than the signal threshold value and the correlation coefficient is larger than the coefficient threshold value, so that the auditory sensation in the ear is interfered by the external noisy environment, and the audio intelligibility and the auditory sensation are affected. For example, the sound quality changes when a user listens to an unclear voice call or listens to music in an external noisy environment.
It should be noted that the signal threshold may be set according to actual requirements, for example, the signal threshold may be set in a range of 50dB and 100 dB.
In the disclosed embodiments, the correlation coefficient is used to characterize the degree of correlation between the ambient sound signal and the ear canal sound signal. For example, detection of an ambient sound signal but not an ear canal sound signal in an external noisy environment indicates that the correlation coefficient between the ambient sound signal and the ear canal sound signal is less than or equal to the coefficient threshold, i.e. the degree of correlation between the ambient sound signal and the ear canal sound signal is small.
It should be noted that, the correlation coefficient between the ambient sound signal and the ear canal sound signal may be calculated by the correlation coefficient module before the adjustment. The correlation coefficient module may comprise a pearson correlation coefficient module, embodiments of the present disclosure not being limited.
Here, the ear wearing device can adjust not only the acoustic signal of the ear wearing device but also the wearing state based on the correlation coefficient. In some embodiments, the wearing state of the ear wearing device is output based on the correlation coefficient between the ambient sound signal and the ear canal sound signal.
That is, whether the wearing state of the ear wearing device is abnormal or not can be judged by the correlation coefficient, so that the prompt is given when the wearing state of the ear wearing device is abnormal. For example, in a case where the ear wearing device is worn askew at the ear position, the ear wearing device can be adjusted in time by prompting the user to improve the sense of hearing. For another example, when the depth of insertion of the ear-worn device into the ear is less than a preset depth, the user may adjust the depth of the ear-worn device by prompting the user.
It should be noted that, the wearing state of the output ear wearing device may include: through the wearing state of the voice output ear wearing device, the method can further comprise: the wearing state of the ear wearing device is output to the mobile terminal to be displayed to a user through the mobile terminal, and the embodiment of the disclosure is not limited.
In the embodiment of the present disclosure, the output configuration may include a volume configuration, a gain configuration, a frequency band width for performing gain or attenuation, and the like, and the embodiment of the present disclosure is not limited.
Illustratively, in adjusting the output configuration, the volume configuration may be adjusted in one instance, with the volume being turned up based on the initial volume configuration; in another case, the gain configuration may be adjusted to increase the gain value based on the initial gain configuration.
In the embodiment of the disclosure, after the output configuration of the ear wearing device is adjusted, the acoustic signal is output according to the adjusted output configuration. That is, embodiments of the present disclosure actively adjust the output configuration based on the ambient sound signal and the ear canal sound signal for the purpose of adjusting the output sound signal.
Illustratively, in the case of adjusting the volume configuration, the volume of the output sound signal is increased by the adjusted volume configuration, so that the consistency of the hearing feeling can be ensured in an external noisy environment; under the condition of adjusting the gain configuration, the gain value of the output sound signal is improved through the adjusted gain configuration, so that different noise environments are ensured to be matched with the output gain.
Here, the embodiment of the disclosure adjusts the output configuration of the ear wearing device when the signal value of the ear canal sound signal is greater than the signal threshold and the correlation coefficient is greater than the coefficient threshold, so that the ear wearing device can adjust the output configuration when the external noisy environment interferes with the audio signal in the ear, and can improve the hearing sensitivity. In addition, the output configuration is not adjusted solely according to the auditory canal sound signal, but is adjusted according to the signal value and the correlation coefficient of the auditory canal sound signal, so that the adjustment accuracy is improved.
In some embodiments, the adjusting the output configuration of the ear worn device comprises:
acquiring a sound frequency band, in which the correlation coefficient between the auditory canal sound signal and the environmental sound signal is larger than the coefficient threshold;
comparing the sound amplitude corresponding to the sound frequency band with a standard amplitude to obtain an output parameter;
the output configuration is adjusted based on the output parameters.
In the embodiment of the disclosure, a sound frequency band with a correlation coefficient greater than a coefficient threshold in an ear canal sound signal can be obtained through an ear canal microphone module of the ear wearing device, and the output configuration is adjusted based on an output parameter obtained from the sound frequency band. Therefore, the embodiment of the disclosure can adaptively adjust the output parameters based on the sound frequency band, so that the frequency response heard by the influence of the environmental noise can be reduced, the hearing sensitivity is improved, and the adjustment accuracy can be improved.
The above-mentioned sound frequency band may be formed by at least one sub-frequency band in the whole frequency band, and may also be the whole frequency band, and the embodiments of the present disclosure are not limited.
In the specification, the abscissa in the amplitude spectrum chart represents frequency, and the ordinate represents amplitude. In the amplitude spectrogram, the sound frequency band with the correlation coefficient larger than the coefficient threshold corresponds to the sound amplitude. The sound amplitude is greater than the standard amplitude. The standard amplitude may be an experimental amplitude corresponding to an audio frequency band in experimental conditions, where the experimental conditions may include a quiet environmental condition or an environmental condition where noise does not affect the hearing.
In the embodiment of the disclosure, the output parameters can be obtained through different comparison conditions. In some embodiments, comparing the sound amplitude corresponding to the sound frequency band with the standard amplitude to obtain the output parameter may include obtaining the output parameter corresponding to the difference based on the difference between the sound amplitude and the standard amplitude. In other embodiments, comparing the sound amplitude corresponding to the sound frequency band with the standard amplitude to obtain the output parameter may further include obtaining the output parameter corresponding to the quotient based on a quotient of the sound amplitude and the standard amplitude.
It should be noted that, a difference mapping relation table between the difference and the output parameter is stored in the ear wearing device, and the output parameter corresponding to the difference can be obtained by searching the difference mapping relation table. Of course, the ear wearing device also stores a quotient mapping relation table between the quotient and the output parameter, and the output parameter corresponding to the quotient can be obtained by searching the quotient mapping relation table.
In the disclosed embodiments, after the output parameters are obtained, the output configuration may be adjusted based on the output parameters. In some embodiments, the output parameters include at least one of:
An output gain; an output frequency; and outputting the volume.
That is, when the output parameter is an output gain, the gain configuration in the output configuration may be adjusted based on the output gain; when the output parameters are an output gain and an output frequency, the frequency configuration in the frequency output configuration may be adjusted based on the output frequency while the gain configuration in the output configuration is adjusted based on the output gain.
Therefore, the embodiment of the disclosure not only can adjust single configuration, but also can flexibly adjust different configurations, so that the output configuration can be adjusted more flexibly, and the listening consistency can be better maintained in an external noisy environment.
In some embodiments, the adjusting the output configuration of the ear worn device if the signal value of the ear canal sound signal is greater than a signal threshold and the correlation coefficient is greater than a coefficient threshold comprises:
acquiring a duration for which the ear canal sound signal is greater than a signal threshold and the correlation coefficient is greater than the coefficient threshold, if the signal value of the ear canal sound signal is greater than the signal threshold and the correlation coefficient is greater than the coefficient threshold;
in the event that the duration is greater than a time threshold, an adjustment of the output configuration is initiated.
In the disclosed embodiments, the duration may be obtained by a timer in the ear worn device.
It should be noted that, the time threshold may be set according to the switching frequency acceptable by the user. For example, the time threshold may be set between 10 seconds and 120 seconds.
In the embodiment of the disclosure, the output configuration of the ear wearing device is adjusted under the condition that the duration is greater than the time threshold, so that the user requirement can be met better under the condition that the user experience caused by frequent adjustment of the output configuration is poor, and the experience of the user is improved.
In some embodiments, the method further comprises:
directly adopting the output configuration to output the acoustic signal under the condition that the signal value of the auditory canal acoustic signal is smaller than or equal to the signal threshold value;
Or directly outputting the acoustic signal using the output configuration in case the correlation coefficient is less than or equal to the coefficient threshold.
In the embodiment of the disclosure, the two cases that the signal value of the acoustic signal of the auditory canal is smaller than or equal to the signal threshold value and the correlation coefficient is smaller than or equal to the coefficient threshold value can be characterized in that the external noisy environment does not cause interference to the auditory sensation in the ear or the caused interference influence degree is small, so that the acoustic signal of the auditory canal is acceptable to users. At this time, the ear wearing device does not adjust the output configuration, and directly outputs the acoustic signal through the output configuration.
Thus, the output configuration is not adjusted when the acoustic signal of the auditory canal is detected, but the interference condition caused by external noise is measured, so that the adjustment of the output configuration is more refined and meets the user experience requirement.
In the embodiment of the disclosure, after the ear wearing device outputs the acoustic signal according to the adjusted output configuration, if the signal value of the auditory canal acoustic signal is detected to be less than or equal to the signal threshold value in the preset period, the acoustic signal is directly output through the output configuration; if the correlation coefficient is detected to be less than or equal to the coefficient threshold value within the preset period, the acoustic signal is directly output through the output configuration. In this way, the ear worn device can be enabled to adaptively close the adjustment.
In some embodiments, the method further comprises:
upon detecting an end instruction, the adjusting of the acoustic signal of the ear-worn device is stopped.
The end instruction can be obtained by switching a switch key trigger on the ear wearing device. For example, the switching element is switched from an on state to an off state. The end instruction may also be sent to the ear-worn device by the mobile terminal or the wrist-worn device.
In the embodiment of the disclosure, the output sound signal is stopped to be regulated by detecting the ending instruction, so that the regulation scene of the output sound signal is enriched, the output sound signal is regulated in the external noisy environment to more meet different requirements of users, and meanwhile, the intellectualization of the ear wearing equipment is further improved.
For a better understanding of one or more of the embodiments of the present disclosure described above, the embodiments of the present disclosure also present the following examples:
As shown in fig. 3, the ear-worn device performing the audio processing method may further include the steps of:
S201, the ear wearing equipment is in a working state;
s202, starting an environment microphone module and starting an auditory canal microphone module;
s203, acquiring an environment sound signal and an ear canal sound signal;
S204, judging whether the signal value of the auditory canal sound signal is larger than a signal threshold value; if yes, go to step S205; if not, go to step 206;
s205, judging whether a correlation coefficient between the environment sound signal and the ear canal sound signal is larger than a coefficient threshold value; if yes, go to step S207; if not, go to step S206;
s206, directly adopting output configuration to output sound signals;
s207, adjusting the output configuration of the ear wearing device;
S208, outputting an acoustic signal according to the adjusted output configuration.
In the embodiment of the disclosure, the ear wearing device can automatically adjust the output configuration according to the environment sound signal and the ear canal sound signal, so that the user operation can be simplified, and the intellectualization of the earphone is improved; and moreover, the output configuration of the output sound signals in different noise environments is automatically adjusted, so that the output sound signals are matched with the environmental noise, and the playing definition and the listening sensitivity are improved. In addition, the output configuration is not adjusted solely according to the auditory canal sound signal, but is adjusted according to the signal value of the auditory canal sound signal and the correlation coefficient, thereby improving the adjustment accuracy.
The embodiment of the present disclosure further proposes an audio processing apparatus, as shown in fig. 4, the audio processing apparatus 1000 includes:
an acquisition module 1001 configured to acquire an ambient sound signal and an ear canal sound signal by an ear wearing device in a state in which the ear wearing device is in operation;
A first adjustment module 1002 configured to adjust an acoustic signal output by the ear worn device based on the ambient sound signal and the ear canal sound signal.
In some embodiments, the first adjustment module is further configured to determine a correlation coefficient between the ambient sound signal and the ear canal sound signal when the ear worn device is in a worn state; and when the signal value of the auditory canal sound signal is larger than a signal threshold value and the correlation coefficient is larger than a coefficient threshold value, adjusting the output configuration of the ear wearing device, and outputting the sound signal based on the adjusted output configuration.
In some embodiments, the first adjustment module is further configured to obtain a sound frequency band in the ear canal sound signal for which the correlation coefficient with the ambient sound signal is greater than the coefficient threshold; comparing the sound amplitude corresponding to the sound frequency band with a standard amplitude to obtain an output parameter; the output configuration is adjusted based on the output parameters.
In some embodiments, the first adjustment module is further configured to obtain, based on a difference between the sound amplitude and the standard amplitude, an output parameter corresponding to the difference.
In some embodiments, the output parameters include at least one of:
An output gain; an output frequency; and outputting the volume.
In some embodiments, the first adjustment module is further configured to obtain a duration of time that the ear canal sound signal is greater than the signal threshold and the correlation coefficient is greater than the coefficient threshold if the signal value of the ear canal sound signal is greater than the signal threshold and the correlation coefficient is greater than the coefficient threshold; in the event that the duration is greater than a time threshold, an adjustment of the output configuration is initiated.
In some embodiments, the apparatus further comprises:
a second adjustment module configured to directly output the acoustic signal using the output configuration if a signal value of the ear canal acoustic signal is less than or equal to the signal threshold; or alternatively
And a third adjustment module configured to directly output the acoustic signal in the output configuration if the signal value of the ear canal acoustic signal is greater than the signal threshold and the correlation coefficient is less than or equal to the coefficient threshold.
In some embodiments, the apparatus further comprises:
An output module configured to output a wearing state of the ear wearing device based on the correlation coefficient between the environmental sound signal and the ear canal sound signal.
In some embodiments, the acquisition module is further configured to acquire the ambient sound signal through an ambient microphone module in the ear worn device; acquiring the ear canal sound signal through an ear canal microphone module in the ear wearing device; wherein the ambient microphone module comprises: a talk microphone module and/or a feed-forward microphone module; the ear canal microphone module includes: bone conduction microphone module and/or feedback microphone module.
In some embodiments, the apparatus further comprises:
and a stop adjustment module configured to stop adjusting the acoustic signal of the ear-worn device if an end instruction is detected.
The specific manner in which the various modules of the apparatus of the above embodiments perform operations has been described in detail in connection with embodiments of the method, and will not be described in detail herein.
Fig. 5 is a block diagram of a mobile terminal according to an exemplary embodiment. For example, the mobile terminal 800 may be a mobile phone, tablet device, personal digital assistant, or the like.
Referring to fig. 5, the mobile terminal 800 may include one or more of the following components: a processing component 802, a memory 804, a power component 806, a multimedia component 808, an audio component 810, an input/output (I/O) interface 812, a sensor component 814, and a communication component 816.
The processing component 802 generally controls overall operation of the mobile terminal 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to perform all or part of the steps of the methods described above. Further, the processing component 802 can include one or more modules that facilitate interactions between the processing component 802 and other components. For example, the processing component 802 can include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.
The memory 804 is configured to store various types of data to support operations at the device 800. Examples of such data include instructions for any application or method operating on the mobile terminal 800, contact data, phonebook data, messages, pictures, videos, and the like. The memory 804 may be implemented by any type or combination of volatile or nonvolatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.
The power supply component 806 provides power to the various components of the mobile terminal 800. The power supply components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the mobile terminal 800.
The multimedia component 808 includes a screen between the mobile terminal 800 and the user that provides an output interface. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may sense not only the boundary of a touch or slide action, but also the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and/or a rear camera. The front camera and/or the rear camera may receive external multimedia data when the device 800 is in an operational mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have focal length and optical zoom capabilities.
The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a Microphone (MIC) configured to receive external audio signals when the mobile terminal 800 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may be further stored in the memory 804 or transmitted via the communication component 816. In some embodiments, audio component 810 further includes a speaker for outputting audio signals.
The I/O interface 812 provides an interface between the processing component 802 and peripheral interface modules, which may be a keyboard, click wheel, buttons, etc. These buttons may include, but are not limited to: homepage button, volume button, start button, and lock button.
The sensor assembly 814 includes one or more sensors for providing status assessment of various aspects of the mobile terminal 800. For example, the sensor assembly 814 may detect an on/off state of the device 800, a relative positioning of the components, such as a display and keypad of the mobile terminal 800, the sensor assembly 814 may also detect a change in position of the mobile terminal 800 or a component of the mobile terminal 800, the presence or absence of a user's contact with the mobile terminal 800, an orientation or acceleration/deceleration of the mobile terminal 800, and a change in temperature of the mobile terminal 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscopic sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 816 is configured to facilitate communication between the mobile terminal 800 and other devices, either wired or wireless. The mobile terminal 800 may access a wireless network based on a communication standard, such as WiFi,3G or 5G, or a combination thereof. In one exemplary embodiment, the communication component 816 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, the communication component 816 further includes a Near Field Communication (NFC) module to facilitate short range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the mobile terminal 800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic elements for executing the methods described above.
In an exemplary embodiment, a non-transitory computer readable storage medium is also provided, such as memory 804 including instructions executable by processor 820 of mobile terminal 800 to perform the above-described method. For example, the non-transitory computer readable storage medium may be ROM, random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.
A non-transitory computer readable storage medium that, when executed by a processor of an ear-worn device, enables the ear-worn device to perform an audio processing method, the method comprising: acquiring an environment sound signal and an ear canal sound signal through the ear wearing equipment under the condition that the ear wearing equipment is in a working state; and adjusting the acoustic signal output by the ear wearing device based on the environmental acoustic signal and the ear canal acoustic signal.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any adaptations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It is to be understood that the present disclosure is not limited to the precise arrangements and instrumentalities shown in the drawings, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims (13)
1. An audio processing method, comprising:
acquiring an environment sound signal and an ear canal sound signal through the ear wearing equipment under the condition that the ear wearing equipment is in a working state;
and adjusting the acoustic signal output by the ear wearing device based on the environmental acoustic signal and the ear canal acoustic signal.
2. The method of claim 1, wherein the adjusting the acoustic signal output by the ear worn device based on the ambient sound signal and the ear canal sound signal comprises:
Determining a correlation coefficient between the ambient sound signal and the ear canal sound signal with the ear worn device in a worn state;
adjusting the output configuration of the ear wearing device when the signal value of the ear canal sound signal is greater than a signal threshold and the correlation coefficient is greater than a coefficient threshold;
outputting the acoustic signal based on the adjusted output configuration.
3. The method of claim 2, wherein the adjusting the output configuration of the ear-worn device comprises:
acquiring a sound frequency band, in which the correlation coefficient between the auditory canal sound signal and the environmental sound signal is larger than the coefficient threshold;
comparing the sound amplitude corresponding to the sound frequency band with a standard amplitude to obtain an output parameter;
the output configuration is adjusted based on the output parameters.
4. A method according to claim 3, wherein comparing the sound amplitude corresponding to the sound frequency band with a standard amplitude to obtain an output parameter comprises:
And acquiring the output parameter corresponding to the difference value based on the difference value between the sound amplitude value and the standard amplitude value.
5. A method according to claim 3, wherein the output parameters comprise at least one of:
An output gain; an output frequency; and outputting the volume.
6. The method of claim 2, wherein the adjusting the output configuration of the ear worn device if the signal value of the ear canal sound signal is greater than a signal threshold and the correlation coefficient is greater than a coefficient threshold comprises:
acquiring a duration for which the ear canal sound signal is greater than the signal threshold and the correlation coefficient is greater than the coefficient threshold, if the signal value of the ear canal sound signal is greater than the signal threshold and the correlation coefficient is greater than the coefficient threshold;
in the event that the duration is greater than a time threshold, an adjustment of the output configuration is initiated.
7. The method according to claim 2, wherein the method further comprises:
directly adopting the output configuration to output the acoustic signal under the condition that the signal value of the auditory canal acoustic signal is smaller than or equal to the signal threshold value;
Or directly outputting the acoustic signal using the output configuration in case the correlation coefficient is less than or equal to the coefficient threshold.
8. The method according to claim 2, wherein the method further comprises:
Outputting a wearing state of the ear wearing device based on the correlation coefficient between the environmental sound signal and the ear canal sound signal.
9. The method of any of claims 1 to 8, wherein the acquiring, by the ear worn device, the ambient sound signal and the ear canal sound signal comprises:
Acquiring the ambient sound signal through an ambient microphone module in the ear-worn device;
Acquiring the ear canal sound signal through an ear canal microphone module in the ear wearing device;
wherein the ambient microphone module comprises: a talk microphone module and/or a feed-forward microphone module;
the ear canal microphone module includes: bone conduction microphone module and/or feedback microphone module.
10. The method according to any one of claims 1 to 8, further comprising:
upon detecting an end instruction, the adjusting of the acoustic signal of the ear-worn device is stopped.
11. An audio processing apparatus, the apparatus comprising:
The device comprises an acquisition module, a control module and a control module, wherein the acquisition module is configured to acquire an environment sound signal and an ear canal sound signal through the ear wearing equipment under the condition that the ear wearing equipment is in a working state;
A first adjustment module configured to adjust an acoustic signal output by the ear worn device based on the ambient sound signal and the ear canal sound signal.
12. An ear-worn device, comprising:
A processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to perform the audio processing method of any of claims 1 to 10.
13. A non-transitory computer readable storage medium, which when executed by a processor of an ear-worn device, causes the ear-worn device to perform the audio processing method of any of claims 1-10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310183579.9A CN118574050A (en) | 2023-02-28 | 2023-02-28 | Audio processing method and device, ear wearing equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310183579.9A CN118574050A (en) | 2023-02-28 | 2023-02-28 | Audio processing method and device, ear wearing equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN118574050A true CN118574050A (en) | 2024-08-30 |
Family
ID=92465966
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310183579.9A Pending CN118574050A (en) | 2023-02-28 | 2023-02-28 | Audio processing method and device, ear wearing equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN118574050A (en) |
-
2023
- 2023-02-28 CN CN202310183579.9A patent/CN118574050A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107493500B (en) | Multimedia resource playing method and device | |
| US12236971B2 (en) | Method and device for spectral expansion of an audio signal | |
| US10893352B2 (en) | Programmable interactive stereo headphones with tap functionality and network connectivity | |
| CN106454644B (en) | Audio playing method and device | |
| CN106888327B (en) | Voice playing method and device | |
| CN108845787B (en) | Audio adjusting method, device, terminal and storage medium | |
| US11741985B2 (en) | Method and device for spectral expansion for an audio signal | |
| CN113473304A (en) | Howling suppression method, howling suppression device, earphone and storage medium | |
| CN113596665A (en) | Howling suppression method, howling suppression device, earphone and storage medium | |
| CN111988704B (en) | Sound signal processing method, device and storage medium | |
| CN113099336A (en) | Method and device for adjusting audio parameters of earphone, earphone and storage medium | |
| CN115550791A (en) | Audio processing method, device, earphone and storage medium | |
| CN108093132B (en) | Terminal device and ringtone volume control method | |
| CN115714944A (en) | Audio processing method and device, earphone and storage medium | |
| CN113824838B (en) | Sounding control method and device, electronic equipment and storage medium | |
| CN113852893B (en) | Data processing method and device, terminal and storage medium | |
| CN115623121A (en) | Call method and electronic equipment | |
| CN113596662B (en) | Method for suppressing howling, device for suppressing howling, earphone, and storage medium | |
| CN111694539B (en) | Method, device and medium for switching between earphone and loudspeaker | |
| CN118574050A (en) | Audio processing method and device, ear wearing equipment and storage medium | |
| CN115410547B (en) | Audio processing method, device, electronic equipment and storage medium | |
| CN113495713B (en) | Method and device for adjusting earphone audio parameters, earphone and storage medium | |
| CN113660594B (en) | Self-adjusting noise reduction method and device for hearing aid system | |
| US20250124942A1 (en) | Method and device for spectral expansion of an audio signal | |
| CN118042330A (en) | Wind speed determining method, device, medium and earphone equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |