CN115460526B - Method, electronic device and system for determining hearing model - Google Patents

Abstract

A method for determining a hearing model, an electronic device, and a system, relating to the technical field of hearing aids, can determine a user's hearing condition based on an orientation test, that is, obtain a hearing model, thereby assisting in realizing hearing compensation. Wherein, playing level test audio including various first sound signals with different frequencies and horizontal orientations but the same amplitude, and receiving level test results, the level test results include the user's level perception orientation of the various first sound signals. Playing vertical test audio of multiple second sound signals with different amplitudes and vertical orientations but the same spectrum signal, and receiving vertical test results, the vertical test results include the user's vertical perception orientation of the multiple second sound signals. Based on the horizontal test result and the vertical test result, the hearing model of the user is obtained, and the hearing model includes the first lowest amplitude of the sound signal of each frequency that the user can perceive.

Description

Method, electronic device and system for determining hearing model

technical field

The present application relates to the technical field of hearing aids, and in particular to a method for determining a hearing model, an electronic device and a system.

Background technique

If you stay in a noisy environment for a long time or have bad ear habits, the user's hearing will be damaged. Moreover, hearing loss is irreversible. For hearing-impaired users and non-hearing-impaired users, in the process of using electronic devices such as mobile phones and tablets, the audio effects played by the electronic devices they hear may be completely different. In other words, for hearing-impaired users, the audio effect they hear may not be as expected. To achieve the desired effect, the electronic device needs to compensate the played audio, for example, increase the amplitude of the frequency band in the audio where the user's hearing is impaired.

Obviously, the electronic device first needs to determine the hearing condition of the user and the range that the user can hear in each frequency band, and then can accurately compensate based on this.

However, the inventor found in the process of implementing the embodiments of the present application that there is no relatively simple solution for determining the user's hearing condition in the prior art, which leads to the inability to accurately implement compensation on the electronic device.

Contents of the invention

In view of this, the present application provides a method for determining a hearing model, an electronic device and a system, which can determine a user's hearing condition based on an orientation test, that is, obtain a hearing model, thereby assisting in realizing hearing compensation.

In a first aspect, an embodiment of the present application provides a method for determining a hearing model, which is applied to an electronic device. Wherein, the level test audio is played, and the level test audio includes multiple first sound signals with different frequencies and horizontal orientations but with the same amplitude. The level test result fed back by the user is received, and the level test result of the right ear test sequence includes the user's level perception orientation of various first sound signals of the right ear test sequence. Since the user needs to rely on the ILD to perceive the horizontal orientation, that is, the amplitude will affect the user's perception of the horizontal orientation. Then, setting the horizontal test audio to include multiple sound signals with the same amplitude can avoid affecting the user's judgment of the horizontal orientation due to different amplitudes.

And, the vertical test audio is played, and the vertical test audio includes multiple second sound signals with different amplitudes and vertical orientations but the same spectral signals. The vertical test result fed back by the user is received, and the vertical test result of the right ear test sequence includes the user's vertical perception orientation of various second sound signals of the right ear test sequence. Since the user needs to rely on the change of the spectral signal to perceive the change of the vertical orientation, that is, the spectral signal will affect the user's perception of the vertical orientation. Then, setting the vertical test audio to include the same sound signal as the ordinary signal can avoid affecting the user's judgment of the vertical orientation due to different spectrum signals.

Finally, the user's hearing model is obtained based on the horizontal test result and the vertical test result, and the hearing model includes the first lowest amplitude of the sound signal of each frequency that the user can perceive. That is to say, the hearing model can reflect the user's hearing status to sound signals of various frequencies. It can thus be used for hearing compensation. For example, the lowest amplitude corresponding to the frequency of 1.1KHz in the hearing model is 40dB, and the lowest amplitude corresponding to the frequency of 1.1KHz in the hearing model of normal users is 30dB, that is, the lowest amplitude that the tested user can hear at 1.1KHz is worse than that of the normal user. 10dB, the electronic device can increase the amplitude by 10dB when playing 1.1KHz sound. In this way, audio can be played personalizedly for hearing-impaired users so that they can obtain the same audio effects as normal users.

In a possible design manner of the first aspect, playing the level test audio includes: playing the level test audio through earphones. The above-mentioned playing the vertical test audio includes: playing the vertical test audio through the earphone.

By adopting this embodiment, the earphone is used to play the test audio, which can reduce the influence of the surrounding environment on the hearing test.

In a possible design of the first aspect, the above method further includes: acquiring the first feedforward signal collected by the feedforward microphone in the left earbud of the earphone, and acquiring the second feedforward signal collected by the feedforward microphone in the right earbud of the earphone. feed signal. The above-mentioned playing the horizontal test audio through the earphones and playing the vertical test audio through the earphones includes: when the first feedforward signal is less than the first threshold and the second feedforward signal is less than the first threshold, playing the horizontal test audio through the earphones, Play vertical test audio through headphones.

With this embodiment, the test audio is played and tested only when the feedforward signals of the two earplugs are very small, that is, the ambient noise of the environment where the two earplugs are located is relatively small. In this way, environmental noise can be prevented from affecting the user's perception of the orientation.

In a possible design of the first aspect, the above method further includes: acquiring a first feedback signal collected by the feedback microphone in the left earplug, and acquiring a second feedback signal collected by the feedback microphone in the right earplug. The above-mentioned playing horizontal test audio through earphones and playing vertical test audio through earphones includes: the difference between the first feedforward signal and the first feedback signal is greater than the second threshold, and the difference between the second feedforward signal and the second feedback signal When the value is greater than the second threshold, the horizontal test audio is played through the earphone, and the vertical test audio is played through the earphone.

With this embodiment, when the difference between the feedforward signal and the feedback signal in the two earplugs is large, that is, the left earplug and the right earplug are very close to the ear, and the isolation effect on the external environmental sound is very good In this case, the test audio is played and tested. In this way, it is possible to avoid the user's perception of the orientation due to poor sound insulation and noise reduction effect of the earphone.

In a possible design of the first aspect, the above method further includes: sending the same preset audio to the left earplug and the right earplug of the earphone, and the preset audio is used to test the hardware of the speaker of the left earplug and the speaker of the right earplug difference. Obtain the third feedback signal collected by the feedback microphone in the left earbud, and obtain the fourth feedback signal collected by the feedback microphone in the right earbud, the third feedback signal includes the result of the preset audio played by the speaker of the left earbud, and the fourth feedback signal includes the right earbud The speaker plays the preset audio result. Calibration coefficients are determined to align the third feedback signal and the fourth feedback signal. The calibration coefficients are sent to the first earbud, be it the left earbud or the right earbud. That is, the calibration coefficients can mask out hardware differences between the speaker in the left earbud and the speaker in the right earbud.

Correspondingly, the above-mentioned playing the horizontal test audio through the earphones and the vertical test audio through the earphones include: using the calibration coefficient to calibrate the horizontal test audio through the first earplug and then playing the calibrated horizontal test audio, and playing the horizontal test audio through the second earplug . And, after the vertical test audio is calibrated by using the calibration coefficient through the first earplug, the calibrated vertical test audio is played, and the vertical test audio is played through the second earplug. Wherein, the second earplug is an earplug other than the first earplug among the left earplug and the right earplug. For example, if the first earplug is the left earplug, then the second earplug is the right earplug; if the first earplug is the right earplug, then the second earplug is the left earplug.

By adopting this embodiment, the hardware difference between the left earplug and the right earplug is shielded by the calibration coefficient, thereby avoiding the influence of the hardware difference on the test effect.

In a possible design of the first aspect, the above-mentioned obtaining of the user's hearing model based on the horizontal test result and the vertical test result includes: determining the horizontal angle loss of the user's hearing based on the horizontal test result. The angular deviation of the perceived azimuth of the level of the sound signal. The vertical angle loss of the hearing of the user is determined based on the vertical test result, and the vertical angle loss includes the angular deviation of the user's vertical perception orientation of sound signals of various amplitudes. A hearing model of the user is calculated based on the horizontal angle loss and the vertical angle loss.

In a possible design of the first aspect, the electronic device includes a first correspondence and a second correspondence, and the first correspondence includes changes in amplitude and changes in the level perception and orientation of sound signals by people without hearing loss The second correspondence includes the correspondence between the change of the frequency and the change of the vertical perception direction of the sound signal by the people without hearing loss. The above-mentioned calculation of the user's hearing model based on the horizontal angle loss and the vertical angle loss includes: based on the first correspondence, converting the horizontal angle loss into the relative amplitude loss of the user's ears, the relative amplitude loss includes sound signals of various frequencies, the user's left The difference in amplitude perceived by the ear and the right ear. Based on the second corresponding relationship, the vertical angle loss is converted into a frequency loss model of the user's ears, and the frequency loss model includes the second lowest amplitude of the sound signal of each frequency that the user can perceive. The hearing model is obtained by modifying the frequency loss model based on the relative amplitude loss.

Using this embodiment, the angle loss of the horizontal azimuth can be converted into a relative amplitude loss through the first correspondence obtained in advance, and the angle loss of the vertical azimuth can be converted into a frequency loss model through the second correspondence obtained in advance. That is to say, the frequency loss model is the lowest amplitude that the user can hear for sounds of each frequency on the basis of not considering the angular loss of the horizontal orientation. Therefore, further modifying the basic model based on the relative amplitude loss can obtain a hearing model that integrates the angular loss of the horizontal orientation and the angular loss of the vertical orientation, making the result of the hearing model more reasonable.

In a possible design of the first aspect, the above-mentioned modification of the frequency loss model based on the relative amplitude loss to obtain the hearing model includes: adding the first lowest amplitude corresponding to the first frequency in the frequency loss model to the relative amplitude loss The amplitude difference corresponding to the first frequency is used to obtain the second lowest amplitude corresponding to the first frequency in the hearing model. Wherein, the first frequency is any frequency included in the frequency loss model.

By adopting this embodiment, the minimum amplitude of each frequency in the corresponding frequency loss model can be corrected.

In a possible design manner of the first aspect, considering that the user is a hearing-impaired user, the amplitude loss in hearing may interfere with the measurement of the vertical orientation. Therefore, before testing the angle loss of the vertical orientation, the absolute amplitude loss of both ears of the user may be tested first, including the first absolute amplitude loss of the left ear and the second absolute amplitude loss of the right ear. Then, in the process of testing the angular loss of the vertical azimuth, the first absolute amplitude loss and the second absolute amplitude loss are smoothed, so that the testing process of the vertical azimuth is not disturbed by the amplitude loss.

Based on this, the above method further includes: subtracting the first absolute amplitude loss from the amplitudes of the various second sound signals in the vertical test audio to obtain various left ear test signals. The amplitudes of the multiple second sound signals are subtracted from the second absolute amplitude loss to obtain multiple right ear test signals, and the multiple left ear test signals and the multiple right ear test signals constitute updated vertical test audio. Among them, the first absolute amplitude loss is the difference between the lowest audible amplitude of people without hearing loss within the preset frequency range and the lowest audible amplitude audible by the user's left ear, and the second absolute amplitude loss is the difference between the preset frequency range The difference between the lowest audible amplitude for people without hearing loss and the lowest audible amplitude for the user's right ear. Correspondingly, playing the vertical test audio through the earphone includes: playing various left-ear test signals through the left earplug of the earphone, and playing various right-ear test signals through the right earplug of the earphone.

By adopting this embodiment, it is possible to avoid the interference of the amplitude loss in the testing process of the vertical azimuth, and improve the accuracy of the vertical azimuth testing.

Moreover, the electronic device also includes a first corresponding relationship and a second corresponding relationship, the first corresponding relationship includes the corresponding relationship between the change of the amplitude and the change of the horizontal perception direction of the sound signal by people without hearing loss, and the second corresponding relationship includes the frequency The corresponding relationship between the change of the change and the change of the vertical perception orientation of the sound signal in the population without hearing loss.

Correspondingly, when calculating the hearing loss, it is necessary to make up for the first absolute amplitude loss and the second absolute amplitude loss that have been smoothed out before. Therefore, calculating the hearing model of the user based on the horizontal angle loss and the vertical angle loss includes: based on the first corresponding relationship, converting the horizontal angle loss into the relative amplitude loss of the user's ears, the relative amplitude loss includes the sound signals of each frequency, the user The difference in amplitude perceived by the left and right ears. The relative amplitude loss is corrected based on the first absolute amplitude loss and the second absolute amplitude loss to obtain a binaural amplitude loss. Based on the second corresponding relationship, the vertical angle loss is converted into a frequency loss model of the user's ears, and the frequency loss model includes the second lowest amplitude of the sound signal of each frequency that the user can perceive. The hearing model is obtained by modifying the frequency loss model based on binaural amplitude loss.

By adopting this embodiment, the first absolute amplitude loss and the second absolute amplitude loss smoothed out before can be supplemented on the basis of the relative amplitude loss, so that accurate amplitude loss can be obtained.

In a possible design of the first aspect, the above-mentioned correction of the relative amplitude loss based on the first absolute amplitude loss and the second absolute amplitude loss to obtain the binaural amplitude loss includes: in the relative amplitude loss, the second frequency corresponding to The first amplitude difference is added to the difference between the first absolute amplitude loss and the second absolute amplitude loss to obtain a second amplitude difference corresponding to the second frequency in the binaural amplitude loss.

In a possible design of the first aspect, after the user's hearing model is obtained based on the horizontal test result and the vertical test result, the above method further includes: after increasing the sound signal of the third frequency in the audio to be played by a preset amplitude Play, the third frequency is any frequency of the sound signal included in the audio to be played, and the preset amplitude is the first lowest amplitude corresponding to the third frequency in the hearing model and the sound signal of the third frequency that people without hearing loss can hear The third lowest magnitude difference. For example, the lowest amplitude corresponding to the frequency of 1.1KHz in the hearing model is 40dB, and the lowest amplitude corresponding to the frequency of 1.1KHz in the hearing model of normal users is 30dB, that is, the lowest amplitude that the tested user can hear at 1.1KHz is worse than that of the normal user. 10dB, the electronic device can increase the amplitude by 10dB when playing 1.1KHz sound. In this way, audio can be played personalizedly for hearing-impaired users so that they can obtain the same audio effects as normal users.

In a possible design of the first aspect, the level test audio includes a first level test audio and a second level test audio, and the first level test audio corresponds to multiple frequencies of multiple first sound signals that appear sequentially. The order, the order of the multiple frequencies corresponding to the multiple first sound signals sequentially appearing in the second level test audio is not completely the same.

By adopting this embodiment, it is possible to test the hearing condition of the user in different frequency sequences. Therefore, the hearing condition of the tested user to the sound signals of each frequency can be obtained more accurately.

In a possible design manner of the first aspect, the vertical test audio includes a first vertical test audio and a second vertical test audio, and multiple amplitudes corresponding to multiple second sound signals appearing sequentially in the first vertical test audio The sequence, the sequence of the multiple amplitudes corresponding to the multiple second sound signals appearing sequentially in the second vertical test audio is not completely the same.

By adopting this embodiment, it is possible to test the hearing condition of the user in different amplitude sequences. Therefore, the hearing condition of the user under test for sound signals of various amplitudes can be obtained more accurately.

In the second aspect, the embodiment of the present application also provides an electronic device, the electronic device includes a memory and one or more processors; the memory is coupled to the processor; the memory is used to store computer program codes, The computer program code includes computer instructions. When the computer instructions are executed by the processor, the electronic device executes the method according to the first aspect and any possible design manner thereof.

In a third aspect, an embodiment of the present application provides a chip system, which is applied to an electronic device including a display screen and a memory; the chip system includes one or more interface circuits and one or more processors; the interface The circuit and the processor are interconnected by a line; the interface circuit is configured to receive a signal from a memory of the electronic device and send the signal to the processor, the signal including computer instructions stored in the memory; When the processor executes the computer instruction, the electronic device executes the method described in the first aspect and any possible design manner thereof.

In a fourth aspect, the present application provides a computer-readable storage medium, the computer-readable storage medium includes computer instructions, and when the computer instructions are run on an electronic device, the electronic device executes the first aspect and any one thereof. A possible design approach is described.

In a fifth aspect, the present application provides a computer program product. When the computer program product runs on a computer, the computer executes the method described in the first aspect and any possible design manner thereof.

In a sixth aspect, the present application provides a communication system, the communication system includes an electronic device for executing the method according to the first aspect and any possible design manner thereof, and includes an earphone for playing test audio.

It can be understood that the electronic device described in the second aspect provided above, the chip system described in the third aspect, the computer-readable storage medium described in the fourth aspect, the computer product described in the fifth aspect, and the computer product described in the fifth aspect For the beneficial effects that can be achieved by the communication system described above, reference may be made to the beneficial effects in the first aspect and any possible design manner thereof, which will not be repeated here.

Description of drawings

FIG. 1 is a schematic diagram of a process for determining a hearing model provided by an embodiment of the present application;

FIG. 2 is a schematic structural diagram of a communication system provided by an embodiment of the present application;

FIG. 3 is a schematic structural diagram of a mobile phone provided by an embodiment of the present application;

FIG. 4 is a schematic diagram of the types of earphones provided by the embodiment of the present application;

FIG. 5 is a schematic structural diagram of an earphone provided by an embodiment of the present application;

FIG. 6 is a schematic structural diagram of a speaker and a microphone in an earphone provided by an embodiment of the present application;

FIG. 7 is a schematic diagram of the principle of implementing audio compensation provided by the embodiment of the present application;

FIG. 8 is one of the schematic diagrams of the mobile phone interface provided by the embodiment of the present application;

FIG. 9 is a schematic diagram of the principle of implementing environment detection provided by the embodiment of the present application;

Figure 10 is a schematic diagram of the test sequence provided by the embodiment of the present application;

FIG. 11 is an interactive flowchart for determining angle loss provided by the embodiment of the present application;

FIG. 12 is the second schematic diagram of the mobile phone interface provided by the embodiment of the present application;

Fig. 13 is a schematic diagram of the angle loss curve provided by the embodiment of the present application;

Fig. 14 is a schematic diagram of the principle of determining the hearing model provided by the embodiment of the present application;

FIG. 15 is an interactive flow chart for determining the absolute amplitude loss provided by the embodiment of the present application;

FIG. 16 is the third schematic diagram of the mobile phone interface provided by the embodiment of the present application;

Fig. 17 is a schematic diagram of the result of an absolute amplitude loss provided by the embodiment of the present application;

Fig. 18 is an interactive flowchart for determining angle loss in combination with absolute amplitude loss provided by the embodiment of the present application;

Fig. 19 is a schematic diagram of the principle of determining a hearing model combined with absolute amplitude loss provided by the embodiment of the present application;

FIG. 20 is a structural diagram of a chip system provided by an embodiment of the present application.

Detailed ways

In the conventional technology, there are mainly two ways to determine the hearing impairment of the user: one is to play sounds of different frequencies, and make frequency response judgments with relatively coarse resolutions on the left and right ears respectively. This method can usually only obtain results with relatively sparse frequencies, and cannot obtain accurate damage conditions. The other is to use complex test signals and intensive subjective listening to draw hearing curves. The diagnosis takes a long time. In addition to professional medical personnel, it also depends on medical equipment and the environment, which requires high professionalism.

Due to the above defects, these conventional technologies cannot be used in electronic devices to accurately determine the hearing impairment of the user, and compensate the audio before the electronic device plays the audio, so that the hearing-impaired user can also obtain a better hearing effect.

Based on this, an embodiment of the present application provides an audio playback method. Referring to FIG. 1 , the electronic device can test the angular loss of the hearing of the user's ears in the horizontal direction and the angular loss in the vertical direction. Wherein, the angular loss of the horizontal orientation refers to the angular deviation between the horizontal orientation of the sound source perceived by the measured user and the horizontal orientation of the sound source perceived by the normal user. The angle loss of the vertical orientation refers to the angular deviation between the vertical orientation of the sound source perceived by the tested user and the vertical orientation of the sound source perceived by the normal user. Then, the electronic device determines the hearing model of the user under test based on the angular loss in the horizontal orientation and the angular loss in the vertical orientation. Wherein, the hearing model includes the lowest amplitude (as shown in the vertical coordinate a of the hearing model in FIG. 1 ) that the user under test can hear at different frequencies (as shown in the abscissa f of the hearing model in FIG. 1 ). Finally, before playing the audio, the electronic device can perform compensation based on the hearing model of the tested user and the hearing model of the normal user. For example, the lowest amplitude corresponding to the frequency of 1.1KHz in the hearing model of the tested user is 40dB, and the lowest amplitude corresponding to the frequency of 1.1KHz in the hearing model of the normal user is 30dB. Crowd) at 1.1KHz can hear the lowest amplitude difference of 10dB, when the electronic equipment plays the sound of 1.1KHz, the amplitude can be increased by 10dB. In this way, the audio can be played personalizedly for the hearing-impaired user under test, so that the user can obtain the same audio effect as the normal user.

In summary, using the embodiment of this application, the hearing model of the user under test can be finally obtained by testing the angular loss of the horizontal orientation and the angular loss of the vertical orientation. The angular loss of the horizontal orientation and the angular loss of the vertical orientation are obviously easier measured and thus simple to implement. Moreover, the hearing of the user under test deviates between the horizontal and vertical directions, which can basically be determined to be hearing loss. Therefore, it is usually possible to obtain the hearing model of the user under test based on the angle loss of the horizontal direction and the angle loss of the vertical direction. get more accurate results. In this way, the solution of the embodiment of the present application can be well used to compensate audio, so that hearing-impaired users can also obtain better hearing effects.

The embodiment of the present application also provides a communication system, which is used to implement the audio playing method provided in the embodiment of the present application. Referring to FIG. 2 , the communication system includes an electronic device (such as a mobile phone 210 ) and an earphone (earphone 220 ). The communication connection between the electronic device and the earphone can be, for example, a wired connection or a wireless connection, and is used for transmitting related data of the test audio. Wherein, the earphone can play test audio appearing in various directions in the space. It should be understood that the earphone needs to support stereo playback in order to realize the playback of test audio appearing in various directions in the space. For example, headphones need to have left and right channels. After hearing the test audio with both ears of the user under test, the test results can be fed back, such as the horizontal orientation and vertical orientation. The electronic device can determine the hearing loss of both ears of the user under test (including the angular loss in the horizontal direction and the angular loss in the vertical direction) based on the test results, obtain a hearing model, and complete audio compensation.

By adopting the above communication system and using earphones to play the test audio, the influence of the surrounding environment on the hearing test can be reduced. Certainly, in some other embodiments, the audio playing method provided by the embodiment of the present application may also be implemented solely by an electronic device. That is, playing the test audio is also completed by the electronic device. For example, play test audio through the speaker of the electronic device. In some other embodiments, the test audio may also be played through other audio playback devices deployed around the electronic device. Hereinafter, the implementation of the audio playing method provided in the embodiment of the present application by using the above-mentioned communication system is mainly used as an example for illustration.

Exemplarily, the electronic device in the embodiment of the present application may be a mobile phone, a tablet computer, a desktop, a laptop, a handheld computer, a notebook computer, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook, and a cellular Telephones, personal digital assistants (personal digital assistant, PDA), augmented reality (augmented reality, AR)\virtual reality (virtual reality, VR) equipment and other electronic equipment that supports audio playback, the specific form of the electronic equipment in the embodiment of this application No special restrictions are made. Hereinafter, the solution of the present application will be described mainly by taking the electronic device as a mobile phone as an example.

Please refer to FIG. 3 , which is a hardware structural diagram of a mobile phone 210 provided in an embodiment of the present application. As shown in Figure 3, the mobile phone 210 may include a processor 310, an external memory interface 320, an internal memory 321, a universal serial bus (universalserial bus, USB) interface 330, a charging management module 340, a power management module 341, a battery 342, an antenna 1. Antenna 2, mobile communication module 350, wireless communication module 360, audio module 370, speaker 370A, receiver 370B, microphone 370C, earphone jack 370D, sensor module 380, button 390, motor 391, indicator 392, camera 393, display A screen 394, and a subscriber identification module (subscriber identification module, SIM) card interface 395, etc.

It can be understood that the structure shown in this embodiment does not constitute a specific limitation on the mobile phone 210 . In other embodiments, the mobile phone 210 may include more or fewer components than shown, or combine certain components, or separate certain components, or arrange different components. The illustrated components can be realized in hardware, software or a combination of software and hardware.

The processor 310 may include one or more processing units, for example: the processor 310 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor ( image signal processor (ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU), etc. . Wherein, different processing units may be independent devices, or may be integrated in one or more processors.

It can be understood that the interface connection relationship between the modules shown in this embodiment is only a schematic illustration, and does not constitute a structural limitation of the mobile phone 210 . In some other embodiments, the mobile phone 210 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

The charging management module 340 is configured to receive charging input from the charger. Wherein, the charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 340 can receive charging input from a wired charger through the USB interface 330 . In some wireless charging embodiments, the charging management module 340 can receive wireless charging input through the wireless charging coil of the mobile phone 210 . While the charging management module 340 is charging the battery 342 , it can also supply power to the mobile phone 210 through the power management module 341 .

The power management module 341 is used for connecting the battery 342 , the charging management module 340 and the processor 310 . The power management module 341 receives the input of the battery 342 and/or the charging management module 340, and supplies power for the processor 310, the internal memory 321, the external memory, the display screen 394, the camera 393, and the wireless communication module 360, etc. The power management module 341 can also be used to monitor parameters such as battery capacity, battery cycle times, and battery health status (leakage, impedance). In some other embodiments, the power management module 341 may also be disposed in the processor 310 . In some other embodiments, the power management module 341 and the charging management module 340 may also be set in the same device.

The wireless communication function of the mobile phone 210 can be realized by the antenna 1, the antenna 2, the mobile communication module 350, the wireless communication module 360, the modem processor and the baseband processor.

The wireless communication module 360 can provide applications on the mobile phone 210 including wireless local area networks (wireless local area networks, WLAN) (such as wireless fidelity (wireless fidelity, Wi-Fi) network), bluetooth (bluetooth, BT), global navigation satellite system ( Global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 360 may be one or more devices integrating at least one communication processing module. The wireless communication module 360 receives electromagnetic waves via the antenna 2 , frequency-modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 310 . The wireless communication module 360 can also receive the signal to be sent from the processor 310 , frequency-modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.

The mobile phone 210 realizes the display function through the GPU, the display screen 394, and the application processor. The GPU is a microprocessor for image processing, connected to the display screen 394 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering. Processor 310 may include one or more GPUs that execute program instructions to generate or alter display information.

The mobile phone 210 can realize the shooting function through ISP, camera 393 , video codec, GPU, display screen 394 and application processor. The ISP is used to process the data fed back by the camera 393 . Camera 393 is used to capture still images or video. The object generates an optical image through the lens and projects it to the photosensitive element. In some embodiments, the mobile phone 210 may include 1 or N cameras 393, where N is a positive integer greater than 1.

The external memory interface 320 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the mobile phone 210 . The external memory card communicates with the processor 310 through the external memory interface 320 to implement a data storage function. Such as saving music, video and other files in the external memory card.

The internal memory 321 may be used to store computer-executable program code, which includes instructions. The processor 310 executes various functional applications and data processing of the mobile phone 210 by executing instructions stored in the internal memory 321 . For example, the processor 310 may display different content on the display screen 394 in response to the user's operation of expanding the display screen 394 by executing instructions stored in the internal memory 321 . The internal memory 321 may include an area for storing programs and an area for storing data. Wherein, the stored program area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.) and the like. The storage data area can store data (such as audio data, phone book, etc.) created during the use of the mobile phone 210 . In addition, the internal memory 321 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (universal flash storage, UFS) and the like.

The mobile phone 210 can realize the audio function through the audio module 370, the speaker 370A, the receiver 370B, the microphone 370C, the earphone interface 370D, and the application processor. Such as music playback, recording, etc.

The keys 390 include a power key, a volume key and the like. The key 390 may be a mechanical key. It can also be a touch button. The mobile phone 210 can receive key input and generate key signal input related to user settings and function control of the mobile phone 210 . The motor 391 can generate a vibrating prompt. The motor 391 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. The indicator 392 can be an indicator light, which can be used to indicate the charging status, the change of the battery capacity, and can also be used to indicate messages, missed calls, notifications and the like. The SIM card interface 395 is used for connecting a SIM card. The SIM card can be inserted into the SIM card interface 395 or pulled out from the SIM card interface 395 to realize contact and separation with the mobile phone 210 . The mobile phone 210 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1.

Exemplarily, the earphone 220 in the embodiment of the present application may be a wired earphone or a wireless earphone. Further, referring to FIG. 4 , the wireless headset may include a true wireless (True Wireless Stereo, TWS) headset 401 , a neck-worn wireless headset 402 , or a head-worn wireless headset 403 . It should be understood that earphones are usually paired. As shown in FIG. 4 , the TWS earphone 401 includes a left earphone 401a and a right earphone 401b. In order to facilitate the distinction between a pair of earphones and a single earphone, hereinafter, a pair of earphones is referred to as an earphone, and a single earphone is referred to as an earphone, which corresponds to the left earphone and the right earphone, and can be divided into a left earphone and a right earphone.

In the following, a single earplug will be used as an example to illustrate the hardware structure of the earphone.

Referring to FIG. 5 , it shows a schematic structural diagram of an earphone 220 provided by an embodiment of the present application. As shown in FIG. 5, the earbud may include a processor 510, a memory 521, a charge management module 540, a power management module 541, a battery 542, a wireless communication module 560, an audio module 570, a speaker 570A, a microphone 570C, a motor 591, and an indicator 592 et al.

The processor 510 may include one or more processing units, for example: the processor 510 may include a sound signal processor (image signal processor, ISP), a controller, a memory, a digital signal processor (digital signal processor, DSP), a baseband processor , and/or a neural network processor (neural-network processing unit, NPU), etc. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.

The memory 521 may be used to store computer-executable program code including instructions. The processor 510 executes various functional applications and data processing of the earphone 220 by executing instructions stored in the memory 521 . In the embodiment of the present application, the processor 510 may execute the instructions stored in the memory 521 to complete processing such as test audio playback and calibration before the hearing test.

The memory 521 may include an area for storing programs and an area for storing data. Wherein, the stored program area can store an operating system, an application program required by at least one function (such as a sound playing function), and the like. The storage data area can store data created during use of the earphone 220 (such as audio data) and the like. In addition, the memory 521 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (universal flash storage, UFS) and the like.

The charging management module 540 is used for receiving charging input from the charger. Wherein, the charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 540 may receive charging input from a wired charger through a charging interface. In some wireless charging embodiments, the charging management module 540 can receive wireless charging input through the electrode sensor 580K of the earphone 220 . While the charging management module 540 is charging the battery 542 , it can also supply power to the electronic device through the power management module 541 .

The power management module 541 is used for connecting the battery 542 , the charging management module 540 and the processor 510 . The power management module 541 receives the input of the battery 542 and/or the charging management module 540 to provide power for the processor 510, the internal memory 521 and so on. The power management module 541 can also be used to monitor parameters such as battery capacity, battery cycle times, and battery health status (leakage, impedance). In some embodiments, the power management module 541 can also be disposed in the processor 510 . In some other embodiments, the power management module 541 and the charging management module 540 may also be set in the same device.

The wireless communication function of the wireless earphone can be realized through the wireless communication 560, such as a Bluetooth (bluetooth, BT) module. Through the wireless communication module 560, the earphone 220 can establish a communication connection with electronic devices such as mobile phones and tablets, so that the earphone 220 can be used to listen to music, answer calls, and the like.

The earphone 220 can implement audio functions through an audio module 570 , a speaker 570A, a microphone 570C, and an application processor.

The audio module 570 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal. The audio module 570 may also be used to encode and decode audio signals. In some embodiments, the audio module 570 may be set in the processor 510 , or some functional modules of the audio module 570 may be set in the processor 510 .

Speaker 570A is used to play audio. Microphone 570C, also called "microphone" or "microphone", is used to collect surrounding sound signals. One or more microphones 570C may be provided in the headset 220 . For example, if multiple microphones 570C are installed in the earphone 220, they can not only be used to collect sound signals, but also can be used for functions such as noise reduction, sound source identification, and directional recording.

Referring to FIG. 6, the headset 220 includes a speaker 570A. In the embodiment of the present application, the speaker 570A can be used to play test audio. The earphone 220 also includes two microphones 570C in total, a feedback microphone (Feed Back MIC, FB MIC) 570C1 and a feedforward microphone (Feed Forward MIC, FF MIC) 570C2. The FB MIC 570C1 is set at a position close to the ear canal when the earphone 220 is in the wearing state, and is used for collecting sound signals in the ear canal. When the speaker 570A is working, the sound signal in the ear canal includes the sound signal corresponding to the audio played by the speaker 570A. The FF MIC 570C2 is set at a position where the earphone 220 is exposed to the external environment when it is worn, and is used for collecting sound signals in the surrounding environment of the ear. For example, if the user under test wears earphones and rides the subway, the sound signals in the surrounding environment of the ears may include ambient noise in the subway.

The motor 591 can generate vibration prompts, so it can be used for incoming call vibration prompts, and can also be used for touch/tap vibration feedback.

The indicator 592 can be an indicator light, which can be used to indicate the charging status, the change of the battery capacity, and can also be used to indicate messages, missed calls, notifications and so on.

It can be understood that the structures of the mobile phone 210 and the earphone 220 shown in this embodiment are only exemplary. In some other embodiments, both the mobile phone 210 and the earphone 220 may include more or less components than shown in the figure, or some components may be combined, or some components may be separated, or different component arrangements may be made. The illustrated components can be realized in hardware, software or a combination of software and hardware.

The audio playing method provided in the embodiment of the present application may be executed in the communication system composed of the above-mentioned mobile phone 210 and earphone 220 .

Usually, the tested user usually relies on the Interaural Level Difference (ILD) and the Interaural Time Difference (ITD) to perceive the horizontal position of the sound source. And, the user under test relies on changes in the spectral signal to perceive the vertical orientation of the sound source. Then, for hearing-impaired users, the spatial orientation (including horizontal orientation and vertical orientation) perceived by them may be different from the spatial orientation (including horizontal orientation and vertical orientation) perceived by normal users.

Based on this, in the embodiment of the present application, the mobile phone may first test the angular loss of the measured user's ears in the horizontal orientation and the angular loss in the vertical orientation. Referring to Figure 7, in the angular loss of the horizontal orientation, the horizontal axis is the frequency f, and the vertical axis is the angular deviation Δdh between the horizontal orientation of the sound source perceived by the measured user's ears and the horizontal orientation of the sound source perceived by the normal user. That is, the angular loss of the horizontal orientation can reflect: the measured user's perception deviation in the horizontal orientation to sounds of different frequencies. For example, for a sound with frequency f1, the measured user's perception deviation in the horizontal direction is Δdh1. In the angle loss of the vertical orientation, the horizontal axis is the amplitude a, and the vertical axis is the angular deviation Δdv between the vertical orientation of the sound source perceived by the measured user’s ears and the vertical orientation of the sound source perceived by the normal user. That is, the angular loss of the vertical orientation can reflect: the measured user's perception deviation in the vertical orientation to sounds of different amplitudes. For example, for a sound with an amplitude of a1, the measured user's perception deviation in the vertical direction is Δdv1.

After obtaining the angular loss in the horizontal orientation and the angular loss in the vertical orientation, the mobile phone may determine the hearing model of the user under test based on the angular loss in the horizontal orientation and the angular loss in the vertical orientation. For example, the mobile phone can input the angle loss of the horizontal orientation and the angle loss of the vertical orientation into a preset artificial intelligence (AI) model, and the preset AI model can be obtained by converting the angle loss of the horizontal orientation and the angle loss of the vertical orientation Features of the hearing model.

Continuing to refer to FIG. 7 , in the hearing model, the dotted line is the hearing model of the tested user, and the solid line is the hearing model of the normal user. In addition, the horizontal axis is the frequency f, and the vertical axis is the lowest amplitude a (also called the first lowest amplitude) of the sound that can be heard by the user (tested user or normal user) at each frequency. Then, the amplitude difference corresponding to each frequency between the hearing model of the tested user and the normal user is the amplitude loss of the tested user at the corresponding frequency. It will be appreciated that greater amplitude loss indicates more severe hearing loss. Smaller amplitude losses indicate less hearing loss.

After obtaining the hearing model, the mobile phone can perform compensation based on the hearing model of the tested user and the normal user before playing the video, that is, compensation based on amplitude loss. In a specific implementation manner, the sound signal of the third frequency in the audio to be played is increased to a preset amplitude and then played, the third frequency is any frequency of the sound signal included in the audio to be played, and the preset amplitude is the frequency in the hearing model. The difference between the first lowest amplitude corresponding to the third frequency and the third lowest amplitude that people without hearing loss can hear the sound signal of the third frequency. Exemplarily, in the compensation example shown in FIG. 7 , the amplitude loss corresponding to frequency f2 (that is, the third frequency is f2) is Δa2, then when playing the sound with frequency f2, the amplitude can be increased by Δa2. And, the amplitude loss corresponding to the frequency f3 (that is, the third frequency is f3) is Δa3, then when playing the sound with the frequency f3, the amplitude can be increased by Δa3.

In this embodiment of the application, it is necessary to use earphones to play the test audio. However, if the ambient noise is high, such as the environment where the tested user is located in a workshop with large machines, the ambient noise may enter the ear canal, thereby affecting the spatial orientation of the tested user's perception of the sound in the test audio. Or, if the earphone does not fit the ear very well, for example, the earplug of the earphone is small, the ambient noise may also enter the ear canal, which will also affect the user under test's perception of the direction of the sound in the test audio.

Based on this, in some embodiments, after the mobile phone detects that the user under test activates the audio compensation function, it may first detect whether the environmental conditions of the test are met. If the environmental conditions are met, the earphone can be further used to play the test audio, so as to test the angular loss in the horizontal orientation and the angular loss in the vertical orientation. If the environmental conditions are not satisfied, the user under test is prompted to go to a quiet location for re-testing, or the user under test is prompted to wear the earphone again.

Wherein, the audio compensation function is used to compensate the audio based on the hearing loss of the tested user before the mobile phone plays the audio. For example, Figure 7 shows the process for f1 compensation. In the settings of the mobile phone, or the settings of the music player and the video player, a switch of the audio compensation function may be provided to enable or disable the audio compensation function.

Exemplarily, the mobile phone may display the interface 801 shown in FIG. 8 , the interface 801 is a setting interface in the mobile phone settings, and the interface 801 includes an audio compensation switch 802 . After the mobile phone detects that the user under test turns on or off the audio compensation switch 802 , the audio compensation function can be turned on or off. The mobile phone may display an interface 803 shown in FIG. 8 in response to the user being tested turning on the audio compensation switch 802 , that is, detecting the user being tested turning on the audio compensation function. The interface 803 includes a prompt "Please wear the earphones and connect the mobile phone and the earphones", thereby prompting the user to wear the earphones and establish a connection between the mobile phone and the earphones to prepare for playing the test audio.

It should be understood that after the earphone is in the wearing state and the connection between the mobile phone and the earphone is established, the earphone may send indication information to the mobile phone to indicate that the earphone has been worn. After the mobile phone receives the instruction information, it can be determined that the headset has been worn successfully and the connection with the mobile phone is established, and then the environment detection can be started.

Exemplarily, after the headset is worn and successfully connected, the mobile phone may display an interface 804 shown in FIG. 8 , the interface 804 includes a control 805 for starting environment detection, which is used to trigger the mobile phone to start environment detection.

During the environment detection process, the mobile phone may collect the FF MIC signal and the FB MIC signal of the left earbud, and collect the FF MIC signal and the FB MIC signal of the right earbud. Wherein, the FF MIC signal can reflect the sound condition of the external environment, and the FBMIC signal can reflect the sound condition in the ear canal. Based on the above FF MIC signal and FB MIC signal, the mobile phone can detect whether the environmental conditions are satisfied. For example, if the FF MIC signals of the left earplug and the right earplug are both smaller than the first threshold λ1, it indicates that the environmental noise is relatively small and the environmental condition is met. For another example, if the FB MIC signals of the left earplug and the right earplug are both smaller than the third threshold λ2, it indicates that the interference sound in the ear canal is small and the environmental condition is satisfied. For another example, if the difference between the FF MIC signal of the left earplug and the FB MIC signal is greater than the second threshold λ3, and the difference between the FF MIC signal of the right earplug and the FB MIC signal is greater than the second threshold λ3, it indicates that the left earplug and the right earplug Both are very close to the ear, and the left and right earplugs have a good isolation effect on external ambient sound, which meets the environmental conditions. This embodiment of the present application does not specifically limit it.

For ease of description, the FB MIC signal of the left earbud can be called the first feedback signal, the FBMIC signal of the right earbud can be called the second feedback signal, the FF MIC signal of the left earbud can be called the first feedforward signal, and the FF MIC signal of the right earbud can be called the first feedforward signal. The FF MIC signal is called the second feedforward signal.

Further, in order to avoid accidental errors, the mobile phone can collect FF MIC signals and FB MIC signals within a period of time (such as 5s, 10s, etc.), and then check whether the environmental conditions are met based on the FF MIC signals and FB MIC signals during this period.

Exemplarily, after the mobile phone detects that the user under test clicks or long-presses the control 805 to start environment detection in the interface 804 shown in FIG. 8, it can display the interface 806 shown in FIG. Prompt 807, used to prompt the collected signal content. And, the interface 806 also includes a progress prompt 808 for prompting the progress of signal acquisition. For example, the progress prompt 808 prompts 24% progress of the current collection to 5 seconds.

In a specific implementation, after the mobile phone collects the FF MIC signal and the FB MIC signal for a period of time, it can calculate the root mean square (Root Mean Square, RMS) of the FF MIC signal for the left earplug and the right earplug respectively, And the RMS of the FB MIC signal is calculated separately for the left and right earbuds. The calculated RMS is then used to determine whether the environmental conditions are met.

Exemplarily, if the calculated RMS satisfies the following relationship (1), it is determined that the environmental condition is satisfied:

关系（1）

relationship (1)

为左耳塞的FF MIC信号，

为右耳塞的FF MIC信号。即，左 耳塞的FF MIC信号的RMS和右耳塞的FF MIC信号的RMS都小于第一阈值，则确定满足环境条 件。 in,

is the FF MIC signal of the left earbud,

It is the FF MIC signal of the right earbud. That is, if both the RMS of the FF MIC signal of the left earbud and the RMS of the FF MIC signal of the right earbud are smaller than the first threshold, it is determined that the environmental condition is met.

Conversely, if the above relationship (1) is not satisfied, it indicates that the ambient sound of the environment where the left earplug and the right earplug are located is relatively loud, and it is determined that the environmental condition is not satisfied.

As an example, further, on the basis of satisfying the above relationship (1), if the calculated RMS satisfies the following relationship (1), it is determined that the environmental conditions are met:

关系（2）

relationship (2)

为左耳塞的FB MIC信号，

为右耳塞的FB MIC信号。即，在左 耳塞的FF MIC信号的RMS和FB MIC信号的RMS的差值大于第二阈值λ3，且右耳塞的FF MIC信 号的RMS和FB MIC信号的RMS的差值大于第二阈值λ3，则确定满足环境条件。 in,

is the FB MIC signal of the left earbud,

It is the FB MIC signal of the right earbud. That is, the difference between the RMS of the FF MIC signal of the left earplug and the RMS of the FB MIC signal is greater than the second threshold λ3, and the difference between the RMS of the FF MIC signal of the right earplug and the RMS of the FB MIC signal is greater than the second threshold λ3, It is determined that the environmental conditions are met.

In addition, due to differences in hardware, there are also tolerances in the acoustic structure of the left and right earbuds of some headphones. For example, the same audio signal is input to the left earbud and the right earbud, but the audio signals output from the speaker of the left earbud and the speaker of the right earbud are different. That is to say, even if the left earplug and the right earplug receive the same audio signal, the sound effect heard by the left ear canal of the tested user is different from that heard by the right ear canal due to structural differences between the left earplug and the right earplug. There are differences in sound effects. For example, the sounds heard by the two ears at their respective ear-Drum Reference Points (eDRP) are different. In this way, the accuracy of subsequent tests may be affected.

Based on this, in some embodiments, the mobile phone can also calibrate the left earplug and the right earplug, so as to prevent the difference in hardware between the left earplug and the right earplug from affecting subsequent tests. After the headset is worn and connected successfully, see Figure 9, the mobile phone can control to send the same audio signal (also called preset audio) to the left and right earbuds, such as audio signal a in Figure 9, and collect the left earbud’s The FB MIC signal (also called the third feedback signal) and the FB MIC signal of the right earbud (also called the fourth feedback signal). Among them, the difference in physiological structure in the ear canal is ignored. Therefore, the FB MIC signal of the left earplug can be approximated as the sound signal heard at the eDRP of the left ear, and the FB MIC signal of the right earplug can be approximated as the sound signal heard at the eDRP of the right ear. sound signal. After the audio signal a is played, the mobile phone can obtain the change curves including the audio signal a, the FB MIC signal of the left earplug, and the FB MIC signal of the right earplug as shown in FIG. 9 . The horizontal axis of the curve is frequency, and the vertical axis is amplitude.

The mobile phone analyzes the change curve of the FB MIC signal of the left earplug and the FB MIC signal of the right earplug, and determines the calibration coefficient p that makes REC-L _FB (s)/REC-R _FB (s)=1. Among them, REC-L _FB (s) is the FB MIC signal of the left earbud, and REC-R _FB (s) is the FB MIC signal of the right earbud. That is, the calibration coefficient p is determined so that both the frequency and the amplitude of the FB MIC signal and the FB MIC signal match. The calibration coefficient p is used to adjust the input signal to the speaker in the left earbud, or to adjust the input signal to the speaker in the right and left earbuds. Thereby masking out the hardware difference between the speaker in the left earbud and the speaker in the right earbud. For convenience of description, the earplugs for which the calibration coefficient p is used for calibration may be referred to as first earplugs, and the earplugs other than the first earplugs may be referred to as second earplugs. For example, if the first earplug is the left earplug, then the second earplug is the right earplug; if the first earplug is the right earplug, then the second earplug is the left earplug.

Subsequently, in the process of testing the angular loss in the horizontal orientation and the angular loss in the vertical orientation, the mobile phone may first calibrate the test audio based on the calibration coefficient p before sending the test audio to the earphone. Wherein, calibration includes amplitude calibration and/or frequency calibration.

In a specific implementation manner, the mobile phone may calibrate the test audio input to the left earplug based on the calibration coefficient p, obtain the calibrated test audio, and then send it to the left earplug. In this implementation, the mobile phone may send the test audio to the right earbud without calibration. It should be understood that after calibrating the test audio sent to the left earbud, the input signal to the speaker in the left earbud will change accordingly. In this way, the input signal input to the speaker in the left earplug can be adjusted, and the hardware difference between the speaker in the left earplug and the speaker in the right earplug can be shielded.

In another specific implementation manner, the mobile phone may calibrate the test audio input to the right earplug based on the calibration coefficient p, obtain the calibrated test audio, and then send it to the right earplug. In this implementation, the mobile phone may send the test audio to the left earbud without calibration. It will be appreciated that after calibrating the test audio sent to the right earbud, the input signal to the speaker in the left earbud will change accordingly. In this way, the input signal input to the speaker in the right earplug can be adjusted, and the hardware difference between the speaker in the left earplug and the speaker in the right earplug can be shielded.

In the aforementioned specific implementation of calibration, the mobile phone calibrates the test audio based on the calibration coefficient p. Of course, in some other implementation manners, after the mobile phone analyzes and obtains the calibration coefficient, it may also send the calibration coefficient p to the left earplug or the right earplug. The test audio is then calibrated by the left or right earbud based on the calibration coefficient p. This embodiment of the present application does not specifically limit it.

After completing the above environment detection and calibration, the mobile phone can test the angular loss of the horizontal orientation and the angular loss of the vertical orientation. Certainly, in some other embodiments, the above-mentioned process of environment detection, or the process of calibration may also be omitted.

The following describes the specific implementation of testing the angular loss of the horizontal orientation and the angular loss of the vertical orientation:

Before testing the angle loss in the horizontal direction, the mobile phone needs to determine m sets of horizontal test sequences for testing the angle loss in the horizontal direction. A set of level test sequences includes n level test samples. Since the user needs to rely on the ILD to perceive the horizontal orientation, that is, the amplitude will affect the user's perception of the horizontal orientation. Based on this, it can be set that in n horizontal test samples included in a group of horizontal test sequences, the sound amplitudes are the same. In this way, it is avoided that the user's judgment on the horizontal orientation is affected by the difference in amplitude. However, among the n horizontal test samples included in a set of horizontal test sequences, the frequencies of sounds and the preset horizontal orientations appearing are different. Among them, different frequencies can be simulated by using sounds emitted by different objects. For example, sounds produced by various musical instruments have different frequencies, and multiple musical instrument sounds can be used to simulate multiple sounds of different frequencies.

For example, refer to the horizontal orientation diagram and a set of horizontal test sequences shown in Figure 10. From the perspective of the top view of the human head, the orientation of the front of the face and perpendicular to the center of the face is horizontal 0°, and the horizontal orientation is counterclockwise. The angle gradually increases, such as increasing to 15°, 30°, 45°... . A set of horizontal test sequences includes three horizontal test samples, which are the horizontal test sample ① shown in Figure 10: the drum sound that appears at the preset horizontal orientation of 23° and the amplitude is A1; the horizontal test sample ②: that appears at the preset Assume a piano sound with a horizontal orientation of 83° and an amplitude of A1; and, level test sample ③: a guitar sound with a preset horizontal orientation of 233° and an amplitude of A1. Obviously, the amplitude of the sound in the level test sample ①, the level test sample ② and the level test sample ③ is A1, so the amplitude is the same. And, the proficiency test sample ①, the proficiency test sample ② and the proficiency test sample ③ are drum, piano and guitar sounds respectively, so the frequencies are different. Moreover, the preset horizontal orientations of the sounds in the horizontal test sample ①, horizontal test sample ② and horizontal test sample ③ are respectively 23°, 83° and 233°, so the preset horizontal orientations are different.

The frequencies included in the two sets of horizontal test sequences can be completely different, partially or completely the same.

Exemplarily, the 3 level test samples included in one set of level test sequences are respectively drum sound, piano sound and guitar sound, and the 3 level test samples included in another group level test sequence are violin sound, harmonica sound and The suona sound, that is, the frequencies included in the two horizontal test sequences are completely different.

Also exemplary, the 3 level test samples included in one group of level test sequences are drum sound, piano sound and guitar sound respectively, and the 3 level test samples included in another group level test sequence are respectively piano sound, guitar sound It is the same as the violin sound, that is, the frequency part included in the two sets of horizontal test sequences, and the same is the corresponding frequency of the piano sound and the guitar sound.

Exemplarily again, the 3 level test samples included in one group of level test sequences are respectively drum sound, piano sound and guitar sound, and the 3 level test samples included in another group level test sequence are respectively drum sound, piano sound and guitar sound, that is, the two horizontal test sequences consisted of exactly the same frequencies.

In a specific implementation manner, if the frequencies included in the two sets of horizontal test sequences are completely the same, the timings at which the frequencies appear can be different (that is, the order is different). In this way, the two sets of horizontal test sequences can include n horizontal test samples with the same frequency but different frequency time sequences, which are used to test the hearing conditions of the tested users under different frequency time sequences. Therefore, the hearing status of the tested user to the sound of each frequency can be obtained more accurately.

For example, two sets of horizontal test sequences are shown in Table 1 below:

Table 1

It should be understood that the above Table 1 omits the two preset parameters of vertical orientation and amplitude.

Obviously, the two sets of horizontal test sequences in Table 1 above all include the sounds of drums, pianos and guitars, that is, the included frequencies are the same. However, among the 3 proficiency test samples included in the first group of proficiency test sequences, drum sounds, piano sounds and guitar sounds are sequentially chronologically; among the 3 proficiency test samples included in the 2nd group proficiency test sequences, drum voice, guitar and piano. Then, the first group of horizontal test sequences and the second group of horizontal test sequences can not only be used to test the user's hearing of drums, piano sounds and guitar sounds; In the case of the sound of the piano, the user's hearing of the guitar sound; and, the second group of horizontal test sequences can be used to test the user's hearing of the guitar sound when the guitar sound appears after the drum sound.

And, before testing the angle loss in the vertical direction, the mobile phone needs to determine q sets of vertical test sequences for testing the angle loss in the vertical direction. A set of vertical test sequences includes w vertical test samples. Since the user needs to rely on the change of the spectral signal to perceive the change of the vertical orientation, that is, the spectral signal will affect the user's perception of the vertical orientation. Based on this, it can be set that among the w vertical test samples included in a set of vertical test sequences, the spectral signals of the sound are the same. In this way, it is avoided that the user's judgment on the vertical orientation is affected by the different spectral signals. However, among the n vertical test samples included in a set of vertical test sequences, the sound amplitudes and vertical orientations appearing are different. Wherein, the same spectral signal can be simulated by the same piece of music, for example, the spectral signals in a set of vertical test sequences including w vertical test samples are all music a.

For example, refer to the vertical orientation diagram and a set of vertical test sequences in Figure 10. From the perspective of the right view of the human head, the orientation of the front of the face and perpendicular to the center of the face is vertical 0°, and the vertical orientation is counterclockwise. The angle gradually increases, such as increasing to 15°, 30°, 45°... . A set of vertical test sequences includes 3 vertical test samples, which are vertical test sample 1 shown in Figure 10: appearing at the preset vertical orientation of 53° and curve a with an amplitude of A1; vertical test sample 2: appearing at the preset Assume a curve a with a vertical orientation of 188° and an amplitude of A2; and, vertical test sample 3: a curve a with a preset vertical orientation of 278° and an amplitude of A3. Obviously, the vertical test sample 1, the vertical test sample 2 and the vertical test sample 3 are all curved a, so the spectral signals are the same. And, the amplitudes of curve a in vertical test sample 1, vertical test sample 2, and vertical test sample 3 are A1, A2, and A3 respectively, so the amplitudes are different. Moreover, the preset vertical orientations where curve a appears in vertical test sample 1, vertical test sample 2, and vertical test sample 3 are 53°, 188°, and 278°, respectively, so the preset vertical orientations are different.

The two sets of vertical test sequences may include completely different, partially or completely identical amplitudes.

Exemplarily, the amplitudes of the sounds in the 3 vertical test samples included in one set of vertical test sequences are A1, A2 and A3 respectively, and the amplitudes of the sounds in the 3 vertical test samples included in another set of vertical test sequences are A4 respectively , A5 and A6, that is, the amplitudes included in the two sets of vertical test sequences are completely different.

Exemplarily again, the amplitudes of the sounds in the 3 vertical test samples included in one set of vertical test sequences are respectively A1, A2 and A3, and the amplitudes of the sounds in the 3 vertical test samples included in another set of vertical test sequences are respectively A2, A3 and A6, that is, two sets of vertical test sequences include the same amplitude part, and the same ones are A2 and A2.

Exemplarily again, the amplitudes of the sounds in the 3 vertical test samples included in one set of vertical test sequences are respectively A1, A2 and A3, and the amplitudes of the sounds in the 3 vertical test samples included in another set of vertical test sequences are respectively A1, A2 and A3, that is, two sets of vertical test sequences include exactly the same amplitude.

In a specific implementation manner, if the amplitudes included in the two sets of vertical test sequences are completely the same, the timings at which the amplitudes appear can be different (that is, the order is different). In this way, the two vertical test sequences can include w vertical test samples with the same frequency but different amplitude timings, which are used to test the hearing condition of the tested user under different amplitude timings. Therefore, the hearing status of the tested user to sounds of various amplitudes can be obtained more accurately. Its principle is similar to the above-mentioned principle of the same frequency but different frequency timing in the level test sequence. For details, please refer to the description of the relevant part above (such as the related content in Table 1), and will not repeat it here.

So far, m sets of horizontal test sequences for testing the angle loss of the horizontal orientation have been determined, that is, there are multiple sets of horizontal test sequences. Multiple sets of horizontal test sequences can simulate a large number of possible frequency combinations. And, q sets of vertical test sequences for testing the angle loss of the vertical orientation are determined, that is, there are also multiple sets of vertical test sequences. Multiple vertical test sequences can simulate a large number of possible amplitude combinations. However, in actual implementation, there may be only one set of horizontal test sequences and vertical test sequences. That is, a set of horizontal test sequences is used to determine the angular loss of horizontal azimuth, and a set of vertical test sequences is used to determine the angular loss of vertical azimuth. This embodiment of the present application does not specifically limit it. The following mainly takes m groups of horizontal test sequences and q groups of vertical test sequences as examples for illustration.

After the mobile phone determines m sets of horizontal test sequences and q sets of vertical test sequences, it can test the angle loss of the horizontal orientation and the angle loss of the vertical orientation. Referring to Figure 11, the process of testing the angular loss of the horizontal orientation and the angular loss of the vertical orientation includes:

S1101. The mobile phone sends the kth group of target test sequences to the earphone. The kth group of target test sequences is any group of test sequences in the m group of horizontal test sequences and the q group of vertical test sequences, and k ranges from 1, 2, 3...m+ The values in q are taken sequentially.

Taking m=q=10 as an example, the mobile phone can first send 10 sets of test audio corresponding to the horizontal test sequence to the earphone in sequence, and then send the test audio corresponding to 10 sets of vertical test sequences to the earphone in turn.

Among them, if the kth group of target test sequences is a set of horizontal test sequences, then the kth group of target test sequences includes sounds with the same amplitude and different frequencies (such as different musical instruments) that appear in multiple preset horizontal orientations (which can be called various first sound signals). Take the kth group of target test sequences as an example of a group of horizontal test sequences shown in the aforementioned Figure 10, then the kth group of target test sequences should include the sound of drums appearing at 23° in the horizontal direction, the sound of piano appearing at 83° and The guitar sound that appears at 233°.

And, if the kth group of target test sequences is a group of vertical test sequences, then the kth group of target test sequences includes sounds with the same spectrum signal (like the same piece of music) and different amplitudes (can be called multiple second sound signals). Taking the kth group of target test sequences as an example of the group of vertical test sequences shown in Figure 10 above, the kth group of target test sequences should include the curve a with the amplitude A1 appearing at 53° in the vertical direction, and the curve a at 188° The curve a with the amplitude of A2 and the curve a with the amplitude of A3 appearing at 278°.

Exemplarily, after the environment detection and calibration are completed, the mobile phone may display the interface 1201 shown in FIG. 12 . The interface 1201 includes a prompt "Earphone is ready, whether to start hearing loss detection" for prompting to start hearing loss detection. And, the interface 1201 also includes two options of "Yes" and "No", for the user under test to choose whether to detect hearing loss. After the mobile phone detects that the user under test selects the "Yes" option in the interface 1201, it can start to send the first set of target test sequences, such as the first set of horizontal test sequences, to the earphone.

What needs to be explained here is that the mobile phone sends the k-th group of target test sequences to the earphone, specifically, the mobile phone sends the k-th group of target test sequences to the left earplug and the right earplug of the headset respectively; The k-th group of target test sequences, and then the k-th group of target test sequences is synchronized from the earplug to the other earplug. This embodiment of the present application does not specifically limit it.

S1102. The earphone plays the test audio k corresponding to the kth group of target test sequences.

For ease of description, the test audio k corresponding to the horizontal test sequence may be referred to as the horizontal test audio, and the test audio k corresponding to the vertical test sequence may be referred to as the vertical test audio.

After receiving the k-th group of target test sequences, the two earplugs of the earphone can play the test audio corresponding to the k-th group of target test sequences from the speaker. In this way, sound signals can be transmitted to both ears of the user under test. It should be understood that as long as the earphone is a stereo earphone, the effect of playing the corresponding sound at the preset horizontal orientation and the preset vertical orientation can be achieved. That is, stereoscopic playback is realized.

Based on the effect of binaural hearing, the user under test can give feedback on the perceived orientation of the sounds appearing in multiple preset horizontal orientations or multiple preset vertical orientations in the k-th group of target test sequences, that is, the feedback perception result k.

Taking the k-th group of target test sequences as an example, the mobile phone may display the interface 1202 shown in FIG. A horizontal orientation map is included in , which is used to select the perceived orientation. And, the interface 1202 also includes a prompt "after the earphone starts to play the test audio, please select the orientation of the sound in the above horizontal orientation map", which is used to prompt selection of the perceived orientation. For example, after the earphone has played the drum sound at the kth group target test sequence horizontal orientation 23 °, the user under test clicks the area of 30 °-45 ° in the horizontal orientation diagram in the interface 1203 shown in Figure 12, such as clicking 38 °, Then the test result k includes: the user under test perceives the drum sound at a horizontal orientation of 23° in the target test sequence of the kth group as 38°.

S1103. The mobile phone receives the test result k, which includes multiple perception orientations of the tested user corresponding to multiple sounds in the kth group of target test sequences.

For ease of description, the test result k fed back for the test audio k corresponding to the horizontal test sequence may be referred to as the horizontal test result, and the test result k fed back for the test audio k corresponding to the vertical test sequence may be referred to as the vertical test result.

Wherein, the kth group of target test sequences is a set of horizontal test sequences, and multiple sounds refer to sounds of multiple frequencies. The kth group of target test sequences is a set of vertical test sequences, and multiple sounds refer to sounds with multiple amplitudes.

Exemplarily, taking the k-th group of target test sequences as a group of horizontal test sequences shown in Figure 10 (denoted as the first group of horizontal test sequences) as an example, a complete test result k can be shown in Table 2 below:

Table 2

The above Table 2 can reflect that the test results k corresponding to the first group of horizontal test sequences include: the measured user's perception of the drum sound in the first group of horizontal test sequences is 38°; The perceptual orientation of 83°; and, the perceived orientation of the guitar sound in the group 1 horizontal test sequence is 263°.

S1104. According to the test result k, the mobile phone calculates the angular deviation of the user's perceived orientation to the multiple sounds in the kth group of target test sequences.

In some embodiments, the mobile phone can also test normal users, for example, use the above S1101-S1103 to test normal users, and obtain the normal user's perception result k' corresponding to the k-th group of target test sequences.

Taking the k-th group of target test sequences as a group of horizontal test sequences shown in Figure 10 (denoted as the first group of horizontal test sequences) as an example, a complete test result k' can be shown in Table 3 below:

table 3

The above Table 2 can reflect that the test results k' corresponding to the first group of horizontal test sequences include: the user's perception of the drum sound in the first group of horizontal test sequences is 30°; The perceived orientation of the sound is 85°; and, the perceived orientation of the guitar sound in the Group 1 horizontal test sequence is 275°.

In this embodiment, for any sound in the kth group of target test sequences, the perceived orientation of the sound in the test result k is subtracted from the perceived orientation of the sound in the test result k' to obtain the user's perception of the sound. The angular bias of the perceived bearing.

Exemplarily, the test result k and the test result k' are shown in the above-mentioned Table 2 and Table 3 respectively, then it can be calculated that the user under test has a set of horizontal test sequences shown in Figure 10 (denoted as the first group of horizontal test sequences ), the angular deviation of the perceived orientation of the drum sound is 38°-30°=8°, the angular deviation of the perceived orientation of the piano sound is 83°-85°=-2°, and the angular deviation of the perceived orientation of the guitar sound is 263 °-250°=13°. In addition, the drum sound, piano sound and guitar sound correspond to different frequencies, such as f1, f2 and f3. If f1<f2<f3, then, based on the angular deviation of the measured user to the drum sound, piano sound and guitar sound8 °, -2° and 13°, the angular loss of a group of horizontal azimuths corresponding to the first group of horizontal test sequences as shown in Figure 13 can be obtained (such as the angular loss of the first group of horizontal azimuths).

With this embodiment, the perceived orientation of the normal user is used as the standard orientation to calculate the angular deviation of the perceived orientation of the measured user.

Of course, in some other embodiments, the mobile phone may also use multiple preset horizontal orientations or multiple vertical orientations in the k-th group of target test sequences as standard orientations to calculate the angular deviation of the perceived orientation of the user under test. In this embodiment, it is only necessary to replace the perceived orientation of the normal user in the foregoing embodiments with the preset horizontal orientation or the preset vertical orientation, which will not be repeated here.

It should be noted that, in the above description about S1104, the horizontal test sequence is mainly used for description. In practice, the same is true for the vertical test sequence, and an example is used below to illustrate.

Exemplarily, the kth group of target test sequences is a group of vertical test sequences shown in Figure 10 (denoted as the first group of vertical test sequences), then a complete test result k can be shown in the following table 4:

Table 4

The above table 4 can reflect that the test result k corresponding to the first group of vertical test sequences includes: the measured user's perception of the sound with amplitude A1 in the first group of vertical test sequences is 300°; The perceived orientation of the sound of amplitude A2 is 32°; and, the perceived orientation of the sound of amplitude A3 in the set 1 vertical test sequence is 229°.

Similarly, the k-th group of target test sequences is a group of vertical test sequences shown in Figure 10 (denoted as the first group of vertical test sequences), and a corresponding complete test result k' can be shown in Table 5 below:

table 5

The above table 5 can reflect that the test result k' corresponding to the first group of vertical test sequences includes: the measured user's perception of the sound with amplitude A1 in the first group of vertical test sequences is 280°; for the first group of vertical test sequences The perceived orientation of the sound of the medium amplitude A2 is 50°; and the perceived orientation of the sound of the amplitude A3 in the first set of vertical test sequences is 200°.

Based on the above Table 4 and Table 5, it can be calculated that the angular deviation of the perceived orientation of the sound with amplitude A1 in the group of vertical test sequences shown in Figure 10 (denoted as the first group of horizontal test sequences) by the tested user is 300° -280°=20°, the angular deviation of the perceived orientation of the sound with amplitude A2 is 32°-50°=-18°, and the angular deviation of the perceived orientation of the sound with amplitude A1 is 229°-200°=29°. If A1<A2<A3, then, based on the angular deviations of the measured users to the sounds with amplitudes A1, A2 and A3 of 20°, -18° and 29° respectively, the first group of vertical test sequence correspondences as shown in Figure 13 can be obtained The angular loss of a group of vertical orientations (such as the angular loss of the vertical orientation of group 1).

Of course, the angular loss in the horizontal orientation and the angular loss in the vertical orientation may also be expressed in the form of a table or text, which is not specifically limited in this embodiment of the present application.

In the above description about S1101-S1104, only the specific implementation of completing the test for a group of target test sequences is described. In practice, after the tests are completed for m groups of horizontal test sequences and q groups of vertical test sequences, the angular loss of m groups of horizontal orientations corresponding to m groups of horizontal test sequences can be obtained, and q groups corresponding to q groups of vertical test sequences can be obtained Angular loss in vertical orientation.

At this point, the test audio is played through the earphones, the mobile phone obtains the test results and analyzes and calculates the test results, and finally the angle loss of the m group of horizontal orientations and the angle loss of the q group of vertical orientations can be obtained.

Subsequently, the mobile phone may use m sets of angular losses in horizontal orientations and q sets of angular losses in vertical orientations to determine the hearing model of the user.

In some embodiments, referring to FIG. 14 , the mobile phone can use m groups of angular losses in horizontal orientation as input, run the standard orientation model, and obtain the relative amplitude loss of the hearing of the user under test. The relative amplitude loss refers to the sound of each frequency, the Measure the amplitude difference (also called amplitude change) perceived by the user's left ear and right ear. And, the mobile phone can use the angular loss of q groups of vertical orientations as input, run the standard orientation model, and obtain the basic model of the user's hearing ability under test. Among them, the basic model is the lowest amplitude that the tested user can hear for the sound of each frequency without considering the relative amplitude loss. Then, the mobile phone can correct the basic model based on the relative amplitude loss to obtain the hearing model of the user under test. That is, the lowest amplitude that can be heard by the user under test for the sound of each frequency on the basis of considering the relative amplitude loss. For example, the amplitude corresponding to each frequency in the basic model (also called the first frequency, as shown in Figure 14, f1 in the basic model) (that is, the first lowest amplitude, as shown in Figure 14, a1 in the basic model) Add the amplitude deviation corresponding to the frequency in the relative amplitude loss (f1 in the relative amplitude loss shown in Figure 14) (△a1 in the relative amplitude loss shown in Figure 14), and get the frequency in the hearing model (Figure 14 The amplitude corresponding to f1) in the hearing model shown (also can be called the second lowest amplitude, such as a1+△a1 in the hearing model shown in Figure 14).

In a specific implementation manner, the mobile phone first performs fusion processing on the angular losses of m groups of horizontal azimuths, and obtains a corresponding relationship 1 in which the angular deviation of the horizontal azimuth changes with frequency changes. As shown in FIG. 13 , the angle loss of a group of horizontal orientations includes the angle deviation of each frequency. Exemplarily, the standard azimuth model may average multiple angle deviations corresponding to the same frequency among m groups of angle losses of horizontal azimuths to obtain an average value of angle deviations of sounds of corresponding frequencies. For example, in the angular loss of the horizontal orientation in the first group, the second group and the third group, the angular deviation of the measured user's voice to f1 is △dh11, △dh12 and △dh13 in turn. Then, the mobile phone can obtain the average angle deviation △dh11=(△dh11+△dh12+△dh13)/3 of the measured user's voice to f1. After obtaining the above correspondence 1, the mobile phone can input the correspondence 1 into the standard azimuth model, and the standard azimuth model can output the relative amplitude loss.

What needs to be explained so far is that if only one set of horizontal test sequences is used to determine the angular loss of horizontal orientation, only one set of angular loss of horizontal orientation will be obtained. Then, the angular loss of this set of horizontal orientation can be regarded as the corresponding relationship 1 . That is to say, if only one set of horizontal test sequences is used to obtain a set of angular losses of horizontal azimuths, the step of fusing m sets of angular losses of horizontal azimuths can be omitted.

Exemplarily, the standard orientation model can be trained as follows:

Collect multiple sets of horizontal training samples for hearing tests on normal users, and obtain a fitting model in which normal users perceive changes in horizontal orientation as the amplitude of the sound changes. Exemplarily, the multiple sets of level training samples are the aforementioned m sets of level test samples. Regarding the multiple sets of horizontal training samples, please refer to the relevant explanations about the m sets of horizontal test sequences above, and will not repeat them here.

For any set of level training samples, by playing the level training audio corresponding to the level training samples, and then receiving the perception orientation of the horizontal orientation fed back by the normal user, the initial horizontal perception orientation of the normal user to the initial sound of a certain frequency and amplitude is determined . Then, the amplitude in the group of horizontal training samples can be adjusted multiple times, and the adjusted horizontal training audio can be played after each adjustment, and then the perceived orientation of the horizontal orientation fed back by normal users can be received, so as to determine the normal user's perception of a certain frequency and adjustment. After the magnitude of the sound's horizontal perceived orientation. In this way, through a large amount of training on multiple sets of horizontal training samples, the corresponding relationship 2 (also called the first corresponding relationship) in which the normal user's horizontal perception orientation changes with the change of the sound amplitude can be obtained by fitting. For example, the correspondence 2 includes the amplitude change Δa0, and the angular deviation of the horizontal perception azimuth is Δdh1.

After obtaining the above correspondence 2, the mobile phone inputs the correspondence 1 into the standard azimuth model, and the mobile phone can determine the corresponding amplitude change in the correspondence 2 based on the angle deviation corresponding to each frequency in the correspondence 1. Therefore, the amplitude change corresponding to each frequency in the correspondence relationship 1, that is, the relative amplitude loss can be obtained.

In a specific implementation manner, the mobile phone first fuses the angle losses of q groups of vertical azimuths to obtain a corresponding relationship 3 in which the angle deviation of the vertical azimuth changes with the change of the amplitude. As shown in FIG. 13 , a set of angular losses in vertical orientations includes angular deviations of various magnitudes. Exemplarily, the standard azimuth model may calculate a weighted average of multiple angular deviations corresponding to the same magnitude in the angular losses of q groups of vertical azimuths, to obtain the mean value of the angular deviations of sounds of corresponding magnitudes. In the process of calculating the weighted average value, the weight value can be determined based on the frequencies of the spectral signals used in each group of vertical test sequences.

For example, in the vertical test sequences of Group 1, Group 2 and Group 3, spectral signals with frequencies f1, f2 and f3 are used in turn, and f2 and f3 are located in the middle frequency range to which the human ear is sensitive, that is, 1.1KHz- 3.8KHz, while f1 is lower than 1.1KHz. Then, you can set a higher weight for the angular loss of the 2nd and 3rd vertical orientations, and set a lower weight for the angular loss of the 1st vertical orientation. If in the vertical test sequences of Group 1, Group 2 and Group 3, the angular deviation of the measured user to the sound of amplitude A1 is △dv11, △dv12 and △dv13 in sequence. Then, the mobile phone can obtain the average angle deviation △dv11=△dh11*k1+△dh12*k2+△dh13*k3 of the measured user to the sound of amplitude A1, where k2 and k3 are greater than k1. After obtaining the above correspondence 3, the mobile phone can input the correspondence 3 into the standard azimuth model, and the standard azimuth model can output the basic model (also called the frequency loss model).

What needs to be explained so far is that if only one set of vertical test sequences is used to determine the angle loss of vertical orientation, only one set of angle loss of vertical orientation will be obtained, then the angle loss of this set of vertical orientation can be regarded as the corresponding relationship 3 . That is to say, if only one set of vertical test sequences is used to obtain a set of angle losses of vertical orientations, the step of fusing the angle losses of q sets of vertical orientations can be omitted. Exemplarily, the standard orientation model can be trained as follows:

Collect multiple sets of vertical training samples for hearing tests on normal users, and obtain a fitting model in which normal users perceive changes in vertical orientation as the frequency of the sound changes. Exemplarily, the multiple sets of vertical training samples are the aforementioned q sets of vertical test samples. For multiple sets of vertical training samples, please refer to the relevant description about q sets of vertical test sequences above, and will not repeat them here.

For any set of vertical training samples, by playing the vertical training audio corresponding to the vertical training samples, and then receiving the perception orientation of the vertical orientation fed back by the normal user, the initial vertical perception orientation of the normal user to the initial sound of a certain frequency and amplitude is determined . Then, the frequency of the group of vertical training sample spectrum signals can be adjusted multiple times, and the adjusted training audio is played after each adjustment, and then the perception orientation of the vertical orientation fed back by the normal user is received, so as to determine the normal user's perception of a certain frequency and adjustment. Perceived orientation after the level of the frequency of the sound. In this way, through a large amount of training on multiple sets of vertical training samples, the corresponding relationship 4 (also called the second corresponding relationship) in which the normal user's vertical perception orientation changes with the frequency of the sound can be fitted by fitting. For example, the correspondence 4 includes the frequency change Δf, such as changing to f0+Δf, the angular deviation of the vertical perception azimuth is Δdv1.

After obtaining the above correspondence 4, the mobile phone inputs the correspondence 3 into the standard azimuth model, and the mobile phone can determine the corresponding frequency in the correspondence 4 based on the angle deviation corresponding to each amplitude in the correspondence 3. Thus, the frequency of each amplitude in the corresponding relationship 3 can be obtained. That is, a basic model including the second lowest amplitude of sound of each frequency that the user can perceive is obtained.

The user under test in the current test may be a hearing-impaired user, and the amplitude loss in hearing may interfere with the measurement of the angular loss in the vertical orientation. Based on this, in some embodiments, before testing the angle loss of the vertical orientation, before S1101 shown in FIG. Absolute amplitude loss and second absolute amplitude loss in the right ear. Then, in the process of testing the angle loss of the vertical azimuth, the first absolute amplitude loss and the second absolute amplitude loss can be smoothed out, so that the process of testing the angle of the vertical azimuth will not be disturbed by the amplitude loss.

Referring to Figure 15, the process of testing the first absolute magnitude loss includes:

S1501. The mobile phone determines a reference range.

Wherein, the reference amplitude is the initial amplitude for testing the first absolute amplitude loss.

It can test the normal user's hearing of sounds with different amplitudes within the preset frequency range, and determine the lowest audible range of the normal user within the preset frequency range. The mobile phone can use the lowest audible amplitude of a normal user within the preset frequency range as the reference amplitude.

Exemplarily, since the human ear is most sensitive to intermediate frequency signals of 1.1KHz-3.8KHz, the preset frequency range can be set within 1.1KHz to 3.8KHz.

S1502. The mobile phone sends a test signal within a preset frequency range and an amplitude j to the left earbud, and j gradually increases from the reference amplitude.

Exemplarily, the reference amplitude is A0, the mobile phone first sends a test signal within the preset frequency range and the amplitude is A0 to the left earbud for the first time; the second time the mobile phone sends a test signal within the preset frequency range and the amplitude is A0 +1 for the test signal.

S1503. The left earplug plays the audio corresponding to the test signal.

S1504. The mobile phone receives hearing feedback from the user under test, and the hearing feedback includes two types of hearing feedback and hearing feedback.

After the left earbud plays the audio corresponding to the test signal, if the user under test can hear it, he can report that he can hear it; if he can’t hear it, he can feedback that he can’t hear it. For example, after the mobile phone detects that the user under test selects the "Yes" option in the interface 1601 shown in Figure 16, the mobile phone can start to test the absolute loss, and after each test signal is sent, the mobile phone can display the test signal shown in Figure 16. interface 1602, the interface 1602 includes a prompt "Do you hear the sound played by the left earbud", which is used to prompt the user under test to input hearing feedback. And, the interface 1602 also includes two options of "can hear" and "can't hear", which are used to select the hearing feedback result.

S1505. The mobile phone determines whether the left ear can hear the sound with amplitude j based on the hearing feedback. If not, continue to execute S1502; if yes, execute S1506.

If it cannot be heard, it means that the user under test has hearing loss to the sound of the current amplitude j, and needs to continue to perform S1502 and its subsequent steps, and continue testing for the test signal whose amplitude j is j+1 until it is determined that the user under test can hear the sound. to the extent. If it can be heard, it means that the user under test has no force loss to the sound of the current amplitude j, and then execute S1506 to determine the first absolute amplitude loss.

S1506. The mobile phone determines the difference between the reference amplitude and j as the first absolute amplitude loss.

Exemplarily, the reference amplitude is A0, and the current j=A0+2, then it can be determined that the first absolute amplitude loss is -2dB.

The foregoing only illustrates the specific implementation of determining the first absolute amplitude loss, and the same is true for the process of determining the second absolute amplitude loss in practice. The only caveat: During the process of determining the second absolute amplitude loss, the phone needs to send a test signal to the right earbud and play the test signal from the right earbud.

Exemplarily, in the process of testing the first absolute amplitude loss in the manner shown in FIG. 15 above, the hearing feedback of the user under test is shown in the column “Test the left ear of the user under test” in FIG. 17 . That is, the lowest amplitude that can be heard by the left ear is 2dB higher than the reference amplitude. In other words, the hearing of the left ear is 2dB worse than that of normal users, and the first absolute amplitude loss is -2dB. And, in the process of testing the second absolute amplitude loss in a manner similar to that shown in FIG. 15 above, the hearing feedback of the user under test is shown in the column “Testing the right ear of the user under test” in FIG. 17 . That is, the lowest amplitude that can be heard by the right ear is 3dB higher than the reference amplitude. In other words, the right ear hearing is 3dB worse than normal users, and the second absolute magnitude loss is -3dB.

After obtaining the first absolute amplitude loss and the second absolute amplitude loss, see FIG. 18, before S1101 shown in FIG. 11 above, it also includes:

S1801. The mobile phone updates q sets of vertical test sequences based on the first absolute amplitude loss and the second absolute amplitude loss to obtain updated q sets of vertical test sequences. Each updated set of vertical test sequences includes a left ear test sequence and a right ear test sequence.

For any set of vertical test sequences, the mobile phone can subtract the first absolute amplitude loss from the amplitudes of multiple vertical test samples included in the set of vertical test sequences to obtain a set of vertical test sequences (including a variety of left ear test signal); and, subtracting the second absolute amplitude loss from the amplitudes of a plurality of vertical test samples included in the set of vertical test sequences to obtain another set of vertical test sequences for testing the right ear (including a variety of right ear test signal). That is, a set of vertical test sequences can be updated to obtain two sets of vertical test sequences for left ear and right ear tests respectively (which can be referred to as a set of left ear test sequences and a set of right ear test sequences). That is, the updated set of vertical test sequences includes two sub-test sequences.

Exemplarily, the first group of vertical test sequences sequentially includes vertical test samples with amplitudes A1, A2 and A3, and the first absolute amplitude loss is -2dB, and the second absolute amplitude loss is -3dB, then the obtained first group The vertical test sequence pair includes the following two sub-test sequences:

Left ear test sequence, including vertical test samples with amplitudes A1+2dB, A2+2 dB and A3+2 dB in turn;

Right ear test sequence, including vertical test samples with amplitudes A1+3dB, A2+3dB and A3+3dB in sequence.

After S1801, corresponding to q sets of vertical test sequences, q sets of updated vertical left test sequences can be obtained, and each updated set of vertical test sequences includes two sub-test sequences.

Continue to refer to Figure 18, S1101 shown in Figure 11 is specifically:

S1101', the mobile phone sends the kth group of target test sequences to the earphone, the kth group of target test sequences is any group of test sequences in the m group of horizontal test sequences and the updated q group of vertical test sequences, and k is from 1, 2, 3 ...... The values in m+q are taken sequentially.

Different from the above S1101, if the kth group of target test sequences is an updated set of vertical test sequences, then the kth group of target test sequences includes left ear test sequences and right ear test sequences. Then, if the k-th group of target test sequences is an updated set of vertical test sequences, the earphone needs to send the left ear test sequence included in the k-th group of target test sequences to the left earbud, and send the k-th group of target test sequences to the right earbud. right ear test sequence.

Continue to refer to Figure 18, S1102 shown in Figure 11 is specifically:

S1102', the earphone plays the test audio k corresponding to the k-th group of target test sequences; wherein, if the k-th group of target test sequences is an updated set of vertical test sequences, the left earplug plays the test audio k1 corresponding to the left ear test sequence, The right earbud plays the test audio k2 corresponding to the right ear test sequence.

In this way, the mobile phone can smooth out the absolute loss of the amplitude of the two ears to avoid interference with the vertical test.

Furthermore, in this embodiment, since the absolute loss of the amplitude of both ears is smoothed out during the vertical test. Then, in the subsequent process of determining the hearing model, it is necessary to make up for the absolute loss of amplitude, so as to improve the accuracy of the determined hearing model. Exemplarily, the difference from the process of determining the hearing model shown in Figure 14 above is not: see Figure 19 (the difference is mainly in the bold rectangle box in Figure 19), in this embodiment, the mobile phone is based on the standard orientation After the relative magnitude loss is obtained by the model, the relative magnitude loss can be corrected by combining the first absolute magnitude loss and the second absolute magnitude loss. Exemplarily, the difference between the absolute amplitude loss of the left ear and the right ear can be calculated, and the amplitude difference corresponding to each frequency (also called the second frequency) in the relative amplitude loss (also called the first amplitude difference value) plus the difference of the absolute amplitude loss to obtain the amplitude difference (also called the second amplitude difference) corresponding to the corresponding frequency (ie, the second frequency) in the binaural amplitude loss. For example, the first absolute amplitude loss is -2dB, and the second absolute amplitude loss is -3dB, then the difference of absolute amplitude loss is -2-(-3)dB=1dB, and the amplitude difference corresponding to frequency f1 in relative amplitude loss is △a1, then adding 1 to △a1 can get the amplitude difference corresponding to frequency f1 in binaural amplitude loss, that is, △a1+1. Subsequently, when the hearing model is fused, the binaural amplitude loss is fused with the basic model instead of the relative amplitude loss and the basic model. For example, in the hearing model shown in Figure 19, the amplitude corresponding to the frequency f1 is the sum of the amplitude a1 corresponding to the frequency f1 in the basic model and the amplitude loss △a1+1 corresponding to the frequency f1 in the binaural amplitude loss, that is, a1+△a1+1 .

The embodiment of the present application also provides an electronic device, and the electronic device may include: a memory and one or more processors. The memory and processor are coupled. The memory is used to store computer program code comprising computer instructions. When the processor executes the computer instructions, the electronic device can execute various functions or steps performed by the mobile phone in the foregoing method embodiments.

The embodiment of the present application also provides a chip system, as shown in FIG. 20 , the chip system 2000 includes at least one processor 2001 and at least one interface circuit 2002 . The processor 2001 and the interface circuit 2002 can be interconnected through lines. For example, interface circuit 2002 may be used to receive signals from other devices, such as memory of an electronic device. For another example, the interface circuit 2002 may be used to send signals to other devices (such as the processor 2001). Exemplarily, the interface circuit 2002 can read instructions stored in the memory, and send the instructions to the processor 2001 . When the instructions are executed by the processor 2001, the electronic device can be made to perform various steps performed by the mobile phone in the foregoing embodiments. Of course, the chip system may also include other discrete devices, which is not specifically limited in this embodiment of the present application.

This embodiment also provides a computer-readable storage medium, where computer instructions are stored in the computer-readable storage medium, and when the computer instructions are run on the electronic device, the electronic device is made to perform the various functions performed by the mobile phone in the above method embodiments or steps.

This embodiment also provides a computer program product. When the computer program product is run on a computer, the computer is made to execute various functions or steps performed by the mobile phone in the above method embodiments.

In addition, an embodiment of the present application also provides a device, which may specifically be a chip, a component or a module, and the device may include a connected processor and a memory; wherein the memory is used to store computer-executable instructions, and when the device is running, The processor can execute the computer-executable instructions stored in the memory, so that the chip executes various functions or steps performed by the wristwatch in the above-mentioned method embodiments, so as to realize the estimation of physical age.

Among them, the electronic equipment, communication system, computer-readable storage medium, computer program product or chip provided in this embodiment are all used to execute the corresponding method provided above, therefore, the beneficial effects it can achieve can refer to the above The beneficial effects of the provided corresponding method will not be repeated here.

Through the description of the above embodiments, those skilled in the art can clearly understand that for the convenience and brevity of the description, only the division of the above-mentioned functional modules is used as an example for illustration. In practical applications, the above-mentioned functions can be allocated according to needs It is completed by different functional modules, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above.

In the several embodiments provided in this application, it should be understood that the disclosed devices and methods may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined Or it can be integrated into another device, or some features can be omitted, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.

The unit described as a separate component may or may not be physically separated, and a component displayed as a unit may be one physical unit or multiple physical units, that is, it may be located in one place, or may be distributed to multiple different places. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.

If the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the software product is stored in a storage medium Among them, several instructions are included to make a device (which may be a single-chip microcomputer, a chip, etc.) or a processor (processor) execute all or part of the steps of the methods in the various embodiments of the present application. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program codes. .

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application without limitation. Although the present application has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present application can be Make modifications or equivalent replacements without departing from the spirit and scope of the technical solutions of the present application.

Claims (17)

1. A method for determining hearing model, characterized in that it is applied to electronic equipment, including: Play level test audio, the level test audio includes a variety of first sound signals with different frequencies and horizontal orientations but the same amplitude; receiving a user-feedback level test result, the level test result including the user's level perception orientation of the various first sound signals; Playing vertical test audio, the vertical test audio includes a variety of second sound signals with different amplitudes and vertical orientations but the same spectrum signal; receiving a vertical test result fed back by the user, the vertical test result including the user's vertical perception orientation of the plurality of second sound signals; A hearing model of the user is obtained based on the horizontal test result and the vertical test result, the hearing model includes the first lowest amplitude of the sound signal of each frequency that the user can perceive, and the hearing model is used for hearing compensation. 2. The method according to claim 1, wherein the playing level test audio comprises: Playing the level test audio through an earphone connected to the electronic device; The playing vertical test audio includes: Play the vertical test audio through the earphone. 3. The method according to claim 2, wherein the method further comprises: Obtaining a first feedforward signal collected by a feedforward microphone in the left earplug of the earphone, and obtaining a second feedforward signal collected by a feedforward microphone in the right earplug of the earphone; The playing the horizontal test audio through the earphone connected to the electronic device, and the playing the vertical test audio through the earphone include: When the first feed-forward signal is less than the first threshold and the second feed-forward signal is less than the first threshold, play the level test audio through the earphone connected to the electronic device, and pass The earphone plays the vertical test audio. 4. method according to claim 3, is characterized in that, described method also comprises: Obtain a first feedback signal collected by the feedback microphone in the left earplug, and obtain a second feedback signal collected by the feedback microphone in the right earplug; The playing the horizontal test audio through the earphone connected to the electronic device, and the playing the vertical test audio through the earphone include: When the difference between the first feedforward signal and the first feedback signal is greater than a second threshold, and the difference between the second feedforward signal and the second feedback signal is greater than a second threshold, by An earphone connected to the electronic device plays the horizontal test audio, and plays the vertical test audio through the earphone. 5. The method according to claim 2, characterized in that the method further comprises: Sending the same preset audio to the left earplug and the right earplug of the earphone, the preset audio is used to test the hardware difference between the speaker of the left earplug and the speaker of the right earplug; Obtain a third feedback signal collected by the feedback microphone in the left earplug, and obtain a fourth feedback signal collected by the feedback microphone in the right earplug, where the third feedback signal includes that the speaker of the left earplug plays the preview Assuming an audio result, the fourth feedback signal includes a result of playing the preset audio by the speaker of the right earplug; determining calibration coefficients for aligning the third feedback signal and the fourth feedback signal; sending the calibration coefficient to the first earplug, the first earplug being the left earplug or the right earplug; The playing the horizontal test audio through the earphone connected to the electronic device, and the playing the vertical test audio through the earphone include: Play the calibrated level test audio after the level test audio is calibrated by using the calibration coefficient through the first earplug, and play the uncalibrated level test audio through the second earplug; and, Play the calibrated vertical test audio after calibrating the vertical test audio by using the calibration coefficient through the first earplug, and play the uncalibrated vertical test audio through the second earplug; Wherein, the second earplug is an earplug other than the first earplug among the left earplug and the right earplug. 6. The method according to any one of claims 2-5, wherein said obtaining the hearing model of the user based on said horizontal test result and vertical test result comprises: Determine the horizontal angle loss of the user's hearing based on the level test result, the horizontal angle loss includes the user's angular deviation of the horizontal perception orientation of the sound signal of each frequency; Determining the vertical angle loss of the user's hearing based on the vertical test results, the vertical angle loss including the user's angular deviation of the vertical perception orientation of the sound signal of each amplitude; A hearing model for the user is calculated based on the horizontal angular loss and the vertical angular loss. 7. The method according to claim 6, wherein the electronic device includes a first corresponding relationship and a second corresponding relationship, the first corresponding relationship includes the variation of amplitude and the response of people without hearing loss to sound signals The corresponding relationship between the change of the horizontal perception orientation, the second correspondence includes the correspondence between the change of the frequency and the change of the vertical perception orientation of the sound signal by the crowd without hearing loss; The calculating the hearing model of the user based on the horizontal angle loss and the vertical angle loss includes: Based on the first correspondence, the horizontal angle loss is converted into a relative amplitude loss of both ears of the user, and the relative amplitude loss includes a sound signal of each frequency, and an amplitude difference perceived by the user's left ear and right ear; Based on the second corresponding relationship, the vertical angle loss is converted into a frequency loss model of the user's ears, and the frequency loss model includes the second lowest amplitude of the sound signal of each frequency that the user can perceive; The hearing model is obtained by modifying the frequency loss model based on the relative amplitude loss. 8. The method according to claim 7, wherein the modifying the frequency loss model based on the relative amplitude loss to obtain the hearing model comprises: adding the first lowest amplitude corresponding to the first frequency in the frequency loss model to the amplitude difference corresponding to the first frequency in the relative amplitude loss to obtain the first minimum amplitude corresponding to the first frequency in the hearing model 2. the lowest range; Wherein, the first frequency is any frequency included in the frequency loss model. 9. The method according to claim 6, further comprising: Subtracting the first absolute amplitude loss from the amplitudes of the multiple second sound signals in the vertical test audio to obtain multiple left ear test signals; The amplitudes of the various second sound signals are subtracted from the second absolute amplitude loss to obtain various right ear test signals, and the various left ear test signals and the various right ear test signals constitute the updated vertical test audio; Wherein, the first absolute amplitude loss is the difference between the lowest audible amplitude and the lowest audible amplitude audible to the user's left ear within the preset frequency band without hearing loss, and the second absolute amplitude loss is The difference between the lowest audible amplitude for people without hearing loss within the preset frequency range and the lowest audible amplitude for the user's right ear; The playing the vertical test audio through the earphone includes: The various left ear test signals are played through the left earplug of the earphone, and the various right ear test signals are played through the right earplug of the earphone. 10. The method according to claim 9, wherein the electronic device includes a first corresponding relationship and a second corresponding relationship, and the first corresponding relationship includes the variation of amplitude and the response of people without hearing loss to sound signals. The corresponding relationship between the change of the horizontal perception orientation, the second correspondence includes the correspondence between the change of the frequency and the change of the vertical perception orientation of the sound signal by the crowd without hearing loss; The calculating the hearing model of the user based on the horizontal angle loss and the vertical angle loss includes: Based on the first correspondence, the horizontal angle loss is converted into a relative amplitude loss of both ears of the user, and the relative amplitude loss includes a sound signal of each frequency, and an amplitude difference perceived by the user's left ear and right ear; correcting the relative amplitude loss based on the first absolute amplitude loss and the second absolute amplitude loss to obtain a binaural amplitude loss; Based on the second corresponding relationship, the vertical angle loss is converted into a frequency loss model of the user's ears, and the frequency loss model includes the second lowest amplitude of the sound signal of each frequency that the user can perceive; The hearing model is obtained by modifying the frequency loss model based on the binaural amplitude loss. 11. The method according to claim 10, wherein the modifying the relative amplitude loss based on the first absolute amplitude loss and the second absolute amplitude loss to obtain a binaural amplitude loss comprises: In the relative amplitude loss, the first amplitude difference corresponding to the second frequency is added to the difference between the first absolute amplitude loss and the second absolute amplitude loss to obtain the first amplitude difference in the binaural amplitude loss The second amplitude difference corresponding to the two frequencies. 12. The method according to claim 1, characterized in that, after the user's hearing model is obtained based on the horizontal test result and the vertical test result, the method further comprises: The sound signal of the third frequency in the audio to be played is raised to a preset amplitude and then played, the third frequency is any frequency of the sound signal included in the audio to be played, and the preset amplitude is set in the hearing model. The difference between the first lowest amplitude corresponding to the third frequency and the third lowest amplitude that people without hearing loss can hear the sound signal of the third frequency. 13. The method according to claim 1, wherein the level test audio comprises a first level test audio and a second level test audio, and a plurality of first sound signals appearing successively in the first level test audio The sequence of the corresponding multiple frequencies is not exactly the same as the sequence of the multiple frequencies corresponding to the multiple first sound signals sequentially appearing in the second horizontal test audio. 14. The method according to claim 1, wherein the vertical test audio comprises a first vertical test audio and a second vertical test audio, and multiple second sound signals appearing in sequence in the first vertical test audio The sequence of the corresponding multiple amplitudes is not exactly the same as the sequence of the multiple amplitudes corresponding to the multiple second sound signals appearing sequentially in the second vertical test audio. 15. An electronic device, characterized in that the electronic device includes a memory and one or more processors; the memory is coupled to the processor; the memory is used to store computer program code, and the computer program code comprising computer instructions, which, when executed by the processor, cause the electronic device to execute the method according to any one of claims 1-14. 16. A computer-readable storage medium, with instructions stored in the computer-readable storage medium, characterized in that, when the instructions are run on an electronic device, the electronic device is made to perform the steps described in claims 1-14. any one of the methods described. 17. A communication system, characterized in that the communication system comprises an electronic device for performing the method according to any one of claims 1-14, and an earphone for playing test audio.

Images