CN112291689B - Sound playback method, wearable device and readable storage medium - Google Patents

Abstract

The invention discloses a sound playing method, wearable equipment and a readable storage medium, wherein the sound playing method is used for the wearable equipment, the wearable equipment comprises a loudspeaker, and the sound playing method comprises the following steps: transmitting a detection wave to the human ear, and recording the transmission time, wherein the detection wave is reflected after encountering the human ear; receiving the reflected detection wave, recording the receiving time, and obtaining the distance between the loudspeaker and the human ear according to the transmitting time and the receiving time; determining an adjusting parameter according to the distance between the loudspeaker and the human ear; and adjusting the audio signal of the loudspeaker according to the adjusting parameter. The technical scheme of the invention can adjust the playing audio under the condition that the distances between the loudspeaker and the ears are different, so that the playing of the sound reaches an ideal state.

Description

Sound playback method, wearable device and readable storage medium

technical field

The present invention relates to the technical field of sound playback, and in particular, to a sound playback method, a wearable device and a readable storage medium.

Background technique

A wearable device is an electronic device that can be worn on the user's body. When different people wear it, there will be differences in the wearing state, such as the size of the human head. The wearable device is provided with a speaker, and the distance between the speaker and the ear is different for different users due to the difference in body shape, which makes it difficult for the sound playback to reach an ideal state.

SUMMARY OF THE INVENTION

Based on this, in view of the problem that the distance between the speaker and the ear is different due to the difference in shape, it is difficult to achieve the ideal state of sound playback. It is necessary to provide a sound playback method, a wearable device and a readable storage medium. When the distance between the speaker and the ear is different, adjust the playback audio so that the sound playback can reach the ideal state.

In order to achieve the above object, the present invention proposes a sound playing method, which is used in a wearable device, the wearable device includes a speaker, and the sound playing method includes:

Send a probe wave to the human ear, and record the launch time, wherein the probe wave is reflected after encountering the human ear;

Receive the reflected probe wave, record the receiving time, and obtain the distance between the speaker and the human ear according to the transmitting time and the receiving time;

Determine the adjustment parameter according to the distance between the speaker and the human ear;

The audio signal of the speaker is adjusted according to the adjustment parameter.

Optionally, the human ear includes an external auditory canal;

The step of obtaining the distance between the loudspeaker and the human ear according to the transmitting time and the receiving time includes:

Obtain the near-point distance and far-point distance between the speaker and the auricle of the human ear according to the transmitting time and the receiving time;

The distance between the speaker and the entrance of the external auditory canal of the human ear is calculated according to the near point distance and the far point distance.

Optionally, the wearable device includes a sound pickup microphone, the sound pickup microphone is disposed adjacent to the speaker, and the detection wave includes ultrasonic waves;

The described steps of transmitting probe waves to the human ear and recording the launch time include:

control the speaker to emit ultrasonic waves, and record the emission time of the ultrasonic waves;

The steps of receiving the reflected probe wave and recording the receiving time include:

The pickup microphone is controlled to receive the reflected ultrasonic waves, and the receiving time of the reflected ultrasonic waves is recorded.

Optionally, the described launch probe wave to the human ear, and the step of recording the launch time, also includes:

According to the preset time, the detection wave is periodically emitted to the human ear, and the emission time is recorded.

Optionally, the step of determining the adjustment parameter according to the distance between the speaker and the human ear includes:

Comparing the distance between the speaker and the human ear with a preset distance to generate a comparison result, wherein the preset distance includes a plurality of preset distances, and different preset distances correspond to different adjustment parameters;

The adjustment parameter corresponding to the preset distance is retrieved according to the comparison result.

Optionally, after the step of comparing the distance between the speaker and the human ear and the preset distance, the method includes:

If the distance between the speaker and the human ear is greater than the maximum value of the preset distance, the user is prompted to check the position state of the wearable device.

Optionally, after the step of comparing the distance between the speaker and the human ear with a preset distance, the method further includes:

If the distance between the speaker and the human ear is greater than the maximum value of the preset distance, and the difference between the distance between the speaker and the human ear and the value of the preset distance exceeds a preset threshold, cut off the audio of the speaker Signal.

Optionally, a plurality of the preset distances are set at equal intervals in sequence from small to large.

In addition, in order to achieve the above object, the present invention also provides a wearable device, the wearable device includes: a memory, a processor, and a sound playback program stored in the memory and running on the processor; When the sound playing program is executed by the processor, the steps of the above-mentioned sound playing method are realized.

In addition, in order to achieve the above purpose, the present invention also provides a readable storage medium, on which a sound playback program is stored, and when the sound playback program is executed by a processor, the sound playback method as described above is implemented A step of.

In the technical solution proposed by the present invention, when the user uses the wearable device, the wearing position is different, and the distance between the speaker and the human ear is far or near. The probe wave is emitted to the human ear, and the probe wave is reflected after encountering the human ear. By recording the emission time and reception time, the distance between the speaker and the human ear is obtained, and then the adjustment parameters of the speaker are determined through this distance. The audio signal of the speaker is adjusted according to the adjustment parameters, so that the user can receive clear audio and the sound playback can reach an ideal state.

Description of drawings

In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention, and for those of ordinary skill in the art, other drawings can also be obtained according to the structures shown in these drawings without creative efforts.

1 is a schematic flowchart of a first embodiment of a sound playback method according to the present invention;

2 is a schematic flowchart of a second embodiment of a sound playback method according to the present invention;

3 is a schematic flowchart of a third embodiment of a sound playback method according to the present invention;

4 is a schematic structural diagram of a wearable device worn by a user in the present invention;

5 is a schematic flowchart of a fourth embodiment of a sound playback method according to the present invention;

6 is a schematic flowchart of a fifth embodiment of a sound playback method according to the present invention;

7 is a schematic flowchart of a sixth embodiment of a sound playback method according to the present invention;

FIG. 8 is a schematic flowchart of a seventh embodiment of a sound playing method according to the present invention.

The realization, functional characteristics and advantages of the present invention will be further described with reference to the accompanying drawings in conjunction with the embodiments.

Detailed ways

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

When the user uses the wearable device, the size of the human body is different, which will lead to differences in the wearing state, and the distance between the speaker and the human ear will be different, making it difficult for the sound playback to reach the ideal state. clear.

In order to solve the above problems, referring to FIG. 1, a first embodiment of the present invention is proposed. The present invention provides a sound playback method, which is used in a wearable device, and the wearable device includes a headset, and also includes VR (VirtualReality, Virtual reality) display devices, and may also include AR (Augmented Reality) display devices. Wearable devices include speakers, also known as horns. Sound playback methods include:

In step S10, a detection wave is transmitted to the human ear, and the emission time is recorded, wherein the detection wave is reflected after encountering the human ear; a detection wave generator is provided in the wearable device, and the detection wave is transmitted through the detection wave generator, and the detection wave is generated in the detection wave. While the generator emits the probe wave, the emission time is recorded. The detection wave can be a light wave or a sound wave. When light waves meet human ears, diffuse reflection occurs. Sound waves are mechanical waves. Sound waves can also be reflected when they meet human ears. The wearable device is provided with a processor, which controls the emission of detection waves and records the emission time.

Step S20: Receive the reflected detection wave, record the reception time, and obtain the distance between the speaker and the human ear according to the transmission time and the reception time; the wearable device is provided with a detection wave receiver, and the reflected detection wave is received through the receiver. After that, record the reception time. During the propagation of the sounding wave, the propagation speed is fixed. By calculating the time difference between the transmitting time and the receiving time, the propagation distance of the sounding wave is calculated by multiplying the time difference and the propagation speed. Since the detection wave propagates back and forth between the wearable device and the human ear, divide the propagation distance by two to obtain the distance between the wearable device and the human ear. The detection wave receiver and the speaker are located close to each other, and the distance between the wearable device and the human ear can be understood as the distance between the speaker and the human ear.

In step S30, the adjustment parameter is determined according to the distance between the speaker and the human ear; when the user uses the wearable device, the distance between the speaker and the human ear is also different depending on the wearing position of the user. By adjusting the audio signal at different distance positions, users get clear sound. And record the adjustment parameters at different distances to make the sound clear, and store the adjustment parameters corresponding to the distance. The distance between the speaker and the human ear and the adjustment parameters are in one-to-one correspondence. After the distance between the speaker and the human ear is calculated in step S20, a uniquely determined adjustment parameter can be found according to the distance value.

Step S40, adjust the audio signal of the speaker according to the adjustment parameter. After the adjustment parameter is determined, the audio signal of the speaker is adjusted according to the adjustment parameter, so that the user can quickly obtain a clear audio signal under the distance between the speaker and the human ear.

In the technical solution proposed in this embodiment, when the user uses the wearable device, the wearing position is different, and the distance between the speaker and the human ear is far or near. The probe wave is emitted to the human ear, and the probe wave is reflected after encountering the human ear. By recording the emission time and reception time, the distance between the speaker and the human ear is obtained, and then the adjustment parameters of the speaker are determined through this distance. The audio signal of the speaker is adjusted according to the adjustment parameters, so that the user can receive clear audio and the sound playback can reach an ideal state.

Referring to FIG. 2 , on the basis of the first embodiment of the present invention, a second embodiment of the present invention is proposed. The human ear includes the external auditory canal, the user's answering sound is mainly transmitted through the external auditory canal, and the sound is transmitted through the entrance of the external auditory canal. cochlea.

The steps of obtaining the distance between the speaker and the human ear according to the transmitting time and the receiving time include:

Step S201, obtain the near point distance and far point distance between the speaker and the auricle of the human ear according to the transmitting time and the receiving time; the shape and structure of the human ear are complex, the surrounding structure of the human ear forms the auricle, and the external auditory canal is located inside the auricle. When the user wears the wearable device, the position of the speaker is far from the auricle, that is, the near point distance between the speaker and the auricle of the human ear, and the far point distance between the speaker and the auricle of the human ear.

Step S202: Calculate the distance between the speaker and the entrance of the external auditory canal of the human ear according to the near point distance and the far point distance. In order to accurately obtain the distance between the speaker and the entrance of the external auditory canal of the human ear, the near point distance and the far point distance are added and summed, and then the average value is calculated. This average value is understood as the entrance between the speaker and the external auditory canal of the human ear. the distance between. When measuring the distance, the sounding wave generator is aimed at the human ear and launched. In order to make the calculation result more accurate, multiple near-point distances and multiple far-point distances can also be measured. Averaging is performed multiple times to improve detection accuracy.

Referring to FIG. 3 , based on the first embodiment of the present invention, a third embodiment of the present invention is proposed. Referring to FIG. 4 , a schematic diagram of a wearable device 20 worn by a user 10 is shown. The wearable device 20 includes a sound pickup. The microphone 210 and the sound pickup microphone 210 are arranged adjacent to the speaker 220 . FIG. 4 also shows a schematic diagram of the speaker 220 transmitting ultrasonic waves to the proximal point of the auricle 110 and transmitting ultrasonic waves to the far point of the auricle 110 . Probe waves include ultrasonic waves. The frequency range of the sound that the human ear can pick up is 20Hz to 20000Hz, and the human ear cannot pick up the sound when it exceeds this range. At frequencies greater than 20000Hz, it is in the ultrasonic range. Through ultrasonic detection, it can avoid interfering with the normal listening of external sounds by the human ear during the detection process.

The steps of launching a probe wave to the human ear and recording the launch time include:

Step S110, control the speaker to emit ultrasonic waves, and record the emission time of the ultrasonic waves;

The steps of receiving the reflected probe wave and recording the time of reception include:

Step S210, controlling the sound pickup microphone to receive the reflected ultrasonic waves, and recording the receiving time of the reflected ultrasonic waves. The speaker is a component that emits sound waves. Using the speaker to emit ultrasonic waves can make full use of the electronic components already installed in the wearable device, thereby saving the space and cost of installing additional components. In addition, it can be known that, in this embodiment, the probe wave generator refers to a speaker. The pickup microphone receives sound waves through the pickup function, and the time when the speaker emits ultrasonic waves is recorded as the transmitting time, and the time when the pickup microphone receives the ultrasonic waves is the receiving time. A timing unit is set in the wearable device, the timing unit records the transmission time and the reception time, and transmits the transmission time and the reception time to the processor, and the processor obtains the near-point distance and the far-point distance through calculation. It should be pointed out that when calculating the near-point distance and far-point distance, the transmission time of the two is the same, but the reception time is different. That is, the short receiving time is used to calculate the near point distance, and the long receiving time is used to calculate the far point distance.

Referring to shown in Figure 5, on the basis of the first embodiment of the present invention, the fourth embodiment of the present invention is proposed, and the detection wave is emitted to the human ear, and the step of recording the emission time, also includes:

Step S101 , according to a preset time, the detection wave is periodically transmitted to the human ear, and the transmission time is recorded. That is, the probe wave is sent in the form of a pulse wave. When the user wears the wearable device, there will be a movement of the head or movement, which will cause the distance between the speaker and the human ear to change. In order to continuously ensure that the human ear can obtain clear sound, the distance between the speaker and the human ear needs to be adjusted frequently. For example, the preset time is 1 second, and every 1 second, the detection wave is emitted to the human ear. Through this regular emission of the detection wave to the human ear, the audio signal of the speaker can be adjusted in time and accurately, thereby ensuring that the user can obtain better sound quality. good sound quality.

Referring to FIG. 6 , on the basis of the above-mentioned embodiments of the present invention, a fifth embodiment of the present invention is proposed, and the steps of determining adjustment parameters according to the distance between the speaker and the human ear include:

Step S310, compare the distance between the speaker and the human ear and the preset distance, and generate a comparison result, wherein the preset distance includes a plurality of preset distances, and different preset distances correspond to different adjustment parameters;

In step S320, the adjustment parameters corresponding to the preset distance are retrieved according to the comparison result. When the user uses the speaker, the wearing position is different, and the parameters that need the speaker to play sound are also different. For example, when the speaker is closer to the human ear, the volume of the sound to be played is lower, and when the speaker is farther from the human ear, the volume of the sound to be played is higher. To this end, a plurality of different adjustment parameters are set in the wearable device, and each adjustment parameter corresponds to a preset distance. After comparing the distance between the speaker and the human ear with the preset distance, find the preset distance value that matches the distance between the speaker and the human ear and the preset distance, and then retrieve the saved adjustment parameters through the preset distance value. . Wherein, the distance between the speaker and the human ear may be equal to the preset distance, or the preset distance may be a range value, and the speaker is within this range value.

Referring to FIG. 7 , on the basis of the fifth embodiment of the present invention, a sixth embodiment of the present invention is proposed. After the step of comparing the distance between the speaker and the human ear and the preset distance, the steps include:

Step S311 , if the distance between the speaker and the human ear is greater than the maximum preset distance, the user is prompted to check the position state of the wearable device. The speaker in the wearable device emits sound waves. Since the sound waves are mechanical waves, the energy of the sound waves gradually decreases during the transmission process. As a result, the distance between the user's human ear and the speaker exceeds a certain range, and the human ear cannot hear the sound clearly. When the user's wearing position is incorrect and the distance between the speaker and the human ear is too large, a prompt needs to be issued to the user, thereby further ensuring the validity of the sound. The prompts can be voice prompts, vibration prompts, or music prompts. After the user checks the position of the wearable device and adjusts it correctly, an adjustment completion prompt can be issued. For example, it can be set that the maximum preset distance is 10 cm, and when it is detected that the distance between the speaker and the human ear is greater than 10 cm, the user is prompted to check the position of the wearable device.

In addition, a safe distance can also be set. In order to reduce the speaker's misjudgment of the position of the human ear and the possibility of the speaker taking the peripheral object as the human ear, only the measured value within the safe distance can be understood as the distance between the speaker and the human ear.

Referring to FIG. 8 , on the basis of the sixth embodiment of the present invention, a seventh embodiment of the present invention is proposed. After the step of comparing the distance between the speaker and the human ear and the preset distance, it further includes:

Step S312, if the distance between the speaker and the human ear is greater than the maximum preset distance, and the difference between the distance between the speaker and the human ear and the value of the preset distance exceeds the preset threshold, cut off the audio signal of the speaker. When a user uses a wearable device, the wearable device needs to be removed in some cases. For example, when a user communicates with a person, in order to show respect, the wearable device needs to be removed. At this time, the wearable device is in normal operation, and the speaker is still playing sound, which is easy to cause power loss. After the user takes off the wearable device, the position of the speaker and the user's human ear will gradually increase. Calculate the difference between the distance between the speaker and the human ear and the preset distance, and compare the difference with the preset threshold. If it is less than the preset threshold, the speaker will continue to operate normally. If it exceeds the preset threshold, turn off the wearable device. The power supply, and then cut off the audio signal of the speaker, reduce power loss. The preset threshold can be changed and set according to the user's needs. For example, the preset threshold may be 5 cm, 10 cm, or the like.

On the basis of the above-mentioned embodiments of the present invention, an eighth embodiment of the present invention is proposed, wherein a plurality of preset distances are set at equal intervals in sequence from small to large. Each preset distance corresponds to an adjustment parameter, and the orderly classification of the speaker adjustment parameters is ensured by setting the preset distances at equal intervals. Therefore, the adjustment direction of the audio signal can be clearly known through the setting of equal intervals from small to large. It is also faster to obtain adjustment parameters in advance.

The present invention also provides a wearable device, the wearable device includes: a memory, a processor, and a sound playing program stored in the memory and running on the processor; when the sound playing program is executed by the processor, the above sound playing is realized steps of the method.

For the specific implementation manner of the wearable device of the present invention, reference may be made to the above-mentioned embodiments of the sound playback method, which will not be repeated here.

The present invention also provides a readable storage medium on which a sound playing program is stored, and when the sound playing program is executed by a processor, the steps of the above sound playing method are implemented.

For the specific implementation manner of the readable storage medium of the present invention, reference may be made to the above-mentioned embodiments of the sound playback method, which will not be repeated here.

It should be noted that, herein, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion, such that a process, method, article or system comprising a series of elements includes not only those elements, It also includes other elements not expressly listed or inherent to such a process, method, article or system. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in the process, method, article or system that includes the element.

The above-mentioned serial numbers of the embodiments of the present invention are only for description, and do not represent the advantages or disadvantages of the embodiments.

From the description of the above embodiments, those skilled in the art can clearly understand that the method of the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is better implementation. Based on such understanding, the technical solutions of the present invention can be embodied in the form of software products in essence or the parts that make contributions to the prior art, and the computer software products are stored in a storage medium (such as ROM/RAM) as described above. , magnetic disk, optical disc), including several instructions to make a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in the various embodiments of the present invention.

The above are only the preferred embodiments of the present invention, and are not intended to limit the scope of the present invention. Under the inventive concept of the present invention, the equivalent structure transformation made by the contents of the description and drawings of the present invention, or directly/indirectly applied to other All relevant technical fields are included in the scope of patent protection of the present invention.

Claims (7)

1. A sound playback method, wherein the sound playback method is used in a wearable device, the wearable device comprises a speaker, and the sound playback method comprises: Send a probe wave to the human ear, and record the launch time, wherein the probe wave is reflected after encountering the human ear; Receive the reflected probe wave and record the receiving time; obtaining the distance between the speaker and the human ear according to the transmitting time and the receiving time; Determine the adjustment parameter according to the distance between the speaker and the human ear; Comparing the distance between the speaker and the human ear with a preset distance to generate a comparison result, wherein the preset distance includes a plurality of preset distances, and different preset distances correspond to different adjustment parameters; According to the comparison result, the adjustment parameter corresponding to the preset distance is retrieved; If the distance between the speaker and the human ear is greater than the maximum value of the preset distance, prompt the user to check the position state of the wearable device; If the distance between the speaker and the human ear is greater than the maximum value of the preset distance, and the difference between the distance between the speaker and the human ear and the value of the preset distance exceeds a preset threshold, cut off the audio of the speaker Signal; The audio signal of the speaker is adjusted according to the adjustment parameter. 2. The sound playback method according to claim 1, wherein the human ear comprises an external auditory canal; The step of obtaining the distance between the loudspeaker and the human ear according to the transmitting time and the receiving time includes: Obtain the near-point distance and far-point distance between the speaker and the auricle of the human ear according to the transmitting time and the receiving time; The distance between the speaker and the entrance of the external auditory canal of the human ear is calculated according to the near point distance and the far point distance. 3. The sound playback method according to claim 1, wherein the wearable device comprises a sound pickup microphone, the sound pickup microphone is disposed adjacent to the speaker, and the detection wave comprises an ultrasonic wave; The described steps of transmitting probe waves to the human ear and recording the launch time include: control the speaker to emit ultrasonic waves, and record the emission time of the ultrasonic waves; The steps of receiving the reflected probe wave and recording the receiving time include: The pickup microphone is controlled to receive the reflected ultrasonic waves, and the receiving time of the reflected ultrasonic waves is recorded. 4. sound playback method as claimed in claim 1, is characterized in that, described to human ear launch probe wave, and record the step of launching time, also comprises: According to the preset time, the detection wave is periodically emitted to the human ear, and the emission time is recorded. 5 . The sound playing method of claim 1 , wherein a plurality of the preset distances are set at equal intervals in sequence from small to large. 6 . 6. A wearable device, characterized in that the wearable device comprises: a memory, a processor, and a sound playback program stored on the memory and executable on the processor; the sound playback program is The processor implements the steps of the sound playing method according to any one of claims 1 to 5 when executed. 7. A readable storage medium, characterized in that, a sound playback program is stored on the readable storage medium, and the sound playback program is implemented as described in any one of claims 1 to 5 when the sound playback program is executed by a processor. The steps of the sound playback method.

Images