CN112765395B - Audio playback method, electronic device and storage medium - Google Patents

Abstract

The embodiment of the invention relates to the technical field of intelligent music playing, and discloses an audio playing method, electronic equipment and a storage medium. The audio playing method comprises the following steps: determining the position relation between a user and a loudspeaker in an area where the user is located; determining the sound relation between the environment sound of the area where the user is located and the audio currently played by the loudspeaker; determining a filter coefficient of the loudspeaker according to the position relation and the sound relation; and filtering the audio according to the filter coefficient, and focusing the filtered audio to the user, so that the user can listen to the music played by the user without wearing a headset to separate from the music playing device which is required to be carried with the user, and convenience is provided for the user.

Description

Audio playback method, electronic device and storage medium

Technical field

Embodiments of the present invention relate to the technical field of intelligent music playback, and in particular to an audio playback method, electronic device and storage medium.

Background technique

In gym exercise scenarios, users usually use audio playback devices to play music to reduce boredom caused by repetitive monotonous exercises and improve comfort during fitness exercises. Methods of playing music in the prior art include: Method 1: Use head-mounted sports headphones or in-ear sports headphones to play audio through a portable playback device (such as a mobile phone, MP3). Method 2: Play music through the gym’s PA system.

However, the inventor found that there are at least the following problems in the related technology: the first method requires wearing headphones on the user, which affects the user's movement and is not convenient enough for the user. Method 2: The music played by the broadcast system usually uses uniform background music, which cannot adapt to everyone's preferences.

Contents of the invention

The purpose of the embodiments of the present invention is to provide a music playing method, electronic device and storage medium, so that the user can listen to the music played for the user without wearing earphones and detached from the music playing device that needs to be carried, thus providing the user with convenience .

In order to solve the above technical problems, an embodiment of the present invention provides an audio playback method, which includes: determining the positional relationship between the user and the speakers in the area where the user is located; determining the environmental sound in the area where the user is located and the location of the audio playback method. The sound relationship between the audio currently played by the speaker; determining the filter coefficient of the speaker according to the position relationship and the sound relationship; filtering the audio according to the filter coefficient, and focusing the filtered audio to said user.

An embodiment of the present invention also provides an electronic device, including: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores information that can be executed by the at least one processor. instructions, which are executed by the at least one processor, so that the at least one processor can execute the above audio playback method.

An embodiment of the present invention also provides a computer-readable storage medium that stores a computer program. When the computer program is executed by a processor, the above-mentioned audio playback method is implemented.

In the embodiment of the present invention, the relationship between the user and the speaker is determined; wherein the speaker is installed in the area where the user is located, and the relationship includes: the positional relationship between the user and the speaker and/or the location where the user is located. The sound relationship between the ambient sound in the area and the audio currently played by the speaker; according to the relationship, determine the filter coefficient of the speaker; filter the audio currently played by the speaker according to the filter coefficient, and focus The filtered audio is transmitted to the area where the user is located. The positional relationship between the user and the speaker can reflect the distance between the user and the speaker. The sound relationship between the environmental sound in the user's area and the currently played audio can reflect the audio played by the user that can actually be heard by the environmental sound. The degree of interference, combined with the filter coefficient determined by the positional relationship and/or the sound relationship, is beneficial to making the filtered music adapt to the positional relationship between the user and the speaker and/or reducing the degree of interference of environmental sounds on the played audio. Focus the filtered audio to the area where the user is, that is, focus the filtered music to the area where the user is, so that the user can hear the filtered music as much as possible, while other users in other areas can hardly hear the filtered music. Music, to avoid the impact of music played by speakers set in the user's area on other users in other areas, and to facilitate the use of speakers set in different areas to play different music for users in different areas, thereby adapting to the personal preferences of different users . The music playing method in this embodiment allows the user to listen to the music played for the user without wearing headphones and leaving the music playing device that needs to be carried around, which provides convenience for the user and is conducive to improving the performance when the user is in the fitness area. User’s fitness experience.

In addition, determining the filter coefficient of the speaker according to the relationship includes: obtaining the user's current motion data and determining an adjustment coefficient according to the motion data; determining the adjustment coefficient according to the adjustment coefficient and the relationship. The filter coefficient of the speaker. The motion data can reflect the user's current motion state. On the basis of the position relationship and/or sound relationship, the filter coefficients are further combined with the adjustment coefficient determined based on the user's current motion data, so that the filtered music can also adapt to the user's current state. Movement state is conducive to improving the user's experience of listening to music during exercise.

In addition, the motion data includes motion duration and/or motion speed, the adjustment coefficient includes a first adjustment coefficient and/or a second adjustment coefficient, and determining the adjustment coefficient according to the motion data includes: according to the user's current The duration difference between the exercise duration and the preset exercise duration, determine the first adjustment coefficient corresponding to the duration difference; and/or, according to the difference between the user's current exercise speed and the preset exercise speed the speed difference, and determine the second adjustment coefficient corresponding to the speed difference. The duration difference can reflect the difference between the user's actual exercise duration and the expected exercise duration. The speed difference can reflect the difference between the user's actual exercise speed and the expected exercise speed. The duration difference can help make a more reasonable determination. The first adjustment coefficient is conducive to a more reasonable determination of the second adjustment coefficient based on the speed difference, thereby further improving the rationality of the determined filter coefficient.

In addition, when the audio currently played by the speaker is played to the preset progress, the method also includes: obtaining the current heart rate value and the recommended heart rate value of the user; if the current heart rate value is greater than the recommended heart rate value, Determine the target audio closest to the currently played audio based on the list, and use the target audio as the audio played by the speaker after the currently played audio is played; or, obtain the current heart rate value and the The heart rate difference of the recommended heart rate value is determined based on the recommended play value of each audio after the currently played audio in the list, and the audio that matches the heart rate difference is determined, and the matched audio is used as the currently played audio. The audio played by the speaker after the audio is played; wherein the recommended playback value of the target audio is less than or equal to the preset playback threshold, and the recommended playback value is used to represent the excitement level of the target audio. Combining the excitement level of the audio, the user's current heart rate value and the recommended heart rate value for the user, it is possible to more reasonably determine the audio played by the speaker after the currently played audio is played, and improve the consistency between the audio played by the speaker and the user's heart rate. For example, the current heart rate value is greater than the recommended heart rate value, that is, the current heart rate value is larger. In order to reduce the user's current heart rate value, if the excitement level of the next audio is low, the next audio can be used as the audio to be played by the next speaker. , to increase the possibility that the user's heart rate will decrease after hearing the next audio.

Description of drawings

One or more embodiments are exemplified by the pictures in the corresponding drawings, and these exemplary illustrations do not constitute limitations to the embodiments.

Figure 1 is a flow chart of an audio playback method mentioned in the first embodiment of the present invention;

Figure 2 is a flow chart of the sub-steps of step 102 mentioned in the first embodiment of the present invention;

Figure 3 is a flow chart of the audio playback method mentioned in the second embodiment of the present invention;

Figure 4 is a flow chart of the sub-steps of step 305 mentioned in the second embodiment of the present invention;

FIG. 5 is a schematic structural diagram of an electronic device according to a third embodiment of the present invention.

Detailed ways

In order to make the objectives, technical solutions and advantages of the embodiments of the present invention clearer, each implementation mode of the present invention will be described in detail below with reference to the accompanying drawings. However, those of ordinary skill in the art will understand that in various embodiments of the present invention, many technical details are provided to enable readers to better understand the present application. However, even without these technical details and various changes and modifications based on the following embodiments, the technical solution claimed in this application can also be implemented. The division of the following embodiments is for convenience of description and should not constitute any limitation on the specific implementation of the present invention. The various embodiments can be combined with each other and quoted from each other on the premise that there is no contradiction.

The inventor of the present application considered that in the scenario of gym exercise, the head-mounted sports headphones or in-ear sports headphones used in the prior art play audio through portable playback devices (such as mobile phones, MP3), because the user In fitness exercises, which are usually intense, these two types of headphones are either not firmly fixed, affecting the user's movement, or they need to be fixed more firmly on the user, making the fixed parts of the headphones and the user very uncomfortable. In addition, traditional sports headphones have built-in earplugs, bone conduction headphones and Bluetooth modules. When there is strong external interference during exercise and outdoors (gym is a venue with strong sound source interference), the sound transmission quality and sound transmission effect are poor, thus affecting the user experience. In the existing technology, when listening to music through the gym's broadcast system, since most fitness venues are open spaces, there are many users in the gym, and different music rhythms are suitable for different exercises, the music played by the broadcast system cannot Adapted to everyone's preferences. Moreover, unified background music is usually used, and it is impossible to provide corresponding music according to different sports training, nor to provide sports guidance tutorials required for different sports.

In order to solve the above-mentioned problems in the prior art, the first embodiment of the present invention provides an audio playback method, so that the user can listen to the music played for the user without wearing headphones and detached from the music playback device that needs to be carried. It provides users with convenience and improves their sports experience. The application scenario of the audio playback method in this embodiment may be a scenario where the user needs to listen to music in an open space equipped with speakers, such as an open space such as a gym. The music playback method in this embodiment is applied to an electronic device. The electronic device can be a music playback device or a cloud server. Taking the electronic device as a cloud server as an example, the implementation details of the audio playback method in this embodiment will be specifically described below. The following contents are only implementation details provided for ease of understanding and are not necessary to implement this solution.

The flow chart of the audio playback method in this embodiment is shown in Figure 1, including:

Step 101: Determine the relationship between the user and the speaker.

Step 102: Determine the filter coefficient of the speaker according to the relationship.

Step 103: Filter the audio currently played by the speaker according to the filter coefficient, and focus the filtered audio to the area where the user is located.

Among them, the speaker is set in the area where the user is located. The area where the user is located may be one of multiple individual sub-areas divided based on the entire fitness area of the gym. For example, based on sound focusing technology, a gym places each fitness equipment in zones to form multiple logically independent sub-areas. Each sub-area is equipped with speakers. The speakers can be set on the ceiling above the sub-area, or On the ground, speakers can be placed above the area where the user is located. For example, speakers in different sub-areas are placed directly above the sub-area. It can also be set in other places according to actual needs, which is not specifically limited in this embodiment. The number of speakers provided in a sub-area can be set according to actual needs, and this embodiment does not specifically limit this.

In one example, a separate sub-area is the area where the treadmill is located. The speakers set in the area where the treadmill is located are all arranged based on focusing technology. The bodybuilder stands on the treadmill, and the part where his or her ears are is the focus position of the speaker's sound. That is to say, the exercisers on the treadmill can hear the sound played by the speakers set in the sub-area where they are located, but the exercisers in other areas (such as the sub-area where the chest equipment is located) cannot hear the sound. For example, in a gym, speakers with sound focusing systems are placed directly above different sub-areas. Loudspeakers with sound focusing systems project area-specific focused sound waves to sub-areas below.

In a specific implementation, the speaker includes a filter module, which is used to filter the sound output by the speaker. The degree of filtering can be determined based on the relationship between the user and the speaker, the user's current motion state, etc.

In one example, each sub-area is equipped with an indoor sensing system, which may include pressure sensing floors, equipment sensors, distance sensors and other information collection devices. The indoor sensing system can sense indoor attributes (such as temperature, humidity, noise level), and can also collect fitness body location information, sports sign monitoring data, etc.

In specific implementation, after the user enters the gym, the cloud server can obtain the user's exercise data. Movement data includes user data and device data. The user can log in to the cloud server after entering the gym. For example, when the user enters the gym and wears a wearable device such as a bracelet, the bracelet is bound to the user and the user logs in through the bracelet. The cloud server can track the location of the bracelet to obtain the data collected by the bracelet. User data, and device data measured by the corresponding fitness equipment at the location of the bracelet.

Among them, user data can include heart rate, body temperature, exercise speed, exercise duration and other data collected through the bracelet. The equipment data can be data measured by the equipment used by the bodybuilder (the equipment used by the bodybuilder can be determined by the corresponding fitness equipment at the location of the bracelet). Taking a treadmill as an example, the data includes slope, exercise duration, and speed. , heart rate, etc. Among them, user data and device data may store duplicate data, such as heart rate, speed, etc., which are all collected here.

Optionally, the bracelet can also be used to open lockers, record user behavior, historical fitness data, body indicators, fitness tutorials, body data collection and other functions.

After the user enters the gym, the cloud server can also determine the area where the user is located and obtain the sensing data of the indoor sensing system in the area where the user is located. Among them, the cloud server can determine the area the user is in, that is, which sub-area in the gym, by tracking the location of the bracelet. The cloud server can then obtain sensing data based on the indoor sensing systems deployed in the sub-area. Sensing data includes environmental data and person data; among them, environmental data is data about the environment of the area where the user is located, such as the sound energy value of the ambient sound in the area where the user is located, the floor pressure in the area where the user is located, etc. Character data is the user's data sensed by the indoor sensing system in the area where the user is located, such as the user's current maximum height (for example, obtained by measuring the current height of a bodybuilder), the height value of the lowest position of the user's head (for example, the user's maximum height). The height of the chin from the ground can be obtained by identifying the user's head and identifying the position of the chin, thereby obtaining the height of the chin from the ground).

In one example, wrapping fitness equipment with a sound-absorbing sponge layer and laying sound-absorbing cotton mats on the floor can help reduce the reflection of focused projected sound waves to the surroundings and reduce interference between adjacent sub-areas in the gym.

Based on the structure of the gym mentioned above, that is, the partition setting of the speakers, the layout of the indoor induction system, and the collection of motion data and induction data, each fitness person in the gym can play music through the music playing method of this embodiment.

In step 101, the relationship between the user and the speaker includes: the positional relationship between the user (such as a bodybuilder) and the speaker and/or the sound relationship between the ambient sound in the area where the user is and the audio currently played by the speaker.

In one example, the positional relationship between the user and the speaker may include a distance relationship. The distance relationship is, for example, the distance relationship between the user's ear position and the position of the speaker.

In another example, the positional relationship between the user and the speaker may include: a height relationship between the height value of the user and the height value of the speaker, where the height relationship is, for example, the absolute value of the height difference. Among them, the user's height value h and the speaker's height value h1 can be sensed through the indoor sensing system in the area where the user is located. The absolute value h2 of the height difference is the absolute value of h1-h.

In an example, the user's height value can be calculated by the following formula:

h = (the current maximum height of the user - the height of the lowest position of the user's head) * 2/3 + the height of the lowest position of the user's head;

Among them, the user's current maximum height can be understood as the height of the highest position of the user's head.

In one example, the height value of the speaker can be determined by the following formula:

h1＝d*tanα+h0

Among them, h1 is the height value of the speaker, α is the angle between the speaker in the speaker and the horizontal plane, h0 is the height of the speaker, and d is the horizontal distance between the speaker and the user. Among them, d can be sensed through the indoor sensing system in the area where the user is located.

In one example, the sound relationship between the ambient sound in the area where the user is located and the audio currently played by the speaker includes a volume relationship, such as a volume difference relationship.

In another example, the sound relationship between the environmental sound in the area where the user is located and the audio currently played by the speaker includes: the sound energy value relationship between the sound energy value of the environmental sound and the sound energy value of the currently played audio, such as , the difference relationship, ratio relationship of sound energy values, etc. Among them, the sound energy value E1 of the environmental sound can be sensed through the indoor sensing system in the area where the user is located.

In an example, the sound energy value of the currently played audio can be calculated by the following formula:

Among them, E0 is the sound energy value of the currently played audio, a1 and a2 are preset coefficients, f is the frequency mean of the currently played audio, A _max is the maximum amplitude of the currently played audio, and A _min is the currently played audio. The minimum amplitude value of the audio, T is the duration standard deviation determined based on the currently played audio. a1 and a2 can be set by those skilled in the art according to actual needs. For example, a1 can take a value between 1 and 2, and a2 can take a value between 330 and 360. In this embodiment, a1 can be 1.293, and a2 can be 346.

In one example, the duration standard deviation in the above formula can be determined as follows:

First, get each rhythm point of the currently playing audio. Among them, the rhythm point is determined based on the energy value of the currently played audio, and a time point with a larger energy value can be determined as a rhythm point. For example, the energy value threshold is set in advance, and the energy value corresponding to each time point of the currently played audio is calculated. If the energy value corresponding to a certain time point is greater than the energy value threshold, the time point can be used as a rhythm point.

Secondly, based on each rhythm point, calculate the duration between two adjacent rhythm points to obtain the duration sequence. That is to say, calculate the duration between the next rhythm point and the previous rhythm point to obtain a sequence, such as {2 seconds, 4 seconds, 1 second...}.

Then, determine the duration standard deviation of each duration in the duration sequence. In specific implementation, the duration standard deviation can be calculated using the standard deviation calculation formula. The standard deviation reflects the degree of discreteness of the data. Therefore, in this embodiment, the duration standard deviation can reflect the density of the rhythm points of the currently played audio. The smaller the duration standard deviation, the denser it is, which means that it is biased towards a regular rhythm. The larger the standard deviation of the duration, the more scattered it is, which means the rhythm is irregular.

In step 102, the filter coefficient of the speaker is determined according to the relationship, that is, the sound relationship and/or the position relationship. Among them, the filter coefficient is mainly used to filter the audio played in the speakers in the user's area. The higher the filter coefficient, the better the filtering effect. The lower the filter coefficient, the poor filtering effect. By filtering the speakers in the user's area Coefficient adjustment can ensure that after the speaker performs sound focusing, the sound focusing effect in the area where the user is located is the best, which is conducive to achieving the effect that no matter where the user, that is, the fitness person, goes, the sound follows.

In one example, the cloud server can determine the filter coefficient of the speaker based on the sound relationship. Specifically, the cloud server can pre-store the corresponding relationship between the sound relationship and the filter coefficient, so as to determine the filter coefficient of the speaker in the user's area based on the pre-stored corresponding relationship. Among them, the corresponding relationship can be set by those skilled in the art according to actual needs, or can be obtained through big data analysis. For example, the sound relationship is the volume difference between the volume value of the ambient sound in the area where the user is and the volume value of the audio currently played by the speaker. The greater the volume difference, the greater the filter coefficient. It can be understood that the larger the volume difference, the greater the volume value of the ambient sound in the area where the user is located is higher than the volume value of the audio currently played by the speaker, and the volume value of the audio currently played by the speaker needs to be increased to offset it. The interference of ambient sounds improves the user's experience of listening to the audio currently played by the speaker.

In one example, the cloud server can determine the filter coefficient of the speaker based on the position relationship. Specifically, the cloud server can pre-store the corresponding relationship between the sound relationship and the filter coefficient, so as to determine the filter coefficient of the speaker in the user's area based on the pre-stored corresponding relationship. Among them, the corresponding relationship can be set by those skilled in the art according to actual needs, or can be obtained through big data analysis.

In one example, the cloud server can determine the filter coefficient of the speaker based on the position relationship and the sound relationship. For example, the position relationship is the absolute value h2 of the above-mentioned height difference, and the sound relationship is the energy ratio E2 between the sound energy value E1 of the ambient sound and the sound energy value E0 of the currently played audio. If E2 is less than 1, the filter coefficient can be E2 ^h2 . If E2 is not less than 1, that is, E2 is greater than or equal to 1, the filter coefficient is 0.

In one example, step 102 can also be implemented through the following sub-steps, with reference to Figure 2, including:

Step 201: Obtain the user's current motion data and determine the adjustment coefficient based on the motion data.

Step 202: Determine the filter coefficient of the speaker according to the adjustment coefficient and the relationship.

The motion data in step 201 includes motion duration and/or motion speed, and the adjustment coefficient includes a first adjustment coefficient and/or a second adjustment coefficient. Determining the adjustment coefficient according to the motion data includes: according to the user's current motion duration and a preset value. The duration difference between the movement durations is used to determine the first adjustment coefficient corresponding to the duration difference; and/or, based on the speed difference between the user's current movement speed and the preset movement speed, the speed difference is determined The corresponding second adjustment coefficient.

In one example, the exercise data includes exercise duration, and the adjustment coefficient includes a first adjustment coefficient. The first adjustment coefficient may be determined by: determining the duration difference between the user's current exercise duration and the preset exercise duration, and determining a third corresponding to the duration difference based on the duration difference and the preset first correspondence. An adjustment factor. Among them, the preset exercise duration can be the desired exercise duration, and the user can preset the duration of exercise he wants in advance. The duration difference between the user's current exercise duration and the preset exercise duration can reflect the user's actual exercise duration and Hope the difference in duration of exercise. The first corresponding relationship can be set by those skilled in the art according to actual needs, or obtained through big data analysis. For example, the duration difference is the current exercise duration minus the preset exercise duration. The greater the duration difference, the smaller the first adjustment coefficient. That is to say, when the current exercise duration is greater than the preset exercise duration, it means that the user has reached the desired exercise duration. At this time, the duration difference is a positive number. The greater the current exercise duration (the greater the positive duration difference). , the smaller the first adjustment coefficient is, it indicates that it is hoped that the user's movement will be slower; when the current movement duration is less than the preset movement duration, it means that the user has not reached the desired movement duration. At this time, the duration difference is a negative number, and the current movement The larger the duration (the larger the negative duration difference is), the smaller the first adjustment coefficient is.

In one example, the motion data includes motion speed, and the adjustment coefficient includes a second adjustment coefficient. The second adjustment coefficient may be determined by: determining the speed difference between the user's current movement speed and the preset movement speed, and determining the second adjustment coefficient corresponding to the speed difference according to the speed difference and the preset second correspondence. 2. Adjustment coefficient. Among them, the preset movement speed can be the desired movement speed, and the user can preset the speed at which he or she wants to move in advance. The speed difference between the user's current movement speed and the preset movement speed can reflect the user's actual movement speed and Hope the difference in speed of movement. The second corresponding relationship can be set by those skilled in the art according to actual needs, or obtained through big data analysis. When the user's current movement speed is greater than the preset movement speed, as the current movement speed increases, the second adjustment coefficient becomes smaller and smaller. In specific implementation, as the current movement speed increases, the second adjustment coefficient becomes smaller and smaller.

In one example, if the energy ratio is less than 1, the cloud server can determine the filter coefficient of the speaker based on the first adjustment coefficient, the energy ratio and the absolute value of the height difference. For example, it is determined by the following formula:

β＝t1*E2 ^h2

Among them, β is the filter coefficient, t1 is the first adjustment coefficient, E2 is the energy ratio, and h2 is the absolute value of the height difference.

In one example, if the energy ratio is less than 1, the cloud server may determine the filter coefficient of the speaker based on the second adjustment coefficient, the energy ratio and the absolute value of the height difference. For example, it is determined by the following formula:

β＝t2*E2 ^h2

Among them, β is the filter coefficient, t2 is the second adjustment coefficient, E2 is the energy ratio, and h2 is the absolute value of the height difference.

In one example, if the energy ratio is less than 1, the cloud server can determine the filter coefficient of the speaker based on the first adjustment coefficient, the second adjustment coefficient, the energy ratio, and the absolute value of the height difference. For example, it is determined by the following formula:

β＝t1*t2*E2 ^h2

In one example, if the energy ratio is greater than or equal to 1, the cloud server may determine that the filter coefficient of the speaker is 0.

It should be noted that the above example introduces how to determine the filter coefficients of the speakers in the area where a user is located, that is, a sub-area. In a specific implementation, the cloud server can determine the filter coefficients of the speakers in multiple sub-areas where multiple users are located. Filter coefficient, that is, each speaker has its own filter coefficient.

In a specific implementation, after determining the filter coefficient of the speaker, the cloud server can send the filter coefficient to the speaker, so that the speaker can filter the currently played audio based on the filter coefficient and focus the filtered audio to the area where the user is located. It is helpful to ensure that the maximum position of the audio sound is at the user's ears and follows the user's movement.

In one example, the cloud server can determine the fitness equipment placed in the user's area based on the area where the user is located, thereby determining the type of exercise based on the determined fitness equipment, and then monitoring the user's sports signs to obtain the audio from the user's personal database. Audio with a suitable rhythm is automatically selected from the playlist and played through speakers corresponding to different filter coefficients, so that users located under the speakers with sound focusing systems can listen to the audio.

In addition, users can also connect to the server of the music cloud system through the smartphone App, interact with the music cloud system through the App, and customize exclusive fitness playlists, music playback modes and music switching modes. The music playback mode can select the duration of the music. , the music switching mode allows you to choose to switch songs by actively pressing the bracelet button or by using an exclusive singing gesture customized by the built-in accelerometer of the bracelet.

In one example, an alarm reminder can be made based on the collected user's motion data to avoid user injury. Such as the voice prompt: You have been exercising for more than 40 minutes. To avoid injury, it is recommended that you rest for 5 minutes and stretch your legs.

It should be noted that the above-mentioned examples in this embodiment are illustrations for convenience of understanding and do not limit the technical solution of the present invention.

In this embodiment, the positional relationship between the user and the speaker can reflect the distance between the user and the speaker, and the sound relationship between the environmental sound in the user's area and the currently played audio can reflect the playback that the user can actually hear. The degree of interference of audio by environmental sounds, and the filter coefficient determined by combining the positional relationship and/or sound relationship, can help make the filtered music adapt to the positional relationship between the user and the speaker and/or reduce the degree of interference of environmental sounds on the played audio. . Focus the filtered audio to the area where the user is, that is, focus the filtered music to the area where the user is, so that the user can hear the filtered music as much as possible, while other users in other areas can hardly hear the filtered music. Music, to avoid the impact of music played by speakers set in the user's area on other users in other areas, and to facilitate the use of speakers set in different areas to play different music for users in different areas, thereby adapting to the personal preferences of different users . The music playing method in this embodiment allows the user to listen to the music played for the user without wearing headphones and leaving the music playing device that needs to be carried around, which provides convenience for the user and is conducive to improving the performance when the user is in the fitness area. User’s fitness experience.

The second embodiment of the present invention relates to an audio playing method. The implementation details of the audio playback method of this embodiment are described in detail below. The following content is only provided for the convenience of understanding and is not necessary for implementation of this solution.

The flow chart of the audio playback method in this embodiment is shown in Figure 3, including:

Step 301: Determine the relationship between the user and the speaker.

Step 302: Determine the filter coefficient of the speaker according to the relationship.

Step 303: Filter the audio currently played by the speaker according to the filter coefficient, and focus the filtered audio to the area where the user is located.

Among them, steps 301 to 303 are substantially the same as steps 101 to 103 in the first embodiment. To avoid repetition, they will not be described again here.

Step 304: When the audio currently played by the speaker is played to the preset progress, obtain the user's current heart rate value and recommended heart rate value.

Step 305: According to the current heart rate value and the recommended heart rate value, determine the audio played by the speaker after the currently played audio is played based on the list.

Among them, the preset progress in step 304 can be set according to actual needs, for example, set to 90%.

In one example, the cloud server can obtain the user's current heart rate value through the bracelet worn by the user, or can obtain the user's current heart rate value through the fitness equipment used by the user. If the current heart rate value measured by the bracelet and the current heart rate value measured by the fitness device are obtained at the same time and the current heart rate values measured by the two devices are different, the largest one can be selected as the user's current heart rate value.

In an example, the user's recommended heart rate value can be obtained by calculating it through the following formula:

Recommended heart rate value = heart rate value at registration + (B1-B2×age-heart rate at login)×[B3+exercise years/(age-B4)].

Among them, the heart rate value when registering can be understood as: the heart rate value collected when the user registers as a member in the gym. The heart rate value when logging in can be understood as the heart rate value when the user logs into the cloud server after entering the gym. The number of years of exercise can be the heart rate value when the user logs in to the cloud server. After the server, you choose the number of years. Among them, B1, B2, B3, and B4 are preset coefficients. The value range of B1 can be 190~250, the value range of B2 can be 0~1, the value range of B3 can be 0~1, and the value range of B4 can be 0~1. The value range can be 5~15. In an example, the values of these coefficients can be: B1=220, B2=2/3, B3=0.6, B4=10.

In one example, the list in step 305 can be a playlist corresponding to the user, such as a personal database created through the music cloud system. The personal database includes playlists, music style preferences, and audio playback setting preferences. If the user has set a playlist in advance, the playlist is read. If the user does not set a playlist, obtain the user's age, occupation (these data are filled in when registering through the bracelet) and other n songs that people similar to the user like to listen to are determined, and use them as the user's corresponding playlist. .

In one example, when the cloud server determines that the currently playing song (i.e. audio) has been played to 90% (preset progress), it can determine the current song in the user's corresponding playlist based on the user's current heart rate value and the recommended heart rate value. Whether the next song should be kept or deleted. If the judgment result is to retain, that is, the next song of the current song in the playlist is the song that the speaker needs to play after the currently playing song is played; if the judgment result is to delete, then continue to judge whether the next song is to be retained or deleted. . That is to say, if there is a reserved song in the subsequent songs in the playlist, the song will be played next. If there is no reserved song in the playlist, a song will be randomly selected from the songs played by users similar to the user. song, determine whether to retain it. If it is retained, the song is added to the playlist as the next song to be played. If it is not retained, another song is randomly selected until the next song is found.

In one example, the method of determining the audio played by the speaker after the currently played audio is completed is: if the current heart rate value is greater than the recommended heart rate value, determine the target audio closest to the currently played audio based on the list, and use the target audio as The audio played by the speaker after the currently played audio has been played; where the recommended playback value of the target audio is less than or equal to the preset playback threshold, and the recommended playback value is used to represent the degree of excitement. The nearest target audio allows you to determine whether the audio in the list is the target audio in sequence according to the order of the audio in the list. After finding the nearest target audio, there is no need to judge whether other audios in the list are target audio, which is helpful to speed up the selection. The speed of the target audio.

In one example, the target audio closest to the currently played audio determined based on the list can be the target audio closest to the currently played audio among the audios ranked after the currently played audio in the list, which is beneficial to avoid previously played audio. The audio is played again, improving the user's listening experience.

In another example, the target audio closest to the currently played audio determined based on the list may be the target audio closest to the currently played audio among the audios in the list except the currently played audio, that is, the target audio may be located at Before the currently playing audio, it may also come after the currently playing audio. It is helpful to expand the scope of finding the target audio and improve the possibility of finding the target audio.

In one example, if there is other audio between the target audio and the currently playing audio, delete the audio between the target audio and the currently playing audio.

In an example, the way to find the target audio can refer to Figure 4: including:

Step 401: Determine whether the current heart rate value is greater than the recommended heart rate value; if so, execute step 402, otherwise execute step 403.

Step 402: Obtain the recommended play value of the next audio of the currently played audio in the list.

Among them, the recommended playback value is used to represent the excitement level of the next audio. The higher the excitement level of the audio, the greater the recommended playback value.

In one example, the recommended playback value can be determined as follows: the cloud server obtains each rhythm point of the audio whose recommended playback value is to be determined in the list, and based on each rhythm point, calculates the duration between two adjacent rhythm points to obtain the duration. sequence; determine the duration standard deviation of each duration in the duration sequence; determine the recommended playback value based on the duration standard deviation and the tag value used to represent the degree of excitement. The calculation method of the duration standard deviation of an audio piece has been described in the first embodiment, and will not be described again to avoid repetition. The following mainly explains the method of determining the recommended playback value of the next audio based on the standard deviation of the duration and the label value used to characterize the excitement of the next audio:

In one example, the recommended playing value of the next audio may be the product of the duration standard deviation and the label value used to characterize the excitement level of the next audio. Among them, the label is soothing, rock, etc., and the label value is a value obtained based on the corresponding relationship between the preset label and the degree of excitement. The smaller the value, the more excited it is. The tag value is obtained based on big data analysis, or may be set manually, which is not specifically limited in this embodiment.

Step 403: Determine the next audio as the target audio.

That is to say, if the current heart rate value is greater than the recommended heart rate value and the recommended playback value is less than or equal to the preset playback threshold, the next audio will be retained in the playlist.

Step 404: Determine whether the recommended playback value is less than or equal to the preset playback threshold; if so, execute step 403; otherwise, execute step 405.

The preset playback threshold can be set according to actual needs, which is not specifically limited in this embodiment.

Step 405: Continue to search for the target audio in the list.

That is to say, if the current heart rate value is greater than the recommended heart rate value, and the recommended play value is greater than the preset play threshold, the next audio can be deleted, and the next audio in the play list can be continued to be judged as to be retained or deleted. If the retained audio, the retained audio will be used as the target audio. If the target audio does not exist in the list, you can also randomly select a song from the audio played by users similar to the user to determine whether to retain it. If it is retained, the song will be added to the list as the target audio. If it is not retained, then Select another random song until you find the target audio.

In another example, the method of determining the audio played by the speaker after the currently played audio is finished is: obtaining the heart rate difference between the current heart rate value and the recommended heart rate value, based on each audio in the list except the currently played audio. The recommended playback value determines the audio that matches the heart rate difference, and uses the matched audio as the audio played by the speaker after the currently played audio is played. The recommended playback value is used to represent the degree of excitement. The calculation method of the recommended playback value has been explained above and will not be repeated here. This method is conducive to referring to all audios in the list except the currently playing audio, so as to obtain the audio that best matches the heart rate difference, so that the played audio can well adapt to the user's current heart rate.

For example, a preset relationship between the heart rate difference and the recommended play value can be set in advance, and the target recommended play value corresponding to the user's heart rate difference can be selected based on the preset relationship, and the values of each audio in the list except the currently played audio can be obtained. Recommended playback value. The recommended playback value of the final matched audio is equal to or close to the above target recommended playback value. If there are multiple audios that are ultimately matched, one of the multiple audios can be randomly selected as the audio played by the speaker after the currently playing audio is played. The above-mentioned preset relationship between the heart rate difference value and the recommended playback value can be set according to actual needs, or can be obtained through big data analysis, which is not specifically limited in this embodiment.

Through the above method, it can be ensured that the currently played audio matches the user's current heart rate value. When the current heart rate value is high, songs with low excitement, such as soothing songs, are played. When the current heart rate value is low, songs with low excitement are played. High-pitched songs, such as rock songs, are helpful to improve the user's sports experience.

In this implementation, the user can detach from the music playback device that needs to be carried around, and change the audio played by the speaker according to the type of exercise corresponding to each sub-area and the user's current heart rate value during exercise, and filter the audio played by the speaker based on the filter coefficients. , so that the sound size and sound direction of the audio can be adjusted without the user's distraction, which greatly improves the user's fitness experience.

In one example, the indoor sensing system can report sensing data to the cloud and the gym backend, and the bracelet worn by the user reports the collected user data to the cloud (i.e., cloud server) and the gym backend. The backend of the gym plays corresponding background music to the fitness area through the music cloud system. At this time, the cloud can select music with a suitable rhythm for playback based on the user's exercise type, exercise intensity, and sports sign monitoring data transmitted by the bracelet, and can play it when the user starts exercising. When the exercise stops, the music gradually stops, allowing the user to exercise while exercising. It is separated from the music playing equipment and improves the user experience during fitness. The fitness playlist can be edited through the smartphone app at ordinary times. During exercise, it can automatically play suitable songs in the playlist, and then automatically switch to random music that suits the user's preferences and exercise rhythm. The cloud can provide voice training tutorials based on the user's fitness plan, allowing users to follow along.

In one example, a sports data collection system is installed on fitness equipment. The system is also equipped with a wireless communication module, which can upload user movement data collected by the fitness equipment to the song selection system in the cloud to improve the accuracy of song selection. And it can also establish the user's fitness profile in the personal database and record the user's fitness data. Optionally, based on the user's fitness data, background music for "professional training courses" can be produced to provide professional guidance for individual fitness.

It should be noted that the above-mentioned examples in this embodiment are illustrations for convenience of understanding and do not limit the technical solution of the present invention.

In this embodiment, by combining the excitement level of the next audio, the user's current heart rate value and the recommended heart rate value for the user, it can be more reasonably determined whether the next audio is the audio that the speaker needs to play after the currently played audio is completed. For example, the current heart rate value is greater than the recommended heart rate value, that is, the current heart rate value is larger. In order to reduce the user's current heart rate value, if the excitement level of the next audio is low, the next audio can be used as the audio to be played by the next speaker. , increasing the possibility that the user's heart rate will drop after hearing the next audio, which is conducive to improving the user's fitness experience.

The steps of the various methods above are divided just for the purpose of clear description. During implementation, they can be combined into one step or some steps can be split into multiple steps. As long as they include the same logical relationship, they are all within the scope of protection of this patent. ; Adding insignificant modifications or introducing insignificant designs to the algorithm or process without changing the core design of the algorithm and process are within the scope of protection of this patent.

The third embodiment of the present invention relates to an electronic device, as shown in Figure 5, including at least one processor 501; and a memory 502 communicatively connected with the at least one processor 501; wherein the memory 502 stores information that can be processed by at least one The instructions executed by the processor 501 are executed by at least one processor 501, so that the at least one processor 501 can execute the audio playback method in the first or second embodiment.

The memory 502 and the processor 501 are connected using a bus. The bus may include any number of interconnected buses and bridges. The bus connects various circuits of one or more processors 501 and the memory 502 together. The bus may also connect various other circuits together such as peripherals, voltage regulators, and power management circuits, which are all well known in the art and therefore will not be described further herein. The bus interface provides the interface between the bus and the transceiver. A transceiver may be one element or may be multiple elements, such as multiple receivers and transmitters, providing a unit for communicating with various other devices over a transmission medium. The data processed by the processor 501 is transmitted on the wireless medium through the antenna. Furthermore, the antenna also receives the data and transmits the data to the processor 501.

Processor 501 is responsible for managing the bus and general processing, and can also provide various functions, including timing, peripheral interfaces, voltage regulation, power management, and other control functions. The memory 502 may be used to store data used by the processor 501 when performing operations.

The fourth embodiment of the present invention relates to a computer-readable storage medium storing a computer program. The above method embodiments are implemented when the computer program is executed by the processor.

That is, those skilled in the art can understand that all or part of the steps in the methods of the above embodiments can be completed by instructing relevant hardware through a program. The program is stored in a storage medium and includes several instructions to cause a device ( It may be a microcontroller, a chip, etc.) or a processor (processor) that executes all or part of the steps of the methods described in various embodiments of this application. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program code.

Those of ordinary skill in the art can understand that the above-mentioned embodiments are specific examples for realizing the present invention, and in practical applications, various changes can be made in form and details without departing from the spirit and spirit of the present invention. scope.

Claims (11)

1. An audio playing method, comprising:

determining a relationship between a user and a speaker; wherein the speaker is disposed in an area where the user is located, and the relationship includes: the position relation between the user and the loudspeaker and the sound relation between the environment sound of the area where the user is located and the audio currently played by the loudspeaker;

determining filter coefficients of the loudspeaker according to the relation;

filtering the audio currently played by the loudspeaker according to the filter coefficient, and focusing the filtered audio to the area where the user is located;

wherein the loudspeaker is a loudspeaker with an acoustic focusing system.

2. The audio playing method according to claim 1, wherein the determining the filter coefficients of the speaker according to the relation includes:

acquiring current motion data of the user, and determining an adjustment coefficient according to the motion data;

and determining the filter coefficient of the loudspeaker according to the adjustment coefficient and the relation.

3. The audio playing method according to claim 2, wherein the motion data comprises a motion duration and/or a motion speed, the adjustment coefficients comprise a first adjustment coefficient and/or a second adjustment coefficient, and the determining the adjustment coefficients according to the motion data comprises:

Determining a first adjustment coefficient corresponding to a time length difference value according to the time length difference value between the current time length of the user and a preset time length of the user; and/or the number of the groups of groups,

and determining a second adjustment coefficient corresponding to the speed difference value according to the speed difference value between the current movement speed of the user and the preset movement speed.

4. The audio playing method according to claim 3, wherein the positional relationship includes a height relationship between a height value of the user and a height value of the speaker; and/or the number of the groups of groups,

the sound relationship includes a sound energy value relationship between a sound energy value of the ambient sound and a sound energy value of the currently played audio.

5. The audio playing method according to claim 4, wherein the positional relationship includes the height relationship, the height relationship is an absolute value of a height difference, the sound relationship includes the sound energy value relationship, the sound energy value relationship is an energy ratio, the motion data includes a motion duration and a motion speed, the adjustment coefficient includes a first adjustment coefficient and a second adjustment coefficient, and the determining the filter coefficient of the speaker according to the adjustment coefficient and the relationship includes:

If the energy ratio is less than 1, the filter coefficient is determined by the following formula:

β＝t1*t2*E2 ^h2

the β is the filter coefficient, the t1 is the first adjustment coefficient, the t2 is the second adjustment coefficient, the E2 is the energy ratio, and the h2 is the absolute value of the height difference.

6. The audio playing method according to claim 1, wherein when the audio currently played by the speaker is played to a preset progress, the method further comprises:

acquiring a current heart rate value and a recommended heart rate value of the user;

if the current heart rate value is larger than the recommended heart rate value, determining a target audio closest to the current played audio based on a list, and taking the target audio as the audio played by the loudspeaker after the current played audio is played; or, obtaining a heart rate difference value between the current heart rate value and the recommended heart rate value, determining an audio matched with the heart rate difference value according to recommended playing values of all the audios except the currently played audio in a list, and taking the matched audio as the audio played by the loudspeaker after the currently played audio is played;

The recommended playing value of the target audio is smaller than or equal to a preset playing threshold, and the recommended playing value is used for representing the excitation degree.

7. The audio playing method according to claim 6, wherein the recommended playing value is obtained by:

acquiring each rhythm point of the audio of the recommended playing value to be determined in the list;

according to each rhythm point, calculating the time length between two adjacent rhythm points to obtain a time length sequence;

determining the standard deviation of the time length of each time length in the time length sequence;

and determining the recommended playing value according to the time standard deviation and the label value for representing the excitation degree.

8. The audio playing method according to claim 1, wherein the relationship includes the positional relationship including a height relationship between a height value of the user and a height value of the speaker, the height value of the speaker being determined by the following formula:

h1＝d*tanα+h0

wherein h1 is a height value of the speaker, α is an angle between a speaker in the speaker and a horizontal plane, h0 is a height of the speaker, and d is a horizontal distance between the speaker and the user.

9. The audio playback method as recited in claim 4, wherein the relationship comprises the sound relationship, the sound relationship comprising a sound energy value relationship between a sound energy value of the ambient sound and a sound energy value of the currently played audio, the sound energy value of the currently played audio being determined by the following formula:

wherein E0 is the sound energy value of the current playing audio, a1 and a2 are both preset coefficients, f is the frequency average value of the current playing audio, A _max For the maximum amplitude value, A, of the currently playing audio _min And T is the standard deviation of the duration determined based on the currently played audio.

10. An electronic device, comprising:

at least one processor; the method comprises the steps of,

a memory communicatively coupled to the at least one processor; wherein,,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the audio playback method of any one of claims 1 to 9.

11. A computer readable storage medium storing a computer program, wherein the computer program when executed by a processor implements the audio playback method of any one of claims 1 to 9.