CN111294626A

CN111294626A - Lyric display method and device

Info

Publication number: CN111294626A
Application number: CN202010069663.4A
Authority: CN
Inventors: 刘秋实; 张晓光; 杨胤; 陈佳
Original assignee: Tencent Music Entertainment Technology Shenzhen Co Ltd
Current assignee: Tencent Music Entertainment Technology Shenzhen Co Ltd
Priority date: 2020-01-21
Filing date: 2020-01-21
Publication date: 2020-06-16

Abstract

The application discloses a lyric display method and device, and belongs to the technical field of internet. The method comprises the following steps: sending an accompaniment playing instruction of a target song to the intelligent sound box to receive playing progress time sent by the intelligent sound box in the process of playing the accompaniment audio of the target song; determining the actual playing progress time of the intelligent sound box based on the playing progress time and the data transmission time delay between the intelligent sound box and the intelligent terminal; and displaying the lyric data of the target song based on the actual playing progress moment. The lyric that this application can make intelligent terminal show is synchronous with the accompaniment audio frequency of intelligent audio amplifier broadcast, has improved user's K song and has experienced.

Description

Lyric display method and device

Technical Field

The application relates to the technical field of internet, in particular to a lyric display method and device.

Background

Along with the development of artificial intelligence technology, the function of intelligent audio amplifier is also more abundant. At present, some intelligent sound boxes can also realize the karaoke function besides weather forecast, travel route inquiry and the like.

The user can interact with the intelligent sound box through the mobile phone, and the intelligent sound box plays accompaniment audio. The user can simultaneously and manually turn over the lyrics on the mobile phone to follow the accompaniment to carry out the K song.

In the process of implementing the present application, the inventor finds that the prior art has at least the following problems:

when a user is singing K, the lyrics and the accompaniment of the song cannot be synchronized in real time, so that the lyrics cannot be displayed along with the accompaniment, and the experience of the user on the K song is poor.

Disclosure of Invention

The embodiment of the application provides a lyric display method and device, and the problem that K song experience is poor due to the fact that lyrics and song accompaniment cannot synchronously adjust lyric progress in real time can be solved. The technical scheme is as follows:

in a first aspect, a method for displaying lyrics is provided, where the method includes:

sending an accompaniment playing instruction of a target song to the intelligent sound box;

receiving the playing progress moment sent by the intelligent sound box in the process of playing the accompaniment audio of the target song;

determining the actual playing progress time of the intelligent sound box based on the playing progress time and the data transmission time delay of the intelligent sound box and the intelligent terminal;

and displaying the lyric data of the target song based on the actual playing progress moment.

In one possible implementation, the method further includes:

after the connection with the intelligent sound box is established, at least one request message is sent to the intelligent sound box in a preset period, and the sending time of the request message is recorded;

receiving a response message corresponding to each request message in the at least one request message returned by the intelligent sound box, and recording the receiving time of the response request;

and determining the data transmission time delay of the intelligent sound box and the intelligent terminal based on the sending time of each request message in the at least one request message and the receiving time of the corresponding response message.

In a possible implementation manner, the determining, based on a sending time of each request message in the at least one request message and a receiving time of a corresponding response message, a data transmission delay between the smart speaker and the smart terminal includes:

determining a difference value between the sending time of each request message in the at least one request message and the receiving time of the corresponding response message, and dividing the difference value by two to obtain the data transmission delay corresponding to the request message;

and determining an average value of data transmission time delays corresponding to the at least one request message as the data transmission time delay of the intelligent sound box and the intelligent terminal.

In a possible implementation manner, the determining an actual playing progress time of the smart speaker based on the playing progress time and a data transmission delay between the smart speaker and the smart terminal includes:

and adding the playing progress time and the data transmission time delay of the intelligent sound box and the intelligent terminal to obtain the actual playing progress time of the intelligent sound box.

In a possible implementation manner, the displaying the lyric data of the target song based on the actual playing progress time includes:

determining a target lyric display time which is larger than the actual playing progress time and has the smallest difference with the actual playing progress time in the lyric display time corresponding to each sentence of lyric data of the target song;

and determining the time difference between the target lyric display time and the actual playing progress time, and displaying the lyric data corresponding to the target lyric display time at the preset position of a lyric display interface at the time different from the receiving time of the actual playing progress time by the time difference.

In a second aspect, a method for displaying lyrics is provided, the method comprising:

receiving an accompaniment playing instruction of a target song sent by an intelligent terminal;

acquiring the accompaniment audio of the target song;

determining a budget playing progress time based on the playing progress time and the data transmission delay between the intelligent terminal and the intelligent sound box, wherein the budget playing progress time is used for indicating the actual playing progress time of the intelligent sound box when the intelligent terminal receives the budget playing progress time;

and sending the budget playing progress time to the intelligent terminal so that the intelligent terminal displays the lyric data of the target song based on the budget playing progress time.

In one possible implementation, the method further includes:

after connection with the intelligent terminal is established, at least one request message is sent to the intelligent terminal in a preset detection period, and the sending time of the request message is recorded;

receiving a second response message corresponding to each request message in the at least one request message returned by the mobile phone terminal, and recording the receiving time of the response request;

and determining the data transmission time delay between the intelligent terminal and the intelligent sound box based on the sending time of each request message in the at least one request message and the receiving time of the corresponding response message.

In a possible implementation manner, the determining, based on a sending time of each request message in the at least one request message and a receiving time of a corresponding response message, a data transmission delay between the smart terminal and the smart speaker includes:

and determining an average value of data transmission time delays corresponding to the at least one request message as the data transmission time delay of the intelligent terminal and the intelligent sound box.

In a possible implementation manner, the determining a budget play progress time based on the play progress time and a data transmission delay between the intelligent terminal and the intelligent sound box includes:

and adding the playing progress time and the data transmission time delay of the intelligent terminal and the intelligent sound box to obtain the budget playing progress time.

In a third aspect, an apparatus for displaying lyrics is provided, the apparatus comprising:

the transmitting module is used for transmitting an accompaniment playing instruction of the target song to the intelligent sound box;

the receiving module is used for receiving the playing progress moment sent by the intelligent sound box in the process of playing the accompaniment audio of the target song;

the determining module is used for determining the actual playing progress time of the intelligent sound box based on the playing progress time and the data transmission time delay of the intelligent sound box and the intelligent terminal;

and the display module is used for displaying the lyric data of the target song based on the actual playing progress moment.

In one possible implementation manner, the apparatus further includes a detection module configured to:

In a possible implementation manner, the detection module is configured to:

In one possible implementation manner, the determining module is configured to:

In one possible implementation manner, the display module is configured to:

In a fourth aspect, an apparatus for displaying lyrics is provided, the apparatus comprising:

the receiving module is used for receiving an accompaniment playing instruction of the target song sent by the intelligent terminal;

the acquisition module is used for acquiring the accompaniment audio of the target song;

the determining module is used for determining a budget playing progress time based on the playing progress time and the data transmission delay between the intelligent terminal and the intelligent sound box, wherein the budget playing progress time is used for indicating the actual playing progress time of the intelligent sound box when the intelligent terminal receives the budget playing progress time;

and the transmission module is used for transmitting the budget playing progress time to the intelligent terminal so that the intelligent terminal displays the lyric data of the target song based on the budget playing progress time.

In a possible implementation manner, the detection module is configured to:

In one possible implementation manner, the determining module is configured to:

In a fifth aspect, an intelligent terminal is provided, where the intelligent terminal includes a processor and a memory, where the memory stores at least one instruction, and the instruction is loaded and executed by the processor to implement the operation performed by the method for displaying lyrics according to the first aspect.

In a sixth aspect, a smart sound box is provided, where the smart sound box includes a processor and a memory, where the memory stores at least one instruction, and the instruction is loaded and executed by the processor to implement the operation performed by the method for displaying lyrics according to the second aspect.

A seventh aspect provides a computer-readable storage medium, having at least one instruction stored therein, which is loaded and executed by a processor to implement the operations performed by the method for displaying lyrics according to the first aspect or the second aspect.

The technical scheme provided by the embodiment of the application has the following beneficial effects:

when a user uses the intelligent sound box and the intelligent terminal to carry out K song, the intelligent terminal receives the playing progress moment sent by the intelligent sound box in the process of playing the accompaniment audio of the target song. And then, determining the actual playing progress moment of the intelligent sound box based on the playing progress moment and the data transmission time delay of the intelligent sound box and the intelligent terminal. Because there is the time delay in the data transmission between intelligent terminal and the intelligent audio amplifier, so, when the intelligent terminal received the broadcast progress moment that intelligent audio amplifier sent, the actual broadcast progress moment of intelligent audio amplifier was not the broadcast progress moment of receipt constantly, in this application embodiment on the basis of broadcast progress moment of receipt, combines data transmission time delay to confirm when receiving this broadcast progress moment, the actual broadcast progress moment of intelligent audio amplifier. Therefore, the lyrics of the target song are displayed based on the actual playing progress moment, so that the lyrics and the accompaniment are synchronous, and the K song experience of the user is improved.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

FIG. 1 is a schematic illustration of an implementation environment provided by an embodiment of the present application;

FIG. 2 is a flow chart of a method for displaying lyrics according to an embodiment of the present application;

FIG. 3 is a diagram of a lyric display interface according to an embodiment of the present application;

FIG. 4 is a schematic diagram of a lyric display interface provided by an embodiment of the present application;

FIG. 5 is a flowchart of a method for displaying lyrics according to an embodiment of the present application;

FIG. 6 is a flow chart of a method for displaying lyrics according to an embodiment of the present application;

FIG. 7 is a flowchart of a method for displaying lyrics according to an embodiment of the present application;

FIG. 8 is a schematic structural diagram of an apparatus for displaying lyrics according to an embodiment of the present application;

FIG. 9 is a schematic structural diagram of an apparatus for displaying lyrics according to an embodiment of the present application;

fig. 10 is a schematic structural diagram of an intelligent terminal provided in an embodiment of the present application;

fig. 11 is a schematic structural diagram of an intelligent sound box provided in an embodiment of the present application.

Detailed Description

To make the objects, technical solutions and advantages of the present application more clear, embodiments of the present application will be described in further detail below with reference to the accompanying drawings.

Fig. 1 is a schematic diagram of an implementation environment provided by an embodiment of the present application. Referring to fig. 1, an implementation environment of the embodiment of the present application may include an intelligent terminal and an intelligent speaker. The intelligent terminal can be an electronic device such as a mobile phone and a tablet personal computer. An application program with the karaoke function can be installed in the user client, and correspondingly, the application program with the karaoke function is also installed in the intelligent loudspeaker box. Before the intelligent terminal and the intelligent sound box are combined to play the song K, a connection may be established between the intelligent terminal and the intelligent sound box, and the connection may be a network connection, such as a Transmission Control Protocol (TCP) connection. The user can be through intelligent terminal control smart speaker broadcast accompaniment audio frequency, and smart speaker can feed back the broadcast progress of accompaniment audio frequency to intelligent terminal, in addition, can have data transmission delay between intelligent terminal and the smart speaker. The terminal can display the lyrics by combining the playing progress and the data transmission delay.

Fig. 2 is a flowchart of a method for displaying lyrics according to an embodiment of the present disclosure. In the embodiment of the method, the data transmission delay between the intelligent sound box and the intelligent terminal is calculated by the intelligent terminal. The method can be implemented by an intelligent terminal, and referring to fig. 2, the method embodiment may include the following steps:

step 201, sending an accompaniment playing instruction of the target song to the intelligent sound box.

In implementation, the connection between the intelligent terminal and the intelligent sound box can be established first. Then, the user can select a target song which wants to play the karaoke through an application program with the karaoke function installed in the intelligent terminal. The intelligent terminal can send a playing instruction of the target song to the intelligent sound box after the user selects the target song, and the accompaniment audio acquisition instruction can carry song information of the target song, wherein the song information can comprise a song identifier, a singer identifier and the like. After the intelligent sound box receives the accompaniment audio acquisition command, the accompaniment audio corresponding to the target song can be acquired. Here, when the smart speaker acquires the accompaniment audio, whether the accompaniment audio is stored or not can be locally inquired, if the accompaniment audio is not inquired, the accompaniment audio can be acquired from the music server and can be played.

Step 202, receiving a playing progress moment sent by the smart sound box in the process of playing the accompaniment audio of the target song.

The playing progress time can be a corresponding accompaniment timestamp of an audio frame currently being played by the intelligent sound box. Each audio frame in the accompaniment audio may correspond to a fixed accompaniment time stamp. The accompaniment time stamp corresponding to the audio frame in the accompaniment audio refers to the time offset of the playing time of the audio frame relative to the playing starting time of the accompaniment audio.

In implementation, the smart sound box can send the playing progress moment to the smart terminal in the process of playing the accompaniment audio. Here, the smart speaker transmits a play progress time to the smart terminal when playing each audio frame of the accompaniment audio.

And 203, determining the actual playing progress moment of the intelligent sound box based on the playing progress moment and the data transmission time delay of the intelligent sound box and the intelligent terminal.

In implementation, after the intelligent terminal is connected with the intelligent sound box, the data transmission delay between the intelligent sound box and the intelligent terminal can be detected according to a preset period. The method for detecting the data transmission delay by the intelligent terminal can be as follows.

And sending at least one request message to the intelligent sound box in each preset detection period. And receiving a response message corresponding to each request message in the at least one request message returned by the intelligent sound box. And determining the data transmission time delay between the intelligent sound box and the intelligent terminal based on the sending time of each request message in the at least one request message and the receiving time of the corresponding response message. The preset detection period may be set to be small, for example, 1 second, 2 seconds, and the like, and at least one request message may be one request message, or may be multiple request messages, for example, 2, 3, and the like. The following describes the case where the intelligent terminal sends one request message and sends a plurality of request messages in each preset detection period.

Case one, a request message is sent.

In each preset detection period, the intelligent terminal can send a request message to the intelligent sound box and record the sending time of the request message, and after receiving the request message, the intelligent sound box returns a corresponding response message to the intelligent terminal. And when the intelligent terminal receives the response message, recording the receiving time. And then, calculating the time difference between the sending time of the request message and the receiving time of the corresponding response message, wherein the time difference can be used as the data transmission time delay between the intelligent sound box and the local.

Case two, send multiple request messages.

In each preset detection period, the intelligent terminal can send a request message to the intelligent sound box and record the sending time of the request message, and after receiving the request message, the intelligent sound box returns a corresponding response message to the intelligent terminal. And when the intelligent terminal receives the response message, recording the receiving time and continuously sending the next request message. For each request message, the same as in the case above, the time difference between the sending instant of the request message and the receiving instant of the corresponding response message can be calculated. And then, calculating the time difference mean value corresponding to the sent request messages, and taking the time difference mean value as the data transmission time delay of the intelligent sound box and the intelligent terminal.

It should be further noted that, for each preset detection period, the data transmission delay between the intelligent sound box and the intelligent terminal in the preset detection period can be determined. Then, the intelligent terminal may determine the data transmission delay within a preset detection period each time, and may replace the data transmission delay determined within the previous preset detection period with the data transmission delay determined within the preset detection period. That is, only one data transmission delay may be stored in the smart terminal.

When the intelligent terminal receives the playing progress moment sent by the intelligent sound box, the playing progress moment can be added with the data transmission delay determined last time to obtain the actual playing progress moment of the intelligent sound box. For example, the playing progress time sent by the intelligent sound box to the intelligent terminal is 1s, and the data transmission delay is 0.3s, so that the intelligent terminal can calculate that the actual playing progress time of the intelligent sound box is 1.3s when the playing progress time is received.

And step 204, displaying the lyric data of the target song based on the actual playing progress moment.

In implementation, after a user selects a target song in the intelligent terminal, the intelligent terminal may obtain lyric data of the target song. Each sentence of lyric data corresponds to a lyric display time, which may also be referred to as a lyric timestamp. The lyric display time refers to the time offset of the lyric in the song required to be displayed according to a preset form relative to the starting playing time of the song. The time of display of the lyrics is explained below by way of example. For example, in a song, a lyric needs to be displayed in a preset form at the 10 th s after the song is played, and then the display time of the lyric corresponding to the lyric is 10 s.

After the actual playing time of the intelligent sound box is determined, the intelligent terminal can determine the target lyric display time which is larger than the actual playing progress time and has the minimum difference with the actual playing progress time in the lyric display time corresponding to each sentence of lyric data of the target song. And determining the time difference between the target lyric display time and the actual playing progress time, and displaying the lyric data corresponding to the target lyric display time at the preset position of the lyric display interface at the time different from the current time by the time difference.

For example, the intelligent terminal determines that the actual playing time of the intelligent sound box is 3.2 s. The lyric data of the target song and the corresponding lyric display time may be as shown in table 1 below. The intelligent terminal can calculate the time greater than the actual playing progress and the target lyric display time with the minimum difference value with the actual playing progress as the lyric display time 5s corresponding to the first sentence of lyrics. The lyrics show a time difference of 1.8s between the instant 5s and the actual playing instant 3.2 s. Then, the lyrics of the first sentence may be displayed at a preset position in the lyric display interface at a time 1.8s after the actual playing progress time is received.

TABLE 1

Lyrics of a target song	Lyric display time
		Lyrics of first sentence	5s
Lyrics of the second sentence	6.5s
		Lyrics of the third sentence	10.3s
……	……

Fig. 3 is a schematic diagram of a lyric display interface, in which the dotted line is the preset position. Corresponding to the above example, the determined lyrics of the first sentence may be displayed at a time 1.8s after the actual playing progress time is received, at the dashed line. Further, when the time of the second sentence of lyrics at which the second sentence of lyrics needs to be displayed is reached, the first lyrics may be slid up to be away from the dotted line and the second sentence of lyrics may be slid to be displayed at the dotted line as shown in fig. 4.

It should be further noted that, the above is only an example of a display manner of the lyric data corresponding to the determined display time of the target lyric, and the lyric data may also be displayed in other manners, for example, the lyric data is displayed in the middle of a lyric display interface, and only the lyric is displayed in the lyric display. The embodiment of the present application does not limit the specific display mode of the lyric data.

In the embodiment of the application, when a user uses the intelligent sound box and the intelligent terminal to perform K song, the intelligent terminal receives the playing progress moment sent by the intelligent sound box in the process of playing the accompaniment audio of the target song. And then, determining the actual playing progress moment of the intelligent sound box based on the playing progress moment and the data transmission time delay of the intelligent sound box and the intelligent terminal. Because there is the time delay in the data transmission between intelligent terminal and the intelligent audio amplifier, so, when the intelligent terminal received the broadcast progress moment that intelligent audio amplifier sent, the actual broadcast progress moment of intelligent audio amplifier was not the broadcast progress moment of receipt constantly, in this application embodiment on the basis of broadcast progress moment of receipt, combines data transmission time delay to confirm when receiving this broadcast progress moment, the actual broadcast progress moment of intelligent audio amplifier. Therefore, the lyrics of the target song are displayed based on the actual playing progress moment, so that the lyrics and the accompaniment are synchronous, and the K song experience of the user is improved.

Fig. 5 is a flowchart of another method for displaying lyrics according to an embodiment of the present application. In the embodiment of the method, the data transmission delay between the intelligent sound box and the intelligent terminal is calculated by the intelligent terminal. The method can be implemented by an intelligent terminal and an intelligent sound box, and referring to fig. 5, the embodiment of the method can include the following steps:

step 501, the intelligent terminal sends an accompaniment playing instruction of the target song to the intelligent sound box.

The specific implementation of step 501 is the same as the specific implementation of the operation performed by the smart terminal in step 201, and is not described herein again.

Step 502, the intelligent sound box sends a playing progress moment to the intelligent terminal in the process of playing the accompaniment audio of the target song.

The specific implementation of step 502 is the same as the specific implementation of the operation performed by the smart sound box in step 202, and is not described herein again.

Step 503, the intelligent terminal determines the actual playing progress time of the intelligent sound box based on the playing progress time and the data transmission time delay between the intelligent sound box and the intelligent terminal.

The specific implementation of step 503 is the same as the specific implementation of the operation performed by the smart terminal in step 203, and is not described herein again.

And 504, the intelligent terminal displays the lyric data of the target song based on the actual playing progress moment.

The specific implementation of step 504 is the same as the specific implementation of the operation performed by the smart terminal in step 204, and is not described herein again.

Fig. 6 is a flowchart of another method for displaying lyrics according to an embodiment of the present application. In the embodiment of the method, the data transmission delay between the intelligent sound box and the intelligent terminal is calculated by the intelligent sound box. The method may be implemented by a smart speaker, and referring to fig. 6, the embodiment may include the following steps:

step 601, receiving an accompaniment playing instruction of a target song sent by the intelligent terminal.

Step 602, obtaining the accompaniment audio of the target song.

For the specific implementation of step 602, the method is the same as the method for the smart speaker to obtain the accompaniment audio of the target song in step 201, and details are not repeated herein.

Step 603, in the process of playing the accompaniment audio of the target song, determining the budget playing progress time based on the playing progress time and the data transmission delay between the intelligent terminal and the intelligent sound box.

And the budget playing progress time is used for indicating the actual playing progress time of the intelligent sound box when the intelligent terminal receives the budget playing progress time.

In implementation, after the intelligent sound box is connected with the intelligent terminal, the data transmission delay between the intelligent terminal and the intelligent sound box can be detected according to a preset period. The method for detecting the data transmission delay by the smart speaker may be as follows.

And sending at least one request message to the intelligent terminal in each preset detection period. And receiving a response message corresponding to each request message in the at least one request message returned by the intelligent terminal. And determining the data transmission time delay between the intelligent terminal and the intelligent sound box based on the sending time of each request message in the at least one request message and the receiving time of the corresponding response message. The preset detection period may be set to be small, for example, 1 second, 2 seconds, and the like, and at least one request message may be one request message, or may be multiple request messages, for example, 2, 3, and the like. The following describes the case where the smart speaker sends one request message and sends a plurality of request messages in each preset detection period.

Case one, a request message is sent.

In each preset detection period, the smart sound box can send a request message to the smart terminal, record the sending time of the request message, and after receiving the request message, the smart terminal returns a corresponding response message to the smart sound box. And when the intelligent sound box receives the response message, recording the receiving moment. Then, the time difference between the sending time of the request message and the receiving time of the corresponding response message is calculated, and the time difference can be used as the data transmission delay between the intelligent terminal and the local terminal.

Case two, send multiple request messages.

In each preset detection period, the smart sound box can send a request message to the smart terminal, record the sending time of the request message, and after receiving the request message, the smart terminal returns a corresponding response message to the smart sound box. And when the intelligent sound box receives the response message, recording the receiving moment and continuously sending the next request message. For each request message, the same as in the case above, the time difference between the sending instant of the request message and the receiving instant of the corresponding response message can be calculated. And then, calculating the time difference mean value corresponding to the sent request messages, and taking the time difference mean value as the data transmission time delay of the intelligent terminal and the intelligent sound box.

It should be further noted that, for each preset detection period, the data transmission delay between the intelligent sound box and the intelligent terminal in the preset detection period can be determined. Then, the smart speaker may replace the data transmission delay determined in the previous preset detection period with the data transmission delay determined in the present preset detection period every time the data transmission delay within the preset detection period is determined. That is, only one data transmission delay may be stored in the smart box.

The smart speaker may add the playing progress time corresponding to the audio frame to the data transmission delay determined last time to obtain the budget playing progress time. For example, if the playing progress time is 1s and the data transmission delay is 0.3s, the smart sound box may add the playing progress time 1s and the data transmission delay for 0.3s to obtain a budget playing progress time 1.3s, that is, when the smart terminal receives the budget playing progress time, the actual playing progress time of the smart sound box is 1.3 s.

And step 604, sending the budget playing progress time to the intelligent terminal so that the intelligent terminal displays the lyric data of the target song based on the budget playing progress time.

The specific implementation of the intelligent terminal displaying the lyrics of the target song based on the budget playing progress time in step 604 is the same as the specific implementation of step 204, and is not described herein again.

Fig. 7 is a flowchart of another method for displaying lyrics according to an embodiment of the present application. In the embodiment of the method, the data transmission delay between the intelligent sound box and the intelligent terminal is calculated by the intelligent sound box. The method can be implemented by an intelligent terminal and an intelligent sound box, and referring to fig. 7, the embodiment of the method can include the following steps:

step 701, the intelligent terminal sends an accompaniment playing instruction of the target song to the intelligent sound box.

Step 702, the smart sound box obtains the accompaniment audio of the target song.

And 703, in the process of playing the accompaniment audio of the target song, the intelligent sound box determines the budget playing progress moment based on the playing progress moment and the data transmission delay between the intelligent terminal and the intelligent sound box.

The specific implementation manner in step 703 is the same as the specific implementation manner of the operation performed by the smart speaker in step 603, and is not described herein again.

And 704, the intelligent sound box sends the budget playing progress time to the intelligent terminal.

Step 705, the intelligent terminal displays the lyrics of the target song based on the budget playing progress time.

The specific implementation manner in step 705 is similar to the specific implementation manner in which the intelligent terminal displays the lyrics of the target song based on the actual playing progress time in step 204, and is not described herein again.

Based on the same technical concept, an embodiment of the present application further provides a device for displaying lyrics, which may be an intelligent terminal in the foregoing embodiment, as shown in fig. 8, the device includes:

a sending module 810, configured to send an accompaniment playing instruction of a target song to the smart sound box;

a receiving module 820, configured to receive a playing progress moment sent by the smart sound box in a process of playing an accompaniment audio of the target song;

a determining module 830, configured to determine an actual playing progress time of the smart speaker based on the playing progress time and a data transmission delay between the smart speaker and the smart terminal;

and the display module 840 is used for displaying the lyric data of the target song based on the actual playing progress moment.

In a possible implementation manner, the detection module is configured to:

In a possible implementation manner, the determining module 830 is configured to:

In one possible implementation manner, the display module 840 is configured to:

It should be noted that: in the device for displaying lyrics provided in the above embodiment, when displaying lyrics, only the division of the above functional modules is used for illustration, and in practical applications, the above function distribution may be completed by different functional modules according to needs, that is, the internal structure of the intelligent terminal is divided into different functional modules to complete all or part of the above described functions. In addition, the device for displaying lyrics provided by the above embodiment and the method embodiment for displaying lyrics belong to the same concept, and the specific implementation process is detailed in the method embodiment and will not be described herein again.

Based on the same technical concept, an embodiment of the present application further provides a device for displaying lyrics, which may be an intelligent sound box in the foregoing embodiment, as shown in fig. 9, the device includes:

a receiving module 910, configured to receive an accompaniment playing instruction of a target song sent by an intelligent terminal;

an obtaining module 920, configured to obtain an accompaniment audio of the target song;

a determining module 930, configured to determine a budget playing progress time based on the playing progress time and a data transmission delay between the intelligent terminal and the intelligent sound box, where the budget playing progress time is used to indicate an actual playing progress time of the intelligent sound box when the intelligent terminal receives the budget playing progress time;

a sending module 940, configured to send the estimated playing progress time to the intelligent terminal, so that the intelligent terminal displays the lyric data of the target song based on the estimated playing progress time.

In a possible implementation manner, the detection module is configured to:

In a possible implementation manner, the determining module 930 is configured to:

It should be noted that: in the device for displaying lyrics provided in the above embodiment, when displaying lyrics, only the division of the above functional modules is used for illustration, and in practical applications, the above functions may be distributed by different functional modules according to needs, that is, the internal structure of the smart speaker is divided into different functional modules to complete all or part of the above described functions. In addition, the device for displaying lyrics provided by the above embodiment and the method embodiment for displaying lyrics belong to the same concept, and the specific implementation process is detailed in the method embodiment and will not be described herein again.

Fig. 10 shows a block diagram of an intelligent terminal 1000 according to an exemplary embodiment of the present application. The terminal 1000 can be: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group audio Layer III, motion Picture Experts compression standard audio Layer 3), an MP4 player (Moving Picture Experts Group audio Layer IV, motion Picture Experts compression standard audio Layer 4), a notebook computer, or a desktop computer. Terminal 1000 can also be referred to as user equipment, portable terminal, laptop terminal, desktop terminal, or the like by other names.

In general, terminal 1000 can include: a processor 1001 and a memory 1002.

Processor 1001 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and so forth. The processor 1001 may be implemented in at least one hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), and a PLA (Programmable Logic Array). The processor 1001 may also include a main processor and a coprocessor, where the main processor is a processor for processing data in an awake state, and is also referred to as a Central Processing Unit (CPU); a coprocessor is a low power processor for processing data in a standby state. In some embodiments, the processor 1001 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content required to be displayed on the display screen. In some embodiments, the processor 1001 may further include an AI (Artificial Intelligence) processor for processing a computing operation related to machine learning.

Memory 1002 may include one or more computer-readable storage media, which may be non-transitory. The memory 1002 may also include high-speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, a non-transitory computer readable storage medium in memory 1002 is used to store at least one instruction for execution by processor 1001 to implement a method of lyric display as provided by method embodiments herein.

In some embodiments, terminal 1000 can also optionally include: a peripheral interface 1003 and at least one peripheral. The processor 1001, memory 1002 and peripheral interface 1003 may be connected by a bus or signal line. Various peripheral devices may be connected to peripheral interface 1003 via a bus, signal line, or circuit board. Specifically, the peripheral device includes: at least one of radio frequency circuitry 1004, touch screen display 1005, camera 1006, audio circuitry 1007, positioning components 1008, and power supply 1009.

The peripheral interface 1003 may be used to connect at least one peripheral related to I/O (Input/Output) to the processor 1001 and the memory 1002. In some embodiments, processor 1001, memory 1002, and peripheral interface 1003 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 1001, the memory 1002, and the peripheral interface 1003 may be implemented on separate chips or circuit boards, which are not limited by this embodiment.

The Radio Frequency circuit 1004 is used for receiving and transmitting RF (Radio Frequency) signals, also called electromagnetic signals. The radio frequency circuitry 1004 communicates with communication networks and other communication devices via electromagnetic signals. The radio frequency circuit 1004 converts an electrical signal into an electromagnetic signal to transmit, or converts a received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 1004 comprises: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and so forth. The radio frequency circuit 1004 may communicate with other terminals via at least one wireless communication protocol. The wireless communication protocols include, but are not limited to: metropolitan area networks, various generation mobile communication networks (2G, 3G, 4G, and 5G), Wireless local area networks, and/or WiFi (Wireless Fidelity) networks. In some embodiments, the rf circuit 1004 may further include NFC (Near Field Communication) related circuits, which are not limited in this application.

The display screen 1005 is used to display a UI (User Interface). The UI may include graphics, text, icons, video, and any combination thereof. When the display screen 1005 is a touch display screen, the display screen 1005 also has the ability to capture touch signals on or over the surface of the display screen 1005. The touch signal may be input to the processor 1001 as a control signal for processing. At this point, the display screen 1005 may also be used to provide virtual buttons and/or a virtual keyboard, also referred to as soft buttons and/or a soft keyboard. In some embodiments, display screen 1005 can be one, providing a front panel of terminal 1000; in other embodiments, display 1005 can be at least two, respectively disposed on different surfaces of terminal 1000 or in a folded design; in still other embodiments, display 1005 can be a flexible display disposed on a curved surface or on a folded surface of terminal 1000. Even more, the display screen 1005 may be arranged in a non-rectangular irregular figure, i.e., a shaped screen. The Display screen 1005 may be made of LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), and the like.

The camera assembly 1006 is used to capture images or video. Optionally, the camera assembly 1006 includes a front camera and a rear camera. Generally, a front camera is disposed at a front panel of the terminal, and a rear camera is disposed at a rear surface of the terminal. In some embodiments, the number of the rear cameras is at least two, and each rear camera is any one of a main camera, a depth-of-field camera, a wide-angle camera and a telephoto camera, so that the main camera and the depth-of-field camera are fused to realize a background blurring function, and the main camera and the wide-angle camera are fused to realize panoramic shooting and VR (Virtual Reality) shooting functions or other fusion shooting functions. In some embodiments, camera assembly 1006 may also include a flash. The flash lamp can be a monochrome temperature flash lamp or a bicolor temperature flash lamp. The double-color-temperature flash lamp is a combination of a warm-light flash lamp and a cold-light flash lamp, and can be used for light compensation at different color temperatures.

The audio circuit 1007 may include a microphone and a speaker. The microphone is used for collecting sound waves of a user and the environment, converting the sound waves into electric signals, and inputting the electric signals to the processor 1001 for processing or inputting the electric signals to the radio frequency circuit 1004 for realizing voice communication. For stereo sound collection or noise reduction purposes, multiple microphones can be provided, each at a different location of terminal 1000. The microphone may also be an array microphone or an omni-directional pick-up microphone. The speaker is used to convert electrical signals from the processor 1001 or the radio frequency circuit 1004 into sound waves. The loudspeaker can be a traditional film loudspeaker or a piezoelectric ceramic loudspeaker. When the speaker is a piezoelectric ceramic speaker, the speaker can be used for purposes such as converting an electric signal into a sound wave audible to a human being, or converting an electric signal into a sound wave inaudible to a human being to measure a distance. In some embodiments, the audio circuit 1007 may also include a headphone jack.

A location component 1008 is employed to locate a current geographic location of terminal 1000 for navigation or LBS (location based Service). The positioning component 1008 may be a positioning component based on the GPS (global positioning System) in the united states, the beidou System in china, the graves System in russia, or the galileo System in the european union.

Power supply 1009 is used to supply power to various components in terminal 1000. The power source 1009 may be alternating current, direct current, disposable batteries, or rechargeable batteries. When the power source 1009 includes a rechargeable battery, the rechargeable battery may support wired charging or wireless charging. The rechargeable battery may also be used to support fast charge technology.

In some embodiments, terminal 1000 can also include one or more sensors 1010. The one or more sensors 1010 include, but are not limited to: acceleration sensor 1011, gyro sensor 1012, pressure sensor 1013, fingerprint sensor 1014, optical sensor 1015, and proximity sensor 1016.

Acceleration sensor 1011 can detect acceleration magnitudes on three coordinate axes of a coordinate system established with terminal 1000. For example, the acceleration sensor 1011 may be used to detect components of the gravitational acceleration in three coordinate axes. The processor 1001 may control the touch display screen 1005 to display a user interface in a landscape view or a portrait view according to the gravitational acceleration signal collected by the acceleration sensor 1011. The acceleration sensor 1011 may also be used for acquisition of motion data of a game or a user.

The gyro sensor 1012 may detect a body direction and a rotation angle of the terminal 1000, and the gyro sensor 1012 and the acceleration sensor 1011 may cooperate to acquire a 3D motion of the user on the terminal 1000. From the data collected by the gyro sensor 1012, the processor 1001 may implement the following functions: motion sensing (such as changing the UI according to a user's tilting operation), image stabilization at the time of photographing, game control, and inertial navigation.

Pressure sensor 1013 may be disposed on a side frame of terminal 1000 and/or on a lower layer of touch display 1005. When pressure sensor 1013 is disposed on a side frame of terminal 1000, a user's grip signal on terminal 1000 can be detected, and processor 1001 performs left-right hand recognition or shortcut operation according to the grip signal collected by pressure sensor 1013. When the pressure sensor 1013 is disposed at a lower layer of the touch display screen 1005, the processor 1001 controls the operability control on the UI interface according to the pressure operation of the user on the touch display screen 1005. The operability control comprises at least one of a button control, a scroll bar control, an icon control and a menu control.

The fingerprint sensor 1014 is used to collect a fingerprint of the user, and the processor 1001 identifies the user according to the fingerprint collected by the fingerprint sensor 1014, or the fingerprint sensor 1014 identifies the user according to the collected fingerprint. Upon identifying that the user's identity is a trusted identity, the processor 1001 authorizes the user to perform relevant sensitive operations including unlocking a screen, viewing encrypted information, downloading software, paying, and changing settings, etc. Fingerprint sensor 1014 can be disposed on the front, back, or side of terminal 1000. When a physical key or vendor Logo is provided on terminal 1000, fingerprint sensor 1014 can be integrated with the physical key or vendor Logo.

The optical sensor 1015 is used to collect the ambient light intensity. In one embodiment, the processor 1001 may control the display brightness of the touch display screen 1005 according to the intensity of the ambient light collected by the optical sensor 1015. Specifically, when the ambient light intensity is high, the display brightness of the touch display screen 1005 is increased; when the ambient light intensity is low, the display brightness of the touch display screen 1005 is turned down. In another embodiment, the processor 1001 may also dynamically adjust the shooting parameters of the camera assembly 1006 according to the intensity of the ambient light collected by the optical sensor 1015.

Proximity sensor 1016, also known as a distance sensor, is typically disposed on a front panel of terminal 1000. Proximity sensor 1016 is used to gather the distance between the user and the front face of terminal 1000. In one embodiment, when proximity sensor 1016 detects that the distance between the user and the front surface of terminal 1000 gradually decreases, processor 1001 controls touch display 1005 to switch from a bright screen state to a dark screen state; when proximity sensor 1016 detects that the distance between the user and the front of terminal 1000 is gradually increased, touch display screen 1005 is controlled by processor 1001 to switch from a breath-screen state to a bright-screen state.

Those skilled in the art will appreciate that the configuration shown in FIG. 10 is not intended to be limiting and that terminal 1000 can include more or fewer components than shown, or some components can be combined, or a different arrangement of components can be employed.

Fig. 11 is a schematic structural diagram of a smart sound box according to an embodiment of the present disclosure, where the smart sound box 1100 may generate a relatively large difference due to different configurations or performances, and may include one or more processors (CPUs) 1101, one or more memories 1102, and an audio circuit 1103. Wherein the memory 1102 has stored therein at least one instruction, which is loaded and executed by the processor 1101 to implement the methods provided by the above-mentioned method embodiments. The audio circuitry 1103 may include a microphone and a speaker. The microphone is used for collecting sound waves of the user and the environment, converting the sound waves into electric signals, and inputting the electric signals to the processor 1101 for processing. For the purpose of stereo sound collection or noise reduction, a plurality of microphones may be respectively disposed at different positions of the smart sound box 1100. The microphone may also be an array microphone or an omni-directional pick-up microphone. The speaker is then used to convert the electrical signals from the processor 1101 into sound waves. The loudspeaker can be a traditional film loudspeaker or a piezoelectric ceramic loudspeaker. When the speaker is a piezoelectric ceramic speaker, the speaker can be used for purposes such as converting an electric signal into a sound wave audible to a human being, or converting an electric signal into a sound wave inaudible to a human being to measure a distance. In some embodiments, the audio circuit 1103 may also include a headphone jack. Of course, the smart speaker may further have components such as a wired or wireless network interface, an input/output interface, and the like, so as to perform input/output, and the smart speaker may further include other components for implementing the device function, which is not described herein again.

In an exemplary embodiment, a computer-readable storage medium, such as a memory, including instructions executable by a processor in a terminal to perform the method of lyric display in the above embodiments is also provided. The computer readable storage medium may be non-transitory. For example, the computer-readable storage medium may be a ROM (Read-Only Memory), a RAM (Random Access Memory), a CD-ROM (Compact Disc Read-Only Memory), a magnetic tape, a floppy disk, an optical data storage device, and the like.

It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.

The above description is only exemplary of the present application and should not be taken as limiting, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims

1. A lyric display method is applied to an intelligent terminal, the intelligent terminal is connected with an intelligent sound box, and the method comprises the following steps:

2. The method of claim 1, further comprising:

3. The method according to claim 2, wherein the determining the data transmission delay between the smart sound box and the smart terminal based on the transmission time of each request message in the at least one request message and the reception time of the corresponding response message comprises:

4. The method according to any one of claims 1 to 3, wherein the determining the actual playing progress time of the smart sound box based on the playing progress time and the data transmission delay between the smart sound box and the smart terminal comprises:

5. The method according to any of claims 1-4, wherein the displaying the lyric data of the target song based on the actual playing progress time comprises:

6. A lyric display method is applied to a smart sound box, the smart sound box is connected with a smart terminal, and the method comprises the following steps:

acquiring the accompaniment audio of the target song;

in the process of playing the accompaniment audio of the target song, determining a budget playing progress time based on the playing progress time and the data transmission delay between the intelligent terminal and the intelligent sound box, wherein the budget playing progress time is used for indicating the actual playing progress time of the intelligent sound box when the intelligent terminal receives the budget playing progress time;

7. The method of claim 6, further comprising:

8. The method according to claim 7, wherein the determining a data transmission delay between the smart terminal and the smart speaker based on a transmission time of each request message of the at least one request message and a reception time of the corresponding response message comprises:

9. The method according to any one of claims 6 to 8, wherein the determining a budget playing progress time based on the playing progress time and a data transmission delay between the intelligent terminal and the intelligent speaker comprises:

10. The device for displaying the lyrics is applied to an intelligent terminal, the intelligent terminal is connected with an intelligent sound box, and the device comprises:

11. The device for displaying the lyrics is characterized in that the device is applied to an intelligent sound box, the intelligent sound box is connected with an intelligent terminal, and the device comprises:

12. An intelligent terminal, comprising a processor and a memory, wherein the memory stores at least one instruction, and the instruction is loaded and executed by the processor to implement the operations performed by the method for displaying lyrics according to any one of claims 1 to 5.

13. A smart sound box comprising a processor and a memory, the memory having stored therein at least one instruction that is loaded and executed by the processor to perform operations performed by the method of lyric display of any one of claims 6-10.

14. A computer-readable storage medium having stored therein at least one instruction which is loaded and executed by a processor to perform operations performed by a method of lyric display according to any one of claims 1 to 5 or 6 to 10.