WO2021052198A1

WO2021052198A1 - Interactive media content playback method and device

Info

Publication number: WO2021052198A1
Application number: PCT/CN2020/113597
Authority: WO
Inventors: 闫旭伟
Original assignee: 中兴通讯股份有限公司
Priority date: 2019-09-19
Filing date: 2020-09-04
Publication date: 2021-03-25
Also published as: CN112533062A

Abstract

An interactive media content playback method and device. The method comprises: a client displays a plot branch option of an interactive media content, and different plot branches correspond to different plot contents; when it is detected that a user selects a first plot branch in the branch option, request a streaming media server for a plot content corresponding to the first plot branch; and receive and play the plot content corresponding to the first plot branch that is returned by the streaming media server.

Description

Method and device for playing interactive media content

Cross-references to related applications

This application is filed based on a Chinese patent application with an application number of 201910888989.7 and an application date of September 19, 2019, and claims the priority of the Chinese patent application. The entire content of the Chinese patent application is hereby incorporated into this application by way of introduction.

Technical field

The embodiments of the present application relate to, but are not limited to, the field of interactive digital television, and more specifically to a method and device for playing interactive media content.

Background technique

Although the current interactive digital TV field provides users with more and clearer digital media content, like traditional TV media content, users cannot really experience the joy of interactive movie watching, and most of the media content is limited to a single The viewing experience of the movie, that is, the content that all users watch has the same plot and ending, and users can only choose to watch different content according to their personal preferences. Although some media content service providers have provided media content that can be selected for plot development, most of them are realized through customized application software, which has not been able to form a unified standardized process for use in the digital TV field. .

Summary of the invention

In view of this, an embodiment of the present application provides a method for playing interactive media content, including: the client displays the plot branch options of the interactive media content, and different plot branches correspond to different plot content; when it is detected that the user selects all When the first scenario branch in the branch option is described, the scenario content corresponding to the first scenario branch is requested from the streaming media server; the scenario content corresponding to the first scenario branch returned by the streaming media server is received and played.

The embodiment of the present application also provides a device for playing interactive media content, which is applied to the client, and includes: a display unit for the client to display the plot branch options of the interactive media content. Different plot branches correspond to different plot content. Request unit, used to request the streaming media server for the story content corresponding to the first story branch when it is detected that the user selects the first story branch in the branch option; the playing unit is used to receive and play the stream The story content corresponding to the first story branch returned by the media server.

An embodiment of the present application also provides a device for playing interactive media content, including a memory, a processor, and a computer program stored on the memory and running on the processor, and the computer program is processed by the processor. The above method of playing interactive media content is realized when the device is executed.

The embodiment of the present application also provides a computer-readable storage medium having an information processing program stored on the computer-readable storage medium, and when the information processing program is executed by a processor, the steps of the above method for playing interactive media content are implemented .

Other features and advantages of the present application will be described in the following description, and partly become obvious from the description, or understood by implementing the present application. The purpose and other advantages of the application can be realized and obtained through the structures specifically pointed out in the specification, claims and drawings.

Description of the drawings

The accompanying drawings are used to provide a further understanding of the technical solution of the present application, and constitute a part of the specification. Together with the embodiments of the present application, they are used to explain the technical solution of the present application, and do not constitute a limitation to the technical solution of the present application.

FIG. 1 is a schematic flowchart of a method for playing interactive media content according to an embodiment of the application;

2 is a schematic flowchart of a method for playing interactive media content according to another embodiment of the application

FIG. 3 is a schematic diagram of multiple branches and multiple endings of interactive media content provided in an embodiment of this application;

4 is a schematic flowchart of a method for playing interactive media content according to another embodiment of the application;

Fig. 5 is a schematic structural diagram of a device for playing interactive media content provided by an embodiment of the application.

detailed description

In order to make the objectives, technical solutions, and advantages of the present application clearer, the embodiments of the present application will be described in detail below in conjunction with the accompanying drawings. It should be noted that the embodiments in this application and the features in the embodiments can be combined with each other arbitrarily if there is no conflict.

The steps shown in the flowcharts of the drawings can be executed in a computer system such as a set of computer-executable instructions. And, although a logical sequence is shown in the flowchart, in some cases, the steps shown or described may be performed in a different order than here.

Fig. 1 is a schematic flowchart of a method for playing interactive media content according to an embodiment of the application. As shown in Fig. 1, the method includes:

Step 101: The client displays the plot branch options of the interactive media content, and different plot branches correspond to different plot content;

Step 102: When it is detected that the user selects the first scenario branch among the branch options, request the streaming media server for the scenario content corresponding to the first scenario branch;

Step 103: Receive and play the plot content corresponding to the first plot branch returned by the streaming media server.

Wherein, the scenario branch options of the interactive media content displayed by the client include:

After the client starts to play the interactive media content, when the first scenario selection point is played, the scenario branch option corresponding to the first scenario selection point is displayed.

Wherein, before the client starts to play the interactive media content, the method further includes:

The streaming media server saves the interactive media content including different plot branches produced by a media content provider;

The index files of different plot branches of the interactive media content are sent to the client according to the streaming media protocol negotiated with the client.

Wherein, when the streaming media protocol is a hypertext transfer protocol dynamic adaptive streaming DASH streaming media protocol, the index file is a media presentation description MPD file;

When the streaming media protocol is a hypertext transfer protocol live streaming HLS streaming media protocol, the index file is an M3U8 file.

Wherein, the display of the scenario branch options of the interactive media content corresponding to the first scenario selection point includes:

The client parses the index file, and displays the indexes of different plot branches corresponding to the first plot selection point in a preset format.

Wherein, the preset form is a dialog box or a picture; the dialog box or picture corresponds to the index of different story branches corresponding to the first story selection point.

Wherein, the request to the streaming media server for the plot content corresponding to the first plot branch includes:

According to the index of the first scenario branch, request the streaming media server for the scenario content corresponding to the first scenario branch.

Among them, the method also includes:

When the second scenario selection point is played, the scenario branch options corresponding to the second scenario selection point are displayed;

When detecting that the user selects the second scenario branch in the scenario branch options corresponding to the second scenario selection point, the client requests the streaming media server for the scenario content corresponding to the second scenario branch;

Receiving and playing the plot content corresponding to the second plot branch returned by the streaming media server.

FIG. 2 is a schematic flowchart of a method for playing interactive media content according to another embodiment of the application. As shown in FIG. 2, the method includes:

Step 201: The media content provider publishes interactive media content to the streaming media server;

Among them, interactive media content means that the same media content can have different plot trends and even endings. In addition, different plot branches may lead to the same ending.

In interactive media content, each plot selection point can be set with different plot branch options, and different plot branches correspond to different plot content. For example, as shown in Figure 3, there are options 1-1 and 1-2 at plot selection point 1, corresponding to different plot branches 1 and 2, respectively; at plot selection point 2, there are options 2-1 and 2-2, respectively corresponding to different The plot branches of 1-1 and 1-2, 1-2 go to branch 3-1; at plot selection point 3, there are options 3-1 and 3-2, which correspond to different plot branches 3-1 and 3-2 respectively; Among them, the plot branch 1-1 corresponds to ending 1, the plot branch 3-1 corresponds to ending 2, and the plot branch 3-2 corresponds to ending 3.

Specifically, the media content provider can design and produce interactive media content according to the plot in Figure 3, and then publish it to the streaming media server.

Step 202: The streaming media server saves the interactive media content, and sends index files of different plot branches in the interactive media content to the client according to the streaming media protocol negotiated with the client;

Specifically, the streaming media server encapsulates the corresponding interactive media content into a network data packet through an encoder, and transmits it through the network to all mobile phones, set-top boxes, smart TVs and other clients that subscribe to the media content. The end user can choose the media content independently. Interact with the client.

Step 203: The client starts to play the interactive media content, and when the first scenario selection point is played, the scenario branch option corresponding to the first scenario selection point is displayed;

Specifically, the client parses the index file, and displays the indexes of different plot branches corresponding to the first plot selection point in a preset format;

Wherein, the preset form is a dialog box or picture, etc.; the dialog box or picture corresponds to the index of the different story branches corresponding to the first story selection point.

Step 204: When the client detects that the user selects the first scenario branch corresponding to the first scenario selection point, it requests the streaming media server for the scenario content corresponding to the first scenario branch according to the index of the first scenario branch;

Among them, the user can select a branch of interest according to the scenario branch options displayed by the client. After the client detects the branch selected by the user, the client requests the streaming media server for corresponding scenario content according to the index corresponding to the branch.

Step 205: After receiving the request, the streaming media server returns the plot content corresponding to the first plot branch to the client;

Step 206: The client terminal receives and plays the plot content corresponding to the first plot branch returned by the streaming media server.

Among them, the method also includes:

When it is detected that the user selects the second scenario branch in the scenario branch options corresponding to the second scenario selection point, the client requests the streaming media server to correspond to the second scenario branch according to the index of the second scenario branch Content of the plot;

And so on, until the entire interactive media content is played.

In the technical solution provided by this embodiment, the client is responsible for playing interactive media content, and showing the branch options to the user when the plot is selected; the user only needs to select the corresponding option according to personal preference at the plot selection point to play different plots content.

The technical solution provided by this embodiment is different from the traditional TV media content with only a single ending, which limits users to the same media content, and can realize the playback of multi-story, multiple endings and interactive media content, so that users can play in the media content. Choose on key nodes to get a different viewing experience.

FIG. 4 is a schematic flowchart of a method for playing interactive media content according to another embodiment of the application. As shown in FIG. 4, the method includes:

Step 401: The media content provider publishes interactive media content to the streaming media server;

Among them, the media content provider system can provide interactive media content with different plot branches and different endings to the streaming media server. For example, it is shown in Figure 3, which will not be repeated here.

Step 402: The streaming media server saves the interactive media content, and sends index files of different plot branches in the interactive media content to the client according to the streaming media protocol negotiated with the client;

Wherein, the streaming media server may store the interactive media content in the form of data fragments.

Specifically, the streaming media server re-encodes the interactive media content provided by the media content provider into network data packets, and stores the data in the form of fragments in the server, and finally selects the following protocol to carry the data according to actual needs. Packets are transmitted:

1. DASH (Dynamic Adaptive Streaming over HTTP, HyperText Transfer Protocol, HyperText Transfer Protocol dynamic adaptive streaming) streaming media protocol

Among them, the DASH protocol uses MPD (Media Presentation Description) files to describe the composition of the code stream in the media content. Among them, the document is organized in the form of XML (eXtensible Markup Language). In the standard DASH protocol, the description format of media fragment data is as follows:

In this embodiment, the protocol is extended, and a special field "MultiSessions" is customized in the file to describe different data fragment address index files, that is, different plot branches. At the same time, in the "MultiSessions" field, describe the content of the options of different branches for the client to display, as shown below:

2. HLS (HTTP Live Streaming, HyperText Transfer Protocol, Hypertext Transfer Protocol live streaming) streaming media protocol

Among them, the HLS protocol uses M3U8 (a text file customized by the HLS protocol) to describe the composition of the code stream in the media content. In the standard HLS protocol, the description format of media fragment data is as follows:

#EXTINF:

http://media.example.com/first.ts

In this embodiment, the protocol is extended to customize the special field "#EXT-CHOICES" to describe different data fragment address index files when the plot branch is selected. As follows:

#EXT-CHOICES:yes,

http://media.example.com/first_1.ts

#EXT-CHOICES:no,

http://media.example.com/first_2.ts

Step 403: The client starts to play the interactive media content, and when the first scenario selection point is played, the scenario branch option corresponding to the first scenario selection point is displayed;

Specifically, when the client plays this type of media content, it parses the M3U8 or MPD file according to the above-mentioned custom protocol content. The client is responsible for displaying the content of the branch option when the plot branch is selected, and at the same time responds to the user's option to the server Request the corresponding media content to continue playing.

Among them, the content of the branch option can be displayed in the form of a dialog box or a picture with a hyperlink.

Specifically, the user can select the interactive media content through the remote control (for set-top boxes, smart TVs) or mobile phones (for smart phones), etc.; the client determines whether there are historical bookmarks in the interactive media content according to the user's selection, and if so , The media data will be played after requesting the bookmark location from the streaming media server. Otherwise, start playing from the beginning. When the client recognizes that the program is played to the branch point of the plot, the branch options are displayed through dialog boxes or pictures; the user judges the branch options, and if the first plot branch is selected through the remote control or mobile phone, step 404 is entered; if the selection is abandoned , The branch option 1 is selected by default, and step 404 is entered; if return is selected, step 407 is entered.

Step 404: When the client detects that the user selects the first plot branch corresponding to the first plot selection point, it requests the streaming media server for the plot content corresponding to the first plot branch according to the index of the first plot branch;

Step 405: After receiving the request, the streaming media server returns the plot content corresponding to the first plot branch to the client;

Step 406: The client terminal receives and plays the plot content corresponding to the first plot branch returned by the streaming media server;

In step 407, the client terminal exits this play, records the historical bookmarks, and directly displays the branch option during the next play.

Wherein, after step 406, the method may further include:

And so on, until the entire interactive media content is played.

The technical solutions provided by the embodiments of this application extend the streaming media protocol and formulate a set of protocol standards for the server and client to collaborate together, which saves the workload of media content providers. At the same time, open interactive media content also helps operations Merchants or platforms increase user viscosity and improve user experience.

Fig. 5 is a schematic structural diagram of a device for playing interactive media content provided by an embodiment of the application. As shown in Fig. 5, the device includes:

The display unit is used for the client side to display the plot branch options of interactive media content, and different plot branches correspond to different plot content;

The request unit is configured to, when it is detected that the user selects the first scenario branch in the branch options, request the scenario content corresponding to the first scenario branch from the streaming media server;

The playing unit is configured to receive and play the story content corresponding to the first story branch returned by the streaming media server.

Wherein, the display unit is configured to display the scenario branch option corresponding to the first scenario selection point when the interactive media content starts to be played, when the first scenario selection point is played.

Among them, the device also includes:

The receiving unit is configured to receive the index files of different plot branches of the interactive media content sent by the streaming media server according to the streaming media protocol negotiated with the streaming media server before the client starts to play the interactive media content.

Wherein, the display unit is configured to parse the index file, and display the index of the different scenario branches corresponding to the first scenario selection point in a preset format.

Wherein, the request unit is configured to request, from the streaming media server, the plot content corresponding to the first plot branch according to the index of the first plot branch.

An embodiment of the present application also provides a device for playing interactive media content, including a memory, a processor, and a computer program stored on the memory and running on the processor, and the computer program is processed by the processor. The method for playing interactive media content described in any one of the above items is implemented when the device is executed.

The embodiment of the present application also provides a computer-readable storage medium having an information processing program stored on the computer-readable storage medium, and when the information processing program is executed by a processor, the interactive media playback described in any one of the above is implemented The steps of the content method.

The technical solutions provided by the embodiments of the present invention can realize that users can independently select plot content development and enjoy different movie viewing experiences.

A person of ordinary skill in the art can understand that all or some of the steps, functional modules/units in the system, and apparatus in the methods disclosed above can be implemented as software, firmware, hardware, and appropriate combinations thereof. In the hardware implementation, the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may consist of several physical components. The components are executed cooperatively. Some or all of the components may be implemented as software executed by a processor, such as a digital signal processor or a microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on a computer-readable medium, and the computer-readable medium may include a computer storage medium (or a non-transitory medium) and a communication medium (or a transitory medium). As is well known to those of ordinary skill in the art, the term computer storage medium includes volatile and non-volatile data implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Sexual, removable and non-removable media. Computer storage media include but are not limited to RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cassettes, magnetic tapes, magnetic disk storage or other magnetic storage devices, or Any other medium used to store desired information and that can be accessed by a computer. In addition, as is well known to those of ordinary skill in the art, communication media usually contain computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as carrier waves or other transmission mechanisms, and may include any information delivery media. .

Claims

A method for playing interactive media content, including:

The client shows the plot branch options of interactive media content, and different plot branches correspond to different plot content;

When it is detected that the user selects the first scenario branch in the branch options, request the streaming media server for the scenario content corresponding to the first scenario branch;

Receiving and playing the plot content corresponding to the first plot branch returned by the streaming media server.
The method according to claim 1, wherein the display of the plot branching options of the interactive media content by the client includes:

After the client starts to play the interactive media content, when the first scenario selection point is played, the scenario branch option corresponding to the first scenario selection point is displayed.
The method according to claim 2, wherein before the client starts to play the interactive media content, the method further comprises:

The streaming media server saves the interactive media content including different plot branches produced by a media content provider;

The index files of different plot branches of the interactive media content are sent to the client according to the streaming media protocol negotiated with the client.
The method of claim 3, wherein:

When the streaming media protocol is a hypertext transfer protocol dynamic adaptive streaming DASH streaming media protocol, the index file is a media presentation description MPD file;

When the streaming media protocol is a hypertext transfer protocol live streaming HLS streaming media protocol, the index file is an M3U8 file.
The method according to claim 3, wherein said displaying the scenario branching options of the interactive media content corresponding to the first scenario selection point comprises:

The client parses the index file, and displays the indexes of different plot branches corresponding to the first plot selection point in a preset format.
The method of claim 5, wherein:

The preset form is a dialog box or a picture; the dialog box or picture corresponds to the index of different story branches corresponding to the first story selection point.
The method according to claim 5, wherein said requesting from the streaming media server the plot content corresponding to the first plot branch comprises:

According to the index of the first scenario branch, request the streaming media server for the scenario content corresponding to the first scenario branch.
A device for playing interactive media content, applied to a client, includes:

The display unit is used for the client side to display the plot branch options of interactive media content, and different plot branches correspond to different plot content;

The request unit is configured to, when it is detected that the user selects the first scenario branch in the branch options, request the scenario content corresponding to the first scenario branch from the streaming media server;

The playing unit is configured to receive and play the story content corresponding to the first story branch returned by the streaming media server.
A device for playing interactive media content, comprising a memory, a processor, and a computer program stored on the memory and capable of running on the processor, and the computer program is executed by the processor as claimed in the claims The method for playing interactive media content described in any one of 1 to 7.
A computer-readable storage medium, wherein an information processing program is stored on the computer-readable storage medium, and when the information processing program is executed by a processor, the interactive playback as described in any one of claims 1 to 7 is realized The steps of the media content method.