CN107547917A - The broadcasting of channel and processing method and processing device, the processing system of channel - Google Patents

Abstract

The present invention provides a channel playing and processing method and device, and a channel processing system. The channel playing method includes: the streaming media playing terminal obtains the channel list of the main channel to be played from the channel list of the streaming media system side equipment. The main index file, wherein, the main index file carries an extension tag used to mark the sub-index file of the sub-channel; the streaming media playback terminal parses the main index file to obtain the sub-index file; the streaming media playback terminal obtains the sub-index file from the streaming media system side device The first transport stream TS corresponding to the main index file, and the second transport stream TS corresponding to the sub-index file; the streaming media playback terminal decodes the first TS and the second TS, and plays the decoded main TS on the same display interface Channels and subchannels. The present invention solves the problem of complex channel management and playing caused by maintaining the mapping relationship of the two channels corresponding to the generated two streams when two channels are to be played in the related art.

Description

Channel broadcasting and processing method and device, channel processing system

technical field

The present invention relates to the communication field, in particular, to a channel playing and processing method and device, and a channel processing system.

Background technique

In the existing open Internet-based video service (Over The Top, referred to as OTT) live broadcast service, if a certain channel needs to have a pip channel, it is necessary to send two code streams on the streaming media server side, one for OTT live broadcast and one for pip , and two channel information will be generated in the channel management system, one OTT live channel and one pip live channel. In addition, the channel management system and the terminal system need to maintain the mapping relationship between the OTT live channel and the pip channel. The terminal is playing the OTT live channel and the When using the pip channel, the information of the two channels needs to be processed. Once the number of OTT live channels increases, the number of pip channels will also increase accordingly, which increases the complexity of channel management and playback.

In the related art, when two channels are to be played, maintaining the mapping relationship between the two generated streams corresponding to the two channels leads to complicated channel management and playback, and there is no effective solution at present.

Contents of the invention

Embodiments of the present invention provide a channel playing and processing method and device, and a channel processing system to at least solve the problem of maintaining two channels corresponding to the generated two code streams in the related art when two channels are to be played. The mapping relationship leads to complex problems in channel management and playback.

According to one aspect of the present invention, a method for playing a channel is provided, including: the streaming media player terminal obtains the main index file for the main channel to be played from the channel list of the streaming media system side device, wherein the main channel The index file carries an extension tag used to mark the sub-index file of the sub-channel; the streaming media playback terminal parses the main index file to obtain the sub-index file; the streaming media playback terminal obtains the sub-index file from the streaming media system The side device acquires the first transport stream TS corresponding to the main index file, and the second transport stream TS corresponding to the sub-index file; Decoding, and playing the decoded main channel and sub-channel on the same display interface.

Further, the streaming media playing terminal playing the decoded main channel and the sub-channel on the same display interface includes: the streaming media playing terminal playing the main channel on the current display interface; the streaming media playing terminal Playing the sub-channel on a partial display interface of the current display interface.

Further, after playing the decoded main channel and the sub-channel on the same display interface, the method further includes: the streaming media playback terminal receives an instruction for closing the sub-channel; the streaming media playback The terminal closes the sub-channel.

Further, the main channel is an adaptive streaming media HLS channel on the Internet, and the sub-channel is a picture-in-picture PIP channel.

Further, the main index is the main m3u8 of the HLS channel, and the sub-index is the primary m3u8 of the PIP channel.

According to one aspect of the present invention, a channel processing method is provided, including: the streaming media system side device adds an extension tag to the main index file of the main channel to be played, and the extension tag is used to mark the sub channel of the sub channel. Index file: the stream media system side device acquires the main index file after adding the extension tag and updates it to the channel list.

Further, before the streaming media system side device adds the extension tag to the main index file of the main channel to be played, the method further includes: the streaming media system side device determines that the display interface of the main channel to be played is playing Simultaneously play said sub-channel.

Further, the main channel is an adaptive streaming media HLS channel on the Internet, and the sub-channel is a picture-in-picture PIP channel.

Further, the main index is the main m3u8 of the HLS channel, and the sub-index is the primary m3u8 of the PIP channel.

According to another aspect of the present invention, there is provided a device for playing channels, which is applied to the streaming media playing terminal side, including: a first acquisition module, configured to acquire the channels to be played from the channel list of the equipment on the streaming media system side. The main index file of the main channel, wherein, the main index file carries an extension tag used to mark the sub-index file of the sub-channel; the parsing module is used to analyze the main index file to obtain the sub-index file; the first Two obtaining module, used to obtain the first transport stream TS corresponding to the main index file and the second transport stream TS corresponding to the sub index file from the streaming media system side device; the playing module is used for The first TS and the second TS are decoded, and the decoded main channel and the sub-channel are played on the same display interface.

Further, the playing module includes: a first playing unit, used to play the main channel on the current display interface; a second playing unit, used to play the sub-channel on a partial display interface of the current display interface.

Further, after playing the decoded main channel and the sub-channel on the same display interface, the device further includes: a receiving module, configured to receive an instruction for closing the sub-channel; a closing module, configured to close the sub-channel. The subchannel.

Further, the main channel is an adaptive streaming media HLS channel on the Internet, and the sub-channel is a picture-in-picture PIP channel.

Further, the main index is the main m3u8 of the HLS channel, and the sub-index is the primary m3u8 of the PIP channel.

According to another aspect of the present invention, a channel processing device is provided, which is applied to the device side of the streaming media system, and includes: an adding module, used to add an extension tag to the main index file of the main channel to be played, so The extended tag is used to mark the sub-index file of the sub-channel; the third obtaining module is used to obtain the main index file added with the extended tag and update it into the channel list.

Further, the device further includes: a determining module, used to determine that while the display interface of the main channel to be played is played, before the adding module adds the extension mark to the main index file of the main channel to be played Play said subchannel.

Further, the main channel is an adaptive streaming media HLS channel on the Internet, and the sub-channel is a picture-in-picture PIP channel.

Further, the main index is the main m3u8 of the HLS channel, and the sub-index is the primary m3u8 of the PIP channel.

According to another aspect of the present invention, a channel processing system is provided, including: the above-mentioned device applied to the streaming media server side and the device applied to the streaming media playing terminal side.

According to the present invention, the extension tag used to mark the sub-index file of the sub-channel is added to the main index file of the main channel to be played, and the first TS corresponding to the main index file can be parsed out when the main channel is played. , and the second transport stream TS corresponding to the sub-index file, and then play the decoded main channel and sub-channel on the same display interface, so that when two channels need to be played, only one channel is needed, thus solving the problem in related technologies When two channels are to be played, maintaining the mapping relationship of the two channels corresponding to the generated two code streams leads to complex channel management and playback.

Description of drawings

The accompanying drawings described here are used to provide a further understanding of the present invention and constitute a part of the application. The schematic embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute improper limitations to the present invention. In the attached picture:

FIG. 1 is a flow chart 1 of a method for playing a channel according to an embodiment of the present invention;

FIG. 2 is a second flowchart of a channel processing method according to an embodiment of the present invention;

FIG. 3 is a first structural block diagram of a channel playing device according to an embodiment of the present invention;

FIG. 4 is a second structural block diagram of a channel processing device according to an embodiment of the present invention;

5 is a structural block diagram of a channel processing system according to an embodiment of the present invention;

Fig. 6 is the structural block diagram of using pip extension mark in OTT live broadcasting system according to the embodiment of the present invention;

7 is a flowchart of a method for generating a channel list according to an embodiment of the present invention;

Fig. 8 is the flow chart of the playing method of OTT live channel and pip according to the embodiment of the present invention;

Fig. 9 is a schematic diagram of the relationship between master, sub, and pip-level m3u8 in ott according to an embodiment of the present invention;

Fig. 10 is a schematic diagram of the composition of the playback proxy module in an OTT environment according to an embodiment of the present invention;

Fig. 11 is a flow chart 1 of a method for using pip extension markers to play pip in OTT live broadcast according to an embodiment of the present invention;

Fig. 12 is a flow chart 2 of a method for using pip extension markers to play pip in OTT live broadcast according to an embodiment of the present invention;

Fig. 13 is a flow chart three of a method for pip playing in OTT live broadcast using pip extension markers according to an embodiment of the present invention;

FIG. 14 is a fourth flowchart of a method for pip playing in OTT live broadcasting using pip extension tags according to an embodiment of the present invention.

detailed description

Hereinafter, the present invention will be described in detail with reference to the drawings and examples. It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other.

It should be noted that the terms "first" and "second" in the description and claims of the present invention and the above drawings are used to distinguish similar objects, but not necessarily used to describe a specific sequence or sequence.

Example 1

In this embodiment, a method for playing a channel is provided. FIG. 1 is a flow chart of a method for playing a channel according to an embodiment of the present invention. As shown in FIG. 1 , the process includes the following steps:

Step S102: The streaming media player terminal acquires the main index file for the main channel to be played from the channel list of the streaming media system side device, wherein the main index file carries an extension tag for marking the sub-index file of the sub-channel;

Step S104: The streaming media player terminal parses the main index file to obtain a sub-index file;

Step S106: The streaming media player terminal acquires a first transport stream (Transport Stream, TS for short) corresponding to the main index file and a second transport stream TS corresponding to the sub-index file from the streaming media system side device;

Step S108: The streaming media player terminal decodes the first TS and the second TS, and plays the decoded main channel and sub-channel on the same display interface.

Through the above-mentioned steps S102 and S108 of this embodiment, through the extension tag used to mark the sub-index file of the sub-channel in the main index file of the main channel to be played, when the main channel is played, the main index file can be parsed out. The corresponding first TS, and the second transport stream TS corresponding to the sub-index file, and then play the decoded main channel and sub-channel on the same display interface, so that when two channels need to be played, only one channel is needed, thus solving the problem In the related art, when two channels are to be played, the mapping relationship between the two channels corresponding to the generated two code streams is maintained, resulting in complex channel management and playback problems.

It should be noted that the main channel involved in this embodiment may be an adaptive streaming media HLS channel on the Internet, and the sub-channel may be a picture-in-picture PIP channel. Based on this, the main index involved in this embodiment is the main m3u8 of the adaptive streaming media (Http Live Streaming, HLS for short) channel on the Internet, and the sub-index is the primary m3u8 of the PIP channel.

Wherein, the M3U8 file refers to the M3U file in UTF-8 encoding format. The M3U file is an indexed plain text file. When it is opened, the playback software does not play it, but finds the network address of the corresponding audio and video file according to its index for online playback.

It can be seen that the main channel and sub-channels involved in this embodiment are preferably streaming media servers and open Internet video service OTT channels; In the specific application scenario, the following four extension tags are used to list the original OTT live broadcast and the main m3u8 with pip extension tags:

(1), OTT live broadcast original master m3u8:

#EXTM3U

#EXT-X-VERSION:1

#EXT-X-STREAM-INF: PROGRAM-ID=2, BANDWIDTH=1383680

01.m3u8

#EXT-X-STREAM-INF: PROGRAM-ID=2, BANDWIDTH=940000

02.m3u8

#EXT-X-STREAM-INF: PROGRAM-ID=2, BANDWIDTH=548960

03.m3u8

(2), OTT live streaming of main m3u8 with pip extension flag:

#EXTM3U

#EXT-X-VERSION:1

#EXT-X-STREAM-INF: PROGRAM-ID=2, BANDWIDTH=1383680

01.m3u8

#EXT-X-STREAM-INF: PROGRAM-ID=2, BANDWIDTH=940000

02.m3u8

#EXT-X-STREAM-INF: PROGRAM-ID=2, BANDWIDTH=548960

03.m3u8

## EXT-X-STREAM-INF-PIP:PROGRAM-ID=2

#index.m3u8

(3), master m3u8 with fixed pip play extension flag in OTT live:

#EXTM3U

#EXT-X-VERSION:1

#EXT-X-STREAM-INF: PROGRAM-ID=2, BANDWIDTH=1383680

01.m3u8

#EXT-X-STREAM-INF: PROGRAM-ID=2, BANDWIDTH=940000

02.m3u8

#EXT-X-STREAM-INF: PROGRAM-ID=2, BANDWIDTH=548960

03.m3u8

## EXT-X-STREAM-INF-PIP:PROGRAM-ID=2

#index.m3u8

#PERSISTENT-PIP

(4), the main m3u8 of the pip extension tag with the pip playback window width, height and coordinates of the upper left corner of the playback in the OTT live broadcast:

#EXTM3U

#EXT-X-VERSION:1

#EXT-X-STREAM-INF: PROGRAM-ID=2, BANDWIDTH=1383680

01.m3u8

#EXT-X-STREAM-INF: PROGRAM-ID=2, BANDWIDTH=940000

02.m3u8

#EXT-X-STREAM-INF: PROGRAM-ID=2, BANDWIDTH=548960

03.m3u8

## EXT-X-STREAM-INF-PIP:PROGRAM-ID=2

#index.m3u8

#WIDTH-PIP:100

#HEIGHT-PIP: 200

#COORD-PIP: 100, 200

It can be seen that in this embodiment, by adding: ##EXT-X-STREAM-INF-PIP and the pip extension tag of #index.m3u8 in the main m3u8 of OTT live broadcast, index.m3u8 is the first level of pip The relative path of m3u8 in the streaming server. Through this pip extension mark, the first-level m3u8 of the pip channel corresponding to hls is integrated into the main m3u8 of hls.

In addition, it should be noted that #PERSISTENT-PIP in (3) represents the fixed playback mark of pip extension, #WIDTH-PIP in (4) represents the playback width of pip extension, and #HEIGHT-PIP represents the playback width of pip extension , #COORD-PIP indicates the coordinate position of the upper left corner of pip extension playback.

In another optional implementation of this embodiment, the manner in which the streaming media playback terminal involved in this embodiment plays the decoded main channel and sub-channel on the same display interface may include:

Step S108-1: The streaming media player terminal plays the main channel on the current display interface;

Step S108-2: The streaming media player terminal plays the sub-channel on the partial display interface of the current display interface.

It can be seen from the above steps S108-1 and S108-2 that the sub-channel is played on the same display interface as the main channel, and is only a part of the current display interface; in combination with the above-mentioned four specific extension marks, in this embodiment the extension The mark can be fixed or not, that is to say, the sub-channel can be fixed, or one of multiple extended marks can be selected to play according to needs; in addition, based on the above-mentioned fourth type of extended mark, the position of the sub-channel can also be played For setting, that is, what percentage of the current display interface and where it appears can be set. For example, the sub-channel is preferably located at the upper left corner or upper right corner of the current display interface, accounting for 1/8 of the entire display interface.

In addition, in an optional implementation of this embodiment, after playing the decoded main channel and sub-channel on the same display interface, the method further includes: the streaming media playback terminal receives an instruction for closing the sub-channel, and then the streaming media playback Terminals can close subchannels. That is to say, when playing the PIP channel and the HLS channel on the same display interface, the user can close the PIP channel as required, and only play the HLS channel.

Example 2

Fig. 2 is a flow chart 2 of a channel processing method according to an embodiment of the present invention. As shown in Fig. 2, the steps of the method include:

Step S202: The streaming media system side device adds an extension tag to the main index file of the main channel to be played, and the extension tag is used to mark the sub-index file of the sub-channel;

Step S204: The streaming media system side device acquires the main index file with the extension tag added and updates it to the channel list.

It should be noted that the streaming media system side device includes: an OTT electronic program guide (Electronic Program Guide, EPG for short) platform, wherein step S202 is executed by the streaming media server, and step S204 is executed by the OTT EPG.

In another optional implementation of this embodiment, before the streaming media system side device adds the extension tag to the main index file of the main channel to be played, the method of this embodiment further includes: the streaming media system side device determines The sub-channel is simultaneously played on the display interface of the main channel to be played.

Through the description of the above embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is Better implementation. Based on such an understanding, the essence of the technical solution of the present invention or the part that contributes to the prior art can be embodied in the form of software products, and the computer software products are stored in a storage medium (such as ROM/RAM, disk, CD) contains several instructions to enable a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in various embodiments of the present invention.

Example 3

In this embodiment, a device for playing a channel is also provided. The device is used to implement the above embodiments and preferred implementation modes, and what has been described will not be repeated here. As used below, the term "module" may be a combination of software and/or hardware that realizes a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, implementations in hardware, or a combination of software and hardware are also possible and contemplated.

Fig. 3 is a structural block diagram 1 of a device for playing a channel according to an embodiment of the present invention, the device is applied to a streaming media playing terminal side, as shown in Fig. Acquire the main index file for the main channel to be played in the channel list of the side device, wherein the main index file carries the extension mark for the sub-index file of the sub-channel; the parsing module 34 is coupled with the first acquisition module 32 Connection, for analyzing the main index file to obtain the sub-index file; the second acquisition module 36, coupled with the analysis module 34, for obtaining the first transport stream TS corresponding to the main index file from the streaming media system side device, and The second transport stream TS corresponding to the sub-index file; the playback module 38, coupled with the second acquisition module 36, is used to decode the first TS and the second TS, and play the decoded main channel and sub-channel on the same display interface channel.

Optionally, after playing the decoded main channel and sub-channel on the same display interface, the device further includes: a receiving module, configured to receive an instruction for closing the sub-channel; and a closing module, configured to close the sub-channel.

Optionally, the playing module 38 includes: a first playing unit for playing the main channel on the current display interface; a second playing unit for playing the sub-channel on a partial display interface of the current display interface.

It should be noted that the above-mentioned modules can be realized by software or hardware. For the latter, it can be realized by the following methods, but not limited to this: the above-mentioned modules are all located in the same processor; or, the above-mentioned modules can be combined in any combination The forms of are located in different processors.

Example 4

Fig. 4 is a structural block diagram 2 of a channel processing device according to an embodiment of the present invention. The device is applied to the device side of the streaming media system. As shown in Fig. 4 , the device includes: an adding module 42 for adding an extension tag to In the main index file of the main channel to be played, the extension tag is used to mark the sub-index file of the sub-channel; the third obtaining module 44 is used to obtain the main index file after adding the extension tag and update it into the channel list.

Optionally, the device may further include: a determining module, used to determine to play the sub-channel while playing the display interface of the main channel to be played before the adding module adds the extension mark to the main index file of the main channel to be played .

It should be noted that the above-mentioned modules can be realized by software or hardware. For the latter, it can be realized by the following methods, but not limited to this: the above-mentioned modules are all located in the same processor; or, the above-mentioned modules can be combined in any combination The forms of are located in different processors.

Example 5

FIG. 5 is a structural block diagram of a channel processing system according to an embodiment of the present invention. As shown in FIG. 5 , the system includes: the device of Embodiment 3 and the device of Embodiment 4.

It should be noted that the above-mentioned embodiment 3 and embodiment 4 are device embodiments respectively corresponding to the method embodiment 1 and embodiment 2 of this embodiment, so the principle of the scheme is consistent, and the corresponding explanations are also consistent That is to say, they are consistent in the realization of the whole solution, and the above method embodiment can be used to explain and illustrate the device embodiment 3 and embodiment 4.

Below in conjunction with specific embodiment 6 and accompanying drawing, the present invention is described in detail;

Example 6

This embodiment provides a method and device for using pip extension tags to play pip in OTT live broadcast.

Fig. 6 is the structural block diagram of using pip extension mark in OTT live broadcasting system according to the embodiment of the present invention, as shown in Fig. 6, this system comprises: stream media server module, channel management module, digital TV set top box (Set Top Box , STB for short) channel receiving module, STB channel analysis module, STB m3u8 processing module, STB player module, also includes pip extension tag generation and integration module, pip extension tag analysis module.

The streaming media server module is used to generate the code stream of the OTT live channel and the main and sub-m3u8, generate the small code stream of pip and the first-level m3u8 file of pip;

The pip extension tag generation and integration module is used to put the extension tag of pip into the main m3u8 of the OTT live channel to generate a new main m3u8 of the OTT live channel;

The channel management module is used to obtain the new main m3u8 of the OTT live channel and generate the OTT live channel.

The channel receiving module of the STB is used to obtain the channel list from the channel management module after the STB successfully logs into the OTT EPG template;

STB's channel parsing module is used to parse the received channel list and display it on STB's OTTEPG. The user selects a channel for OTT live broadcast, the m3u8 processing module obtains the main m3u8 file of the channel from the streaming media server module, and starts the analysis of the main m3u8;

At this time, the pip extension tag parsing module judges whether there is a pip extension tag, and if so, stores the pip m3u8 information corresponding to the channel, and then the m3u8 processing module of the STB starts to download the sub-m3u8 file from the streaming media server module, and parses the sub-m3u8 file , download the ts segment, and then send the code stream to the STB player to start OTT live broadcast and pip playback.

Based on the above-mentioned system device of the present embodiment, the steps of the method for using the pip extension tag in the OTT live broadcast in the present embodiment include:

Step S602: A channel on the streaming server side corresponds to two code streams of hls and pip, and the pip extension tag generation and integration module integrates the primary m3u8 of pip into the main m3u8 of hls through the pip extension tag.

Step S604: The channel management module processes the update master m3u8 of a channel to generate an hls channel.

Step S606: After the STB or the channel receiving module in the client software successfully logs in to the OTT EPG platform, the set-top box receives the channel list issued by the channel management module, and the channel information is analyzed by the channel analysis module of the STB or the client software, and displayed on the On the OTT EPG template of STB or client software.

Step S608: The user uses the remote control to select an hls channel, the STB or the client software obtains the main m3u8 file of the channel from the streaming media server, and the pip extension tag parsing module of the STB or the client software analyzes it, if the main m3u8 file in the hls If there is a pip extension tag in it, the first-level m3u8 information of pip is parsed out, and then the m3u8 processing module starts to process the m3u8 information of hls and pip.

Step S610: The m3u8 processing module requests the hls ts fragment file from the streaming media server to be played by the player. If there is pip playback, the m3u8 processing module requests the pip ts fragment from the streaming media server, and the player performs pip playback .

Step S612: the user closes the playback of the hls channel, the m3u8 processing module exits, and the player exits.

Step S614: the user closes the pip channel playback, the pip extension tag parsing module, the m3u8 processing module exits, and the player exits.

Step S616: The user switches the channel, then enters S612, S614, S608, S610.

Through the above method of this embodiment, when generating the main m3u8 of the OTT live channel, the information of the pip channel is integrated into the main m3u8 file of the OTT live channel through the pip extension tag, so that the same channel OTT live and pip only needs to generate a channel information in the channel management system, and does not need to maintain the mapping relationship between OTT live channels and pip channels. When end users need to play OTT live broadcast and pip, they only need to process the information of one channel, and do not need Maintain the mapping relationship between OTT live broadcast and pip, pip playback can be done by analyzing the extended pip tag in the main m3u8 of the channel, which simplifies the channel system and terminal channel management and playback management, and also facilitates the expansion of pip playback position in OTT, Other pip characteristics such as size; thereby overcome the problem that two channels need to be generated for hls and pip playback in the OTT system in the related art, and the mapping relationship between the hls channel and the pip channel needs to be maintained.

FIG. 7 is a flowchart of a method for generating a channel list according to an embodiment of the present invention. As shown in FIG. 7, the steps of the method include:

Step S702: the encoder component of the streaming media server judges whether the hls channel being encoded has a pip requirement, if so, enters S704, S706, S708, S710, otherwise enters S712;

Step S704: Obtain the main m3u8 file of the hls channel;

Step S706: Obtain the relative address of the first-level m3u8 of pip;

Step S708: adding extended pip flags in the main m3u8 of the hls channel;

Step S710: update the main m3u8 of the hls channel, and then enter S712;

Step S712: publish the main m3u8 of the hls channel;

Step S714: the channel management module collects hls channel-related information and generates an hls channel.

Fig. 8 is the flow chart of the playing method of OTT live channel and pip according to the embodiment of the present invention, as shown in Fig. 8, the steps of this method include:

Step S802: The STB logs into the OTT EPG channel management module.

Step S804: The OTT EPG channel management module sends the channel list to the channel receiving module of the STB.

Step S806: The channel analyzing module analyzes the channel list of the channel receiving module, and displays it on the OTT EPG template of the STB.

Step S808: the user uses the remote controller to select a channel to play, and the STB obtains the main m3u8 file of the channel from the streaming media server.

Step S810: The pip extension tag parsing module judges whether there is a pip extension tag in the main m3u8 of the channel, and if so, proceeds to S812; otherwise, proceeds to S818.

Step S812: The pip extension tag parsing module parses out the primary m3u8 address of pip.

Step S814: Determine whether there is a pip play request, if yes, go to S816, otherwise go to S818.

Step S816: the m3u8 processing module obtains pip first-level m3u8 and ts fragments.

Step S818: the m3u8 processing module obtains the m3u8 and ts segments of the ott live broadcast.

Step S820: the m3u8 processing module distributes the ts segment to the player.

Step S822: The player decodes and plays the corresponding program.

Fig. 9 is a schematic diagram of the relationship between master, sub, and pip first-level m3u8 in OTT according to an embodiment of the present invention. As shown in Fig. 9, a new addition is added in the master m3u8 of OTT live broadcast: ##EXT-X-STREAM-INF-PIP, and the pip extension tag for #index.m3u8. In addition, according to the industry-standard m3u8 protocol, 01.m3u8 in the main m3u8 of the OTT live broadcast points to the sub-01.m3u8 of the OTT live broadcast, and 01.m3u8 contains each ts segment of this program. Also, 02.m3u8 and 03.m3u8 are similar.

Among them, the extension mark of pip, according to the method of extension analysis, index.m3u8 points to the first-level m3u8 of pip, and the first-level m3u8 contains the ts fragment of pip.

Figure 10 is a schematic diagram of the composition of the playback proxy module in the OTT environment according to an embodiment of the present invention. As shown in Figure 10, the playback proxy module includes: the playback proxy consists of an m3u8 processing module, a pip extension tag parsing module, and an m3u8 forwarding module. The m3u8 forwarding module is responsible for processing the player's m3u8 and ts requests, and sends the requests to the m3u8 processing module for processing. The m3u8 processing module is responsible for interacting with the streaming media server to obtain m3u8 and ts, and after processing by this module and the pip extension tag analysis module, Send the m3u8 and ts to the m3u8 forwarding module, and the m3u8 forwarding module returns the m3u8 and ts to the player.

Embodiment 7:

In this embodiment, the player is deployed in the STB/Pad/mobile phone to carry out OTT hls and pip video services. Based on Figure 6, this embodiment provides a method for using pip extension tags to play pip in OTT live broadcasting, as shown in Fig. 11 is a flow chart of a method for using pip extension tags to play pip in OTT live broadcast according to an embodiment of the present invention. As shown in FIG. include:

Step S1102: the encoder in the streaming server encodes the code stream of hls live broadcast and pip, and extends the pip tag to the main m3u8 of hls live broadcast.

Step S1104: the media server publishes the hls live broadcast information.

Step S1106: the channel management system generates the hls live channel.

Step S1108: The STB/Pad/mobile phone logs in to the OTT EPG platform, obtains the channel list issued by the channel management module, analyzes it by the channel analysis module, and displays it on the OTT EPG template of the STB.

Step S1110: The user uses the remote control to select an hls channel, the STB/Pad/mobile phone interacts with the streaming server to obtain the main m3u8, the streaming server returns the main m3u8, the STB/Pad/mobile phone parses the main m3u8, if there is pip extension tag information , then analyze the extended pip information of the main m3u8, and then the STB/Pad/mobile phone obtains the sub-m3u8 and ts of hls and pip from the streaming server.

Step S1112: The streaming media server returns the sub-m3u8 and ts of hls and pip to the STB/Pad/mobile phone, and starts playing hls and pip.

Embodiment 8:

Fixed live broadcast of pip in OTT environment.

In this embodiment, the player is deployed in the STB/Pad/mobile phone to carry out OTT hls and pip video services. Based on Figure 6, this embodiment provides a method for using pip extension tags to play pip in OTT live broadcasting, as shown in Fig. 12 is the second flow chart of a method for using pip extension markers to play pip in OTT live broadcast according to an embodiment of the present invention. As shown in FIG. 12 , the steps of the method include:

S1202: The encoder in the streaming server encodes the code stream of hls live broadcast and advertisement pip, extends the pip mark of the advertisement code stream to the main m3u8 of hls live broadcast, and adds the fixed advertisement pip mark of #PERSISTENT-PIP in the pip extension mark.

S1204: The media server publishes the hls live broadcast information.

S1206: The channel management system generates the hls live channel.

S1208: The STB/Pad/mobile phone logs in to the OTT EPG platform, obtains the channel list issued by the channel management module, analyzes it by the channel analysis module, and displays it on the OTT EPG template of the STB.

S1210: The user uses the remote control to select an hls channel, the STB/Pad/mobile phone interacts with the streaming server to obtain the main m3u8, the streaming server returns the main m3u8, the STB/Pad/mobile phone parses the main m3u8, and if there is pip extension information, then Parse the extended pip information of the main m3u8, and then the STB/Pad/mobile phone obtains the sub-m3u8 and ts of hls and pip from the streaming server.

S1212: The streaming media server returns the sub-m3u8 and ts of hls and pip to the STB/Pad/mobile phone, and starts playing hls and pip. If the extension tag of pip can be parsed to the fixed advertisement pip tag of #PERSISTENT-PIP, then pip The playback is controlled by the player. When the hls live broadcast is not exited, the pip playback will always exist and cannot be fast forwarded or rewinded. In the case of an OTT live broadcast, the pip will always play without exiting the effect.

Embodiment 9:

In this embodiment, the playback agent deployed in the STB/Pad/mobile phone (the playback agent here refers to the processing module that supports the pip extension mark, not the player), and the player is deployed on the STB/Pad/mobile phone, with Develop OTT hls and pip video services. Based on FIG. 6 , this embodiment provides a method for using pip extension tags to play pip in OTT live broadcasting. FIG. 13 is a flowchart three of a method for using pip extension tags to play pip in OTT live broadcasting according to an embodiment of the present invention, as shown in FIG. As shown in Figure 13, the proxy hls and pip of the third-party player in the OTT environment, the steps of the method include:

Step S1302, the encoder in the streaming media server encodes the code stream of hls live broadcast and pip, and extends the pip tag to the main m3u8 of hls live broadcast.

Step S1304, the media server publishes the hls live broadcast information.

Step S1306, the channel management system generates the hls live channel.

Step S1308, the STB/Pad/mobile phone logs in to the OTT EPG platform, obtains the channel list issued by the channel management module, analyzes it by the channel analysis module, and displays it on the template of the STB.

Step S1310, the user uses the remote controller to select an hls channel on the STB, the STB player forwards the playback request to the playback agent, and the playback agent interacts with the streaming media server to obtain the main m3u8, and if there is pip extension information, parse out the pip one Level m3u8, then obtain the ts of hls and pip from the streaming media server, and m3u8, and then return the m3u8 and ts data of hls and pip to the player, and the player passively receives the data and starts playing hls and pip.

Embodiment 10:

The player is deployed in the STB/Pad/mobile phone to carry out OTT hls and pip video services. Based on FIG. 6 , this embodiment provides a method for using pip extension tags to play pip in OTT live broadcasting. FIG. 14 is a flowchart four of a method for using pip extension tags to play pip in OTT live broadcasting according to an embodiment of the present invention, as As shown in Figure 14, under the Ott environment, the position and size of the pip can be adjusted to play, as shown in Figure 14, the steps of the method include:

Step S1402: The encoder in the streaming server encodes the code stream of hls live broadcast and advertising pip, and the pip mark of the extended code stream is sent to the main m3u8 of hls live broadcast. In addition, the extended mark needs to carry the size and display position of pip, specifically the new Add #WIDTH-PIP, #HEIGHT-PIP, #COORD-PIP 3 pip tags, which respectively represent the width, height, and coordinate value of the upper left corner of the video played by pip.

Step S1404: the media server publishes the hls live broadcast information.

Step S1406: the channel management system generates the hls live channel.

Step S1408: The STB/Pad/mobile phone logs in to the OTT EPG platform, obtains the channel list issued by the channel management module, analyzes it by the channel analysis module, and displays it on the OTT EPG template of the STB.

Step S1410: The user uses the remote control to select an hls channel, the STB/Pad/mobile phone interacts with the streaming server to obtain the main m3u8, the streaming server returns the main m3u8, the STB/Pad/mobile phone parses the main m3u8, if there is pip extension information, Then analyze the extended pip information of the main m3u8, and then the STB/Pad/mobile phone obtains the sub-m3u8 and ts of hls and pip from the streaming media server.

Step S1412: The streaming media server returns the sub-m3u8 and ts of hls and pip to the STB/Pad/mobile phone, and starts playing hls and pip, if there are #WIDTH-PIP, #HEIGHT-PIP, #COORD-PIP in the pip extension tag pip playback attribute mark, then the playback of pip will be controlled by the player according to the position and size information of pip.

To sum up, in the OTT environment provided by this embodiment, hls and pip are integrated into one channel by extending m3u8 through pip, which solves the complexity of managing multiple channels in the head-end channel management system and solves the problem of rapid expansion The complexity of other features of pip simplifies the management of the mapping relationship between hls channel and pip channel, improves the value of OTT live broadcast and pip business, and reduces the load of channel management system, STB/mobile phone/Pad management and broadcast channels.

Optionally, for specific examples in this embodiment, reference may be made to the examples described in the foregoing embodiments and optional implementation manners, and details are not repeated in this embodiment.

Obviously, those skilled in the art should understand that each module or each step of the above-mentioned present invention can be realized by a general-purpose computing device, and they can be concentrated on a single computing device, or distributed in a network formed by multiple computing devices Alternatively, they may be implemented in program code executable by a computing device so that they may be stored in a storage device to be executed by a computing device, and in some cases in an order different from that shown here The steps shown or described are carried out, or they are separately fabricated into individual integrated circuit modules, or multiple modules or steps among them are fabricated into a single integrated circuit module for implementation. As such, the present invention is not limited to any specific combination of hardware and software.

The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and changes. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention shall be included within the protection scope of the present invention.

Claims (19)

1. A method for playing a channel, comprising: The streaming media playback terminal obtains the main index file for the main channel to be played from the channel list of the streaming media system side device, wherein the main index file carries an extension tag for marking the sub-index file of the sub-channel; The streaming media player terminal parses the main index file to obtain the sub-index file; The streaming media playback terminal acquires a first transport stream TS corresponding to the main index file and a second transport stream TS corresponding to the sub index file from the streaming media system side device; The streaming media player terminal decodes the first TS and the second TS, and plays the decoded main channel and the sub-channel on the same display interface. 2. The method according to claim 1, wherein the streaming media player terminal playing the decoded main channel and the sub-channel on the same display interface comprises: The streaming media player terminal plays the main channel on the current display interface; The streaming media player terminal plays the sub-channel on a partial display interface of the current display interface. 3. The method according to claim 1, characterized in that, after playing the decoded main channel and the sub-channel on the same display interface, the method further comprises: The streaming media player terminal receives an instruction for closing the sub-channel; The streaming media player terminal closes the sub-channel. 4. The method according to claim 2, wherein the main channel is an adaptive streaming media HLS channel on the Internet, and the sub-channel is a picture-in-picture PIP channel. 5. The method according to claim 4, wherein the main index is the main m3u8 of the HLS channel, and the sub-index is the primary m3u8 of the PIP channel. 6. A processing method for a channel, comprising: The streaming media system side device adds an extension tag to the main index file of the main channel to be played, and the extension tag is used to mark the sub-index file of the sub-channel; The streaming media system side device acquires the main index file with the extension tag added and updates it to the channel list. 7. The method according to claim 6, characterized in that, before the streaming media system side device adds the extension tag to the main index file of the main channel to be played, the method further comprises: The streaming media system side device determines to play the sub-channel while playing the display interface of the main channel to be played. 8. The method according to claim 6, wherein the main channel is an adaptive streaming media HLS channel on the Internet, and the sub-channel is a picture-in-picture PIP channel. 9. The method according to claim 8, wherein the main index is the main m3u8 of the HLS channel, and the sub-index is the primary m3u8 of the PIP channel. 10. A playing device for a channel, applied to a streaming media playing terminal side, characterized in that it comprises: The first obtaining module is used to obtain the main index file for the main channel to be played from the channel list of the streaming media system side device, wherein the main index file carries the extension of the sub-index file used to mark the sub-channel mark; A parsing module, configured to parse the main index file to obtain the sub-index file; A second acquiring module, configured to acquire a first transport stream TS corresponding to the main index file and a second transport stream TS corresponding to the sub-index file from the streaming media system side device; A playing module, configured to decode the first TS and the second TS, and play the decoded main channel and sub-channel on the same display interface. 11. The device according to claim 10, wherein the playing module comprises: The first playing unit is used to play the main channel on the current display interface; The second playing unit is configured to play the sub-channel on a partial display interface of the current display interface. 12. The device according to claim 10, wherein after playing the decoded main channel and the sub-channel on the same display interface, the device further comprises: a receiving module, configured to receive an instruction for closing the sub-channel; The closing module is used to close the sub-channel. 13. The device according to claim 11, wherein the main channel is an adaptive streaming media HLS channel on the Internet, and the sub-channel is a picture-in-picture PIP channel. 14. The device according to claim 13, wherein the main index is the main m3u8 of the HLS channel, and the sub-index is the primary m3u8 of the PIP channel. 15. A channel processing device, applied to the device side of the streaming media system, characterized in that it comprises: The adding module is used to add an extension tag to the main index file of the main channel to be played, and the extension tag is used to mark the sub-index file of the sub-channel; The third obtaining module is used to obtain and update the main index file after adding the extension tag into the channel list. 16. The device according to claim 15, further comprising: The determining module is configured to determine to play the sub-channel while playing the display interface of the main channel to be played before the adding module adds the extension mark to the main index file of the main channel to be played. 17. The device according to claim 15, wherein the main channel is an adaptive streaming media HLS channel on the Internet, and the sub-channel is a picture-in-picture PIP channel. 18. The device according to claim 17, wherein the main index is the main m3u8 of the HLS channel, and the sub-index is the primary m3u8 of the PIP channel. 19. A channel processing system, comprising: the device according to any one of claims 10 to 14 and the device 18 according to any one of claims 15.