CN104348781A - Multimedia service transmission method and terminal equipment - Google Patents

Abstract

The invention discloses a multimedia service transmission method and terminal equipment, and relates to the communication field. The method disclosed in the present invention includes: the terminal acquires the currently available network transmission rate, and acquires the decoded output code rate of the multimedia content with the same service attribute as the applied multimedia service; the terminal at least at least acquires the acquired network transmission rate and multimedia decoding The smaller value of the output code rate is sent to the multimedia service provider; the terminal receives the multimedia service provider according to the terminal's network transmission rate and the smaller value of the decoding output code rate. business content. The invention also discloses a terminal device. The technical solution of the present application can well negotiate the multimedia service capabilities instantly supported by the terminal, so that the multimedia provider can match the best multimedia service content and send it to the terminal, providing the best user experience of the terminal.

Description

A multimedia service transmission method and terminal equipment

technical field

The present invention relates to the communication field, and more specifically relates to a multimedia service transmission method and terminal equipment.

Background technique

With the development of mobile communication technology and the popularization of intelligent terminals, mobile multimedia services are also developing faster and faster. Users can enjoy rich multimedia services through mobile smart terminals, such as mobile TV, online high-definition video, and so on. When a terminal uses multimedia services, it usually conducts capability negotiation with a server or other terminal that provides multimedia services, and informs the other party of the device capabilities of the terminal, such as supported multimedia formats, resolutions, bit rates, etc. After the capability negotiation is passed, the adaptation The multimedia content of the terminal can be delivered to the terminal for display. But this existing technology considers the inherent capabilities of the terminal equipment, not the dynamic capabilities. This is because factors such as the network transmission rate and the real-time processing capability of the terminal also affect the user's multimedia service experience. When the network transmission rate is guaranteed and the real-time processing capability of the terminal can handle multimedia service content, users can obtain normal multimedia experience. When the network communication is not smooth or the terminal also needs to process other parallel services and does not have enough idle resources to process multimedia service content, the multimedia service will not proceed smoothly. The problem of how to develop multimedia services when the terminal's dynamic capability changes has not been solved in the prior art.

Contents of the invention

The technical problem to be solved by the present invention is to provide a multimedia service transmission method and terminal equipment to solve the problem of multimedia service transmission under the condition of terminal dynamic capability change.

In order to solve the above technical problems, the present invention discloses a multimedia service transmission method, which includes:

The terminal obtains the currently available network transmission rate, and obtains the decoded output code rate of the multimedia content with the same service attribute as the applied multimedia service;

The terminal at least sends the smaller value of the acquired network transmission rate and multimedia decoding output code rate to the multimedia service provider;

The terminal receives the multimedia service content delivered by the multimedia service provider according to the smaller value of the terminal's network transmission rate and decoding output code rate.

Optionally, in the above method, the terminal at least sends the smaller value of the obtained network transmission rate and multimedia decoding output code rate to the multimedia service provider:

The terminal sends the smaller value of the acquired network transmission rate and multimedia decoding output code rate to the multimedia service provider; or

The terminal sends both the acquired network transmission rate and the multimedia decoding output code rate to the multimedia service provider.

Optionally, in the above method, when the terminal sends both the acquired network transmission rate and multimedia decoding output code rate to the multimedia service provider, the terminal sends the acquired network transmission rate and multimedia decoding output code rate Rates are sent to the multimedia service provider at the same time or separately.

Optionally, in the above method, the terminal obtaining the decoded output code rate of the multimedia content with the same service attribute as the applied multimedia service refers to:

The terminal obtains the multimedia decoding output code rate of the local multimedia content with the same service attribute according to the service attribute of the applied multimedia service; or

The terminal obtains a multimedia content segment with the same service attribute as the applied multimedia service for decoding, and obtains a multimedia decoding output code rate; or

The terminal obtains the decoded output code rate when the terminal plays the multimedia content of the applied multimedia service.

Optionally, in the above method, before the step of obtaining the same multimedia decoding output code rate as the service attribute of the applied multimedia service, the method further includes:

The terminal applies for a multimedia service from the multimedia service provider;

The multimedia service provider feeds back the service attribute of the multimedia service applied by the terminal to the terminal.

Optionally, in the above method, the service attribute of the multimedia service includes at least the code rate of the multimedia service content, and one or more of the following information:

Encapsulation format, encoding format, and resolution of multimedia service content.

Optionally, in the above method, the network transmission rate includes a downlink transmission rate.

The invention also discloses a terminal device, including:

The first unit obtains the currently available network transmission rate and the same multimedia decoding output code rate as the service attribute of the applied multimedia service;

The second unit sends at least the smaller value of the obtained network transmission rate and multimedia decoding output code rate to the multimedia service provider;

The third unit receives the multimedia service content delivered by the multimedia service provider according to the smaller value of the terminal's network transmission rate and decoding output code rate.

Optionally, in the terminal device above, the second unit at least sending the smaller value of the acquired network transmission rate and multimedia decoding output code rate to the multimedia service provider means:

The second unit sends the smaller value of the obtained network transmission rate and multimedia decoding output code rate to the multimedia service provider; or

Sending both the acquired network transmission rate and the multimedia decoding output code rate to the multimedia service provider.

Optionally, in the terminal device above, when the second unit sends both the acquired network transmission rate and the multimedia decoding output code rate to the multimedia service provider, the acquired network transmission rate and the multimedia decoding output code rate Rates are sent to the multimedia service provider at the same time or separately.

Optionally, in the above-mentioned terminal device, the first unit obtaining the same multimedia decoding output code rate as the service attribute of the applied multimedia service refers to:

The first unit obtains the multimedia decoding output code rate of the local multimedia content with the same service attribute according to the service attribute of the applied multimedia service; or

Obtain and decode multimedia content fragments with the same service attributes as the applied multimedia service, and obtain the output code rate of multimedia decoding; or

Obtain the decoded output code rate when playing the multimedia content of the applied multimedia service locally.

Optionally, the above-mentioned terminal equipment also includes:

The fourth unit is to apply for a multimedia service from the multimedia service provider, and receive the service attribute of the multimedia service fed back by the multimedia service provider.

Optionally, in the above terminal device, the service attribute of the multimedia service includes at least the code rate of the multimedia service content, and one or more of the following information:

Encapsulation format, encoding format, and resolution of multimedia service content.

Optionally, in the above terminal device, the network transmission rate includes a downlink transmission rate.

It can be seen from the above embodiments that the technical solution of the present application sends the real-time transmission rate of the terminal network and the multimedia decoding output code rate, or the smaller value of the two, to the multimedia provider at the user terminal, which can well negotiate the real-time support of the terminal. Multimedia service capabilities, so that the multimedia provider can match the best multimedia service content and deliver it to the terminal, providing the best user experience for the terminal.

Description of drawings

Fig. 1 is the flowchart of multimedia service transmission in the embodiment of the present invention;

Fig. 2 is a schematic diagram of the system structure in the embodiment of the present invention.

Detailed ways

In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be further described in detail below in conjunction with the accompanying drawings. It should be noted that, in the case of no conflict, the embodiments of the present application and the features in the embodiments can be combined with each other arbitrarily.

Example 1

This embodiment provides a multimedia service transmission method, the method is based on the real-time conditions of the network communication between the terminal and the multimedia provider and the real-time state of the terminal processing capability to transmit the multimedia service, that is, the terminal needs to notify the multimedia service provider The real-time status of the relevant terminal in order to negotiate the best multimedia service experience. The implementation process of this method is shown in Figure 1, including the following operations:

Step 100, the terminal obtains the currently available network transmission rate, and obtains the decoded output code rate of the multimedia content with the same service attribute as the applied multimedia service;

The service attributes of the above-mentioned multimedia services include at least the code rate of the multimedia service content, and one or more of the following information:

Encapsulation format, encoding format, and resolution of multimedia service content.

The network transmission rate at least includes the downlink transmission rate.

In addition, in the above step 100, when the terminal obtains the decoded output code rate of the multimedia content with the same service attribute as the applied multimedia service, various methods can be adopted, and this embodiment provides the following three acquisition methods (of course, the technical solution of this application The acquisition methods in are not limited to the following three):

1) The terminal obtains the multimedia decoding output code rate of the local multimedia content with the same service attribute according to the service attribute of the applied multimedia service.

2) The terminal obtains and decodes the multimedia content segment with the same service attribute as the applied multimedia service, and obtains the multimedia decoding output code rate; or

3) The terminal obtains the decoding output code rate when the terminal plays the multimedia content of the applied multimedia service.

Step 200, the terminal sends at least the smaller value of the obtained network transmission rate and multimedia decoding output code rate to the multimedia service provider;

In the above step 200, the terminal at least sends the smaller value of the obtained network transmission rate and multimedia decoding output code rate to the multimedia service provider:

The terminal may send the smaller value of the obtained network transmission rate and the multimedia decoding output code rate to the multimedia service provider. It is also possible to send both the acquired network transmission rate and the multimedia decoding output code rate to the multimedia service provider.

It should be noted that if the terminal sends both the acquired network transmission rate and the multimedia decoding output code rate to the multimedia service provider, when selecting the sending method, the acquired network transmission rate and the multimedia decoding output code rate can be simultaneously Or send them to the multimedia service provider respectively. For example, the same piece of information is used to simultaneously send the network transmission rate and the multimedia decoding output code rate to the multimedia service provider. Of course, it is also possible to use two pieces of information to send the network transmission rate and the multimedia decoding output code rate to the multimedia service provider.

Step 300, the terminal receives the multimedia service content delivered by the multimedia service provider according to the smaller value of the terminal's network transmission rate and decoding output code rate.

On the basis of the above method, before the terminal obtains the step of multimedia decoding output code rate identical to the service attribute of the applied multimedia service, the following operations may also be included:

The terminal applies for the multimedia service from the multimedia service provider;

The multimedia service provider feeds back the service attribute of the multimedia service applied by the terminal to the terminal.

The foregoing method will be described in detail below in combination with specific application scenarios.

Application scenario 1, the user needs to order an online high-definition video program through a mobile terminal. Assuming that the code rate of this multimedia content is 2Mbps, then the network transmission rate for the mobile terminal to obtain the content must reach 2Mbps, and at the same time, the decoding and output capability of the multimedia content of the mobile terminal must also reach 2Mbps. Of course, the mobile terminal must also support the media encoding format of the multimedia. , display resolution and other requirements. However, if any of the first two indicators is not satisfied, users will experience freezes when enjoying online high-definition programs. However, the real-time transmission rate of network communication and the processing capability of the terminal may change at any time. If the theoretical requirements for multimedia services cannot be met, it is necessary to negotiate the real-time capability information of the terminal in time to apply for multimedia services that can be adapted to the terminal (such as applying for standard-definition services). or low-bit-rate multimedia content). Specifically, in this scenario, the transmission process of multimedia services is as follows:

Step 1: The mobile terminal applies for a multimedia service from a multimedia service provider, and the multimedia service provider returns the service attribute of the multimedia service.

The above multimedia services may be video, audio, picture or a mixture of these.

The service attributes of the above-mentioned multimedia service include at least the code rate of the multimedia service content, and optionally, parameters such as encapsulation format, encoding format, and resolution of the multimedia service content.

Step 2: The mobile terminal obtains the currently available network transmission rate.

In this step, through some speed measurement software, the smart phone terminal can easily obtain the network transmission rate. It should be noted that, in this step, the downlink transmission rate is mainly obtained to evaluate whether the multimedia service content can be delivered to the terminal smoothly.

Step 3: The mobile terminal obtains the real-time decoding output code rate of the multimedia content with the same service attribute according to the service attribute of the multimedia service.

Because the terminal can process multimedia content when it is idle, when the terminal processes other services and processes multimedia in parallel, due to lack of processing resources, the normal multimedia decoding output code rate may not be achieved. Therefore, it is necessary to obtain an immediate multimedia decoding output code rate, and the local multimedia content with the same service attribute can be decoded to obtain a decoded output code rate. If there is no local multimedia content with the same service attribute, the terminal can obtain the multimedia content segment of this service attribute from other channels (for example, directly obtain the trial broadcast/trial listening segment from the multimedia service provider) and decode it to obtain the decoded output bit rate.

Step 4: The terminal sends the transmission rate and the decoding output code rate or the smaller value of the two to the multimedia service provider.

When the terminal sends both the network transmission rate and the multimedia decoding output code rate to the multimedia service provider, the terminal sends the network transmission rate and the multimedia decoding output code rate to the multimedia service provider simultaneously or separately. For example, the terminal sends the network transmission rate to the multimedia service provider when applying for the multimedia service, and sends the decoded output code rate to the multimedia service provider after obtaining the multimedia decoding output code rate.

Step 5: The terminal receives the multimedia service content delivered by the multimedia service provider after matching the smaller value of the terminal's network transmission rate and the decoding output code rate.

Application Scenario 2: The user has already enjoyed online high-definition multimedia content through the mobile terminal. Due to the influence of the network signal or the terminal is processing other services, the multimedia program being appreciated appears stuck. At this time, it is necessary to adjust the source of the program to give the user a better experience. experience.

Step 1: When the mobile phone plays online high-definition multimedia content, obtain the network transmission rate of the mobile terminal and the decoding output bit rate when playing online high-definition video;

The mobile terminal can obtain the terminal's network transmission rate and multimedia decoding output code rate periodically or when the terminal generates concurrent events.

Step 2: The terminal sends the network transmission rate and the decoding output code rate or the smaller value of the two to the multimedia service provider.

The terminal can periodically report the network transmission rate and the decoding output bit rate or the smaller value of the two. It is also possible to set a monitoring module on the terminal to monitor and report the above parameters when an abnormality occurs in the network communication or when the terminal generates other concurrent events (for example, the terminal performs file download or the terminal performs certain mathematical operations).

Step 3: The terminal receives the multimedia service content delivered by the multimedia service provider after matching the new multimedia content when the smaller value of the terminal's network transmission rate and decoding output code rate is abnormal.

For example, when the multimedia provider finds that the smaller value of the network transmission rate reported by the terminal and the decoded output bit rate is abnormal (the value is lower than the bit rate of the multimedia service content), it will choose standard definition program content or other forms of content to replace high definition program content Send it to the mobile terminal so that the mobile terminal can play it smoothly.

In the above embodiments, the multimedia service provider does not match the multimedia service content according to the traditional terminal capability parameters (fixed parameters), but considers the network communication conditions of the terminal and the real-time multimedia processing capability of the terminal to match the multimedia service content.

Example 2

As shown in FIG. 2 , it is a system structure diagram in the embodiment of the present invention, which shows the service interaction between the terminal equipment and the multimedia service provider. In the prior art, a terminal usually initiates a service request to a multimedia service provider, and the multimedia service provider delivers multimedia content to the terminal. During this process, the terminal usually informs the multimedia service provider of the multimedia capabilities supported by the terminal, such as requirements such as multimedia format, multimedia resolution, and code rate, through SDP files or UA Profile or other methods. But it does not take into account the real-time conditions of network communication and the real-time status of terminal processing capabilities. Therefore, the applicant proposed that the terminal should inform the multimedia service provider about the real-time status of the terminal, so as to negotiate the multimedia service with the best experience.

Based on the above ideas, this embodiment provides a terminal device, as shown in FIG. 2 , which includes at least the following three units.

The first unit obtains the currently available network transmission rate and the same multimedia decoding output code rate as the service attribute of the applied multimedia service;

Among them, the service attribute of the multimedia service includes at least the code rate of the multimedia service content, and one or more of the following information:

Encapsulation format, encoding format, and resolution of multimedia service content.

The network transmission rate at least includes the downlink transmission rate.

Specifically, the first unit may obtain the multimedia decoding output code rate of the local multimedia content with the same service attribute according to the service attribute of the applied multimedia service; or

Obtain and decode multimedia content fragments with the same service attributes as the applied multimedia service, and obtain the output code rate of multimedia decoding; or

Obtain the decoded output code rate when playing the multimedia content of the applied multimedia service locally.

The second unit sends at least the smaller value of the obtained network transmission rate and multimedia decoding output code rate to the multimedia service provider;

It should be noted that the above-mentioned second unit, at least sending the smaller value of the obtained network transmission rate and multimedia decoding output code rate to the multimedia service provider refers to:

Send the smaller value of the obtained network transmission rate and multimedia decoding output code rate to the multimedia service provider; or send both the obtained network transmission rate and multimedia decoding output code rate to the multimedia service provider .

Wherein, when the second unit sends both the acquired network transmission rate and the multimedia decoding output code rate to the multimedia service provider, the acquired network transmission rate and the multimedia decoding output code rate may be simultaneously or separately sent to the multimedia service provider .

The third unit receives the multimedia service content delivered by the multimedia service provider according to the smaller value of the terminal's network transmission rate and decoding output code rate.

Some proposals propose that, on the basis of the above architecture, the terminal device may further include a fourth unit, which applies for a multimedia service from the multimedia service provider and receives service attributes of the multimedia service fed back by the multimedia service provider.

It can be seen from the above embodiments that the technical solution of this application sends the smaller value of the real-time transmission rate of the terminal network and the output code rate of multimedia decoding to the multimedia provider at the user terminal, which can well negotiate the real-time support of the terminal. Multimedia service capabilities, so that the multimedia provider can match the best multimedia service content and deliver it to the terminal, providing the best user experience for the terminal.

Those skilled in the art can understand that all or part of the steps in the above method can be completed by instructing relevant hardware through a program, and the program can be stored in a computer-readable storage medium, such as a read-only memory, a magnetic disk or an optical disk, and the like. Optionally, all or part of the steps in the foregoing embodiments may also be implemented using one or more integrated circuits. Correspondingly, each module/unit in the foregoing embodiments may be implemented in the form of hardware, or may be implemented in the form of software function modules. This application is not limited to any specific form of combination of hardware and software.

The above descriptions are only preferred examples of the present invention, and are not intended to limit the protection scope of the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention shall be included within the protection scope of the present invention.

Claims (14)

1. A multimedia service transmission method, characterized in that the method comprises: The terminal obtains the currently available network transmission rate, and obtains the decoded output code rate of the multimedia content with the same service attribute as the applied multimedia service; The terminal at least sends the smaller value of the acquired network transmission rate and multimedia decoding output code rate to the multimedia service provider; The terminal receives the multimedia service content delivered by the multimedia service provider according to the smaller value of the terminal's network transmission rate and decoding output code rate. 2. The method according to claim 1, wherein the terminal sends at least the smaller value of the acquired network transmission rate and the multimedia decoding output code rate to the multimedia service provider: The terminal sends the smaller value of the acquired network transmission rate and multimedia decoding output code rate to the multimedia service provider; or The terminal sends both the acquired network transmission rate and the multimedia decoding output code rate to the multimedia service provider. 3. The method of claim 2, wherein When the terminal sends both the acquired network transmission rate and the multimedia decoding output code rate to the multimedia service provider, the terminal simultaneously or separately sends the acquired network transmission rate and multimedia decoding output code rate to the Multimedia service provider. 4. The method according to claim 1, wherein the decoding output code rate of the multimedia content obtained by the terminal with the same service attribute of the applied multimedia service refers to: The terminal obtains the multimedia decoding output code rate of the local multimedia content with the same service attribute according to the service attribute of the applied multimedia service; or The terminal obtains a multimedia content segment with the same service attribute as the applied multimedia service for decoding, and obtains a multimedia decoding output code rate; or The terminal obtains the decoded output code rate when the terminal plays the multimedia content of the applied multimedia service. 5. The method according to any one of claims 1 to 4, characterized in that, before the step of obtaining the same multimedia decoding output code rate as the service attribute of the applied multimedia service, the method also includes: The terminal applies for a multimedia service from the multimedia service provider; The multimedia service provider feeds back the service attribute of the multimedia service applied by the terminal to the terminal. 6. The method of claim 5, wherein, The service attributes of the multimedia service include at least the code rate of the multimedia service content, and one or more of the following information: Encapsulation format, encoding format, and resolution of multimedia service content. 7. The method of claim 5, wherein, The network transmission rate includes a downlink transmission rate. 8. A terminal device, characterized in that it comprises: The first unit obtains the currently available network transmission rate and the same multimedia decoding output code rate as the service attribute of the applied multimedia service; The second unit sends at least the smaller value of the obtained network transmission rate and multimedia decoding output code rate to the multimedia service provider; The third unit receives the multimedia service content delivered by the multimedia service provider according to the smaller value of the network transmission rate and the decoding output code rate of the terminal. 9. The terminal device according to claim 8, wherein the second unit, at least sending the acquired network transmission rate and the multimedia decoding output code rate to the multimedia service provider means: The second unit sends the smaller value of the obtained network transmission rate and multimedia decoding output code rate to the multimedia service provider; or Sending both the acquired network transmission rate and the multimedia decoding output code rate to the multimedia service provider. 10. The terminal device according to claim 9, characterized in that, When the second unit sends both the acquired network transmission rate and the multimedia decoding output code rate to the multimedia service provider, simultaneously or separately send the acquired network transmission rate and the multimedia decoding output code rate to the multimedia service provider. service provider. 11. The terminal device according to claim 8, wherein the first unit, obtaining the same multimedia decoding output code rate as the service attribute of the applied multimedia service refers to: The first unit obtains the multimedia decoding output code rate of the local multimedia content with the same service attribute according to the service attribute of the applied multimedia service; or Obtain and decode multimedia content fragments with the same service attributes as the applied multimedia service, and obtain the output code rate of multimedia decoding; or Obtain the decoded output code rate when playing the multimedia content of the applied multimedia service locally. 12. The terminal device according to any one of claims 8 to 11, further comprising: The fourth unit is to apply for a multimedia service from the multimedia service provider, and receive the service attribute of the multimedia service fed back by the multimedia service provider. 13. The terminal device according to claim 12, characterized in that, The service attributes of the multimedia service include at least the code rate of the multimedia service content, and one or more of the following information: Encapsulation format, encoding format, and resolution of multimedia service content. 14. The terminal device according to claim 12, characterized in that, The network transmission rate includes a downlink transmission rate.