CN103260053B - System, media player and method for dynamically adjusting code rate of multimedia data - Google Patents

Abstract

The invention discloses a system for dynamically adjusting multimedia data code rate, a media playing device and a method. The method for dynamically adjusting the multimedia data code rate comprises the following steps: predicting a predicted network speed of a multimedia playing device by a code rate adjusting module according to a current geographic position of the multimedia playing device and historical network speed information; adjusting a code rate request according to the predicted network speed by the code rate adjusting module and transmitting the code rate request to a multimedia resource server; transcoding a multimedia data by a multimedia data transcoding module of the multimedia resource server according to the code rate request; and receiving and playing the transcoded multimedia data by the multimedia playing device.

Description

System, media player and method for dynamically adjusting code rate of multimedia data

technical field

The present invention relates to a system, a media playing device and a method for dynamically adjusting the code rate of multimedia data, and in particular to a system, a media playing device and a method for predicting and dynamically adjusting the code rate of multimedia data by using geographic positioning information.

Background technique

Most of the current network multimedia playback devices manually set the definition or bit rate of the multimedia resources to be played by the user, or can only select from certain optional bit rate levels according to the current bandwidth (Bandwidth) status of the network where they are located. Make selections to adjust the resolution or bit rate.

However, if the selected code rate does not match the bandwidth, it will cause the phenomenon that the picture playing multimedia data is not clear enough or the picture is sluggish. In addition, adjusting the code rate according to the current bandwidth status of the network is basically a lagging remedy. It is bound to appear that the multimedia data playback screen is not clear enough or the screen is slow before the adjustment. Therefore, how to predict and adjust the code rate according to the bandwidth condition of the network is a problem to be solved at present.

Contents of the invention

The invention provides a system, a media playing device and a method for dynamically adjusting the code rate of multimedia data.

The present invention proposes a system for dynamically adjusting code rate of multimedia data, including: a multimedia resource server, a multimedia player and a code rate adjustment module. The above-mentioned multimedia resource server includes a multimedia data storage module and a multimedia data transcoding module. The above-mentioned multimedia data storage module is used for storing a piece of multimedia data. The multimedia data transcoding module is coupled to the multimedia data storage module, and requests to transcode the multimedia data according to a code rate. The multimedia playing device is used for receiving and playing the transcoded multimedia data. The code rate adjustment module is coupled to the multimedia data transcoding module, and predicts a predicted network speed of the multimedia player device based on a current geographic location and historical network speed information of the multimedia player device, and according to the predicted network speed Adjust the code rate request and send it to the multimedia data transcoding module, wherein the historical network speed information is at least one geographic location where network speed changes and at least one historical network speed corresponding to the geographic location where network speed changes.

The present invention proposes a multimedia playing device, coupled to a multimedia resource server, including: a multimedia data buffer module, used to receive and temporarily store a piece of multimedia data transmitted by the above-mentioned multimedia resource server; a multimedia playing module, coupled to To the above-mentioned multimedia data buffering module, in order to play the above-mentioned multimedia data; And a code rate adjustment module, coupled to the above-mentioned multimedia data buffering module, according to a geographic location where the above-mentioned multimedia playback device is currently located and a historical network speed information, predict the above-mentioned A predicted network speed of the multimedia playback device, and adjust a code rate request according to the predicted network speed and send it to the above-mentioned multimedia resource server, wherein the above-mentioned historical network speed information is at least one network speed change geographical location and corresponding to the above-mentioned network speed change geographical location At least one historical internet speed for the location.

The present invention proposes a method for dynamically adjusting the code rate of multimedia data, including: predicting a predicted network of the above-mentioned multimedia playing device by a code rate adjusting module according to a geographic location where a multimedia playing device is currently located and a historical network speed information speed; adjust a code rate request according to the above-mentioned predicted network speed by the above-mentioned code rate adjustment module and send it to a multimedia resource server; use a multimedia data transcoding module of the above-mentioned multimedia resource server to transcode a code rate request according to the above-mentioned code rate multimedia data; and receiving and playing the transcoded multimedia data by the multimedia playback device, wherein the historical network speed information is at least one network speed changing geographical location and at least one historical network speed corresponding to the above network speed changing geographical location.

In order to make the above and other objects, features and advantages of the present invention more comprehensible, preferred embodiments are enumerated below and described in detail with reference to the accompanying drawings.

Description of drawings

1A-1B are schematic diagrams showing a system for dynamically adjusting code rates of multimedia data according to a first embodiment of the present invention.

FIG. 2 is a schematic diagram showing a system for dynamically adjusting code rates of multimedia data according to a second embodiment of the present invention.

FIG. 3 is a flowchart showing a method for dynamically adjusting code rates of multimedia data according to an embodiment of the invention.

Description of reference symbols

100 systems

110 multimedia resource server

112 multimedia data storage module

114 multimedia data transcoding module

116 code rate adjustment module

120 multimedia player

122 code rate adjustment module

124 multimedia data buffer module

126 multimedia player module

200 systems

210 multimedia resource server

212 multimedia data storage module

214 multimedia data transcoding module

220 multimedia player

222 code rate adjustment module

228 GPS module

230 historical information database

300 method flow chart

S302, S304, S306, S308 steps

detailed description

In order to make the purpose, features, and advantages of the present invention more comprehensible, preferred embodiments are specifically cited below, and are described in detail with reference to FIG. 1A to FIG. 3 . The description of the present invention provides different examples to illustrate the technical features of different implementations of the present invention. Wherein, the configuration of each element in the embodiment is for illustration, not for limiting the present invention. In addition, part of the reference numerals in the embodiments are repeated for the purpose of simplifying the description, and do not imply the correlation between different embodiments.

1A-1B are schematic diagrams showing a system 100 for dynamically adjusting code rates of multimedia data according to a first embodiment of the present invention. The system 100 mainly includes a multimedia resource server 110 and a multimedia player 120 .

In FIG. 1A , the multimedia resource server 110 mainly includes a multimedia data storage module 112 and a multimedia data transcoding module 114 . The multimedia data storage module 112 is used for storing a piece of multimedia data. The multimedia data transcoding module 114 is coupled to the multimedia data storage module 112 for transcoding the multimedia data according to a code rate request. To illustrate in more detail, the multimedia data transcoding module 114 first reads out the multimedia data from the multimedia data storage module 112 and then decodes it, and then encodes it with a coding algorithm of a new code rate according to the code rate request. The "code rate" used here is a term for multimedia data processing. "Bit rate" is equal to the amount of data per second before compression divided by the compression ratio (data amount per second before compression ÷ compression ratio), where the amount of data per second before compression refers to the frame rate multiplied by the resolution (frame rate × resolution Rate). To explain in more detail, the frame rate refers to the number of pictures displayed per second, which affects the smoothness of the picture and is directly proportional to the fluency of the picture. The larger the frame rate, the smoother the screen playback; the smaller the frame rate, the more jumpy the screen playback. Resolution refers to the length and width of a (rectangular) picture, ie the dimensions of the picture. The multimedia data transcoding module 114 can adjust the code rate during transcoding by adjusting parameters such as frame rate, resolution and compression ratio. The present invention does not limit which parameter is specifically adjusted.

In this embodiment, the multimedia resource server 110 can be an independently working server device, or a functional module in a multi-functional server. For example, the multimedia resource server 110 can be a NAS server of a home entertainment center or a public server like youtube, and those skilled in the art can understand that the multimedia resource server is not limited to these forms.

The multimedia playing device 120 receives and plays the transcoded multimedia data from the multimedia data transcoding module 114 . In one embodiment, the multimedia playing device 120 further includes a code rate adjustment module 122 . In this embodiment, the multimedia playing device 120 may be a personal computer, a notebook computer, a tablet computer, an intelligent terminal device, a mobile phone, a PAD, and other devices equipped with multimedia playing capabilities.

The code rate adjustment module 122 predicts a predicted network speed of the multimedia player 120 according to a current geographic location of the multimedia player 120 and a historical network speed information, and adjusts the code rate request according to the predicted network speed, and then transmits the request to the multimedia resource The multimedia data transcoding module 114 in the server 110 performs encoding according to the code rate request by the multimedia data transcoding module 114 . The paths of the users of the multimedia player 120 using the multimedia player 120 are largely similar. For example, they take public transport or drive in the morning and take the same route every day, and the same goes for getting off work. The quality of the network communication signal in a certain geographical location is relatively fixed. Therefore, the multimedia playback device 120 of the present invention records the geographical location and the corresponding network speed of each network speed change as the historical network speed information. So that a geographical location-based network status database is established in the multimedia player 120, for example, when the user uses the multimedia player 120 to play video in the process of continuous movement (such as on the way to and from get off work), it can reach the next network speed change. Before the geographic location, predict the network speed changes that will be faced in advance, and communicate with the multimedia resource server 110 in advance to adjust the code rate. Compared with the mechanism for adjusting the code rate, the system for dynamically adjusting the code rate of multimedia data in the present invention can better prevent interruption of the user's multimedia data and ensure smooth playback of the multimedia data. In addition, since the prediction mechanism is only needed when the geographic location of the user using the multimedia player 120 changes frequently, the code rate of the multimedia data is constantly and dynamically adjusted to ensure the smooth playback of the multimedia data. Therefore, in an embodiment of the present invention, the multimedia The playback device 120 may provide the user with the option of enabling or disabling the prediction mechanism (such as providing a corresponding option in the client software).

It should be noted that in this embodiment, the code rate adjustment module is set in the multimedia playback device 120 for illustration (the code rate adjustment module 122 shown in FIG. 1A ). In other embodiments, the code rate adjustment module can also be set in the multimedia resource server 110 (such as the code rate adjustment module 116 shown in FIG. 1B ).

Due to possible errors in prediction, the code rate adjustment module 122 (or 116 ) also detects a current network speed, and corrects the above code rate request according to the current network speed. The current network speed refers to the real network speed detected by the multimedia playback device 120 after actually arriving at a certain geographic location.

In one embodiment, as shown in FIG. 1A , the multimedia playing device 120 further includes a multimedia data buffering module 124 and a multimedia playing module 126 . The multimedia data buffering module 124 is coupled to the above code rate adjustment module 122 and the multimedia playing module 126 . The multimedia data buffering module 124 is used for receiving and temporarily storing the transcoded multimedia data generated by the multimedia data transcoding module 114 according to the code rate request. Finally, the multimedia playing module 126 plays the transcoded multimedia data temporarily stored in the multimedia data transcoding module 114 .

Wherein, the current network speed can be determined according to the transcoded multimedia data temporarily stored in the multimedia data buffer module 124 . The code rate adjustment module 122 can establish a preset upper limit and a preset lower limit in advance, so when the transcoded multimedia data temporarily stored in the multimedia data buffer module 124 is continuously lower than the preset lower limit (ie, the network rate is too low), the code rate adjustment module 122 adjusts and sends the code rate request to the multimedia data transcoding module 114 to request to reduce the code rate. Conversely, when the transcoded multimedia data temporarily stored in the multimedia data buffer module 124 is continuously higher than a preset upper limit (that is, the network speed is too high), the code rate adjustment module 122 adjusts and sends the code rate request to The multimedia data transcoding module 124 requests to increase the encoding rate.

In addition, in another embodiment, the code rate adjustment module 122 can obtain relevant information about the current network speed by testing the network interface. For example, the code rate adjustment module 122 can obtain the current network speed status of the network between the multimedia playback device 120 and the multimedia resource server 110 by testing the time for sending or receiving a certain amount of multimedia data from the multimedia playback device 120 . In yet another embodiment, the multimedia player 120 can also obtain the current network speed status by determining the mobile service provider, for example, by judging that the network currently used by the multimedia player 120 is the Global System for Mobile Communications for Mobile Communications, GSM), General Packet Radio Service (GPRS), Enhanced Datarates for GSM Evolution (EDGE) or 3G network, so as to know the network speed range of the current location , and use this to determine the current network speed. By further correcting the code rate in real time based on the current network speed, when there is an error in the previously predicted network speed (for example, when the network speed of a certain geographical location changes greatly), the code rate adjusted according to the predicted network speed can be adjusted in a timely manner. Make further corrections to ensure that the bit rate can better match the network speed.

FIG. 2 is a schematic diagram showing a system 200 for dynamically adjusting code rates of multimedia data according to a second embodiment of the present invention. The system 200 mainly includes a multimedia resource server 210 and a multimedia player 220 . The multimedia playing device 220 further includes a code rate adjustment module 222 , a global positioning system module 228 and a historical information database 230 . The functions of components with the same names as those in the first embodiment are also as described above, and will not be repeated here. The main difference between FIG. 2 and FIG. 1A is that the multimedia playback device 220 further includes a GPS module 228 and a historical information database 230 .

The GPS module 228 is used to determine the geographic location of the multimedia playback device 220 . The historical information database 230 is coupled to the global positioning system module 228 and the code rate adjustment module 222 to store historical network speed information, which can be any commercially available device or product for storing information, such as a hard disk, various memories, CD, DVD, computer, server and other devices. Wherein the historical network speed information is at least one geographical location where the network speed changes and at least one historical network speed corresponding to the geographical location where the network speed changes. For example, a user may frequently travel certain routes, such as commuting to and from get off work by a vehicle that travels the same route. Therefore, information such as the strength of the communication signal and the status of certain places along the route will not change from time to time. Therefore, the geographical location of network speed changes in the common path where the multimedia player 220 is located, such as the position of the node where the network speed changes (such as latitude and longitude), and the historical network speed corresponding to the geographical location of the network speed change can be recorded as historical network speed information. Next, when the multimedia playback device 220 is about to travel through the same path, the code rate adjustment module 222 can predict the historical network speed corresponding to the geographical location information according to the historical network speed information stored in the historical information database 230 by querying, and dynamically Adjust bit rate request. In one embodiment, when the geographic location determined in real time by the multimedia player 220 via the global positioning system module 228 is spatially close to one of the multiple network speed change geographic locations, it means that the network speed is about to change, and the code rate adjustment module In step 222, the historical network speed corresponding to the geographical location of the network speed change in the historical information database 230 is used as the predicted network speed. In one embodiment, the code rate adjustment module 222 searches a mapping table (not shown) according to the predicted network speed to find the corresponding code rate to determine the above code rate request, and sends it to the multimedia data transcoding module 214 for adjustment. For the coding rate, the mapping table can be stored inside the code rate adjustment module 222 . In another embodiment, the coding rate adjustment module 222 linearly adjusts the coding rate of the multimedia data transcoding module 214 according to the change trend of the predicted network speed. In other embodiments, when the predicted network speed is very slow and the current network speed is very fast, the capacity of the data cache in the multimedia playback device 220 can also be temporarily expanded, and more multimedia data can be fetched from the multimedia resource server 210, so that After entering the geographic location where the network speed becomes slow, even if the encoding rate is not adjusted, the smooth playback of multimedia data can be maintained.

As mentioned above, although the probability of occurrence is low, the network speed of a certain geographical location may indeed change, resulting in errors in the predicted network speed. Therefore, in addition to correcting the above code rate request in real time according to the current network speed, code The rate adjustment module 222 will also compare the current network speed with the corresponding historical network speed. At the same time, the code rate adjustment module 222 updates the historical network speed information. In one embodiment, the code rate adjustment module 222 can directly replace the historical network speed with the current network speed, update and store it in the historical information database 230 . In another embodiment, the code rate adjustment module 222 can calculate and update the historical network speed according to a weight index corresponding to the current network speed and historical network speed (for example, historical network speed=current network speed×40%+historical network speed× 60%), and then stored in the historical information database 230.

FIG. 3 is a flowchart 300 showing a method for dynamically adjusting code rates of multimedia data according to an embodiment of the present invention, with reference to FIG. 1A . First, in step S302, a code rate adjustment module is used to predict a predicted network speed of the multimedia playback device according to a current geographic location of the multimedia playback device and historical network speed information. In step S304, a code rate request is adjusted by the code rate adjustment module according to the predicted network speed and sent to a multimedia resource server. In step S306, a multimedia data transcoding module of the multimedia resource server requests to transcode a piece of multimedia data according to the code rate. Finally, in step S308, the transcoded multimedia data is received and played by a multimedia data buffer module of the multimedia playing device. In addition, although the probability of occurrence is low, the network speed of a certain geographical location may change, resulting in errors in the predicted network speed. Therefore, in another embodiment of the present invention, between steps S304 and S306, when the After the multimedia playback device actually reaches the location where the network speed changes, the code rate adjustment module detects the current network speed of the multimedia playback device, and corrects the above code rate request in real time according to the current network speed. When the network speed is different from the historical network speed, the step of updating the corresponding historical network speed information according to the current network speed is also performed.

Therefore, through the system and method for dynamically adjusting the code rate of multimedia data of the present invention, the network status corresponding to the geographic location information can be recorded, and the weighted correction can be performed with reference to the current network speed when passing the same geographic location multiple times. When the user is watching a multimedia video, before reaching the next location where the network speed changes, the multimedia playback device can predict the network speed situation that will be faced in advance, and dynamically communicate with the multimedia resource server to adjust the code rate, so as to achieve more Good playback effect. In addition, the bit rate is further corrected in real time based on the current network speed. When there is an error in the previously predicted network speed, the bit rate can be further corrected in time to ensure that the bit rate can better match the network speed.

Although the present invention has been disclosed above with preferred embodiments, it is not intended to limit the present invention. Those skilled in the art can make some changes and modifications without departing from the spirit and scope of the present invention. Therefore, the present invention The scope of protection of the invention is based on the claims of the present invention.

Claims (10)

1. A system for dynamically adjusting the code rate of multimedia data, comprising: A multimedia resource server, including: a multimedia data storage module for storing a multimedia data; and A multimedia data transcoding module, coupled to the above multimedia data storage module, and requests to transcode the above multimedia data according to a code rate; A multimedia playback device, used to receive and play the transcoded multimedia data; and A code rate adjustment module, coupled to the above-mentioned multimedia data transcoding module, predicts a predicted network speed of the above-mentioned multimedia player device according to a current geographic location of the above-mentioned multimedia player device and a historical network speed information, and according to the above-mentioned predicted network speed Quickly adjust the above code rate request and send it to the above multimedia data transcoding module, Wherein the above-mentioned historical network speed information is at least one network speed changing geographical location and at least one historical network speed corresponding to the above-mentioned network speed changing geographical location, wherein when the geographical location where the above-mentioned multimedia playback device is located is close to the above-mentioned at least one network speed changing geographical location For a time, the code rate adjustment module uses the historical network speed corresponding to the geographic location of the network speed change as the predicted network speed. 2. The system for dynamically adjusting code rate of multimedia data according to claim 1, wherein said code rate adjustment module also detects a current network speed, and then corrects said code rate request according to the current network speed. 3. The system for dynamically adjusting the code rate of multimedia data as claimed in claim 2, wherein said multimedia playback device further comprises: A multimedia data buffer module, coupled to the code rate adjustment module, for receiving and temporarily storing the transcoded multimedia data; and A multimedia playing module, coupled to the above-mentioned multimedia data buffer module, for playing the above-mentioned temporarily stored transcoded multimedia data, Wherein the above-mentioned current network speed is determined according to the above-mentioned transcoded multimedia data temporarily stored in the above-mentioned multimedia data buffer module; When the above-mentioned transcoded multimedia data temporarily stored in the above-mentioned multimedia data buffer module continues to be lower than a preset lower limit, the above-mentioned code rate adjustment module adjusts and sends the above-mentioned code rate request to the above-mentioned multimedia data transcoding module to request reduce an encoding rate; and When the above-mentioned transcoded multimedia data temporarily stored in the above-mentioned multimedia data buffer module is continuously higher than a preset upper limit, the above-mentioned code rate adjustment module adjusts and sends the above-mentioned code rate request to the above-mentioned multimedia data transcoding module to request Increase the encoding rate above. 4. The system for dynamically adjusting the code rate of multimedia data as claimed in claim 1, said multimedia playback device further comprising: A global positioning system module, used to determine the above-mentioned geographic location where the above-mentioned multimedia playback device is located; and A historical information database, coupled to the above-mentioned global positioning system module and the above-mentioned code rate adjustment module, for storing the above-mentioned historical network speed information. 5. The system for dynamically adjusting the code rate of multimedia data as claimed in claim 4, wherein the code rate adjustment module also detects a current network speed, when the above-mentioned current network speed corresponds to the geographic location where the multimedia playback device is currently located When the historical network speeds are different, the above-mentioned code rate adjustment module updates the above-mentioned historical network speed information according to the above-mentioned current network speed, and stores it in the above-mentioned historical information database. 6. The system for dynamically adjusting the code rate of multimedia data as claimed in claim 5, wherein said code rate adjustment module calculates and updates said historical network speed information according to a weight index corresponding to said current network speed and said historical network speed, and stores it in The aforementioned historical information database. 7. The system for dynamically adjusting the code rate of multimedia data as claimed in claim 1, wherein the code rate adjustment module searches a mapping table according to the predicted network speed to determine the code rate request. 8. A multimedia playback device coupled to a multimedia resource server, comprising: A multimedia data buffer module, used to receive and temporarily store a multimedia data transmitted by the above-mentioned multimedia resource server; A multimedia playing module, coupled to the above-mentioned multimedia data buffer module, for playing the above-mentioned multimedia data; and A code rate adjustment module, coupled to the above-mentioned multimedia data buffer module, predicts a predicted network speed of the above-mentioned multimedia player device according to a current geographic location of the above-mentioned multimedia player device and a historical network speed information, and according to the above-mentioned predicted network speed adjust a code rate request and send it to the above-mentioned multimedia resource server, Wherein the above-mentioned historical network speed information is at least one geographical location of network speed change and at least one historical network speed corresponding to the geographical location of above-mentioned network speed change, Wherein when the geographic location where the multimedia playback device is located is close to one of the at least one network speed change geographic location, the code rate adjustment module uses the historical network speed corresponding to the network speed change geographic location as the predicted network speed. 9. The multimedia player as claimed in claim 8, further comprising: A global positioning system module, used to determine the geographic location where the above-mentioned multimedia playback device is located; and A historical information database, coupled to the above-mentioned global positioning system module and the above-mentioned code rate adjustment module, for storing the above-mentioned historical network speed information. 10. A method for dynamically adjusting the code rate of multimedia data, comprising: A code rate adjustment module is used to predict a predicted network speed of the above-mentioned multimedia playback device according to a geographic location where the multimedia playback device is currently located and a historical network speed information; Adjusting a code rate request according to the predicted network speed by the code rate adjustment module and sending it to a multimedia resource server; Using a multimedia data transcoding module of the multimedia resource server to request transcoding of a multimedia data according to the code rate; and Receiving and playing the above-mentioned transcoded multimedia data by the above-mentioned multimedia playing device, Wherein the above-mentioned historical network speed information is at least one geographical location of network speed change and at least one historical network speed corresponding to the above-mentioned geographical location of network speed change, Wherein when the geographic location where the multimedia playback device is located is close to one of the at least one network speed change geographic location, the code rate adjustment module uses the historical network speed corresponding to the network speed change geographic location as the predicted network speed.