CN113709447B

CN113709447B - Method and device for detecting playing performance of terminal equipment

Info

Publication number: CN113709447B
Application number: CN202110882526.7A
Authority: CN
Inventors: 王鹏; 周霆; 王健; 吕嘉伟; 关小龙; 程相昱
Original assignee: Beijing QIYI Century Science and Technology Co Ltd
Current assignee: Beijing QIYI Century Science and Technology Co Ltd
Priority date: 2021-08-02
Filing date: 2021-08-02
Publication date: 2024-01-26
Anticipated expiration: 2041-08-02
Also published as: CN113709447A

Abstract

The invention provides a method and a device for detecting playing performance of terminal equipment, wherein the method comprises the following steps: the terminal equipment plays the test video data off screen; generating detection data aiming at the off-screen played test video data; and detecting the playing performance of the terminal equipment based on the detection data. The efficiency of detecting the playing performance of the terminal equipment is improved by generating the detection data when the terminal equipment plays the specially-made test video data and then analyzing the playing performance of the terminal equipment based on the detection data. And the test video data is played off-screen on the terminal equipment, so that the detection process is not perceived by the user, and the influence of the detection process on the use of the terminal equipment by the user is avoided.

Description

Method and device for detecting playing performance of terminal equipment

Technical Field

The invention belongs to the technical field of multimedia, and particularly relates to a method and a device for detecting playing performance of terminal equipment.

Background

In recent years, with the continuous development and perfection of internet technology, more and more users watch videos through terminal equipment or make video calls with friends; accordingly, bandwidth occupation is also increasing.

The prior art mainly adopts a video coding mode of AVC (AdvancedVideo Coding ) to code video data so as to compress the video data, but the compression capability of AVC has difficulty in alleviating the bandwidth occupation of video data which is increasing gradually, so in order to reduce the bandwidth occupation of video data, the video data can be coded by a coding mode of a higher-level video compression coding mode, such as HEVC (High EfficiencyVideo Coding ); HEVC improves compression efficiency by about 50% when compressing 1080P video data compared to AVC.

However, HEVC is an emerging video coding manner, and many playback devices, such as high-definition players, high-definition boxes, smart televisions, smart phones, and the like, cannot decode video data compressed by HEVC, and cannot normally play video data compressed by HEVC; if video data encoded by HEVC is directly sent to the playing device for playing, the problems of green screen, black screen and the like are easy to occur. Therefore, before video data encoded by HEVC is sent to a playback device for playback, playback performance of the playback device needs to be detected, for example, whether the playback device can decode and normally play video data compressed by HEVC.

In the prior art, when the playing performance of the playing equipment is detected, the playing performance of the playing equipment with different types and models is detected by manpower, and the detection efficiency is low.

Disclosure of Invention

The embodiment of the invention aims to provide a method for detecting the playing performance of terminal equipment so as to detect the playing performance of the terminal equipment. The specific technical scheme is as follows:

in a first aspect of the present invention, there is provided a method for detecting playing performance of a terminal device, including:

the terminal equipment plays the test video data off screen;

generating detection data aiming at the off-screen played test video data;

and detecting the playing performance of the terminal equipment based on the detection data.

Optionally, the test video data includes first video data obtained by decoding original video data encoded by a preset encoding mode;

the detecting, based on the detection data, the playing performance of the terminal device includes:

and judging whether the terminal equipment supports a preset decoding mode or not based on the detection data, wherein the preset decoding mode corresponds to the preset encoding mode.

Optionally, the detection data includes first detection data generated for first video data played off-screen; the step of judging whether the terminal equipment supports a preset decoding mode based on the detection data comprises the following steps:

Comparing the first detection data with the original video data, and judging whether a first preset abnormal event occurs in the process of off-screen playing of the first video data by the terminal equipment;

if the first preset abnormal event occurs in the process of off-screen playing the first video data by the terminal equipment, judging that the terminal equipment does not support the preset decoding mode;

if the first preset abnormal event does not occur in the process of off-screen playing the first video data by the terminal equipment, judging that the terminal equipment supports the preset decoding mode;

wherein the first preset exception event comprises at least one of the following exception events: an image abnormal event, a stuck event and a frame loss event.

Optionally, the test video data further includes decoding original video data encoded by other encoding modes, and the obtained second video data, where the other encoding modes are decoding modes corresponding to decoding modes supported by the terminal device; the detection data further comprises second detection data generated for second video data played off-screen;

based on the detection data, judging whether the terminal device supports a preset decoding mode, and further comprising:

Comparing the second detection data with the original video data, and judging whether a first preset abnormal event occurs in the process of off-screen playing of the second video data by the terminal equipment;

if a first preset abnormal event does not occur in the process of off-screen playing of the first video data and the second video data by the terminal equipment, judging that the terminal equipment supports the preset decoding mode;

and if the first preset abnormal event occurs in the process of off-screen playing of the first video data by the terminal equipment, the first preset abnormal event does not occur in the process of off-screen playing of the second video data, and the terminal equipment is judged not to support the preset decoding mode.

Optionally, the detecting, based on the detection data, the playing performance of the terminal device includes:

and judging whether the terminal equipment supports serial broadcasting of different video data or not based on the detection data.

Optionally, the test video data includes third video data, the third video data including movie video data and advertisement video data in series; the detection data comprises third detection data generated for third video data played off-screen;

The detecting the serial broadcasting performance of the terminal equipment based on the detection data comprises the following steps:

judging whether a second preset abnormal event occurs in the process of off-screen playing of the third video data by the terminal equipment according to the third detection data;

if the second preset abnormal event occurs in the process of off-screen playing of the third video data by the terminal equipment, judging that the terminal equipment does not support the serial playing of the video data and the advertisement video data;

if the second preset abnormal event does not occur in the process of off-screen playing of the third video data by the terminal equipment, judging that the terminal equipment supports serial playing of the video data and the advertisement video data;

wherein the second preset exception event includes: jump exception event.

Optionally, the test video data comprises fourth video data comprising video data of at least two resolutions in series; the detection data comprises fourth detection data generated for fourth video data played off-screen;

judging whether a second preset abnormal event occurs in the process of off-screen playing of the fourth video data by the terminal equipment according to the fourth detection data;

If the second preset abnormal event occurs in the process of off-screen playing of the fourth video data by the terminal equipment, judging that the terminal equipment does not support serial playing of the video data with different resolutions;

and if the second preset abnormal event does not occur in the process of off-screen playing of the fourth video data by the terminal equipment, judging that the terminal equipment supports serial playing of the video data with different resolutions.

Optionally, before the terminal device plays the detected video data off-screen, the method further includes:

detecting the working state of the terminal equipment;

and executing the step of off-screen playing detection video data at the terminal equipment when the working state meets the preset test condition.

Optionally, the detecting the working state of the terminal device includes:

detecting whether the terminal equipment enters a standby state;

if the terminal equipment enters a standby state, when the terminal equipment enters the standby state for more than a preset time period, judging that the working state meets a preset test condition.

Optionally, the detection data includes: screenshot, system time, play time.

In a second aspect of the present invention, there is also provided a device for detecting playing performance of a terminal device, including:

The test video data playing module is used for off-screen playing of the test video data by the terminal equipment;

the detection data generation module is used for generating detection data aiming at the off-screen played test video data;

and the play performance detection module is used for detecting the play performance of the terminal equipment based on the detection data.

the play performance detection module comprises:

and the decoding mode detection sub-module is used for judging whether the terminal equipment supports a preset decoding mode or not based on the detection data, and the preset decoding mode corresponds to the preset encoding mode.

Optionally, the detection data includes first detection data generated for first video data played off-screen;

the decoding mode detection sub-module is used for comparing the first detection data with the original video data and judging whether a first preset abnormal event occurs in the process of off-screen playing the first video data by the terminal equipment;

the decoding mode detection sub-module is further configured to compare the second detection data with the original video data, and determine whether a first preset abnormal event occurs in the process of off-screen playing of the second video data by the terminal device;

Optionally, the play performance detection module includes:

and the serial broadcasting detection sub-module is used for judging whether the terminal equipment supports serial broadcasting of different video data or not based on the detection data.

the serial broadcast detection sub-module is used for judging whether a second preset abnormal event occurs in the process of off-screen playing of the third video data by the terminal equipment according to the third detection data;

wherein the second preset exception event includes: jump exception event.

the serial broadcast detection sub-module is used for judging whether a second preset abnormal event occurs in the process of off-screen playing of the fourth video data by the terminal equipment according to the fourth detection data;

Optionally, the apparatus further comprises:

the working state detection module is used for detecting the working state of the terminal equipment before the terminal equipment plays the detection video data off screen.

Optionally, the working state detection module includes:

a standby state detection sub-module, configured to detect whether the terminal device enters a standby state;

and the duration detection submodule is used for judging that the working state meets the preset test condition when the terminal equipment enters the standby state and exceeds the preset duration if the terminal equipment enters the standby state.

Optionally, the detection data includes: screenshot, system time, play time.

In still another aspect of the present invention, there is further provided a computer readable storage medium, where instructions are stored, when the computer readable storage medium runs on a computer, to cause the computer to execute the method for detecting playing performance of any one of the above-mentioned terminal devices.

In yet another aspect of the implementation of the present invention, there is also provided a computer program product containing instructions, which when run on a computer, cause the computer to perform the method for detecting playback performance of any one of the terminal devices described above.

According to the method for detecting the playing performance of the terminal equipment, the terminal equipment firstly plays the test video data off-screen, and generates detection data aiming at the test video data played off-screen; and then detecting the playing performance of the terminal equipment based on the detection data. The efficiency of detecting the playing performance of the terminal equipment is improved by generating the detection data when the terminal equipment plays the specially-made test video data and then analyzing the playing performance of the terminal equipment based on the detection data. And the test video data is played off-screen on the terminal equipment, so that the detection process is not perceived by the user, and the influence of the detection process on the use of the terminal equipment by the user is avoided.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below.

Fig. 1 is a step flowchart of a method for detecting playing performance of a terminal device according to an embodiment of the present invention;

fig. 2 is a flowchart of optional steps of a method for detecting playing performance of a terminal device according to an embodiment of the present invention;

fig. 3 is a flowchart of optional steps of another method for detecting play performance of a terminal device according to an embodiment of the present invention;

Fig. 4 is a flowchart of optional steps of a method for detecting playing performance of a terminal device according to another embodiment of the present invention;

fig. 5 is a block diagram of a device for detecting playing performance of a terminal device according to an embodiment of the present invention;

fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be described below with reference to the accompanying drawings in the embodiments of the present invention.

Before playing video data on the terminal device, it is necessary to detect whether the terminal device has a corresponding playing performance. Therefore, the embodiment of the invention provides a method for detecting the playing performance of the terminal equipment, which is used for detecting the playing performance of the terminal equipment so as to judge whether the terminal equipment can normally play the video data.

Fig. 1 is a step flowchart of a method for detecting playing performance of a terminal device according to an embodiment of the present invention, which specifically may include the following steps:

and step 101, off-screen playing test video data by the terminal equipment.

Because the production standards and the production technologies are different among manufacturers, the playing performance of the produced terminal equipment is different; play performance is the ability to process video data; for example: the ability to decode video data encoded by a preset encoding scheme, the ability to stream different video data, and the like.

If the video data is directly sent to the terminal device for playing, the problem that the video data cannot be played even due to the fact that the terminal device does not have corresponding playing performance and a green screen, a clamping and the like appear in the playing process is likely to be caused, and therefore user experience is affected. Therefore, in the embodiment of the invention, before the video data is sent to the terminal device, the playing performance of the terminal device can be detected first, so as to judge whether the terminal device has the capability of processing the video data.

In the embodiment of the invention, the terminal equipment can play the test video data first, and the test video data can be used for detecting the playing performance of the terminal equipment.

As an example, the corresponding encoded video data may be prefabricated according to the actual detection requirement; for example, when it is required to detect whether the terminal device has the capability of decoding video data encoded by the preset encoding mode, the preset encoding mode may be adopted to encode the original video data, and then the original video data encoded by the preset encoding mode is sent to the terminal device.

After receiving the encoded original video data, the terminal device can decode the encoded original video data by using a decoder, thereby obtaining test video data.

Because the test video data is used for detecting the playing performance of the terminal equipment, the content of the video image of the test video data may not have ornamental value; if playing directly on the screen of the terminal device, it may affect the user's use of the terminal device, for example: when the terminal equipment is in a standby state, the test video data is suddenly played. Therefore, in the embodiment of the invention, the test video data can be played off-screen on the terminal equipment. Off-screen playing the test video data may refer to off-screen rendering the test video data on the terminal device. Off-screen rendering refers to the GPU (Graphics Processing Unit, graphics processor) newly developing a buffer beyond the current screen buffer for rendering operations. The test video data is played off-screen, so that the whole detection process is not perceived by a user, and the influence on the use of terminal equipment by the user is avoided.

As an example, the terminal device may refer to a device for playing video data, such as: high definition players, high definition boxes, smart televisions, smart phones, etc., and embodiments of the present invention are not limited in this regard.

Step 102, generating detection data for the off-screen played test video data.

In the embodiment of the invention, if the terminal equipment does not have the playing performance to be detected by the test video data, the test video data cannot be played normally; if the terminal equipment has the playing performance to be detected by the test video data, the test video data can be played normally.

Therefore, the terminal device can generate detection data for the off-screen played test video data when the off-screen played test video data is played. The detection data may refer to the image of the test video data that is played off-screen and the system of the terminal device when the terminal device plays the test video data off-screen, and the collected data, for example: the system time of the terminal device, screenshot of the test video data image played off-screen, and the like, which are not limited by the embodiment of the invention. The detection data can be used for analyzing whether an abnormality and the like occur when the terminal equipment plays the test video data.

And step 103, detecting the playing performance of the terminal equipment based on the detection data.

After the detection data are generated, the terminal equipment can analyze the playing condition of the off-screen playing test video data of the terminal equipment based on the detection data so as to determine whether the terminal equipment can normally play the test video data or not, and further judge whether the terminal equipment has the playing performance to be detected by the test video data or not.

In an embodiment of the present invention, when the terminal device determines that the terminal device has (or does not have) the playing performance to be detected by the test video data, a detection result may be generated according to the determination result, and the detection result is sent to a server connected to the terminal device, so that when the server subsequently sends the video data to the terminal device, the server may send the video data based on the playing performance of the terminal device in the detection result, thereby avoiding sending video data that cannot be normally played to the terminal device.

In summary, in the embodiment of the present invention, a terminal device firstly plays test video data off-screen, and generates detection data for the test video data played off-screen; and then detecting the playing performance of the terminal equipment based on the detection data. The efficiency of detecting the playing performance of the terminal equipment is improved by generating the detection data when the terminal equipment plays the specially-made test video data and then analyzing the playing performance of the terminal equipment based on the detection data. And the test video data is played off-screen on the terminal equipment, so that the detection process is not perceived by the user, and the influence of the detection process on the use of the terminal equipment by the user is avoided.

In the embodiment of the present invention, the playing performance may include an ability to decode video data encoded by a preset encoding manner, and an ability to play different video data in series. In the following, an embodiment will be described in which the capability of detecting whether a terminal device has the capability of decoding video data encoded by a preset encoding mode is used as an example:

fig. 2 is a flowchart of optional steps of a method for detecting playing performance of a terminal device according to an embodiment of the present invention, which specifically may include the following steps:

step 201, off-screen playing test video data by a terminal device; the test video data comprises first video data obtained by decoding original video data coded by a preset coding mode.

When detecting whether the terminal device has the capability of decoding the video data encoded by the preset encoding mode, the original video data can be encoded by the preset encoding mode in advance, and then the original video data encoded by the preset encoding mode is sent to the terminal device.

After receiving the encoded original video data, the terminal equipment can firstly decode the encoded original video data by using a decoder so as to obtain first video data; the first video data may be used to detect whether the terminal device has the capability to decode video data encoded by a preset encoding scheme.

After the first video data is obtained, the terminal equipment can play the first video data off screen.

In the embodiment of the present invention, the preset coding mode may refer to HEVC, and of course, may refer to a coding mode with higher compression efficiency and better compression effect than HEVC.

As an example, the test video data may be downloaded in advance by the terminal device, so as to avoid that the accuracy of the detection result is affected due to a network problem during playing, which is not limited in the embodiment of the present invention.

Step 202, generating detection data for the off-screen played test video data.

As an example, when the terminal device does not have the capability of decoding the video data encoded by the preset encoding mode, the first video data cannot be normally played; when the terminal equipment has the capability of decoding the video data encoded by the preset encoding mode, the first video data can be normally played. Thus, the detection data may be generated for the off-screen played first video data while the first video data is off-screen played.

In an embodiment of the present invention, the detection data may include: the screenshot, the system time, the playing time, etc. may, of course, also include other data of the terminal device when playing the first video data, which is not limited in the embodiment of the present invention.

As an example, the screenshot may refer to off-screen playing a screenshot of an image corresponding to the first video data; the system time may refer to a system time of the terminal device; the play time may refer to a video time of the first video data that is played off-screen.

Step 203, based on the detection data, determining whether the terminal device supports a preset decoding mode, where the preset decoding mode corresponds to the preset encoding mode.

After the detection data is generated, whether the terminal equipment can normally play the first video data or not can be judged according to the detection data, and whether the terminal equipment has the capability of decoding the video data in the preset encoding mode or not is judged according to a judgment result.

As an example, if the terminal device has a capability of decoding video data of a preset encoding mode, it may be considered that the terminal device supports a preset decoding mode; the preset decoding mode corresponds to the preset encoding mode, namely, the original video data encoded by the preset encoding mode is required to be decoded by the preset decoding mode.

In an embodiment of the present invention, the step 203 may include the following sub-steps:

sub-step 11, the detection data comprises first detection data generated for first video data played off-screen; comparing the first detection data with the original video data, and judging whether a first preset abnormal event occurs in the process of off-screen playing of the first video data by the terminal equipment.

In the embodiment of the present invention, when the terminal device plays the first video data off-screen, the terminal device may generate the first detection data for the first video data that is played off-screen, for example: and capturing a screenshot of an image corresponding to the first video data which is played off-screen, and acquiring the system time, the playing time and the like of the terminal equipment when the first video data is played off-screen. The first detection data may be used to determine whether an abnormality occurs when the terminal device plays the first video data.

In the embodiment of the invention, the original video data can be used as a reference, and then the first detection data is compared with the original video data, so that whether a first preset abnormal event occurs when the terminal equipment plays the first video data is judged. The first preset exception event may include: one or more of an image anomaly event, a stuck event, and a frame loss event, where the image anomaly event may refer to a problem that a screenshot of a green screen, a flower screen, or the like is inconsistent with an image of original video data, which is not limited by embodiments of the present invention.

As an example, the screenshot in the first detection data may be compared with the image of the original video frame in the original video data, so as to determine whether an image anomaly event occurs when the terminal device plays the first video data. For example: the similarity between the screenshot and the original video frame image can be calculated using SSIM (Structural SIMilarity ) and PH (Perceptual Hashing, perceptual hash), and then it is determined whether an image anomaly has occurred based on the similarity. The image of the original video frame in the original video data may be sent to the terminal device simultaneously with the encoded original video data, which is not limited in the embodiment of the present invention.

In the embodiment of the invention, in order to simplify the process of comparing the screenshot with the original video frame image, a frame number can be preset on each frame of the original video data; when comparison is needed, the frame number on the screenshot can be identified first, and then the original video frame corresponding to the frame number is obtained from the original video data according to the frame number; and comparing the screenshot with the image of the original video frame, thereby improving the comparison efficiency.

As another example, whether a stuck event or a lost frame event occurs in the first video data that is played off-screen may be determined according to the frame rate of the original video data, the screenshot in the first video data, and the system time. For example: the frame rate of the original video data is 25 frames/second, the frame number of the screenshot is identified as 100, the system time for starting to play the first video data is 01:00:00, the normal system time when the first video data is played with 100 really is calculated as 01:00:04, and in addition, the actual system time when the frame number 100 is played is determined from the first detection data; if the actual system time is later than 01:00:04, the terminal equipment can be considered to generate a clamping event when the first video data is played; if the actual system time is earlier than 01:00:04, the terminal device may be considered to have a frame loss event when playing the first video data, which is not limited in the embodiment of the present invention.

And step 12, if the first preset abnormal event occurs in the process of off-screen playing the first video data by the terminal equipment, judging that the terminal equipment does not support the preset decoding mode.

In the embodiment of the invention, based on the comparison of the first detection data and the original video data, whether an image abnormal event and/or a stuck event and/or a frame loss event occurs when the terminal equipment plays the first video data off-screen can be determined.

As an example, if it is determined, according to the comparison, that an image abnormal event and/or a stuck event and/or a frame loss event occurs when the terminal device plays the first video data off-screen, it may be considered that a first preset abnormal event occurs when the terminal device plays the first video data off-screen.

When the terminal equipment plays the first video data off screen, a first preset abnormal event occurs, and the terminal equipment can be considered to be incapable of normally playing the first video data; furthermore, it may be determined that the terminal device does not have the capability of decoding video data encoded by the preset encoding mode, that is, the terminal device does not support the preset decoding mode corresponding to the preset encoding mode.

And step 13, if the first preset abnormal event does not occur in the process of off-screen playing the first video data by the terminal equipment, judging that the terminal equipment supports the preset decoding mode.

As an example, if it is determined, according to the comparison, that the terminal device does not have an image abnormal event, a stuck event and a frame loss event when the first video data is played off-screen, it may be considered that the terminal device does not have the first preset abnormal event when the first video data is played off-screen.

When the terminal equipment plays the first video data off screen and a first preset abnormal event does not occur, the terminal equipment can be considered to normally play the first video data; furthermore, it may be determined that the terminal device has a capability of decoding video data encoded in a preset encoding manner, that is, the terminal device supports a preset decoding manner corresponding to the preset encoding manner.

In an embodiment of the present invention, when the terminal device determines that the terminal device has (or does not have) the playing performance to be detected by the test video data, the terminal device may generate a detection result according to the determination result, and send the detection result to a server connected to the terminal device; further, the server may add the model of the terminal device to the white list (or not), and open (or not open) video data encoded in a preset encoding manner to the terminal device of the model.

After video data coded by a preset coding mode is opened to the terminal equipment of the model, the terminal equipment of the model can also detect the video data by the steps when the video data coded by the preset coding mode is played daily. And when detecting that the video data encoded by the preset encoding mode is played by the terminal equipment, or when the user feedback is abnormal, feeding back the video data to the server, so that the server can adjust the preset encoding mode opened by the terminal equipment of the model, for example, sending the video data encoded by the AVC encoding mode to the terminal equipment of the model, and stopping sending the video data encoded by the HEVC encoding mode to the terminal equipment of the model, which is not limited by the embodiment of the invention.

In another embodiment of the present invention, the step 203 may further include the following sub-steps:

step 21, the test video data further includes decoding original video data encoded by other encoding modes, and the other encoding modes are decoding modes corresponding to decoding modes supported by the terminal device; the detection data further comprises second detection data generated for second video data played off-screen; comparing the second detection data with the original video data, and judging whether a first preset abnormal event occurs in the process of off-screen playing of the second video data by the terminal equipment.

When the terminal device itself is abnormal, for example, screenshot and screen blacking cannot be performed normally, accuracy of the first detection data may be affected, that is, the first detection data cannot accurately reflect whether the terminal device can play the first video data normally. Therefore, in the embodiment of the invention, the second video data which can be normally played by the terminal equipment can be played on the terminal equipment. The second video data may be used to exclude interference of the abnormal condition of the terminal device itself to the play performance detection result.

As an example, the original video data encoded by other encoding methods, which are encoding methods corresponding to the decoding methods supported by the terminal device, such as AVC, may be sent to the terminal device. After receiving the original video data encoded by other encoding modes, the terminal equipment can decode the original video data by using a decoder to obtain second video data.

Because the other coding modes are coding modes corresponding to the decoding modes supported by the terminal equipment, the terminal equipment can decode the original video data coded by the other coding modes and can normally play the second video data under the normal condition. Therefore, in the embodiment of the invention, the second video data can be played off-screen on the terminal equipment, the second detection data is generated aiming at the second video data played off-screen, and whether the terminal equipment has abnormality or not is judged based on the second detection data.

As an example, the second detection data may be compared with the original video data, so as to determine whether the first preset abnormal event occurs when the terminal device plays the second video data off-screen. When a first preset abnormal event occurs, the terminal equipment can be considered to have abnormality; when the first preset abnormal event does not occur, the terminal device can be considered to be normal.

In the embodiment of the invention, the original video data of the second detection data is consistent with the original video data of the first detection data.

And a sub-step 22 of judging that the terminal equipment supports the preset decoding mode if a first preset abnormal event does not occur in the process of off-screen playing the first video data and the second video data by the terminal equipment.

As an example, if the terminal device does not have any abnormality when playing the first video data and the second video data, the terminal device may be considered to have no abnormality, and the terminal device may be able to play the first video data normally; furthermore, it may be determined that the terminal device has a capability of decoding video data encoded in a preset encoding manner, that is, the terminal device supports a preset decoding manner corresponding to the preset encoding manner.

And step 23, if the first preset abnormal event occurs in the process of off-screen playing the first video data by the terminal equipment, the first preset abnormal event does not occur in the process of off-screen playing the second video data, and the terminal equipment is judged to not support the preset decoding mode.

As another example, if the terminal device generates a first preset abnormal event while playing the first video data and does not generate the first preset abnormal event while playing the second video data, the terminal device may be considered to have no abnormality, but the terminal device cannot normally play the first video data; furthermore, it may be determined that the terminal device does not have a capability of decoding video data encoded in a preset encoding manner, that is, the terminal device does not support a preset decoding manner corresponding to the preset encoding manner.

As yet another example, if the terminal device generates a second preset abnormal event while playing the second video data, it may be considered that the terminal device itself is abnormal; at this time, if the terminal device continues to determine whether to support the preset decoding mode corresponding to the preset encoding mode, a misjudgment situation may occur. Therefore, in order to avoid misjudgment on the playing performance of the terminal equipment, the first video data and the second video data can be played back on the terminal equipment; of course, the fault detection may be performed on the terminal device first, and then the play performance of the terminal device may be detected.

In an embodiment of the present invention, before the terminal device plays the test video data off-screen, the method may further include the following steps:

detecting the working state of the terminal equipment; and executing the step of off-screen playing detection video data at the terminal equipment when the working state meets the preset test condition.

In the embodiment of the invention, in order to avoid interference to normal use of the terminal equipment by the user in the detection process, the working state of the terminal equipment can be detected first; and when the working state meets the preset test condition, the test video data is played off screen on the terminal equipment. The operating state may include: the power-off state, the play state, the standby state, etc., to which the embodiments of the present invention are not limited.

As an example, it may be detected whether the terminal device enters a standby state; if the terminal equipment enters a standby state, when the terminal equipment enters the standby state for more than a preset time period, judging that the working state meets a preset test condition.

Since the detection process requires the terminal device to be in the beginning, in the embodiment of the present invention, it may be detected whether the terminal device enters the standby state.

In the embodiment of the invention, after the terminal equipment enters the standby state, the time for entering the standby state can be detected to judge whether the time for entering the standby state exceeds the preset duration. When the time for the terminal equipment to enter the standby state exceeds the preset time length, the user can be considered that the terminal equipment is not used in a short time; therefore, when the time for the terminal device to enter the standby state exceeds the preset duration, the working state is judged to meet the preset test condition. And detecting the playing performance of the terminal equipment after the working state meets the preset test condition so as to avoid influencing the normal use of the terminal equipment by a user.

In the embodiment of the invention, the test video data can be played off-screen according to the normal playing sequence, or can be played off-screen in a mode of dragging a progress bar, for example: and when the screen-off playing is performed, dragging the playing time from 00:01:00 to 0:01:35. The embodiments of the present invention are not limited in this regard.

In summary, in the embodiment of the invention, the terminal device decodes the video data adopting the preset encoding mode, then performs off-screen playing on the decoded video data, and generates detection data in the off-screen playing process; and then judging the decoding capability of the terminal equipment according to the detection data to determine whether the terminal equipment supports a preset decoding mode.

In addition, video data encoded by the supported encoding mode is played on the terminal equipment so as to eliminate the interference of the abnormality of the terminal equipment on the play performance detection result, and the accuracy of detecting whether the terminal equipment supports the preset decoding mode is improved.

In the embodiment of the invention, the capability of serializing different video data can comprise the capability of serializing video data and advertisement video data and the capability of serializing different resolution video data. In the following, description will be given by taking, as an embodiment, the capability of detecting whether a terminal device has a serial video data and an advertisement video data:

fig. 3 is a flowchart of optional steps of another method for detecting playing performance of a terminal device according to an embodiment of the present invention, which specifically may include the following steps:

Step 301, off-screen playing test video data by a terminal device; the test video data includes third video data including movie video data and advertisement video data in series.

In the process of playing video data, the terminal equipment may play advertisement video data in series; for example: firstly, playing advertisement video data, and then playing film video data; or, the video data is played first, then the advertisement video data is played, and then the video data is played.

However, since the width and height of the advertisement video data image and the frame rate of the video frame may not be the same as those of the movie video data image, if the advertisement video data and the movie video data are directly serially broadcast, a problem such as a skip abnormality may occur. Therefore, in the embodiment of the invention, the video data and the advertisement video data can be connected in series to obtain the third video data. The third video data may be used to detect whether the terminal device has the capability to stream video data and advertisement video data. After the third video data is obtained, the third video data can be played off-screen on the terminal equipment.

Step 302, generating detection data for the off-screen played test video data; the detection data includes third detection data generated for third video data that is played off-screen.

And when third video data is played off-screen on the terminal equipment, third detection data can be generated aiming at the third video data played off-screen. The third detection data may be used to determine whether an abnormality occurs when the terminal device serial plays video data and advertisement video data.

Step 303, determining whether a second preset abnormal event occurs in the process of off-screen playing the third video data by the terminal device according to the third detection data.

In the embodiment of the invention, the playing condition of the connection part of the film video data and the advertisement video data can be analyzed according to the third detection data so as to judge whether a second preset abnormal event occurs in the process of off-screen playing of the third video data by the terminal equipment.

As an example, the second preset exception event includes a jump exception event. The jump exception event may refer to an abnormality in the video image at the junction, for example: the front and rear images have inconsistent width and height, jump image black screen, jump card, etc., which is not limited by the embodiment of the invention.

Step 304, if the second preset abnormal event occurs in the process of off-screen playing the third video data by the terminal device, determining that the terminal device does not support serial playing of the video data and the advertisement video data.

As an example, if the terminal device finds, according to the third detection data, that a second preset abnormal event occurs in the process of playing the third video data, the terminal device may consider that the terminal device may not normally play the third video data; further, it may be determined that the terminal device does not have the capability to stream video data and advertisement video data.

And 305, if the second preset abnormal event does not occur in the process of off-screen playing the third video data by the terminal equipment, judging that the terminal equipment supports the serial playing of the video data and the advertisement video data.

As an example, if the terminal device does not find that the second preset abnormal event occurs in the process of playing the third video data according to the third detection data, the terminal device may be considered to be able to normally play the third video data; further, it may be determined that the terminal device has the capability of streaming video data and advertising video data.

In summary, in the embodiment of the present invention, video data and advertisement video data are serially broadcast on a terminal device, so as to detect whether the terminal device supports serial broadcasting of the video data and the advertisement video data.

The following description will be made with reference to an embodiment of the capability of detecting whether a terminal device has a capability of streaming video data of different resolutions:

fig. 4 is a flowchart of optional steps of a method for detecting playing performance of a terminal device according to another embodiment of the present invention, which specifically may include the following steps:

step 401, off-screen playing test video data by a terminal device; the test video data includes fourth video data including video data of at least two resolutions in series.

When a user watches video, the terminal device can adjust the resolution of the video data according to the network condition, for example: when the network situation becomes worse, the video data can be switched from high resolution to low resolution. When switching the resolution of video data, it is necessary to stream video data from the currently playing video data to another resolution. In the process of serial broadcasting, the problems of jumping abnormality such as jumping image black screen, jumping and blocking are very easy to occur. Therefore, in the embodiment of the invention, the video data with different resolutions can be connected in series to obtain the fourth video data. The fourth video data may be used to detect whether the terminal device has the capability to stream video data of different resolutions. After the fourth video data is obtained, the fourth video data can be played off-screen on the terminal equipment.

As an example, the image, frame rate of video data of different resolutions concatenated may be uniform, as embodiments of the invention are not limited in this regard.

Step 402, generating detection data for the off-screen played test video data; the detection data includes fourth detection data generated for fourth video data for off-screen playback.

And when the fourth video data is played off-screen on the terminal equipment, fourth detection data can be generated aiming at the fourth video data played off-screen. The fourth detection data may be used to determine whether an abnormality occurs when the terminal device serially broadcasts video data with different resolutions.

Step 403, determining whether a second preset abnormal event occurs in the process of off-screen playing of the fourth video data by the terminal device according to the fourth detection data.

In the embodiment of the invention, the playing condition of the connection part of the video data with different resolutions can be analyzed according to the fourth detection data so as to judge whether a second preset abnormal event occurs in the process of off-screen playing of the fourth video data by the terminal equipment.

Step 404, if the second preset abnormal event occurs in the process of off-screen playing the fourth video data by the terminal device, determining that the terminal device does not support serial playing of video data with different resolutions.

As an example, if the terminal device finds, according to the fourth detection data, that a second preset abnormal event occurs in the process of playing the fourth video data, the terminal device may consider that the terminal device may not normally play the fourth video data; further, it may be determined that the terminal device does not have the capability to stream video data of different resolutions, and the terminal device does not support the streaming of the video data of different resolutions.

Step 405, if the second preset abnormal event does not occur in the process of off-screen playing the fourth video data by the terminal device, determining that the terminal device supports serial playing of video data with different resolutions.

As an example, if the terminal device does not find that the second preset abnormal event occurs in the process of playing the fourth video data according to the fourth detection data, the terminal device may be considered to be capable of normally playing the third video data; furthermore, it may be determined that the terminal device has the capability to stream video data of different resolutions, the terminal device supporting the streaming of the video data of different resolutions.

In summary, in the embodiment of the present invention, video data with different resolutions are serially broadcast on a terminal device, so as to detect whether the terminal device supports serial broadcast of the video data with different resolutions.

It should be noted that, for simplicity of explanation, the system embodiments are depicted as a series of acts, but it should be understood by those skilled in the art that the embodiments are not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred embodiments, and that the acts are not necessarily required by the embodiments of the invention.

Fig. 5 is a block diagram of a device for detecting playing performance of a terminal device according to an embodiment of the present invention, which may specifically include the following modules:

the test video data playing module 501 is used for off-screen playing test video data by the terminal equipment;

the detection data generation module 502 is configured to generate detection data for the off-screen played test video data;

and a play performance detection module 503, configured to detect play performance of the terminal device based on the detection data.

In a preferred embodiment of the present invention, the test video data includes first video data obtained by decoding original video data encoded by a preset encoding method;

The play performance detection module 503 includes:

In a preferred embodiment of the present invention, the detection data includes first detection data generated for first video data played off-screen;

wherein the first preset exception event includes at least one exception of: an image abnormal event, a stuck event and a frame loss event.

In a preferred embodiment of the present invention, the test video data further includes second video data obtained by decoding original video data encoded by other encoding methods, where the other encoding methods are decoding methods corresponding to decoding methods supported by the terminal device; the detection data further comprises second detection data generated for second video data played off-screen;

In a preferred embodiment of the present invention, the play performance detection module 503 includes:

In a preferred embodiment of the present invention, the test video data includes third video data including movie video data and advertisement video data connected in series; the detection data comprises third detection data generated for third video data played off-screen;

Wherein the second preset exception event includes: jump exception event.

In a preferred embodiment of the present invention, the test video data includes fourth video data including video data of at least two resolutions in series; the detection data comprises fourth detection data generated for fourth video data played off-screen;

In a preferred embodiment of the present invention, the apparatus further comprises:

the working state detection module 504 is configured to detect a working state of the terminal device before the terminal device plays the detected video data off-screen.

In a preferred embodiment of the present invention, the working state detection module 504 includes:

In a preferred embodiment of the present invention, the detection data includes: screenshot, system time, play time.

To sum up, in the embodiment of the invention, firstly, off-screen playing test video data is carried out on terminal equipment, and detection data is generated aiming at the off-screen played test video data; and then detecting the playing performance of the terminal equipment based on the detection data. The efficiency of detecting the playing performance of the terminal equipment is improved by generating the detection data when the terminal equipment plays the specially-made test video data and then analyzing the playing performance of the terminal equipment based on the detection data. And the test video data is played off-screen on the terminal equipment, so that the detection process is not perceived by the user, and the influence of the detection process on the use of the terminal equipment by the user is avoided.

The embodiment of the invention also provides an electronic device, as shown in fig. 6, which comprises a processor 601, a communication interface 602, a memory 603 and a communication bus 604, wherein the processor 601, the communication interface 602 and the memory 603 complete communication with each other through the communication bus 604,

a memory 603 for storing a computer program;

the processor 601 is configured to execute the program stored in the memory 603, and implement the following steps:

the terminal equipment plays the test video data off screen;

generating detection data aiming at the off-screen played test video data;

wherein the second preset exception event includes: jump exception event.

detecting the working state of the terminal equipment;

Optionally, the detecting the working state of the terminal device includes:

detecting whether the terminal equipment enters a standby state;

Optionally, the detection data includes: screenshot, system time, play time.

The communication bus mentioned by the above terminal may be a peripheral component interconnect standard (Peripheral Component Interconnect, abbreviated as PCI) bus or an extended industry standard architecture (Extended Industry StandardArchitecture, abbreviated as EISA) bus, etc. The communication bus may be classified as an address bus, a data bus, a control bus, or the like. For ease of illustration, the figures are shown with only one bold line, but not with only one bus or one type of bus.

The communication interface is used for communication between the terminal and other devices.

The memory may include random access memory (RandomAccess Memory, RAM) or non-volatile memory (non-volatile memory), such as at least one disk memory. Optionally, the memory may also be at least one memory device located remotely from the aforementioned processor.

The processor may be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU for short), a network processor (Network Processor, NP for short), etc.; but also digital signal processors (Digital Signal Processing, DSP for short), application specific integrated circuits (Application Specific Integrated Circuit, ASIC for short), field-programmable gate arrays (Field-Programmable GateArray, FPGA for short) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

In yet another embodiment of the present invention, a computer readable storage medium is provided, where instructions are stored, when the computer readable storage medium runs on a computer, to cause the computer to execute the method for detecting playing performance of a terminal device according to any one of the foregoing embodiments.

In yet another embodiment of the present invention, a computer program product containing instructions, which when executed on a computer, causes the computer to perform the method for detecting playing performance of a terminal device according to any one of the foregoing embodiments is provided.

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, produces a flow or function in accordance with embodiments of the present invention, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another, for example, by wired (e.g., coaxial cable, optical fiber, digital Subscriber Line (DSL)), or wireless (e.g., infrared, wireless, microwave, etc.). The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid State Disk (SSD)), etc.

It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

In this specification, each embodiment is described in a related manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments.

The foregoing description is only of the preferred embodiments of the present invention and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention are included in the protection scope of the present invention.

Claims

1. The method for detecting the playing performance of the terminal equipment is characterized by comprising the following steps:

the terminal equipment newly opens up a buffer zone outside the current screen buffer zone to render test video data for detecting the playing performance of the terminal equipment so as to play the test video data off-screen; the test video data comprises third video data, the third video data comprises film video data and advertisement video data which are connected in series, and the width and height of the advertisement video data image and the frame rate of the video frame are different from each other;

generating detection data for judging whether the terminal equipment can normally play the test video data aiming at the off-screen played test video data;

based on the detection data, detecting the playing performance of the terminal device includes: and judging whether the terminal equipment supports serial broadcasting of different video data or not based on the detection data.

2. The method according to claim 1, wherein the test video data further comprises first video data obtained by decoding original video data encoded by a preset encoding method;

the detecting, based on the detection data, the playing performance of the terminal device further includes:

3. The method of claim 2, wherein the detection data comprises first detection data generated for off-screen played first video data; the step of judging whether the terminal equipment supports a preset decoding mode based on the detection data comprises the following steps:

4. The method according to claim 3, wherein the test video data further includes decoding original video data encoded by other encoding methods, and the other encoding methods are decoding methods corresponding to the decoding methods supported by the terminal device; the detection data further comprises second detection data generated for second video data played off-screen;

5. The method of claim 1, wherein the detection data comprises third detection data generated for third video data that is played off-screen;

wherein the second preset exception event includes: jump exception event.

6. The method of claim 1, wherein the test video data further comprises fourth video data comprising video data of at least two resolutions in series; the detection data comprises fourth detection data generated for fourth video data played off-screen;

7. The method of claim 1, wherein prior to off-screen playback of the detected video data by the terminal device, the method further comprises:

detecting the working state of the terminal equipment;

8. The method of claim 7, wherein the detecting the operating state of the terminal device comprises:

detecting whether the terminal equipment enters a standby state;

9. The method of claim 1, wherein the detection data comprises: screenshot, system time, play time.

10. The device for detecting the playing performance of the terminal equipment is characterized by comprising the following components:

the test video data playing module is used for newly opening a buffer zone outside the current screen buffer zone of the terminal equipment to render test video data for detecting the playing performance of the terminal equipment so as to play the test video data off screen; the test video data comprises third video data, the third video data comprises film video data and advertisement video data which are connected in series, and the width and height of the advertisement video data image and the frame rate of the video frame are different from each other;

the detection data generation module is used for generating detection data for judging whether the terminal equipment can normally play the test video data aiming at the off-screen played test video data;

the play performance detection module is used for detecting the play performance of the terminal equipment based on the detection data;

The play performance detection module comprises:

11. The electronic equipment is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory are communicated with each other through the communication bus;

a memory for storing a computer program;

a processor for carrying out the method steps of any one of claims 1-9 when executing a program stored on a memory.

12. A computer readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the method according to any one of claims 1-9.