CN117135399A - Video jamming detection method and device, electronic equipment and storage medium - Google Patents

Abstract

The invention discloses a video clamping detection method, a device, electronic equipment and a storage medium. By adopting the embodiment of the invention, the video to be detected can be detected in a blocking way under the condition of not depending on the video information of the video to be detected, and the video blocking detection efficiency is improved.

Description

Video stutter detection method, device, electronic equipment and storage medium

Technical field

The present invention relates to the field of image processing technology, and in particular to a video freeze detection method, device, electronic equipment and storage medium.

Background technique

With the rapid development of multimedia technology, the requirements for the user experience of multimedia files such as videos are getting higher and higher. Among them, the smoothness of video playback is a problem that users are more concerned about.

In related technologies, in order to determine the smoothness of video playback, it is usually determined by observing the stuttering situation of the video played by the test device. However, observing whether the video played by the test device is stuttered is manually and subjectively judged, which leads to the failure of the video. The detection accuracy of freeze detection is low and the error rate is high, which cannot meet the video playback smoothness needs of different users.

Therefore, how to implement simple and effective video freeze detection is an urgent problem that needs to be solved.

Contents of the invention

The purpose of the embodiments of the present invention is to provide a video freeze detection method, device, electronic equipment and storage medium to solve the technical problems of low detection accuracy and high error rate of video freeze detection in related technologies.

In a first aspect, embodiments of the present invention provide a video freeze detection method, including:

Mark the video to be detected to obtain the first video containing marked information;

Record the playback process of the first video to obtain a second video;

Obtain mark information collected within the target time period in the second video;

According to the video frame rate of the second video and the collected mark information, the freezing result of the playback process is determined.

In a second aspect, an embodiment of the present invention provides a video freeze detection device, including:

The marking module is used to mark the video to be detected and obtain the first video containing marked information;

A recording module, used to record the playback process of the first video to obtain the second video;

An acquisition module, used to acquire the mark information collected within the target time period in the second video;

A freeze detection module is configured to determine the freeze result of the playback process based on the video frame rate of the second video and the collected mark information.

In some embodiments, the marking module includes an extraction unit, a marking unit and a synthesis unit;

The extraction unit is used to perform image frame extraction processing on the video to be detected to obtain several first images;

The marking unit is configured to perform marking processing on the first image according to the image frame number of the first image in the video to be detected, so as to obtain several second images containing marking information, wherein, the The mark information corresponds to the image frame serial number;

The synthesis unit is configured to perform video synthesis processing on a plurality of the second images to obtain a first video containing mark information.

In some embodiments, the marking unit is specifically configured to generate marking information associated with the image frame number according to the image frame number of the first image; and add the marking information to the first image. , obtain several second images containing mark information.

In some embodiments, the mark information includes QR code information;

The marking unit is specifically configured to add the QR code information to the first image in the form of an image to obtain several second images containing QR code images, wherein the QR code image The size is smaller than the size of the first image.

In some embodiments, the marking unit is specifically configured to construct a marked area in the first image, the pixel values of the marked area are different from the pixel values of the non-marked area, and the non-marked area is the third An area in an image other than the marked area; adding the marked information to the marked area to obtain several second images containing marked information.

In some embodiments, the synthesis unit is specifically configured to sort a plurality of the second images according to the image frame sequence number corresponding to the mark information to obtain a plurality of sorted second images; at the target video frame rate Video reconstruction is performed on the plurality of sorted second images to obtain a first video containing mark information.

In some embodiments, the jam detection module includes a first determination unit, a second determination unit and a jam detection unit;

The first determining unit is used to determine the image frame sequence number of each frame of image corresponding to the collected mark information;

The second determining unit is used to determine the first image frame number with the smallest number and the second image frame number with the largest number among the image frame numbers of each frame image;

The freeze detection unit is configured to determine the difference between the first image frame number and the second image frame number, the length of the target time period, and the video frame rate of the second video. , determine the jamming result of the playback process.

In a third aspect, embodiments of the present invention provide an electronic device. The electronic device includes a processor, a memory, and a computer program stored in the memory and executable on the processor. The processor executes the computer program. The program implements the steps in any of the above video freeze detection methods.

In a fourth aspect, embodiments of the present invention provide a computer-readable storage medium. The computer-readable storage medium stores a computer program. When the computer program is executed by a processor, the video freezing described in any of the above items is achieved. Steps in the detection method.

Embodiments of the present invention provide a video freeze detection method, device, electronic equipment and storage medium. The method can obtain a first video containing marked information by marking the video to be detected, and record the playback of the first video. The second video is obtained in the process, so that the stuck detection of the playback process can be realized based on the mark information collected within the target time period in the second video and the video frame rate of the second video. By adopting the embodiments of the present invention, it is possible to implement freeze detection in the video to be detected without relying on the video information of the video to be detected, thereby improving the efficiency of video freeze detection.

Description of the drawings

Figure 1 is a schematic flow chart of a video freeze detection method provided by an embodiment of the present invention;

Figure 2 is a schematic diagram of a second image containing mark information provided by an embodiment of the present invention;

Figure 3 is another schematic diagram of a second image containing mark information provided by an embodiment of the present invention;

Figure 4 is a schematic flow chart of the video freeze detection principle provided by an embodiment of the present invention;

Figure 5 is a schematic diagram of the application scenario corresponding to Figure 4;

Figure 6 is a schematic structural diagram of a video freeze detection device provided by an embodiment of the present invention;

Figure 7 is a schematic structural diagram of a marking module provided by an embodiment of the present invention;

Figure 8 is a schematic structural diagram of a jam detection module provided by an embodiment of the present invention;

Figure 9 is a schematic structural diagram of an electronic device provided by an embodiment of the present invention;

FIG. 10 is another schematic structural diagram of an electronic device provided by an embodiment of the present invention.

Detailed ways

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without making creative efforts fall within the scope of protection of the present invention.

It should be understood that various steps described in the method implementations of the present disclosure may be executed in different orders and/or in parallel. Furthermore, method embodiments may include additional steps and/or omit performance of illustrated steps. The scope of the present disclosure is not limited in this regard.

As used herein, the term "include" and its variations are open-ended, ie, "including but not limited to." The term "based on" means "based at least in part on." The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; and the term "some embodiments" means "at least some embodiments". Relevant definitions of other terms will be given in the description below.

In related technologies, in order to determine the smoothness of video playback, it is usually determined by observing the stuttering situation of the video played by the test device. However, observing whether the video played by the test device is stuttered is manually and subjectively judged, which leads to the failure of the video. The detection accuracy of freeze detection is low and the error rate is high, which cannot meet the video playback smoothness needs of different users.

Therefore, how to implement simple and effective video freeze detection is an urgent problem that needs to be solved.

In order to solve the technical problems existing in the related art, an embodiment of the present invention provides a video freeze detection method. Please refer to Figure 1. Figure 1 is a schematic flow chart of the video freeze detection method provided by an embodiment of the present invention. The method includes steps 101 to 104;

Step 101: Mark the video to be detected to obtain a first video containing mark information.

In related technologies, video freeze detection is usually accomplished by observing the freeze situation of the video to be detected. However, manually and subjectively observing the video freeze situation with the naked eye has a high error rate and cannot improve video freeze. The detection accuracy of the test. Therefore, this application can obtain the first video containing the mark information by performing mark processing on the video to be detected, and then play the first video and identify the mark information in the first video during the playback process, so as to obtain the first video based on the third video. The mark information in a video determines the freezing situation during the playback process. Compared with manually observing the video freezing situation subjectively with the naked eye, this application can provide reliable judgment standards for the judgment of video freezing situations, and effectively adjust the video freezing situation. Detection accuracy of video stutter detection.

In some embodiments, the marking process provided by this implementation may be to mark each frame of the image in the video to be detected, thereby generating specific marking information in each frame of the image in the video to be detected, thereby facilitating subsequent processing of the marked to-be-contained images. When detecting video freezes, that is, the first video, the freeze status of the video playback can be determined based on the mark information contained in each frame of the image.

Specifically, this embodiment provides a step of labeling the video to be detected to obtain the first video containing label information: performing image frame extraction processing on the video to be detected to obtain several first images; The image frame number in the video to be detected is marked, and the first image is marked to obtain several second images containing marked information; the video synthesis process is performed on several second images to obtain the first video containing marked information.

Since the video is composed of multiple images with consecutive frame numbers, the image frame extraction process provided in this embodiment mainly splits the video to be detected into multiple images with consecutive frame numbers. That is, the first image provided by this embodiment. Then, according to the image frame number corresponding to each first image, the corresponding first image is marked, and a plurality of second images containing marked information can be obtained. The mark information provided by this embodiment corresponds to the image frame number, so that the image frame number of the second image in the corresponding video can be determined based on the mark information.

In this embodiment, the mark information provided by this embodiment can be information related to the image frame serial number of each frame of image. In this way, the image frame serial number of each frame of image that has been played during the playback process can be determined based on the mark information, and then This facilitates the subsequent completion of video freeze detection processing based on the image frame sequence number. Specifically, this embodiment provides a step of labeling the first image according to the image frame number of the first image in the video to be detected, and obtaining several second images containing label information, which may be: according to the first image The image frame serial number is used to generate tag information associated with the image frame serial number; the tag information is added to the first image to obtain several second images containing tag information.

Among them, the video to be detected provided by this embodiment may include n frames of images, then the image frame serial numbers provided by this embodiment may be 1, 2, 3,..., n, and the corresponding image frame serial numbers can be obtained after the tag information is recognized. .

As an optional embodiment, please refer to Figure 2. Figure 2 is a schematic diagram of a second image containing mark information provided by an embodiment of the present invention. As shown in Figure 2, the mark information provided by this embodiment can be two-dimensional. Code information, by adding the QR code information to the first image, it can avoid the situation where the mark information is blocked by the content in the first image, thereby improving the recognition rate of the mark information, thereby improving the detection of video freeze detection. Accuracy. Specifically, the step of adding mark information to the first image to obtain several second images containing mark information provided in this embodiment may be: adding the QR code information to the first image in the form of an image. , obtain several second images containing two-dimensional code images, where the size of the two-dimensional code image is smaller than the size of the first image.

As another optional embodiment, please refer to Figure 3. Figure 3 is another schematic diagram of a second image containing mark information provided by an embodiment of the present invention. As shown in Figure 3, the mark information provided by this embodiment is It can be added to the preset area of the first image to further improve the recognition rate of the mark information. Specifically, this embodiment provides a step of adding mark information to a first image to obtain several second images containing mark information, which may be: constructing a mark area in the first image; adding mark information to the mark area. , several second images containing mark information are obtained.

In this embodiment, the preset area is the mark area. This area can be a pre-selected area. For example, the area at the lower end of the first image shown in Figure 3. This area can be at the upper end, middle end, etc. of the first image. Position, the marked area can be 1/5 of the first image, or can be 1/3, 1/2, etc., as long as it is not larger than the first image. The pixel values of the marked area provided by this embodiment are different from the pixel values of the non-marked area. The non-marked area is the area in the first image other than the marked area. Optionally, the pixel value of the marking area provided in this embodiment can be 0, that is, black as shown in Figure 3. By setting the pixel value of the marking area to 0 and setting the marking information in the black marking area, It can further improve the recognition rate of mark information, and further improve the detection accuracy of video freeze detection.

It should be noted that the pixel value of the marking area provided by this embodiment is not limited to 0, and can also be pixel values such as 1, 2, 254, 255, etc., as long as the marking information in the marking area can be accurately identified. , no specific limitation is made here.

In some embodiments, after adding tag information to the first image to obtain the second image, this embodiment requires video synthesis processing on the second image containing the tag information to obtain the first video containing the tag information. Optionally, this embodiment performs video synthesis processing on the second image containing the mark information at a fixed video frame rate, so as to facilitate the process of playing the second video, in which the mark information in the second image in the second video is processed. Perform identification processing. Specifically, this embodiment provides a step of performing video synthesis processing on several second images to obtain a first video containing mark information, which may be: sorting several second images according to the image frame number corresponding to the mark information. , obtain several sorted second images; perform video reconstruction on several sorted second images at the target video frame rate, and obtain a first video containing mark information.

In this embodiment, the target video frame rate provided by this embodiment can be 30 frames, or it can be a frame number greater than 30 frames, such as 45 frames, 60 frames, etc., and is not specifically limited here. Among them, the video reconstruction provided by this embodiment mainly synthesizes the second images corresponding to the consecutive image frame numbers to form a continuous picture to obtain the first video containing the mark information.

Step 102: Record the playback process of the first video to obtain the second video.

In this embodiment, a capture card or a recording tool provided with the test equipment can be used to record the playback process of the first video, thereby obtaining the second video. Among them, in this embodiment, when recording the playback process of the first video, a specific frame rate needs to be used for recording. Specifically, 30 frames can be used, or a number of frames greater than 30 frames, such as 45 frames, 60 frames, etc. can be used. , no specific limitation is made here.

Step 103: Obtain mark information collected within the target time period in the second video.

In this embodiment, after obtaining the recorded second video, if video clip detection needs to be performed in a designated third-party application, the recorded second video needs to be published to the third-party application to generate the first external network link, and play the recorded second video through the first external network link in the third-party application; if video freeze detection needs to be performed online, the recorded second video needs to be published to the external network server To generate a second external network link, and play the recorded second video through the second external network link in online mode; if video freeze detection needs to be performed locally, the recorded second video needs to be stored locally device, and play the stored second video on the local device.

Among them, in order to complete the video freeze detection during the playback process, this embodiment needs to obtain the mark information collected within the target time period in the second video, so as to determine that the playback process is played within the target time period based on the collected mark information. Whether the frame number of the image matches the video frame rate of the second video, thereby determining the freezing result of the playback process. Specifically, this embodiment mainly collects the second image that has been played within the target time period in the second video, and then obtains the corresponding mark information such as QR code information in the played second image, thereby identifying the mark information. to determine the image frame sequence number of the image that has been played within the target time period in the second video, so that the subsequent video freeze detection process can complete the video freeze detection based on the image frame sequence number of the played image.

In this embodiment, the target time period provided by this embodiment can be 1 second, or can be a value such as 2 seconds, 3 seconds, etc., as long as it is not longer than the playback duration of the second video, and is not specifically limited here.

Step 104: Determine the freezing result during the playback process based on the video frame rate of the second video and the collected mark information.

In this embodiment, the video frame rate of the second video provided in this embodiment may be a specific frame rate set during the recording process. When the first video is not recorded at a fixed frame rate, the average frame rate during playback of the second video can be used as the second video based on the playback duration of the second video and the number of frames of the images contained in the second video. The video frame rate of the second video.

As an optional embodiment, this implementation can determine the actual frame rate of the playback process of the second video based on the image frame number corresponding to the collected tag information, and then compare the actual frame rate with the video frame rate of the second video, When the actual frame rate and the video frame rate of the second video meet the preset relationship, it can be determined that the freezing result during the playback process of the second video is freezing. The preset relationship provided by this embodiment may be that the actual frame rate is less than half of the video frame rate of the second video. Specifically, the step of determining the jamming result of the playback process based on the video frame rate of the second video and the collected mark information provided by this embodiment may be: determining the image of each frame corresponding to the collected mark information. Frame serial number; determine the first image frame serial number with the smallest serial number and the second image frame serial number with the largest serial number among the image frame serial numbers of each frame image; according to the difference between the first image frame serial number and the second image frame serial number, the target The length of the time period and the video frame rate of the second video determine the jamming result during playback.

For example, when the target time period is 1 second, the image frame numbers corresponding to the tag information collected within 1 second are 1, 2, 3,..., 25 respectively, and the video frame rate of the second video is 60, then it can be determined The first image frame number is 1 and the second image frame number is 25, thus determining that the difference between the first image frame number and the second image frame number is 24, and then judging the first image frame number and the second image frame number. Is the difference of 24 smaller than the video frame rate of the second video, which is half of 60, which is 30? Since 24 is less than 30, it can be determined that the freezing result during the playback of the second video is freezing.

In this embodiment, when the target time period provided by this embodiment is a time period greater than 1 second, such as 2 seconds, then when determining the actual frame rate of the playback process within the target time period, the first image frame serial number needs to be The difference between the frame number of the second image and the frame number of the second image is divided by the target time period, which is 2, so that the actual frame rate of the playback process within the target time period can be obtained.

In order to better explain the video freeze detection principle of the embodiment of the present invention, please refer to Figure 4 and Figure 5 at the same time. Figure 4 is a schematic flow chart of the video freeze detection principle provided by the embodiment of the present invention. Figure 5 is a flow chart of the video freeze detection principle provided by the embodiment of the present invention. Schematic diagram of the corresponding application scenario. As shown in Figures 4 and 5, when it is necessary to perform video freeze detection on a video to be detected, the video to be detected is first subjected to image frame extraction processing to split the video to be detected into several first images containing image frame serial numbers. (Including n frames of first images), and then add mark information to each frame of the first image. Specifically, add QR code information (mark information) representing the image frame sequence number to each frame of image, thereby obtaining several QR codes containing two The second image containing the QR code information is then subjected to video reconstruction processing to obtain the first video containing the QR code information. After that, use a capture card or recording tool to record/capture the playback process of the first video to obtain the second video. After obtaining the second video, obtain the video frame rate of the second video, and perform frame splitting processing on the second video to obtain multiple second images containing QR code information, and identify each frame that has been played within the target time period. QR code information in the second image, and determine the actual frame rate of the second video during the playback process within the target time period based on the image frame sequence number identified by the QR code information. Finally, it is determined whether the actual frame rate is less than half of the video frame rate of the second video. If so, it is determined that the freezing result during the playback process of the second video is freezing, otherwise it is determined that there is no freezing.

At this point, the description of the video freeze detection method provided by this embodiment is completed.

In summary, the present invention discloses a video freeze detection method. The method includes labeling the video to be detected, obtaining a first video containing label information, recording the playback process of the first video, obtaining a second video, and obtaining a second video. The mark information collected during the target time period in the video is used to determine the jamming result during the playback process based on the video frame rate of the second video and the collected mark information. By adopting the embodiments of the present invention, it is possible to implement freeze detection in the video to be detected without relying on the video information of the video to be detected, thereby improving the efficiency of video freeze detection.

According to the method described in the above embodiment, this embodiment will be further described from the perspective of a video freeze detection device. The video freeze detection device can be implemented as an independent entity, or can be integrated in an electronic device, such as a terminal. To achieve this, the terminal can include mobile phones, tablets, etc.

Please refer to Figure 6. Figure 6 is a schematic structural diagram of a video freeze detection device provided by an embodiment of the present invention. As shown in Figure 6, a video freeze detection device 600 provided by an embodiment of the present invention includes: a marking module 601; Recording module 602, acquisition module 603 and freeze detection module 604;

Among them, the marking module 601 is used to mark the video to be detected to obtain the first video containing mark information.

The recording module 602 is used to record the playback process of the first video to obtain the second video.

The acquisition module 603 is used to acquire the mark information collected within the target time period in the second video.

The freeze detection module 604 is used to determine the freeze result during the playback process based on the video frame rate of the second video and the collected mark information.

In some embodiments, please refer to Figure 7. Figure 7 is a schematic structural diagram of a marking module provided by an embodiment of the present invention. As shown in Figure 7, a marking module 601 provided by an embodiment of the present invention includes an extraction unit 6011, a marking unit 6012 and synthesis unit 6013;

The extraction unit 6011 is used to extract image frames of the video to be detected to obtain several first images.

The marking unit 6012 is configured to perform marking processing on the first image according to the image frame number of the first image in the video to be detected, to obtain several second images containing marking information, where the marking information corresponds to the image frame number.

The synthesis unit 6013 is used to perform video synthesis processing on several second images to obtain a first video containing mark information.

In some embodiments, the marking unit 6012 is specifically configured to generate marking information associated with the image frame number according to the image frame number of the first image; add the marking information to the first image to obtain several third images containing marking information. Two images.

In some embodiments, the marking information includes QR code information, and the marking unit 6012 is specifically configured to add the QR code information to the first image in the form of an image to obtain several second images containing QR code images. , wherein the size of the QR code image is smaller than the size of the first image.

In some embodiments, the marking unit 6012 is specifically configured to construct a marked area in the first image. The pixel values of the marked area are different from the pixel values of the non-marked area. The non-marked area is an area in the first image other than the marked area. ; Add mark information to the mark area to obtain several second images containing mark information.

In some embodiments, the synthesis unit 6013 is specifically configured to sort several second images according to the image frame number corresponding to the mark information to obtain several sorted second images; to sort several sorted second images at the target video frame rate. Perform video reconstruction on the second image to obtain the first video containing mark information.

In some embodiments, please refer to Figure 8, which is a schematic structural diagram of a freeze detection module provided by an embodiment of the present invention. As shown in Figure 8, a freeze detection module 604 provided by this embodiment includes a first Determining unit 6041, second determining unit 6042 and stuck detection unit 6043;

Among them, the first determining unit 6041 is used to determine the image frame sequence number of each frame image corresponding to the collected mark information.

The second determining unit 6042 is used to determine the first image frame number with the smallest number and the second image frame number with the largest number among the image frame numbers of each frame image.

The freeze detection unit 6043 is configured to determine the freeze result of the playback process based on the difference between the first image frame number and the second image frame number, the length of the target time period, and the video frame rate of the second video.

During specific implementation, each of the above modules and/or units can be implemented as an independent entity, or can be combined in any way and implemented as the same or several entities. For the specific implementation of each of the above modules and/or units, please refer to the previous method implementation. For example, please refer to the beneficial effects in the previous method embodiments for specific beneficial effects that can be achieved, and will not be described again here.

In addition, please refer to FIG. 9 , which is a schematic structural diagram of an electronic device provided by an embodiment of the present invention. The electronic device may be a mobile terminal such as a smart phone, a tablet computer, and other devices. As shown in FIG. 9 , the electronic device 900 includes a processor 901 and a memory 902 . Among them, the processor 901 is electrically connected to the memory 902.

The processor 901 is the control center of the electronic device 900. It uses various interfaces and lines to connect various parts of the entire electronic device, and executes electronic tasks by running or loading applications stored in the memory 902 and calling data stored in the memory 902. Various functions of the device 900 and processing data, thereby monitoring the electronic device 900 as a whole.

In this embodiment, the processor 901 in the electronic device 900 will follow the following steps to load instructions corresponding to the processes of one or more application programs into the memory 902, and the processor 901 will run the instructions stored in the memory 902. application in the application, thereby implementing any step in the video freeze detection method provided by the above embodiment.

The electronic device 900 can implement the steps in any embodiment of the video freeze detection method provided by the embodiments of the present invention, and therefore can achieve the beneficial effects that can be achieved by any video freeze detection method provided by the embodiments of the present invention. , please refer to the previous embodiment for details and will not be described again here.

Please refer to Figure 10. Figure 10 is another schematic structural diagram of an electronic device provided by an embodiment of the present invention. As shown in Figure 10, Figure 10 shows a specific structural block diagram of an electronic device provided by an embodiment of the present invention. The electronic device It can be used to implement the video freeze detection method provided in the above embodiment. The electronic device 1000 may be a mobile terminal such as a smart phone or a laptop computer.

The RF circuit 1010 is used to receive and send electromagnetic waves, realize mutual conversion of electromagnetic waves and electrical signals, and thereby communicate with communication networks or other devices. RF circuit 1010 may include a variety of existing circuit elements for performing these functions, such as antennas, radio frequency transceivers, digital signal processors, encryption/decryption chips, Subscriber Identity Module (SIM) cards, memory, and the like. The RF circuit 1010 can communicate with various networks such as the Internet, an intranet, a wireless network, or communicate with other devices through a wireless network. The above-mentioned wireless network may include a cellular telephone network, a wireless local area network or a metropolitan area network. The above-mentioned wireless networks can use various communication standards, protocols and technologies, including but not limited to Global System for Mobile Communication (GSM), Enhanced Data GSM Environment (EDGE), broadband code division Multiple access technology (Wideband Code Division Multiple Access, WCDMA), code division multiple access technology (Code Division Access, CDMA), time division multiple access technology (Time Division Multiple Access, TDMA), wireless fidelity technology (Wireless Fidelity, Wi-Fi) ( Such as the Institute of Electrical and Electronics Engineers standards IEEE 802.11a, IEEE 802.11b, IEEE802.11g and/or IEEE802.11n), Voice over Internet Protocol (VoIP), Worldwide Interoperability for Microwave Access, Wi-Max), other protocols for email, instant messaging and short messaging, and any other suitable communication protocols, even those that are not yet developed.

The memory 1020 can be used to store software programs and modules, such as the program instructions/modules corresponding to the video freeze detection method in the above embodiment. The processor 1080 executes various functional applications by running the software programs and modules stored in the memory 1020. Detect video freezes.

Memory 1020 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 1020 may further include memory located remotely relative to the processor 1080 , and these remote memories may be connected to the electronic device 1000 through a network. Examples of the above-mentioned networks include but are not limited to the Internet, intranets, local area networks, mobile communication networks and combinations thereof.

The input unit 1030 may be used to receive input numeric or character information and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control. Specifically, the input unit 1030 may include a touch-sensitive surface 1031 and other input devices 1032. The touch-sensitive surface 1031, also known as a touch display or a touchpad, can collect the user's touch operations on or near it (for example, the user uses a finger, stylus, or any suitable object or accessory on the touch-sensitive surface 1031 or on the operations near the touch-sensitive surface 1031), and drive the corresponding connection device according to the preset program. Optionally, the touch-sensitive surface 1031 may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact point coordinates, and then sends it to the touch controller. to the processor 1080, and can receive commands from the processor 1080 and execute them. In addition, the touch-sensitive surface 1031 can be implemented using various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch-sensitive surface 1031, the input unit 1030 may also include other input devices 1032. Specifically, other input devices 1032 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), trackball, mouse, joystick, etc.

The display unit 1040 may be used to display information input by the user or information provided to the user as well as various graphical user interfaces of the electronic device 1000 , which may be composed of graphics, text, icons, videos, and any combination thereof. The display unit 1040 may include a display panel 1041. Optionally, the display panel 1041 may be configured in the form of LCD (Liquid Crystal Display, liquid crystal display), OLED (Organic Light-Emitting Diode, organic light-emitting diode), etc. Further, the touch-sensitive surface 1031 can cover the display panel 1041. When the touch-sensitive surface 1031 detects a touch operation on or near it, it is sent to the processor 1080 to determine the type of the touch event. The processor 1080 then determines the type of the touch event. Type provides corresponding visual output on display panel 1041. Although in the figure, the touch-sensitive surface 1031 and the display panel 1041 are used as two independent components to implement input and output functions, in some embodiments, the touch-sensitive surface 1031 and the display panel 1041 can be integrated to implement input and output functions. output function.

Electronic device 1000 may also include at least one sensor 1050, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor. The ambient light sensor may adjust the brightness of the display panel 1041 according to the brightness of the ambient light, and the proximity sensor may generate an interrupt when the flip is closed or closed. As a kind of motion sensor, the gravity acceleration sensor can detect the magnitude of acceleration in various directions (usually three axes). It can detect the magnitude and direction of gravity when stationary. It can be used to identify applications of mobile phone posture (such as horizontal and vertical screen switching, related games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, knock), etc.; as for the electronic device 1000, it can also be configured with other sensors such as gyroscope, barometer, hygrometer, thermometer, infrared sensor, etc., here No longer.

The audio circuit 1060, the speaker 1061, and the microphone 1062 can provide an audio interface between the user and the electronic device 1000. The audio circuit 1060 can transmit the electrical signal converted from the received audio data to the speaker 1061, and the speaker 1061 converts it into a sound signal for output; on the other hand, the microphone 1062 converts the collected sound signal into an electrical signal, and the audio circuit 1060 After receiving, it is converted into audio data, and then processed by the audio data output processor 1080, and then sent to, for example, another terminal through the RF circuit 1010, or the audio data is output to the memory 1020 for further processing. Audio circuitry 1060 may also include an earphone jack to provide communication of peripheral earphones with electronic device 1000 .

The electronic device 1000 can help users receive requests, send information, etc. through the transmission module 1070 (such as a Wi-Fi module), which provides users with wireless broadband Internet access. Although the transmission module 1070 is shown in the figure, it can be understood that it is not a necessary component of the electronic device 1000 and can be omitted as needed without changing the essence of the invention.

The processor 1080 is the control center of the electronic device 1000, using various interfaces and lines to connect various parts of the entire mobile phone, by running or executing software programs and/or modules stored in the memory 1020, and calling data stored in the memory 1020 , perform various functions of the electronic device 1000 and process data, thereby performing overall monitoring of the electronic device. Optionally, the processor 1080 may include one or more processing cores; in some embodiments, the processor 1080 may integrate an application processor and a modem processor, where the application processor mainly processes the operating system, user interface and applications, etc., the modem processor primarily handles wireless communications. It can be understood that the above modem processor may not be integrated into the processor 1080.

The electronic device 1000 also includes a power supply 1090 (such as a battery) that powers various components. In some embodiments, the power supply can be logically connected to the processor 1080 through a power management system to manage charging, discharging, and power consumption through the power management system. Management and other functions. Power supply 1090 may also include one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, power status indicators, and other arbitrary components.

Although not shown, the electronic device 1000 also includes a camera (such as a front camera, a rear camera), a Bluetooth module, etc., which will not be described again here. Specifically in this embodiment, the display unit of the electronic device is a touch screen display, and the mobile terminal also includes a memory and one or more programs, wherein one or more programs are stored in the memory and are configured to be configured by one or more programs. The above processor executes one or more programs to implement any step in the video freeze detection method provided by the above embodiments.

During specific implementation, each of the above modules can be implemented as an independent entity, or can be combined in any way and implemented as the same or several entities. For the specific implementation of each of the above modules, please refer to the previous method embodiments, and will not be described again here.

Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructions, or by controlling relevant hardware through instructions. The instructions can be stored in a computer-readable storage medium, and loaded and executed by the processor. To this end, embodiments of the present invention provide a storage medium in which a plurality of instructions are stored, and the instructions can implement any step in the video freeze detection method provided in the above embodiments when executed by a processor.

The storage medium may include: read only memory (ROM, Read Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk, etc.

Since the instructions stored in the storage medium can execute the steps in any embodiment of the video freeze detection method provided by the embodiment of the present invention, therefore, any video freeze detection method provided by the embodiment of the present invention can be implemented. The beneficial effects that can be achieved are detailed in the previous embodiments and will not be described again here.

The above is a detailed introduction to a video freeze detection method, device, electronic equipment and storage medium provided by the embodiments of the present application. This article uses specific examples to illustrate the principles and implementation methods of the present application. The above embodiments The description is only used to help understand the methods and core ideas of this application; at the same time, for those skilled in the art, there will be changes in the specific implementation and application scope based on the ideas of this application. In summary, The contents of this specification should not be construed as limiting this application. Moreover, for those of ordinary skill in the art, several improvements and modifications can be made without departing from the principles of the present invention, and these improvements and modifications are also regarded as the protection scope of the present invention.

Claims (10)

1. A video clip detection method, comprising:

marking the video to be detected to obtain a first video containing marking information;

recording the playing process of the first video to obtain a second video;

acquiring marking information acquired in a target time period in the second video;

and determining a clamping result of the playing process according to the video frame rate of the second video and the acquired marking information.

2. The method of claim 1, wherein the marking the video to be detected to obtain the first video containing marking information comprises:

carrying out image frame extraction processing on the video to be detected to obtain a plurality of first images;

marking the first image according to the image frame number of the first image in the video to be detected to obtain a plurality of second images containing marking information, wherein the marking information corresponds to the image frame number;

and carrying out video synthesis processing on the plurality of second images to obtain a first video containing marking information.

3. The method according to claim 2, wherein the marking the first image according to the image frame number of the first image in the video to be detected to obtain a plurality of second images containing marking information includes:

Generating mark information associated with the image frame number according to the image frame number of the first image;

and adding the marking information into the first image to obtain a plurality of second images containing the marking information.

4. The method of claim 3, wherein the tag information comprises two-dimensional code information;

the step of adding the marking information to the first image to obtain a plurality of second images containing the marking information, which comprises the following steps:

and adding the two-dimensional code information into the first image in the form of an image to obtain a plurality of second images containing two-dimensional code images, wherein the size of the two-dimensional code images is smaller than that of the first image.

5. A method according to claim 3, wherein said adding the marking information to the first image results in a number of second images containing marking information, comprising:

constructing a marked area in the first image, wherein the pixel value of the marked area is different from the pixel value of a non-marked area, and the non-marked area is an area except the marked area in the first image;

and adding the marking information into the marking area to obtain a plurality of second images containing the marking information.

6. The method of claim 2, wherein said video composition of said plurality of second images to obtain a first video containing marking information comprises:

sorting the plurality of second images according to the image frame numbers corresponding to the marking information to obtain a plurality of sorted second images;

and carrying out video reconstruction on the plurality of sequenced second images at the target video frame rate to obtain a first video containing marking information.

7. The method of claim 2, wherein determining the stuck result of the playing process based on the video frame rate of the second video and the collected marking information comprises:

determining the image frame sequence number of each frame image corresponding to the acquired marking information;

determining a first image frame number with the minimum sequence number and a second image frame number with the maximum sequence number in the image frame numbers of the frame images;

and determining a clamping result of the playing process according to the difference value between the first image frame number and the second image frame number, the time length of the target time period and the video frame rate of the second video.

8. A video clip detecting apparatus, comprising:

the marking module is used for marking the video to be detected to obtain a first video containing marking information;

the recording module is used for recording the playing process of the first video to obtain a second video;

the acquisition module is used for acquiring the mark information acquired in the target time period in the second video;

and the clamping and stopping detection module is used for determining the clamping and stopping result of the playing process according to the video frame rate of the second video and the acquired marking information.

9. An electronic device comprising a processor, a memory and a computer program stored in the memory and executable on the processor, the processor implementing the steps of the method according to any one of claims 1 to 7 when the computer program is executed.

10. A computer-readable storage medium, characterized in that it stores a computer program which, when executed by a processor, implements the steps in the method according to any one of claims 1 to 7.