CN108184165B - Video playback method, electronic device, and computer-readable storage medium - Google Patents

Abstract

The invention discloses a video playing method, an electronic device and a computer readable storage medium. The video playing method comprises the following steps: judging whether a moving object appears in the current scene or not in the process of shooting the current scene by the camera according to the shooting frame rate to record the video; recording an initial time stamp and a cut-off time stamp of a moving object when the moving object appears in a current scene; determining a static part and a dynamic part in the video according to the initial timestamp and the ending timestamp when the video is played; and controlling the video player to play the static part at a first play frame rate and play the dynamic part at a second play frame rate, wherein the second play frame rate is less than the first play frame rate. The video playing method, the electronic device and the computer readable storage medium in the embodiment of the invention can automatically determine the motion segment in the recorded video in the video recording process, and can directly and slowly play the motion segment during playing without manual interception by a user, so that the user experience is better.

Description

Video playback method, electronic device, and computer-readable storage medium

technical field

The present invention relates to the technical field of video playback, and in particular, to a video playback method, an electronic device and a computer-readable storage medium.

Background technique

When an existing mobile phone plays a video, the automatic slow play function cannot be realized, and the user experience is poor.

SUMMARY OF THE INVENTION

Embodiments of the present invention provide a video playback method, an electronic device, and a computer-readable storage medium.

The present invention provides a video playback method for electronic devices. The electronic device includes a camera and a video player, and the video broadcasting method includes:

During the process that the camera shoots the current scene according to the shooting frame rate to record the video, judging whether there is a moving object in the current scene;

When a moving object appears in the current scene, record the initial timestamp and the expiration timestamp when the moving object appears;

while playing the video, determining a static portion and a dynamic portion in the video according to the initial timestamp and the expiration timestamp; and

Controlling the video player to play the static part at a first play frame rate, and controlling the video player to play the dynamic part at a second play frame rate, the second play frame rate being smaller than the first play frame rate frame rate.

The present invention provides an electronic device. The electronic device includes a camera, a video player and a processor. The processor is configured to determine whether a moving object appears in the current scene during the process that the camera shoots the current scene according to the shooting frame rate to record the video, and when a moving object appears in the current scene, records the occurrence of the moving object. The initial timestamp and the expiration timestamp of the moving object, when playing the video, determine the static part and the dynamic part in the video according to the initial timestamp and the expiration timestamp, and control the video player Playing the static part at a first playing frame rate, and controlling the video player to play the dynamic part at a second playing frame rate, where the second playing frame rate is smaller than the first playing frame rate.

The present invention provides an electronic device. The electronic device includes a camera, a video player, one or more processors, memory, and one or more programs. Wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the programs comprising instructions for performing the above-described video playback method.

The present invention provides a computer-readable storage medium. The computer-readable storage medium includes a computer program used in conjunction with an electronic device capable of imaging. The computer program can be executed by the processor to complete the above-mentioned video playback method.

The video playback method, electronic device, and computer-readable storage medium of the embodiments of the present invention can identify whether there is a moving object in the current scene captured by the camera during the video recording process, and record the initial timestamp and the expiration timestamp of the moving object when motion occurs. , so that the motion segment in the recorded video is automatically determined according to the initial timestamp and the expiration timestamp. In this way, the motion segment can be directly played in slow motion during playback without the user's manual interception, and the user experience is better.

Additional aspects and advantages of the present invention will be set forth, in part, from the following description, and in part will be apparent from the following description, or may be learned by practice of the invention.

Description of drawings

The above and/or additional aspects and advantages of the present invention will become apparent and readily understood from the following description of embodiments taken in conjunction with the accompanying drawings, wherein:

FIG. 1 is a schematic flowchart of a video playback method according to some embodiments of the present invention.

2 is a schematic diagram of an electronic device according to some embodiments of the present invention.

FIG. 3 is a schematic flowchart of a video playback method according to some embodiments of the present invention.

FIG. 4 is a schematic flowchart of a video playback method according to some embodiments of the present invention.

FIG. 5 is a schematic diagram of the principle of difference between two frames of a video playback method according to some embodiments of the present invention.

FIG. 6 is a schematic diagram of the principle of three-frame difference in a video playback method according to some embodiments of the present invention.

FIG. 7 is a schematic flowchart of a video playback method according to some embodiments of the present invention.

FIG. 8 is a schematic flowchart of a video playback method according to some embodiments of the present invention.

9 is a schematic diagram of an electronic device according to some embodiments of the present invention.

10 is a schematic diagram of an electronic device according to some embodiments of the present invention.

Detailed ways

The following describes in detail the embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals refer to the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary, and are intended to explain the present invention and should not be construed as limiting the present invention.

Please refer to FIGS. 1 to 2 together. The video playback method according to the embodiment of the present invention can be applied to the electronic device 100 . The electronic device 100 includes a camera 10 and a video player 20 . Video playback methods include:

02: During the process that the camera 10 shoots the current scene according to the shooting frame rate to record the video, determine whether there is a moving object in the current scene;

04: When a moving object appears in the current scene, record the initial timestamp and the expiration timestamp of the moving object;

06: While playing the video, determine the static part and dynamic part in the video according to the initial timestamp and the expiration timestamp; and

08: Control the video player 20 to play the static part at a first playback frame rate, and control the video player 20 to play the dynamic part at a second playback frame rate, where the second playback frame rate is smaller than the first playback frame rate.

Referring to FIG. 2 again, the video playback method according to the embodiment of the present invention can be implemented by the electronic device 100 according to the embodiment of the present invention. The electronic device 100 includes a camera 10 , a video player 20 and a processor 30 . Step 02 , step 04 , step 06 and step 08 may all be implemented by the processor 30 .

That is to say, the processor 30 can be used to determine whether a moving object appears in the current scene during the process that the camera 10 shoots the current scene according to the shooting frame rate to record a video, and when a moving object appears in the current scene, records the occurrence of the moving object. The initial time stamp and the end time stamp, when playing the video, determine the static part and the dynamic part in the video according to the initial time stamp and the end time stamp, and control the video player 20 to play the static part at the first playback frame rate, and The video player 20 is controlled to play the dynamic part at a second playing frame rate, wherein the second playing frame rate is smaller than the first playing frame rate.

It can be understood that when a moving object or scene appears in the video, the user often wants to be able to slow play the segment corresponding to the moving object or scene, so as to observe the motion details of the moving object or scene. However, in the existing way of playing a video, a user usually needs to manually capture a motion segment in the video, and then perform slow playback on the captured motion segment. Such a video playback mode that requires manual operation by the user to achieve slow playback is less intelligent, and the user experience is also poor.

The video playback method of the embodiment of the present invention can identify whether there is a moving object in the current scene captured by the camera 10 during the video recording process, and record the initial timestamp and the expiration timestamp of the moving object when the motion occurs, so that according to the initial timestamp and the expiration timestamp The timestamp automatically determines the motion segment in the recorded video, so that the motion segment can be directly played in slow motion during playback without the user's manual interception, and the user experience is better.

In some embodiments, the electronic device 100 may be a mobile phone, a laptop computer, a tablet computer, a smart watch, a smart bracelet, a smart helmet, a smart glasses, a single-lens reflex camera, or the like.

Referring to FIG. 3, in some embodiments, the video playback method of the embodiment of the present invention further includes:

011: Determine whether the user selects the video slow play mode; when the user selects the video slow play mode, go to step 02.

Referring to FIG. 2 again, step 011 may be implemented by the processor 30 . That is to say, the processor 30 can also be used to judge whether the user selects the video slow-play mode, and when the user selects the video slow-play mode, the camera 10 enters the process of shooting the current scene according to the shooting frame rate to record the video, The steps of judging whether there is a moving object in the current scene.

Among them, the user can choose whether to enter the video slow play mode in various ways. For example, the user touches the touch screen of the electronic device 100 by means of a touch operation to click a virtual button to enter the video slow play mode; or, the user selects the video slow play mode displayed on the UI interface of the electronic device 100 through a keyboard or a mouse. The selection key of the playback mode; or, the user enters the voice through voice, for example, the microphone of the electronic device 100 collects the voice sent by the user, and after sending it to the processor 30, the processor 30 recognizes that the voice is "using video slow playback" ”, the electronic device 100 is triggered to enter the video slow play mode.

In this way, the electronic device 100 can provide the user with multiple playback modes such as slow video playback and normal video playback, thereby giving the user more video viewing experience and improving the user's satisfaction with use.

Referring to FIG. 3 , in some embodiments, the shooting frame rate of the camera 10 includes a first shooting frame rate and a second shooting frame rate, wherein the first shooting frame rate is smaller than the second shooting frame rate. The video playback method of the embodiment of the present invention further includes:

012: control the camera 10 to shoot the current scene at the first shooting frame rate before no moving objects appear in the current scene; and

03: After a moving object appears in the current scene, control the camera 10 to shoot the current scene according to the second shooting frame rate.

Referring to FIG. 2 again, in some embodiments, both step 012 and step 03 may be implemented by the processor 30 . In other words, the processor 30 can also be used to control the camera 10 to shoot the current scene according to the first shooting frame rate before no moving objects appear in the current scene, and control the camera 10 to shoot the current scene according to the second shooting frame rate after a moving object appears in the current scene. The frame rate captures the current scene.

It can be understood that the common shooting frame rate of the existing video recording is 30 frames per second (fps), because the continuous smooth picture can only be seen by the human eye when the picture refresh rate reaches or exceeds 24 fps during the video playback process. The 30fps shooting frame rate recording video can meet the requirements of picture fluency on the one hand, and on the other hand, it can reduce the occupation of storage space by video files. However, when the user wants to play a video slowly, it is required that the video needs to be recorded at a higher frame rate during recording, for example, record at a frame rate of 120fps, and play at a frame rate of 30gps during playback. In this way, on the one hand, the original 120 frames of images can be played in 1 second, but now it takes 4 seconds to complete the playback, so as to achieve a slow playback effect; on the other hand, the playback frame rate of 30fps can also meet the needs of fluency.

Therefore, in the video playback method of the embodiment of the present invention, before recording a video, the user first selects to enter the mode of slow video playback, and then the camera 10 starts recording the video at the first shooting frame rate. Assuming that the first shooting frame rate is 30fps, the camera 10 will shoot 30 frames of images within one second. When the processor 30 processes multiple frames of images collected by the camera 10 and determines that there is a moving scene in the scene, the processor 30 records the initial time stamp of the moving object, and controls the camera 10 to start recording video at the second shooting frame rate, for example, If the camera 10 shoots a video at a shooting frame rate of 120 fps, the camera 10 will shoot 120 frames of images within one second. When the processor 30 processes the images collected by the camera 10 and determines that the moving objects in the scene stop moving, the processor 30 records the expiration time stamp when the moving objects stop moving, and controls the camera 10 to record the video at the first shooting frame rate, for example, 30fps .

In this way, using a higher shooting frame rate to record the dynamic part of a video and using a lower shooting frame rate to record the static part of a video can not only meet the requirements of slow playback of the dynamic part of the video, but also The total number of images in the video file can be reduced, and the storage space occupied by the video file can be further reduced.

Of course, it is also feasible to use the second shooting frame rate for video recording throughout the entire process.

Further, in the video playback process, the first playback frame rate is equal to the playback frame rate during video recording.

Specifically, when the entire video recording is recorded with a uniform high shooting frame rate, for example, 120 fps is used for recording, then during the video playback, the first playback frame rate corresponding to the static part is also 120 fps. During video recording, the static part is recorded with a lower frame rate of the first shooting, for example, 30fps is used for recording, and the dynamic part is recorded with a higher frame rate of the second shooting, for example, 120fps is used for recording, then when the video is played During this period, the first playback frame rate corresponding to the static part is also 30fps. In this way, when the user watches the static part of the video, the user can have the viewing and feeling experience of playing at a constant speed, without the feeling of fast or slow playback, and the user's viewing experience is better.

Referring to FIG. 4, in some embodiments, in step 02, when the camera 10 shoots the current scene according to the shooting frame rate to record the video, judging whether there is a moving object in the current scene includes:

021: Acquire the adjacent first frame image and the second frame image obtained by the camera 10 shooting the current scene according to the shooting frame rate;

022: obtaining a plurality of luminance difference values between the first frame image and the second frame image according to the luminance value of each pixel point in the first frame image and the luminance value of each pixel point in the second frame image;

023: Calculate the number of pixels whose luminance difference is greater than the preset luminance difference; and

024: When the number is greater than the preset number, determine that there are moving objects in the current scene.

Referring to FIG. 2 again, in some embodiments, step 021 , step 022 , step 023 and capture 024 may all be implemented by the processor 30 . That is to say, the processor 30 can also be used to obtain the adjacent first frame image and the second frame image obtained by the camera 10 shooting the current scene according to the shooting frame rate, according to the brightness value and the brightness value of each pixel in the first frame image. The luminance value of each pixel in the second frame image obtains multiple luminance difference values between the first frame image and the second frame image, calculates the number of pixels whose luminance difference value is greater than the preset luminance difference value, and calculates the number of pixels whose luminance difference value is greater than the preset luminance difference value. When the preset number is used, it is determined that there are moving objects in the current scene.

Among them, the adjacent first frame image and the second frame image should be understood in a broad sense, that is to say, if the first frame image is the nth frame image, the second frame image adjacent to the nth frame image can be : the n+1th frame image, the n+2th frame image, the n+th frame image, the n-1th frame image, the n-2th frame image, the n-3th frame image, etc. In a specific embodiment of the present invention, the absolute value of the frame number of the difference between the first frame image and the second frame image shall not exceed 4 frames.

将差分图像D_n中的每个像素点与预设亮度值进行比较，将亮度值大于预设亮度值的像素点标记为运动点，并将像素值更改为255，将亮度值小于预设亮度值像素点标记为背景点，并将像素值更改为0。最后，计算像素值为255的像素点的个数，当像素点的个数大于预设个数时，确定当前场景中出现运动物体。Specifically, referring to FIG. 5 , when the camera 10 shoots the current scene according to the shooting frame rate to record the video, it can generate multiple frames of images. The processor 30 selects the n-th frame image and the n+1-th frame image from the multi-frame images to detect whether there is a moving object in the current scene. Specifically, according to the formula Y=0.2990R+0.5870G+0.1140B, the processor 30 converts the pixel value of the nth frame image based on the RGB space into the pixel value based on the YCrCb space, so as to obtain the brightness of each pixel in the nth frame image In the same way, the processor 30 converts the pixel value of the n+1th frame image based on the RGB space into the pixel value based on the YCrCb space, so as to obtain the luminance value of each pixel in the n+1th frame image. Assuming that the brightness value of the pixel point in the nth frame of image is F _n (x, y), and the brightness value of the pixel point in the nth frame image is F _n+1 (x, y), then the corresponding Subtract the brightness values of the pixel points and take their absolute values to obtain the difference image D _n . The brightness value of the pixel points in the difference image D _n is D _n =|F _n+1 (x,y)-F _n (x, y)|. Then, binarize each pixel in the difference image D _n to obtain a binarized image R _n . Specifically, as shown in the formula:

Compare each pixel in the differential image D _n with the preset brightness value, mark the pixels whose brightness value is greater than the preset brightness value as motion points, change the pixel value to 255, and change the brightness value less than the preset brightness value. The value pixel points are marked as background points, and the pixel value is changed to 0. Finally, the number of pixels with a pixel value of 255 is calculated, and when the number of pixels is greater than the preset number, it is determined that a moving object appears in the current scene.

In a specific embodiment of the present invention, a two-frame difference method is used to detect whether a moving object appears in the current scene. In some embodiments, a three-frame difference method may also be used to detect whether a moving object appears in the current scene.

将差分图像D'_n中的每个像素点与预设亮度值进行比较，将亮度值大于预设亮度值的像素点标记为运动点，并将像素值更改为255，将亮度值小于预设亮度值像素点标记为背景点，并将像素值更改为0。最后，计算像素值为255的像素点的个数，当像素点的个数大于预设个数时，确定当前场景中出现运动物体。Specifically, referring to FIG. 6 , when the camera 10 shoots the current scene according to the shooting frame rate to record the video, it can generate multiple frames of images. The processor 30 selects the n-th frame image, the n+1-th frame image, and the n+2-th frame image from the multi-frame images to detect whether there is a moving object in the current scene. Specifically, according to the formula Y=0.2990R+0.5870G+0.1140B, the processor 30 converts the pixel value of the nth frame image based on the RGB space into the pixel value based on the YCrCb space, so as to obtain the brightness of each pixel in the nth frame image In the same way, the processor 30 converts the pixel values of the n+1th frame image and the n+2th frame image based on the RGB space into the pixel value based on the YCrCb space, so as to obtain the n+1th frame image and the n+2th frame image. The luminance value of each pixel in the frame image. Assume that the luminance values of pixels in the nth frame image, the n+1th frame image, and the n+2th frame image are F _n (x, y), F _n+1 (x, y) and F _n+2 ( x, y). Then subtract the brightness values of the pixels corresponding to the nth frame image and the n+1th frame image and take the absolute value to obtain the difference image D _n . The luminance values of the pixels are subtracted and their absolute values are taken to obtain the difference image D _n+1 . The brightness value of the pixel point in the differential image D _n is D _n =|F _n+1 (x,y)-F _n (x,y)|, and the brightness value of the pixel point in the differential image D _n+1 is D _{n+ 1} = | _Fn+2 (x,y)-Fn ₊₁ (x,y)|. Then, the difference image D _n and the difference image D _n+1 are processed by the following formula to obtain the difference image D' _n : D' _n (x, y)=|F _n+1 (x, y)-F _n (x, y)|∩| _Fn+2 (x,y)-Fn ₊₁ (x,y)|. Then, binarize each pixel in the difference image D' _n to obtain a binarized image R _n :

Compare each pixel in the differential image D' _n with the preset brightness value, mark the pixels whose brightness value is greater than the preset brightness value as motion points, change the pixel value to 255, and change the brightness value less than the preset brightness value to 255. Intensity value pixels are marked as background points, and the pixel value is changed to 0. Finally, the number of pixels with a pixel value of 255 is calculated, and when the number of pixels is greater than the preset number, it is determined that a moving object appears in the current scene.

Similarly, to determine whether the moving object in the current scene stops moving can also be detected by the method of inter-frame difference. When the number of pixels with a brightness value greater than the preset brightness value in the differential image is less than the preset number, it is determined that the moving object stops moving.

In this way, whether there is a moving object in the current scene is detected according to the brightness difference between two or more adjacent frames of images, and the initial timestamp of the current moment is recorded immediately when the moving object is detected, and the moment when the moving object is detected to stop. Record the expiry timestamp of the current moment.

Referring to FIG. 7, in some embodiments, in step 02, when the camera 10 shoots the current scene according to the shooting frame rate to record the video, judging whether there is a moving object in the current scene includes:

025: Acquire multiple frames of images obtained by the camera 10 shooting the current scene to obtain optical flow data; and

026: Determine whether there is a moving object in the current scene according to the optical flow data.

Referring again to FIG. 2 , in some embodiments, both step 025 and capturing 026 may be implemented by the processor 30 . That is to say, the processor 30 can also be configured to acquire multiple frames of images obtained by the camera 10 shooting the current scene to obtain optical flow data, and determine whether there is a moving object in the current scene according to the optical flow data.

Specifically, the optical flow refers to the motion speed of the grayscale mode in the captured image. When the human eye moves relative to the observed object, the mirror image of the object forms a series of continuously changing images on the flat retina (ie, the plane of the image), and this series of continuously changing image information continuously "flows" through the retina , as if it is a "flow" of light, so it is called optical flow. Optical flow is defined on a per-pixel basis. Optical flow reflects changes in objects in the current scene. For the stationary camera 10, the moving objects in the current scene form a series of continuously changing images on the imaging plane. Each frame of image captured by the camera 1010 has a plurality of pixels, and each pixel has a motion vector, that is, an optical flow.

In practical applications, to determine whether there is a moving body in the current scene through optical flow, the optical flow data obtained by the processor 30 from at least two frames of captured images can be used to determine and extract the moving body. When the camera 10 shoots the current scene at a preset frame rate to record a video, it will obtain multiple frames of images. The description is given by taking two adjacent frames of images, that is, the captured image of the k (k∈N*) th frame and the captured image of the k+1 th frame as an example. Wherein, the time interval between capturing the k-th frame image and capturing the k+1-th frame image is Δt. When the value of Δt is small, each pixel in the k-th frame image can be in a one-to-one correspondence with each pixel in the k+1-th frame image. At this time, the optical flow of each pixel p in the image can be expressed as optical flow A vector or motion vector (u_p, v_p), where "u_p" represents the horizontal component of the optical flow vector of pixel p, and "v_p" represents the vertical component of the optical flow vector of pixel p. If the adjacent pixel p is moving on the adjacent frame, then its optical flow vector (u_p,v_p) will be (0,0), if the pixel p is moving on the adjacent frame, then its optical flow The vector (u_p, v_p) will be non-zero. In this way, after calculating the optical flow vector of each pixel, the processor 30 determines whether the value of the optical flow vector of each pixel is 0, and the pixels whose optical flow vector is not 0 are merged into the position of the moving object. In this way, when it is calculated that the number of pixels whose optical flow vector is not 0 in the two frames of images is greater than a predetermined threshold, it is determined that there is a moving object in the current scene.

Similarly, judging whether the moving object in the current scene stops moving can also be detected by the optical flow method. When the number of pixels whose optical flow vector is not 0 in the two frames of images is less than a predetermined number, it is determined that the moving object stops moving.

In this way, whether there is a moving object in the current scene is detected according to the optical flow method, and the initial timestamp of the current moment is recorded immediately when the moving object is detected, and the expiration timestamp of the current moment is recorded immediately when the moving object is detected to stop.

In some embodiments, when the processor 30 processes two adjacent frames or adjacent multi-frame images and determines that a moving object appears in the current scene, the processor 30 will shoot a corresponding frame of the involved multi-frame images. The time is recorded as the initial time stamp. When two adjacent frames or adjacent multi-frame images are processed and it is determined that the moving object in the current scene stops moving, the processor 30 will record the shooting time corresponding to one frame of the involved multi-frame images. Set to the expiration timestamp. In a recorded video, there may be multiple pairs of corresponding initial timestamps and expiration timestamps, and the processor 30 stores one or more pairs of time pairs in a pre-designed structure array, for example, the If the size is 2*5+1, the structure array can store up to 5 time pairs, and the last data in the structure array is the start time of video recording. After the video recording is completed, the processor 30 encapsulates the structure array together with the image captured by the camera 10 and the audio recorded by the microphone of the electronic device 100 to form a video file. When the user wants to play the video file, the processor 30 decapsulates the video file, and separates audio data, image data and time pair data, wherein the audio data and video data are both compressed and encoded data. Audio data and image data are decoded and restored to uncompressed image data and uncompressed original audio data. Finally, the synchronously decoded image data and audio data are played synchronously, and the video is slow-played according to the time.

Please refer to FIG. 8 again, in some embodiments, when the video is played in step 06, determining the static part and the dynamic part in the video according to the initial timestamp and the expiration timestamp include:

061: Compare the duration of each dynamic part of the video with the size of the preset duration; and

062: Reclassify the video of the dynamic part whose duration is shorter than the preset duration as the video of the static part.

Referring to FIG. 2 again, in some embodiments, both step 061 and step 062 may be implemented by the processor 30 . That is to say, the processor 30 can also be used to compare the duration of the video of each dynamic part with the preset duration, and reclassify the video of the dynamic part whose duration is shorter than the preset duration as the video of the static part.

Specifically, during the video recording process, there may be multiple dynamic parts in which moving objects appear. For example, the start time of video recording is 00:00:00, a moving object appears at 00:05:00, stops moving at 00:07:00, and moves again at 00:13:00 Object, at 00:14:30 the object stops moving again, at 00:21:10 the object appears moving again, and at 00:21:13 the object stops moving again, then this video contains three appearances The dynamic part of a moving object. The length of the video for the first dynamic part is 2 minutes, and the length of the video for the second dynamic part is 1 minute and 30 seconds. The duration of the video for the third dynamic part is 3 seconds. Assuming that the preset duration is 10 seconds, since 3 seconds is less than 10 seconds, the video of the third dynamic part is reclassified as the video of the static part.

It can be understood that when the duration of the video of the dynamic part is too short, the motion of the moving object in the dynamic video of the part may not be the main part that the user pays attention to. Therefore, a dynamic part with an excessively short duration can be merged into a video of a static part, and no slow-play operation is performed on the part of the dynamic video during playback. In this way, when a user watches a video, the problem that the switching frequency between normal-speed playback and slow-speed playback is too high to affect the user's viewing experience will not occur.

Further, when the duration of the video of the dynamic part is too long, for example, the user uses the electronic device 100 to record a video of the child playing football, during this process, the child and the football are usually in a state of continuous movement, and at this time the duration of the video of the dynamic part is It will be longer, and if the video in the dynamic part continues to perform slow playback operation during playback, it will greatly reduce the user's viewing experience. Therefore, the recording conditions of the initial timestamp and the expiration timestamp can be further limited, that is, under the condition that moving objects appear in the current scene, it is necessary to further detect whether a specific object appears in the current scene or whether multiple objects appear at the same time. A specific object, the current moment is recorded as the initial timestamp only when a specific object or multiple specific objects appear at the same time. Taking the above video of a child playing football as an example, it can be further identified whether a child and a soccer ball appear at the same time in the current scene. There are three specific objects and the goal. When these three specific objects appear at the same time, the moment when these three specific objects appear at the same time is recorded as the initial timestamp, and when any one of the three disappears in the current scene. , and record this moment as the deadline timestamp. It can be understood that when three specific objects, a child, a football and a goal appear at the same time in the current scene, it may be the key process for the child to shoot. This process may be the main part of the user's attention. Only slow playback of this process is performed. It can avoid the problem that the duration of the video in the dynamic part is too long, which reduces the user's viewing experience, and can also extract the essence of the video for the user to further improve the user's viewing experience.

Referring to FIG. 9 , an electronic device 100 according to an embodiment of the present invention includes a camera 10 , a video player 20 , one or more processors 30 , a memory 40 and one or more programs 41 . Among them, one or more programs 41 are stored in the memory 40 and configured to be executed by the one or more processors 30 . The program 41 includes instructions for executing the video playback method described in any one of the above embodiments.

For example, program 41 includes instructions for performing the following steps:

Camera 10 and Video Player 20. Video playback methods include:

02: During the process that the camera 10 shoots the current scene according to the shooting frame rate to record the video, determine whether there is a moving object in the current scene;

04: When a moving object appears in the current scene, record the initial timestamp and the expiration timestamp of the moving object;

06: While playing the video, determine the static part and dynamic part in the video according to the initial timestamp and the expiration timestamp; and

08: Control the video player 20 to play the static part at a first playback frame rate, and control the video player 20 to play the dynamic part at a second playback frame rate, where the second playback frame rate is smaller than the first playback frame rate.

For another example, the program 41 also includes instructions for performing the following steps:

012: control the camera 10 to shoot the current scene at the first shooting frame rate before no moving objects appear in the current scene; and

03: After a moving object appears in the current scene, control the camera 10 to shoot the current scene according to the second shooting frame rate.

Referring to FIG. 10 , a computer-readable storage medium 200 according to an embodiment of the present invention includes a computer program 201 used in conjunction with the electronic device 100 capable of imaging. The computer program 201 can be executed by the processor 30 to implement the video playback method described in any one of the above embodiments. The computer-readable storage medium 200 may be a storage medium independent of the electronic device 100 , or may be a storage medium integrated in the electronic device 100 .

For example, computer program 201 can be executed by processor 30 to accomplish the following steps:

02: During the process that the camera 10 shoots the current scene according to the shooting frame rate to record the video, determine whether there is a moving object in the current scene;

04: When a moving object appears in the current scene, record the initial timestamp and the expiration timestamp of the moving object;

06: While playing the video, determine the static part and dynamic part in the video according to the initial timestamp and the expiration timestamp; and

08: Control the video player 20 to play the static part at a first playback frame rate, and control the video player 20 to play the dynamic part at a second playback frame rate, where the second playback frame rate is smaller than the first playback frame rate.

For another example, the computer program 201 can also be executed by the processor 30 to complete the following steps:

012: control the camera 10 to shoot the current scene at the first shooting frame rate before no moving objects appear in the current scene; and

03: After a moving object appears in the current scene, control the camera 10 to shoot the current scene according to the second shooting frame rate.

In the description of this specification, description with reference to the terms "one embodiment," "some embodiments," "example," "specific example," or "some examples", etc., mean specific features described in connection with the embodiment or example , structure, material or feature is included in at least one embodiment or example of the present invention. In this specification, schematic representations of the above terms are not necessarily directed to the same embodiment or example. Furthermore, the particular features, structures, materials or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, those skilled in the art may combine and combine the different embodiments or examples described in this specification, as well as the features of the different embodiments or examples, without conflicting each other.

In addition, the terms "first" and "second" are only used for descriptive purposes, and should not be construed as indicating or implying relative importance or implying the number of indicated technical features. Thus, a feature delimited with "first", "second" may expressly or implicitly include at least one of that feature. In the description of the present invention, "plurality" means at least two, such as two, three, etc., unless otherwise expressly and specifically defined.

Any description of a process or method in the flowcharts or otherwise described herein may be understood to represent a module, segment or portion of code comprising one or more executable instructions for implementing a specified logical function or step of the process , and the scope of the preferred embodiments of the invention includes alternative implementations in which the functions may be performed out of the order shown or discussed, including performing the functions substantially concurrently or in the reverse order depending upon the functions involved, which should It is understood by those skilled in the art to which the embodiments of the present invention belong.

The logic and/or steps represented in flowcharts or otherwise described herein, for example, may be considered an ordered listing of executable instructions for implementing the logical functions, may be embodied in any computer-readable medium, For use with, or in conjunction with, an instruction execution system, apparatus, or device (such as a computer-based system, a system including a processor, or other system that can fetch instructions from and execute instructions from an instruction execution system, apparatus, or apparatus) or equipment. For the purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transport the program for use by or in connection with an instruction execution system, apparatus, or apparatus. More specific examples (non-exhaustive list) of computer readable media include the following: electrical connections with one or more wiring (electronic devices), portable computer disk cartridges (magnetic devices), random access memory (RAM), Read Only Memory (ROM), Erasable Editable Read Only Memory (EPROM or Flash Memory), Fiber Optic Devices, and Portable Compact Disc Read Only Memory (CDROM). In addition, the computer readable medium may even be paper or other suitable medium on which the program may be printed, as the paper or other medium may be optically scanned, for example, followed by editing, interpretation, or other suitable medium as necessary process to obtain the program electronically and then store it in computer memory.

It should be understood that various parts of the present invention may be implemented in hardware, software, firmware or a combination thereof. In the above-described embodiments, various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or a combination of the following techniques known in the art: Discrete logic circuits, application specific integrated circuits with suitable combinational logic gates, Programmable Gate Arrays (PGA), Field Programmable Gate Arrays (FPGA), etc.

Those skilled in the art can understand that all or part of the steps carried by the methods of the above embodiments can be completed by instructing the relevant hardware through a program, and the program can be stored in a computer-readable storage medium, and the program can be stored in a computer-readable storage medium. When executed, one or a combination of the steps of the method embodiment is included.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing module, or each unit may exist physically alone, or two or more units may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware, and can also be implemented in the form of software function modules. If the integrated modules are implemented in the form of software functional modules and sold or used as independent products, they may also be stored in a computer-readable storage medium.

The above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, and the like. Although the embodiments of the present invention have been shown and described above, it should be understood that the above-mentioned embodiments are exemplary and should not be construed as limiting the present invention. Embodiments are subject to variations, modifications, substitutions and variations.

Claims (16)

1. a video playback method, for electronic device, is characterized in that, described electronic device comprises camera and video player, and described video broadcast method comprises: During the process that the camera shoots the current scene according to the shooting frame rate to record the video, determine whether there is a moving object in the current scene; When a moving object appears in the current scene, determine whether a specific object appears in the current scene; When the specific object appears in the current scene, recording the initial timestamp and the expiration timestamp of the appearance of the specific object; while playing the video, determining a static portion and a dynamic portion in the video according to the initial timestamp and the expiration timestamp; and Controlling the video player to play the static part at a first play frame rate, and controlling the video player to play the dynamic part at a second play frame rate, the second play frame rate being smaller than the first play frame rate frame rate. 2. The video playback method according to claim 1, wherein the video playback method further comprises: Determine whether the user selects the video slow-play mode; and When the user selects the video slow play mode, the step of judging whether there is a moving object in the current scene during the process that the camera shoots the current scene according to the shooting frame rate to record the video is entered. 3 . The video playback method according to claim 1 , wherein the first playback frame rate is equal to the shooting frame rate. 4 . 4. The video playback method according to claim 1, wherein the shooting frame rate comprises a first shooting frame rate and a second shooting frame rate, and the first shooting frame rate is smaller than the second shooting frame rate , the video playback method further includes: before the specific object does not appear in the current scene, controlling the camera to shoot the current scene according to the first shooting frame rate; and After the specific object appears in the current scene, the camera is controlled to shoot the current scene according to the second shooting frame rate. 5. The video playback method according to claim 1, wherein, in the process that the camera shoots the current scene according to the shooting frame rate to record the video, it is judged whether there is a moving object in the current scene. Steps include: Acquiring the adjacent first frame image and second frame image obtained by the camera shooting the current scene according to the shooting frame rate; Acquiring a plurality of luminance difference values between the first frame image and the second frame image according to the luminance value of each pixel in the first frame image and the luminance value of each pixel in the second frame image; Calculate the number of pixels whose luminance difference value is greater than the preset luminance difference value; and When the number is greater than a preset number, it is determined that the moving object appears in the current scene. 6. The video playback method according to claim 1, wherein, in the process that the camera shoots the current scene according to the shooting frame rate to record the video, it is judged whether there is a moving object in the current scene. Steps include: acquiring multiple frames of images obtained by capturing the current scene by the camera to obtain optical flow data; and Whether the moving object appears in the current scene is determined according to the optical flow data. 7. The video playback method according to claim 1, wherein when the number of the dynamic parts is multiple, the video playback method further comprises: comparing the duration of the video for each of said dynamic parts with the size of a preset duration; and Reclassifying the video of the dynamic portion with the duration shorter than the preset duration as the video of the static portion. 8. An electronic device, characterized in that the electronic device comprises a camera, a video player and a processor; the processor is used for: During the process that the camera shoots the current scene according to the shooting frame rate to record the video, judging whether there is a moving object in the current scene; When a moving object appears in the current scene, determine whether a specific object appears in the current scene; When the specific object appears in the current scene, recording the initial timestamp and the expiration timestamp of the appearance of the specific object; while playing the video, determining a static portion and a dynamic portion in the video according to the initial timestamp and the expiration timestamp; and Controlling the video player to play the static part at a first play frame rate, and controlling the video player to play the dynamic part at a second play frame rate, the second play frame rate being smaller than the first play frame rate frame rate. 9. The electronic device according to claim 8, wherein the processor is further configured to: Determine whether the user selects the video slow-play mode; and When the user selects the video slow play mode, the step of judging whether there is a moving object in the current scene during the process that the camera shoots the current scene according to the shooting frame rate to record the video is entered. 10 . The electronic device of claim 8 , wherein the first playback frame rate is equal to the shooting frame rate. 11 . 11. The electronic device according to claim 8, wherein the shooting frame rate comprises a first shooting frame rate and a second shooting frame rate, the first shooting frame rate is smaller than the second shooting frame rate, The processor is also used to: before the specific object does not appear in the current scene, controlling the camera to shoot the current scene according to the first shooting frame rate; and After the specific object appears in the current scene, the camera is controlled to shoot the current scene according to the second shooting frame rate. 12. The electronic device according to claim 8, wherein the processor is further configured to: Acquiring the adjacent first frame image and second frame image obtained by the camera shooting the current scene according to the shooting frame rate; Obtaining a plurality of luminance difference values between the first frame image and the second frame image according to the luminance value of each pixel in the first frame image and the luminance value of each pixel in the second frame image; Calculate the number of pixels whose luminance difference value is greater than the preset luminance difference value; and When the number is greater than a preset number, it is determined that the moving object appears in the current scene. 13. The electronic device according to claim 8, wherein the processor is further configured to: acquiring multiple frames of images obtained by capturing the current scene by the camera to obtain optical flow data; and Whether the moving object appears in the current scene is determined according to the optical flow data. 14. The electronic device according to claim 8, wherein the processor is further configured to: comparing the duration of the video for each of said dynamic parts with the size of a preset duration; and Reclassifying the video of the dynamic portion with the duration shorter than the preset duration as the video of the static portion. 15. An electronic device, wherein the electronic device comprises: Camera; video player; one or more processors; memory; and one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by the one or more processors, the programs comprising means for performing any one of claims 1 to 7 The instruction of the video playback method described in item. 16. A computer-readable storage medium, characterized in that it comprises a computer program used in conjunction with an electronic device capable of taking a picture, the computer program being executable by a processor to complete the video according to any one of claims 1 to 7 play method.

Images