CN105898565A - Video processing method and device - Google Patents

Abstract

Embodiments of the present invention provide a video processing method and device, comprising: acquiring a video frame to be played; determining the pixel depth of the video frame to be played, and determining the video frame to be played according to the pixel depth of the video frame to be played If it is determined that the video quality level of the video frame to be played is less than the preset level, then when the video frame to be played is a dark scene image, image enhancement processing is performed on the video frame to be played. According to the video processing method and device provided in the embodiments of the present invention, after the video frame to be played is acquired, the video quality level of the video frame to be played is determined according to the pixel depth of the video frame to be played, and the video quality level of the video frame to be played is determined. When the quality level is lower than the preset level, image enhancement processing is performed on the dark field scene image in the video frame to be played, thereby improving the quality of the video frame to be played, thereby providing a better visual experience for the user during video playback .

Description

A video processing method and device

technical field

Embodiments of the present invention relate to the field of video technologies, and in particular, to a video processing method and device.

Background technique

With the development of smart TVs, watching live TV is no longer the only purpose of TV. Users can watch their favorite movies and programs by playing videos on the network, local storage devices, multi-screen sharing, etc.

At present, when the existing video playback devices play video, they only play according to video parameters such as video encoding format, video encoding parameters, and video quality. However, some videos are of poor quality, resulting in blurred images during playback. Phenomenon, which cannot satisfy the user's visual experience.

Therefore, how to process the video according to the quality of the video when playing the video, so as to provide a better visual experience for the user, has not yet had an effective solution.

Contents of the invention

Embodiments of the present invention provide a video processing method and device to solve the problems in the prior art that video is only played according to video parameters of video resources, resulting in blurred images when playing videos with poor performance.

An embodiment of the present invention provides a video processing method, including:

Get the video frame to be played;

Determine the pixel depth of the video frame to be played, and determine the video quality level of the video frame to be played according to the pixel depth of the video frame to be played;

If it is determined that the video quality level of the video frame to be played is less than the preset level, then for each video frame to be played in the video frame to be played, when the video frame to be played is a dark field scene image, Image enhancement processing is performed on the video frame to be played.

An embodiment of the present invention provides a video processing device, including:

An acquisition unit, configured to acquire video frames to be played;

A determining unit, configured to determine the pixel depth of the video frame to be played, and determine the video quality level of the video frame to be played according to the pixel depth of the video frame to be played;

A processing unit, configured to determine that the video quality level of the video frame to be played is less than a preset level, for each video frame to be played in the video frame to be played, the video frame to be played is a dark field When the scene image is displayed, image enhancement processing is performed on the video frame to be played.

In the video processing method and device provided by the embodiments of the present invention, after acquiring the video frame to be played, the video quality level of the video frame to be played is determined according to the pixel depth of the video frame to be played, and after determining the video frame to be played When the video quality level of the frame is less than the preset level, image enhancement processing is performed on the dark field scene image in the video frame to be played, thereby improving the quality of the video frame to be played, so as to provide users with better performance when the video is played. visual experience.

Description of drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are For some embodiments of the present invention, those skilled in the art can also obtain other drawings based on these drawings without creative work.

FIG. 1 is a schematic flowchart of a video processing method provided by an embodiment of the present invention;

Fig. 2 is a flow chart of a video processing method provided by an embodiment of the present invention;

FIG. 3 is a schematic structural diagram of a video processing device provided by an embodiment of the present invention.

detailed description

In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

Based on the above discussion, as shown in FIG. 1 , a schematic flowchart of a video processing method provided by an embodiment of the present invention is shown. The execution subject in FIG. 1 may be a mobile phone, a computer, a set-top box and other devices.

As shown in Figure 1, the method specifically includes the following steps:

Step 101: Obtain video frames to be played;

Step 102: Determine the pixel depth of the video frame to be played, and determine the video quality level of the video frame to be played according to the pixel depth of the video frame to be played;

Step 103: If it is determined that the video quality level of the video frame to be played is lower than a preset level, performing image enhancement processing on the video frame to be played when the video frame to be played is a dark scene image.

In step 101, the acquired video frame to be played is a video frame after video encoding. Therefore, after the video frame to be played is obtained, the video frame to be played needs to be decoded according to the video encoding method of the video frame to be played.

In the embodiment of the present invention, the video coding method corresponding to the video frame to be played may be any existing video coding method, which is not limited in the embodiment of the present invention. For example, HEVC (High Efficiency Video Coding, high-efficiency video coding), H264, and the like.

In the embodiment of the present invention, the video frame to be played may be obtained through a network, or may be obtained through a locally stored video file, which is not limited in the embodiment of the present invention.

It should be noted that, in this embodiment of the present invention, the video format of the obtained video file corresponding to the video frame to be played may be any of the existing video formats. For example, formats such as AVI (Audio Video Interleaved, Audio Video Interleaved), ASF (Advanced Streaming format, Advanced Streaming Format), FLV (Flash Video), MPEG (Motion Picture Experts Group, Motion Video Frame Expert Group).

In step 102, after the video frame to be played is obtained, the resolution of the video frame to be played may be determined. At the same time, the number of bits used for storing each pixel of the video frame to be played before decoding may also be determined according to the data size and resolution of the video frame to be played before decoding.

For example, the resolution of a video frame to be played is 1024×768, and its data volume before decoding is 768kb, then the video frame to be played stores the number of bits used by each pixel before decoding as 8= 768×1024×8÷(1024×768).

In the embodiment of the present invention, after determining the resolution of the video frame to be played, it is also possible to first determine whether the resolution of the video frame to be played is smaller than the preset resolution, if the resolution of the video frame to be played is smaller than the preset resolution rate, then perform upsampling processing on the video frame to be played; if the resolution of the video frame to be played is greater than or equal to the preset resolution, then no longer perform upsampling processing on the video frame to be played.

Optionally, the preset resolution can be 720p. Of course, this is just an example, and the preset resolution can also be other values, which will not be repeated here.

In the embodiment of the present invention, upsampling may be implemented by using a sampling filtering method. Specifically, if the order of the sampling filter is N, the pixel values of the sampled pixels are x ₁ , x ₂ , ..., x _N-1 , x _N , and the coefficients of the sampling filter are C ₁ , C ₂ , ..., C _N-1 , C _N , then the interpolated pixel value y is:

$\mathrm{<span\; class="notranslate">\; the\; y</span>}<span\; class="notranslate">\; =</span>\underset{\mathrm{<span\; class="notranslate">\; i</span>}<span\; class="notranslate">\; =</span>\mathrm{<span\; class="notranslate">\; 1</span>}}{\overset{\mathrm{<span\; class="notranslate">\; N</span>}}{<span\; class="notranslate">\; \&Sigma;</span>}}{\mathrm{<span\; class="notranslate">\; C</span>}}_{\mathrm{<span\; class="notranslate">\; i</span>}}<span\; class="notranslate">\; \&times;</span>{\mathrm{<span\; class="notranslate">\; x</span>}}_{\mathrm{<span\; class="notranslate">\; i</span>}}\mathrm{<span\; class="notranslate">\; ...</span>}<span\; class="notranslate">\; (</span>\mathrm{<span\; class="notranslate">\; 1</span>}<span\; class="notranslate">\; )</span>$

In the embodiment of the present invention, after determining the resolution of the video frame to be played, or after performing upsampling processing on the video frame to be played, the pixels of the video frame to be played may be determined according to the resolution of the video frame to be played The depth is to determine the number of bits used for storing each pixel of the video frame to be played after being decoded.

For example, if the resolution of a video frame to be played is 1024×768, and its data volume is 1.5M, its pixel depth is 16, that is, 16 bits are used to store each pixel.

In step 103, after the pixel depth of the video frame to be played is determined, the video quality level of the video frame to be played can be determined according to the pixel depth of the video frame to be played. In the embodiment of the present invention, the video quality level of the video frame to be played can be determined according to the following formula:

Wherein, q is the video quality level of the video frame to be played; k is a preset value; x is the number of bits used for storing each pixel of the video frame to be played before decoding; b is the pixel depth, that is The video frame to be played stores the number of bits used by each pixel after being decoded. For rounding down operation. The value of k can be determined according to actual conditions, for example, any value from 0 to 31 can be taken.

After the video quality level of the video frame to be played is determined, if it is determined that the video quality level of the video frame to be played is greater than or equal to a preset level, the video frame to be played may be played directly. Wherein, the preset level may take a value according to the actual situation, which will not be repeated here.

Optionally, in this embodiment of the present invention, after the video quality level of the video frame to be played is determined, deblocking filtering may be performed on the video frame to be played, so as to further improve the video quality of the video frame to be played. Specifically, for each of the video frames to be played, deblocking filter processing is performed on the video frames to be played. By performing deblocking filter processing on each frame of the video frame to be played, smoothing filtering can be performed on the edge of the video frame to be played, thereby eliminating the false boundary caused by the block coding algorithm in the video frame to be played.

Optionally, in this embodiment of the present invention, after the video quality level of the video frame to be played is determined, before deblocking filtering is performed on the video frame to be played, it may also be determined whether the video frame to be played has passed the loop If loop filtering is performed, deblocking filter processing may no longer be performed on the video frame to be played.

Finally, the to-be-played video frame after the deblocking filtering process can be displayed.

Optionally, in this embodiment of the present invention, if it is determined that the video quality level of the video frame to be played is lower than a preset level, then for each video frame to be played in the video frame to be played, it is determined that the video frame to be played Whether the video frame is a dark field scene image, if the video frame to be played is not a dark field scene image, the video frame to be played can be directly displayed. If the video frame to be played is a dark scene image, image enhancement processing is performed on the video frame to be played.

In the embodiment of the present invention, if it is determined that the brightness component value of each pixel in the video frame to be played is smaller than a brightness threshold, then it is determined that the video frame to be played is a dark field scene image.

Optionally, the brightness threshold can be calculated by the following formula:

$\mathrm{<span\; class="notranslate">\; h</span>}<span\; class="notranslate">\; =</span>\frac{{\mathrm{<span\; class="notranslate">\; h</span>}}_{\mathrm{<span\; class="notranslate">\; m</span>}\mathrm{<span\; class="notranslate">\; a</span>}\mathrm{<span\; class="notranslate">\; x</span>}}<span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; h</span>}}_{\mathrm{<span\; class="notranslate">\; m</span>}\mathrm{<span\; class="notranslate">\; i</span>}\mathrm{<span\; class="notranslate">\; no</span>}}}{\mathrm{<span\; class="notranslate">\; 16</span>}}\mathrm{<span\; class="notranslate">\; ...</span>}<span\; class="notranslate">\; (</span>\mathrm{<span\; class="notranslate">\; 3</span>}<span\; class="notranslate">\; )</span>$

Wherein, H is the brightness threshold, h _max is the maximum brightness value that the pixel in the video frame to be played can reach, and h _min is the minimum brightness value that the pixel in the video frame to be played can reach .

Of course, the above are just examples, and the brightness threshold can also be determined by other methods, which will not be repeated here.

After determining that the video frame to be played is a dark field scene image, performing discrete cosine transformation (Discrete Cosine Transformation, DCT) on the video frame to be played, and performing quantization processing on the video frame to be played after the discrete cosine transform ; Then, perform an inverse discrete cosine transformation (Inverse Discrete Cosine Transformation, IDCT) on the video frame to be played after the quantization process, to obtain the video frame to be played after image enhancement processing.

Since dark field scene images are prone to block effects, color spots, false colors, etc., the video frames to be played after enhanced processing can overcome block effects, color spots, false colors, etc. Improve the user's visual experience when viewing video frames.

The above process will be described in detail below in conjunction with the embodiments.

As shown in FIG. 2 , it is a flowchart of a video processing method provided by an embodiment of the present invention.

Step 201: Obtain video frames to be played.

The video frame to be played obtained here is a video frame after video encoding, and video decoding needs to be performed on the video frame to be played at this time.

Step 202: Determine the resolution of the video frame to be played, and judge whether the resolution of the video frame to be played is greater than a preset resolution, if not, go to step 203, otherwise go to step 204.

Step 203: Perform upsampling processing on the video frame to be played.

Step 204: Determine the pixel depth of the video frame to be played, and determine the video quality level of the video frame to be played according to the pixel depth.

Step 205: Determine whether the video frame to be played is lower than a preset level, if not, go to step 206, otherwise, go to step 207.

Step 206: Perform deblocking filter processing on the to-be-played video frame, and go to step 209.

Step 207: Determine whether the video frame to be played is a dark field scene image, if yes, go to step 208, otherwise go to step 209.

Step 208: Perform image enhancement processing on the video frame to be played.

Step 209: Play the video frame to be played.

Specifically, perform discrete cosine transform on the video frame to be played, and perform quantization processing on the video frame to be played after the discrete cosine transform; perform inverse discrete cosine on the video frame to be played after the quantization process Transform to obtain the video frame to be played after image enhancement processing.

Step 209: Play the video frame to be played.

Based on the same inventive concept, an embodiment of the present invention further provides a video processing device, which can execute the above method.

As shown in FIG. 3, a schematic structural diagram of a video processing device is also provided for an embodiment of the present invention, including:

An acquisition unit 301, configured to acquire video frames to be played;

A determining unit 302, configured to determine the pixel depth of the video frame to be played, and determine the video quality level of the video frame to be played according to the pixel depth of the video frame to be played;

The processing unit 303 is configured to perform image enhancement processing on the video frame to be played when it is determined that the video quality level of the video frame to be played is lower than a preset level when the video frame to be played is a dark scene image.

Optionally, before determining the video quality level of the video frame to be played according to the pixel depth of the video frame to be played, the processing unit is further configured to:

If it is determined that the resolution of the video frame to be played is smaller than the preset resolution, performing upsampling processing on the video frame to be played.

Optionally, the determining unit 302 is specifically configured to:

Determine the video quality level of the video frame to be played according to the following formula:

Wherein, q is the video quality level of the video frame to be played; k is a preset value; x is the number of bits used for storing each pixel of the video frame to be played before decoding; b is the pixel depth.

Optionally, the processing unit 303 is further configured to:

If it is determined that the video quality level of the video frame to be played is greater than or equal to the preset level, performing deblocking filter processing on the video frame to be played.

Optionally, the processing unit 303 is specifically configured to:

Perform discrete cosine transform on the video frame to be played, and perform quantization processing on the video frame to be played after the discrete cosine transform;

performing an inverse discrete cosine transform on the video frame to be played after the quantization processing, to obtain the video frame to be played after image enhancement processing.

In summary, according to the video processing method and device provided by the embodiments of the present invention, after the video frame to be played is acquired, the video quality level of the video frame to be played is determined according to the pixel depth of the video frame to be played, and the When it is determined that the video quality level of the video frame to be played is lower than a preset level, image enhancement processing is performed on the dark field scene image in the video frame to be played, thereby improving the quality of the video frame to be played. Because the method provided by the embodiment of the present invention is to select different post-processing methods and processing intensities for the video frames to be played according to the video quality level of the video frames to be played, when the video quality level of the video frames to be played is higher, do not perform or select When the video quality level of the video frame to be played is low, the processing intensity of the video frame to be played is increased, so as to improve the video quality at the expense of limited processing capacity and give users a better visual experience

The device embodiments described above are only illustrative, and the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in One place, or it can be distributed to multiple network elements. Part or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. It can be understood and implemented by those skilled in the art without any creative effort.

Through the above description of the implementations, those skilled in the art can clearly understand that each implementation can be implemented by means of software plus a necessary general hardware platform, and of course also by hardware. Based on this understanding, the essence of the above technical solution or the part that contributes to the prior art can be embodied in the form of software products, and the computer software products can be stored in computer-readable storage media, such as ROM/RAM, magnetic discs, optical discs, etc., including several instructions to make a computer device (which may be a personal computer, server, or network device, etc.) execute the methods described in various embodiments or some parts of the embodiments.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still be Modifications are made to the technical solutions described in the foregoing embodiments, or equivalent replacements are made to some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims (10)

1. A video processing method, characterized in that, comprising: Get the video frame to be played; Determine the pixel depth of the video frame to be played, and determine the video quality level of the video frame to be played according to the pixel depth of the video frame to be played; If it is determined that the video quality level of the video frame to be played is lower than a preset level, performing image enhancement processing on the video frame to be played when the video frame to be played is a dark scene image. 2. The method according to claim 1, wherein, before determining the video quality level of the video frame to be played according to the pixel depth of the video frame to be played, further comprising: If it is determined that the resolution of the video frame to be played is smaller than the preset resolution, performing upsampling processing on the video frame to be played. 3. The method according to claim 1 or 2, wherein the determining the video quality level of the video frame to be played according to the pixel depth of the video frame to be played comprises: Determine the video quality level of the video frame to be played according to the following formula: Wherein, q is the video quality level of the video frame to be played; k is a preset value; x is the number of bits used for storing each pixel of the video frame to be played before decoding; b is the pixel depth. 4. The method according to any one of claims 1 to 3, wherein the method further comprises: If it is determined that the video quality level of the video frame to be played is greater than or equal to the preset level, performing deblocking filter processing on the video frame to be played. 5. The method according to any one of claims 1 to 3, wherein the performing image enhancement processing on the video frame to be played comprises: Perform discrete cosine transform on the video frame to be played, and perform quantization processing on the video frame to be played after the discrete cosine transform; performing an inverse discrete cosine transform on the video frame to be played after the quantization processing, to obtain the video frame to be played after image enhancement processing. 6. A video processing device, characterized in that, comprising: An acquisition unit, configured to acquire video frames to be played; A determining unit, configured to determine the pixel depth of the video frame to be played, and determine the video quality level of the video frame to be played according to the pixel depth of the video frame to be played; A processing unit, configured to perform image enhancement processing on the video frame to be played when it is determined that the video quality level of the video frame to be played is lower than a preset level when the video frame to be played is a dark field scene image. 7. The device according to claim 6, wherein before determining the video quality level of the video frame to be played according to the pixel depth of the video frame to be played, the processing unit is further configured to: If it is determined that the resolution of the video frame to be played is smaller than the preset resolution, performing upsampling processing on the video frame to be played. 8. The device according to claim 6 or 7, wherein the determining unit is specifically configured to: Determine the video quality level of the video frame to be played according to the following formula: Wherein, q is the video quality level of the video frame to be played; k is a preset value; x is the number of bits used for storing each pixel of the video frame to be played before decoding; b is the pixel depth. 9. The device according to any one of claims 6 to 8, wherein the processing unit is further used for: If it is determined that the video quality level of the video frame to be played is greater than or equal to the preset level, performing deblocking filter processing on the video frame to be played. 10. The device according to any one of claims 6 to 8, wherein the processing unit is specifically configured to: Perform discrete cosine transform on the video frame to be played, and perform quantization processing on the video frame to be played after the discrete cosine transform; performing an inverse discrete cosine transform on the video frame to be played after the quantization processing, to obtain the video frame to be played after image enhancement processing.