CN106961610A - With reference to the ultra high-definition video new type of compression framework of super-resolution rebuilding - Google Patents
With reference to the ultra high-definition video new type of compression framework of super-resolution rebuilding Download PDFInfo
- Publication number
- CN106961610A CN106961610A CN201710151638.9A CN201710151638A CN106961610A CN 106961610 A CN106961610 A CN 106961610A CN 201710151638 A CN201710151638 A CN 201710151638A CN 106961610 A CN106961610 A CN 106961610A
- Authority
- CN
- China
- Prior art keywords
- frame
- super
- video sequence
- definition video
- ultra high
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000006835 compression Effects 0.000 title claims abstract description 27
- 238000007906 compression Methods 0.000 title claims abstract description 27
- 238000000034 method Methods 0.000 claims abstract description 30
- 230000011218 segmentation Effects 0.000 claims abstract description 6
- 238000012549 training Methods 0.000 claims description 10
- 230000008569 process Effects 0.000 claims description 6
- 238000005070 sampling Methods 0.000 claims description 6
- NUHSROFQTUXZQQ-UHFFFAOYSA-N isopentenyl diphosphate Chemical compound CC(=C)CCO[P@](O)(=O)OP(O)(O)=O NUHSROFQTUXZQQ-UHFFFAOYSA-N 0.000 claims description 3
- 238000012986 modification Methods 0.000 claims description 3
- 230000004048 modification Effects 0.000 claims description 3
- 238000012935 Averaging Methods 0.000 claims description 2
- 230000006641 stabilisation Effects 0.000 claims 1
- 238000011105 stabilization Methods 0.000 claims 1
- 230000006872 improvement Effects 0.000 abstract description 5
- 238000005516 engineering process Methods 0.000 abstract description 4
- 238000011160 research Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 3
- 230000003044 adaptive effect Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000013139 quantization Methods 0.000 description 2
- 238000010561 standard procedure Methods 0.000 description 2
- 241000272194 Ciconiiformes Species 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/59—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/154—Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
本发明针对HEVC视频编码标准提供了一种结合超分辨率重建的超高清视频新型压缩框架。主要包括利用奇数分割方法，结合基于学习的超分辨率重建技术。利用一种基于“分割‑补偿”的策略来进一步提升针对单幅图像或I帧的压缩性能，利用HEVC作为基本编码框架，利用HEVC帧内编码和帧间编码的各自特征对视频序列进行压缩。并利用超分辨率重建技术对重建视频客观质量进一步提升。实验结果表明，本发明的视频压缩方法，基本实现了在低码率端的同等码率情况下的重建视频质量的提升。
Aiming at the HEVC video coding standard, the present invention provides a novel ultra-high-definition video compression framework combined with super-resolution reconstruction. It mainly includes the use of odd segmentation methods combined with learning-based super-resolution reconstruction techniques. A strategy based on "segmentation-compensation" is used to further improve the compression performance for a single image or I frame, using HEVC as the basic coding framework, and using the respective characteristics of HEVC intra-frame coding and inter-frame coding to compress video sequences. And use super-resolution reconstruction technology to further improve the objective quality of the reconstructed video. Experimental results show that the video compression method of the present invention basically realizes the improvement of the reconstructed video quality under the same bit rate at the low bit rate end.
Description
技术领域technical field
本发明涉及图像通信领域中的视频压缩技术问题，尤其是涉及一种结合超分辨率重建的超高清视频压缩方法。The invention relates to video compression technical issues in the field of image communication, in particular to an ultra-high-definition video compression method combined with super-resolution reconstruction.
背景技术Background technique
随着高清图像和视频(1920×1080像素及以上)的普及，甚至已有4K(3840×2160)电视机的信号以及8K(8192×4320)超高清视频，人们对高清图像和视频的需求不断增加，数据量也随之不断增大。仅仅凭借硬盘的容量扩充和传输设备的更新改进，还不能很好地解决存储和传输的问题。因此，如何在保证视频编码质量的同时降低编码的计算复杂度成为了视频编码领域研究的热点。With the popularization of high-definition images and videos (1920×1080 pixels and above), there are even 4K (3840×2160) TV signals and 8K (8192×4320) ultra-high-definition videos, and people’s demand for high-definition images and videos continues As the amount of data increases, the amount of data also increases. The problem of storage and transmission cannot be well solved just by expanding the capacity of the hard disk and updating and improving the transmission equipment. Therefore, how to reduce the computational complexity of encoding while ensuring the quality of video encoding has become a research hotspot in the field of video encoding.
我们知道，利用图像和视频资源在时间和空间上的冗余性可实现对数据量的压缩。现有的用于静止图像压缩的JPEG、JPEG2000标准，主要适用于视频资源压缩的编码标准H.264/AVC、最新的高性能视频编码(HEVC)等都是变换编码和预测编码结合的混合编码框架。类似于以往的国际标准，HEVC仍旧采用混合编码框架，包括变換、量化、熵编码、帧内预测、帧间预测以及环路滤波等模块。但是HEVC几乎在每个模块中都引入了新的编码技术。HEVC编码标准与之前主流的压缩标准H.264/AVC相比，重建图像的质量在相同PSNR下，编码码率可以节省50％以上，目前来说，HEVC标准的性能是最好的，超过了以往所有的图像和视频编码标准。但HEVC的编码计算复杂度也超过了以往所有编码标准，因此，一些研究机构和研究人员对如何有效降低HEVC的编码计算复杂度展开了大量研究。We know that the compression of data volume can be achieved by using the redundancy of image and video resources in time and space. The existing JPEG and JPEG2000 standards for still image compression, the coding standard H.264/AVC mainly suitable for video resource compression, and the latest high-performance video coding (HEVC) are hybrid coding that combines transform coding and predictive coding. frame. Similar to previous international standards, HEVC still uses a hybrid coding framework, including modules such as transformation, quantization, entropy coding, intra prediction, inter prediction, and loop filtering. But HEVC introduces new encoding techniques in almost every module. Compared with the previous mainstream compression standard H.264/AVC, the HEVC coding standard can save more than 50% of the coding bit rate under the same PSNR of the quality of the reconstructed image. At present, the performance of the HEVC standard is the best, exceeding All previous image and video coding standards. However, the computational complexity of HEVC encoding exceeds all previous encoding standards. Therefore, some research institutions and researchers have conducted a lot of research on how to effectively reduce the computational complexity of HEVC encoding.
实际上在H.264/AVC视频编码阶段，针对压缩性能提升方面的研究已经取得了一定的成果。其中帧内自适应分割预测编码(ADPC)的编码性能提升比较突出。ADPC把I帧通过水平或垂直采样分成两帧分别进行帧内和帧间编码，再使用率失真代价函数对两种采用方式和标准预测模式进行最优选择。另外，针对H.264/AVC的帧间预测宏块级混合时空预测算法(MLH-TSP)被提出。MLH-TSP提出了垂直时空预测(VTSP)和水平时空预测(HTSP)用来编码帧间编码帧中的宏块，最后仍然利用率失真代价函数进行最终预测模式的选择。但当视频序列分辨率足够大时，在某一帧划分为四个或更多的子帧后，相邻子帧之间即具备有很强的时间相关性，可充分利用相邻帧间的相关性，去除时间冗余。为了减少预测残差即进一步减少所要传递的数据量，帧内预测可以合理的转化为帧间预测。一种基于树形结构的自适应多采样帧内预测编码算法被提出(A Tree Structure Based Adaptive MultisamplingPrediction Coding for Intra-Frame，TS_AMPC)。此方法继续沿用分割的思路，把I帧分割为4个子帧后分别进行帧内和帧间编码，最后使用率失真代价函数对四种采用方式和标准预测模式进行最优选择。In fact, in the H.264/AVC video coding stage, research on improving compression performance has achieved certain results. Among them, the coding performance improvement of intra-frame Adaptive Partition Predictive Coding (ADPC) is more prominent. ADPC divides the I frame into two frames through horizontal or vertical sampling for intra-frame and inter-frame encoding respectively, and then uses the rate-distortion cost function to optimally select the two adoption methods and the standard prediction mode. In addition, for H.264/AVC, an inter-prediction macroblock-level hybrid spatio-temporal prediction algorithm (MLH-TSP) is proposed. MLH-TSP proposes vertical spatio-temporal prediction (VTSP) and horizontal spatio-temporal prediction (HTSP) to encode macroblocks in inter-coded frames, and finally uses the rate-distortion cost function to select the final prediction mode. However, when the resolution of the video sequence is large enough, after a certain frame is divided into four or more subframes, there is a strong time correlation between adjacent subframes, which can make full use of the time gap between adjacent frames. Correlation, remove time redundancy. In order to reduce the prediction residual, that is, to further reduce the amount of data to be transmitted, intra prediction can be reasonably converted to inter prediction. A Tree Structure Based Adaptive Multisampling Prediction Coding for Intra-Frame (TS_AMPC) is proposed. This method continues to use the idea of segmentation, divides the I frame into 4 sub-frames and performs intra-frame and inter-frame coding respectively, and finally uses the rate-distortion cost function to optimally select the four adoption methods and the standard prediction mode.
发明内容Contents of the invention
为了提高新一代视频压缩编码标准HEVC视频编码性能，本发明在充分利用HEVC编码标准基础上，结合超分辨率重建技术、帧内预测和帧间预测相关性，提出了一种新型视频压缩编码方法，在低码率段相比HEVC标准编码方法有一定的性能提升。In order to improve the video coding performance of the new generation of video compression coding standard HEVC, the present invention proposes a new video compression coding method based on the full use of the HEVC coding standard, combined with super-resolution reconstruction technology, intra prediction and inter prediction correlation , compared with the HEVC standard encoding method in the low bit rate segment, there is a certain performance improvement.
本发明的基本思想是利用一种基于“分割-补偿”的策略来进一步提升针对单幅图像或I帧的压缩性能，利用HEVC作为基本编码框架，利用HEVC帧内编码和帧间编码的各自特征对视频序列进行压缩。并利用基于学习的超分辨率重建技术对重建视频客观质量进一步提升。进而达到在HEVC基础上进一步提高视频编码性能的目的。The basic idea of the present invention is to use a strategy based on "segmentation-compensation" to further improve the compression performance for a single image or I frame, use HEVC as the basic coding framework, and use the respective characteristics of HEVC intra-frame coding and inter-frame coding Compresses a video sequence. And the objective quality of the reconstructed video is further improved by using the learning-based super-resolution reconstruction technology. Then achieve the purpose of further improving video coding performance on the basis of HEVC.
本发明针对超高清视频序列的压缩提出一种新型视频压缩编码框架，此与传统编码框架HEVC相结合，同时采用奇数分割方法，把超高清视频序列的I帧进行下采样，降低了视频序列的数据量。本发明充分利用了现有标准框架中优良的压缩性能，从而在根本上保证了此框架的压缩性能不被降低。本发明在重建环节利用超分辨率技术对相关重建帧进行客观质量补偿。具体主要包括以下过程步骤：The present invention proposes a new type of video compression coding framework for the compression of ultra-high-definition video sequences. This is combined with the traditional coding framework HEVC, and at the same time, an odd-numbered segmentation method is used to down-sample the I frame of the ultra-high-definition video sequence, reducing the video sequence. The amount of data. The invention makes full use of the excellent compression performance of the existing standard frame, thereby fundamentally ensuring that the compression performance of the frame is not reduced. In the reconstruction link, the present invention uses the super-resolution technology to perform objective quality compensation on related reconstruction frames. Specifically, it mainly includes the following process steps:
(1)判断当前编码帧是否为第1帧，若为第1帧，则对原始超高清视频序列的第1帧进行奇数分割成5帧；(1) Judging whether the current coded frame is the first frame, if it is the first frame, the first frame of the original ultra-high-definition video sequence is divided into 5 frames in odd numbers;
(2)将超高清视频序列中后续三帧依次隔行隔列下采样得到3帧，构成8帧的高清视频序列，对得到的8帧高清视频序列使用encoder_lowdelay_P_main.cfg配置文件进行IPPP帧间编码，形成码流；(2) Subsequent three frames in the ultra-high-definition video sequence are sequentially down-sampled to obtain 3 frames, forming an 8-frame high-definition video sequence, and using the encoder_lowdelay_P_main.cfg configuration file to perform IPPP inter-frame encoding on the obtained 8-frame high-definition video sequence, Form code stream;
(3)利用解码端获得的高清视频序列的前4个P帧，进行插值后得到重建的超高清视频序列的第1帧；(3) Utilize the first 4 P frames of the high-definition video sequence obtained by the decoding end to obtain the first frame of the reconstructed ultra-high-definition video sequence after interpolation;
(4)将重建后超高清视频序列的第1帧与编码后高清视频序列的第1帧做超分辨率字典训练得到与各个QP值对应的字典，使用字典指导编码后高清视频序列剩余3个P帧进行超分辨率重建为超高清视频序列的后3帧；(4) Perform super-resolution dictionary training on the first frame of the reconstructed ultra-high-definition video sequence and the first frame of the encoded high-definition video sequence to obtain a dictionary corresponding to each QP value, and use the dictionary to guide the remaining 3 high-definition video sequences after encoding The P frame is super-resolution reconstructed into the last 3 frames of the ultra-high-definition video sequence;
(5)组合重建后的超高清视频序列1个I帧和超分辨率重建后的高清视频序列后3个P帧，生成新的超高清视频序列。(5) Combining one I frame of the reconstructed ultra-high definition video sequence and the last three P frames of the super-resolution reconstructed high definition video sequence to generate a new ultra high definition video sequence.
在本发明的上述技术方案中，对于在步骤(1)，利用奇数分割把第一帧分为1个I帧和4个P帧，其中I帧中各点像素由原始图中每四点像素值求平均得到，P帧中各点像素由原始图隔行隔列下采样得到。In the above technical solution of the present invention, for step (1), the first frame is divided into 1 I frame and 4 P frames by odd division, wherein each point pixel in the I frame is divided into every four pixels in the original image The average value is obtained, and the pixels of each point in the P frame are obtained by downsampling the original image every other row and column.
在本发明的上述技术方案中，所述结合超分辨率重建的超高清视频新型压缩框架，将原始超高清序列下采样为高清视频序列，降低了I帧比特率。In the above technical solution of the present invention, the novel compression framework for ultra-high-definition video combined with super-resolution reconstruction downsamples the original ultra-high-definition sequence into a high-definition video sequence, reducing the bit rate of the I frame.
在本发明的上述技术方案中，所述HEVC的帧间编码方法保持HEVC编码和解码过程的完整稳定，对其中的编解码步骤不做任何修改。In the above technical solution of the present invention, the HEVC interframe encoding method maintains the integrity and stability of the HEVC encoding and decoding process, and does not make any modification to the encoding and decoding steps therein.
在本发明的上述技术方案中，所述超分辨率字典训练方法构造相应的样本库，采用K-SVD字典学习算法进行超分辨率字典训练。In the above technical solution of the present invention, the super-resolution dictionary training method constructs a corresponding sample library, and uses the K-SVD dictionary learning algorithm for super-resolution dictionary training.
在本发明的上述技术方案中，所述超分辨率字典训练方法采用的样本库不仅使用重建后超高清视频序列的第1帧，同时使用编码后高清视频序列的第1帧。In the above technical solution of the present invention, the sample library adopted by the super-resolution dictionary training method not only uses the first frame of the reconstructed ultra-high-definition video sequence, but also uses the first frame of the encoded high-definition video sequence.
根据本发明的上述方法可以编制执行上述结合超分辨率重建的超高清视频新型压缩方法。According to the above method of the present invention, it is possible to compile and execute the above novel compression method for ultra-high-definition video combined with super-resolution reconstruction.
本发明是基于以下思路分析而完成的：The present invention is based on following train of thought analysis and finishes:
视频序列在HEVC编码过程中，帧内编码比帧间编码需要占有更多的编码比特，即I帧数据量远远大于P帧数据量，利用I帧和P帧各自的编码特征把一幅静止图像下采样分割后组合成视频序列，那么对组合而成的视频序列编码数据量会小于对原始静止图像进行I帧编码的数据量。当一幅图像的分辨率足够大时，在将这幅图像划分为四个或更多子帧后，这些分割后形成的子帧之间具有很强的时间相关性，尤其是在超高清图像中，这一特点更是突出，所以预测残差比较平坦，即很多预测残差值接近于零。因此我们可以针对超高清图像和视频(1600P以上)进行分割。In the HEVC encoding process of a video sequence, intra-frame coding requires more coding bits than inter-frame coding, that is, the data volume of I frame is much larger than that of P frame. After the image is down-sampled and segmented, it is combined into a video sequence, and the amount of encoded data for the combined video sequence will be smaller than the amount of data for I-frame encoding of the original still image. When the resolution of an image is large enough, after the image is divided into four or more subframes, there is a strong temporal correlation between the subframes formed after these divisions, especially in ultra-high-definition images In , this feature is even more prominent, so the prediction residual is relatively flat, that is, many prediction residual values are close to zero. Therefore, we can segment ultra-high-definition images and videos (above 1600P).
在分割所构成的高清视频序列中，高清视频序列的第1帧I帧，是由超高清视频序列中的I帧四点求平均得到；高清视频序列的后4帧P1至P4帧，由超高清视频序列中的I帧隔行隔列下采样依次得到；最后跟高清视频序列的3帧P5至P7帧，由超高清视频序列中后续3个P帧依次隔行隔列下采样得到。在HEVC编码端针对分割后的高清视频序列进行IPPP编码，形成各自的码流。此过程保持HEVC编码和解码过程的完整稳定，对其中的编解码步骤不做任何修改。In the high-definition video sequence formed by segmentation, the first frame I frame of the high-definition video sequence is obtained by averaging four points of the I frame in the ultra-high-definition video sequence; the last 4 frames P1 to P4 frames of the high - definition video sequence, It is obtained by down-sampling the I frame in the ultra-high-definition video sequence alternately; the last three frames P 5 to P 7 in the high-definition video sequence are obtained by down-sampling the subsequent 3 P frames in the ultra-high-definition video sequence. . At the HEVC encoding end, IPPP encoding is performed on the divided high-definition video sequences to form respective code streams. This process maintains the integrity and stability of the HEVC encoding and decoding process without any modification to the encoding and decoding steps.
最后在解码端，对解码后的高清视频序列的I帧和P帧分别进行重建得到超高清视频序列。利用奇数分割的方法把解码重建后高清序列中的P1至P4帧插值得到超高清I帧，作为重建后超高清视频的第1帧。用此I帧与高清视频序列的I1做超分辨率字典训练生成各QP(35-50)对应的字典，使用训练好的字典对高清视频序列剩余3个P帧进行解码后高清视频序列中P5至P7帧进行超分辨运算，得到相应的超高清后3个P帧。利用插值得到的超高清I帧和超分辨率重建后的超高清后续3个P帧组合成重建后的超高清视频序列。实验结果表明，本发明的视频压缩方法，基本实现了在低码率端的同等码率情况下的重建视频质量的提升。Finally, at the decoding end, the I frame and the P frame of the decoded high definition video sequence are respectively reconstructed to obtain an ultra high definition video sequence. Use the method of odd division to interpolate frames P 1 to P 4 in the decoded and reconstructed high-definition sequence to obtain an ultra-high-definition I frame, which is used as the first frame of the reconstructed ultra-high-definition video. Use this I frame and I 1 of the high-definition video sequence to do super-resolution dictionary training to generate a dictionary corresponding to each QP (35-50), and use the trained dictionary to decode the remaining 3 P frames of the high-definition video sequence. In the high-definition video sequence Frames P 5 to P 7 are subjected to super-resolution calculations to obtain the corresponding ultra-high-definition last 3 P frames. The ultra-high-definition I frame obtained by interpolation and the subsequent three P-frames of ultra-high-definition reconstruction after super-resolution are combined to form a reconstructed ultra-high-definition video sequence. Experimental results show that the video compression method of the present invention basically realizes the improvement of the reconstructed video quality under the same bit rate at the low bit rate end.
附图说明Description of drawings
图1高清视频序列分割方案示意图；Fig. 1 Schematic diagram of HD video sequence segmentation scheme;
图2高清视频序列编解码过程；Fig. 2 high-definition video sequence encoding and decoding process;
图3超高清视频序列生成示意图。Figure 3 Schematic diagram of ultra-high-definition video sequence generation.
具体实施方式detailed description
下面结合实施例对本发明作进一步的详细说明，有必要指出的是，以下的实施例只用于对本发明做进一步的说明，不能理解为对本发明保护范围的限制，所属领域技术熟悉人员根据上述发明内容，对本发明做出一些非本质的改进和调整进行具体实施，应仍属于本发明的保护范围。The present invention will be further described in detail below in conjunction with the examples. It must be pointed out that the following examples are only used to further illustrate the present invention and cannot be interpreted as limiting the protection scope of the present invention. Content, making some non-essential improvements and adjustments to the present invention for specific implementation shall still belong to the protection scope of the present invention.
1.同时打开两个算法的程序并设置好相同的配置文件，参考软件选择HM16.0，量化步长(QP)值分别取35、40、45和50。本发明将与HEVC直接编码超高清视频序列4帧的方法进行比较。并对其两种视频编码性能：比特率、峰值信噪比(PSNR)(其中PSNR体现视频的客观视频质量)，进行了比较分析。1. Open the programs of the two algorithms at the same time and set the same configuration file. The reference software selects HM16.0, and the quantization step (QP) value is 35, 40, 45 and 50 respectively. The present invention will be compared with the HEVC method of directly encoding 4 frames of ultra-high-definition video sequences. And it compares and analyzes two kinds of video coding performances: bit rate, peak signal-to-noise ratio (PSNR) (PSNR reflects the objective video quality of video).
2.编码的对象为超高清视频序列为：Training、Running、Cup、Dolls、Penguin、Jogging。2. The encoding objects are ultra-high-definition video sequences: Training, Running, Cup, Dolls, Penguin, Jogging.
3.利用HM16.0标准方法对超高清视频序列在HEVC方式下进行视频编码；3. Utilize the HM16.0 standard method to encode ultra-high-definition video sequences in HEVC mode;
4.将超高清视频下采为8帧高清视频；4. Download ultra-high-definition video to 8-frame high-definition video;
5.利用HM16.0标准方法对高清视频序列在HEVC方式下进行视频编码；5. Use the HM16.0 standard method to encode high-definition video sequences in HEVC mode;
6.对高清视频序列格式码流解码，得到解码后视频，对解码后视频进行基于学习的超分辨视频重建。6. Decode the high-definition video sequence format code stream to obtain the decoded video, and perform learning-based super-resolution video reconstruction on the decoded video.
7.两个程序分别输出视频编码后的比特率、PSNR值，上述2个质量指标的结果如表1所示。统计显示在低码率段(QP范围35-50)本发明算法实验压缩性能基本超过了HEVC压缩性能。7. The two programs respectively output the bit rate and PSNR value after video encoding. The results of the above two quality indicators are shown in Table 1. Statistics show that in the low bit rate segment (QP range 35-50), the experimental compression performance of the algorithm of the present invention basically exceeds the HEVC compression performance.
表1本发明算法与HEVC标准视频编码性能的比较Table 1 Algorithm of the present invention and the comparison of HEVC standard video coding performance
Claims (7)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710151638.9A CN106961610B (en) | 2017-03-15 | 2017-03-15 | Novel super-high-definition video compression framework combined with super-resolution reconstruction |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710151638.9A CN106961610B (en) | 2017-03-15 | 2017-03-15 | Novel super-high-definition video compression framework combined with super-resolution reconstruction |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106961610A true CN106961610A (en) | 2017-07-18 |
| CN106961610B CN106961610B (en) | 2020-05-05 |
Family
ID=59470742
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710151638.9A Active CN106961610B (en) | 2017-03-15 | 2017-03-15 | Novel super-high-definition video compression framework combined with super-resolution reconstruction |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106961610B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110557651A (en) * | 2019-09-09 | 2019-12-10 | 云南师范大学 | ultrahigh-definition dynamic image display method based on big data distributed storage technology |
| CN111010505A (en) * | 2019-11-07 | 2020-04-14 | 广东工业大学 | A transient scene reconstruction algorithm and device |
| CN111586412A (en) * | 2020-05-06 | 2020-08-25 | 华为技术有限公司 | High-definition video processing method, master device, slave device and chip system |
| CN111711817A (en) * | 2019-03-18 | 2020-09-25 | 四川大学 | An optimization research on HEVC intra-frame coding compression performance combined with convolutional neural network |
| CN111726614A (en) * | 2019-03-18 | 2020-09-29 | 四川大学 | A HEVC coding optimization method based on spatial downsampling and deep learning reconstruction |
| CN111882564A (en) * | 2020-07-27 | 2020-11-03 | 山东大学 | Compression processing method for ultra-high definition medical pathological image |
| CN118869997A (en) * | 2024-06-26 | 2024-10-29 | 南通大学 | A joint optimization method for compression and reconstruction of ultra-high-definition video |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101938656A (en) * | 2010-09-27 | 2011-01-05 | 上海交通大学 | Video Codec System Based on Key Frame Super-resolution Reconstruction |
| CN102196253A (en) * | 2010-03-11 | 2011-09-21 | 中国科学院微电子研究所 | Video coding method and device for adaptive selection of frame type |
| CN102196256A (en) * | 2010-03-11 | 2011-09-21 | 中国科学院微电子研究所 | A video coding method and device |
| US20120328200A1 (en) * | 2010-01-15 | 2012-12-27 | Limin Liu | Edge enhancement for temporal scaling with metadata |
| CN103607591A (en) * | 2013-10-28 | 2014-02-26 | 四川大学 | Image compression method combining super-resolution reconstruction |
-
2017
- 2017-03-15 CN CN201710151638.9A patent/CN106961610B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120328200A1 (en) * | 2010-01-15 | 2012-12-27 | Limin Liu | Edge enhancement for temporal scaling with metadata |
| CN102196253A (en) * | 2010-03-11 | 2011-09-21 | 中国科学院微电子研究所 | Video coding method and device for adaptive selection of frame type |
| CN102196256A (en) * | 2010-03-11 | 2011-09-21 | 中国科学院微电子研究所 | A video coding method and device |
| CN101938656A (en) * | 2010-09-27 | 2011-01-05 | 上海交通大学 | Video Codec System Based on Key Frame Super-resolution Reconstruction |
| CN103607591A (en) * | 2013-10-28 | 2014-02-26 | 四川大学 | Image compression method combining super-resolution reconstruction |
Non-Patent Citations (1)
| Title |
|---|
| FERNANDA BRANDI,RICARDO DE QUEIROZ,DEBARGHA MUKHERJEE: "SUPER-RESOLUTION OF VIDEO USING KEY FRAMES AND MOTION ESTIMATION", 《IEEE》 * |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111711817A (en) * | 2019-03-18 | 2020-09-25 | 四川大学 | An optimization research on HEVC intra-frame coding compression performance combined with convolutional neural network |
| CN111726614A (en) * | 2019-03-18 | 2020-09-29 | 四川大学 | A HEVC coding optimization method based on spatial downsampling and deep learning reconstruction |
| CN111711817B (en) * | 2019-03-18 | 2023-02-10 | 四川大学 | A HEVC Intra-frame Coding Compression Performance Optimization Method Combined with Convolutional Neural Network |
| CN110557651A (en) * | 2019-09-09 | 2019-12-10 | 云南师范大学 | ultrahigh-definition dynamic image display method based on big data distributed storage technology |
| CN111010505A (en) * | 2019-11-07 | 2020-04-14 | 广东工业大学 | A transient scene reconstruction algorithm and device |
| CN111586412A (en) * | 2020-05-06 | 2020-08-25 | 华为技术有限公司 | High-definition video processing method, master device, slave device and chip system |
| CN111586412B (en) * | 2020-05-06 | 2022-07-26 | 华为技术有限公司 | High-definition video processing method, master device, slave device and chip system |
| CN111882564A (en) * | 2020-07-27 | 2020-11-03 | 山东大学 | Compression processing method for ultra-high definition medical pathological image |
| CN118869997A (en) * | 2024-06-26 | 2024-10-29 | 南通大学 | A joint optimization method for compression and reconstruction of ultra-high-definition video |
| CN118869997B (en) * | 2024-06-26 | 2025-02-18 | 南通大学 | Compression and reconstruction combined optimization method for ultra-high definition video |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106961610B (en) | 2020-05-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106961610B (en) | Novel super-high-definition video compression framework combined with super-resolution reconstruction | |
| KR101055738B1 (en) | Method and apparatus for encoding/decoding video signal using prediction information of intra-mode macro blocks of base layer | |
| US10142654B2 (en) | Method for encoding/decoding video by oblong intra prediction | |
| JP6701391B2 (en) | Digital frame encoding/decoding by downsampling/upsampling with improved information | |
| CN101252686B (en) | Method and system for lossless encoding and decoding in video frames based on interleaved prediction | |
| CN103248893B (en) | From H.264/AVC standard to code-transferring method and transcoder thereof the fast frame of HEVC standard | |
| CN113923455B (en) | Bidirectional inter-frame prediction method and device | |
| CN102196256B (en) | Video coding method and device | |
| CN101159875A (en) | Double predictive video encoding and decoding method and device | |
| CN103442228B (en) | Code-transferring method and transcoder thereof in from standard H.264/AVC to the fast frame of HEVC standard | |
| CN105681797B (en) | A kind of DVC-HEVC video transcoding methods based on prediction residual | |
| CN113170143A (en) | A Corresponding Derivation Method for Boundary Strength of Encoder, Decoder and Deblocking Filter | |
| WO2011110088A1 (en) | Method and divece for video predictive encoding | |
| CN111711817B (en) | A HEVC Intra-frame Coding Compression Performance Optimization Method Combined with Convolutional Neural Network | |
| CN106101709A (en) | A kind of Primary layer inter-frame prediction method of the SHVC quality scalability combining enhancement layer | |
| CN101964910A (en) | Video spatial resolution conversion method based on code-rate type transcoding assistance | |
| CN108063947A (en) | A kind of lossless reference frame compression method based on pixel texture | |
| CN115002482B (en) | End-to-end video compression method and system using structural preserving motion estimation | |
| CN102510496B (en) | Quick size reduction transcoding method based on region of interest | |
| CN1194544C (en) | Video Coding Method Based on Time-Space Domain Correlation Motion Vector Prediction | |
| CN100586185C (en) | A Mode Selection Method for H.264 Video Reduced Resolution Transcoding | |
| CN101262607B (en) | Two-folded prediction video coding and decoding method and device | |
| Wang et al. | Video compression at extremely low bit rates | |
| CN116744020A (en) | Method for quick intra-frame prediction of universal video coding based on adjacent block depth | |
| KR100883591B1 (en) | Method and apparatus for encoding / decoding video signal using prediction information of internal mode block of base layer |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |