[go: up one dir, main page]

CN115604462A - Video compression method and system applying component analysis - Google Patents

Video compression method and system applying component analysis Download PDF

Info

Publication number
CN115604462A
CN115604462A CN202211091544.4A CN202211091544A CN115604462A CN 115604462 A CN115604462 A CN 115604462A CN 202211091544 A CN202211091544 A CN 202211091544A CN 115604462 A CN115604462 A CN 115604462A
Authority
CN
China
Prior art keywords
frame
data
coefficient
compression
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211091544.4A
Other languages
Chinese (zh)
Inventor
吴冠标
孙中民
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tianjin Guorui Digital Safety System Co ltd
Original Assignee
Tianjin Guorui Digital Safety System Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tianjin Guorui Digital Safety System Co ltd filed Critical Tianjin Guorui Digital Safety System Co ltd
Priority to CN202211091544.4A priority Critical patent/CN115604462A/en
Publication of CN115604462A publication Critical patent/CN115604462A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/105Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • G06V20/46Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136Incoming video signal characteristics or properties
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146Data rate or code amount at the encoder output
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Artificial Intelligence (AREA)
  • Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

The invention provides a video compression method and a video compression system applying component analysis, which form a double video key frame screening mechanism by adopting a principal component analysis algorithm to screen video key frames and combining frame difference operation, thereby minimizing the correlation of video subspaces, further realizing video compression to the maximum extent and overcoming the problems of low compression ratio and serious information loss in the prior art.

Description

一种应用成分分析的视频压缩方法和系统A video compression method and system using component analysis

技术领域technical field

本申请涉及网络多媒体领域,尤其涉及一种应用成分分析的视频压缩方法和系统。The present application relates to the field of network multimedia, in particular to a video compression method and system using component analysis.

背景技术Background technique

由于现有的视频长度越来越大,常见的视频压缩方法更多地侧重于数据量的压缩,即存在压缩率低、丢失信息严重的问题。如何在压缩的同时能够做到尽可能多保留冗余信息,同时又兼顾根据视频内容采取不同程度的压缩,是本领域技术人员需要考虑的问题。As the length of existing video is getting larger and larger, common video compression methods focus more on data volume compression, that is, there are problems of low compression rate and serious loss of information. How to retain as much redundant information as possible while compressing while taking into account different degrees of compression according to the video content is a problem that those skilled in the art need to consider.

因此,急需一种针对性的应用成分分析的视频压缩方法和系统。Therefore, there is an urgent need for a targeted method and system for video compression using component analysis.

发明内容Contents of the invention

本发明的目的在于提供一种应用成分分析的视频压缩方法和系统,采用主成分分析算法对视频关键帧筛选,并结合帧差值运算,形成两重视频关键帧的筛选机制,使视频子空间的相关性最小化,从而最大限度的实现视频压缩。The purpose of the present invention is to provide a video compression method and system using component analysis, which uses principal component analysis algorithm to screen video key frames, and combines frame difference calculations to form a screening mechanism for double video key frames, making the video subspace The correlation is minimized, so as to realize the maximum video compression.

第一方面,本申请提供一种应用成分分析的视频压缩方法,所述方法包括:In a first aspect, the present application provides a video compression method using component analysis, the method comprising:

根据获取策略,获取多个不同平台的视频数据流,对所述视频数据流进行分帧处理,得到以帧为单位的第一数据;Acquiring video data streams of a plurality of different platforms according to the acquisition strategy, and performing frame division processing on the video data streams to obtain first data in units of frames;

将所述第一数据的每一帧与参考帧进行差值运算,对所述差值进行估计,若差值在预设范围内,则表明该帧与参考帧差别不大,不是关键帧,将该帧从所述第一数据中剔除出去;Performing a difference calculation between each frame of the first data and a reference frame, and estimating the difference, if the difference is within a preset range, it indicates that the frame is not much different from the reference frame and is not a key frame, removing the frame from the first data;

将差值运算后的第一数据的逐个帧输入语义分析模型,得到词含义,将所述词含义与所述关键词做相似度计算,当相似度值高于第一阈值时,给当前帧赋予第一系数;Input the frame by frame of the first data after the difference operation into the semantic analysis model to obtain the meaning of the word, calculate the similarity between the meaning of the word and the keyword, and when the similarity value is higher than the first threshold, give the current frame assign the first coefficient;

将所述第一数据输入到向量矩阵模板中,得到第一向量矩阵P1,计算该第一向量矩阵P1的转置矩阵T1;将所述参考帧输入到向量矩阵模板中,得到参考矩阵P2,计算该参考矩阵P2的转置矩阵T2,计算T1与T2的相关度,剔除所述相关度值高于第二阈值的帧,得到第二数据;The first data is input into the vector matrix template to obtain the first vector matrix P1, and the transposition matrix T1 of the first vector matrix P1 is calculated; the reference frame is input into the vector matrix template to obtain the reference matrix P2, Calculating a transpose matrix T2 of the reference matrix P2, calculating the correlation between T1 and T2, and removing frames whose correlation value is higher than a second threshold to obtain second data;

根据所述第一系数生成压缩系数,对所述第二数据进行压缩编码,得到发送数据流,所述压缩编码采用所述压缩系数作为参数;generating a compression coefficient according to the first coefficient, performing compression coding on the second data to obtain a transmission data stream, and using the compression coefficient as a parameter in the compression coding;

接收对方设备发送的压缩数据流,得到映射数据流的冗余信息,其中包含有关键词,将所述关键词输入语义分析模型,得到第二词含义,查询得到对应类别的第二系数;根据所述第二系数生成第二压缩系数,对所述压缩数据流进行解压缩。Receive the compressed data stream sent by the other party's equipment, obtain the redundant information of the mapped data stream, which contains keywords, input the keywords into the semantic analysis model, obtain the meaning of the second word, and query to obtain the second coefficient of the corresponding category; The second coefficient generates a second compression coefficient for decompressing the compressed data stream.

第二方面,本申请提供一种应用成分分析的视频压缩系统,所述系统包括:In a second aspect, the present application provides a video compression system using component analysis, the system comprising:

获取单元,用于根据获取策略,获取多个不同平台的视频数据流,对所述视频数据流进行分帧处理,得到以帧为单位的第一数据;An acquisition unit, configured to acquire a plurality of video data streams of different platforms according to an acquisition strategy, and perform frame processing on the video data streams to obtain first data in units of frames;

预处理单元,用于将所述第一数据的每一帧与参考帧进行差值运算,对所述差值进行估计,若差值在预设范围内,则表明该帧与参考帧差别不大,不是关键帧,将该帧从所述第一数据中剔除出去;将差值运算后的第一数据的逐个帧输入语义分析模型,得到词含义,将所述词含义与所述关键词做相似度计算,当相似度值高于第一阈值时,给当前帧赋予第一系数;A preprocessing unit, configured to perform a difference operation on each frame of the first data and a reference frame, and estimate the difference, and if the difference is within a preset range, it indicates that the difference between the frame and the reference frame is the same Large, not a key frame, this frame is removed from the first data; the first data after the difference operation is input into the semantic analysis model frame by frame to obtain the meaning of the word, and the meaning of the word is combined with the keyword Perform similarity calculation, when the similarity value is higher than the first threshold, assign the first coefficient to the current frame;

再处理单元,用于将所述第一数据输入到向量矩阵模板中,得到第一向量矩阵P1,计算该第一向量矩阵P1的转置矩阵T1;将所述参考帧输入到向量矩阵模板中,得到参考矩阵P2,计算该参考矩阵P2的转置矩阵T2,计算T1与T2的相关度,剔除所述相关度值高于第二阈值的帧,得到第二数据;A reprocessing unit, configured to input the first data into the vector matrix template to obtain the first vector matrix P1, and calculate the transposition matrix T1 of the first vector matrix P1; input the reference frame into the vector matrix template , obtain the reference matrix P2, calculate the transpose matrix T2 of the reference matrix P2, calculate the correlation between T1 and T2, and eliminate the frames whose correlation value is higher than the second threshold, and obtain the second data;

压缩单元,用于根据所述第一系数生成压缩系数,对所述第二数据进行压缩编码,得到发送数据流,所述压缩编码采用所述压缩系数作为参数;A compression unit, configured to generate a compression coefficient according to the first coefficient, and compress and encode the second data to obtain a transmission data stream, and the compression encoding uses the compression coefficient as a parameter;

解压单元,用于接收对方设备发送的压缩数据流,得到映射数据流的冗余信息,其中包含有关键词,将所述关键词输入语义分析模型,得到第二词含义,查询得到对应类别的第二系数;根据所述第二系数生成第二压缩系数,对所述压缩数据流进行解压缩。The decompression unit is used to receive the compressed data stream sent by the other device, and obtain the redundant information of the mapped data stream, which contains keywords, and input the keywords into the semantic analysis model to obtain the meaning of the second word, and obtain the corresponding category of second coefficient; generating a second compression coefficient according to the second coefficient, and decompressing the compressed data stream.

第三方面,本申请提供一种应用成分分析的视频压缩系统,所述系统包括处理器以及存储器:In a third aspect, the present application provides a video compression system using component analysis, the system includes a processor and a memory:

所述存储器用于存储程序代码,并将所述程序代码传输给所述处理器;The memory is used to store program codes and transmit the program codes to the processor;

所述处理器用于根据所述程序代码中的指令执行第一方面四种可能中任一项所述的方法。The processor is configured to execute the method described in any one of the four possibilities in the first aspect according to instructions in the program code.

第四方面,本申请提供一种计算机可读存储介质,所述计算机可读存储介质用于存储程序代码,所述程序代码用于执行第一方面四种可能中任一项所述的方法。In a fourth aspect, the present application provides a computer-readable storage medium, where the computer-readable storage medium is used to store program code, and the program code is used to execute the method described in any one of the four possibilities in the first aspect.

有益效果Beneficial effect

本发明提供一种应用成分分析的视频压缩方法和系统,通过采用主成分分析算法对视频关键帧筛选,并结合帧差值运算,形成两重视频关键帧的筛选机制,使视频子空间的相关性最小化,从而最大限度的实现视频压缩,克服现有技术压缩率低、丢失信息严重的问题。The present invention provides a video compression method and system using component analysis. By adopting a principal component analysis algorithm to screen video key frames and combining frame difference calculations, a dual video key frame screening mechanism is formed, so that the correlation of video subspaces The performance is minimized, thereby realizing video compression to the greatest extent, and overcoming the problems of low compression rate and serious loss of information in the prior art.

附图说明Description of drawings

为了更清楚地说明本发明实施例中的技术方案,下面将对实施例中所需要使用的附图作简单地介绍,显而易见地,对于本领域普通技术人员而言,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings that need to be used in the embodiments will be briefly introduced below. Obviously, for those of ordinary skill in the art, without paying creative work Below, other drawings can also be obtained from these drawings.

图1为本发明一种应用成分分析的视频压缩方法的流程图;Fig. 1 is a flow chart of a video compression method using component analysis of the present invention;

图2为本发明一种应用成分分析的视频压缩系统的架构图。FIG. 2 is a structural diagram of a video compression system applying component analysis according to the present invention.

具体实施方式detailed description

下面结合附图对本发明的优选实施例进行详细阐述,以使本发明的优点和特征能更易于被本领域技术人员理解,从而对本发明的保护范围做出更为清楚明确的界定。The preferred embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings, so that the advantages and features of the present invention can be more easily understood by those skilled in the art, so as to define the protection scope of the present invention more clearly.

图1为本申请提供的应用成分分析的视频压缩方法的流程图,包括:Fig. 1 is the flow chart of the video compression method of application component analysis provided by the present application, including:

根据获取策略,获取多个不同平台的视频数据流,对所述视频数据流进行分帧处理,得到以帧为单位的第一数据;Acquiring video data streams of a plurality of different platforms according to the acquisition strategy, and performing frame division processing on the video data streams to obtain first data in units of frames;

将所述第一数据的每一帧与参考帧进行差值运算,对所述差值进行估计,若差值在预设范围内,则表明该帧与参考帧差别不大,不是关键帧,将该帧从所述第一数据中剔除出去;Performing a difference calculation between each frame of the first data and a reference frame, and estimating the difference, if the difference is within a preset range, it indicates that the frame is not much different from the reference frame and is not a key frame, removing the frame from the first data;

将差值运算后的第一数据的逐个帧输入语义分析模型,得到词含义,将所述词含义与所述关键词做相似度计算,当相似度值高于第一阈值时,给当前帧赋予第一系数;Input the frame by frame of the first data after the difference operation into the semantic analysis model to obtain the meaning of the word, calculate the similarity between the meaning of the word and the keyword, and when the similarity value is higher than the first threshold, give the current frame assign the first coefficient;

将所述第一数据输入到向量矩阵模板中,得到第一向量矩阵P1,计算该第一向量矩阵P1的转置矩阵T1;将所述参考帧输入到向量矩阵模板中,得到参考矩阵P2,计算该参考矩阵P2的转置矩阵T2,计算T1与T2的相关度,剔除所述相关度值高于第二阈值的帧,得到第二数据;The first data is input into the vector matrix template to obtain the first vector matrix P1, and the transposition matrix T1 of the first vector matrix P1 is calculated; the reference frame is input into the vector matrix template to obtain the reference matrix P2, Calculating a transpose matrix T2 of the reference matrix P2, calculating the correlation between T1 and T2, and removing frames whose correlation value is higher than a second threshold to obtain second data;

根据所述第一系数生成压缩系数,对所述第二数据进行压缩编码,得到发送数据流,所述压缩编码采用所述压缩系数作为参数;generating a compression coefficient according to the first coefficient, performing compression coding on the second data to obtain a transmission data stream, and using the compression coefficient as a parameter in the compression coding;

接收对方设备发送的压缩数据流,得到映射数据流的冗余信息,其中包含有关键词,将所述关键词输入语义分析模型,得到第二词含义,查询得到对应类别的第二系数;根据所述第二系数生成第二压缩系数,对所述压缩数据流进行解压缩。Receive the compressed data stream sent by the other party's equipment, obtain the redundant information of the mapped data stream, which contains keywords, input the keywords into the semantic analysis model, obtain the meaning of the second word, and query to obtain the second coefficient of the corresponding category; The second coefficient generates a second compression coefficient for decompressing the compressed data stream.

在一些优选实施例中,不同的平台预先设置不同的获取策略,所述获取策略是根据所述视频特征和热度信息的修正记录更新的。In some preferred embodiments, different platforms preset different acquisition strategies, and the acquisition strategies are updated according to the correction records of the video features and popularity information.

在一些优选实施例中,所述获取多个不同平台的视频数据流包括对所述视频数据流的加密编解码。In some preferred embodiments, the acquiring video data streams of multiple different platforms includes encoding and decoding the video data streams.

在一些优选实施例中,所述压缩编码包括量化编码。In some preferred embodiments, said compression encoding comprises quantization encoding.

图2为本申请提供的应用成分分析的视频压缩系统的架构图,所述系统包括:Fig. 2 is the architectural diagram of the video compression system of application component analysis that the application provides, and described system comprises:

获取单元,用于根据获取策略,获取多个不同平台的视频数据流,对所述视频数据流进行分帧处理,得到以帧为单位的第一数据;An acquisition unit, configured to acquire a plurality of video data streams of different platforms according to an acquisition strategy, and perform frame processing on the video data streams to obtain first data in units of frames;

预处理单元,用于将所述第一数据的每一帧与参考帧进行差值运算,对所述差值进行估计,若差值在预设范围内,则表明该帧与参考帧差别不大,不是关键帧,将该帧从所述第一数据中剔除出去;将差值运算后的第一数据的逐个帧输入语义分析模型,得到词含义,将所述词含义与所述关键词做相似度计算,当相似度值高于第一阈值时,给当前帧赋予第一系数;A preprocessing unit, configured to perform a difference operation on each frame of the first data and a reference frame, and estimate the difference, and if the difference is within a preset range, it indicates that the difference between the frame and the reference frame is the same Large, not a key frame, this frame is removed from the first data; the first data after the difference operation is input into the semantic analysis model frame by frame to obtain the meaning of the word, and the meaning of the word is combined with the keyword Perform similarity calculation, when the similarity value is higher than the first threshold, assign the first coefficient to the current frame;

再处理单元,用于将所述第一数据输入到向量矩阵模板中,得到第一向量矩阵P1,计算该第一向量矩阵P1的转置矩阵T1;将所述参考帧输入到向量矩阵模板中,得到参考矩阵P2,计算该参考矩阵P2的转置矩阵T2,计算T1与T2的相关度,剔除所述相关度值高于第二阈值的帧,得到第二数据;A reprocessing unit, configured to input the first data into the vector matrix template to obtain the first vector matrix P1, and calculate the transposition matrix T1 of the first vector matrix P1; input the reference frame into the vector matrix template , obtain the reference matrix P2, calculate the transpose matrix T2 of the reference matrix P2, calculate the correlation between T1 and T2, and eliminate the frames whose correlation value is higher than the second threshold, and obtain the second data;

压缩单元,用于根据所述第一系数生成压缩系数,对所述第二数据进行压缩编码,得到发送数据流,所述压缩编码采用所述压缩系数作为参数;A compression unit, configured to generate a compression coefficient according to the first coefficient, and compress and encode the second data to obtain a transmission data stream, and the compression encoding uses the compression coefficient as a parameter;

解压单元,用于接收对方设备发送的压缩数据流,得到映射数据流的冗余信息,其中包含有关键词,将所述关键词输入语义分析模型,得到第二词含义,查询得到对应类别的第二系数;根据所述第二系数生成第二压缩系数,对所述压缩数据流进行解压缩。The decompression unit is used to receive the compressed data stream sent by the other device, and obtain the redundant information of the mapped data stream, which contains keywords, and input the keywords into the semantic analysis model to obtain the meaning of the second word, and obtain the corresponding category of second coefficient; generating a second compression coefficient according to the second coefficient, and decompressing the compressed data stream.

本申请提供一种应用成分分析的视频压缩系统,所述系统包括:所述系统包括处理器以及存储器:The present application provides a video compression system using component analysis, the system includes: the system includes a processor and a memory:

所述存储器用于存储程序代码,并将所述程序代码传输给所述处理器;The memory is used to store program codes and transmit the program codes to the processor;

所述处理器用于根据所述程序代码中的指令执行第一方面所有实施例中任一项所述的方法。The processor is configured to execute the method in any one of the embodiments of the first aspect according to instructions in the program code.

本申请提供一种计算机可读存储介质,所述计算机可读存储介质用于存储程序代码,所述程序代码用于执行第一方面所有实施例中任一项所述的方法。The present application provides a computer-readable storage medium, where the computer-readable storage medium is used to store program code, and the program code is used to execute the method described in any one of the embodiments of the first aspect.

具体实现中,本发明还提供一种计算机存储介质,其中,该计算机存储介质可以存储有程序,该程序执行时可包括本发明各个实施例中的部分或全部步骤。所述的存储介质可以为磁碟、光盘、只读存储记忆体(简称:ROM)或随机存储记忆体(简称:RAM)等。In a specific implementation, the present invention also provides a computer storage medium, wherein the computer storage medium may store a program, and the program may include part or all of the steps in the various embodiments of the present invention when executed. The storage medium may be a magnetic disk, an optical disk, a read-only memory (referred to as ROM) or a random access memory (referred to as RAM), and the like.

本领域的技术人员可以清楚地了解到本发明实施例中的技术可借助软件加必需的通用硬件平台的方式来实现。基于这样的理解,本发明实施例中的技术方案本质上或者对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品可以存储在存储介质中,如ROM/RAM、磁碟、光盘等,包括若干指令用以使得一台计算机设备(可以是个人计算机、服务器、或者网络设备等)执行本发明各个实施例或者实施例的某些部分所述的方法。Those skilled in the art can clearly understand that the technologies in the embodiments of the present invention can be implemented by means of software plus a necessary general-purpose hardware platform. Based on this understanding, the essence of the technical solutions in the embodiments of the present invention or the part that contributes to the prior art can be embodied in the form of software products, and the computer software products can be stored in storage media, such as ROM/RAM, A magnetic disk, an optical disk, etc., include several instructions to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute the methods described in various embodiments or some parts of the embodiments of the present invention.

本说明书各个实施例之间相同相似的部分互相参见即可。尤其,对于实施例而言,由于其基本相似于方法实施例,所以描述的比较简单,相关之处参见方法实施例中的说明即可。For the same and similar parts in the various embodiments of this specification, refer to each other. In particular, as for the embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and for relevant parts, please refer to the description in the method embodiments.

以上所述的本发明实施方式并不构成对本发明保护范围的限定。The embodiments of the present invention described above are not intended to limit the protection scope of the present invention.

Claims (7)

1.一种应用成分分析的视频压缩方法,其特征在于,所述方法包括:1. A video compression method using component analysis, characterized in that the method comprises: 根据获取策略,获取多个不同平台的视频数据流,对所述视频数据流进行分帧处理,得到以帧为单位的第一数据;Acquiring video data streams of a plurality of different platforms according to the acquisition strategy, and performing frame division processing on the video data streams to obtain first data in units of frames; 将所述第一数据的每一帧与参考帧进行差值运算,对所述差值进行估计,若差值在预设范围内,则表明该帧与参考帧差别不大,不是关键帧,将该帧从所述第一数据中剔除出去;Performing a difference calculation between each frame of the first data and a reference frame, and estimating the difference, if the difference is within a preset range, it indicates that the frame is not much different from the reference frame and is not a key frame, removing the frame from the first data; 将差值运算后的第一数据的逐个帧输入语义分析模型,得到词含义,将所述词含义与所述关键词做相似度计算,当相似度值高于第一阈值时,给当前帧赋予第一系数;Input the frame by frame of the first data after the difference operation into the semantic analysis model to obtain the meaning of the word, calculate the similarity between the meaning of the word and the keyword, and when the similarity value is higher than the first threshold, give the current frame assign the first coefficient; 将所述第一数据输入到向量矩阵模板中,得到第一向量矩阵P1,计算该第一向量矩阵P1的转置矩阵T1;将所述参考帧输入到向量矩阵模板中,得到参考矩阵P2,计算该参考矩阵P2的转置矩阵T2,计算T1与T2的相关度,剔除所述相关度值高于第二阈值的帧,得到第二数据;The first data is input into the vector matrix template to obtain the first vector matrix P1, and the transposition matrix T1 of the first vector matrix P1 is calculated; the reference frame is input into the vector matrix template to obtain the reference matrix P2, Calculating a transpose matrix T2 of the reference matrix P2, calculating the correlation between T1 and T2, and removing frames whose correlation value is higher than a second threshold to obtain second data; 根据所述第一系数生成压缩系数,对所述第二数据进行压缩编码,得到发送数据流,所述压缩编码采用所述压缩系数作为参数;generating a compression coefficient according to the first coefficient, performing compression coding on the second data to obtain a transmission data stream, and using the compression coefficient as a parameter in the compression coding; 接收对方设备发送的压缩数据流,得到映射数据流的冗余信息,其中包含有关键词,将所述关键词输入语义分析模型,得到第二词含义,查询得到对应类别的第二系数;根据所述第二系数生成第二压缩系数,对所述压缩数据流进行解压缩。Receive the compressed data stream sent by the other party's equipment, obtain the redundant information of the mapped data stream, which contains keywords, input the keywords into the semantic analysis model, obtain the meaning of the second word, and query to obtain the second coefficient of the corresponding category; The second coefficient generates a second compression coefficient for decompressing the compressed data stream. 2.根据权利要求1所述的方法,其特征在于:不同的平台预先设置不同的获取策略,所述获取策略是根据所述视频特征和热度信息的修正记录更新的。2. The method according to claim 1, characterized in that: different platforms preset different acquisition strategies, and the acquisition strategies are updated according to the correction records of the video features and popularity information. 3.根据权利要求2所述的方法,其特征在于:所述获取多个不同平台的视频数据流包括对所述视频数据流的加密编解码。3. The method according to claim 2, characterized in that: said acquiring multiple video data streams of different platforms comprises encoding and decoding the video data streams. 4.根据权利要求3所述的方法,其特征在于:所述压缩编码包括量化编码。4. The method according to claim 3, wherein said compression coding comprises quantization coding. 5.一种应用成分分析的视频压缩系统,其特征在于,所述系统包括:5. A video compression system using component analysis, characterized in that the system comprises: 获取单元,用于根据获取策略,获取多个不同平台的视频数据流,对所述视频数据流进行分帧处理,得到以帧为单位的第一数据;An acquisition unit, configured to acquire a plurality of video data streams of different platforms according to an acquisition strategy, and perform frame processing on the video data streams to obtain first data in units of frames; 预处理单元,用于将所述第一数据的每一帧与参考帧进行差值运算,对所述差值进行估计,若差值在预设范围内,则表明该帧与参考帧差别不大,不是关键帧,将该帧从所述第一数据中剔除出去;将差值运算后的第一数据的逐个帧输入语义分析模型,得到词含义,将所述词含义与所述关键词做相似度计算,当相似度值高于第一阈值时,给当前帧赋予第一系数;A preprocessing unit, configured to perform a difference operation on each frame of the first data and a reference frame, and estimate the difference, and if the difference is within a preset range, it indicates that the difference between the frame and the reference frame is the same Large, not a key frame, this frame is removed from the first data; the first data after the difference operation is input into the semantic analysis model frame by frame to obtain the meaning of the word, and the meaning of the word is combined with the keyword Perform similarity calculation, when the similarity value is higher than the first threshold, assign the first coefficient to the current frame; 再处理单元,用于将所述第一数据输入到向量矩阵模板中,得到第一向量矩阵P1,计算该第一向量矩阵P1的转置矩阵T1;将所述参考帧输入到向量矩阵模板中,得到参考矩阵P2,计算该参考矩阵P2的转置矩阵T2,计算T1与T2的相关度,剔除所述相关度值高于第二阈值的帧,得到第二数据;A reprocessing unit, configured to input the first data into the vector matrix template to obtain the first vector matrix P1, and calculate the transposition matrix T1 of the first vector matrix P1; input the reference frame into the vector matrix template , obtain the reference matrix P2, calculate the transpose matrix T2 of the reference matrix P2, calculate the correlation between T1 and T2, and eliminate the frames whose correlation value is higher than the second threshold, and obtain the second data; 压缩单元,用于根据所述第一系数生成压缩系数,对所述第二数据进行压缩编码,得到发送数据流,所述压缩编码采用所述压缩系数作为参数;A compression unit, configured to generate a compression coefficient according to the first coefficient, and compress and encode the second data to obtain a transmission data stream, and the compression encoding uses the compression coefficient as a parameter; 解压单元,用于接收对方设备发送的压缩数据流,得到映射数据流的冗余信息,其中包含有关键词,将所述关键词输入语义分析模型,得到第二词含义,查询得到对应类别的第二系数;根据所述第二系数生成第二压缩系数,对所述压缩数据流进行解压缩。The decompression unit is used to receive the compressed data stream sent by the other device, and obtain the redundant information of the mapped data stream, which contains keywords, and input the keywords into the semantic analysis model to obtain the meaning of the second word, and obtain the corresponding category of a second coefficient; generating a second compression coefficient according to the second coefficient, and decompressing the compressed data stream. 6.一种应用成分分析的视频压缩系统,其特征在于,所述系统包括处理器以及存储器:6. A video compression system using component analysis, characterized in that the system includes a processor and a memory: 所述存储器用于存储程序代码,并将所述程序代码传输给所述处理器;The memory is used to store program codes and transmit the program codes to the processor; 所述处理器用于根据所述程序代码中的指令执行实现权利要求1-4任一项所述的方法。The processor is configured to implement the method according to any one of claims 1-4 according to instructions in the program code. 7.一种计算机可读存储介质,其特征在于,所述计算机可读存储介质用于存储程序代码,所述程序代码用于执行实现权利要求1-4任一项所述的方法。7. A computer-readable storage medium, wherein the computer-readable storage medium is used to store program codes, and the program codes are used to implement the method according to any one of claims 1-4.
CN202211091544.4A 2022-09-07 2022-09-07 Video compression method and system applying component analysis Pending CN115604462A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211091544.4A CN115604462A (en) 2022-09-07 2022-09-07 Video compression method and system applying component analysis

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211091544.4A CN115604462A (en) 2022-09-07 2022-09-07 Video compression method and system applying component analysis

Publications (1)

Publication Number Publication Date
CN115604462A true CN115604462A (en) 2023-01-13

Family

ID=84843364

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211091544.4A Pending CN115604462A (en) 2022-09-07 2022-09-07 Video compression method and system applying component analysis

Country Status (1)

Country Link
CN (1) CN115604462A (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060228029A1 (en) * 2005-03-29 2006-10-12 Microsoft Corporation Method and system for video clip compression
CN109561316A (en) * 2018-10-26 2019-04-02 西安科锐盛创新科技有限公司 A kind of VR three dimensional image processing method
CN109947991A (en) * 2017-10-31 2019-06-28 腾讯科技(深圳)有限公司 A kind of extraction method of key frame, device and storage medium
CN111629262A (en) * 2020-05-08 2020-09-04 Oppo广东移动通信有限公司 Video image processing method and device, electronic device and storage medium
CN112784110A (en) * 2021-01-26 2021-05-11 北京嘀嘀无限科技发展有限公司 Key frame determination method and device, electronic equipment and readable storage medium
CN113516006A (en) * 2021-04-01 2021-10-19 广州云硕科技发展有限公司 Efficient information processing method and system for intelligent robot
CN114205613A (en) * 2021-12-02 2022-03-18 北京智美互联科技有限公司 Method and system for synchronously compressing internet audio and video data
CN114898263A (en) * 2022-05-09 2022-08-12 浙江理工大学 A video key frame extraction method based on image information entropy and HOG_SSIM
CN115022645A (en) * 2022-06-24 2022-09-06 杭州海康威视数字技术股份有限公司 Video compression method and device, electronic equipment and machine-readable storage medium

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060228029A1 (en) * 2005-03-29 2006-10-12 Microsoft Corporation Method and system for video clip compression
CN109947991A (en) * 2017-10-31 2019-06-28 腾讯科技(深圳)有限公司 A kind of extraction method of key frame, device and storage medium
CN109561316A (en) * 2018-10-26 2019-04-02 西安科锐盛创新科技有限公司 A kind of VR three dimensional image processing method
CN111629262A (en) * 2020-05-08 2020-09-04 Oppo广东移动通信有限公司 Video image processing method and device, electronic device and storage medium
CN112784110A (en) * 2021-01-26 2021-05-11 北京嘀嘀无限科技发展有限公司 Key frame determination method and device, electronic equipment and readable storage medium
CN113516006A (en) * 2021-04-01 2021-10-19 广州云硕科技发展有限公司 Efficient information processing method and system for intelligent robot
CN114205613A (en) * 2021-12-02 2022-03-18 北京智美互联科技有限公司 Method and system for synchronously compressing internet audio and video data
CN114898263A (en) * 2022-05-09 2022-08-12 浙江理工大学 A video key frame extraction method based on image information entropy and HOG_SSIM
CN115022645A (en) * 2022-06-24 2022-09-06 杭州海康威视数字技术股份有限公司 Video compression method and device, electronic equipment and machine-readable storage medium

Similar Documents

Publication Publication Date Title
JP6928041B2 (en) Methods and equipment for processing video
US12026925B2 (en) Channel-wise autoregressive entropy models for image compression
US10965948B1 (en) Hierarchical auto-regressive image compression system
CN114095728B (en) End-to-end video compression method, device and computer readable storage medium
CN109785847B (en) Audio compression algorithm based on dynamic residual error network
US20190392302A1 (en) Efficient encoding and decoding sequences using variational autoencoders
WO2023051783A1 (en) Encoding method, decoding method, apparatus, device, and readable storage medium
US10366698B2 (en) Variable length coding of indices and bit scheduling in a pyramid vector quantizer
WO2023159820A1 (en) Image compression method, image decompression method, and apparatuses
CN114205613B (en) Method and system for synchronously compressing Internet audio and video data
WO2019004749A1 (en) Method and apparatus for performing low complexity computation in transform kernel for video compression
US12469114B2 (en) Method, device, system, electronic device, and storage medium for image processing
CN119180874B (en) Image coding and decoding method and compression method for machine and human vision
CN115604462A (en) Video compression method and system applying component analysis
CN113743518B (en) An approximately reversible image translation method based on joint inter-frame coding and embedding
CN116011556A (en) A system and method for training an audio codec
CN115567719B (en) Video compression method and system and storage medium
CN115580724A (en) Improved network video data compression method and system
CN120166112B (en) A communication edge cloud segmentation reasoning method, device, equipment, product and medium for large language models
CN119250020B (en) Text compression method, text decompression method, model training method, device and equipment
CN119011858B (en) Image coding, decoding and compressing method and system oriented to machine vision
CN114359418B (en) Image processing method, device, electronic device and storage medium
CN114979639B (en) Deep learning feature quantization method and device
CN110188367A (en) A kind of data processing method and device
Moon et al. Local Non-linear Quantization for Neural Network Compression in MPEG-NNR

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB03 Change of inventor or designer information

Inventor after: Sun Zhongmin

Inventor before: Wu Guanbiao

Inventor before: Sun Zhongmin

CB03 Change of inventor or designer information
RJ01 Rejection of invention patent application after publication

Application publication date: 20230113

RJ01 Rejection of invention patent application after publication