CN108337507A - Scheduling method for high efficiency video coding device - Google Patents
Scheduling method for high efficiency video coding device Download PDFInfo
- Publication number
- CN108337507A CN108337507A CN201710043756.8A CN201710043756A CN108337507A CN 108337507 A CN108337507 A CN 108337507A CN 201710043756 A CN201710043756 A CN 201710043756A CN 108337507 A CN108337507 A CN 108337507A
- Authority
- CN
- China
- Prior art keywords
- frame signal
- frame
- module
- signal
- sub
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 49
- 238000013139 quantization Methods 0.000 claims description 72
- 238000006243 chemical reaction Methods 0.000 claims 13
- 230000000875 corresponding effect Effects 0.000 description 23
- 241000023320 Luma <angiosperm> Species 0.000 description 18
- OSWPMRLSEDHDFF-UHFFFAOYSA-N methyl salicylate Chemical compound COC(=O)C1=CC=CC=C1O OSWPMRLSEDHDFF-UHFFFAOYSA-N 0.000 description 18
- 238000010586 diagram Methods 0.000 description 10
- 230000009466 transformation Effects 0.000 description 5
- 239000011159 matrix material Substances 0.000 description 2
- 230000002596 correlated effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
- H04N19/107—Selection of coding mode or of prediction mode between spatial and temporal predictive coding, e.g. picture refresh
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/124—Quantisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/186—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/625—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using discrete cosine transform [DCT]
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Discrete Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
Description
技术领域technical field
本发明指一种高效率视频编码装置的排程方法,尤指一种可适性调整进行帧内输入信号的编码操作的排程顺序,以提高高效率视频编码装置的处理效率的排程方法。The present invention refers to a scheduling method for a high-efficiency video encoding device, especially a scheduling method for adaptively adjusting the scheduling sequence of encoding operations for intra-frame input signals to improve the processing efficiency of a high-efficiency video encoding device .
背景技术Background technique
传统上,高效率视频编码装置可接收包含有多个输入帧信号的影音数据,且每一帧输入信号包含有多个亮度帧信号与多个色度帧信号,且每一亮度帧信号与每一色度帧信号对应为一矩阵信号,使得每一亮度帧信号与每一色度帧信号皆包含有已编号的多个子亮度帧信号与已编号的多个子色度帧信号。由于每一子亮度帧信号或每一子色度帧信号间有依附关系,即编码后一者的子亮度帧信号或子色度帧信号需参考编码前一者的子亮度帧信号或子色度帧信号的编码结果,据此,当高效率视频编码装置欲进行一帧内编码操作时,由于高效率视频编码装置需逐一对子亮度帧信号或子色度帧信号进行所对应的编码操作(例如一像素预估操作、一离散余弦转换操作、一量化操作、一反量化操作、一反离散余弦转换操作与一像素重建操作),其将造成大部分的硬件资源处于一等待输入信号的情况,而其硬件排程无法被有效利用。另外,当高效率视频编码装置欲进行一帧内/帧间编码操作时,现有的高效率视频编码装置仍必须逐一进行多个输入帧信号的编码操作,而对于硬件资源的排程也同样缺乏效率。Traditionally, a high-efficiency video encoding device can receive audio-visual data including a plurality of input frame signals, and each frame input signal includes a plurality of luma frame signals and a plurality of chroma frame signals, and each luma frame signal and each A chrominance frame signal corresponds to a matrix signal, so that each luminance frame signal and each chrominance frame signal include a plurality of numbered sub-luminance frame signals and a number of numbered sub-chrominance frame signals. Since each sub-brightness frame signal or each sub-chrominance frame signal has a dependency relationship, that is, the sub-brightness frame signal or sub-chrominance frame signal of the latter needs to refer to the sub-brightness frame signal or sub-color frame signal of the former. Therefore, when the high-efficiency video encoding device intends to perform an intra-frame encoding operation, the high-efficiency video encoding device needs to perform corresponding encoding operations on the sub-luminance frame signals or sub-chrominance frame signals one by one (such as a pixel estimation operation, a discrete cosine transform operation, a quantization operation, an inverse quantization operation, an inverse discrete cosine transform operation, and a pixel reconstruction operation), which will cause most of the hardware resources to be in a waiting input signal situation, and its hardware scheduling cannot be effectively utilized. In addition, when the high-efficiency video coding device intends to perform an intra-frame/inter-frame coding operation, the existing high-efficiency video coding device still has to perform coding operations on multiple input frame signals one by one, and the scheduling of hardware resources is also the same Lack of efficiency.
因此,提供一种用于高效率视频编码装置的排程方法,以提高高效率视频编码装置进行帧内编码操作与帧内/帧间编码操作的处理效率,已成为本领域的重要课题。Therefore, it has become an important subject in the art to provide a scheduling method for a high-efficiency video encoding device to improve the processing efficiency of the intra-frame encoding operation and intra-frame/inter-frame encoding operation performed by the high-efficiency video encoding device.
发明内容Contents of the invention
因此,本发明的主要目的即在于提供一种可适性调整进行帧内输入信号的编码操作的排程顺序,以对应提高高效率视频编码装置的处理效率。Therefore, the main objective of the present invention is to provide an adaptively adjustable scheduling sequence for encoding operations of intra-frame input signals, so as to correspondingly improve the processing efficiency of a high-efficiency video encoding device.
本发明揭示一种排程方法,用于一高效率视频编码装置,该排程方法包含有由该高效率视频编码装置的一排程模块接收多个输入帧信号,以对应产生一控制信号来判断每一输入帧信号是否进行一帧内/帧间编码操作,并由该排程模块判断每一输入帧信号为一亮度帧信号或一色度帧信号;以及当该控制信号被判断来进行该帧内/帧间编码操作时,该高效率视频编码装置于每一工作周期内依序对多个帧信号的多者进行一第一编码操作与一第二编码操作;其中,该第一编码操作依序进行一像素预估操作、一离散余弦转换操作、一量化操作、一反量化操作、一反离散余弦转换操作与一像素重建操作,该第二编码操作是依序进行一动作补偿操作、该离散余弦转换操作、该量化操作、该反量化操作、该反离散余弦转换操作与该像素重建操作,而每一工作周期是每一输入帧信号中单一亮度帧信号或单一色度帧信号进行该第一编码操作中任一操作或该第二编码操作中任一操作所对应的一时间。The present invention discloses a scheduling method for a high-efficiency video coding device. The scheduling method includes receiving a plurality of input frame signals by a scheduling module of the high-efficiency video coding device to generate a control signal correspondingly. judging whether an intra-frame/inter-frame coding operation is performed on each input frame signal, and judging by the scheduling module whether each input frame signal is a luma frame signal or a chrominance frame signal; and when the control signal is judged to perform the During the intra-frame/inter-frame coding operation, the high-efficiency video coding device sequentially performs a first coding operation and a second coding operation on a plurality of frame signals in each working cycle; wherein, the first coding The operation sequentially performs a pixel estimation operation, a discrete cosine transform operation, a quantization operation, an inverse quantization operation, an inverse discrete cosine transform operation and a pixel reconstruction operation, and the second encoding operation is a motion compensation operation in sequence , the discrete cosine transform operation, the quantization operation, the inverse quantization operation, the inverse discrete cosine transform operation and the pixel reconstruction operation, and each duty cycle is a single luma frame signal or a single chrominance frame signal in each input frame signal A time corresponding to any operation in the first encoding operation or any operation in the second encoding operation is performed.
本发明另揭示一种高效率视频编码装置,包含有一排程模块,用来接收多个输入帧信号,以对应产生一控制信号来判断每一输入帧信号是否进行一帧内/帧间编码操作,及用来判断每一输入帧信号为一亮度帧信号或一色度帧信号;以及一工作回圈模块,耦接该排程模块,包含有一预估模块、一离散余弦转换模块、一量化模块、一反量化模块、一反离散余弦转换模块与一像素重建模块且彼此为依序耦接;其中,当该控制信号被判断来进行该帧内/帧间编码操作时,该工作回圈模块于每一工作周期内依序对该多个帧信号的多者进行该第一编码操作与一第二编码操作,该第一编码操作依序进行一像素预估操作、一离散余弦转换操作、一量化操作、一反量化操作、一反离散余弦转换操作与一像素重建操作,该第二编码操作依序进行一动作补偿操作、该离散余弦转换操作、该量化操作、该反量化操作、该反离散余弦转换操作与该像素重建操作,而每一工作周期是每一输入帧信号中单一亮度帧信号或单一色度帧信号进行该第一编码操作中任一操作或该第二编码操作中任一操作所对应的一时间。The present invention also discloses a high-efficiency video encoding device, which includes a scheduling module for receiving a plurality of input frame signals and correspondingly generating a control signal to determine whether an intra-frame/inter-frame encoding operation is performed on each input frame signal , and used to determine whether each input frame signal is a luminance frame signal or a chrominance frame signal; and a working loop module, coupled to the scheduling module, including an estimation module, a discrete cosine transform module, and a quantization module , an inverse quantization module, an inverse discrete cosine transform module, and a pixel reconstruction module are sequentially coupled to each other; wherein, when the control signal is judged to perform the intra-frame/inter-frame coding operation, the working loop module The first encoding operation and a second encoding operation are sequentially performed on the plurality of frame signals in each working cycle, and the first encoding operation sequentially performs a pixel estimation operation, a discrete cosine transform operation, A quantization operation, an inverse quantization operation, an inverse discrete cosine transform operation, and a pixel reconstruction operation, the second encoding operation sequentially performs a motion compensation operation, the discrete cosine transform operation, the quantization operation, the inverse quantization operation, the The inverse discrete cosine transform operation and the pixel reconstruction operation, and each duty cycle is that a single luminance frame signal or a single chrominance frame signal in each input frame signal performs either operation in the first encoding operation or in the second encoding operation A time corresponding to any operation.
附图说明Description of drawings
图1为本发明实施例一高效能视频编码装置的示意图。FIG. 1 is a schematic diagram of a high-efficiency video encoding device according to an embodiment of the present invention.
图2为本发明实施例一排程流程的流程图。FIG. 2 is a flow chart of a scheduling process according to an embodiment of the present invention.
图3为本发明实施例一帧内编码流程的流程图。FIG. 3 is a flowchart of an intra-frame encoding process according to an embodiment of the present invention.
图4为本发明实施例一亮度帧信号与多个色度帧信号的示意图。FIG. 4 is a schematic diagram of a luma frame signal and a plurality of chrominance frame signals according to an embodiment of the present invention.
图5为图4实施例一亮度帧信号与多个色度帧信号所对应帧内编码操作的执行时间的示意图。FIG. 5 is a schematic diagram of execution time of intra-frame encoding operations corresponding to a luma frame signal and a plurality of chrominance frame signals according to the embodiment of FIG. 4 .
图6为本发明实施例一帧内/帧间编码流程的流程图。FIG. 6 is a flowchart of an intra-frame/inter-frame encoding process according to an embodiment of the present invention.
图7为本发明实施例中多个输入帧信号的亮度帧信号所对应帧内/帧间编码操作的执行时间的示意图。FIG. 7 is a schematic diagram of execution time of intra-frame/inter-frame coding operations corresponding to luma frame signals of multiple input frame signals in an embodiment of the present invention.
图8为图1中一排程模块的一实施例的示意图。FIG. 8 is a schematic diagram of an embodiment of a scheduling module in FIG. 1 .
符号说明Symbol Description
1 高效能视频编码装置1 High-efficiency video encoding device
10 排程模块10 Scheduling Module
11 预估模块11 Estimation Module
12 离散余弦转换模块12 discrete cosine transform modules
13 量化模块13 quantization module
14 反量化模块14 Inverse quantization module
15 反离散余弦转换模块15 Inverse discrete cosine transform module
16 像素重建模块16 pixel reconstruction module
17、18 转传单元17, 18 transfer unit
20 排程流程20 Scheduling process
200、202、204、206、300、302、304、306、308、600、602、604、606、608 步骤200, 202, 204, 206, 300, 302, 304, 306, 308, 600, 602, 604, 606, 608 steps
30 帧内编码流程30 Intra-frame encoding process
60 帧内/帧间编码流程60 Intra/Inter coding process
LM 工作回圈模块LM working loop module
S_L 亮度帧信号S_L luminance frame signal
S_L_0~S_L_15 子亮度帧信号S_L_0~S_L_15 sub-luminance frame signal
S_Cb、S_Cr 色度帧信号S_Cb, S_Cr Chroma frame signal
S_Cb_16~S_Cb_19、S_Cr_20~S_Cr_23 子色度帧信号S_Cb_16~S_Cb_19, S_Cr_20~S_Cr_23 sub-chroma frame signal
IAP 像素预估操作IAP pixel estimation operation
DCT 离散余弦转换操作DCT discrete cosine transform operation
Q 量化操作Q quantization operation
IQ 反量化操作IQ dequantization operation
IDCT 反离散余弦转换操作IDCT inverse discrete cosine transform operation
REC 像素重建操作REC pixel reconstruction operation
MC 动作补偿操作MC Motion Compensation Operation
T1~T8、S1~S8 时点T1~T8, S1~S8 time points
具体实施方式Detailed ways
请参考图1,图1为本发明实施例一高效能视频编码装置1的示意图。如图1所示,高效能视频编码装置1包含有一排程模块10与一工作回圈模块LM。其中,排程模块10可用来接收多个输入帧信号,以对应产生一控制信号来判断每一输入帧信号进行一帧内编码操作或一帧内/帧间编码操作,及用来判断每一输入帧信号为一亮度帧信号或一色度帧信号。工作回圈模块LM耦接排程模块10,包含有一预估模块11、一离散余弦转换模块12、一量化模块13、一反量化模块14、一反离散余弦转换模块15与一像素重建模块16,且彼此为依序耦接,每一者可对应进行一像素预估操作/一动作补偿操作、一离散余弦转换操作、一量化操作、一反量化操作、一反离散余弦转换操作与一像素重建操作,而该些操作为本领域具通常知识者所熟知,为求简洁,不逐一详述。Please refer to FIG. 1 , which is a schematic diagram of a high-efficiency video encoding device 1 according to an embodiment of the present invention. As shown in FIG. 1 , the high-efficiency video encoding device 1 includes a scheduling module 10 and a working loop module LM. Wherein, the scheduling module 10 can be used to receive a plurality of input frame signals, to generate a corresponding control signal to judge each input frame signal to perform an intra-frame coding operation or an intra-frame/inter-frame coding operation, and to judge each input frame signal The input frame signal is a luma frame signal or a chrominance frame signal. The working loop module LM is coupled to the scheduling module 10, and includes an estimation module 11, a discrete cosine transform module 12, a quantization module 13, an inverse quantization module 14, an inverse discrete cosine transform module 15 and a pixel reconstruction module 16 , and are sequentially coupled to each other, each of which can correspondingly perform a pixel estimation operation/a motion compensation operation, a discrete cosine transform operation, a quantization operation, an inverse quantization operation, an inverse discrete cosine transform operation and a pixel Reconstruction operations, and these operations are well known to those skilled in the art, for the sake of brevity, they are not described in detail one by one.
此外,量化模块13还耦接一转传单元17,用来接收并输出量化模块13所产生的一剩余信号至一帧内亮度暂存器或一帧内色度暂存器(图中未示),而像素重建模块16也耦接另一转传单元18,用来接收并输出像素重建模块16的一重建信号至另一帧内亮度暂存器或另一帧内色度暂存器(图中未示),使得暂存于帧内亮度暂存器或帧内色度暂存器内的相关信号可作为高效率视频编码装置1其他操作的需求;前述接收剩余信号的帧内亮度暂存器与接收重建信号的另一帧内亮度暂存器不限于个别独立的暂存器,亦有可能为同一存储器的不同暂存区块,同理,帧内色度暂存器亦同。再者,预估模块11、离散余弦转换模块12、量化模块13、反量化模块14、反离散余弦转换模块15与像素重建模块16皆包含有一剖析器(parser),可用来接收排程模块10所产生的控制信号,以对应判断目前已接收至少一输入帧信号进行帧内编码操作或帧内/帧间编码操作,同时,还可用来判断输入帧信号为亮度帧信号或色度帧信号。In addition, the quantization module 13 is also coupled to a transfer unit 17 for receiving and outputting a residual signal generated by the quantization module 13 to an intra-frame luminance register or an intra-frame chrominance register (not shown in the figure ), and the pixel reconstruction module 16 is also coupled to another transfer unit 18 for receiving and outputting a reconstruction signal of the pixel reconstruction module 16 to another intra-frame luminance register or another intra-frame chrominance register ( not shown in the figure), so that the relevant signals temporarily stored in the intra-frame luminance register or the intra-frame chrominance register can be used as the requirements for other operations of the high-efficiency video encoding device 1; The register and another intra-frame luminance register receiving the reconstructed signal are not limited to individual independent registers, and may also be different register blocks of the same memory. Similarly, the intra-frame chrominance register is the same. Moreover, the estimation module 11 , the DCT module 12 , the quantization module 13 , the inverse quantization module 14 , the inverse discrete cosine transformation module 15 and the pixel reconstruction module 16 all include a parser (parser), which can be used to receive the scheduling module 10 The generated control signal is used to determine whether at least one input frame signal has been received for intra-frame coding or intra-frame/inter-frame coding, and can also be used to determine whether the input frame signal is a luma frame signal or a chrominance frame signal.
值得注意地,本实施例中的每一帧输入信号包含有多个亮度帧信号与多个色度帧信号,每一亮度帧信号与每一色度帧信号对应为一矩阵信号,且每一亮度帧信号与每一色度帧信号皆包含有已编号的多个子亮度帧信号与多个子色度帧信号,而编号方式可为一Z型编码(如其后的图4所示),然其非用以限制本发明的范畴。在此情况下,本实施例中的高效能视频编码装置1先透过排程模块10来判断所接收的输入帧信号将进行帧内编码操作或帧内/帧间编码操作,同时判断输入帧信号为亮度帧信号或色度帧信号,并将以上的判断结果输出为控制信号且传输至工作回圈模块LM,进而对多个子亮度帧信号与多个子色度帧信号进行一第一编码操作与一第二编码操作,其中第一编码操作依序进行像素预估操作、离散余弦转换操作、量化操作、反量化操作、反离散余弦转换操作与像素重建操作,而第二编码操作依序进行动作补偿操作、离散余弦转换操作、量化操作、反量化操作、反离散余弦转换操作与像素重建操作,至于详细的操作方式将于以下段落详述。It is worth noting that each frame input signal in this embodiment includes a plurality of luminance frame signals and a plurality of chrominance frame signals, and each luminance frame signal and each chrominance frame signal correspond to a matrix signal, and each luminance frame signal The frame signal and each chrominance frame signal all include a plurality of numbered sub-luminance frame signals and a plurality of sub-chrominance frame signals, and the numbering method can be a Z-type code (as shown in Figure 4 thereafter), but it is not used To limit the scope of the present invention. In this case, the high-efficiency video encoding device 1 in this embodiment first judges that the received input frame signal will be subjected to an intra-frame encoding operation or an intra-frame/inter-frame encoding operation through the scheduling module 10, and at the same time determines whether the input frame signal The signal is a luminance frame signal or a chrominance frame signal, and the above judgment result is output as a control signal and transmitted to the working loop module LM, and then a first encoding operation is performed on a plurality of sub-luminance frame signals and a plurality of sub-chrominance frame signals and a second encoding operation, wherein the first encoding operation sequentially performs a pixel estimation operation, a discrete cosine transform operation, a quantization operation, an inverse quantization operation, an inverse discrete cosine transform operation, and a pixel reconstruction operation, and the second encoding operation performs sequentially The operation of motion compensation, discrete cosine transform, quantization, inverse quantization, inverse discrete cosine transform and pixel reconstruction will be detailed in the following paragraphs.
进一步地,本实施例高效能视频编码装置1所适用的排程方法可归纳为一排程流程20,且被编译为一程序码而储存于高效能视频编码装置1的一储存装置中,并由高效能视频编码装置1的一处理器模块来对应进行,进而控制排程模块10与工作回圈模块LM的相关操作,如图2所示,排程流程20包含以下步骤。Further, the scheduling method applicable to the high-efficiency video encoding device 1 of this embodiment can be summarized into a scheduling process 20, which is compiled into a program code and stored in a storage device of the high-efficiency video encoding device 1, and A processor module of the high-efficiency video encoding device 1 performs corresponding operations, and then controls related operations of the scheduling module 10 and the working loop module LM. As shown in FIG. 2 , the scheduling process 20 includes the following steps.
步骤200:开始。Step 200: start.
步骤202:排程模块10接收多个输入帧信号,以对应产生控制信号来判断每一输入帧信号进行帧内编码操作或帧内/帧间编码操作;若判断进行帧内编码操作,进行步骤204,若判断进行帧内/帧间编码操作,进行步骤206。Step 202: The scheduling module 10 receives a plurality of input frame signals, and generates a control signal correspondingly to determine whether each input frame signal performs an intra-frame encoding operation or an intra-frame/inter-frame encoding operation; if it is determined to perform an intra-frame encoding operation, proceed to the step 204. If it is determined that the intra-frame/inter-frame coding operation is performed, go to step 206.
步骤204:当排程模块10判断进行帧内编码操作时,高效率视频编码装置1依序对每一亮度帧信号的多个子亮度帧信号中一者与每一色度帧信号的多个子色度帧信号中一者进行第一编码操作。Step 204: When the scheduling module 10 determines to perform an intra-frame encoding operation, the high-efficiency video encoding device 1 sequentially performs one of the plurality of sub-luminance frame signals of each luma frame signal and the plurality of sub-chrominance sub-chroma of each chrominance frame signal One of the frame signals undergoes a first encoding operation.
步骤206:当排程模块10判断进行帧内/帧间编码操作时,高效率视频编码装置1于每一工作周期内依序对多个帧信号的多者进行第一编码操作与第二编码操作。Step 206: When the scheduling module 10 determines to perform the intra-frame/inter-frame coding operation, the high-efficiency video coding device 1 sequentially performs the first coding operation and the second coding operation on multiple frame signals in each working cycle operate.
本实施例中排程流程20所对应的程序码,可对应储存于排程模块10、预估模块11、离散余弦转换模块12、量化模块13、反量化模块14、反离散余弦转换模块15与像素重建模块16(甚至是转传单元17、18)中,以提升高效能视频编码装置1的处理效能,然非用以限制本发明的范畴。此外,本实施例中的每一工作周期是每一输入帧信号中单一亮度帧信号或单一色度帧信号进行第一编码操作中任一操作或第二编码操作中任一操作所对应的一时间,举例来说,每一工作周期可理解为一最短时间间隔,以让预估模块11、离散余弦转换模块12、量化模块13、反量化模块14、反离散余弦转换模块15与像素重建模块16中任一者对单一亮度帧信号(或单一色度帧信号)皆能完成其相关操作,据此,根据所接收输入帧信号的多寡,将使得第一编码操作与第二编码操作可对应多个工作周期且为依序排列。The program code corresponding to the scheduling process 20 in this embodiment can be correspondingly stored in the scheduling module 10, the estimation module 11, the discrete cosine transformation module 12, the quantization module 13, the inverse quantization module 14, the inverse discrete cosine transformation module 15 and the The pixel reconstruction module 16 (even the transfer units 17, 18) is used to improve the processing performance of the high-performance video encoding device 1, but it is not intended to limit the scope of the present invention. In addition, each duty cycle in this embodiment is a period corresponding to any operation in the first encoding operation or any operation in the second encoding operation for a single luminance frame signal or a single chrominance frame signal in each input frame signal. Time, for example, each duty cycle can be understood as a minimum time interval, so that the estimation module 11, the discrete cosine transform module 12, the quantization module 13, the inverse quantization module 14, the inverse discrete cosine transform module 15 and the pixel reconstruction module Any one of 16 can complete its related operations on a single luminance frame signal (or a single chrominance frame signal). Accordingly, according to the amount of received input frame signals, the first encoding operation and the second encoding operation can be made to correspond Multiple work cycles and are arranged sequentially.
于步骤202中,排程模块10根据所接收的多个输入帧信号,对应产生控制信号来判断进行步骤204(即进行帧内编码操作)或进行步骤206(即进行帧内/帧间编码操作),当然,根据不同需求,本领域具通常知识者亦可将步骤202所对应的判断机制拆成两个部分,以独立判断是否要进行帧内编码操作且独立判断是否要进行帧内/帧间编码操作,在此情况下,步骤202所对应的程序码将可区分为两个子程序码来独立进行操作,或是依序先后进行该两者所对应的程序码的判断操作,以上非用以限制本发明的范畴)。至于步骤204与步骤206的操作内容还可进一步归纳为一帧内编码流程30或一帧内/帧间编码流程60,详细说明可参考以下段落。In step 202, the scheduling module 10 generates a corresponding control signal according to the received multiple input frame signals to determine whether to proceed to step 204 (i.e. perform intra-frame encoding operation) or to perform step 206 (i.e. perform intra-frame/inter-frame encoding operation) ), of course, according to different needs, those skilled in the art can also split the judging mechanism corresponding to step 202 into two parts, so as to independently judge whether to perform intra-frame coding operation and independently judge whether to perform intra-frame/frame In this case, the program code corresponding to step 202 can be divided into two subroutine codes to operate independently, or the judgment operation of the program codes corresponding to the two subroutines can be performed sequentially. to limit the scope of the present invention). The operation content of step 204 and step 206 can be further summarized into an intra-frame encoding process 30 or an intra-frame/inter-frame encoding process 60 , and details can be referred to the following paragraphs.
本实施例中帧内编码流程30还可编译为另一程序码,且储存于高效能视频编码装置1的储存装置中,并由高效能视频编码装置1的处理器模块来对应进行,进而控制工作回圈模块LM的相关操作,如图3所示,帧内编码流程30包含以下步骤。In this embodiment, the intra-frame coding process 30 can also be compiled into another program code, and stored in the storage device of the high-performance video coding device 1, and correspondingly executed by the processor module of the high-performance video coding device 1, and then controlled The relevant operations of the working loop module LM, as shown in FIG. 3 , the intra-frame encoding process 30 includes the following steps.
步骤300:开始。Step 300: start.
步骤302:于一第一工作周期,高效率视频编码装置1对第一子亮度帧信号进行一第一操作。Step 302: In a first duty cycle, the high-efficiency video encoding device 1 performs a first operation on the first sub-luminance frame signal.
步骤304:于第一工作周期后的一第二工作周期,高效率视频编码装置1对第一子色度帧信号进行第一操作,同时高效率视频编码装置1对第一子亮度帧信号进行一第二操作。Step 304: In a second working period after the first working period, the high-efficiency video encoding device 1 performs the first operation on the first sub-chroma frame signal, and at the same time, the high-efficiency video encoding device 1 performs the first operation on the first sub-luminance frame signal a second operation.
步骤306:于第二工作周期后的一第三工作周期,高效率视频编码装置1对第一子色度帧信号进行第二操作。Step 306: In a third working period after the second working period, the high-efficiency video encoding device 1 performs a second operation on the first sub-chrominance frame signal.
步骤308:结束。Step 308: end.
本实施例根据工作回圈模块LM所接收的控制信号与输入帧信号,以对应启动用于工作回圈模块LM的帧内编码流程30。此外,排程模块10一并将多个输入帧信号对应的亮度帧信号或色度帧信号的判断结果告知工作回圈模块LM,以让工作回圈模块LM依序对亮度帧信号的多个子亮度帧信号与色度帧信号的多个子色度帧信号进行第一编码操作。In this embodiment, according to the control signal received by the working loop module LM and the input frame signal, the intra-frame encoding process 30 for the working loop module LM is correspondingly started. In addition, the scheduling module 10 notifies the working loop module LM of the judging results of the luminance frame signals or chrominance frame signals corresponding to the multiple input frame signals, so that the working loop module LM sequentially processes the multiple sub-frame signals of the luminance frame signals. A first encoding operation is performed on the luma frame signal and the plurality of sub-chroma frame signals of the chroma frame signal.
举例来说,于本实施例中,若亮度帧信号包含有第一子亮度帧信号且色度帧信号包含有第一子色度帧信号,排程模块10依序接收第一子亮度帧信号与第一子色度帧信号,而第一操作与第二操作依序为编码操作的像素预估操作、离散余弦转换操作、量化操作、反量化操作、反离散余弦转换操作与像素重建操作中连续两者。在此情况下,于步骤302中,高效率视频编码装置1r工作回圈模块LM将对第一子亮度帧信号进行第一操作;步骤304中,于第一工作周期后r第二工作周期,工作回圈模块LM将对第一子色度帧信号进行第一操作,同时工作回圈模块LM还对第二子亮度帧信号进行第二操作;步骤306中,于第二工作周期后的第三工作周期,工作回圈模块LM对第二子色度帧信号进行第二操作。For example, in this embodiment, if the luma frame signal includes the first sub-luminance frame signal and the chroma frame signal includes the first sub-chroma frame signal, the scheduling module 10 receives the first sub-luminance frame signal in sequence and the first sub-chroma frame signal, and the first operation and the second operation are the pixel estimation operation, the discrete cosine transform operation, the quantization operation, the inverse quantization operation, the inverse discrete cosine transform operation and the pixel reconstruction operation in the sequence of the encoding operation Both in a row. In this case, in step 302, the working loop module LM of the high-efficiency video coding device 1r will perform the first operation on the first sub-luminance frame signal; in step 304, after the first working period r second working period, The working loop module LM will perform the first operation on the first sub-chroma frame signal, and at the same time, the working loop module LM will also perform the second operation on the second sub-luminance frame signal; in step 306, after the second working cycle Three working cycles, the working loop module LM performs a second operation on the second sub-chroma frame signal.
换句话说,由于第一子亮度帧信号与第一子色度帧信号间不存在相互依存的参考关系,使得本实施例的帧内编码流程30可于单一工作周期内进行至少两个信号r第一编码操作,即步骤304中工作回圈模块LM对第一子色度帧信号进行第一操作与对第一子亮度帧信号进行第二操作,当然,本实施例中亮度帧信号所包含的子亮度帧信号与色度帧信号所包含的子色度帧信号的数量仅为示范性说明,而执行步骤304的次数亦可根据子亮度帧信号与子色度帧信号的数量来对应调整。据此,帧内编码流程30先进行子亮度帧信号的编码操作,并于下一个工作周期后,同时对子亮度帧信号与子色度帧信号进行第一编码操作,直到子色度帧信号完成第一编码操作后,再逐一完成剩下子亮度帧信号的第一编码操作。In other words, since there is no interdependent reference relationship between the first sub-luminance frame signal and the first sub-chroma frame signal, the intra-frame encoding process 30 of this embodiment can perform at least two signals r in a single working cycle. The first encoding operation, that is, the working loop module LM in step 304 performs the first operation on the first sub-chroma frame signal and the second operation on the first sub-luminance frame signal. Of course, the brightness frame signal contained in this embodiment The number of sub-chroma frame signals included in the sub-luminance frame signal and the chroma frame signal is only for exemplary illustration, and the number of times of performing step 304 can also be adjusted correspondingly according to the numbers of the sub-luminance frame signal and the sub-chroma frame signal . Accordingly, the intra-frame encoding process 30 first performs the encoding operation of the sub-luminance frame signal, and after the next working cycle, performs the first encoding operation on the sub-luminance frame signal and the sub-chroma frame signal at the same time until the sub-chroma frame signal After the first encoding operation is completed, the first encoding operations of the remaining sub-luminance frame signals are completed one by one.
举例来说,请参考图4,图4为本发明实施例一亮度帧信号S_L与多个色度帧信号S_Cb、S_Cr的示意图。本实施例中的亮度帧信号S_L包含有多个子亮度帧信号S_L_0~S_L_15(即分别编码为0~15),色度帧信号S_Cb包含有子色度帧信号S_Cb_16~S_Cb_19~(即分别编码为16~19),色度帧信号S_Cr包含有子色度帧信号S_Cr_20~S_Cr_23。另外,请参考图5,图5为图4实施例一亮度帧信号S_L与多个色度帧信号S_Cb、S_Cr所对应帧内编码操作的执行时间的示意图,其中,亮度帧信号与色度帧信号所进行的第一编码操作可标示为像素预估操作IAP、离散余弦转换操作DCT、量化操作Q、反量化操作IQ、反离散余弦转换操作IDCT与像素重建操作REC。For example, please refer to FIG. 4 , which is a schematic diagram of a luma frame signal S_L and a plurality of chrominance frame signals S_Cb and S_Cr according to an embodiment of the present invention. The luminance frame signal S_L in this embodiment includes a plurality of sub-luminance frame signals S_L_0~S_L_15 (that is, coded as 0~15 respectively), and the chroma frame signal S_Cb includes sub-chroma frame signals S_Cb_16~S_Cb_19~ (that is, coded as 16-19), the chroma frame signal S_Cr includes sub-chroma frame signals S_Cr_20-S_Cr_23. In addition, please refer to FIG. 5. FIG. 5 is a schematic diagram of the execution time of the intra-frame encoding operation corresponding to the luma frame signal S_L and the multiple chrominance frame signals S_Cb and S_Cr in the embodiment of FIG. 4, wherein the luma frame signal and the chroma frame signals The first encoding operation performed on the signal can be denoted as pixel estimation operation IAP, discrete cosine transform operation DCT, quantization operation Q, inverse quantization operation IQ, inverse discrete cosine transform operation IDCT, and pixel reconstruction operation REC.
据此,于一第一时点T1,由子亮度帧信号S_L_0进行像素预估操作IAP;于一第二时点T2,由子亮度帧信号S_L_0进行离散余弦转换操作DCT,同时,子色度帧信号S_Cb_16还进行像素预估操作IAP;于一第三时点T3到一第六时点T6,子亮度帧信号S_L_0接续进行量化操作Q、反量化操作IQ、反离散余弦转换操作IDCT与像素重建操作REC,同时,子色度帧信号S_Cb_16还进行离散余弦转换操作DCT、量化操作Q、反量化操作IQ与反离散余弦转换操作IDCT,并于第六时点T6结束时,子亮度帧信号S_L_0已完成第一编码操作,而其对应的编码结果可暂存于亮度暂存器(图中未示)中,并轮到子亮度帧信号S_L_1开始进行相关编码操作,即于一第七时点T7,子亮度帧信号S_L_1进行像素预估操作IAP,而子色度帧信号S_Cb_16还进行像素重建操作REC,如此,子色度帧信号S_Cb_16也完成其第一编码操作,同样地,其对应的编码结果也可暂存于色度暂存器(图中未示)中。据此,一第八时点T8之后每六个时点的操作方式,则重复第二时点T2到第七时点T7的操作方式,以同时对子亮度帧信号S_L_1~S_L_15与子色度帧信号S_Cb_17~S_Cb_19、S_Cr_20~S_Cr_23进行编码操作,直到子色度帧信号S_Cr_23先完成第一编码操作后,工作回圈模块LM才于接下来的每一时点逐一完成剩余子亮度帧信号的第一编码操作。Accordingly, at a first time point T1, the pixel estimation operation IAP is performed by the sub-luminance frame signal S_L_0; at a second time point T2, the discrete cosine transform operation DCT is performed by the sub-luminance frame signal S_L_0, and at the same time, the sub-chrominance frame signal S_Cb_16 also performs the pixel estimation operation IAP; from a third time point T3 to a sixth time point T6, the sub-luminance frame signal S_L_0 successively performs quantization operation Q, inverse quantization operation IQ, inverse discrete cosine transform operation IDCT and pixel reconstruction operation REC, at the same time, sub-chroma frame signal S_Cb_16 also performs discrete cosine transform operation DCT, quantization operation Q, inverse quantization operation IQ and inverse discrete cosine transform operation IDCT, and at the end of the sixth time point T6, sub-luminance frame signal S_L_0 has been The first encoding operation is completed, and the corresponding encoding result can be temporarily stored in the luminance register (not shown in the figure), and it is the turn of the sub-luminance frame signal S_L_1 to start the related encoding operation, that is, at a seventh time point T7 , the sub-luminance frame signal S_L_1 performs the pixel estimation operation IAP, and the sub-chroma frame signal S_Cb_16 also performs the pixel reconstruction operation REC, so that the sub-chroma frame signal S_Cb_16 also completes its first encoding operation, and similarly, its corresponding encoding The result can also be temporarily stored in a chroma register (not shown in the figure). Accordingly, the operation mode of every six time points after the eighth time point T8 is repeated from the second time point T2 to the seventh time point T7, so as to simultaneously control the sub-luminance frame signals S_L_1~S_L_15 and the sub-chroma Frame signals S_Cb_17~S_Cb_19, S_Cr_20~S_Cr_23 carry out the encoding operation until the sub-chroma frame signal S_Cr_23 completes the first encoding operation, and the working loop module LM completes the second encoding operation of the remaining sub-luminance frame signals one by one at each subsequent time point. An encoding operation.
再者,本实施例中帧内/帧间编码操作所对应的一帧内/帧间编码流程60还可编译为另一程序码,且储存于高效能视频编码装置1的储存装置中,并由高效能视频编码装置1的处理器模块来对应进行,进而控制工作回圈模块LM的相关操作,如图6所示,帧内/帧间编码流程60包含以下步骤。Furthermore, an intra/inter coding process 60 corresponding to the intra/inter coding operation in this embodiment can also be compiled into another program code, and stored in the storage device of the high-performance video coding device 1, and The processor module of the high-efficiency video coding device 1 performs corresponding operations, and then controls the related operations of the working loop module LM. As shown in FIG. 6 , the intra/inter coding process 60 includes the following steps.
步骤600:开始。Step 600: start.
步骤602:于第一工作周期,高效率视频编码装置1对多个输入帧信号中的一第一输入帧信号进行第一编码操作且持续六个工作周期。Step 602: During the first working period, the high-efficiency video encoding device 1 performs a first encoding operation on a first input frame signal among the plurality of input frame signals and lasts for six working periods.
步骤604:于第一工作周期后的第二工作周期,高效率视频编码装置1对多个帧信号中的一第二输入帧信号进行第二编码操作且持续六个工作周期。Step 604: In the second working period after the first working period, the high-efficiency video encoding device 1 performs a second encoding operation on a second input frame signal among the plurality of frame signals and lasts for six working periods.
步骤606:重复步骤604来对第二输入帧信号的多个子亮度帧信号与多个子色度帧信号进行第二编码操作,且继续进行第一输入帧信号的第一编码操作。Step 606 : Repeat step 604 to perform a second encoding operation on the sub-luminance frame signals and the plurality of sub-chrominance frame signals of the second input frame signal, and continue to perform the first encoding operation on the first input frame signal.
步骤608:结束。Step 608: end.
本实施例是根据工作回圈模块LM所接收的控制信号与输入帧信号,对应启动用于工作回圈模块LM的帧内/帧间编码流程60,此外,排程模块10还将多个输入帧信号对应的亮度帧信号或色度帧信号的判断结果告知工作回圈模块LM,以让工作回圈模块LM依序对多个帧信号进行第一编码操作与第二编码操作。例如,本实施例的排程模块10接收至少一第一输入帧信号与一第二输入帧信号,且第一输入帧信号与第二输入帧信号皆包含有多个亮度帧信号与多个色度帧信号,且排程模块10依序接收第一输入帧信号与第二输入帧信号。在此情况下,步骤602中,于第一工作周期,高效率视频编码装置1的工作回圈模块LM对第一输入帧信号进行第一编码操作且持续六个工作周期;步骤604中,于第一工作周期后的第二工作周期,工作回圈模块LM将对第二输入帧信号进行第二编码操作且持续六个工作周期;步骤606中,重复步骤604的相关操作来对第二输入帧信号的多个子亮度帧信号与多个子色度帧信号进行第二编码操作,且继续进行第一输入帧信号的第一编码操作。In this embodiment, according to the control signal received by the working loop module LM and the input frame signal, the intra-frame/inter-frame encoding process 60 for the working loop module LM is correspondingly started. In addition, the scheduling module 10 also has multiple input The determination result of the luminance frame signal or the chrominance frame signal corresponding to the frame signal is notified to the working loop module LM, so that the working loop module LM sequentially performs the first encoding operation and the second encoding operation on the plurality of frame signals. For example, the scheduling module 10 of this embodiment receives at least one first input frame signal and one second input frame signal, and both the first input frame signal and the second input frame signal include a plurality of brightness frame signals and a plurality of color frame signals, and the scheduling module 10 sequentially receives the first input frame signal and the second input frame signal. In this case, in step 602, in the first working cycle, the working loop module LM of the high-efficiency video encoding device 1 performs the first encoding operation on the first input frame signal and lasts for six working cycles; in step 604, in In the second working cycle after the first working cycle, the working cycle module LM will perform the second encoding operation on the second input frame signal and last for six working cycles; in step 606, repeat the related operations of step 604 to encode the second input The plurality of sub-luminance frame signals and the plurality of sub-chrominance frame signals of the frame signal are subjected to a second encoding operation, and the first encoding operation of the first input frame signal is continued.
换言之,由于第一输入帧信号与第二输入帧信号间不存在相互依存的参考关系,使得本实施例中的帧内/帧间编码流程60可于单一工作周期内进行至少两个输入帧信号的第一编码操作与第二编码,即帧内/帧间编码流程60所进行的操作可理解为于完成第二输入帧信号的多个子亮度帧信号与多个子色度帧信号的第二编码操作之前,于每一工作周期,工作回圈模块LM同时对第一输入帧信号进行第一编码操作且对第二输入帧信号进行第二编码操作;一旦完成第二输入帧信号的多个子亮度帧信号与多个子色度帧信号的第二编码操作后,于之后的每一工作周期,工作回圈模块LM仅对第一输入帧信号进行第一编码操作。据此,本实施例中帧内/帧间编码流程60先于第一个工作周期进行第一输入帧信号的第一编码操作,于下一个工作周期时,除了持续对第一输入帧信号进行第一编码操作外,同时还对第二输入帧信号进行第二编码操作且持续多个工作周期,直到第二输入帧信号完成第二编码操作,则恢复进行第一输入帧信号的第一编码操作,直到完成第一输入帧信号的第一编码操作后,帧内/帧间编码流程60即可终止。当然,本实施例中执行步骤606的次数还可根据多个输入帧信号所包含的子亮度帧信号与子色度帧信号的数量来进行调整,非用以限制本发明的范畴。In other words, since there is no interdependent reference relationship between the first input frame signal and the second input frame signal, the intra/inter coding process 60 in this embodiment can perform at least two input frame signals in a single working cycle. The first encoding operation and the second encoding, that is, the operation performed by the intra/inter encoding process 60 can be understood as completing the second encoding of the multiple sub-luminance frame signals and the multiple sub-chrominance frame signals of the second input frame signal Before operation, in each working cycle, the working loop module LM simultaneously performs the first encoding operation on the first input frame signal and the second encoding operation on the second input frame signal; once the multiple sub-brightness of the second input frame signal is completed After the second encoding operation of the frame signal and the plurality of sub-chroma frame signals, the working loop module LM only performs the first encoding operation on the first input frame signal in each working cycle thereafter. Accordingly, in this embodiment, the intra-frame/inter-frame encoding process 60 performs the first encoding operation of the first input frame signal prior to the first working cycle, and in the next working cycle, in addition to continuously performing the first input frame signal In addition to the first encoding operation, the second encoding operation is performed on the second input frame signal at the same time and lasts for multiple work cycles, until the second input frame signal completes the second encoding operation, then the first encoding of the first input frame signal is resumed Operation, until the first encoding operation of the first input frame signal is completed, the intra-frame/inter-frame encoding process 60 can be terminated. Of course, the number of executions of step 606 in this embodiment can also be adjusted according to the number of sub-luminance frame signals and sub-chrominance frame signals included in the plurality of input frame signals, which is not intended to limit the scope of the present invention.
请参考图7,图7为本发明实施例中多个输入帧信号的亮度帧信号S_L0、S_L1所对应帧内/帧间编码操作的执行时间的示意图,其中,本实施例中仅绘出工作回圈模块LM所接收的亮度帧信号S_L0、S_L1,亮度帧信号S_L0、S_L1包含有多个子亮度帧信号S_L0_0~S_L0_15、S_L1_0~S_L1_15(即分别编码为0~15),当然,本实施例的工作回圈模块LM也同时接收多个输入帧信号的多个色度帧信号,不过为了简洁说明,以下仅利用子亮度帧信号来代表当前包含已存在多个输入帧信号,然非用以限制本发明的范畴。于本实施例的一第一时点S1到一第六时点S6,由子亮度帧信号S_L0_0依序进行第一编码操作(即像素预估操作IAP、离散余弦转换操作DCT、量化操作Q、反量化操作IQ与反离散余弦转换操作IDCT与像素重建操作REC);于一第二时点S2到一第七时点S7,由子亮度帧信号S_L1_0依序进行第二编码操作(即动作补偿操作MC、离散余弦转换操作DCT、量化操作Q、反量化操作IQ与反离散余弦转换操作IDCT与像素重建操作REC);类似地,于第三时点S3到第五时点S5,由子亮度帧信号S_L1_1~S_L1_3依序进行第二编码操作且持续六个时点,直到一第六时点S6,子亮度帧信号S_L_0完成其编码操作,并于一第七时点S7,由子亮度帧信号S_L0_1接着进行其第一编码操作。当亮度帧信号S_L1完成第二编码操作后,工作回圈模块LM接着继续对亮度帧信号S_L0进行第一编码操作,直到完成亮度帧信号S_L0的第一编码操作,才结束帧内/帧间编码流程60的相关操作。当然,于不同实施例中,还可适性加入不同输入帧信号的多个色度帧信号的操作时点于图7实施例亮度帧信号S_L0、S_L1的操作时点后,或者根据不同需求来对应安排该些色度帧信号的操作时点于工作回圈模块LM的硬件资源的等待时点上,此亦属于本发明的范畴。Please refer to FIG. 7. FIG. 7 is a schematic diagram of the execution time of the intra-frame/inter-frame coding operations corresponding to the brightness frame signals S_L0 and S_L1 of the multiple input frame signals in the embodiment of the present invention. In this embodiment, only the working The luminance frame signals S_L0, S_L1 received by the loop module LM, the luminance frame signals S_L0, S_L1 include a plurality of sub-luminance frame signals S_L0_0~S_L0_15, S_L1_0~S_L1_15 (that is, coded as 0~15 respectively), of course, the The working loop module LM also receives multiple chrominance frame signals of multiple input frame signals at the same time. However, for the sake of brevity, the following only uses the sub-luminance frame signal to represent the existing multiple input frame signals, but it is not used to limit scope of the invention. From a first time point S1 to a sixth time point S6 in this embodiment, the sub-luminance frame signal S_L0_0 sequentially performs the first encoding operation (i.e. pixel prediction operation IAP, discrete cosine transform operation DCT, quantization operation Q, inverse Quantization operation IQ and inverse discrete cosine transform operation IDCT and pixel reconstruction operation REC); From a second time point S2 to a seventh time point S7, the second encoding operation (that is, the motion compensation operation MC) is performed sequentially from the sub-luminance frame signal S_L1_0 , discrete cosine transform operation DCT, quantization operation Q, inverse quantization operation IQ and inverse discrete cosine transform operation IDCT and pixel reconstruction operation REC); similarly, from the third time point S3 to the fifth time point S5, the sub-brightness frame signal S_L1_1 ~S_L1_3 performs the second coding operation in sequence and lasts for six time points, until a sixth time point S6, the sub-luminance frame signal S_L_0 completes its coding operation, and at a seventh time point S7, the sub-luminance frame signal S_L0_1 continues Its first encoding operation. After the luminance frame signal S_L1 completes the second encoding operation, the working loop module LM then continues to perform the first encoding operation on the luminance frame signal S_L0 until the first encoding operation of the luminance frame signal S_L0 is completed, and then the intra/inter-frame encoding is completed Related operations of process 60. Of course, in different embodiments, the operating timing of multiple chrominance frame signals of different input frame signals can also be adaptively added after the operating timing of the luma frame signals S_L0 and S_L1 in the embodiment in FIG. 7 , or according to different requirements. Correspondingly arranging the operation timing of the chrominance frame signals at the waiting timing of the hardware resources of the working loop module LM also belongs to the scope of the present invention.
相较于已知技术,本实施例中的帧内编码流程30与帧内/帧间编码流程60可控制工作回圈模块LM的多个组成模块来同时进行不同输入帧信号的子亮度帧信号或子色度帧信号的第一/第二编码操作,以充分利用原先习知技术中工作回圈模块LM的多个组成模块所耗费的等待时间,进而大幅提高高效能视频编码装置1的执行效率。再者,本实施例还新增转传单元17、18以及帧内亮度暂存器、帧内色度暂存器的操作方式,也可大幅提升高效能视频编码装置1的应用空间。Compared with the known technology, the intra-frame encoding process 30 and the intra-frame/inter-frame encoding process 60 in this embodiment can control multiple components of the working loop module LM to simultaneously perform sub-luminance frame signals of different input frame signals Or the first/second encoding operation of the sub-chroma frame signal, so as to make full use of the waiting time spent by the multiple components of the working loop module LM in the prior known technology, and then greatly improve the execution of the high-efficiency video encoding device 1 efficiency. Furthermore, the present embodiment also adds operation modes of the transfer units 17 and 18 and the intra-frame luma register and the intra-frame chrominance register, which can also greatly increase the application space of the high-efficiency video encoding device 1 .
需注意的是,本发明是透过调整进行帧内输入信号的编码操作的排程顺序,以对应提高处理效率。本领域具通常知识者可根据前述实施例做适当的变化,而不限于此。举例来说,请参考图8,图8为排程模块10的一实施例的示意图。如图8所示,排程模块10可包含一帧内亮度工作伫列、一帧内色度工作伫列、一帧间工作伫列及一逻辑模块。逻辑模块用以判断帧信号间的依附关系,决定启动或输出帧内亮度工作伫列、帧内色度工作伫列或帧间工作伫列的内容,进而输出控制信号至工作回圈模块LM。工作回圈模块LM接收到排程模块10的控制信号后,即可进行对应编码操作。第8图是说明排程模块10的实施方式的一,本领域具通常知识者可根据系统所需适当调整,而不限于此。It should be noted that the present invention improves the processing efficiency by adjusting the scheduling sequence of the encoding operation of the intra-frame input signal. Those skilled in the art can make appropriate changes according to the foregoing embodiments, but are not limited thereto. For example, please refer to FIG. 8 , which is a schematic diagram of an embodiment of the scheduling module 10 . As shown in FIG. 8 , the scheduling module 10 may include an intra-frame luma job queue, an intra-frame chroma job queue, an inter-frame job queue and a logic module. The logic module is used for judging the dependency relationship between frame signals, deciding to start or output the contents of intra-frame luminance work queue, intra-frame chroma work queue or inter-frame work queue, and then output control signals to the work loop module LM. After the working loop module LM receives the control signal from the scheduling module 10, it can perform the corresponding encoding operation. FIG. 8 is an illustration of one implementation of the scheduling module 10 , and those skilled in the art can make appropriate adjustments according to the needs of the system, and are not limited thereto.
综上所述,本发明实施例是教导一种用于高效能视频编码装置的排程方法,透过排程模块及其对应的剖析器,以判断目前输入帧信号欲进行帧内编码操作或帧内/帧间编码操作,并对应传输控制信号至工作回圈模块的预估模块、离散余弦转换模块、量化模块、反量化模块、反离散余弦转换模块与像素重建模块,以分别对不同输入帧信号的亮度帧信号与色度帧信号进行相关编码操作,进而节省已知技术中硬体资源所浪费的等待时间。In summary, the embodiment of the present invention teaches a scheduling method for a high-efficiency video encoding device. Through the scheduling module and its corresponding analyzer, it is determined whether the current input frame signal is to be intra-frame encoded or not. Intra-frame/inter-frame coding operations, and correspondingly transmit control signals to the estimation module, discrete cosine transformation module, quantization module, inverse quantization module, inverse discrete cosine transformation module and pixel reconstruction module of the working loop module, to respectively perform different input The luminance frame signal and the chrominance frame signal of the frame signal are correlated with encoding operation, thereby saving the waiting time wasted by hardware resources in the prior art.
以上所述仅为本发明的较佳实施例,凡依本发明申请专利范围所做的均等变化与修饰,皆应属本发明的涵盖范围。The above descriptions are only preferred embodiments of the present invention, and all equivalent changes and modifications made according to the scope of the patent application of the present invention shall fall within the scope of the present invention.
Claims (19)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710043756.8A CN108337507A (en) | 2017-01-19 | 2017-01-19 | Scheduling method for high efficiency video coding device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710043756.8A CN108337507A (en) | 2017-01-19 | 2017-01-19 | Scheduling method for high efficiency video coding device |
Publications (1)
Publication Number | Publication Date |
---|---|
CN108337507A true CN108337507A (en) | 2018-07-27 |
Family
ID=62922730
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710043756.8A Pending CN108337507A (en) | 2017-01-19 | 2017-01-19 | Scheduling method for high efficiency video coding device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN108337507A (en) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5719628A (en) * | 1993-02-25 | 1998-02-17 | Nec Corporation | Video signal coding method and apparatus |
CN1536531A (en) * | 2003-04-10 | 2004-10-13 | ������������ʽ���� | Image processing device, image processing method, and image processing program |
CN1652605A (en) * | 2003-12-30 | 2005-08-10 | 三星电子株式会社 | Video codecs, data processing systems and methods for the same |
CN102143361A (en) * | 2011-01-12 | 2011-08-03 | 浙江大学 | Video coding method and video coding device |
US20140118388A1 (en) * | 2012-10-30 | 2014-05-01 | Pixtronix, Inc. | Display apparatus employing frame specific composite contributing colors |
TW201622420A (en) * | 2014-12-11 | 2016-06-16 | 上海兆芯集成電路有限公司 | Advanced video coding and decoding chip and advanced video coding and decoding method |
-
2017
- 2017-01-19 CN CN201710043756.8A patent/CN108337507A/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5719628A (en) * | 1993-02-25 | 1998-02-17 | Nec Corporation | Video signal coding method and apparatus |
CN1536531A (en) * | 2003-04-10 | 2004-10-13 | ������������ʽ���� | Image processing device, image processing method, and image processing program |
CN1652605A (en) * | 2003-12-30 | 2005-08-10 | 三星电子株式会社 | Video codecs, data processing systems and methods for the same |
CN102143361A (en) * | 2011-01-12 | 2011-08-03 | 浙江大学 | Video coding method and video coding device |
US20140118388A1 (en) * | 2012-10-30 | 2014-05-01 | Pixtronix, Inc. | Display apparatus employing frame specific composite contributing colors |
TW201622420A (en) * | 2014-12-11 | 2016-06-16 | 上海兆芯集成電路有限公司 | Advanced video coding and decoding chip and advanced video coding and decoding method |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR101184244B1 (en) | Parallel batch decoding of video blocks | |
US8472527B2 (en) | Hierarchical motion estimation using original frame for sub-sampled reference | |
US12184840B2 (en) | Intra/inter mode decision for predictive frame encoding | |
US8238427B2 (en) | Rate distortion optimized adaptive intra refresh for video coding | |
US8213511B2 (en) | Video encoder software architecture for VLIW cores incorporating inter prediction and intra prediction | |
CN100592796C (en) | A video encoder and its intra-frame prediction mode selection method | |
CN1652605B (en) | Video codecs, data processing systems and methods for the same | |
CN103747250B (en) | A kind of parallel intra-frame prediction method of H.264/AVC middle 4x4 sub-macroblock | |
CN105791829A (en) | A HEVC Parallel Intra Prediction Method Based on Multi-core Platform | |
CN1981533A (en) | Method and system for performing deblocking filtering | |
CN109391816B (en) | Parallel processing method of entropy coding in HEVC based on CPU+GPU heterogeneous platform | |
CN1272931A (en) | Image processor | |
CN112422986B (en) | Hardware decoder pipeline optimization method and application | |
CN101902643B (en) | A VLSI Structure Design Method for Parallel Array Intra Prediction Decoder | |
CN108337507A (en) | Scheduling method for high efficiency video coding device | |
WO2024098821A1 (en) | Av1 filtering method and apparatus | |
CN101170692B (en) | Multi-view image encoding and decoding method and encoder and decoder | |
TWI617181B (en) | Scheduling method for high efficiency video coding apparatus | |
US8284836B2 (en) | Motion compensation method and apparatus to perform parallel processing on macroblocks in a video decoding system | |
CN102186082B (en) | H.264 protocol based optimized decoding method for intra-frame coding compression technology | |
US11750800B1 (en) | Encoder and associated signal processing method | |
CN101854535B (en) | Embedded Video Encoder Quantization Method | |
CN119383354B (en) | Coding system, method, chip, and electronic device | |
Wang et al. | Dynamic macroblock wavefront parallelism for parallel video coding | |
US20090006664A1 (en) | Linked DMA Transfers in Video CODECS |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20200413 Address after: No.1, Duhang 1st Road, Hsinchu City, Hsinchu Science Park, Taiwan, China Applicant after: MEDIATEK Inc. Address before: 1/2, 4th floor, 26 Taiyuan Street, Zhubei City, Hsinchu County, Taiwan, China Applicant before: MStar Semiconductor, Inc. |
|
WD01 | Invention patent application deemed withdrawn after publication | ||
WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20180727 |