[go: up one dir, main page]

CN108337507A - Scheduling method for high efficiency video coding device - Google Patents

Scheduling method for high efficiency video coding device Download PDF

Info

Publication number
CN108337507A
CN108337507A CN201710043756.8A CN201710043756A CN108337507A CN 108337507 A CN108337507 A CN 108337507A CN 201710043756 A CN201710043756 A CN 201710043756A CN 108337507 A CN108337507 A CN 108337507A
Authority
CN
China
Prior art keywords
frame signal
frame
module
signal
sub
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710043756.8A
Other languages
Chinese (zh)
Inventor
谢镇宇
曾钰翔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
MediaTek Inc
Original Assignee
MStar Semiconductor Inc Taiwan
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by MStar Semiconductor Inc Taiwan filed Critical MStar Semiconductor Inc Taiwan
Priority to CN201710043756.8A priority Critical patent/CN108337507A/en
Publication of CN108337507A publication Critical patent/CN108337507A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/107Selection of coding mode or of prediction mode between spatial and temporal predictive coding, e.g. picture refresh
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/124Quantisation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/186Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/625Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using discrete cosine transform [DCT]

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Discrete Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

The invention relates to a scheduling method, used for a high-efficiency video coding device, the scheduling method comprises a scheduling module of the high-efficiency video coding device receives a plurality of input frame signals to correspondingly generate a control signal to judge whether each input frame signal carries out an intra-frame/inter-frame coding operation; and when the control signal is determined to perform the intra/inter coding operation, the high efficiency video coding apparatus sequentially performs the first coding operation and a second coding operation on a plurality of frame signals within each duty cycle, wherein each duty cycle performs a time corresponding to any one of the first coding operation or any one of the second coding operation on a single luminance frame signal or a single chrominance frame signal in each input frame signal.

Description

用于高效率视频编码装置的排程方法Scheduling method for high-efficiency video encoding device

技术领域technical field

本发明指一种高效率视频编码装置的排程方法,尤指一种可适性调整进行帧内输入信号的编码操作的排程顺序,以提高高效率视频编码装置的处理效率的排程方法。The present invention refers to a scheduling method for a high-efficiency video encoding device, especially a scheduling method for adaptively adjusting the scheduling sequence of encoding operations for intra-frame input signals to improve the processing efficiency of a high-efficiency video encoding device .

背景技术Background technique

传统上,高效率视频编码装置可接收包含有多个输入帧信号的影音数据,且每一帧输入信号包含有多个亮度帧信号与多个色度帧信号,且每一亮度帧信号与每一色度帧信号对应为一矩阵信号,使得每一亮度帧信号与每一色度帧信号皆包含有已编号的多个子亮度帧信号与已编号的多个子色度帧信号。由于每一子亮度帧信号或每一子色度帧信号间有依附关系,即编码后一者的子亮度帧信号或子色度帧信号需参考编码前一者的子亮度帧信号或子色度帧信号的编码结果,据此,当高效率视频编码装置欲进行一帧内编码操作时,由于高效率视频编码装置需逐一对子亮度帧信号或子色度帧信号进行所对应的编码操作(例如一像素预估操作、一离散余弦转换操作、一量化操作、一反量化操作、一反离散余弦转换操作与一像素重建操作),其将造成大部分的硬件资源处于一等待输入信号的情况,而其硬件排程无法被有效利用。另外,当高效率视频编码装置欲进行一帧内/帧间编码操作时,现有的高效率视频编码装置仍必须逐一进行多个输入帧信号的编码操作,而对于硬件资源的排程也同样缺乏效率。Traditionally, a high-efficiency video encoding device can receive audio-visual data including a plurality of input frame signals, and each frame input signal includes a plurality of luma frame signals and a plurality of chroma frame signals, and each luma frame signal and each A chrominance frame signal corresponds to a matrix signal, so that each luminance frame signal and each chrominance frame signal include a plurality of numbered sub-luminance frame signals and a number of numbered sub-chrominance frame signals. Since each sub-brightness frame signal or each sub-chrominance frame signal has a dependency relationship, that is, the sub-brightness frame signal or sub-chrominance frame signal of the latter needs to refer to the sub-brightness frame signal or sub-color frame signal of the former. Therefore, when the high-efficiency video encoding device intends to perform an intra-frame encoding operation, the high-efficiency video encoding device needs to perform corresponding encoding operations on the sub-luminance frame signals or sub-chrominance frame signals one by one (such as a pixel estimation operation, a discrete cosine transform operation, a quantization operation, an inverse quantization operation, an inverse discrete cosine transform operation, and a pixel reconstruction operation), which will cause most of the hardware resources to be in a waiting input signal situation, and its hardware scheduling cannot be effectively utilized. In addition, when the high-efficiency video coding device intends to perform an intra-frame/inter-frame coding operation, the existing high-efficiency video coding device still has to perform coding operations on multiple input frame signals one by one, and the scheduling of hardware resources is also the same Lack of efficiency.

因此,提供一种用于高效率视频编码装置的排程方法,以提高高效率视频编码装置进行帧内编码操作与帧内/帧间编码操作的处理效率,已成为本领域的重要课题。Therefore, it has become an important subject in the art to provide a scheduling method for a high-efficiency video encoding device to improve the processing efficiency of the intra-frame encoding operation and intra-frame/inter-frame encoding operation performed by the high-efficiency video encoding device.

发明内容Contents of the invention

因此,本发明的主要目的即在于提供一种可适性调整进行帧内输入信号的编码操作的排程顺序,以对应提高高效率视频编码装置的处理效率。Therefore, the main objective of the present invention is to provide an adaptively adjustable scheduling sequence for encoding operations of intra-frame input signals, so as to correspondingly improve the processing efficiency of a high-efficiency video encoding device.

本发明揭示一种排程方法,用于一高效率视频编码装置,该排程方法包含有由该高效率视频编码装置的一排程模块接收多个输入帧信号,以对应产生一控制信号来判断每一输入帧信号是否进行一帧内/帧间编码操作,并由该排程模块判断每一输入帧信号为一亮度帧信号或一色度帧信号;以及当该控制信号被判断来进行该帧内/帧间编码操作时,该高效率视频编码装置于每一工作周期内依序对多个帧信号的多者进行一第一编码操作与一第二编码操作;其中,该第一编码操作依序进行一像素预估操作、一离散余弦转换操作、一量化操作、一反量化操作、一反离散余弦转换操作与一像素重建操作,该第二编码操作是依序进行一动作补偿操作、该离散余弦转换操作、该量化操作、该反量化操作、该反离散余弦转换操作与该像素重建操作,而每一工作周期是每一输入帧信号中单一亮度帧信号或单一色度帧信号进行该第一编码操作中任一操作或该第二编码操作中任一操作所对应的一时间。The present invention discloses a scheduling method for a high-efficiency video coding device. The scheduling method includes receiving a plurality of input frame signals by a scheduling module of the high-efficiency video coding device to generate a control signal correspondingly. judging whether an intra-frame/inter-frame coding operation is performed on each input frame signal, and judging by the scheduling module whether each input frame signal is a luma frame signal or a chrominance frame signal; and when the control signal is judged to perform the During the intra-frame/inter-frame coding operation, the high-efficiency video coding device sequentially performs a first coding operation and a second coding operation on a plurality of frame signals in each working cycle; wherein, the first coding The operation sequentially performs a pixel estimation operation, a discrete cosine transform operation, a quantization operation, an inverse quantization operation, an inverse discrete cosine transform operation and a pixel reconstruction operation, and the second encoding operation is a motion compensation operation in sequence , the discrete cosine transform operation, the quantization operation, the inverse quantization operation, the inverse discrete cosine transform operation and the pixel reconstruction operation, and each duty cycle is a single luma frame signal or a single chrominance frame signal in each input frame signal A time corresponding to any operation in the first encoding operation or any operation in the second encoding operation is performed.

本发明另揭示一种高效率视频编码装置,包含有一排程模块,用来接收多个输入帧信号,以对应产生一控制信号来判断每一输入帧信号是否进行一帧内/帧间编码操作,及用来判断每一输入帧信号为一亮度帧信号或一色度帧信号;以及一工作回圈模块,耦接该排程模块,包含有一预估模块、一离散余弦转换模块、一量化模块、一反量化模块、一反离散余弦转换模块与一像素重建模块且彼此为依序耦接;其中,当该控制信号被判断来进行该帧内/帧间编码操作时,该工作回圈模块于每一工作周期内依序对该多个帧信号的多者进行该第一编码操作与一第二编码操作,该第一编码操作依序进行一像素预估操作、一离散余弦转换操作、一量化操作、一反量化操作、一反离散余弦转换操作与一像素重建操作,该第二编码操作依序进行一动作补偿操作、该离散余弦转换操作、该量化操作、该反量化操作、该反离散余弦转换操作与该像素重建操作,而每一工作周期是每一输入帧信号中单一亮度帧信号或单一色度帧信号进行该第一编码操作中任一操作或该第二编码操作中任一操作所对应的一时间。The present invention also discloses a high-efficiency video encoding device, which includes a scheduling module for receiving a plurality of input frame signals and correspondingly generating a control signal to determine whether an intra-frame/inter-frame encoding operation is performed on each input frame signal , and used to determine whether each input frame signal is a luminance frame signal or a chrominance frame signal; and a working loop module, coupled to the scheduling module, including an estimation module, a discrete cosine transform module, and a quantization module , an inverse quantization module, an inverse discrete cosine transform module, and a pixel reconstruction module are sequentially coupled to each other; wherein, when the control signal is judged to perform the intra-frame/inter-frame coding operation, the working loop module The first encoding operation and a second encoding operation are sequentially performed on the plurality of frame signals in each working cycle, and the first encoding operation sequentially performs a pixel estimation operation, a discrete cosine transform operation, A quantization operation, an inverse quantization operation, an inverse discrete cosine transform operation, and a pixel reconstruction operation, the second encoding operation sequentially performs a motion compensation operation, the discrete cosine transform operation, the quantization operation, the inverse quantization operation, the The inverse discrete cosine transform operation and the pixel reconstruction operation, and each duty cycle is that a single luminance frame signal or a single chrominance frame signal in each input frame signal performs either operation in the first encoding operation or in the second encoding operation A time corresponding to any operation.

附图说明Description of drawings

图1为本发明实施例一高效能视频编码装置的示意图。FIG. 1 is a schematic diagram of a high-efficiency video encoding device according to an embodiment of the present invention.

图2为本发明实施例一排程流程的流程图。FIG. 2 is a flow chart of a scheduling process according to an embodiment of the present invention.

图3为本发明实施例一帧内编码流程的流程图。FIG. 3 is a flowchart of an intra-frame encoding process according to an embodiment of the present invention.

图4为本发明实施例一亮度帧信号与多个色度帧信号的示意图。FIG. 4 is a schematic diagram of a luma frame signal and a plurality of chrominance frame signals according to an embodiment of the present invention.

图5为图4实施例一亮度帧信号与多个色度帧信号所对应帧内编码操作的执行时间的示意图。FIG. 5 is a schematic diagram of execution time of intra-frame encoding operations corresponding to a luma frame signal and a plurality of chrominance frame signals according to the embodiment of FIG. 4 .

图6为本发明实施例一帧内/帧间编码流程的流程图。FIG. 6 is a flowchart of an intra-frame/inter-frame encoding process according to an embodiment of the present invention.

图7为本发明实施例中多个输入帧信号的亮度帧信号所对应帧内/帧间编码操作的执行时间的示意图。FIG. 7 is a schematic diagram of execution time of intra-frame/inter-frame coding operations corresponding to luma frame signals of multiple input frame signals in an embodiment of the present invention.

图8为图1中一排程模块的一实施例的示意图。FIG. 8 is a schematic diagram of an embodiment of a scheduling module in FIG. 1 .

符号说明Symbol Description

1 高效能视频编码装置1 High-efficiency video encoding device

10 排程模块10 Scheduling Module

11 预估模块11 Estimation Module

12 离散余弦转换模块12 discrete cosine transform modules

13 量化模块13 quantization module

14 反量化模块14 Inverse quantization module

15 反离散余弦转换模块15 Inverse discrete cosine transform module

16 像素重建模块16 pixel reconstruction module

17、18 转传单元17, 18 transfer unit

20 排程流程20 Scheduling process

200、202、204、206、300、302、304、306、308、600、602、604、606、608 步骤200, 202, 204, 206, 300, 302, 304, 306, 308, 600, 602, 604, 606, 608 steps

30 帧内编码流程30 Intra-frame encoding process

60 帧内/帧间编码流程60 Intra/Inter coding process

LM 工作回圈模块LM working loop module

S_L 亮度帧信号S_L luminance frame signal

S_L_0~S_L_15 子亮度帧信号S_L_0~S_L_15 sub-luminance frame signal

S_Cb、S_Cr 色度帧信号S_Cb, S_Cr Chroma frame signal

S_Cb_16~S_Cb_19、S_Cr_20~S_Cr_23 子色度帧信号S_Cb_16~S_Cb_19, S_Cr_20~S_Cr_23 sub-chroma frame signal

IAP 像素预估操作IAP pixel estimation operation

DCT 离散余弦转换操作DCT discrete cosine transform operation

Q 量化操作Q quantization operation

IQ 反量化操作IQ dequantization operation

IDCT 反离散余弦转换操作IDCT inverse discrete cosine transform operation

REC 像素重建操作REC pixel reconstruction operation

MC 动作补偿操作MC Motion Compensation Operation

T1~T8、S1~S8 时点T1~T8, S1~S8 time points

具体实施方式Detailed ways

请参考图1,图1为本发明实施例一高效能视频编码装置1的示意图。如图1所示,高效能视频编码装置1包含有一排程模块10与一工作回圈模块LM。其中,排程模块10可用来接收多个输入帧信号,以对应产生一控制信号来判断每一输入帧信号进行一帧内编码操作或一帧内/帧间编码操作,及用来判断每一输入帧信号为一亮度帧信号或一色度帧信号。工作回圈模块LM耦接排程模块10,包含有一预估模块11、一离散余弦转换模块12、一量化模块13、一反量化模块14、一反离散余弦转换模块15与一像素重建模块16,且彼此为依序耦接,每一者可对应进行一像素预估操作/一动作补偿操作、一离散余弦转换操作、一量化操作、一反量化操作、一反离散余弦转换操作与一像素重建操作,而该些操作为本领域具通常知识者所熟知,为求简洁,不逐一详述。Please refer to FIG. 1 , which is a schematic diagram of a high-efficiency video encoding device 1 according to an embodiment of the present invention. As shown in FIG. 1 , the high-efficiency video encoding device 1 includes a scheduling module 10 and a working loop module LM. Wherein, the scheduling module 10 can be used to receive a plurality of input frame signals, to generate a corresponding control signal to judge each input frame signal to perform an intra-frame coding operation or an intra-frame/inter-frame coding operation, and to judge each input frame signal The input frame signal is a luma frame signal or a chrominance frame signal. The working loop module LM is coupled to the scheduling module 10, and includes an estimation module 11, a discrete cosine transform module 12, a quantization module 13, an inverse quantization module 14, an inverse discrete cosine transform module 15 and a pixel reconstruction module 16 , and are sequentially coupled to each other, each of which can correspondingly perform a pixel estimation operation/a motion compensation operation, a discrete cosine transform operation, a quantization operation, an inverse quantization operation, an inverse discrete cosine transform operation and a pixel Reconstruction operations, and these operations are well known to those skilled in the art, for the sake of brevity, they are not described in detail one by one.

此外,量化模块13还耦接一转传单元17,用来接收并输出量化模块13所产生的一剩余信号至一帧内亮度暂存器或一帧内色度暂存器(图中未示),而像素重建模块16也耦接另一转传单元18,用来接收并输出像素重建模块16的一重建信号至另一帧内亮度暂存器或另一帧内色度暂存器(图中未示),使得暂存于帧内亮度暂存器或帧内色度暂存器内的相关信号可作为高效率视频编码装置1其他操作的需求;前述接收剩余信号的帧内亮度暂存器与接收重建信号的另一帧内亮度暂存器不限于个别独立的暂存器,亦有可能为同一存储器的不同暂存区块,同理,帧内色度暂存器亦同。再者,预估模块11、离散余弦转换模块12、量化模块13、反量化模块14、反离散余弦转换模块15与像素重建模块16皆包含有一剖析器(parser),可用来接收排程模块10所产生的控制信号,以对应判断目前已接收至少一输入帧信号进行帧内编码操作或帧内/帧间编码操作,同时,还可用来判断输入帧信号为亮度帧信号或色度帧信号。In addition, the quantization module 13 is also coupled to a transfer unit 17 for receiving and outputting a residual signal generated by the quantization module 13 to an intra-frame luminance register or an intra-frame chrominance register (not shown in the figure ), and the pixel reconstruction module 16 is also coupled to another transfer unit 18 for receiving and outputting a reconstruction signal of the pixel reconstruction module 16 to another intra-frame luminance register or another intra-frame chrominance register ( not shown in the figure), so that the relevant signals temporarily stored in the intra-frame luminance register or the intra-frame chrominance register can be used as the requirements for other operations of the high-efficiency video encoding device 1; The register and another intra-frame luminance register receiving the reconstructed signal are not limited to individual independent registers, and may also be different register blocks of the same memory. Similarly, the intra-frame chrominance register is the same. Moreover, the estimation module 11 , the DCT module 12 , the quantization module 13 , the inverse quantization module 14 , the inverse discrete cosine transformation module 15 and the pixel reconstruction module 16 all include a parser (parser), which can be used to receive the scheduling module 10 The generated control signal is used to determine whether at least one input frame signal has been received for intra-frame coding or intra-frame/inter-frame coding, and can also be used to determine whether the input frame signal is a luma frame signal or a chrominance frame signal.

值得注意地,本实施例中的每一帧输入信号包含有多个亮度帧信号与多个色度帧信号,每一亮度帧信号与每一色度帧信号对应为一矩阵信号,且每一亮度帧信号与每一色度帧信号皆包含有已编号的多个子亮度帧信号与多个子色度帧信号,而编号方式可为一Z型编码(如其后的图4所示),然其非用以限制本发明的范畴。在此情况下,本实施例中的高效能视频编码装置1先透过排程模块10来判断所接收的输入帧信号将进行帧内编码操作或帧内/帧间编码操作,同时判断输入帧信号为亮度帧信号或色度帧信号,并将以上的判断结果输出为控制信号且传输至工作回圈模块LM,进而对多个子亮度帧信号与多个子色度帧信号进行一第一编码操作与一第二编码操作,其中第一编码操作依序进行像素预估操作、离散余弦转换操作、量化操作、反量化操作、反离散余弦转换操作与像素重建操作,而第二编码操作依序进行动作补偿操作、离散余弦转换操作、量化操作、反量化操作、反离散余弦转换操作与像素重建操作,至于详细的操作方式将于以下段落详述。It is worth noting that each frame input signal in this embodiment includes a plurality of luminance frame signals and a plurality of chrominance frame signals, and each luminance frame signal and each chrominance frame signal correspond to a matrix signal, and each luminance frame signal The frame signal and each chrominance frame signal all include a plurality of numbered sub-luminance frame signals and a plurality of sub-chrominance frame signals, and the numbering method can be a Z-type code (as shown in Figure 4 thereafter), but it is not used To limit the scope of the present invention. In this case, the high-efficiency video encoding device 1 in this embodiment first judges that the received input frame signal will be subjected to an intra-frame encoding operation or an intra-frame/inter-frame encoding operation through the scheduling module 10, and at the same time determines whether the input frame signal The signal is a luminance frame signal or a chrominance frame signal, and the above judgment result is output as a control signal and transmitted to the working loop module LM, and then a first encoding operation is performed on a plurality of sub-luminance frame signals and a plurality of sub-chrominance frame signals and a second encoding operation, wherein the first encoding operation sequentially performs a pixel estimation operation, a discrete cosine transform operation, a quantization operation, an inverse quantization operation, an inverse discrete cosine transform operation, and a pixel reconstruction operation, and the second encoding operation performs sequentially The operation of motion compensation, discrete cosine transform, quantization, inverse quantization, inverse discrete cosine transform and pixel reconstruction will be detailed in the following paragraphs.

进一步地,本实施例高效能视频编码装置1所适用的排程方法可归纳为一排程流程20,且被编译为一程序码而储存于高效能视频编码装置1的一储存装置中,并由高效能视频编码装置1的一处理器模块来对应进行,进而控制排程模块10与工作回圈模块LM的相关操作,如图2所示,排程流程20包含以下步骤。Further, the scheduling method applicable to the high-efficiency video encoding device 1 of this embodiment can be summarized into a scheduling process 20, which is compiled into a program code and stored in a storage device of the high-efficiency video encoding device 1, and A processor module of the high-efficiency video encoding device 1 performs corresponding operations, and then controls related operations of the scheduling module 10 and the working loop module LM. As shown in FIG. 2 , the scheduling process 20 includes the following steps.

步骤200:开始。Step 200: start.

步骤202:排程模块10接收多个输入帧信号,以对应产生控制信号来判断每一输入帧信号进行帧内编码操作或帧内/帧间编码操作;若判断进行帧内编码操作,进行步骤204,若判断进行帧内/帧间编码操作,进行步骤206。Step 202: The scheduling module 10 receives a plurality of input frame signals, and generates a control signal correspondingly to determine whether each input frame signal performs an intra-frame encoding operation or an intra-frame/inter-frame encoding operation; if it is determined to perform an intra-frame encoding operation, proceed to the step 204. If it is determined that the intra-frame/inter-frame coding operation is performed, go to step 206.

步骤204:当排程模块10判断进行帧内编码操作时,高效率视频编码装置1依序对每一亮度帧信号的多个子亮度帧信号中一者与每一色度帧信号的多个子色度帧信号中一者进行第一编码操作。Step 204: When the scheduling module 10 determines to perform an intra-frame encoding operation, the high-efficiency video encoding device 1 sequentially performs one of the plurality of sub-luminance frame signals of each luma frame signal and the plurality of sub-chrominance sub-chroma of each chrominance frame signal One of the frame signals undergoes a first encoding operation.

步骤206:当排程模块10判断进行帧内/帧间编码操作时,高效率视频编码装置1于每一工作周期内依序对多个帧信号的多者进行第一编码操作与第二编码操作。Step 206: When the scheduling module 10 determines to perform the intra-frame/inter-frame coding operation, the high-efficiency video coding device 1 sequentially performs the first coding operation and the second coding operation on multiple frame signals in each working cycle operate.

本实施例中排程流程20所对应的程序码,可对应储存于排程模块10、预估模块11、离散余弦转换模块12、量化模块13、反量化模块14、反离散余弦转换模块15与像素重建模块16(甚至是转传单元17、18)中,以提升高效能视频编码装置1的处理效能,然非用以限制本发明的范畴。此外,本实施例中的每一工作周期是每一输入帧信号中单一亮度帧信号或单一色度帧信号进行第一编码操作中任一操作或第二编码操作中任一操作所对应的一时间,举例来说,每一工作周期可理解为一最短时间间隔,以让预估模块11、离散余弦转换模块12、量化模块13、反量化模块14、反离散余弦转换模块15与像素重建模块16中任一者对单一亮度帧信号(或单一色度帧信号)皆能完成其相关操作,据此,根据所接收输入帧信号的多寡,将使得第一编码操作与第二编码操作可对应多个工作周期且为依序排列。The program code corresponding to the scheduling process 20 in this embodiment can be correspondingly stored in the scheduling module 10, the estimation module 11, the discrete cosine transformation module 12, the quantization module 13, the inverse quantization module 14, the inverse discrete cosine transformation module 15 and the The pixel reconstruction module 16 (even the transfer units 17, 18) is used to improve the processing performance of the high-performance video encoding device 1, but it is not intended to limit the scope of the present invention. In addition, each duty cycle in this embodiment is a period corresponding to any operation in the first encoding operation or any operation in the second encoding operation for a single luminance frame signal or a single chrominance frame signal in each input frame signal. Time, for example, each duty cycle can be understood as a minimum time interval, so that the estimation module 11, the discrete cosine transform module 12, the quantization module 13, the inverse quantization module 14, the inverse discrete cosine transform module 15 and the pixel reconstruction module Any one of 16 can complete its related operations on a single luminance frame signal (or a single chrominance frame signal). Accordingly, according to the amount of received input frame signals, the first encoding operation and the second encoding operation can be made to correspond Multiple work cycles and are arranged sequentially.

于步骤202中,排程模块10根据所接收的多个输入帧信号,对应产生控制信号来判断进行步骤204(即进行帧内编码操作)或进行步骤206(即进行帧内/帧间编码操作),当然,根据不同需求,本领域具通常知识者亦可将步骤202所对应的判断机制拆成两个部分,以独立判断是否要进行帧内编码操作且独立判断是否要进行帧内/帧间编码操作,在此情况下,步骤202所对应的程序码将可区分为两个子程序码来独立进行操作,或是依序先后进行该两者所对应的程序码的判断操作,以上非用以限制本发明的范畴)。至于步骤204与步骤206的操作内容还可进一步归纳为一帧内编码流程30或一帧内/帧间编码流程60,详细说明可参考以下段落。In step 202, the scheduling module 10 generates a corresponding control signal according to the received multiple input frame signals to determine whether to proceed to step 204 (i.e. perform intra-frame encoding operation) or to perform step 206 (i.e. perform intra-frame/inter-frame encoding operation) ), of course, according to different needs, those skilled in the art can also split the judging mechanism corresponding to step 202 into two parts, so as to independently judge whether to perform intra-frame coding operation and independently judge whether to perform intra-frame/frame In this case, the program code corresponding to step 202 can be divided into two subroutine codes to operate independently, or the judgment operation of the program codes corresponding to the two subroutines can be performed sequentially. to limit the scope of the present invention). The operation content of step 204 and step 206 can be further summarized into an intra-frame encoding process 30 or an intra-frame/inter-frame encoding process 60 , and details can be referred to the following paragraphs.

本实施例中帧内编码流程30还可编译为另一程序码,且储存于高效能视频编码装置1的储存装置中,并由高效能视频编码装置1的处理器模块来对应进行,进而控制工作回圈模块LM的相关操作,如图3所示,帧内编码流程30包含以下步骤。In this embodiment, the intra-frame coding process 30 can also be compiled into another program code, and stored in the storage device of the high-performance video coding device 1, and correspondingly executed by the processor module of the high-performance video coding device 1, and then controlled The relevant operations of the working loop module LM, as shown in FIG. 3 , the intra-frame encoding process 30 includes the following steps.

步骤300:开始。Step 300: start.

步骤302:于一第一工作周期,高效率视频编码装置1对第一子亮度帧信号进行一第一操作。Step 302: In a first duty cycle, the high-efficiency video encoding device 1 performs a first operation on the first sub-luminance frame signal.

步骤304:于第一工作周期后的一第二工作周期,高效率视频编码装置1对第一子色度帧信号进行第一操作,同时高效率视频编码装置1对第一子亮度帧信号进行一第二操作。Step 304: In a second working period after the first working period, the high-efficiency video encoding device 1 performs the first operation on the first sub-chroma frame signal, and at the same time, the high-efficiency video encoding device 1 performs the first operation on the first sub-luminance frame signal a second operation.

步骤306:于第二工作周期后的一第三工作周期,高效率视频编码装置1对第一子色度帧信号进行第二操作。Step 306: In a third working period after the second working period, the high-efficiency video encoding device 1 performs a second operation on the first sub-chrominance frame signal.

步骤308:结束。Step 308: end.

本实施例根据工作回圈模块LM所接收的控制信号与输入帧信号,以对应启动用于工作回圈模块LM的帧内编码流程30。此外,排程模块10一并将多个输入帧信号对应的亮度帧信号或色度帧信号的判断结果告知工作回圈模块LM,以让工作回圈模块LM依序对亮度帧信号的多个子亮度帧信号与色度帧信号的多个子色度帧信号进行第一编码操作。In this embodiment, according to the control signal received by the working loop module LM and the input frame signal, the intra-frame encoding process 30 for the working loop module LM is correspondingly started. In addition, the scheduling module 10 notifies the working loop module LM of the judging results of the luminance frame signals or chrominance frame signals corresponding to the multiple input frame signals, so that the working loop module LM sequentially processes the multiple sub-frame signals of the luminance frame signals. A first encoding operation is performed on the luma frame signal and the plurality of sub-chroma frame signals of the chroma frame signal.

举例来说,于本实施例中,若亮度帧信号包含有第一子亮度帧信号且色度帧信号包含有第一子色度帧信号,排程模块10依序接收第一子亮度帧信号与第一子色度帧信号,而第一操作与第二操作依序为编码操作的像素预估操作、离散余弦转换操作、量化操作、反量化操作、反离散余弦转换操作与像素重建操作中连续两者。在此情况下,于步骤302中,高效率视频编码装置1r工作回圈模块LM将对第一子亮度帧信号进行第一操作;步骤304中,于第一工作周期后r第二工作周期,工作回圈模块LM将对第一子色度帧信号进行第一操作,同时工作回圈模块LM还对第二子亮度帧信号进行第二操作;步骤306中,于第二工作周期后的第三工作周期,工作回圈模块LM对第二子色度帧信号进行第二操作。For example, in this embodiment, if the luma frame signal includes the first sub-luminance frame signal and the chroma frame signal includes the first sub-chroma frame signal, the scheduling module 10 receives the first sub-luminance frame signal in sequence and the first sub-chroma frame signal, and the first operation and the second operation are the pixel estimation operation, the discrete cosine transform operation, the quantization operation, the inverse quantization operation, the inverse discrete cosine transform operation and the pixel reconstruction operation in the sequence of the encoding operation Both in a row. In this case, in step 302, the working loop module LM of the high-efficiency video coding device 1r will perform the first operation on the first sub-luminance frame signal; in step 304, after the first working period r second working period, The working loop module LM will perform the first operation on the first sub-chroma frame signal, and at the same time, the working loop module LM will also perform the second operation on the second sub-luminance frame signal; in step 306, after the second working cycle Three working cycles, the working loop module LM performs a second operation on the second sub-chroma frame signal.

换句话说,由于第一子亮度帧信号与第一子色度帧信号间不存在相互依存的参考关系,使得本实施例的帧内编码流程30可于单一工作周期内进行至少两个信号r第一编码操作,即步骤304中工作回圈模块LM对第一子色度帧信号进行第一操作与对第一子亮度帧信号进行第二操作,当然,本实施例中亮度帧信号所包含的子亮度帧信号与色度帧信号所包含的子色度帧信号的数量仅为示范性说明,而执行步骤304的次数亦可根据子亮度帧信号与子色度帧信号的数量来对应调整。据此,帧内编码流程30先进行子亮度帧信号的编码操作,并于下一个工作周期后,同时对子亮度帧信号与子色度帧信号进行第一编码操作,直到子色度帧信号完成第一编码操作后,再逐一完成剩下子亮度帧信号的第一编码操作。In other words, since there is no interdependent reference relationship between the first sub-luminance frame signal and the first sub-chroma frame signal, the intra-frame encoding process 30 of this embodiment can perform at least two signals r in a single working cycle. The first encoding operation, that is, the working loop module LM in step 304 performs the first operation on the first sub-chroma frame signal and the second operation on the first sub-luminance frame signal. Of course, the brightness frame signal contained in this embodiment The number of sub-chroma frame signals included in the sub-luminance frame signal and the chroma frame signal is only for exemplary illustration, and the number of times of performing step 304 can also be adjusted correspondingly according to the numbers of the sub-luminance frame signal and the sub-chroma frame signal . Accordingly, the intra-frame encoding process 30 first performs the encoding operation of the sub-luminance frame signal, and after the next working cycle, performs the first encoding operation on the sub-luminance frame signal and the sub-chroma frame signal at the same time until the sub-chroma frame signal After the first encoding operation is completed, the first encoding operations of the remaining sub-luminance frame signals are completed one by one.

举例来说,请参考图4,图4为本发明实施例一亮度帧信号S_L与多个色度帧信号S_Cb、S_Cr的示意图。本实施例中的亮度帧信号S_L包含有多个子亮度帧信号S_L_0~S_L_15(即分别编码为0~15),色度帧信号S_Cb包含有子色度帧信号S_Cb_16~S_Cb_19~(即分别编码为16~19),色度帧信号S_Cr包含有子色度帧信号S_Cr_20~S_Cr_23。另外,请参考图5,图5为图4实施例一亮度帧信号S_L与多个色度帧信号S_Cb、S_Cr所对应帧内编码操作的执行时间的示意图,其中,亮度帧信号与色度帧信号所进行的第一编码操作可标示为像素预估操作IAP、离散余弦转换操作DCT、量化操作Q、反量化操作IQ、反离散余弦转换操作IDCT与像素重建操作REC。For example, please refer to FIG. 4 , which is a schematic diagram of a luma frame signal S_L and a plurality of chrominance frame signals S_Cb and S_Cr according to an embodiment of the present invention. The luminance frame signal S_L in this embodiment includes a plurality of sub-luminance frame signals S_L_0~S_L_15 (that is, coded as 0~15 respectively), and the chroma frame signal S_Cb includes sub-chroma frame signals S_Cb_16~S_Cb_19~ (that is, coded as 16-19), the chroma frame signal S_Cr includes sub-chroma frame signals S_Cr_20-S_Cr_23. In addition, please refer to FIG. 5. FIG. 5 is a schematic diagram of the execution time of the intra-frame encoding operation corresponding to the luma frame signal S_L and the multiple chrominance frame signals S_Cb and S_Cr in the embodiment of FIG. 4, wherein the luma frame signal and the chroma frame signals The first encoding operation performed on the signal can be denoted as pixel estimation operation IAP, discrete cosine transform operation DCT, quantization operation Q, inverse quantization operation IQ, inverse discrete cosine transform operation IDCT, and pixel reconstruction operation REC.

据此,于一第一时点T1,由子亮度帧信号S_L_0进行像素预估操作IAP;于一第二时点T2,由子亮度帧信号S_L_0进行离散余弦转换操作DCT,同时,子色度帧信号S_Cb_16还进行像素预估操作IAP;于一第三时点T3到一第六时点T6,子亮度帧信号S_L_0接续进行量化操作Q、反量化操作IQ、反离散余弦转换操作IDCT与像素重建操作REC,同时,子色度帧信号S_Cb_16还进行离散余弦转换操作DCT、量化操作Q、反量化操作IQ与反离散余弦转换操作IDCT,并于第六时点T6结束时,子亮度帧信号S_L_0已完成第一编码操作,而其对应的编码结果可暂存于亮度暂存器(图中未示)中,并轮到子亮度帧信号S_L_1开始进行相关编码操作,即于一第七时点T7,子亮度帧信号S_L_1进行像素预估操作IAP,而子色度帧信号S_Cb_16还进行像素重建操作REC,如此,子色度帧信号S_Cb_16也完成其第一编码操作,同样地,其对应的编码结果也可暂存于色度暂存器(图中未示)中。据此,一第八时点T8之后每六个时点的操作方式,则重复第二时点T2到第七时点T7的操作方式,以同时对子亮度帧信号S_L_1~S_L_15与子色度帧信号S_Cb_17~S_Cb_19、S_Cr_20~S_Cr_23进行编码操作,直到子色度帧信号S_Cr_23先完成第一编码操作后,工作回圈模块LM才于接下来的每一时点逐一完成剩余子亮度帧信号的第一编码操作。Accordingly, at a first time point T1, the pixel estimation operation IAP is performed by the sub-luminance frame signal S_L_0; at a second time point T2, the discrete cosine transform operation DCT is performed by the sub-luminance frame signal S_L_0, and at the same time, the sub-chrominance frame signal S_Cb_16 also performs the pixel estimation operation IAP; from a third time point T3 to a sixth time point T6, the sub-luminance frame signal S_L_0 successively performs quantization operation Q, inverse quantization operation IQ, inverse discrete cosine transform operation IDCT and pixel reconstruction operation REC, at the same time, sub-chroma frame signal S_Cb_16 also performs discrete cosine transform operation DCT, quantization operation Q, inverse quantization operation IQ and inverse discrete cosine transform operation IDCT, and at the end of the sixth time point T6, sub-luminance frame signal S_L_0 has been The first encoding operation is completed, and the corresponding encoding result can be temporarily stored in the luminance register (not shown in the figure), and it is the turn of the sub-luminance frame signal S_L_1 to start the related encoding operation, that is, at a seventh time point T7 , the sub-luminance frame signal S_L_1 performs the pixel estimation operation IAP, and the sub-chroma frame signal S_Cb_16 also performs the pixel reconstruction operation REC, so that the sub-chroma frame signal S_Cb_16 also completes its first encoding operation, and similarly, its corresponding encoding The result can also be temporarily stored in a chroma register (not shown in the figure). Accordingly, the operation mode of every six time points after the eighth time point T8 is repeated from the second time point T2 to the seventh time point T7, so as to simultaneously control the sub-luminance frame signals S_L_1~S_L_15 and the sub-chroma Frame signals S_Cb_17~S_Cb_19, S_Cr_20~S_Cr_23 carry out the encoding operation until the sub-chroma frame signal S_Cr_23 completes the first encoding operation, and the working loop module LM completes the second encoding operation of the remaining sub-luminance frame signals one by one at each subsequent time point. An encoding operation.

再者,本实施例中帧内/帧间编码操作所对应的一帧内/帧间编码流程60还可编译为另一程序码,且储存于高效能视频编码装置1的储存装置中,并由高效能视频编码装置1的处理器模块来对应进行,进而控制工作回圈模块LM的相关操作,如图6所示,帧内/帧间编码流程60包含以下步骤。Furthermore, an intra/inter coding process 60 corresponding to the intra/inter coding operation in this embodiment can also be compiled into another program code, and stored in the storage device of the high-performance video coding device 1, and The processor module of the high-efficiency video coding device 1 performs corresponding operations, and then controls the related operations of the working loop module LM. As shown in FIG. 6 , the intra/inter coding process 60 includes the following steps.

步骤600:开始。Step 600: start.

步骤602:于第一工作周期,高效率视频编码装置1对多个输入帧信号中的一第一输入帧信号进行第一编码操作且持续六个工作周期。Step 602: During the first working period, the high-efficiency video encoding device 1 performs a first encoding operation on a first input frame signal among the plurality of input frame signals and lasts for six working periods.

步骤604:于第一工作周期后的第二工作周期,高效率视频编码装置1对多个帧信号中的一第二输入帧信号进行第二编码操作且持续六个工作周期。Step 604: In the second working period after the first working period, the high-efficiency video encoding device 1 performs a second encoding operation on a second input frame signal among the plurality of frame signals and lasts for six working periods.

步骤606:重复步骤604来对第二输入帧信号的多个子亮度帧信号与多个子色度帧信号进行第二编码操作,且继续进行第一输入帧信号的第一编码操作。Step 606 : Repeat step 604 to perform a second encoding operation on the sub-luminance frame signals and the plurality of sub-chrominance frame signals of the second input frame signal, and continue to perform the first encoding operation on the first input frame signal.

步骤608:结束。Step 608: end.

本实施例是根据工作回圈模块LM所接收的控制信号与输入帧信号,对应启动用于工作回圈模块LM的帧内/帧间编码流程60,此外,排程模块10还将多个输入帧信号对应的亮度帧信号或色度帧信号的判断结果告知工作回圈模块LM,以让工作回圈模块LM依序对多个帧信号进行第一编码操作与第二编码操作。例如,本实施例的排程模块10接收至少一第一输入帧信号与一第二输入帧信号,且第一输入帧信号与第二输入帧信号皆包含有多个亮度帧信号与多个色度帧信号,且排程模块10依序接收第一输入帧信号与第二输入帧信号。在此情况下,步骤602中,于第一工作周期,高效率视频编码装置1的工作回圈模块LM对第一输入帧信号进行第一编码操作且持续六个工作周期;步骤604中,于第一工作周期后的第二工作周期,工作回圈模块LM将对第二输入帧信号进行第二编码操作且持续六个工作周期;步骤606中,重复步骤604的相关操作来对第二输入帧信号的多个子亮度帧信号与多个子色度帧信号进行第二编码操作,且继续进行第一输入帧信号的第一编码操作。In this embodiment, according to the control signal received by the working loop module LM and the input frame signal, the intra-frame/inter-frame encoding process 60 for the working loop module LM is correspondingly started. In addition, the scheduling module 10 also has multiple input The determination result of the luminance frame signal or the chrominance frame signal corresponding to the frame signal is notified to the working loop module LM, so that the working loop module LM sequentially performs the first encoding operation and the second encoding operation on the plurality of frame signals. For example, the scheduling module 10 of this embodiment receives at least one first input frame signal and one second input frame signal, and both the first input frame signal and the second input frame signal include a plurality of brightness frame signals and a plurality of color frame signals, and the scheduling module 10 sequentially receives the first input frame signal and the second input frame signal. In this case, in step 602, in the first working cycle, the working loop module LM of the high-efficiency video encoding device 1 performs the first encoding operation on the first input frame signal and lasts for six working cycles; in step 604, in In the second working cycle after the first working cycle, the working cycle module LM will perform the second encoding operation on the second input frame signal and last for six working cycles; in step 606, repeat the related operations of step 604 to encode the second input The plurality of sub-luminance frame signals and the plurality of sub-chrominance frame signals of the frame signal are subjected to a second encoding operation, and the first encoding operation of the first input frame signal is continued.

换言之,由于第一输入帧信号与第二输入帧信号间不存在相互依存的参考关系,使得本实施例中的帧内/帧间编码流程60可于单一工作周期内进行至少两个输入帧信号的第一编码操作与第二编码,即帧内/帧间编码流程60所进行的操作可理解为于完成第二输入帧信号的多个子亮度帧信号与多个子色度帧信号的第二编码操作之前,于每一工作周期,工作回圈模块LM同时对第一输入帧信号进行第一编码操作且对第二输入帧信号进行第二编码操作;一旦完成第二输入帧信号的多个子亮度帧信号与多个子色度帧信号的第二编码操作后,于之后的每一工作周期,工作回圈模块LM仅对第一输入帧信号进行第一编码操作。据此,本实施例中帧内/帧间编码流程60先于第一个工作周期进行第一输入帧信号的第一编码操作,于下一个工作周期时,除了持续对第一输入帧信号进行第一编码操作外,同时还对第二输入帧信号进行第二编码操作且持续多个工作周期,直到第二输入帧信号完成第二编码操作,则恢复进行第一输入帧信号的第一编码操作,直到完成第一输入帧信号的第一编码操作后,帧内/帧间编码流程60即可终止。当然,本实施例中执行步骤606的次数还可根据多个输入帧信号所包含的子亮度帧信号与子色度帧信号的数量来进行调整,非用以限制本发明的范畴。In other words, since there is no interdependent reference relationship between the first input frame signal and the second input frame signal, the intra/inter coding process 60 in this embodiment can perform at least two input frame signals in a single working cycle. The first encoding operation and the second encoding, that is, the operation performed by the intra/inter encoding process 60 can be understood as completing the second encoding of the multiple sub-luminance frame signals and the multiple sub-chrominance frame signals of the second input frame signal Before operation, in each working cycle, the working loop module LM simultaneously performs the first encoding operation on the first input frame signal and the second encoding operation on the second input frame signal; once the multiple sub-brightness of the second input frame signal is completed After the second encoding operation of the frame signal and the plurality of sub-chroma frame signals, the working loop module LM only performs the first encoding operation on the first input frame signal in each working cycle thereafter. Accordingly, in this embodiment, the intra-frame/inter-frame encoding process 60 performs the first encoding operation of the first input frame signal prior to the first working cycle, and in the next working cycle, in addition to continuously performing the first input frame signal In addition to the first encoding operation, the second encoding operation is performed on the second input frame signal at the same time and lasts for multiple work cycles, until the second input frame signal completes the second encoding operation, then the first encoding of the first input frame signal is resumed Operation, until the first encoding operation of the first input frame signal is completed, the intra-frame/inter-frame encoding process 60 can be terminated. Of course, the number of executions of step 606 in this embodiment can also be adjusted according to the number of sub-luminance frame signals and sub-chrominance frame signals included in the plurality of input frame signals, which is not intended to limit the scope of the present invention.

请参考图7,图7为本发明实施例中多个输入帧信号的亮度帧信号S_L0、S_L1所对应帧内/帧间编码操作的执行时间的示意图,其中,本实施例中仅绘出工作回圈模块LM所接收的亮度帧信号S_L0、S_L1,亮度帧信号S_L0、S_L1包含有多个子亮度帧信号S_L0_0~S_L0_15、S_L1_0~S_L1_15(即分别编码为0~15),当然,本实施例的工作回圈模块LM也同时接收多个输入帧信号的多个色度帧信号,不过为了简洁说明,以下仅利用子亮度帧信号来代表当前包含已存在多个输入帧信号,然非用以限制本发明的范畴。于本实施例的一第一时点S1到一第六时点S6,由子亮度帧信号S_L0_0依序进行第一编码操作(即像素预估操作IAP、离散余弦转换操作DCT、量化操作Q、反量化操作IQ与反离散余弦转换操作IDCT与像素重建操作REC);于一第二时点S2到一第七时点S7,由子亮度帧信号S_L1_0依序进行第二编码操作(即动作补偿操作MC、离散余弦转换操作DCT、量化操作Q、反量化操作IQ与反离散余弦转换操作IDCT与像素重建操作REC);类似地,于第三时点S3到第五时点S5,由子亮度帧信号S_L1_1~S_L1_3依序进行第二编码操作且持续六个时点,直到一第六时点S6,子亮度帧信号S_L_0完成其编码操作,并于一第七时点S7,由子亮度帧信号S_L0_1接着进行其第一编码操作。当亮度帧信号S_L1完成第二编码操作后,工作回圈模块LM接着继续对亮度帧信号S_L0进行第一编码操作,直到完成亮度帧信号S_L0的第一编码操作,才结束帧内/帧间编码流程60的相关操作。当然,于不同实施例中,还可适性加入不同输入帧信号的多个色度帧信号的操作时点于图7实施例亮度帧信号S_L0、S_L1的操作时点后,或者根据不同需求来对应安排该些色度帧信号的操作时点于工作回圈模块LM的硬件资源的等待时点上,此亦属于本发明的范畴。Please refer to FIG. 7. FIG. 7 is a schematic diagram of the execution time of the intra-frame/inter-frame coding operations corresponding to the brightness frame signals S_L0 and S_L1 of the multiple input frame signals in the embodiment of the present invention. In this embodiment, only the working The luminance frame signals S_L0, S_L1 received by the loop module LM, the luminance frame signals S_L0, S_L1 include a plurality of sub-luminance frame signals S_L0_0~S_L0_15, S_L1_0~S_L1_15 (that is, coded as 0~15 respectively), of course, the The working loop module LM also receives multiple chrominance frame signals of multiple input frame signals at the same time. However, for the sake of brevity, the following only uses the sub-luminance frame signal to represent the existing multiple input frame signals, but it is not used to limit scope of the invention. From a first time point S1 to a sixth time point S6 in this embodiment, the sub-luminance frame signal S_L0_0 sequentially performs the first encoding operation (i.e. pixel prediction operation IAP, discrete cosine transform operation DCT, quantization operation Q, inverse Quantization operation IQ and inverse discrete cosine transform operation IDCT and pixel reconstruction operation REC); From a second time point S2 to a seventh time point S7, the second encoding operation (that is, the motion compensation operation MC) is performed sequentially from the sub-luminance frame signal S_L1_0 , discrete cosine transform operation DCT, quantization operation Q, inverse quantization operation IQ and inverse discrete cosine transform operation IDCT and pixel reconstruction operation REC); similarly, from the third time point S3 to the fifth time point S5, the sub-brightness frame signal S_L1_1 ~S_L1_3 performs the second coding operation in sequence and lasts for six time points, until a sixth time point S6, the sub-luminance frame signal S_L_0 completes its coding operation, and at a seventh time point S7, the sub-luminance frame signal S_L0_1 continues Its first encoding operation. After the luminance frame signal S_L1 completes the second encoding operation, the working loop module LM then continues to perform the first encoding operation on the luminance frame signal S_L0 until the first encoding operation of the luminance frame signal S_L0 is completed, and then the intra/inter-frame encoding is completed Related operations of process 60. Of course, in different embodiments, the operating timing of multiple chrominance frame signals of different input frame signals can also be adaptively added after the operating timing of the luma frame signals S_L0 and S_L1 in the embodiment in FIG. 7 , or according to different requirements. Correspondingly arranging the operation timing of the chrominance frame signals at the waiting timing of the hardware resources of the working loop module LM also belongs to the scope of the present invention.

相较于已知技术,本实施例中的帧内编码流程30与帧内/帧间编码流程60可控制工作回圈模块LM的多个组成模块来同时进行不同输入帧信号的子亮度帧信号或子色度帧信号的第一/第二编码操作,以充分利用原先习知技术中工作回圈模块LM的多个组成模块所耗费的等待时间,进而大幅提高高效能视频编码装置1的执行效率。再者,本实施例还新增转传单元17、18以及帧内亮度暂存器、帧内色度暂存器的操作方式,也可大幅提升高效能视频编码装置1的应用空间。Compared with the known technology, the intra-frame encoding process 30 and the intra-frame/inter-frame encoding process 60 in this embodiment can control multiple components of the working loop module LM to simultaneously perform sub-luminance frame signals of different input frame signals Or the first/second encoding operation of the sub-chroma frame signal, so as to make full use of the waiting time spent by the multiple components of the working loop module LM in the prior known technology, and then greatly improve the execution of the high-efficiency video encoding device 1 efficiency. Furthermore, the present embodiment also adds operation modes of the transfer units 17 and 18 and the intra-frame luma register and the intra-frame chrominance register, which can also greatly increase the application space of the high-efficiency video encoding device 1 .

需注意的是,本发明是透过调整进行帧内输入信号的编码操作的排程顺序,以对应提高处理效率。本领域具通常知识者可根据前述实施例做适当的变化,而不限于此。举例来说,请参考图8,图8为排程模块10的一实施例的示意图。如图8所示,排程模块10可包含一帧内亮度工作伫列、一帧内色度工作伫列、一帧间工作伫列及一逻辑模块。逻辑模块用以判断帧信号间的依附关系,决定启动或输出帧内亮度工作伫列、帧内色度工作伫列或帧间工作伫列的内容,进而输出控制信号至工作回圈模块LM。工作回圈模块LM接收到排程模块10的控制信号后,即可进行对应编码操作。第8图是说明排程模块10的实施方式的一,本领域具通常知识者可根据系统所需适当调整,而不限于此。It should be noted that the present invention improves the processing efficiency by adjusting the scheduling sequence of the encoding operation of the intra-frame input signal. Those skilled in the art can make appropriate changes according to the foregoing embodiments, but are not limited thereto. For example, please refer to FIG. 8 , which is a schematic diagram of an embodiment of the scheduling module 10 . As shown in FIG. 8 , the scheduling module 10 may include an intra-frame luma job queue, an intra-frame chroma job queue, an inter-frame job queue and a logic module. The logic module is used for judging the dependency relationship between frame signals, deciding to start or output the contents of intra-frame luminance work queue, intra-frame chroma work queue or inter-frame work queue, and then output control signals to the work loop module LM. After the working loop module LM receives the control signal from the scheduling module 10, it can perform the corresponding encoding operation. FIG. 8 is an illustration of one implementation of the scheduling module 10 , and those skilled in the art can make appropriate adjustments according to the needs of the system, and are not limited thereto.

综上所述,本发明实施例是教导一种用于高效能视频编码装置的排程方法,透过排程模块及其对应的剖析器,以判断目前输入帧信号欲进行帧内编码操作或帧内/帧间编码操作,并对应传输控制信号至工作回圈模块的预估模块、离散余弦转换模块、量化模块、反量化模块、反离散余弦转换模块与像素重建模块,以分别对不同输入帧信号的亮度帧信号与色度帧信号进行相关编码操作,进而节省已知技术中硬体资源所浪费的等待时间。In summary, the embodiment of the present invention teaches a scheduling method for a high-efficiency video encoding device. Through the scheduling module and its corresponding analyzer, it is determined whether the current input frame signal is to be intra-frame encoded or not. Intra-frame/inter-frame coding operations, and correspondingly transmit control signals to the estimation module, discrete cosine transformation module, quantization module, inverse quantization module, inverse discrete cosine transformation module and pixel reconstruction module of the working loop module, to respectively perform different input The luminance frame signal and the chrominance frame signal of the frame signal are correlated with encoding operation, thereby saving the waiting time wasted by hardware resources in the prior art.

以上所述仅为本发明的较佳实施例,凡依本发明申请专利范围所做的均等变化与修饰,皆应属本发明的涵盖范围。The above descriptions are only preferred embodiments of the present invention, and all equivalent changes and modifications made according to the scope of the patent application of the present invention shall fall within the scope of the present invention.

Claims (19)

1. a kind of scheduling method, is used for a high efficiency video coding apparatus, which includes:
Multiple input frame signal is received by an arranging module of the high efficiency video coding apparatus, a control signal is generated with corresponding Judge whether each input frame signal carries out an encoding operation within the frame/frames, and each input frame is judged by the arranging module Signal is a brightness frame signal or a coloration frame signal;And
When the control signal is judged to carry out the encoding operation within the frame/frames, the high efficiency video coding apparatus is in each One first encoding operation and one second encoding operation sequentially are carried out to more persons of multiple frame signals in work period;
Wherein, which is sequentially to carry out a pixel to estimate operation, discrete cosine transform operation, a quantization behaviour Work, an inverse quantization operation, an anti-discrete cosine conversion operation and a pixel reconstruction operation, which is sequentially to carry out The operation of one motion compensation, discrete cosine transform operation, the quantization operation, the inverse quantization operation, the anti-discrete cosine conversion behaviour Work and the pixel reconstruction operation, and each work period is single brightness frame signal or single chrominance frames in each input frame signal Signal carries out the time corresponding to any operation in any operation in first encoding operation or second encoding operation.
2. scheduling method as described in claim 1, which is characterized in that also include:
When the control signal is judged without the encoding operation within the frame/frames, the high efficiency video coding apparatus is sequentially right In multiple sub- brightness frame signals of each brightness frame signal one in multiple sub- coloration frame signals of one and each coloration frame signal Person carries out first encoding operation.
3. scheduling method as claimed in claim 2, which is characterized in that each brightness frame signal includes that at least one first son is bright Spend frame signal, each coloration frame signal includes at least one first sub- coloration frame signal, and when the control signal be judged not into Row this within the frame/frames encoding operation when, the high efficiency video coding apparatus is sequentially bright to multiple son of each brightness frame signal One carries out first encoding operation with one in multiple sub- coloration frame signal of each coloration frame signal in degree frame signal Step also includes:
In one first work period, which carries out one first operation to the first sub- brightness frame signal;
One second work period after first work period, the high efficiency video coding apparatus believe the first sub- chrominance frames First operation number is carried out, while the high efficiency video coding apparatus carries out one second operation to the first sub- brightness frame signal; And
A third work period after second work period, the high efficiency video coding apparatus believe the first sub- chrominance frames Number carry out second operation;
Wherein, the arranging module received in sequence first sub- brightness frame signal and the first sub- coloration frame signal, and first behaviour Make with second operation to be sequentially that the pixel estimates operation, discrete cosine transform operation, the quantization operation, the inverse quantization behaviour Make, is both continuous in the anti-discrete cosine conversion operation and the pixel reconstruction operation.
4. scheduling method as described in claim 1, which is characterized in that compiled within the frame/frames when arranging module judgement carries out this When code operation, the high efficiency video coding apparatus sequentially to more persons of multiple frame signal carry out first encoding operation with this The step of two encoding operations also includes:
In one first work period, the high efficiency video coding apparatus is to one first input frame signal in multiple input frame signal It carries out first encoding operation and continues six work periods;
One second work period after first work period, the high efficiency video coding apparatus is to multiple input frame signal In one second input frame signal carry out second encoding operation and continue six work periods;And
It repeats above operation and multiple sub- brightness frame signals of the second input frame signal is carried out with multiple sub- coloration frame signals Second encoding operation, and continue first encoding operation of the first input frame signal.
5. scheduling method as claimed in claim 4, which is characterized in that also include:
In second volume for the multiple sub- brightness frame signal and multiple sub- coloration frame signal for completing the second input frame signal Code operation before, in each work period, the high efficiency video coding apparatus simultaneously to this first input frame signal carry out this first Encoding operation and to this second input frame signal carry out second encoding operation.
6. scheduling method as claimed in claim 4, which is characterized in that also include:
Once complete multiple sub- brightness frame signal and the multiple sub- coloration frame signal of the second input frame signal this second After encoding operation, in each work period later, which is somebody's turn to do the first input frame signal First encoding operation.
7. scheduling method as described in claim 1, which is characterized in that the high efficiency video coding apparatus also includes to estimate To carry out, the pixel estimates operation to module or motion compensation operation, a discrete cosine transform module turn to carry out the discrete cosine Change operation, a quantization modules carry out the inverse quantization operation, an anti-discrete cosine to carry out the quantization operation, an inverse quantization module Conversion module rebuilds module carrying out the anti-discrete cosine conversion operation and a pixel and carries out the pixel reconstruction operation, and this is pre- Estimate module, the discrete cosine transform module, the quantization modules, the inverse quantization module, the anti-discrete cosine conversion module and the picture It is sequentially to couple to form a work loop module that element, which rebuilds module,.
8. scheduling method as claimed in claim 7, which is characterized in that this estimates module, the discrete cosine transform module, the amount It all includes a parser to change module, the inverse quantization module, the anti-discrete cosine conversion module and the pixel to rebuild module, is used for The control signal for receiving the arranging module judges whether to the encoding operation within the frame/frames with corresponding, while also judging should It is the brightness frame signal or the coloration frame signal to input frame signal.
9. scheduling method as claimed in claim 7, which is characterized in that the quantization modules are also coupled to one turn of leaflet member, are used for defeated Go out in a residual signal a to frame for the quantization modules coloration buffer in brightness buffer or a frame.
10. scheduling method as claimed in claim 7, which is characterized in that the pixel rebuilds module and is also coupled to one turn of leaflet member, uses Coloration buffer in brightness buffer or a frame is rebuild in a reconstruction signal a to frame for module to export the pixel.
11. a kind of high efficiency video coding apparatus, includes:
One arranging module controls signal to judge that each input frame is believed for receiving multiple input frame signal with corresponding generation one An encoding operation within the frame/frames number whether is carried out, and for judging each input frame signal for a brightness frame signal or a coloration Frame signal;And
One work loop module, couples the arranging module, includes to estimate module, a discrete cosine transform module, a quantization Module, an inverse quantization module, an anti-discrete cosine conversion module rebuild module with a pixel and are sequentially to couple each other;
Wherein, when the control signal is judged to carry out the encoding operation within the frame/frames, the work loop module is in each work Make sequentially to carry out one first encoding operation and one second encoding operation to more persons of multiple frame signal in the period, first coding Operation is sequentially to carry out a pixel to estimate operation, discrete cosine transform operation, a quantization operation, an inverse quantization operation, one instead Discrete cosine transform is operated sequentially carries out that a motion compensation operation, this is discrete with a pixel reconstruction operation, second encoding operation Cosine conversion operation, the quantization operation, the inverse quantization operation, the anti-discrete cosine conversion operation and the pixel reconstruction operation, and Each work period is that single brightness frame signal or single coloration frame signal carry out first coding behaviour in each input frame signal A time in work in any operation or second encoding operation corresponding to any operation.
12. high efficiency video coding apparatus as claimed in claim 11, which is characterized in that this estimates module, the discrete cosine Conversion module, the quantization modules, the inverse quantization module, the anti-discrete cosine conversion module and the pixel rebuild module One parser, for receiving the control signal of the arranging module, carried out in the intra-encoding operations or the frame with corresponding to judgement/ Interframe encode operates, while also judging each input frame signal for the brightness frame signal or the coloration frame signal.
13. high efficiency video coding apparatus as claimed in claim 11, which is characterized in that the quantization modules are also coupled to one turn of biography Unit, coloration buffer in brightness buffer or a frame in the residual signal a to frame for exporting the quantization modules.
14. high efficiency video coding apparatus as claimed in claim 11, which is characterized in that the pixel rebuilds module and is also coupled to one Turn leaflet member, rebuilds in a reconstruction signal a to frame for module that coloration is temporary in brightness buffer or a frame for exporting the pixel Device.
15. high efficiency video coding apparatus as claimed in claim 11, which is characterized in that when the control signal be judged not into Row this within the frame/frames encoding operation when, the work loop module is sequentially to multiple sub- brightness frame signals of each brightness frame signal Middle one carries out first encoding operation with one in multiple sub- coloration frame signals of each coloration frame signal.
16. high efficiency video coding apparatus as claimed in claim 15, which is characterized in that each brightness frame signal include to Few one first sub- brightness frame signal, each coloration frame signal includes at least one first sub- coloration frame signal, and when the control is believed Number be judged without this within the frame/frames encoding operation when, also include following steps:
In one first work period, which carries out one first operation to the first sub- brightness frame signal;
One second work period after first work period, the work loop module carry out the first sub- coloration frame signal First operation, while the work loop module carries out one second operation to the first sub- brightness frame signal;And
A third work period after second work period, the work loop module carry out the first sub- coloration frame signal Second operation;
Wherein, the arranging module received in sequence first sub- brightness frame signal and the first sub- coloration frame signal, and first behaviour Make with second operation to be sequentially that the pixel estimates operation, discrete cosine transform operation, the quantization operation, the inverse quantization behaviour Make, is both continuous in the anti-discrete cosine conversion operation and the pixel reconstruction operation.
17. high efficiency video coding apparatus as claimed in claim 11, which is characterized in that when the control signal is judged progress This within the frame/frames encoding operation when, also include following steps:
In one first work period, which carries out one first input frame signal in multiple frame signal First encoding operation and continue six work periods;
One second work period after first work period, the high efficiency video coding apparatus is in multiple frame signal one Second input frame signal carries out second encoding operation and continues six work periods;And
It repeats above operation and multiple sub- brightness frame signals of the second input frame signal is carried out with multiple sub- coloration frame signals Second encoding operation, and continue first encoding operation of the first input frame signal.
18. high efficiency video coding apparatus as claimed in claim 17, which is characterized in that when the control signal is judged progress This within the frame/frames encoding operation when, also include following steps:
In second volume for the multiple sub- brightness frame signal and multiple sub- coloration frame signal for completing the second input frame signal Code operation before, in each work period, the high efficiency video coding apparatus simultaneously to this first input frame signal carry out this first Encoding operation and to this second input frame signal carry out second encoding operation.
19. high efficiency video coding apparatus as claimed in claim 17, which is characterized in that when the control signal is judged progress This within the frame/frames encoding operation when, also include following steps:
Complete multiple sub- brightness frame signal of the second input frame signal and second coding of multiple sub- coloration frame signal After operation, in each work period, which only carries out first coding to the first input frame signal Operation.
CN201710043756.8A 2017-01-19 2017-01-19 Scheduling method for high efficiency video coding device Pending CN108337507A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710043756.8A CN108337507A (en) 2017-01-19 2017-01-19 Scheduling method for high efficiency video coding device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710043756.8A CN108337507A (en) 2017-01-19 2017-01-19 Scheduling method for high efficiency video coding device

Publications (1)

Publication Number Publication Date
CN108337507A true CN108337507A (en) 2018-07-27

Family

ID=62922730

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710043756.8A Pending CN108337507A (en) 2017-01-19 2017-01-19 Scheduling method for high efficiency video coding device

Country Status (1)

Country Link
CN (1) CN108337507A (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5719628A (en) * 1993-02-25 1998-02-17 Nec Corporation Video signal coding method and apparatus
CN1536531A (en) * 2003-04-10 2004-10-13 ������������ʽ���� Image processing device, image processing method, and image processing program
CN1652605A (en) * 2003-12-30 2005-08-10 三星电子株式会社 Video codecs, data processing systems and methods for the same
CN102143361A (en) * 2011-01-12 2011-08-03 浙江大学 Video coding method and video coding device
US20140118388A1 (en) * 2012-10-30 2014-05-01 Pixtronix, Inc. Display apparatus employing frame specific composite contributing colors
TW201622420A (en) * 2014-12-11 2016-06-16 上海兆芯集成電路有限公司 Advanced video coding and decoding chip and advanced video coding and decoding method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5719628A (en) * 1993-02-25 1998-02-17 Nec Corporation Video signal coding method and apparatus
CN1536531A (en) * 2003-04-10 2004-10-13 ������������ʽ���� Image processing device, image processing method, and image processing program
CN1652605A (en) * 2003-12-30 2005-08-10 三星电子株式会社 Video codecs, data processing systems and methods for the same
CN102143361A (en) * 2011-01-12 2011-08-03 浙江大学 Video coding method and video coding device
US20140118388A1 (en) * 2012-10-30 2014-05-01 Pixtronix, Inc. Display apparatus employing frame specific composite contributing colors
TW201622420A (en) * 2014-12-11 2016-06-16 上海兆芯集成電路有限公司 Advanced video coding and decoding chip and advanced video coding and decoding method

Similar Documents

Publication Publication Date Title
KR101184244B1 (en) Parallel batch decoding of video blocks
US8472527B2 (en) Hierarchical motion estimation using original frame for sub-sampled reference
US12184840B2 (en) Intra/inter mode decision for predictive frame encoding
US8238427B2 (en) Rate distortion optimized adaptive intra refresh for video coding
US8213511B2 (en) Video encoder software architecture for VLIW cores incorporating inter prediction and intra prediction
CN100592796C (en) A video encoder and its intra-frame prediction mode selection method
CN1652605B (en) Video codecs, data processing systems and methods for the same
CN103747250B (en) A kind of parallel intra-frame prediction method of H.264/AVC middle 4x4 sub-macroblock
CN105791829A (en) A HEVC Parallel Intra Prediction Method Based on Multi-core Platform
CN1981533A (en) Method and system for performing deblocking filtering
CN109391816B (en) Parallel processing method of entropy coding in HEVC based on CPU+GPU heterogeneous platform
CN1272931A (en) Image processor
CN112422986B (en) Hardware decoder pipeline optimization method and application
CN101902643B (en) A VLSI Structure Design Method for Parallel Array Intra Prediction Decoder
CN108337507A (en) Scheduling method for high efficiency video coding device
WO2024098821A1 (en) Av1 filtering method and apparatus
CN101170692B (en) Multi-view image encoding and decoding method and encoder and decoder
TWI617181B (en) Scheduling method for high efficiency video coding apparatus
US8284836B2 (en) Motion compensation method and apparatus to perform parallel processing on macroblocks in a video decoding system
CN102186082B (en) H.264 protocol based optimized decoding method for intra-frame coding compression technology
US11750800B1 (en) Encoder and associated signal processing method
CN101854535B (en) Embedded Video Encoder Quantization Method
CN119383354B (en) Coding system, method, chip, and electronic device
Wang et al. Dynamic macroblock wavefront parallelism for parallel video coding
US20090006664A1 (en) Linked DMA Transfers in Video CODECS

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20200413

Address after: No.1, Duhang 1st Road, Hsinchu City, Hsinchu Science Park, Taiwan, China

Applicant after: MEDIATEK Inc.

Address before: 1/2, 4th floor, 26 Taiyuan Street, Zhubei City, Hsinchu County, Taiwan, China

Applicant before: MStar Semiconductor, Inc.

WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20180727