CN103974071A - Video coding method and equipment on basis of regions of interest - Google Patents

Abstract

The present invention discloses a video coding method and device based on an area of interest. The video coding method includes: an object detection step for detecting a specific object in an input video frame, so as to identify the video frame based on the detected specific object A region of interest and a region of non-interest in the region; a quantization parameter calculation step for calculating quantization parameter values of macroblocks in the identified region of interest and a region of non-interest; a macroblock type selection step for calculating a macroblock based on a video frame type of the macroblocks in the region of interest and the non-interest region; and a video encoding step for calculating the quantization parameter values of the macroblocks in the region of interest and the non-interest region and the selected Macroblock type, which encodes video frames. According to the present invention, video compression can be implemented simply and efficiently, which not only ensures the high resolution of the interest area, but also does not make the non-interest area too blurred to be distinguished.

Description

Region-of-interest-based video coding method and device

technical field

The present disclosure relates to video processing technologies, and more specifically, to a region-of-interest (ROI)-based video coding method and device, which can simply and efficiently realize video compression and maintain video frames Good video quality in the ROI area, while not making the video image of the non-ROI area too blurred to be resolved.

Background technique

In recent years, applications based on intelligent video processing have been widely used in various electronic devices, and most applications need to transmit compressed video to back-end servers or other communication terminals for further processing. Therefore, there is a problem of conflict between high requirements for video resolution and limited network bandwidth that limits video quality, and a new video encoding method is required to solve this conflict.

Therefore, the concept of ROI is proposed in the video processing technology, so that the application only pays attention to the important area or object that the user cares about in the video frame, and for other areas in the video frame or picture (that is, the non-interest area), you can Roughly handle or even ignore these areas. The ROI concept applied in video compression usually means that when encoding, more bits are allocated to the area of the video frame that the user pays more attention to, while less bits are allocated to other areas (such as background, irrelevant objects, etc.), A reduction in the coded video stream is thereby achieved. For example, in a smart surveillance application, areas of people, cars, faces, etc. may often be ROI areas and will be encoded with more bits to keep the necessary details clearly visible, while other non-ROI areas will be encoded with fewer bits to code to provide only some basic information.

In the field of video coding, a large number of ROI-based video coding methods have appeared. For example, according to the video encoding method disclosed in the following Non-Patent Document 1, by setting different quantization parameter values for macroblocks (macroblocks) in ROI areas and non-ROI areas in video frames, the encoded video stream can be reduced the size of. However, in this method, the quantization parameters set for the macroblocks in the ROI area and the non-ROI area are fixed values rather than adaptive, so it may not be able to meet the requirements for video quality.

Furthermore, according to the video encoding method disclosed in the following Non-Patent Document 2, the size of the encoded video stream is reduced by limiting the macroblock types of the ROI area and the non-ROI area therein for each frame. However, this may make non-ROI regions such as the background too blurry to be resolved.

In the following video coding method disclosed in Non-Patent Document 3, an improved ratio control algorithm is used to calculate quantization parameter values of macroblocks in the ROI area and non-ROI area to achieve video compression, but the algorithm is more complicated.

Citation

[Non-Patent Document 1]: Lino F, Luís C, Pedro A., "H.264/SVC ROIEncoding with Spatial Scalability", Proceedings of International Conference on Signal Processing and Multimedia Applications. Porto, Portugal: [s.n.], 2008: 212 -215

[Non-Patent Document 2]: Taeyoung Na et al, "A Fast Macroblock ModeDecision Scheme Using ROI-Based Coding of H.264|MPEG-4 Part10AVC for Mobile Video Telephony Applications", Applications of DigitalImage Processing XXXI, edited by Andrew G.Tescher, Proceedings of the SPIE, Volume 7073, pp. 70730I-70730I-10 (2008)

[Non-Patent Document 3]: Sira Rao and Nikil Jayant, "Optimizing Algorithms for Region-of-Interest Video Compression, with Application to MobileTelehealth", ICME, pp.513-516.IEEE, (2006)

Contents of the invention

A brief overview of the invention is given below in order to provide a basic understanding of some aspects of the invention. It should be understood, however, that this summary is not an exhaustive summary of the invention. It is not intended to identify key or critical parts of the invention, nor to limit the scope of the invention. Its sole purpose is to present some concepts of the invention in a simplified form as a prelude to the more detailed description that is presented later.

In view of the above problems, the object of the present invention is to provide a simple and efficient video coding method, which adaptively sets the quantization parameter value of the macroblock in the ROI area and the non-ROI area in the video frame, and based on the video frame The types of macroblocks in the ROI area and non-ROI area are selected according to the type, and the high resolution of the ROI area is guaranteed while realizing video compression without making the video in the non-ROI area too blurred to be distinguishable.

According to an aspect of an embodiment of the present invention, there is provided a video encoding method based on an area of interest, including: an object detection step, which is used to detect a specific object in an input video frame, so as to identify based on the detected specific object A region of interest and a region of non-interest in a video frame; a quantization parameter calculation step for calculating the quantization parameter value of a macroblock in the region of interest identified and a region of non-interest; a macroblock type selection step for based on The types of macroblocks in the region of interest and the region of non-interest are selected according to the type of the video frame; The selected macroblock type to encode the video frame.

According to a preferred embodiment of the present invention, in the macroblock type selection step, when the video frame is an intra frame, all macroblock types can be selected for both the region of interest and the region of non-interest in the video frame; Whereas, in the case that the video frame is an inter frame, for the non-interest region in the video frame, only the inter macroblock type is selected, and for the interest region in the video frame, all macroblock types are selected.

According to another preferred embodiment of the present invention, in the step of calculating the quantization parameter, the quantization parameter value of the macroblock in the region of interest may be calculated according to the size of the region of interest in the video frame.

According to another preferred embodiment of the present invention, in the step of calculating the quantization parameter, calculating the quantization parameter value of the macroblock in the region of interest according to the size of the region of interest in the video frame further includes Quantization parameter values for macroblocks in the region of interest are calculated as the ratio of the number of macroblocks in the video frame to the number of macroblocks in the video frame.

According to another preferred embodiment of the present invention, the video encoding method further includes: a sampling step for sampling video frames before the object detection step, wherein, in the object detection step, by identifying the Regions of interest and regions of non-interest to identify regions of interest and regions of non-interest in video frames.

According to another aspect of the embodiments of the present invention, there is also provided an ROI-based video encoding device, including: an object detection unit configured to detect a specific object in an input video frame, and based on the detected specific object object to identify a region of interest and a region of non-interest in a video frame; a quantization parameter calculation unit configured to calculate a quantization parameter value of a macroblock in the region of interest identified and a region of non-interest; a macroblock type selection unit , configured to select the type of macroblocks in the region of interest and the region of non-interest based on the type of the video frame; The quantization parameter value of the macroblock and the selected macroblock type are used to encode the video frame.

According to still another aspect of the embodiments of the present invention, there is also provided a storage medium, the storage medium includes machine-readable program code, and when the program code is executed on the information processing device, the program code causes the information processing device to execute the The video encoding method based on the region of interest of the present invention.

In addition, according to still another aspect of the embodiments of the present invention, there is also provided a program product, the program product includes machine-executable instructions, and when the instructions are executed on the information processing device, the instructions cause the information processing device to execute the Invented region-of-interest-based video coding method.

Therefore, according to an embodiment of the present invention, by defining the range of the macroblock type for the ROI area and the non-ROI area according to the frame type during the macroblock mode prediction process and by using different Quantizing parameter values can realize video compression simply and efficiently, ensuring high video quality in the ROI area without making the video in the non-ROI area too blurry, making it suitable for content-aware video coding applications, such as access control The face recognition system, the remote monitoring system of the parking lot, etc.

Further aspects of the embodiments of the present invention are given in the description section below, wherein the detailed description serves to fully disclose preferred embodiments of the embodiments of the present invention without imposing limitations thereon.

Description of drawings

The present invention can be better understood by referring to the following detailed description given in conjunction with the accompanying drawings, wherein the same or similar reference numerals are used throughout to designate the same or similar parts. The accompanying drawings, together with the following detailed description, are incorporated in and form a part of this specification, and serve to further illustrate preferred embodiments of the invention and explain the principles and advantages of the invention. in:

1 is a flowchart illustrating an example of an ROI-based video encoding method according to an embodiment of the present invention;

FIG. 2 is a schematic diagram showing an example of ROI region recognition in an object detection step in the ROI-based video coding method shown in FIG. 1;

FIG. 3 is a schematic diagram showing an example implementation of a macroblock type selection step in the ROI-based video coding method shown in FIG. 1;

4 is a schematic diagram showing an example of the effect of reducing the number of frame bits in the ROI-based video coding method according to an embodiment of the present invention compared with the video coding method in the prior art;

5 is a block diagram showing an example of a functional configuration of an ROI-based video encoding device according to an embodiment of the present invention; and

FIG. 6 is a block diagram showing an exemplary structure of a personal computer as an information processing device employed in an embodiment of the present invention.

Detailed ways

Exemplary embodiments of the present invention will be described below with reference to the accompanying drawings. In the interest of clarity and conciseness, not all features of an actual implementation are described in this specification. It should be understood, however, that in developing any such practical embodiment, many implementation-specific decisions must be made in order to achieve the developer's specific goals, such as meeting those constraints related to the system and business, and those Restrictions may vary from implementation to implementation. Moreover, it should also be understood that development work, while potentially complex and time-consuming, would at least be a routine undertaking for those skilled in the art having the benefit of this disclosure.

Here, it should also be noted that, in order to avoid obscuring the present invention due to unnecessary details, only the device structure and/or processing steps closely related to the solution according to the present invention are shown in the drawings, and the Other details not relevant to the present invention are described.

An ROI-based video encoding method and a video encoding device according to embodiments of the present invention will be described below with reference to FIGS. 1 to 6 .

First, an example of a processing flow of an ROI-based video encoding method according to an embodiment of the present invention will be described with reference to FIG. 1 .

Specifically, referring to FIG. 1, the ROI-based video encoding method according to an embodiment of the present invention includes an object detection step S114, a quantization parameter calculation step S116, a macroblock type selection step S118, and a video encoding step S120. Preferably, the method may further include a denoising step S110 and a sampling step S112. The processing in each step will be described in detail below.

First, in the object detection step S114 , a specific object in the input video frame may be detected to identify an area of interest and an area of non-interest in the video frame based on the detected specific object. Specifically, an appropriate object detection algorithm may be used to detect target objects (eg, people, cars, etc.) according to the needs of practical applications, thereby defining ROI regions and non-ROI regions in the video frame based on the detected objects. These object detection algorithms may be any algorithms known in the field of video processing, and will not be described in detail here.

Preferably, the input original video frame may also be preprocessed by using, for example, a filtering method, so as to remove environmental noise included in the video frame and improve video compression quality. In the denoising step S110, noise included in the input video frame may be removed. Preferably, in order to further improve the processing efficiency, the denoising step S110 and the object detection step S114 can be executed in parallel.

In addition, in order to improve the efficiency of video processing, the input video frame may be sampled first before the object detection step S114, so as to reduce the calculation amount of subsequent object detection processing. Preferably, the sampling rate can be set by the user according to the complexity of the object detection algorithm adopted in the object detection step S114.

Preferably, in the object detection step S114, the ROI area and the non-ROI area in the original video frame can be identified by identifying the ROI area and the non-ROI area in the sampled video frame.

Specifically, this process can be described in detail with reference to FIG. 2 . Applying an object detection algorithm to the sampled video frames to detect specific objects included therein, and identifying ROI regions and non-ROI regions in the sampled video frames based on the detected specific objects to obtain Position information and size information of the ROI area, etc. Then, by adjusting the size of the ROI area in the obtained sampled video frame and mapping it back to the original input video, the information of the ROI area and non-ROI area in the original input video frame (for example, position, size, etc.), this information will be used in the subsequent encoding process. This is shown schematically in FIG. 2 .

As an example, since various processes are generally performed at the macroblock level in video processing technology, here, the ROI area may refer to an area including all macroblocks including the target pixel. Accordingly, as an example, the size information of the ROI area in the input video may be represented by the ratio of the number of macroblocks included in the ROI area to the total number of macroblocks included in the video frame, ie, k=N _ROI /N _TOTAL .

Next, after obtaining the relevant information of the ROI area, in the quantization parameter calculation step S116, the quantization parameter values of the macroblocks in the ROI area and the non-ROI area identified in the step S114 can be calculated. Preferably, the quantization parameter value of the macroblock in the ROI area can be calculated according to the size of the ROI area in the video frame.

In video compression processing, it is well known to those skilled in the art that since the ROI area is the area that the user is more concerned about, and the non-ROI area is the area containing unimportant information (such as the background, etc.), it is expected to use more The ROI area is coded with fewer bits to ensure the high resolution of the coded video, and the non-ROI area is coded with fewer bits to reduce the coded video stream to meet the requirements of limited network bandwidth.

Therefore, in the quantization parameter calculation step S116, the quantization parameters of the macroblocks in the ROI area and the non-ROI area are respectively calculated to meet different video coding requirements.

A specific example of calculating quantization parameter values of macroblocks in the ROI area and the non-ROI area is given below. Specifically, for a macroblock in a non-ROI area, a quantization parameter value that is a predetermined fixed constant is generally adopted. The fixed constant can be preset according to specific requirements for video quality. As an example, the fixed constant may be 45 here.

As for the macroblock in the ROI area, in order to control the number of bits, preferably, its quantization parameter value is not fixed but can be adaptively updated according to the size of the ROI area in the video frame.

Preferably, calculating the quantization parameter value of the macroblocks in the ROI area based on the size of the ROI area can be calculated based on the ratio (ie, k) of the number of macroblocks in the ROI area to the total number of macroblocks in the input video frame This is achieved by the quantization parameter values of the macroblocks in . This process can be realized, for example, by the following equation.

QP _ROI = Round(F+R*k) (1)

QP' _ROI = MIN(QP _ROI ,C) (2)

Wherein, QP' _ROI represents the quantization parameter value of the macroblock in the ROI area, k represents the ratio of the quantity of the macroblock in the above-mentioned ROI region and the quantity of the macroblock in the video frame, Round () represents the rounding operation, MIN ( ) represents the operation of taking the minimum value, wherein F, R and C respectively represent the base value, adjustment value and upper limit value of the quantization parameter value of the macroblock in the ROI area, all of which are predetermined constants. Preferably, F may be 22, R may be 50, and C may be 32 as an example.

It should be understood that the calculation methods and numerical values given above are only examples and not limiting, and those skilled in the art can use other numerical values or modify the above calculation formulas according to actual needs, as long as the larger the value of the quantization parameter is, the greater the encoding value is. The video coding principle that requires fewer bits and lower resolution is sufficient.

Next, in order to further reduce the number of bits required for encoding the non-ROI area, thereby further reducing the size of the encoded video stream, the types of macroblocks in the non-ROI area can be limited in the macroblock prediction process.

Specifically, in the macroblock type selection step S118, the type of macroblocks in the ROI area and the non-ROI area may be selected based on the type of the video frame.

As an example, referring to FIG. 3 , in the macroblock type selection step S118, the following rules may be applied to select the macroblock types in the ROI area and the non-ROI area respectively based on the type of the video frame: if the video frame is an intra frame, then for Both the ROI area and the non-ROI area select all macroblock types, because generally speaking, intra frames require more bits to encode; and if the video frame is an inter frame, then for the ROI area in the video frame, select all macroblock type to guarantee high resolution, while for non-ROI regions in video frames, only the inter macroblock type is selected to reduce the bits required for encoding.

For the definition of the macroblock type in video processing, please refer to the relevant regulations in "Recommendation ITU-T H.264, Series H: Audiovisual and Multimedia Systems, Infrastructure of Audiovisual Services-Coding of Moving Video (2009)". More details.

Then, in the video encoding step S120, based on the quantization parameter values of the macroblocks in the ROI area and the non-ROI area calculated in the quantization parameter calculation step S116 and the macroblock type selected in the macroblock type selection step S118, the Video frames are encoded. Preferably, the encoding method may be entropy encoding to achieve lossless video compression.

Preferably, after the denoising process is performed on the video frame, the denoised video frame may be processed in the video encoding step S120.

It should be understood that the above-mentioned rules for selecting macroblock types in ROI areas and non-ROI areas based on frame types are only examples and not limiting, and those skilled in the art can adopt other appropriate rules according to the principle of the present invention to reduce the coding effort. number of bits required.

Fig. 4 schematically shows the effect of reducing the number of frame bits in the ROI-based video coding method according to the embodiment of the present invention compared with the video coding method in the prior art. Wherein, in the graph shown in FIG. 4, the abscissa represents the number of frames, and the ordinate represents the number of bits.

In this example, an example input video frame for testing can be, for example, a video sequence for face detection in an office, so a face detection engine can be applied to obtain ROI region information, and the encoded sequence is IPPPP mode, where, I represents an intra frame, and P represents a predicted frame. As can be seen from FIG. 4, compared with the video coding method of the prior art, by applying the ROI-based video coding method according to the embodiment of the present invention, the number of bits required for coding is greatly reduced (about 30% to 40%) ), so that in the case of limited network bandwidth, the ideal coded video image can be transmitted to the user terminal device, that is, the video that not only ensures the high resolution of the ROI area but does not make the non-ROI area too blurred. In addition, compared with the prior art, the implementation of the ROI-based video encoding method according to the present invention is simpler and more efficient, thereby also reducing the implementation cost of video processing.

Although the example of the ROI-based video coding method according to the embodiment of the present invention has been described in detail above in conjunction with FIGS. According to different actual applications and specific requirements, corresponding modifications are made to the flow of the above method. For example, the execution order of certain steps in the above methods may be adjusted, or certain processing steps may be omitted or added as needed. For example, the denoising step S110 and the sampling step S112 shown in dotted line boxes in FIG. It is realized in steps. In addition, it should be understood that the above examples do not limit the present invention, and those skilled in the art may make appropriate modifications to the above process based on the principles taught and apply it to other applications.

Corresponding to the ROI-based video encoding method according to the embodiment of the present invention, the embodiment of the present invention further provides an ROI-based video encoding device. A functional configuration example of the ROI-based video encoding device according to the present invention will be described in detail below with reference to FIG. 5 .

As shown in FIG. 5 , the ROI-based video encoding device 500 according to the present invention may include an object detection unit 514 , a quantization parameter calculation unit 516 , a macroblock type selection unit 518 and a video encoding unit 520 . Preferably, the video encoding device 500 may further include a denoising unit 510 and a sampling unit 512 . A functional configuration example of each unit will be described in detail below with reference to FIG. 5 .

The object detection unit 514 may be configured to detect a specific object in an input video frame to identify ROI regions and non-ROI regions in the video frame based on the detected specific object. Object detection algorithms known in the art can be used to detect objects according to actual needs.

The quantization parameter calculation unit 516 may be configured to calculate quantization parameter values of macroblocks in the identified ROI area and non-ROI area.

Specifically, for the non-ROI region in the video frame, its quantization parameter value can usually be a predetermined fixed constant, for example, it can be 45 here. As for the ROI area in the video frame, in order to control the number of bits, its quantization parameter value is not fixed but can be adaptively changed according to actual needs. Preferably, the quantization parameter calculation unit 516 can calculate the quantization parameter value of the macroblock in the ROI area according to the size of the ROI area in the video frame.

As an example, the quantization parameter calculation unit 516 may calculate the quantization parameter value of the macroblocks in the ROI area based on the ratio of the number of macroblocks in the ROI area to the total number of macroblocks in the video frame. For the specific calculation process, reference may be made to the calculation equations (1) and (2) described above in the ROI-based video coding method according to the embodiment of the present invention, which will not be repeated here.

It should be understood that the calculation methods and specific numerical values given here are only examples rather than limitations, and can be modified according to actual needs.

The macroblock type selection unit 518 may be configured to select the type of macroblocks in the ROI area and the non-ROI area based on the type of video frame. This can further reduce the number of bits required for encoding non-ROI regions, thereby further reducing the size of the encoded video stream.

Specifically, the selection of the macroblock type can be realized based on the following simple rules: if the video frame is an intra frame, then for the ROI area and the non-ROI area, the macroblock type selection unit 518 can select all macroblock types; If the frame is an inter frame, for the ROI area, the macroblock type selection unit 518 can select all macroblock types, and for the non-ROI area, the macroblock type selection unit 518 can only select the inter macroblock type.

Based on this rule, while ensuring the high resolution of the ROI area, the number of bits required for encoding the non-ROI area can be reduced to reduce the coded video stream, and the video image of the non-ROI area will not be too blurred. This rule is just an example of a rule for selecting a macroblock type in the macroblock mode prediction process, and those skilled in the art can appropriately modify it based on the principle of the present invention.

The video encoding unit 520 may be configured to encode video frames based on the quantization parameter values of the macroblocks in the ROI area and the non-ROI area calculated by the quantization parameter calculation unit 516 and the macroblock type selected by the macroblock type selection unit 518 . Preferably, the encoding method may be entropy encoding.

In addition, in order to reduce environmental noise and improve video compression quality, the original video frame can also be input into the denoising unit 510 for denoising processing.

Specifically, the denoising unit 510 may be configured to remove noise included in the input video frame, which may be implemented, for example, by filtering processing known in the art. Preferably, in order to improve processing efficiency, the denoising unit 510 and the object detection unit 514 may be configured to perform respective processes in parallel, so that the video encoding unit 520 may encode the denoised video.

In addition, in order to reduce the calculation amount of the object detection processing of the object detection unit 514 and improve the efficiency of video processing, sampling processing may also be performed on the video before being input to the object detection unit 514 .

Specifically, the sampling unit 512 may be configured to perform sampling processing on input video frames. Correspondingly, the object detection unit 514 may be configured to identify the ROI area and the non-ROI area in the original video frame by identifying the ROI area and the non-ROI area in the sampled video frame. The specific implementation of obtaining the ROI area information in the original video frame by mapping the position and size information of the ROI area in the obtained sampled video frame back to the original video frame can be referred to in the above method embodiment in conjunction with FIG. 2 description and will not be repeated here.

It should be noted that the ROI-based video coding device described in the embodiment of the present invention corresponds to the aforementioned method embodiment, therefore, for the parts not described in detail in the device embodiment, please refer to the introduction of the corresponding position in the method embodiment , which will not be repeated here.

In addition, the structure and functional configuration of the ROI-based video encoding device 500 described above are only examples and not limiting, and those skilled in the art can modify the above structure as required. For example, the denoising unit 510 and the sampling unit 512 shown in dashed boxes in FIG. 5 are optional units.

In addition, it should also be noted that the series of processes and devices described above may also be implemented by software and/or firmware. In the case of realization by software and/or firmware, the program constituting the software is installed from a storage medium or a network to a computer having a dedicated hardware configuration, such as a general-purpose personal computer 600 shown in FIG. , can perform various functions and so on.

In FIG. 6 , a central processing unit (CPU) 601 executes various processes according to programs stored in a read only memory (ROM) 602 or loaded from a storage section 608 to a random access memory (RAM) 603 . In the RAM 603 , data required when the CPU 601 executes various processes and the like is also stored as necessary.

The CPU 601 , ROM 602 , and RAM 603 are connected to each other via a bus 604 . The input/output interface 605 is also connected to the bus 604 .

The following components are connected to the input/output interface 605: an input section 606 including a keyboard, a mouse, etc.; an output section 607 including a display such as a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker; The storage section 608 includes a hard disk and the like; and the communication section 609 includes a network interface card such as a LAN card, a modem, and the like. The communication section 609 performs communication processing via a network such as the Internet.

A driver 610 is also connected to the input/output interface 605 as needed. A removable medium 611 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 610 as necessary, so that a computer program read therefrom is installed into the storage section 608 as necessary.

In the case of realizing the above-described series of processes by software, the programs constituting the software are installed from a network such as the Internet or a storage medium such as the removable medium 611 .

Those skilled in the art should understand that such a storage medium is not limited to the removable medium 611 shown in FIG. 6 in which the program is stored and distributed separately from the device to provide the program to the user. Examples of removable media 611 include magnetic disks (including floppy disks (registered trademark)), optical disks (including compact disk read-only memory (CD-ROM) and digital versatile disks (DVD)), magneto-optical disks (including )) and semiconductor memory. Alternatively, the storage medium may be the ROM 602, a hard disk contained in the storage section 608, or the like, in which the programs are stored and distributed to users together with devices containing them.

It should also be pointed out that the steps for executing the above series of processes can naturally be executed in chronological order according to the illustrated order, but they do not need to be executed in chronological order. Certain steps may be performed in parallel or independently of each other.

Although the present invention and its advantages have been described in detail, it should be understood that various changes, substitutions and alterations can be made hereto without departing from the spirit and scope of the invention as defined by the appended claims. Moreover, the terms "comprising", "comprising" or any other variation thereof in the embodiments of the present invention are intended to cover a non-exclusive inclusion such that a process, method, article or device comprising a series of elements includes not only those elements, but also Including other elements not expressly listed, or also including elements inherent in such process, method, article or apparatus. Without further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article or apparatus comprising said element.

According to the embodiments of the present invention, the following additional notes are also disclosed:

1. A video encoding method based on a region of interest, comprising:

an object detection step for detecting specific objects in the input video frames to identify regions of interest and non-interest regions in the video frames based on the detected specific objects;

a quantization parameter calculation step for calculating quantization parameter values for macroblocks in the identified regions of interest and non-regions of interest;

a macroblock type selection step for selecting the type of macroblocks in the region of interest and the region of non-interest based on the type of the video frame; and

A video encoding step for encoding the video frame based on the calculated quantization parameter values of the macroblocks in the region of interest and the region of non-interest and the selected macroblock type.

2. The video coding method according to Supplement 1, wherein, in the macroblock type selection step, when the video frame is an intra frame, for the region of interest and non-interest in the video frame All macroblock types are selected for all regions; and in the case that the video frame is an inter frame, only the inter macroblock type is selected for the non-interest region in the video frame, and for the video frame Region of interest, select all macroblock types.

3. The video coding method according to Supplementary Note 1, wherein, in the quantization parameter calculation step, the quantization parameters of the macroblocks in the region of interest are calculated according to the size of the region of interest in the video frame value.

4. According to the video coding method described in Supplement 3, wherein, in the step of calculating the quantization parameter, calculating the quantization parameter value of the macroblock in the region of interest according to the size of the region of interest in the video frame is further including calculating quantization parameter values for macroblocks in the region of interest based on a ratio of the number of macroblocks in the region of interest to the number of macroblocks in the video frame.

5. The video coding method according to Supplementary Note 4, wherein, in the quantization parameter calculation step, the quantization parameter value of the macroblock in the region of interest is calculated based on the following equation:

QP _ROI =Round(F+R*k)

QP' _ROI =MIN(QP _ROI ,C)

Wherein, QP' _ROI represents the quantization parameter value of the macroblock in the region of interest, k represents the ratio of the quantity of the macroblock in the region of interest to the quantity of the macroblock in the video frame, Round() Represents a rounding operation, MIN() represents a minimum value operation, wherein F, R and C represent the base value, adjustment value and upper limit value of the quantization parameter value of the macroblock in the region of interest, all of which are predetermined constant.

6. The video coding method according to Supplement 5, wherein F is 22, R is 50, and C is 32.

7. According to the video encoding method described in Appendix 1, further comprising:

a denoising step for removing noise comprised in said video frames,

Wherein, in the video encoding step, the denoised video frames are encoded.

8. The video coding method according to Supplement 7, wherein the denoising step is performed in parallel with the object detection step.

9. According to the video encoding method described in Appendix 1, further comprising:

a sampling step for sampling said video frames prior to said object detection step,

Wherein, in the object detection step, the region of interest and the region of non-interest in the video frame are identified by identifying the region of interest and the region of non-interest in the sampled video frame.

10. The video coding method according to any one of Supplements 1-9, wherein the quantization parameter value of the macroblock in the non-interest area is a predetermined fixed constant.

11. The video coding method according to Supplement 10, wherein the fixed constant is 45.

12. The video coding method according to any one of Supplements 1-11, wherein, in the video coding step, entropy coding is performed on the video frame.

13. A region-of-interest-based video encoding device, comprising:

an object detection unit configured to detect a specific object in an input video frame to identify a region of interest and a region of non-interest in the video frame based on the detected specific object;

a quantization parameter calculation unit configured to calculate quantization parameter values for macroblocks in the identified regions of interest and non-regions of interest;

a macroblock type selection unit configured to select the type of macroblocks in the region of interest and the region of non-interest based on the type of the video frame; and

A video encoding unit configured to encode the video frame based on the calculated quantization parameter values of the macroblocks in the region of interest and the region of non-interest and the selected macroblock type.

14. The video encoding device according to Supplement 13, wherein the macroblock type selection unit is further configured to, in the case that the video frame is an intra frame, for the region of interest and non-awareness in the video frame All the macroblock types are selected for the regions of interest; and in the case where the video frame is an inter frame, only the inter macroblock type is selected for the non-interest region in the video frame, and for the video frame ROI, select all macroblock types.

15. The video encoding device according to supplementary note 13, wherein the quantization parameter calculation unit is further configured to calculate the quantization of the macroblocks in the region of interest according to the size of the region of interest in the video frame parameter value.

16. The video encoding device according to Supplement 15, wherein the quantization parameter calculation unit is further configured to calculate based on the ratio of the number of macroblocks in the region of interest to the number of macroblocks in the video frame Quantization parameter values of macroblocks in the region of interest.

17. The video encoding device according to Supplement 16, wherein the quantization parameter calculation unit is further configured to calculate the quantization parameter value of the macroblock in the region of interest based on the following equation:

QP _ROI =Round(F+R*k)

QP' _ROI =MIN(QP _ROI ,C)

Wherein, QP' _ROI represents the quantization parameter value of the macroblock in the region of interest, k represents the ratio of the quantity of the macroblock in the region of interest to the quantity of the macroblock in the video frame, Round() Represents a rounding operation, MIN() represents a minimum value operation, wherein F, R and C represent the base value, adjustment value and upper limit value of the quantization parameter value of the macroblock in the region of interest, all of which are predetermined constant.

18. The video encoding device according to supplementary note 17, wherein F is 22, R is 50, and C is 32.

19. The video encoding device according to Supplementary Note 13, further comprising:

a denoising unit configured to remove noise included in said video frame,

Wherein, the video encoding unit is further configured to encode the denoised video frames.

20. The video encoding device according to supplementary note 19, wherein the denoising unit and the object detection unit are configured to perform processing in parallel.

twenty one. The video encoding device according to Supplementary Note 13, further comprising:

a sampling unit configured to sample the video frame,

Wherein, the object detection unit is configured to identify the region of interest and the region of non-interest in the video frame by identifying the region of interest and the region of non-interest in the sampled video frame.

twenty two. The video encoding device according to any one of supplementary notes 13-21, wherein the quantization parameter value of the macroblock in the non-interest region is a predetermined fixed constant.

twenty three. The video encoding device according to supplementary note 22, wherein the fixed constant is 45.

twenty four. The video encoding device according to any one of supplementary notes 13-23, wherein the video encoding unit is further configured to perform entropy encoding on the video frame.

25． A storage medium, the storage medium includes a machine-readable program code, and when the program code is executed on an information processing device, the program code causes the information processing device to execute any one of Supplements 1 to 12. Region-of-interest-based video coding method described in item.

26． A program product, the program product includes machine-executable instructions, and when the instructions are executed on an information processing device, the instructions cause the information processing device to execute the Region-of-interest-based video coding method.

Claims (10)

1. A video coding method based on a region of interest, comprising: an object detection step for detecting specific objects in the input video frames to identify regions of interest and non-interest regions in the video frames based on the detected specific objects; a quantization parameter calculation step for calculating quantization parameter values for macroblocks in the identified regions of interest and non-regions of interest; a macroblock type selection step for selecting the type of macroblocks in the region of interest and the region of non-interest based on the type of the video frame; and A video encoding step for encoding the video frame based on the calculated quantization parameter values of the macroblocks in the region of interest and the region of non-interest and the selected macroblock type. 2. The video coding method according to claim 1, wherein, in the macroblock type selection step, in the case that the video frame is an intra frame, for the region of interest and non- All macroblock types are selected for the regions of interest; and when the video frame is an inter frame, only the inter macroblock type is selected for the non-interest region in the video frame, and for the video frame Region of interest in , select all macroblock types. 3. The video coding method according to claim 1, wherein, in the quantization parameter calculation step, the quantization parameter of the macroblock in the region of interest is calculated according to the size of the region of interest in the video frame value. 4. The video coding method according to claim 3, wherein, in the quantization parameter calculation step, the quantization parameter of the macroblock in the region of interest is calculated according to the size of the region of interest in the video frame Value further includes calculating a quantization parameter value for a macroblock in the region of interest based on a ratio of a number of macroblocks in the region of interest to a number of macroblocks in the video frame. 5. The video encoding method according to claim 1, further comprising: a sampling step for sampling said video frames prior to said object detection step, Wherein, in the object detection step, the region of interest and the region of non-interest in the video frame are identified by identifying the region of interest and the region of non-interest in the sampled video frame. 6. A video encoding device based on a region of interest, comprising: an object detection unit configured to detect a specific object in an input video frame to identify a region of interest and a region of non-interest in the video frame based on the detected specific object; a quantization parameter calculation unit configured to calculate quantization parameter values for macroblocks in the identified regions of interest and non-regions of interest; a macroblock type selection unit configured to select the type of macroblocks in the region of interest and the region of non-interest based on the type of the video frame; and A video encoding unit configured to encode the video frame based on the calculated quantization parameter values of the macroblocks in the region of interest and the region of non-interest and the selected macroblock type. 7. The video encoding device according to claim 6, wherein the macroblock type selection unit is further configured to, when the video frame is an intra frame, for the region of interest and Non-interest regions all select all macroblock types; and in the case where the video frame is an inter frame, only the inter macroblock type is selected for the non-interest region in the video frame, while for the video A region of interest in a frame, with all macroblock types selected. 8. The video encoding device according to claim 6, wherein the quantization parameter calculation unit is further configured to calculate the quantization of the macroblocks in the region of interest according to the size of the region of interest in the video frame parameter value. 9. The video encoding device according to claim 8, wherein the quantization parameter calculation unit is further configured to be based on a ratio of the number of macroblocks in the region of interest to the number of macroblocks in the video frame to calculate the quantization parameter value of the macroblock in the region of interest. 10. The video encoding device of claim 6, further comprising: a sampling unit configured to sample the video frame, Wherein, the object detection unit is further configured to identify the region of interest and the region of non-interest in the video frame by identifying the region of interest and the region of non-interest in the sampled video frame.