JP4696577B2 - Encoding apparatus and method, decoding apparatus and method, recording medium, program, image processing system and method - Google Patents

Description

  The present invention relates to an encoding apparatus and method, a decoding apparatus and method, a recording medium, a program, an image processing system and a method, and in particular, searches for a block having a dynamic range closest to the dynamic range in the block from a previous frame. , Encoding apparatus and method, decoding apparatus and method capable of suppressing copying while maintaining good quality without degrading the output quality of the data before copying by performing motion estimation , Recording medium, program, image processing system and method.

  FIG. 1 shows a configuration example of a conventional image processing system 1. The image processing system 1 includes a playback device 11 that outputs analog image data Van, and a display 12 that displays an image corresponding to the image data Van output from the playback device 11.

  The playback device 11 includes a decoding unit 21 and a D / A (Digital-to-Analog) conversion unit 22. The decoding unit 21 decodes encoded image data reproduced from a recording medium such as an optical disk (not shown), and supplies the decoded digital image data to the D / A conversion unit 22. The D / A conversion unit 22 converts the digital image data from the decoding unit 21 into analog image data, and supplies the analog image data Van to the display 12.

  The display 12 is composed of, for example, a CRT (Cathode Ray Tube) or an LCD (Liquid Crystal Display).

  Conventionally, there has been a risk of unauthorized copying using analog image data Van output from the playback device 11 of such an image processing system 1.

  That is, the analog image data Van output from the reproduction apparatus 11 is converted into digital image data Vdg by the A / D conversion unit 31 and supplied to the encoding unit 32. The encoding unit 32 encodes the digital image data Vdg and supplies the encoded image data Vcd to the recording unit 33. The recording unit 33 records the encoded image data Vcd on a recording medium such as an optical disk.

  In order to prevent unauthorized copying using analog image data Van that is performed as described above, when copyright protection has been conventionally performed, analog image data Van is scrambled and output ( For example, Patent Document 1) or the output of analog image data Vdg has been suppressed. However, in this case, there has been a problem that normal video does not move to the display 12.

  In addition, when encoding and decoding are performed using ADRC (Adaptive Dynamic Range Coding) shown in Patent Document 2, image data deteriorates due to a decrease in dynamic range due to encoding and decoding. The degree of reduction of the dynamic range by ADRC is not so much deterioration. In addition, in the case of ADRC, although it can be applied to a moving image, it does not utilize the characteristics of motion, so that a great deterioration cannot be obtained for the moving image.

  Therefore, a method for preventing unauthorized copying using an analog image signal without causing inconvenience such as no image being displayed has been proposed by the present applicant (see, for example, Patent Document 3).

JP 2001-245270 A Japanese Patent Laid-Open No. 61-144989 JP 2004-289585 A

  In the method described in Patent Document 3, attention is paid to analog noise such as a phase shift of a digital image signal obtained by A / D conversion of the analog image signal, and encoding is focused on the digital image signal. By doing this, it is impossible to copy while maintaining good quality without degrading the quality of the image before copying, thereby preventing unauthorized copying using analog image signals, but the distribution of digital content In recent years, the proposal of another method for preventing unauthorized copying as described above has been demanded.

  The present invention has been made in view of such a situation, so that copying can be easily suppressed while maintaining good quality without deteriorating the quality of output by data before copying. To do.

The encoding apparatus according to the present invention includes a blocking unit configured to block a first frame in input image data, and a dynamic value of a pixel value of a first block of the first frame blocked by the blocking unit. a dynamic range detection section for detecting a range, from the second frame in the image data, detects a second block having the closest dynamic range to the dynamic range detected by the dynamic range detection section, the second block is When a plurality of DCT coefficients are detected , a correlation coefficient between a DCT (Discrete Cosine Transform) coefficient of the first block and a DCT coefficient of the plurality of second blocks is calculated, and the second block having the maximum correlation coefficient is used. , Using the motion estimation means for estimating the motion vector of the first block, and the motion vector estimated by the motion estimation means, Coding means for coding one block.

  The image processing apparatus further includes noise adding means for adding noise to the image data and outputting the image data to which the noise is added, and the blocking means blocks the first frame of the image data to which the noise is added by the noise adding means. Can be.

  And further comprising difference calculation means for calculating a difference between the image data of the second frame corresponding to the first block and the image data of the first block using the motion vector estimated by the motion estimation means. The means can encode the first block by encoding the difference calculated by the difference calculating means.

  The encoding means may be encoded by a JPEG (Joint Photographic Coding Experts Group) method.

  Data output means for outputting the motion vector estimated by the motion estimation means and the first block encoded by the encoding means to the subsequent stage as encoded data can be further provided.

The encoding method of the present invention includes a blocking step of blocking a first frame in input image data, and a pixel value of a first block of the first frame blocked by the processing of the blocking step and dynamic range detection step for detecting a dynamic range, from the second frame in the image data, detects a second block having the closest dynamic range to the dynamic range detected by the processing of the dynamic range detection step, the When a plurality of blocks of 2 are detected , a correlation coefficient between a DCT (Discrete Cosine Transform) coefficient of the first block and a DCT coefficient of the plurality of second blocks is calculated, and the second correlation coefficient having the maximum correlation coefficient is calculated . A motion estimation step for estimating a motion vector of the first block using the block; And a coding step for coding the first block using the motion vector estimated by the logic.

The program recorded on the first recording medium of the present invention includes a blocking step for blocking the first frame in the input image data, and the first frame blocked by the processing of the blocking step. A dynamic range detecting step for detecting a dynamic range of pixel values of the first block of the first block, and a first dynamic range closest to the dynamic range detected by the processing of the dynamic range detecting step from the second frame in the image data. 2 blocks are detected, and when a plurality of second blocks are detected , a correlation coefficient between the DCT coefficients of the first block and the DCT coefficients of the plurality of second blocks is calculated , A motion estimation step of estimating a motion vector of the first block using the second block; Tsu using the motion vector estimated by the processing of up to perform the processing of the first block and a coding step of coding the computer.

A first program of the present invention includes a blocking step for blocking a first frame in input image data, and pixels of the first block of the first frame blocked by the processing of the blocking step A dynamic range detecting step for detecting a dynamic range of the values, and detecting a second block having a dynamic range closest to the dynamic range detected by the processing of the dynamic range detecting step from the second frame in the image data; When a plurality of second blocks are detected , a correlation coefficient between the DCT coefficients of the first block and the DCT coefficients of the plurality of second blocks is calculated, and the second block having the maximum correlation coefficient is used. The motion estimation step for estimating the motion vector of the first block, and the motion estimation step By using the motion vector to perform the processing including an encoding step of encoding the first block to the computer.

The decoding device of the present invention detects a second block of a second frame having a dynamic range closest to the dynamic range of the first block of the first frame in the image data, and detects a plurality of second blocks. If the correlation coefficient between the DCT coefficient of the first block and the DCT coefficients of the plurality of second blocks is calculated , the motion of the first block is calculated using the second block having the maximum correlation coefficient. And a data input means for inputting the motion vector estimated as follows, and encoded data obtained by encoding a difference value between the first frame and the second frame obtained using the motion vector, and input by the data input means Difference value extraction means for extracting a difference value by decoding the encoded data, and image data of the second frame in accordance with the motion vector input by the data input means. A, by adding the difference value extracted by the difference value extracting means, and a data addition means for generating image data of the first frame.

  Noise addition means for adding noise to the image data generated by the data addition means and outputting the image data with the noise added to the subsequent stage can be further provided.

  According to the motion vector input by the data input means, the apparatus further comprises motion compensation means for predicting the image data of the prediction block from the image data of the second frame, and the data addition means is the prediction predicted by the motion compensation means By adding the difference value extracted by the difference value extraction means to the image data of the block, the image data of the first frame can be generated.

The decoding method of the present invention detects a second block of a second frame having a dynamic range closest to the dynamic range of the first block of the first frame in the image data, and detects a plurality of second blocks. If the correlation coefficient between the DCT coefficient of the first block and the DCT coefficients of the plurality of second blocks is calculated , the motion of the first block is calculated using the second block having the maximum correlation coefficient. A data input step for inputting a motion vector estimated as, and encoded data in which a difference value between the first frame and the second frame obtained by using the motion vector is encoded, and processing of the data input step According to the difference value extraction step for extracting the difference value by decoding the input encoded data and the motion vector input by the processing of the data input step , Including the image data of the second frame, by adding the difference value extracted by the processing of the difference value extracting step, and a data addition step of generating image data of the first frame.

The program recorded on the second recording medium of the present invention detects the second block of the second frame having the dynamic range closest to the dynamic range of the first block of the first frame in the image data. When a plurality of second blocks are detected , a correlation coefficient between the DCT coefficient of the first block and the DCT coefficient of the plurality of second blocks is calculated, and the second block having the maximum correlation coefficient is calculated. Data input for inputting a motion vector estimated as the motion of the first block and encoded data obtained by encoding a difference value between the first frame and the second frame obtained using the motion vector A differential value extraction step for extracting a differential value by decoding the encoded data input by the step, the data input step processing, and the data input step processing A data addition step for generating the image data of the first frame by adding the difference value extracted by the processing of the difference value extraction step to the image data of the second frame according to the input motion vector Causes the computer to perform processing including

The second program of the present invention detects a second block of a second frame having a dynamic range closest to the dynamic range of the first block of the first frame in the image data, and the second block is When a plurality of detection coefficients are detected , a correlation coefficient between the DCT coefficients of the first block and the DCT coefficients of the plurality of second blocks is calculated , and the first block is calculated using the second block having the maximum correlation coefficient. A data input step for inputting a motion vector estimated as the motion of the first frame and encoded data obtained by encoding a difference value between the first frame and the second frame obtained using the motion vector; A difference value extraction step for extracting the difference value by decoding the encoded data input by the processing, and a motion vector input by the processing of the data input step In response, the computer includes a process including a data addition step of generating image data of the first frame by adding the difference value extracted by the processing of the difference value extraction step to the image data of the second frame. To do.

In the first image processing system of the present invention, the encoding device includes a blocking unit that blocks the first frame in the input image data, and a first frame that is blocked by the blocking unit. A dynamic range detecting means for detecting a dynamic range of pixel values of one block, and a second block having a dynamic range closest to the dynamic range detected by the dynamic range detecting means from the second frame in the image data. If a plurality of second blocks are detected , a correlation coefficient between the DCT coefficient of the first block and the DCT coefficient of the plurality of second blocks is calculated, and the second block having the maximum correlation coefficient is calculated. Using the motion estimation means for estimating the motion vector of the first block, and the motion vector estimated by the motion estimation means , And a coding means for coding the first block.

In the second image processing system of the present invention, the decoding device detects a second block of the second frame having a dynamic range closest to the dynamic range of the first block of the first frame in the image data. When a plurality of second blocks are detected , a correlation coefficient between the DCT coefficient of the first block and the DCT coefficient of the plurality of second blocks is calculated, and the second block having the maximum correlation coefficient is used. A data input means for inputting a motion vector estimated as the motion of the first block and encoded data obtained by encoding a difference value between the first frame and the second frame obtained using the motion vector A difference value extracting unit that extracts a difference value by decoding the encoded data input by the data input unit, and a motion vector input by the data input unit The image data of the second frame, by adding the difference value extracted by the difference value extracting means, and a data addition means for generating image data of the first frame.

In the first aspect of the present invention, the first frame in the input image data is blocked, and the dynamic range of the pixel value of the first block of the blocked first frame is detected. When a second block having a dynamic range closest to the detected dynamic range is detected from a second frame in the image data, and a plurality of second blocks are detected, the DCT coefficient of the first block ; A correlation coefficient with the DCT coefficients of a plurality of second blocks is calculated, and a motion vector of the first block is estimated using the second block having the largest correlation coefficient. Then, the first block is encoded using the estimated motion vector .

In the second aspect of the present invention, the second block of the second frame having the dynamic range closest to the dynamic range of the first block of the first frame in the image data is detected, and a plurality of second blocks are detected. If detected , the correlation coefficient between the DCT coefficient of the first block and the DCT coefficients of the plurality of second blocks is calculated, and the second block having the maximum correlation coefficient is used to calculate the correlation coefficient of the first block. A motion vector estimated as motion and encoded data obtained by encoding a difference value between the first frame and the second frame obtained using the motion vector are input. Then, a difference value is extracted by decoding the input encoded data, and the first difference value is added to the image data of the second frame in accordance with the input motion vector. Frame image data is generated.

In the third aspect of the present invention, the first frame in the input image data is blocked, and the dynamic range of the pixel value of the first block of the blocked first frame is detected. When a second block having a dynamic range closest to the detected dynamic range is detected from a second frame in the image data, and a plurality of second blocks are detected, the DCT coefficient of the first block ; A correlation coefficient with the DCT coefficients of a plurality of second blocks is calculated, and a motion vector of the first block is estimated using the second block having the largest correlation coefficient. Then, the first block is encoded using the estimated motion vector.

In the fourth aspect of the present invention, the second block of the second frame having the dynamic range closest to the dynamic range of the first block of the first frame in the image data is detected, and a plurality of second blocks are detected. If detected , a correlation coefficient between the DCT coefficient of the first block and the DCT coefficients of the plurality of second blocks is calculated, and the second block having the maximum correlation coefficient is used to calculate the first block. A motion vector estimated as motion and encoded data obtained by encoding a difference value between the first frame and the second frame obtained using the motion vector are input. Then, a difference value is extracted by decoding the input encoded data, and the first difference value is added to the image data of the second frame in accordance with the input motion vector. Frame image data is generated.

  According to the present invention, the degree of degradation of image data can be increased by repeating encoding and decoding. Thus, according to the present invention, it is possible to easily suppress copying while maintaining good quality without degrading the quality of output by data before copying.

  Embodiments of the present invention will be described below. Correspondences between constituent elements described in the claims and specific examples in the embodiments of the present invention are exemplified as follows. This description is to confirm that specific examples supporting the invention described in the claims are described in the embodiments of the invention. Accordingly, although there are specific examples that are described in the embodiment of the invention but are not described here as corresponding to the configuration requirements, the specific examples are not included in the configuration. It does not mean that it does not correspond to a requirement. On the contrary, even if a specific example is described here as corresponding to a configuration requirement, this means that the specific example does not correspond to a configuration requirement other than the configuration requirement. not.

  Further, this description does not mean that all the inventions corresponding to the specific examples described in the embodiments of the invention are described in the claims. In other words, this description is an invention corresponding to the specific example described in the embodiment of the invention, and the existence of an invention not described in the claims of this application, that is, in the future, a divisional application will be made. Nor does it deny the existence of an invention added by amendment.

The encoding device of the present invention (for example, the encoding device 63 of FIG. 2) includes blocking means (for example, the blocking unit 111 of FIG. 5) that blocks the first frame in the input image data. Dynamic range detection means (for example, the DR calculation unit 141 in FIG. 6) for detecting the dynamic range of the pixel value of the first block of the first frame blocked by the blocking means, and a second in the image data When a second block having a dynamic range closest to the dynamic range detected by the dynamic range detection unit is detected from the frame, and a plurality of second blocks are detected, a DCT coefficient of the first block and a plurality of second blocks are detected . calculating a correlation coefficient between DCT coefficients of the second block, with the second block of the maximum correlation coefficient, the motion vector of the first block Using a motion estimation unit (for example, the motion vector calculation unit 144 in FIG. 6) and a motion vector estimated by the motion estimation unit (for example, FIG. 5). Residual encoding unit 116).

The image processing apparatus further includes noise adding means (for example, the A / D conversion unit 81 in FIG. 2) for adding noise to the image data and outputting the image data with the noise added. The blocking means adds noise by the noise adding means. The first frame of the processed image data can be blocked.

Using the motion vector estimated by the motion estimation means, difference calculation means (for example, FIG. 5) calculates a difference between the image data of the second frame corresponding to the first block and the image data in the first block. further comprising a residual calculation section 115), the encoding means, the difference calculated by the difference calculation means by encoding, can be encoded first block.

Data output means for outputting the motion vector estimated by the motion estimation means and the first block encoded by the encoding means to the subsequent stage as encoded data (for example, the data synthesis unit 117 in FIG. 5) is further provided. Can

The encoding method of the present invention includes a blocking step (for example, step S21 in FIG. 9) for blocking the first frame in the input image data, and the first block blocked by the processing of the blocking step. The dynamic range detection step (for example, step S63 in FIG. 11) for detecting the dynamic range of the pixel value of the first block of the frame and the second frame in the image data are detected by the processing of the dynamic range detection step. second block detects with the closest dynamic range to the dynamic range, if the second block is more detected, the DCT coefficient of the first block, the phase relationship between the plurality of DCT coefficients of the second block calculating a number by using a second block of maximum correlation coefficient, estimated motion vector of the first block A motion estimation step (for example, step S69 in FIG. 11) and an encoding step for encoding the first block using the motion vector estimated by the process of the motion estimation step (for example, step S24 in FIG. 9). Including.

Note that the first recording medium of the present invention and the first program of the present invention are also basically the same processing as the above-described encoding method of the present invention, and are therefore repeated, so that the description thereof is omitted.

The decoding device of the present invention (for example, the encoding device 63 in FIG. 2) is configured to use the second block of the second frame having the dynamic range closest to the dynamic range of the first block of the first frame in the image data. When a plurality of second blocks are detected , the correlation coefficient between the DCT coefficient of the first block and the DCT coefficient of the plurality of second blocks is calculated, and the second correlation coefficient is the maximum. Using the block, the motion vector estimated as the motion of the first block and the encoded data obtained by encoding the difference value between the first frame and the second frame obtained using the motion vector are input. A data input means (for example, the data decomposing unit 211 in FIG. 15) and a difference value extracting means (for example, a differential value extracting means for extracting the difference value by decoding the encoded data input by the data input means) The difference value extracted by the difference value extraction unit is added to the image data of the second frame in accordance with the motion vector input by the 15 residual decoding units 212) and the data input unit, so that the first Data addition means (for example, the residual addition unit 215 in FIG. 15) for generating image data of the frame.

Noise addition means (for example, the D / A conversion unit 85 in FIG. 2) for adding noise to the image data generated by the data addition means and outputting the image data with the noise added to the subsequent stage can be further provided.

According to the motion vector input by the data input unit , the image processing unit further includes a motion compensation unit (for example, the motion compensation unit 214 in FIG. 15) that predicts the image data of the prediction block from the image data of the second frame. The means can generate the image data of the first frame by adding the difference value extracted by the difference value extraction means to the image data of the prediction block predicted by the motion compensation means .

The decoding method of the present invention detects a second block of a second frame having a dynamic range closest to the dynamic range of the first block of the first frame in the image data, and detects a plurality of second blocks. If the correlation coefficient between the DCT coefficient of the first block and the DCT coefficients of the plurality of second blocks is calculated , the motion of the first block is calculated using the second block having the maximum correlation coefficient. A data input step (for example, step S211 in FIG. 18) for inputting a motion vector estimated as, and encoded data obtained by encoding a difference value between the first frame and the second frame obtained using the motion vector. ) And a difference value extraction step (for example, step of FIG. 18) for extracting the difference value by decoding the encoded data input by the data input step processing 212), and by adding the difference value extracted by the difference value extraction step to the image data of the second frame in accordance with the motion vector input by the processing of the data input step, the first frame Data addition step (for example, step S214 in FIG. 18) for generating the image data.

Note that the second recording medium of the present invention and the second program of the present invention are also basically the same processing as the above-described decoding method of the present invention, and are therefore repeated, so that the description thereof is omitted.

In the first image processing system of the present invention (for example, the image processing system 51 in FIG. 2), the encoding device (for example, the encoding unit 82 in FIG. 2) uses the first frame in the input image data. Blocking means for blocking (for example, the blocking unit 111 in FIG. 5) and dynamic range detecting means for detecting the dynamic range of the pixel value of the first block of the first frame blocked by the blocking means ( for example, a DR calculation unit 141 of FIG. 6), the second frame in the image data, detects a second block having the closest dynamic range to the dynamic range detected by the dynamic range detection section, the second If a block is more detected, calculates a DCT coefficient of the first block, the correlation coefficient between the plurality of DCT coefficients of the second block, Using the second block having the maximum number of relations, a motion estimation unit that estimates the motion vector of the first block (for example, the motion vector calculation unit 144 in FIG. 6) and the motion vector estimated by the motion estimation unit are used. Encoding means (for example, the residual encoding unit 116 in FIG. 5) for encoding the first block.

In the second image processing system of the present invention (for example, the image processing system 51 in FIG. 2), the decoding device (for example, the decoding unit 84 in FIG. 2) is configured to store the first block of the first frame in the image data. detecting a second block of a second frame having the closest dynamic range to the dynamic range, if the second block is more detected, the DCT coefficient of the first block, DCT of the plurality of second blocks A correlation coefficient with the coefficient is calculated , the second block having the maximum correlation coefficient is used, the motion vector estimated as the motion of the first block, the first frame obtained using the motion vector, and the first frame Data input means (for example, the data decomposing unit 211 in FIG. 15) for inputting encoded data in which a difference value between two frames is encoded, and encoded data input by the data input means A difference value extracting unit (for example, the residual decoding unit 212 in FIG. 15) that extracts a difference value by decoding and a difference between the second frame image data according to the motion vector input by the data input unit. A data addition unit (for example, the residual addition unit 215 in FIG. 15) that generates the image data of the first frame by adding the difference values extracted by the value extraction unit is provided.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 2 shows a configuration example of an image processing system 51 to which the present invention is applied. The image processing system 51 again uses a playback device 61 that outputs analog image data Van1, a display 62 that displays an image corresponding to the image data Van1 output from the playback device 61, and analog image data Van1. The encoding unit 63 is configured to perform encoding processing and record encoded image data Vcd (hereinafter also referred to as encoded data Vcd) on a recording medium such as an optical disk (not shown).

  The playback device 61 includes a decoding unit 71 and a D / A (Digital-to-Analog) conversion unit 72. The decoding unit 71 decodes encoded image data reproduced from a recording medium such as an optical disc (not shown), and supplies the decoded digital image data Vdg0 to the D / A conversion unit 72. The D / A conversion unit 72 converts the digital image data Vdg0 from the decoding unit 71 into analog image data Van1, and supplies the converted analog image data Van1 to the display 62.

  The display 62 is composed of, for example, a CRT (Cathode Ray Tube) or an LCD (Liquid Crystal Display), and displays an image corresponding to the analog image data Van1 from the D / A converter 72.

  The encoding device 63 includes an A / D (Analog-to-Digital) conversion unit 81, an encoding unit 82, a recording unit 83, a decoding unit 84, a D / A conversion unit 85, and a display 86.

  The A / D converter 81 converts the analog image data Van1 from the playback device 61 into digital image data Vdg1, and supplies the digital image data Vdg1 to the encoder 82.

  The encoding unit 82 encodes the digital image data Vdg1 from the A / D conversion unit 81 and supplies the encoded data Vcd to the recording unit 83 or the decoding unit 84. In the encoding unit 82, the same encoding process as that of the encoded image data obtained by reproducing from the recording medium in the reproducing apparatus 61 is executed. That is, the encoding unit 82 estimates a motion vector by searching a block having a dynamic range closest to the dynamic range of the search source block of the digital image data Vdg1 from the image data one frame before, Encoded data Vcd is obtained by entropy encoding the residual after motion estimation. Details of the configuration of the encoding unit 82 will be described later.

  The recording unit 83 records the encoded data Vcd from the encoding unit 82 on a recording medium such as an optical disc (not shown). The encoded data Vcd recorded on the recording medium by the recording unit 83 may be read by the recording unit 83 and supplied to the decoding unit 84.

  The decoding unit 84 decodes the encoded data Vcd from the encoding unit 82 or the recording unit 83, and supplies the decoded digital image data Vdg 2 to the D / A conversion unit 85. In the decoding unit 84, a decoding process similar to the decoding in the decoding unit 71 is executed. That is, the decoding unit 84 is configured by an output block obtained by adding a prediction block and a residual block obtained by performing motion compensation and entropy code decoding using the encoded data Vcd from the encoding unit 82, respectively. Get digital image data Vdg2. Details of the configuration of the decoding unit 84 will be described later.

  The D / A conversion unit 85 converts the digital image data Vdg2 from the decoding unit 84 into analog image data Van2, and supplies the converted analog image data Van2 to the display 86. The display 86 is composed of, for example, a CRT or LCD, and displays an image corresponding to the analog image data Van2 from the D / A converter 85.

  As described above, in the image processing system 51, when the motion search is performed by the encoding unit 82, the corresponding block is searched using the dynamic range. Therefore, the dynamic range is changed by the encoding, and accurate motion estimation is performed. It becomes difficult to do.

  In the image processing system 51, when the D / A converter 72 or the D / A converter 85 converts the data into analog data, the A / D converter 81 converts the data into digital data, and the D / A When data is communicated on a communication path between the conversion unit 72 and the A / D conversion unit 81, white noise that is random sandstorm-like noise is added to the converted image data, resulting in high frequency. Component distortion and distortion due to the phase shift of the image data (hereinafter referred to as phase shift) occur. That is, white noise (high-frequency component distortion) and phase-shift distortion (noise) are added to the converted image data. Note that these white noise and phase shift (distortion due to phase shift) are collectively referred to as analog noise (or analog distortion).

  Here, the distortion of the high frequency component caused by white noise will be described. In the process of converting digital image data into analog image data, white noise with a substantially uniform frequency component is added to the image data. The level of white noise changes randomly in time series, and its distribution almost follows a normal distribution. That is, the level of white noise added to the analog image data corresponding to each pixel changes randomly.

  Therefore, for example, in the digital image data Vdg0 before conversion, even if the pixel values of a plurality of pixels in one horizontal line have the same value, they are D / A converted by the D / A converter 72, Further, the pixel value of the pixel having the same value in the digital image data image data Vdg1 after A / D conversion by the A / D conversion unit 81 is centered on the original value (the same value). As a result, the image data is distorted with high frequency components. Similarly, not only the horizontal direction but also the vertical direction is distorted by high frequency components. In addition, depending on the degree of dispersion of the level of white noise added to each pixel, distortion of components other than high-frequency components may occur.

  As described above, in the D / A conversion unit 72 and the D / A conversion unit 85, white noise is added in the process of converting digital image data into analog image data. In the two dimensions, data distortion occurs. Note that the noise added to the image data is not limited to white noise but also includes other colored noise.

  On the other hand, the distortion due to the phase shift adds distortion due to the phase shift to the image data Van1, and when the A / D conversion is performed on the image data Van1, the position where the image data is quantized shifts, and thus the image data Vdg1 The pixel position is, for example, shifted by φh in the horizontal direction and φv in the vertical direction compared to the pixel position of the original image data Vdg0. The horizontal phase shift width φh is smaller or larger than the horizontal pixel interval, while the vertical phase shift width φv is an integral multiple of the vertical pixel interval. Further, the phase shift may occur only in one direction in the horizontal direction or the vertical direction.

  When the phase shift occurs, the display position of the image is shifted by the range of the phase shift. However, the display position shift is slight, and the image quality of the image that can be visually recognized by the user is almost the same. Has no effect.

  As described above, the analog image data Van1 output from the D / A converter 72 and the digital image data Vdg1 from the A / D converter 81 have white noise and phase as compared with the digital image data Vdg0. The analog image data Van2 output from the D / A converter 85 is further accompanied by white noise and a phase shift as compared with the digital image data Vdg1.

  Although the degree of image quality degradation due to these white noise and phase shift is not so great, the encoding unit 82 uses digital image data Vdg1 with white noise and phase shift based on the dynamic range. By executing the encoding process, the dynamic range used for the motion search further changes, and it is further suppressed that the motion estimation and entropy encoding in the encoding unit 82 are accurately performed.

  As a result, the image quality of the encoded data Vcd obtained from the encoding unit 82 and the analog image data Van2 obtained from the decoding unit 84 are greatly deteriorated compared to the image quality of the digital image data Vdg0 and Vdg1. Thus, it is possible to contribute to the prevention of analog copy while displaying an image with little deterioration in image quality.

  In the image processing system 51 of FIG. 2, white noise addition and phase shift are not caused during analog conversion in the D / A conversion unit 72 or D / A conversion unit 85 or in digital conversion in the A / D conversion unit 81. Although it occurs naturally, it is possible to forcibly apply (add) the occurrence of white noise or phase shift more than naturally occurring.

  As a result, the effect of preventing analog copy can be further improved.

  FIG. 3 shows a frame configuration of image data processed in the image processing system 51 according to the present invention.

  In the example of FIG. 3, a frame of image data is shown along the time axis. The image data is composed of reference frames (hatched in the figure) of the 0th frame and the 5th frame and frames other than the reference frame. The reference frame interval is 5 frame intervals, and can be set by the user.

  In the image processing system 51, among these frames, the reference frame uses ADRC (Adaptive Dynamic Range Coding) shown in Patent Document 2 in which the dynamic range is reduced by encoding and decoding, for example. Intra-frame encoding is performed. Then, inter-frame encoding described below is executed for frames other than the reference frame. That is, the following description is directed to interframe coding.

  Next, an example of processing in the image processing system 51 will be described with reference to the flowchart of FIG.

  In step S1, the decoding unit 71 decodes encoded image data reproduced from a recording medium such as an optical disc (not shown), and supplies the decoded digital image data Vdg0 to the D / A conversion unit 72. The process proceeds to step S2. In step S1, processing similar to the decoding processing in step S6 described later is executed.

  In step S2, the D / A conversion unit 72 converts the digital image data Vdg0 from the decoding unit 71 into analog image data Van1, and the converted analog image data Van1 is displayed on the display 62 and the A / D conversion unit. The process proceeds to step S3.

  Thus, in step S3, an image corresponding to the analog image data Van1 is displayed on the display 62.

  In step S4, the A / D conversion unit 81 converts the analog image data Van1 from the D / A conversion unit 72 into digital image data Vdg1, supplies the digital image data Vdg1, and proceeds to step S5. That is, by the conversion of the D / A conversion unit 72 in step S2 and the conversion of the A / D conversion unit 81 in step S4, the digital image data Vdg1 has white noise and phase shift compared to the digital image data Vdg0. Is added.

  In step S5, the encoding unit 82 encodes the digital image data Vdg1 from the A / D conversion unit 81, supplies the encoded data Vcd to the decoding unit 84, and proceeds to step S6. Details of the processing of the encoding unit 82 will be described later.

  Searching for the block having the dynamic range closest to the dynamic range of the search source block of the digital image data Vdg1 to which the white noise and the phase shift are added from the image data of the previous frame by the encoding process of step S5. Thus, the motion vector is estimated, the residual after the motion estimation is entropy-encoded to obtain encoded data Vcd, and the obtained encoded data Vcd is supplied to the decoding unit 84.

  In step S6, the decoding unit 84 decodes the encoded data Vcd from the encoding unit 82, supplies the decoded digital image data Vdg2 to the D / A conversion unit 85, and proceeds to step S7. Details of the processing of the decoding unit 84 will be described later.

  An output block obtained by adding the prediction block and the residual block obtained by performing motion compensation and decoding of the entropy code using the encoded data Vcd encoded by the encoding unit 82 by the decoding process in step S6 is obtained. Digital image data Vdg2 that is generated and configured by the generated output block is acquired.

  In step S7, the D / A conversion unit 85 converts the digital image data Vdg2 from the decoding unit 84 into analog image data Van2, and supplies the converted analog image data Van2 to the display 86. Proceed to S8.

  As a result, in step S8, an image corresponding to the analog image data Van2 is displayed on the display 86, and the image processing is ended in the image processing system 51.

  As described above, in the image processing system 51 according to the present invention, when the motion search is performed by the encoding unit 82, the corresponding block is searched using the dynamic range. The estimation is not accurate.

  That is, the encoded data Vcd obtained from the encoding unit 82 is not very accurate. Therefore, digital copying can be suppressed.

  In the image processing system 51 according to the present invention, the above-described encoding process is executed using the digital image data Vdg1 to which white noise and phase shift are added, and the dynamic range further changes due to the white noise. Further, accurate motion estimation and entropy encoding are further suppressed.

  Since the decoding process is performed using the encoded data Vcd obtained by encoding the digital image data Vdg1 to which white noise and phase shift are added, motion compensation and residual compensation may be accurately performed. It is suppressed.

  As a result, the encoded data Vcd obtained from the encoding unit 82 and the digital image data Vdg2 from the decoding unit 84 obtained by decoding the encoded data Vcd rather than the image displayed on the display 62 in step S4 are digital image data Vdg0. Since the image quality is greatly deteriorated as compared with the analog image data Van1, the image quality of the image displayed on the display 86 in step S8 is deteriorated, and the analog copy can be prevented.

  It should be noted that the encoded data Vcd whose image quality has greatly deteriorated is read out from the recording medium recorded by the recording unit 83, and the decoded result is also equivalent to the image displayed on the display 86 in step S8. .

  Therefore, in step S1 described above, the image data encoded by the encoding unit 32 is read from the recording medium recorded by the recording unit 83, and the encoding of steps S5 and S6 is performed again on the decoded image data. The image quality of the decoded image data is further deteriorated than that of the digital image data Vdg2. That is, every time encoding and decoding according to the present invention are repeated, the image quality of the image data obtained as a result deteriorates more and more.

  As described above, it is possible to contribute to the prevention of analog copy.

  Next, details of the configuration of the encoding unit 82 in FIG. 2 will be described.

  FIG. 5 is a block diagram showing a configuration of the encoding unit 82. The encoding unit 82 receives the digital image data Vdg1 accompanied by white noise or phase shift from the A / D conversion unit 81, encodes the input digital image data Vdg1, and the encoded data Vcd becomes the subsequent stage. To the recording unit 83 or the decoding unit 84.

  The encoding unit 82 includes a blocking unit 111, a frame memory 112, a motion estimation unit 114, a residual calculation unit 115, a residual encoding unit 116, and a data synthesis unit 117.

  The digital image data Vdg1 from the A / D conversion unit 81 is input to the blocking unit 111 and the frame memory 112. The blocking unit 111 reads an input image, divides it into designated block sizes (for example, 4 × 4 pixels or 8 × 8 pixels), and performs motion estimation for each block using image data of the designated block size as an input block To the unit 114 and the residual calculation unit 115.

  The frame memory 112 accumulates image data of the previous frame (hereinafter also referred to as the previous frame) and supplies the image data to the motion estimation unit 114 and the residual calculation unit 115.

  The motion estimation unit 114 reads the input block supplied from the blocking unit 111 and the previous frame from the frame memory 112, calculates the dynamic range DRin of the input block, and calculates the dynamic range DR closest to the calculated dynamic range DRin. A motion vector is calculated (estimated) by searching for a block having the previous frame, and the calculated motion vector is supplied to the residual calculation unit 115 and the data synthesis unit 117.

  As a result of the search, when a plurality of blocks having the dynamic range DR closest to the dynamic range DRin are searched from the previous frame, the motion estimation unit 114 performs DCT (Discrete Cosine Transform) of the input block and the searched blocks. ) Coefficient is obtained, the correlation coefficient between the DCT coefficient of the input block and the DCT coefficient of the plurality of blocks is calculated, and the motion vector is calculated using the block having the maximum correlation coefficient among the plurality of blocks.

  That is, when a motion vector is estimated by the correlation coefficient of the DCT coefficient in the motion estimator 114, even if white noise or a phase shift is added to the input image data, the motion vector estimation fails too much. There is nothing. Therefore, by obtaining a block having the closest dynamic range before obtaining a block having the maximum correlation coefficient of DCT coefficients from the previous frame, an incorrect motion vector (block) is detected, and motion vector estimation fails. It becomes like this.

  Further, since the calculation of the correlation coefficient of the DCT coefficient is heavy, before obtaining the block having the maximum correlation coefficient of the DCT coefficient, the block having the closest dynamic range is obtained and the correlation coefficient calculation candidate of the DCT coefficient is calculated. By narrowing down, the processing for calculating the correlation coefficient of the DCT coefficient becomes light.

  The residual calculation unit 115 calculates a residual after motion estimation. That is, the residual calculation unit 115 reads the input block from the blocking unit 111, the motion vector from the motion estimation unit 114, and the previous frame from the frame memory 112. The residual calculation unit 115 generates a pixel value of the prediction block using the motion vector and the previous frame, and obtains the prediction block. The residual calculation unit 115 supplies the obtained prediction block and the residual of the input block to the residual encoding unit 116 as a residual block.

  The residual encoding unit 116 reads the residual block from the residual calculation unit 115 and encodes the read residual block using JPEG (Joint Photographic Coding Experts Group). That is, the residual encoding unit 116 performs DCT transform (discrete cosine transform) on the residual block, and uses the general quantization table 121 built in the encoding unit 82 for the DCT-transformed residual block. Then, entropy encoding is performed, and entropy code data obtained by entropy encoding is supplied to the data synthesis unit 117.

  The data synthesis unit 117 reads the motion vector from the motion estimation unit 114 and the entropy code data from the residual encoding unit 116, and uses the motion vector and the entropy code data as the encoded data Vcd as a subsequent recording unit 83. Alternatively, the data is output to the decoding unit 84.

  As described above, the motion estimation unit 114 estimates (calculates) a motion vector by searching for a block having a dynamic range closest to the dynamic range of the input block of the digital image data Vdg1. As a result, the dynamic range changes, and accurate motion estimation becomes difficult.

  Furthermore, when a plurality of blocks having a dynamic range closest to the dynamic range of the input block are searched, a motion vector is calculated by performing a comparison using a correlation coefficient of DCT coefficients (that is, frequency components). Therefore, it is possible to suppress the search for a large number of blocks including too different pixels in the case of only the search based on the dynamic range. For example, it is possible to search for a relatively similar block compared to a case where comparison is performed at the pixel level.

  In addition, since the digital image data Vdg1 input from the A / D conversion unit 81 is added with white noise and phase shift, the dynamic range used by the motion estimation unit 114 changes more and more. It is even more difficult to perform motion estimation accurately.

  As described above, the motion vector obtained by the motion estimation unit 114 is not necessarily accurate, and the entropy code data obtained by encoding the residual after motion estimation obtained using the motion vector is not necessarily accurate. . Therefore, the image quality of the digital image data Vdg2 obtained by decoding using the encoded data Vcd by the decoding unit 84 deteriorates. Thereby, analog copy is suppressed.

  In the example of FIG. 5, the residual block obtained by the residual calculation unit 115 is obtained by estimating the motion vector using the correlation coefficient of the DCT coefficient in the motion estimation unit 114, so that the waveform has a low frequency. There are often. Therefore, the residual encoding unit 116 encodes the residual block by the JPEG method using the DCT transform, thereby greatly reducing the low frequency of the residual block and improving the compression rate by encoding. However, the encoding method in the residual encoding unit 116 is not limited to the JPEG method, and the same effect can be obtained in image quality deterioration of the digital image data Vdg2 even if other entropy encoding is used.

  FIG. 6 shows a configuration example of the motion estimation unit 114 of FIG.

  In the example of FIG. 6, the motion estimation unit 114 includes a DR (Dynamic Range) calculation unit 141, a DR block search unit 142, a DCT block search unit 143, and a motion vector calculation unit 144.

  The DR calculation unit 141 reads the input block supplied from the blocking unit 111 and the previous frame from the frame memory 112. The DR calculation unit 141 calculates the dynamic range DRin from the maximum value and the minimum value of the pixels of the input block. Also, the DR calculation unit 141 divides the previous frame into designated block sizes, and calculates the dynamic range DR of all blocks of the previous frame. The DR calculation unit 141 supplies a block corresponding to the calculated dynamic range to the DR block search unit 142.

  The DR block search unit 142 compares the dynamic range DRin of the input block calculated by the DR calculation unit 141 with the dynamic range DR of the block of the previous frame, and searches for a block having the dynamic range DR closest to the dynamic range DRin. . When there is one searched block, the DR block search unit 142 determines that the searched block is a block of the previous frame corresponding to the input block, supplies the determined block and the input block to the motion vector calculation unit 144, When there are a plurality of searched blocks, the searched blocks and input blocks are supplied to the DCT block search unit 143.

  The DCT block search unit 143 obtains DCT coefficients of a plurality of blocks and input blocks searched by the DR block search unit 142, calculates a correlation coefficient between the DCT coefficients of the input block and the DCT coefficients of the plurality of blocks, Among the blocks, the block having the maximum correlation coefficient is determined to be the block of the previous frame corresponding to the input block, and the determined block and the input block are supplied to the motion vector calculation unit 144.

  Note that the DCT block search unit 143 in FIG. 6 determines the previous frame block corresponding to the input block based on the correlation of the DCT coefficients. However, if the waveform is a frequency component or the like, the FFT may be used. Well, not limited to DCT coefficients.

  The motion vector calculation unit 144 calculates a motion vector based on the block determined by the DR block search unit 142 or the DCT block search unit 143, and supplies the calculated motion vector to the residual calculation unit 115 and the data synthesis unit 117. To do.

  FIG. 7 shows a configuration example of the residual calculation unit 115 of FIG.

  In the example of FIG. 7, the residual calculation unit 115 includes a prediction block calculation unit 151 and a residual calculation unit 152.

  The prediction block calculation unit 151 reads the motion vector from the motion estimation unit 114 and the previous frame from the frame memory 112, generates a pixel value of the prediction block using the motion vector and the previous frame, obtains a prediction block, The obtained prediction block is supplied to the residual calculation unit 152.

  The residual calculation unit 152 reads the input block from the blocking unit 111 and the prediction block from the prediction block calculation unit 151, calculates the residual between the input block and the prediction block, and uses the calculated residual as the residual block. Is supplied to the residual encoding unit 116.

  FIG. 8 shows a configuration example of the residual encoding unit 116 of FIG.

  In the example of FIG. 8, the residual encoding unit 116 includes a DCT coefficient conversion unit 161, a quantization unit 162, and a run length encoding unit 163.

  The DCT coefficient conversion unit 161 reads the residual block from the residual calculation unit 152, converts the read residual block into a DCT coefficient, and supplies the converted DCT coefficient to the quantization unit 162.

  The quantization unit 162 reads the DCT coefficient converted by the DCT coefficient conversion unit 161 and the quantization table 121, quantizes the DCT coefficient (scalar quantization) using the quantization table 121, and generates quantized data. And supplied to the run-length encoding unit 163.

  The run-length encoding unit 163 performs zigzag scanning on the quantized data from the quantization unit 162, and then performs run-length encoding, and supplies the run-length encoded data to the data synthesis unit 117 as entropy code data. .

  Next, the encoding process of the encoding unit 82 in FIG. 5 will be described with reference to the flowchart in FIG. 9. This encoding process is the encoding process of step S5 in the process of the encoding device 63 described above with reference to FIG.

  Digital image data Vdg1 from the A / D conversion unit 81 is input to the blocking unit 111 and the frame memory 112 of the encoding unit 82. The image data of the previous frame input and stored in the frame memory 112 is supplied to the motion estimation unit 114 and the residual calculation unit 115.

  When the digital image data Vdg1 from the A / D conversion unit 81 is input, the blocking unit 111 executes a blocking process in step S21. This blocking process will be described later in detail with reference to FIG.

  By the blocking process of step S21, the read input image is divided into designated block sizes, and the divided image data is supplied as input blocks to the motion estimation unit 114 and the residual calculation unit 115 for each block. The process proceeds to step S22.

  When the input block is input from the blocking unit 111, the motion estimation unit 114 performs a motion estimation process using the input block and the previous frame in step S22. This motion estimation process will be described later in detail with reference to FIG.

  A motion vector is calculated by searching for a block having a dynamic range closest to the dynamic range of the input block from the previous frame by the motion estimation process in step S23. Then, the calculated motion vector is supplied to the residual calculation unit 115 and the data synthesis unit 117, and the process proceeds to step S24.

  When the motion vector is supplied from the motion estimation unit 114, the residual calculation unit 115 executes a residual calculation process in step S23. This residual calculation process will be described later in detail with reference to FIG.

  By the residual calculation process in step S23, the pixel value of the prediction block is generated using the motion vector from the motion estimation unit 114 and the previous frame from the frame memory 112, and the prediction block is obtained. Then, the obtained prediction block and the residual of the input block from the blocking unit 111 are supplied as a residual block to the residual encoding unit 116, and the process proceeds to step S24.

  When the residual block is supplied from the residual calculation unit 115, the residual encoding unit 116 executes a residual encoding process in step S24. This residual encoding process will be described later in detail with reference to FIG.

  By the residual encoding process in step S24, the residual block from the residual calculation unit 115 is converted into DCT coefficients, quantized using the quantization table 121, run-length encoded, and as entropy code data. The data is supplied to the data synthesis unit 117, and the process proceeds to step S25.

  When the entropy code data is input from the residual encoding unit 116, the data synthesis unit 117 performs a data synthesis process in step S25. This data composition processing will be described later in detail with reference to FIG.

  Through the data synthesis process in step S25, the motion vector from the motion estimation unit 114 and the entropy code data from the residual encoding unit 116 are synthesized as encoded data Vcd and output to the recording unit 83 or the decoding unit 84 in the subsequent stage. Is done.

  As described above, the encoding process of the encoding unit 82 is terminated, and the process returns to step S5 in FIG. 4 and proceeds to step S6, where the decoding process is executed.

  Next, the blocking process of the blocking unit 111 in FIG. 5 in step S21 in FIG. 9 will be described with reference to the flowchart in FIG.

  In step S41, the block forming unit 111 reads the digital image data Vdg1 input from the A / D conversion unit 81 as an input image, proceeds to step S42, and converts the input image into a designated block (for example, 4 × 4 pixels or 8 X8 pixels, etc.), and the process proceeds to step S43.

  In step S43, the blocking unit 111 supplies the divided image data of the designated block size as an input block to the motion estimation unit 114 and the residual calculation unit 115 for each block, ends the blocking process, Returning to step S21 of step 9, the process proceeds to step S22.

  Next, the motion estimation process of the motion estimation unit 114 in FIG. 5 in step S22 in FIG. 9 will be described with reference to the flowchart in FIG.

  In step S61, the DR calculation unit 141 reads the input block supplied from the blocking unit 111, proceeds to step S62, reads the previous frame from the frame memory 112, and proceeds to step S63.

  In step S63, the DR calculation unit 141 calculates the dynamic range DRin from the maximum value and the minimum value of the pixels of the input block, supplies the calculated dynamic range DRin and the input block to the DR block search unit 142, and proceeds to step S64. . At this time, the DR calculation unit 141 also calculates the dynamic range DR of each block divided into the designated block size in the previous frame, and supplies the calculated dynamic range DR and the previous frame to the DR block search unit 142.

  In step S64, the DR block searching unit 142 compares the dynamic range DRin of the input block calculated by the DR calculating unit 141 with the dynamic range DR of the block of the previous frame, and the dynamic closest to the dynamic range DRin from the previous frame. The block having the range DR is searched, and the process proceeds to step S65.

  In step S65, the DR block search unit 142 determines whether or not a plurality of blocks having a dynamic range DR closest to the dynamic range DRin of the input block has been searched in step S65. In this case, the searched block and input block are supplied to the DCT block search unit 143, and the process proceeds to step S66.

  In step S66, the DCT block search unit 143 obtains DCT coefficients of a plurality of blocks and input blocks searched by the DR block search unit 142, and calculates a correlation coefficient between the DCT coefficients of the input block and the DCT coefficients of the plurality of blocks. Then, the calculated correlation coefficients of the DCT coefficients are compared, and the process proceeds to step S67.

  As a result of comparing the correlation coefficients of the DCT coefficients, the DCT block search unit 143 determines, in step S67, the block with the largest correlation coefficient among the plurality of blocks as the block of the previous frame corresponding to the input block. The processed block and the input block are supplied to the motion vector calculation unit 144, and the process proceeds to step S69.

  On the other hand, if the DR block search unit 142 determines in step S65 that only one block having the dynamic range DR closest to the dynamic range DRin of the input block has been searched, the process proceeds to step S68, and the searched block is the input block. And the determined block and the input block are supplied to the motion vector calculation unit 144, and the process proceeds to step S69.

  In step S69, the motion vector calculation unit 144 calculates a motion vector based on the block determined by the DR block search unit 142 or the DCT block search unit 143, and uses the calculated motion vector as the residual calculation unit 115 and the data synthesis. Is supplied to the unit 117, the motion estimation process is terminated, the process returns to step S22 in FIG. 9, and the process proceeds to step S23.

  Next, the residual calculation processing of the residual calculation unit 115 in FIG. 5 in step S23 in FIG. 9 will be described with reference to the flowchart in FIG.

  In step S101, the residual calculation unit 152 reads the input block supplied from the blocking unit 111, and proceeds to step S102.

  In step S102, the prediction block calculation unit 151 reads the motion vector supplied from the motion estimation unit 114, proceeds to step S103, reads the previous frame supplied from the frame memory 112, and proceeds to step S104.

  In step S104, the prediction block calculation unit 151 generates a pixel value of the prediction block using the motion vector from the motion estimation unit 114 and the previous frame from the frame memory 112, obtains a prediction block, and obtains the prediction block Is supplied to the residual calculation unit 152, and the process proceeds to step S105.

  In step S105, the residual calculation unit 152 calculates the residual of the input block from the blocking unit 111 and the prediction block from the prediction block calculation unit 151, and uses the calculated residual as the residual block. This is supplied to the encoding unit 116, the residual calculation process is terminated, the process returns to step S23 in FIG. 9, and the process proceeds to step S24.

  Next, the residual encoding process of the residual encoding unit 116 of FIG. 5 in step S24 of FIG. 9 will be described with reference to the flowchart of FIG.

  In step S121, the DCT coefficient conversion unit 161 reads the residual block from the residual calculation unit 152, proceeds to step S122, DCT-transforms the read residual block, acquires the DCT coefficient, and acquires the acquired DCT coefficient. The data is supplied to the quantization unit 162, and the process proceeds to step S123.

  When the DCT coefficient is supplied from the DCT coefficient conversion unit 161, the quantization unit 162 reads the quantization table 121 in step S123, proceeds to step S124, and quantizes the DCT coefficient using the read quantization table 121. The quantized quantized data is supplied to the run-length encoding unit 163, and the process proceeds to step S125.

  When the quantized data is supplied from the quantizing unit 162, the run-length encoding unit 163 performs zigzag scanning on the quantized data (that is, the quantized DCT coefficient) in step S125, and proceeds to step S126. The scanned quantized data is run-length encoded, and the run-length encoded data is supplied as entropy code data to the data synthesis unit 117, the residual encoding process is terminated, and the process returns to step S24 in FIG. Proceed to step S25.

  Next, the data composition processing of the data composition unit 117 in FIG. 5 in step S25 in FIG. 10 will be described with reference to the flowchart in FIG.

  In step S141, the data synthesis unit 117 reads the entropy code data supplied from the residual encoding unit 116, proceeds to step S142, reads the motion vector supplied from the motion estimation unit 114, and proceeds to step S143.

  In step S143, the data synthesis unit 117 synthesizes the entropy code data and the motion vector, and supplies them as encoded data Vcd to the subsequent recording unit 83 or decoding unit 84.

  Then, the data synthesis unit 117 ends the data synthesis process, returns to step S25 in FIG. 9, ends the encoding process in FIG. 9, returns to step S5 in FIG. 4, and proceeds to step S6.

  As described above, in the encoding unit 82, a block having a dynamic range closest to the dynamic range of the input block is searched from the previous frame, and a motion vector is calculated based on the searched block. As a result, the dynamic range changes, and motion vector estimation often fails, making accurate motion estimation difficult.

  Therefore, digital copy and analog copy are suppressed.

  In addition, when a plurality of blocks having a dynamic range closest to the dynamic range of the input block are searched, a motion vector is calculated by performing a comparison using a correlation coefficient of DCT coefficients (that is, frequency components). Therefore, searching for a block including too different pixels can be suppressed a little.

  Further, the motion vector is obtained from the previous frame by searching for a block having a dynamic range closest to the dynamic range by the motion estimation unit 114, and the A / D conversion unit 81. Since the digital image data Vdg1 inputted from is added with white noise and phase shift, the dynamic range is further changed, and many of them are erroneously estimated, which is not sure.

  Therefore, the entropy-encoded data obtained by encoding the residual after motion estimation obtained using this motion vector is not very accurate. As a result, the image quality of the digital image data Vdg2 obtained by decoding using the encoded data Vcd by the decoding unit 84 deteriorates.

  As described above, the analog copy is further suppressed by the encoding by the encoding unit 82.

  Next, details of the configuration of the decoding unit 84 of FIG. 2 will be described.

  FIG. 15 is a block diagram illustrating a configuration of the decoding unit 84. The decoding unit 84 receives the encoded data Vcd from the encoding unit 82 or the recording unit 83, decodes the encoded data Vcd, and supplies it as digital image data Vdg2 to the D / A conversion unit 85 at the subsequent stage. .

  The decoding unit 84 includes a data decomposing unit 211, a residual decoding unit 212, a frame memory 213, a motion compensation unit 214, a residual adding unit 215, and a data combining unit 216.

  The data decomposition unit 211 receives the encoded data Vcd from the encoding unit 82 (or the recording unit 83), decomposes the motion vector and entropy code data from the encoded data Vcd, and converts the motion vector into the motion compensation unit 214. And the entropy code data is supplied to the residual decoding unit 212.

  The residual decoding unit 212 reads the entropy code data from the data decomposition unit 211 and performs residual compensation. That is, the residual decoding unit 212 decodes entropy code data, performs inverse quantization using a general quantization table 121 built in the decoding unit 84, and obtains a value obtained by the inverse quantization, Residual blocks are obtained by inverse DCT transformation, and the obtained residual blocks are supplied to the residual adder 215.

  The frame memory 213 stores the digital image data Vdg2 from the data combination unit 216, and the frame memory 213 supplies the image data of the previous frame to the motion compensation unit 214.

  The motion compensation unit 214 obtains a motion estimation destination block from the previous frame read from the frame memory 213 based on the motion vector from the data decomposition unit 211, obtains a prediction block from the obtained block, and obtains the obtained prediction The block is supplied to the residual adder 215.

  The residual addition unit 215 adds the residual block obtained by the residual decoding unit 212 to the prediction block obtained by the motion compensation unit 214, obtains an output block, and determines the obtained output block as the data combining unit 216. To supply.

  The data combination unit 216 has an output image area in a built-in memory (not shown), writes the image data of the output block from the residual addition unit 215 to the output image area, and all the output blocks are written. At this time, the image data written in the output image area is supplied as digital image data Vdg2 to the D / A conversion unit 85 in the subsequent stage and written into the frame memory 213.

  As described above, in the decoding unit 84 of FIG. 15, the prediction block obtained by the motion compensation unit 214 is acquired based on the motion vector obtained by the encoding unit 82 which is not very certain. The residual block obtained by the residual decoding unit 212 is also obtained based on the motion vector in the encoding unit 82.

  That is, neither the motion compensation performed by the motion compensation unit 214 nor the residual compensation performed by the residual decoding unit 212 is necessarily accurate. Therefore, the image quality of the digital image data Vdg2 including the output block generated by adding the prediction block and the residual block deteriorates. Thereby, analog copy is suppressed.

  FIG. 16 shows a configuration example of the residual decoding unit 212 of FIG.

  In the example of FIG. 18, the residual decoding unit 212 includes a run length decoding unit 221, an inverse quantization unit 222, and an inverse DCT transform unit 223.

  The run-length decoding unit 221 reads the entropy code data from the data decomposing unit 211, performs the run-length decoding on the read entropy code data, and the run-length decoded data, that is, the quantized data, is sent to the inverse quantization unit 222. Supply.

  The inverse quantization unit 222 reads a general quantization table 121, uses the read quantization table 121, inversely quantizes the quantized data that has been run-length decoded by the run-length decoding unit 221, and performs inverse quantization. The obtained value (ie, DCT coefficient) is supplied to the inverse DCT transform unit 223.

  The inverse DCT transformation unit 223 obtains a residual block by performing inverse DCT transformation on the DCT coefficient inversely quantized by the inverse quantization unit 222 and supplies the obtained residual block to the residual addition unit 215. To do.

  FIG. 17 shows a configuration example of the motion compensation unit 214 of FIG.

  In the example of FIG. 17, the motion compensation unit 214 includes a motion compensation processing unit 231 and a prediction block acquisition unit 232.

  The motion compensation processing unit 231 reads the motion vector supplied from the data decomposition unit 211 and reads the previous frame from the frame memory 213. Then, the motion compensation processing unit 231 obtains a motion estimation destination block from the previous frame from the frame memory 213 based on the motion vector from the data decomposing unit 211.

  The prediction block acquisition unit 232 acquires a prediction block from the motion estimation destination block obtained by the motion compensation processing unit 231, and supplies the acquired prediction block to the residual addition unit 215.

  Next, the decoding process of the decoding unit 84 in FIG. 15 will be described with reference to the flowchart in FIG. This encoding process is the decoding process in step S6 in the process of the encoding device 63 described above with reference to FIG.

  The encoded data Vcd is supplied from the encoding unit 82 (or recording unit 83) to the data decomposition unit 211 of the decoding unit 84. When the encoded data Vcd is supplied, the data decomposing unit 211 performs a data decomposing process in step S211. This data decomposition process will be described later in detail with reference to FIG.

  The encoded data Vcd from the encoding unit 82 is decomposed by the data decomposition processing in step S211, the decomposed motion vector is supplied to the motion compensation unit 214, and the entropy code data is supplied to the residual decoding unit 212. The process proceeds to step S212.

  When entropy code data is supplied from the data decomposing unit 211, the residual decoding unit 212 performs a residual decoding process in step S212. This residual decoding process will be described later in detail with reference to FIG.

  The entropy code data is run-length decoded by the residual decoding process in step S212, and the inverse quantization is performed using the run-length decoded quantization data and the quantization table 121, and the value obtained by the inverse quantization. Are subjected to inverse DCT transform to obtain a residual block, which is supplied to the residual adding unit 215, and the process proceeds to step S213.

  When the motion vector is supplied from the data decomposing unit 211, the motion compensating unit 214 executes a motion compensation process in step S213. This motion compensation process will be described later in detail with reference to FIG.

  Based on the motion vector from the data decomposing unit 211, the motion estimation destination block is obtained from the previous frame read from the frame memory 213 by the motion compensation processing in step S213, and the prediction block is obtained from the obtained block. The obtained prediction block is supplied to the residual adding unit 215, and the process proceeds to step S214.

  When the prediction block is supplied from the motion compensation unit 214, the residual addition unit 215 performs residual addition processing in step S214. This residual addition process will be described later in detail with reference to FIG.

  By the residual addition process in step S214, the residual block from the residual decoding unit 212 is added to the prediction block from the motion compensation unit 214 and is supplied to the data combining unit 216 as an output block, and the process proceeds to step S215. move on.

  When the output block is supplied from the residual adding unit 215, the data combining unit 216 executes data combining processing in step S215. This data combination process will be described later in detail with reference to FIG.

  The image data of the output block from the residual adding unit 215 is written in the output image area by the data combination processing in step S215, and the image data written in the output image area when all the output blocks are written. Is supplied as digital image data Vdg2 to the D / A conversion unit 85 in the subsequent stage, the decoding process ends, the process returns to step S6 in FIG. 4, and proceeds to step S7.

  Next, the data decomposition process of the data decomposition unit 211 in FIG. 15 in step S211 in FIG. 18 will be described with reference to the flowchart in FIG.

  In step S231, the data decomposing unit 211 receives the encoded data Vcd supplied from the encoding unit 82, proceeds to step S232, and decomposes the input encoded data Vcd.

  That is, in step S232, the data decomposing unit 211 decomposes the motion vector and entropy code data from the encoded data Vcd, and proceeds to step S233.

  In step S233, the data decomposition unit 211 supplies the decomposed motion vector to the motion compensation unit 214, supplies the decomposed entropy code data to the residual decoding unit 212, ends the data decomposition process, and performs the step of FIG. It returns to S211 and progresses to step S212.

  Next, the residual decoding process of the residual decoding unit 212 in FIG. 15 in step S212 in FIG. 18 will be described with reference to the flowchart in FIG.

  In step S251, the run-length decoding unit 221 reads the entropy code data supplied from the data decomposition unit 211, proceeds to step S252, and performs run-length decoding on the read entropy code data, that is, the run-length decoded data, that is, The quantized data is obtained, the quantized data is supplied to the inverse quantization unit 222, and the process proceeds to step S253.

  In step S253, the inverse vector quantization unit 221 reads the quantization table 121, proceeds to step S254, performs inverse quantization using the quantization data from the run-length decoding unit 221 and the quantization table 121, and performs inverse quantization. The value (that is, the DCT coefficient) obtained by the conversion is supplied to the inverse DCT transform unit 223, and the process proceeds to step S255.

  The quantization table 121 is a general quantization table and is stored in advance in the decoding unit 84.

  In step S <b> 255, the inverse DCT transform unit 223 obtains a residual block by performing inverse DCT transform on the DCT coefficient from the inverse vector quantization unit 221, and supplies the obtained residual block to the residual addition unit 215. Then, the residual decoding process ends, the process returns to step S212 in FIG. 18, and the process proceeds to step S213.

  Next, the motion compensation processing of the motion compensation unit 214 in FIG. 15 in step S213 in FIG. 18 will be described with reference to the flowchart in FIG.

  In step S271, the motion compensation processing unit 231 reads the motion vector supplied from the data decomposition unit 211, proceeds to step S272, reads the previous frame from the frame memory 213, and proceeds to step S273.

  In step S273, the motion compensation processing unit 231 obtains a motion estimation destination block from the previous frame from the frame memory 213 based on the motion vector from the data decomposition unit 211, and proceeds to step S274.

  In step S274, the prediction block acquisition unit 232 acquires a prediction block from the motion estimation destination block obtained by the motion compensation processing unit 231, and supplies the acquired prediction block to the residual addition unit 215 for motion compensation processing. Is finished, the process returns to step S213 in FIG. 18, and proceeds to step S214.

  Next, the residual addition process of the residual addition unit 215 in FIG. 15 in step S214 in FIG. 18 will be described with reference to the flowchart in FIG.

  In step S291, the residual addition unit 215 reads the residual block supplied from the residual decoding unit 212, proceeds to step S292, reads the prediction block supplied from the motion compensation unit 214, and proceeds to step S293.

  In step S293, the residual addition unit 215 obtains an output block by adding the residual block from the residual decoding unit 212 to the prediction block from the motion compensation unit 214, and the obtained output block is subjected to data combination. To the unit 216, the residual addition process is terminated, the process returns to step S214 in FIG. 18, and the process proceeds to step S215.

  Next, the data combining process of the data combining unit 216 in FIG. 15 in step S215 in FIG. 18 will be described with reference to the flowchart in FIG.

  In step S311, the data combination unit 216 inputs all output blocks supplied from the residual addition unit 215 (that is, all blocks corresponding to the input image input by the blocking unit 111 of the encoding unit 82). The process proceeds to step S312.

  In step S312, the data combination unit 216 writes the image data of the output block to the output image area, proceeds to step S313, determines whether writing of all the output blocks is completed, and writes all of the output blocks. If it is determined that the process has not ended, the process returns to step S312 to repeat the subsequent processes.

  If the data combination unit 216 determines in step S313 that writing of all output blocks has been completed, the process proceeds to step S314, in which the image data written in the output image area is converted into digital image data Vdg2, and the subsequent D The data is supplied to the / A converter 85 and written to the frame memory 213, and the process proceeds to step S215 in FIG. 18, the decoding process in FIG. 18 is terminated, the process returns to step S6 in FIG. 4, and the process proceeds to step S7.

  As described above, in the decoding unit 84, motion compensation is performed using the motion vector estimated based on the block having the closest dynamic range by the encoding unit 82, so that a prediction block obtained by motion compensation is used. The image quality of the image data generated in this way deteriorates.

  Further, in the decoding unit 84, residual compensation is performed using entropy code data obtained by JPEG encoding of the residual after motion estimation obtained by using the motion vector by the encoding unit 82. The image quality of the image data generated using the residual block obtained by the compensation is deteriorated.

  Therefore, analog copying can be suppressed.

  As described above, in the image processing system 51 according to the present invention, the encoding process is executed using the digital image data Vdg1 to which white noise and phase shift are added. Accurate entropy encoding is suppressed.

  In the image processing system 51 according to the present invention, since the decoding process is executed using the encoded data Vcd obtained by encoding the digital image data Vdg1 to which white noise and phase shift are added, motion compensation is performed. And the residual compensation is suppressed from being performed accurately.

  As described above, the encoded data Vcd obtained from the encoding unit 82 and the digital image data Vdg2 from the decoding unit 84 obtained by decoding the encoded data Vcd greatly deteriorate in image quality compared with the digital image data Vdg0 and the analog image data Van1. End up. This can contribute to prevention of analog copy.

  In the above description, the decoding unit 84 of the encoding device 63 has been described. However, the decoding unit 71 of the reproduction device 61 has the same configuration, and the same processing is executed. Therefore, the encoding and decoding according to the present invention may be repeatedly performed. In this case, the image quality of the resulting image data is further deteriorated every time it is repeated. It is effective in contributing to prevention.

  Further, in the present embodiment, the block for performing each process has been described as being configured by, for example, 8 pixels × 8 pixels, 4 pixels × 4 pixels, and the like. However, these are examples, and each process is performed. The number of pixels constituting the block to be performed is not limited to the number of pixels.

  The series of processes described above can be executed by hardware, but can also be executed by software. In this case, the playback device 61 and the encoding device 63 in FIG. 2 are configured by, for example, a personal computer 301 as shown in FIG.

  As illustrated in FIG. 24, the CPU 311 executes various processes according to a program recorded in a ROM (Read Only Memory) 312 or a program loaded from a storage unit 318 to a RAM (Random Access Memory) 313. The RAM 313 also appropriately stores data necessary for the CPU 311 to execute various processes.

  The CPU 311, the ROM 312, and the RAM 313 are connected to each other via the bus 314. An input / output interface 315 is also connected to the bus 314.

  The input / output interface 315 includes an input unit 316 including a keyboard and a mouse, a display such as a CRT and an LCD (for example, the display 62 and the display 86 in FIG. 2), an output unit 317 including a speaker, a hard disk, and the like. A communication unit 319 including a storage unit 318, a modem, a terminal adapter, and the like is connected. The communication unit 319 performs communication processing with other information processing apparatuses via a network (not shown) including the Internet.

  A drive 320 is connected to the input / output interface 315 as necessary, and a removable recording medium including a magnetic disk 321, an optical disk 322, a magneto-optical disk 323, a semiconductor memory 324, or the like is appropriately mounted and read from them. The computer program thus installed is installed in the storage unit 318 or the like as necessary.

  That is, the drive 320 corresponds to the recording unit 83 in FIG.

  When a series of processing is executed by software, a program constituting the software may execute various functions by installing a computer incorporated in dedicated hardware or various programs. For example, it is installed from a network or a recording medium into a general-purpose personal computer or the like.

  For example, software having functions such as the decoding unit 71 and the D / A conversion unit 72, the A / D conversion unit 81, the encoding unit 82, the decoding unit 84, and the D / A conversion unit 85 in FIG. The program to be configured is installed. Note that the form of the program is not particularly limited as long as the above-described series of processes can be executed as a whole. For example, the module configuration may include a module corresponding to each of the blocks described above, a module in which some or all of the functions of several blocks are combined, or the functions of the blocks are divided. It may be a module configuration made up of modules. Or the program which has only one algorithm may be sufficient.

  As shown in FIG. 24, the recording medium including such a program is distributed to provide a program to the user separately from the apparatus main body, and includes a magnetic disk 321 (including a floppy disk) on which the program is recorded. ), Optical disk 322 (including compact disk-read only memory (CD-ROM), DVD (digital versatile disk)), magneto-optical disk 323 (including MD (mini-disk)), or semiconductor memory 324, etc. In addition to being configured by a recording medium (package medium), it is configured by a ROM 312 on which a program is recorded, a storage unit 318, and the like provided to the user in a state of being incorporated in the apparatus main body in advance.

  Here, in this specification, the processing steps for describing a program for causing a computer to perform various types of processing do not necessarily have to be processed in time series according to the order described in the flowchart, but in parallel or individually. This includes processing to be executed (for example, parallel processing or processing by an object).

  Further, the program may be processed by a single computer, or may be distributedly processed by a plurality of computers. Furthermore, the program may be transferred to a remote computer and executed.

  In the present specification, the term “system” represents the entire apparatus constituted by a plurality of apparatuses.

It is a block diagram which shows the structural example of the conventional image processing system. It is a block diagram which shows the structural example of the image processing system to which this invention is applied. It is a figure which shows the structure of the flame | frame of image data. It is a flowchart explaining the process of the image processing system of FIG. FIG. 3 is a block diagram illustrating a configuration example of an encoding unit of the encoding device in FIG. 2. It is a block diagram which shows the structural example of the motion estimation part of FIG. It is a block diagram which shows the structural example of the residual calculation part of FIG. It is a block diagram which shows the structural example of the residual encoding part of FIG. 5 is a flowchart for describing an encoding process of an encoding unit in FIG. 2 in step S5 in FIG. It is a flowchart explaining the blocking process of step S21 of FIG. It is a flowchart explaining the motion estimation process of step S22 of FIG. It is a flowchart explaining the residual calculation process of step S23 of FIG. It is a flowchart explaining the residual encoding process of step S24 of FIG. It is a flowchart explaining the data composition process of step S26 of FIG. FIG. 3 is a block diagram illustrating a configuration example of a decoding unit of the encoding device in FIG. 2. It is a block diagram which shows the structural example of the residual decoding part of FIG. It is a block diagram which shows the structural example of the motion compensation part of FIG. 6 is a flowchart for explaining the decoding process of the decoding unit of FIG. 2 in step S6 of FIG. It is a flowchart explaining the data decomposition process of step S211 of FIG. It is a flowchart explaining the residual decoding process of step S212 of FIG. It is a flowchart explaining the motion compensation process of step S213 of FIG. It is a flowchart explaining the residual addition process of step S214 of FIG. It is a flowchart explaining the data combination process of step S215 of FIG. It is a block diagram which shows the structural example of the personal computer to which this invention is applied.

Explanation of symbols

  51 image processing system, 61 playback device, 62 display, 63 encoding device, 81 A / D conversion unit, 82 encoding unit, 83 recording unit, 84 decoding unit, 85 D / A conversion unit, 86 display, 111 block Unit, 112 frame memory, 114 motion estimation unit, 115 residual calculation unit, 116 residual encoding unit, 117 data synthesis unit, 121 quantization table, 211 data decomposition unit, 212 residual decoding unit, 213 frame memory, 214 Motion compensation unit, 215 Residual addition unit, 216 Data combination unit

Claims (16)

In an encoding device for encoding image data,
Blocking means for blocking the first frame in the input image data;
Dynamic range detecting means for detecting a dynamic range of a pixel value of a first block of a first frame blocked by the blocking means;
When a second block having a dynamic range closest to the dynamic range detected by the dynamic range detection unit is detected from the second frame in the image data, and a plurality of the second blocks are detected, A correlation coefficient between a DCT (Discrete Cosine Transform) coefficient of a first block and a plurality of DCT coefficients of the second block is calculated, and the first block is calculated using the second block having the maximum correlation coefficient. Motion estimation means for estimating the motion vector of the block of
An encoding device comprising: encoding means for encoding the first block using the motion vector estimated by the motion estimation means. Noise addition means for adding noise to the image data and outputting the image data to which the noise has been added;
The encoding apparatus according to claim 1, wherein the blocking unit blocks the first frame of the image data to which the noise is added by the noise adding unit. Difference calculation means for calculating a difference between the image data of the second frame corresponding to the first block and the image data of the first block using the motion vector estimated by the motion estimation means. In addition,
The encoding apparatus according to claim 1, wherein the encoding unit encodes the first block by encoding the difference calculated by the difference calculation unit. The encoding device according to claim 3 , wherein the encoding means performs encoding by a JPEG (Joint Photographic Coding Experts Group) method. The code according to claim 1, further comprising data output means for outputting the motion vector estimated by the motion estimation means and the first block encoded by the encoding means to the subsequent stage as encoded data. Device. In an encoding method of an encoding device for encoding image data,
A blocking step of blocking the first frame in the input image data;
A dynamic range detecting step of detecting a dynamic range of a pixel value of a first block of a first frame blocked by the processing of the blocking step;
When a second block having a dynamic range closest to the dynamic range detected by the processing of the dynamic range detection step is detected from the second frame in the image data, and a plurality of the second blocks are detected , Calculating a correlation coefficient between a DCT (Discrete Cosine Transform) coefficient of the first block and a plurality of DCT coefficients of the second block, and using the second block having the maximum correlation coefficient, A motion estimation step for estimating a motion vector of the first block;
And a coding step of coding the first block using the motion vector estimated by the processing of the motion estimation step. A blocking step of blocking the first frame in the input image data;
A dynamic range detecting step of detecting a dynamic range of a pixel value of a first block of a first frame blocked by the processing of the blocking step;
When a second block having a dynamic range closest to the dynamic range detected by the processing of the dynamic range detection step is detected from the second frame in the image data, and a plurality of the second blocks are detected , Calculating a correlation coefficient between a DCT (Discrete Cosine Transform) coefficient of the first block and a plurality of DCT coefficients of the second block, and using the second block having the maximum correlation coefficient, A motion estimation step for estimating a motion vector of the first block;
A recording medium on which a program for causing a computer to perform a process including an encoding step of encoding the first block using the motion vector estimated by the process of the motion estimation step is recorded. A blocking step of blocking the first frame in the input image data;
A dynamic range detecting step of detecting a dynamic range of a pixel value of a first block of a first frame blocked by the processing of the blocking step;
When a second block having a dynamic range closest to the dynamic range detected by the processing of the dynamic range detection step is detected from the second frame in the image data, and a plurality of the second blocks are detected , Calculating a correlation coefficient between a DCT (Discrete Cosine Transform) coefficient of the first block and a plurality of DCT coefficients of the second block, and using the second block having the maximum correlation coefficient, A motion estimation step for estimating a motion vector of the first block;
A program for causing a computer to perform a process including: an encoding step of encoding the first block using the motion vector estimated by the process of the motion estimation step. In a decoding device for decoding image data,
When the second block of the second frame having the dynamic range closest to the dynamic range of the first block of the first frame in the image data is detected, and a plurality of the second blocks are detected, A correlation coefficient between a DCT (Discrete Cosine Transform) coefficient of one block and a plurality of DCT coefficients of the second block is calculated, and the first block is calculated using the second block having the maximum correlation coefficient. Data input means for inputting a motion vector estimated as a block motion and encoded data obtained by encoding a difference value between the first frame and the second frame obtained by using the motion vector;
Difference value extraction means for extracting the difference value by decoding the encoded data input by the data input means;
The image of the first frame is added by adding the difference value extracted by the difference value extracting means to the image data of the second frame in accordance with the motion vector input by the data input means. And a data adding means for generating data. The decoding apparatus according to claim 9 , further comprising noise adding means for adding noise to the image data generated by the data adding means and outputting the image data to which the noise is added to a subsequent stage. Further comprising motion compensation means for predicting image data of a prediction block from the image data of the second frame in accordance with the motion vector input by the data input means;
The data adding unit generates the image data of the first frame by adding the difference value extracted by the difference value extracting unit to the image data of the prediction block predicted by the motion compensation unit. The decoding device according to claim 9 . In a decoding method of a decoding device for decoding image data,
When the second block of the second frame having the dynamic range closest to the dynamic range of the first block of the first frame in the image data is detected, and a plurality of the second blocks are detected, A correlation coefficient between a DCT (Discrete Cosine Transform) coefficient of one block and a plurality of DCT coefficients of the second block is calculated, and the first block is calculated using the second block having the maximum correlation coefficient. A data input step for inputting a motion vector estimated as a motion of a block, and encoded data obtained by encoding a difference value between the first frame and the second frame obtained using the motion vector;
A difference value extracting step of extracting the difference value by decoding the encoded data input by the data input step;
By adding the difference value extracted by the difference value extraction step to the image data of the second frame in accordance with the motion vector input by the data input step, the first frame And a data adding step for generating image data of the frame. When the second block of the second frame having the dynamic range closest to the dynamic range of the first block of the first frame in the image data is detected, and a plurality of the second blocks are detected, A correlation coefficient between a DCT (Discrete Cosine Transform) coefficient of one block and a plurality of DCT coefficients of the second block is calculated, and the first block is calculated using the second block having the maximum correlation coefficient. A data input step for inputting a motion vector estimated as a motion of a block, and encoded data obtained by encoding a difference value between the first frame and the second frame obtained using the motion vector;
A difference value extracting step of extracting the difference value by decoding the encoded data input by the data input step;
By adding the difference value extracted by the difference value extraction step to the image data of the second frame in accordance with the motion vector input by the data input step, the first frame A recording medium on which is recorded a program for causing a computer to perform a process including a data addition step of generating image data of the frame. When the second block of the second frame having the dynamic range closest to the dynamic range of the first block of the first frame in the image data is detected, and a plurality of the second blocks are detected, A correlation coefficient between a DCT (Discrete Cosine Transform) coefficient of one block and a plurality of DCT coefficients of the second block is calculated, and the first block is calculated using the second block having the maximum correlation coefficient. A data input step for inputting a motion vector estimated as a motion of a block, and encoded data obtained by encoding a difference value between the first frame and the second frame obtained using the motion vector;
A difference value extracting step of extracting the difference value by decoding the encoded data input by the data input step;
By adding the difference value extracted by the difference value extraction step to the image data of the second frame in accordance with the motion vector input by the data input step, the first frame A program for causing a computer to perform a process including a data adding step for generating image data of a frame. In an image processing system comprising an encoding device and a decoding device for encoding and decoding image data,
The encoding device includes:
Blocking means for blocking the first frame in the input image data;
Dynamic range detecting means for detecting a dynamic range of a pixel value of a first block of a first frame blocked by the blocking means;
When a second block having a dynamic range closest to the dynamic range detected by the dynamic range detection unit is detected from the second frame in the image data, and a plurality of the second blocks are detected, A correlation coefficient between a DCT (Discrete Cosine Transform) coefficient of a first block and a plurality of DCT coefficients of the second block is calculated, and the first block is calculated using the second block having the maximum correlation coefficient. Motion estimation means for estimating the motion vector of the block of
An image processing system comprising: encoding means for encoding the first block using the motion vector estimated by the motion estimation means. In an image processing system comprising an encoding device and a decoding device for encoding and decoding image data,
The decoding device
When the second block of the second frame having the dynamic range closest to the dynamic range of the first block of the first frame in the image data is detected, and a plurality of the second blocks are detected, A correlation coefficient between a DCT (Discrete Cosine Transform) coefficient of one block and a plurality of DCT coefficients of the second block is calculated, and the first block is calculated using the second block having the maximum correlation coefficient. Data input means for inputting a motion vector estimated as a block motion and encoded data obtained by encoding a difference value between the first frame and the second frame obtained by using the motion vector;
Difference value extraction means for extracting the difference value by decoding the encoded data input by the data input means;
The image of the first frame is added by adding the difference value extracted by the difference value extracting means to the image data of the second frame in accordance with the motion vector input by the data input means. An image processing system comprising: data addition means for generating data.

Images