JP3466640B2 - Apparatus and method for detecting motion vector, apparatus and method for correcting image vibration - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an apparatus and method for detecting a motion vector and an apparatus and method for correcting image vibration. For example, the amount of movement of an image due to so-called camera shake included in video data such as image pickup output of a handy type video camera. The present invention is applied to a camera shake correction device for an image that detects and corrects.

[0002]

2. Description of the Related Art Generally, in a handy type video camera, camera shake during shooting, that is, camera vibration, appears as image vibration. Therefore, as an image shake correction device for an image which corrects the image shake due to such a hand shake, for example, as disclosed in Japanese Patent Laid-Open No. 63-166370, a motion vector of the image is detected and based on this motion vector. Then, a method of correcting video data stored in the image memory has been proposed.

To detect the motion vector of the image, for example, the block matching method is adopted. In the detection of the motion vector of the image by this block matching method, the screen is divided into a number of areas (referred to as blocks), and the representative point pixel of the previous field located at the center of each block and each pixel in the block of the current field are divided. The absolute value of the field difference from the image data is calculated, the absolute value of the field difference of each block is integrated for each corresponding pixel to obtain the correlation integral value, and the correlation integration having the coordinates corresponding to the pixel array for one block is calculated. Form a value table. Then, the motion vector of the entire screen is determined by using the coordinate value of the minimum value of the correlation integrated value in the correlation integrated value table as the coordinate value of the motion vector of the image.

Generally, in the block matching method as described above, an image motion vector due to camera shake and a motion vector due to subject motion are generated at the same time.
It is difficult to distinguish these. Conventionally, as a method of improving the detection accuracy of a motion vector of an image due to camera shake, one screen is divided into a plurality of regions (macroblocks), a motion vector (macrovector) for each macroblock is obtained, and the motion of the entire screen is calculated from them. A method of determining a vector is known. For example, as shown in FIG. 13, 1 × 4 × 3 on one screen
The influence of the motion vector due to the moving object MV is removed by setting (2,0) as the motion vector of the entire screen by the majority decision regarding the macro vector obtained by dividing into two macro blocks.

[0005]

By the way, in the method of detecting the motion vector by obtaining the minimum value of the correlation integrated value table for each macroblock and detecting the motion vector of the entire screen from the motion vector of each macroblock. ,
When there is a moving object, the background image including the information of the shake vector is masked by the moving object.Therefore, the larger the ratio of the moving object in the image is, the more the shake vector is detected as the motion vector of the macroblock unit. However, there is a problem in that it is difficult to detect a correct camera shake vector.

Therefore, the applicant of the present invention divides one screen into a plurality of macroblocks in such a manner that macroblocks that are not adjacent to each other are generated, and obtains the minimum value of the correlation integrated value table for each macroblock to obtain the motion vector. 14 and, as shown in FIG. 14, a camera shake vector of the same motion vector (independent same vector) detected in at least two macroblocks at spatially separated positions is disclosed in, for example, Japanese Patent Application No. It was previously proposed in No. 100384. FIG. 14 shows an example of the motion vector of each macroblock and its (macrovector) generation pattern.

However, for example, as shown in the macro vector in FIG. 15, when a large moving object screen is entered, the motion vector (-3 ，
In some cases, it is not possible to determine 0) and the shake vector (1, -2).

Therefore, the present invention has been made in view of such circumstances, and an object thereof is to enable high-performance image stabilization in a handy type video camera or the like, and a moving object is present in an image. Even in such a case, a motion vector detecting device and method capable of detecting a motion vector with high accuracy, and an image vibration correcting device and method are provided.

[0009]

A motion vector detecting apparatus according to the present invention divides one screen into a plurality of macro blocks in such a manner that macro blocks which are not adjacent to each other are generated, and a motion vector is calculated for each macro block. With the same vector at a spatially separated position or the same vector at a concave position for detecting the motion vector of the entire screen based on each motion vector detected by the macro vector detection means for detecting and the macro vector detection means. A motion vector detecting unit that specifies a valid macroblock and detects a motion vector of the entire screen based on the motion vector of the valid macroblock, a storage unit that stores position information of the valid macroblock, and the motion vector detection When the motion vector of the whole screen is not detected by the method, the same motion vector of the current screen is detected. Of the current screen based on the correlation between the position information of the macroblock having a macroblock and the position information of the effective macroblock used when detecting the motion vector of the entire screen of the previous screen stored in the storage means. And a determination unit that determines a macroblock and outputs the motion vector detected based on the determined effective macroblock of the current screen as a motion vector of the entire screen. Also, the motion vector detecting method according to the present invention divides one screen into a plurality of macro blocks in such a form that macro blocks which are not adjacent to each other are generated, and detects a motion vector for each macro block, The effective macroblock which is the same vector at the spatially distant position or the same vector at the concave position for detecting the motion vector of the entire screen based on the respective motion vectors determined, and the motion vector of the effective macroblock When the motion vector of the entire screen is not detected in the step of detecting the motion vector of the entire screen based on the above, the step of storing the position information of the effective macroblock, and the step of detecting the motion vector, the same motion of the current screen is detected. Position information of a macroblock having a vector and a step for storing the position information. The effective macroblock of the current screen is determined based on the correlation of the position information with the effective macroblock used when detecting the motion vector of the entire previous screen image stored in the current screen. And outputting the motion vector detected based on the effective macroblock as the motion vector of the entire screen. Further, the image vibration correction device according to the present invention divides one screen into a plurality of macroblocks in a form such that macroblocks that are not adjacent to each other are generated, and a macrovector detection unit that detects a motion vector for each macroblock. And an effective macroblock that is the same vector at a spatially separated position or the same vector at a concave position for detecting the motion vector of the entire screen based on each motion vector detected by the macro vector detection means. The motion vector detecting means for detecting the motion vector of the entire screen based on the motion vector of the effective macroblock, the storage means for storing the position information of the effective macroblock, and the motion of the entire screen by the motion vector detecting means. When no vector is detected, the macroblock with the same motion vector of the current screen Of the current screen based on the correlation between the position information of the current screen and the position information of the previous screen stored in the storage means and the effective macroblock used when detecting the motion vector of the entire previous screen. A determination unit that outputs the motion vector detected based on the determined effective macroblock of the current screen as a motion vector of the entire screen, and based on the motion vector of the entire screen output from the determination unit, And a correction unit for correcting the vibration of the image forming the screen. Further, the image vibration correction method according to the present invention is such that macroblocks that are not adjacent to each other are generated,
A step of dividing one screen into a plurality of macroblocks and detecting a motion vector for each macroblock, and a spatially separated position for detecting the motion vector of the entire screen based on each of the detected motion vectors. A valid macroblock that is the same vector or the same vector at a concave position and detects the motion vector of the entire screen based on the motion vector of the valid macroblock, and stores the position information of the valid macroblock. When the motion vector of the entire screen is not detected in the step and the step of detecting the motion vector, the position information of the macroblock having the same motion vector of the current screen and the previous screen stored in the step of storing the position information are stored. Position with effective macroblock used when detecting motion vector of entire screen Determining a valid macroblock of the current screen based on the correlation of the information, and outputting the motion vector detected based on the determined valid macroblock of the current screen as a motion vector of the entire screen, A step of correcting the vibration of the image forming the screen based on the output motion vector of the entire screen.

[0010]

In the motion vector detecting apparatus and method according to the present invention, one screen is divided into a plurality of macro blocks in such a manner that macro blocks which are not adjacent to each other are generated, and a motion vector is detected for each macro block. The effective macroblock, which is the same vector at spatially separated positions or the same vector at the concave position for detecting the motion vector of the entire screen based on each detected motion vector, is specified, and the motion of the effective macroblock is specified. Detecting the motion vector of the entire screen based on the vector, storing the position information of the effective macroblock, when the motion vector of the entire screen is not detected, position information of the macroblock having the same motion vector of the current screen, The effective macro block used when detecting the motion vector of the entire screen of the previous screen stored above. Based on the correlation of the positional information and to determine the effective macro blocks of the current screen, and outputs the motion vector detected on the basis of the effective macro block of the current screen is the determined as a motion vector of the entire screen. Further, in the image vibration correction apparatus and method according to the present invention, one screen is divided into a plurality of macroblocks in such a form that macroblocks that are not adjacent to each other are generated, and a motion vector is detected for each macroblock, The effective macroblock, which is the same vector at spatially separated positions or the same vector at the concave position for detecting the motion vector of the entire screen based on each detected motion vector, is specified, and the motion of the effective macroblock is specified. Detecting the motion vector of the entire screen based on the vector, storing the position information of the effective macroblock, when the motion vector of the entire screen is not detected, position information of the macroblock having the same motion vector of the current screen, The effective macroblock used when detecting the motion vector of the entire screen of the previous screen stored above and Based on the correlation of the position information, the effective macroblock of the current screen is determined, and the motion vector detected based on the determined effective macroblock of the current screen is output as the motion vector of the entire screen, and the output is performed. Based on the motion vector of the entire screen, the vibration of the image forming the screen is corrected.

[0011]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described in detail below with reference to the drawings. An image shake detecting apparatus according to the present invention is configured as shown in FIG. 1, for example.

The camera shake detection device 10 shown in FIG.
The present invention is applied to a camera shake correction apparatus that corrects the movement of an image due to camera shake in a handy type video camera, and constitutes a camera shake correction apparatus together with a correction signal generation unit 20 and a correction unit 30. In FIG. 1, a signal input terminal 1 is supplied with input video data obtained by digitizing a video signal obtained as an image pickup output by an image pickup unit (not shown) of the video camera.

The camera-shake detecting apparatus 10 includes a field difference detector 11 to which input video data is supplied via the signal input terminal 1, and a macro vector detector 12 to which an output of the field difference detector 11 is supplied. An independent / semi-independent same vector determination unit 15 to which the output of the macro vector detection unit 12 is supplied, and a shake vector determination unit to which the outputs of the macro vector detection unit 12 and the independent / semi-independent same vector determination unit 15 are supplied. 16 and.

The field difference detection section 11 comprises a representative point memory 11A to which the input video data is supplied via the signal input terminal 1 and a subtraction circuit 11B.

The representative point memory 11A has image data I _k (0,0) of representative point pixels for each block obtained by dividing an image of one field composed of input video data into a plurality of blocks.
Memorize Specifically, for example, as shown in FIG.
The screen of the field is divided into blocks of m pixels × n lines, and as shown in FIG. 3, the pixel S (0,
0) as a representative point and image data I of each representative point pixel
_k (0, 0) is stored in the representative point memory 11A for one field period. The representative points are evenly distributed on the screen. Then, the image data I _k-1 (0,0) of each representative point pixel one field before read from the representative point memory 11A is supplied to the subtraction circuit 11B.

Further, the subtraction circuit 11B, for input video data supplied through the signal input terminal 1, that is, image data of the current field, m × for each block.
The difference between the image data I _k (x, y) of each of the n pixels and the image data I _k-1 (0, 0) of the representative point pixel of the corresponding block of the previous field read from the representative point memory 11A, that is, Absolute value of field difference | I _k-1 (0,
0) -I _k (x, y) | is detected.

Then, the field difference detector 11
Supplies the field difference absolute value | I _k−1 (0,0) −I _k (x, y) | obtained by the subtraction circuit 11B to the macro vector detection unit 12.

The macro vector detection unit 12 is supplied with the field difference absolute value | I _k-1 (0,0) -I _k (x, y) | obtained by the field difference detection unit 11. Of the field difference absolute value | I _k-1 (0,0) -I _k (x, y) | that is macroblocked by the macroblocking circuit 13 is supplied. Macro vector detection circuit 14A
.About.14L and a vector detection circuit 14M.

The macroblocking circuit 13 is a macroblock which is not adjacent to the field difference absolute value | I _k-1 (0,0) -I _k (x, y) | obtained by the field difference detecting unit 11. In the form of blocks,
One screen is divided into a plurality of macroblocks. For example, as shown in FIG. 4, one screen is divided into 4 × 3 12 macroblocks B1 to B12.

The field difference absolute value | I macroblocked by the macroblocking circuit 13
_k−1 (0,0) −I _k (x, y) | is the macro vector detection circuit 14 corresponding to each macro block B1 to B12.
A to 14L is supplied for each macroblock,
All macroblocks are supplied to the vector detection circuit 14M.

The first macro vector detection circuit 14A
Is the field difference absolute value | I _k-1 (0,0) -I _k (x, y) | of the first macroblock B1 for each field difference of the block composed of m × n pixels. The absolute values are integrated for each corresponding pixel to form the correlation integrated value table of the first macroblock B1, and the minimum value coordinates thereof are detected as motion vector candidates. Similarly, the second to twelfth absolute value integrating circuits 14B to 14L
The corresponding second to twelfth macroblocks B2
~ B12 correlation integrated value table is formed, and each minimum value coordinate is detected as a motion vector candidate. Further, the thirteenth absolute value integration circuit 14M forms a correlation integrated value table of the entire one screen including the first to twelfth macro blocks B1 to B12, and detects the minimum value coordinates as a motion vector candidate. .

Here, the correlation integrated value of each correlation integrated value table formed by the macro vector detecting unit 12 is the image data I _k-1 (0,0) of the representative point pixel of each block and other pixels. It shows the inter-field correlation with the image data I _k (x, y), and the coordinate corresponding to the pixel having a strong correlation has a smaller value, and the correlation integrated value of the coordinates corresponding to the motion vector has the minimum value. The motion vector can be detected by detecting the coordinates of the minimum value in the integrated value table. The minimum value in the correlation integrated value table is one of the minimum values, and when the ratio of moving objects in the image is large, for example, as shown in FIG. The vector is detected as the minimum value coordinate (3, 1) in the correlation integrated value table, and the ratio of the background vector, that is, the handshake vector detected as the coordinate indicating the motion vector in the macroblock unit decreases, but the handshake vector becomes It will be detected as the coordinates (-1, 0) of the minimum value in the above correlation integrated value table.

That is, in this embodiment, the field difference detecting unit 11 and the macro vector detecting unit 12 are used.
Is a method for dividing one screen into a plurality of macroblocks in such a form that macroblocks that are not adjacent to each other are generated and detecting a motion vector for each macroblock. The macrovector in the image shake detection apparatus according to the present invention is It functions as a detection means.

Then, the macro vector detecting unit 12
Is the first to twelfth macro vector detection circuit 14
Macro blocks B1 to B1 detected by A to 14L
The two motion vectors, that is, each macro vector and the motion vector of the entire one screen detected by the vector detection circuit 14M are supplied to the independent / semi-independent same vector determination unit 15 and the camera shake vector determination unit 16.

The independent / quasi-independent same vector determination unit 15
Determines the generation pattern of the same motion vector for each macro vector supplied from the macro vector detection unit 12 and the motion vector of the entire screen, and identifies the same in at least two macro blocks at spatially separated positions. When the motion vector (independent same vector) is detected, the motion vector is output as a shake vector candidate for the entire screen. For example, in the state shown in FIG. 5, the two macroblocks B1 and B4 located at spatially separated positions have the same motion vector (-1,0). Therefore, this motion vector (-1,0) Is the shake vector. As described above, the independent / semi-independent same vector determination unit 15 sets not only the minimum value vector of the integrated value of each macroblock but also the minimum value vector as the shake vector candidate, so that the moving object occupies the screen. Even when the ratio is very large, the probability that a correct shake vector can be detected is increased, the influence of a moving object is reduced, and a shake vector with less error can be obtained.

The independent / semi-independent same vector determination unit 15 determines the same motion vector generation pattern for each macro vector supplied from the macro vector detection unit 12 and the motion vector of the entire screen. 6
As shown in an example of the generation pattern of the same macro vector, when substantially the same motion vector (quasi-independent same vector) is detected in each macro block arranged in a concave shape, the motion vector is set as a shake vector of the entire screen. Output as a candidate.

Here, since a moving object such as a car or a person existing on the screen often appears in a convex shape, substantially the same motion vector is detected in each macroblock arranged in such a concave shape. In this case, by setting the motion vector as a shake vector candidate for the entire screen,
The independent / semi-independent same vector determination unit 15 can reliably detect the shake vector.

Further, the camera shake vector determination unit 16 is
It functions as a shake vector determination unit in the image shake detection apparatus according to the present invention, and includes an overlap degree calculation circuit 16A and a macroblock validity determination memory 16B.

In the camera shake vector determination unit 16,
When the hand-shaking vector is detected by the independent / semi-independent same-vector determining unit 15, the overlapping degree calculating circuit 16A outputs the hand-shaking vector as it is. Further, the overlap degree calculation circuit 16A stores information indicating each macroblock for which the same macrovector as the shake vector output for each field is obtained as valid macroblock information in the macroblock validity determination memory 16B.

For example, in the previous field, the macro vector as shown in FIG. 7 is obtained and the shake vector (-
1, 2) are detected, the camera shake vector (−1, 1,
Information indicating the macroblocks B1, B4, B5, B9 shown by hatching in FIG. 8 in which the same macrovector as in 2) is obtained is stored in the macroblock validity judgment memory 16B as valid macroblock information.

Further, the overlap degree calculating circuit 16A is
When the independent / semi-independent same vector determination unit 15 cannot detect a camera shake vector, the valid macroblock information of one field before is read from the macroblock validity determination memory 16B and supplied from the macrovector detection unit 12. The time correlation of each macro vector of the field is determined, and the motion vector of the macro block for which the time correlation is determined to be significant is output as the shake vector of the entire screen.

For example, if a macro vector as shown in FIG. 9 is obtained in the current field, there is no independent identical vector or preparatory independent identical vector, so the independent / semi-independent identical vector determination unit 15 determines the shake vector. Cannot be detected. Here, the number of detected macro vectors of (7,0) indicating the motion vector of the moving object is 9, and the macro vector of (-4,1) indicating the background vector (shake vector) is detected. Since there are three, the shake vector is simply (7,
It will be decided as 0).

Therefore, the overlapping degree calculation circuit 16A is
Assuming that (7,0) is the shake vector in the current field, the macroblock validity judgment memory 16B
Of the four macroblocks B1, B4, B5, B9 that were valid in the previous field indicated by the valid macroblock information of the previous field read from, only one of the macroblocks B4 is (7, 0). Therefore, −3 + 1 = −2 points are counted. Further, nine B2 to B4, B6 to B8, B10 to B shown by hatching in FIG. 10 in which the macro vector of (7,0) is obtained in the current field are shown.
Of the 12 fields, 1 in macroblock B4 in the previous field
Since only these are valid macroblocks, -8 + 1 = -7 points are counted. And in the current field (7,
When 0) is the shake vector, the evaluation point is counted as -2-7 = -9 points.

Further, the overlap degree calculating circuit 16A, assuming that (-4, -1) is a shake vector in the current field, the macroblock validity judging memory 16
Of the four macroblocks B1, B4, B5, B9 that were valid in the previous field indicated by the valid macroblock information of the previous field read from B, three of the macroblocks B1, B5, B9 are (-4 , −1), it is counted as 3-1 = 2 points. In the current field, the above (-
4, the macro vector of (1) is obtained, the three macro blocks B1, B5, B9 shown by hatching in FIG. 11 are all valid macro blocks in the previous field, so 3-0 = 3 points are counted. To do. Then, in the current field (-
In the case where (4, -1) is the shake vector, the evaluation point is counted as 2 + 3 = 5 points.

The overlap degree calculating circuit 16A has an evaluation score of -9 when (7,0) is a shake vector in the current field, whereas (-4, -1) in the current field. Is 5 and the evaluation point is 5, it can be determined that (-4, -1) is the shake vector.

As described above, in the camera shake detection device of this embodiment, the field difference detection section 11 and the macro vector detection section 12 divide one screen into a plurality of macro blocks in such a manner that macro blocks which are not adjacent to each other are generated. Then, the motion vector is detected for each macro block. Then, the camera shake vector determination unit 16 determines the time correlation of the motion vector for each macro block obtained by the macro vector detection unit 12, and the motion of the macro block determined to have significant time correlation with time correlation. Since the vector is output as a shake vector for the entire screen, the shake vector in the case of entering a large moving object screen that cannot be determined by the method using independent identical vector or preparation independent identical vector or simple majority decision is sure. It can be detected and output.

The method of determining the time correlation of each macro vector of the current field in the overlap degree calculating circuit 16A is not limited to the above method.

Then, the camera-shake detecting apparatus 10 supplies the camera-shake vector detected by the independent / semi-independent same-vector determining section 15 to the correction signal generating section 20.

Further, the correction signal generating section 20, 'as _{input, X t = X t-1} -V t' by the hand-shake is detected by the detection device 10 is hand shake vector V _t image stabilization becomes the correction amount X _t A signal is formed and this image stabilization signal is supplied to the correction section 30.

The correction unit 30 is, for example, as shown in FIG.
As shown in, the address control circuit 31 and the select signal generation circuit 32 to which the shake correction signal is supplied from the correction signal generation unit 20 and the writing / writing of the video data according to the address signal supplied from the address control circuit 31.
The field memory 33 and peripheral memory 34 to be read out, and the field memory 33 and peripheral memory 3
And a selector 35 for selectively outputting the video data read from the No. 4 according to the select signal supplied from the select signal generating circuit 32.

Input video data supplied through the signal input terminal 1 is sequentially written in the field memory 33. The read address of the field memory 33 is controlled by the camera shake correction signal according to the camera shake vector. As a result, from the field memory 33, the video data in which the input video data of one field is moved according to the camera shake vector can be obtained. Then, the video data read from the field memory 33 and the peripheral video data read from the peripheral memory 34 are combined by the selection by the selector 35 and output from the signal output terminal 2 as the video data subjected to the image stabilization process.

In the peripheral memory 34, the video data of the peripheral portion corresponding to the image correction range of the image data subjected to the image stabilization processing output via the selector 35 is sequentially written as peripheral video data.

[0043]

As is apparent from the above description, according to the present invention, one screen is divided into a plurality of macroblocks in a form such that macroblocks that are not adjacent to each other are generated, and each macroblock is moved. Detect a vector, and specify an effective macroblock that is the same vector at a spatially distant position or the same vector at a concave position for detecting the motion vector of the entire screen based on each detected motion vector, A motion vector of the entire screen is detected based on the motion vector of the effective macroblock, position information of the effective macroblock is stored, and when the motion vector of the entire screen is not detected, a macro having the same motion vector of the current screen is detected. The position information of the block and the effective macro used to detect the motion vector of the entire screen of the previous screen stored above. The effective macroblock of the current screen is determined based on the correlation of the position information with the block, and the motion vector detected based on the determined effective macroblock of the current screen is output as the motion vector of the entire screen. Therefore, it is possible to reliably detect and output the shake vector when entering a large moving object screen that cannot be determined by the method using independent identical vector or preparation independent identical vector or a simple majority decision. The probability that the camera shake vector can be detected is increased, the influence of the moving object is reduced, and the camera shake vector with less error can be obtained.

[Brief description of drawings]

FIG. 1 is a block diagram showing the configuration of a camera shake correction apparatus provided with an image shake detection apparatus according to the present invention.

FIG. 2 is a diagram showing a state of screen block division in the camera shake detection device.

FIG. 3 is a diagram showing a structure of one block of a screen divided into blocks.

FIG. 4 is a diagram showing a state of macroblocks obtained by dividing one screen into 12 parts.

FIG. 5 is a diagram showing an example of an independent identical vector generation pattern detected as a shake vector by an independent / semi-independent identical vector determination unit.

FIG. 6 is a diagram showing an example of a generation pattern of quasi-independent identical vectors detected as a shake vector by the independent / quasi-independent identical vector determination unit.

FIG. 7 is a diagram showing a generation state of a macro vector of a previous field in which a shake vector is detected by the independent / semi-independent same vector determination unit.

FIG. 8 is a diagram showing a generation pattern of a macro vector in a previous field in which a shake vector is detected by the independent / semi-independent same vector determination unit.

FIG. 9 is a diagram showing a generation state of a macro vector of a current field in which a hand shake vector cannot be detected by the independent / semi-independent same vector determination unit.

FIG. 10 is a diagram showing a motion vector generation pattern of an object in the current field.

FIG. 11 is a diagram showing an occurrence pattern of a shake vector in the current field.

FIG. 12 is a block diagram showing a configuration of a correction unit of the image stabilization apparatus.

FIG. 13 is a diagram for explaining a method of determining a shake vector by majority decision of macro vectors.

FIG. 14 is a diagram for explaining a method of determining a camera shake vector by using macro vectors at spatially separated positions.

FIG. 15 is a diagram for explaining a failure example of a method of determining a camera shake vector by using macro vectors at spatially separated positions.

[Explanation of symbols]

10: Hand shake detection device 11 ... Field difference detector 12: Macro vector detector 15: Independent / semi-independent vector judgment unit 16: Shake vector determination unit

   ─────────────────────────────────────────────────── ─── Continued front page    (72) Inventor Masashi Uchida               6-735 Kita-Shinagawa, Shinagawa-ku, Tokyo               Knee Co., Ltd. (72) Inventor Tsukasa Hashino               6-735 Kita-Shinagawa, Shinagawa-ku, Tokyo               Knee Co., Ltd.                (56) Reference JP-A-2-157980 (JP, A)

Claims (4)

(57) [Claims] 1. A macro vector detecting means for dividing one screen into a plurality of macro blocks and detecting a motion vector for each macro block in such a form that macro blocks which are not adjacent to each other are generated, and the macro vector detecting means. The same vector at a spatially separated position or a concave position for detecting the motion vector of the entire screen based on each detected motion vector
Of identifying a valid macro block is the same vector, entire screen on the basis of the motion vector of the effective macroblock
Motion vector detection means for detecting a motion vector of the body, and storage means for storing the position information of the effective macroblock
And the motion vector of the whole screen is detected by the above motion vector detection means.
Have the same motion vector of the current screen when not detected
The macroblock position information and the
The effective macroblock of the current screen is determined based on the correlation of the position information with the effective macroblock used when detecting the motion vector of the entire previous screen, and the determined effective macroblock of the current screen is determined. A motion vector detecting device which outputs the motion vector detected based on the above as a motion vector of the entire screen. 2. A step of dividing one screen into a plurality of macroblocks in such a form that macroblocks that are not adjacent to each other are generated and detecting a motion vector for each macroblock, and based on each of the detected motion vectors. The spatially distant position to detect the motion vector of the entire screen.
Identifying a valid macroblock that is the same vector at a vector or a concave position, detecting a motion vector of the entire screen based on the motion vector of the valid macroblock, and storing the position information of the valid macroblock
And the motion of the entire screen in the step of detecting the motion vector above.
When no vector is detected, the same motion vector of the current screen
Information of the macroblock having the
The effective macroblock of the current screen is determined based on the correlation of the position information with the effective macroblock used when detecting the motion vector of the entire screen of the previous screen stored in the step of storing And a step of outputting the motion vector detected based on the effective macroblock of the current screen as a motion vector of the entire screen, the motion vector detecting method. 3. A macro vector detecting means for dividing one screen into a plurality of macro blocks and detecting a motion vector for each macro block in such a form that macro blocks which are not adjacent to each other are generated, and the macro vector detecting means. The same vector at a spatially separated position or a concave position for detecting the motion vector of the entire screen based on each detected motion vector
Of identifying a valid macro block is the same vector, entire screen on the basis of the motion vector of the effective macroblock
Motion vector detection means for detecting a motion vector of the body, and storage means for storing the position information of the effective macroblock
And the motion vector of the whole screen is detected by the above motion vector detection means.
Have the same motion vector of the current screen when not detected
The macroblock position information and the
The effective macroblock of the current screen is determined based on the correlation of the position information with the effective macroblock used when detecting the motion vector of the entire previous screen, and the determined effective macroblock of the current screen is determined. Determining means for outputting the motion vector detected based on the above as a motion vector of the entire screen, and correction for correcting the vibration of the image forming the screen based on the motion vector of the entire screen output from the determining means. An image vibration correction apparatus comprising: 4. A step of dividing one screen into a plurality of macroblocks in such a manner that macroblocks that are not adjacent to each other are generated, and detecting a motion vector for each macroblock, and based on each of the detected motion vectors. The spatially distant position to detect the motion vector of the entire screen.
Identifying a valid macroblock that is the same vector at a vector or a concave position, detecting a motion vector of the entire screen based on the motion vector of the valid macroblock, and storing the position information of the valid macroblock
And the motion of the entire screen in the step of detecting the motion vector above.
When no vector is detected, the same motion vector of the current screen
Information of the macroblock having the
The effective macroblock of the current screen is determined based on the correlation of the position information with the effective macroblock used when detecting the motion vector of the entire screen of the previous screen stored in the step of storing The step of outputting the motion vector detected based on the effective macroblock of the current screen as the motion vector of the entire screen, and the vibration of the images forming the screen based on the output motion vector of the entire screen. And a step of correcting the vibration of an image.