JPH08154212A - Method for generating still image data in video camera - Google Patents

Abstract

PURPOSE: To obtain a method for generating still image data to obtain a display image with high resolution when a still image mode is set in the video camera provided with a solid-state image pickup element with a shake correction area added thereto and executing a shake correction function in a moving image pickup mode. CONSTITUTION: A storage capacity of a field memory is able to store data equipment to two fields, and after the still image mode is set, a shake correction function in the moving image pickup mode is stopped, a horizontal scanning line including a shake correction area is read from a solid-state image pickup element in the 2-field period and image data equipment to one frame are obtained by using the line data so as to interpolate image lines by the line interpolation system. A resolution higher than interlacing field data after shake correction repetitively in a conventional method is obtained by interlacing the image data equivalent to one frame.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method for generating a still image in a video camera, and more particularly to a method for obtaining a finer image in a still image mode in a video camera having a camera shake correction function, and various methods for obtaining a fine image. The present invention relates to a method for realizing a display mode.

[0002]

2. Description of the Related Art In recent years, an image pickup section having an optical system and a solid-state image pickup element is provided, and a video signal output from the image pickup section is subjected to process processing to record / reproduce a standard television signal output. Possible video cameras are becoming popular as so-called "camera integrated VTRs".
Recently, a camera-integrated VTR that converts the signal processing of the camera unit into a digital signal has been put into practical use, but due to the digital signal processing unit, it cannot be realized by a conventional video camera using analog signal processing. It has become possible to realize existing image stabilization functions and value-added functions such as various special effects, and many models already equipped with these functions are on the market.

In particular, in the case where a semiconductor memory capable of high-speed access is mounted on the camera unit, the image signal for one field period is temporarily stored in the memory and an appropriate read control is carried out to provide a camera shake correction function and a still image. It is the current situation that the image output function can be realized very easily, and those technologies are used to differentiate products. For example, it is possible to switch the normal moving image shooting mode to the still image mode by a simple button operation and use the camera-integrated VTR like a still camera.

Furthermore, due to recent advances in semiconductor technology and the like,
As seen in high-definition television (high-definition) and wide-screen television, unlike the conventional television system having an aspect ratio of 3: 4, new media and products based on the aspect ratio of 9:16 are available. Although it has been put to practical use, reproduction of higher quality images in video cameras has always been an important technical issue in evaluating its performance.

[0005]

In the conventional camera-integrated VTR, in the moving image shooting mode, the solid-state image sensor outputs a horizontal scanning signal for every one line in one field period, and the horizontal scanning signal is output to the television on the reproducing side. The image is obtained by interlace scanning with the receiver, but in the still image mode, the image signal for one field period is temporarily stored in the field memory and stored in the memory. A still image is configured by repeatedly outputting the image signal.

Therefore, in the moving image photographing mode, one frame is composed of different image signals for two fields, but in the still image mode only one frame is composed of the image signal of one field, so that the resolution in the vertical direction is about. It will drop in half. That is, there is a problem that the resolution of the image is extremely reduced and the image becomes blurred when the moving image shooting mode is switched to the still image mode, and there is a great demand for image quality improvement in the still image mode.

On the other hand, in the camera-integrated VTR having the above-described camera shake correction function, the solid-state image pickup device has a normal image pickup area.
It has a configuration in which a camera shake correction area is added to (one frame). Then, in the moving image shooting mode, the image data obtained by performing digital signal processing on the image signal output from the entire solid-state image sensor by the interlaced read method is temporarily stored in the frame memory, and the image data is analyzed. By performing read control from the solid-state image sensor based on the obtained camera shake correction amount, necessary horizontal scanning lines corresponding to fields are read, and the field data after digital signal processing is recorded and / or output. There is. Therefore, in a video camera having a camera shake correction function, since the camera shake correction area is added to the solid-state image sensor, it is possible to read out more horizontal scanning lines than the prescribed one field.

In view of the above, the present invention utilizes the characteristics of the video camera having the above-mentioned camera shake correction function to record and / or reproduce a still image that is finer than the conventional method in the still image mode. It was created for the purpose of providing a method for creating data.

[0009]

According to a first aspect of the present invention, a solid-state image sensor is provided which has an image stabilization area added to an image-capturing area for one frame, and in a moving image capturing mode, interlaced reading is performed from all areas of the solid-state image sensor. Image data obtained by subjecting an image signal output by the digital signal processing to digital signal processing to once be stored in a storage means, and reading control from the solid-state image sensor based on a camera shake correction amount obtained by analyzing the image data. In a video camera with a camera shake correction function for reading out a required horizontal scanning line for one field and recording and / or outputting the field data after the digital signal processing, the storage capacity of the storage means is at least two fields of image data. In the still image mode, the procedure for stopping the image stabilization function and the movie shooting mode are set. The procedure of reading horizontal scanning line signals from the entire area of the solid-state image pickup device by the interlaced read method within the reading period of two fields, and writing each line data to the storage means after performing ordinary digital signal processing. A procedure of creating horizontal scanning line data of the number of lines short of the number of horizontal scanning lines for two fields by the line interpolation method and performing uniform interpolation before or after writing in or after reading from the storage state after writing Run 1
The present invention relates to a method for creating still image data in a video camera, which is characterized in that frame still image data is obtained.

According to a second aspect of the present invention, in the above video camera with a camera shake correction function, the storage means has the same storage capacity as described above, and in the still picture mode, the procedure for stopping the camera shake correction function and the two steps in the moving picture shooting mode. While the horizontal scanning line signal is being read from the entire area of the solid-state imaging device by the interlaced reading method within the field reading period, the number of lines short of the number of horizontal scanning lines for two fields may be detected between the horizontal scanning lines. The procedure for evenly inserting the black level line, and the black level line of the black level line before or after writing the respective line data into the storage means after performing the normal digital signal processing or after reading from the storage state Obtaining one frame of still image data by executing a procedure of converting data into interpolated image data by a line interpolation method. According to create a still image data in a video camera according to claim.

According to a third aspect of the present invention, in the video camera with a shake correction function, the storage means has the same storage capacity as described above, and in the still image mode, the procedure for stopping the shake correction function and the moving image shooting mode A procedure for reading horizontal scanning line signals from the entire area of the solid-state image sensor by the interlaced reading method in the middle time zone of the reading period for the field and reading horizontal scanning lines corresponding to the time zones before and after that as black level lines. , An image of a horizontal scanning line read in the intermediate time period before or after the normal digital signal processing is performed, before or after writing each line data in the storage means, or after being read from the storage state The central section is cut out so that the data has a predetermined aspect ratio when displayed in relation to the number of horizontal scanning lines. Steps to convert the region data other than central section to the black level, according to the method of creating still image data in a video camera, characterized in that obtaining the image data of one frame as a whole.

According to a fourth aspect of the present invention, in the above video camera with a camera shake correction function, the storage means has the same storage capacity as described above, and in the still image mode, the procedure for stopping the camera shake correction function and the two steps in the moving image shooting mode. A procedure for reading horizontal scanning line signals from the entire area of the solid-state image pickup device by an interlaced read method within a field reading period, and before writing each line data to the storage means after performing normal digital signal processing. , The horizontal scanning lines are vertically compressed so that the number of read horizontal scanning lines is less than half, and each horizontal scanning line is configured to have a predetermined aspect ratio in display in relation to the number of horizontal scanning lines after the compression. Of the pixel data of the above is uniformly thinned and the image data after the compression by the above procedure is written in a predetermined area of the storage means. 1 frame image data in which a plurality of reduced still image data with different timings are arranged in proper positions by repeatedly performing a series of operations consisting of one or more field reading periods as an interval time. And a method of creating still image data in a video camera.

[0013]

[Action]

Regarding the first invention; In a video camera with a camera shake correction function, since the camera shake correction area is added to the image pickup area for one frame in the solid-state image sensor, the image signal read out from the whole area by the interlace scanning method is The number of horizontal scanning lines is larger than the number of horizontal scanning lines for a normal field. In the moving image shooting mode, unnecessary horizontal scanning lines are discarded by the camera shake correction function to obtain a horizontal scanning line for one field. In the still image mode according to the present invention, the camera shake correction function is stopped and The horizontal scanning lines are read from the entire area of the solid-state imaging device including the image stabilization area in the reading period for two fields in the shooting mode, and all the horizontal scanning line data is used. The number of horizontal scanning lines read in the still image mode is larger than one field but smaller than one frame, and the horizontal scanning line data lacking in the one frame is replaced with the actually read horizontal scanning line data. It is created by the line interpolation method used, and it is interpolated evenly. Incidentally, the interpolation procedure may be performed at any stage before the line data is written into the storage means after the normal digital signal processing is performed, or at the storage state after the writing or after the reading from the storage state. . As a result, 1 is interpolated based on the image data composed of the number of horizontal scanning lines larger than the number of horizontal scanning lines for one field.
By obtaining frame image data and interlacing it every other line, it becomes possible to display a high-resolution and fine still image.

Regarding the second invention; the present invention relates to a modification of the first invention, and although stopping the image stabilizing function in the still image mode is the same, the number of horizontal image pickup devices from the solid-state image pickup device is the same. At the stage of reading the scan line, 1
The horizontal scanning lines lacking for the frame are evenly inserted as black level lines. The black level line can be easily inserted by controlling the read timing with respect to the solid-state image sensor. Then, the black level line is converted into the horizontal scanning line of the interpolated image data by the same interpolation method as in the first aspect of the invention. The execution stage of the interpolation procedure is the same as in the case of the first invention. As a result, even in the present invention, a fine still image can be obtained according to the same principle as that of the first invention, but there is an advantage that the deterioration of the image is small because the black level line inserted in advance is rewritten. .

Regarding the third invention: The present invention is applied when a finer still image is obtained in a so-called "commemorative photo mode" as a special function of a video camera. In this invention, in the still image mode, the camera shake correction function is stopped in the same manner as in the above-described inventions, but the timing at which the horizontal scanning line is interlaced and read from the solid-state image sensor is equivalent to two fields in the moving image shooting mode. It is set in the middle time zone of the reading period. Further, all horizontal scanning lines corresponding to the time zones before and after the intermediate time zone are black level lines. When the read timing and the addition of the black level line correspond to the screen, the upper and lower areas of the screen correspond to the image of the black level line and the intermediate area corresponds to the image of the read horizontal scanning line. By the way, in the above-mentioned "commemorative photo mode", a display mode in which a captured image is surrounded by a white frame is used, and conventionally, a method of simply erasing the field image in the frame portion has been adopted. In the present invention, the screen configuration is cut out so that the central section of each horizontal scanning line data read from the solid-state image sensor is formed so that a predetermined aspect ratio is formed in relation to the number of lines, and the area data other than the cutout area is cut out. This is achieved by converting to black level. In that case, the image is composed of a number of lines larger than the number of horizontal scanning lines for one field, and all the read image signals are used in the vertical direction. It is possible to generate a fine still image in the "photo mode". The data processing in this invention can also be executed at the same stage as in the case of the first invention.

Regarding the fourth invention: The present invention relates to a method for arranging a plurality of time-sequential reduced still images on one screen as a special function of a video camera. In the present invention, the following series of operations is repeated for the required number of still images with a predetermined interval time. First, the camera shake correction function is stopped, and a predetermined number of horizontal scanning lines are read out from the solid-state image pickup device within the read-out period for two fields in the moving image shooting mode. The total number of lines for interlaced reading at that time varies depending on the required number of still images, but naturally it is divided into two or more, and the total number of lines is less than half of one field. Then, since the image data is compressed in the vertical direction, the pixels of each horizontal scanning line are evenly thinned correspondingly to perform the compression in the horizontal direction so that a predetermined aspect ratio can be obtained on the display. To do. It should be noted that these compression procedures are executed after the normal digital signal processing is performed and before the data is written in the storage means. By repeating this series of operations, a plurality of reduced still image data with different timings can be stored in different storage areas in the storage means, and frame data for obtaining the above-described display screen is configured.

[0017]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT An embodiment of "a method for creating still image data in a video camera" of the present invention will be described in detail below with reference to the drawings. First, FIG. 8 is a block circuit diagram of a camera-integrated VTR. 1 is an optical lens unit, 2 is a solid-state image sensor with a shake correction area, 3 is an analog signal processing unit, and 4 is A /
D converter, 5 is a digital signal processing unit, 6 is a D / A converter, 7 is a signal recording / reproducing unit (hereinafter referred to as "recording / reproducing unit"), 8
Is a memory controller, 9 is a field memory, and 10 is a solid-state imaging device drive control unit (hereinafter referred to as "drive control unit"), which records and reproduces an NTSC standard television signal. In this camera-integrated VTR, the solid-state imaging device 2 photoelectrically converts subject light incident from the optical lens unit 1 and the converted signal is converted into an analog signal processing unit 3
After performing correlated double sampling and AGC processing in
It is digitized by the A / D converter 4, and the digital signal is input to the digital signal processing unit 5. Then, the image data that has been subjected to various kinds of signal processing in the digital signal processing unit 5 is stored in the field memory 9 via the memory controller 8 at any time, and further subjected to processing such as camera shake correction processing and special effects, and digitalized again. It is output to the recording / reproducing unit 7 and the D / A converter 6 via the signal processing unit 5. The recording / reproducing unit 7 can record / reproduce the image data after processing on a magnetic tape or a disk, and the image data output to the D / A converter 6 is the digital I / F as it is.
The analog signal output from the output terminal can be connected to an external digital device, and the analog signal converted by the D / A converter 6 can be used as a standard television signal.

Now, when a 630,000 pixel CCD image sensor is used for the solid-state image pickup device 1, there are about 330 effective horizontal scanning lines in the field reading, including the image stabilization area. In the normal moving image shooting mode, the memory controller 8 detects the amount of camera shake correction in the vertical direction, and sends optimum camera shake correction information to the drive controller 10. On the other hand, in the drive control unit 10 that has received the correction information,
Based on the information, necessary 240 lines are cut out from the 330 horizontal scanning lines, and the horizontal scanning lines are read out from the solid-state image sensor 2. Further, since the signal charge is read by changing the combination of the color filters in the even field and the odd field, the signal obtained by D / A converting the image data output from the digital signal processing unit 5 is set on the television receiver side. By interlaced scanning every other field, a standard television signal can be obtained.

Next, each embodiment of the present invention will be described individually. However, in carrying out the method of each embodiment, the field memory 9 in the camera-integrated VTR has a storage capacity capable of storing image data for two fields (that is, image data of 480 lines × 720 pixels). It is assumed that [Embodiment 1] First, as shown in FIGS. 1A and 1B, a charge readout pulse synchronized with a vertical synchronization signal is output from the drive control unit 10 to the solid-state image pickup device 2, and a moving image is captured. In the mode, as in the normal output state shown in FIG. 1C, the solid-state imaging device 2 transfers the signal charge of each photodiode to the vertical transfer CCD at the start of one field period, and the image signal is transferred within that period. Although it is output, the unnecessary signal charges of the horizontal scanning line due to the camera shake correction control are discarded, and the necessary 24
Only 0 lines are output to the analog signal processing unit 3 and processed by the subsequent circuits.

On the other hand, while operating in the above-mentioned moving image shooting mode,
When the still image mode is instructed and input by the operation button (not shown) of the camera-integrated VTR, the camera shake correction control function is stopped at the next rising edge of the vertical synchronizing signal, and the drive control unit 10 causes the vertical synchronizing signal to rise. After outputting the charge read pulse corresponding to, the signal charge transferred from each photodiode to the vertical transfer CCD immediately before is output to the horizontal transfer CC.
The image signal of each horizontal scanning line is sequentially output by the horizontal transfer CCD. However, in this case, since the camera shake correction control function is stopped, it is possible to perform the interlace read-out method from the entire area including the camera shake correction area of the solid-state image sensor 2 by the interlaced read method.
The signals of 30 horizontal scanning lines are output. By the way, since the 1-field period has an output time of 240 lines, the output time of the 330 lines exceeds the 1-field period, and the charge read pulse is output corresponding to the next vertical synchronizing signal. Then, the electric charges accumulated in the respective photodiodes are overlapped and read during this period. Therefore, in the still image mode, the charge read pulse is controlled not to be output for the next vertical synchronizing signal, and in order to prevent the charge from being accumulated in each photodiode over one field period, 1 The charge is neutralized by executing the shutter operation when the field period elapses.

The signal reading of a total of 330 horizontal scanning lines is completed after one field period has elapsed from the start and before two field periods have elapsed, but two field periods have elapsed from the completion of signal reading. A black level signal is output during the period up to. In addition, the output period of the black level signal is 150 (= 480-
330) Equivalent to this. Therefore, if the still image mode is instructed, the 33
0 horizontal scanning lines and 150 black level lines will be read, but the signals are read by the analog signal processing unit.
After being processed in 3, it is digitized by the A / D converter 4 and input to the digital signal processing unit 5. In the digital signal processing unit 5, the data relating to 150 black level lines is discarded and 330 horizontal lines are output. Normal signal processing is applied only to the scanning line, and each processed line data is written in the field memory 9 via the memory controller 8.

Then, as shown in FIG. 2, the digital signal processing section 5 carries out interpolation enlargement processing by electronic zoom while reading the image data of the field memory 9 through the memory controller 8. Specifically, since there are 330 horizontal scanning lines related to the image read from the solid-state image sensor 2, there are more than 240 horizontal scanning lines per field, but 480 horizontal lines per frame have the above black level lines. There is a shortage of 150 lines corresponding to the number of lines, and the 150 lines of the lacking line are created by the line interpolation method using the pixel data of the horizontal scanning line related to the read image, and the created line data is interpolated evenly. By doing so, one frame of still image data is obtained. In this case, in the uniform interpolation, one interpolation line is inserted for every 2.2 horizontal scanning lines read.

Further, the image data obtained by the above-mentioned interpolation enlargement processing is sequentially rewritten by the memory controller 8 in the field memory 9 and the still image data for one frame after interpolation is stored in the field memory 9. Or later,
When the read instruction is issued, the still image data for one frame is read by the memory controller 8 every other line for two field periods, and the read signal is interlaced by the television receiver to thereby obtain the moving image shooting mode. It is possible to obtain a still image having a quality close to that of the image. That is, in the still image mode according to the related art, since the field data composed of 240 horizontal scanning lines are repeatedly interlaced, image deterioration in the vertical direction occurs, but according to this embodiment, the solid-state image sensor 2 is used. Since 330 horizontal scanning lines are obtained from the image pickup signal including the image stabilization area, and the frame image data complemented by the line interpolation method is created based on the line data, a high-resolution fine still image is generated. It will be possible to obtain. In addition, of course, the still image data is recorded in the signal recording / reproducing unit.
It is also possible to record it with 7 or an external digital device.

After the two-field period in the still image mode has elapsed, the moving image shooting mode is automatically restored. However, since the shutter operation is interposed in the still image mode as described above, one field at the time of the return is set. There is no abnormality in the signal read from the solid-state image sensor during the period, and a smooth transition from the moving image shooting mode to the still image mode to the moving image shooting mode is possible. Further, in the present embodiment, the image data of the read signal is once written in the field memory 9 and subjected to interpolation processing to create one frame of still image data. Memory 9
To the digital signal processing unit 5 at the stage of writing data to the field memory 9 or at the stage of reading and reproducing the data written in the field memory 9.
May be performed.

[Embodiment 2] In this embodiment, when a still image mode is instructed by an operation button (not shown) during operation in the moving image photographing mode, (A) and (B) of FIG. Signals are read from the solid-state image sensor 2 at the timings shown in (D) and (D). As is clear from each figure, the timing setting and the like in the transitional state of the moving image shooting mode → still image mode → moving image shooting mode are the same as those in the first embodiment, but in this embodiment, the reading process of each horizontal scanning line is performed. The drive control unit 10 repeatedly performs line reading of two lines and stop reading of one line. That is, signal reading is performed in such a manner that one black level line is inserted into the two horizontal scanning lines output from the solid-state imaging device 2 in the interlaced reading method. However, if the above control is executed in the process of reading out 330 lines, the total number of black level lines becomes 490. Therefore, in order to obtain 480 lines, a portion where the black level lines are not interposed is appropriately provided. Therefore, the above-mentioned signal read time is eventually completed in two frame periods.

The 480 lines read out in this manner are subjected to analog processing and then subjected to A
It is inputted to the digital signal processing unit 5 after being digitized by the / D converter 4, but as shown in FIG. 3, the digital signal processing unit 5 puts each black level line before and after it before performing color separation processing. The image data is converted into a line of image data by the line interpolation method using the horizontal scanning line. While executing the conversion, 480 lines are sequentially written to the field memory 9 through the memory controller 8, and when the two frame periods are completed, the field memory is finished.
Store still image data for 1 frame in 9.

After that, the read and display when the read instruction is issued are the same as the operation described in the first embodiment, and a fine image can be obtained on the television receiver side. In particular, in this embodiment, since the line to be interpolated is inserted in advance as a black level line, the procedure of converting into the interpolated image data in the previous stage of the color separation processing can be adopted, and the interpolation processing described in the first embodiment can be adopted. As described above, since data transfer between the field memory 9 and the digital signal processing unit 5 is not involved, a still image with little image deterioration can be created. However, it is not always necessary to perform the above-described interpolation processing before writing to the field memory 9 as in the present embodiment, and the interpolation processing may be performed after writing to the field memory 9 as in the first embodiment. It is also possible to adopt a method of executing the step of reading the written data and reproducing it.

[Embodiment 3] This embodiment relates to a method of obtaining a still image in the "commemorative photo mode", in which the operation button (not shown) is used to input an instruction in the still image mode during operation in the moving image shooting mode. Then, the signal reading from the solid-state image pickup device 2 is executed at the timings shown in (A), (B) and (E) of FIG.
Therefore, the timing setting and the like in the transition state of the moving image shooting mode → still image mode → moving image shooting mode are the same as those in the first embodiment, but in this embodiment, the read time period of the 330 horizontal scanning lines is the still image. It is characterized in that it is set in the middle of two field periods after the mode is set.
Then, the read is completely stopped by the drive control unit 10 in the time zones existing before and after the read time zone in the two-field period, which is the output period of the black level signal. Therefore, in the 2 field period, [75 black level lines], [330 horizontal scanning lines read from the solid-state image sensor 2 by the interlaced read method], and [75 black level lines] are sequentially output. Will be.

The signals output from the respective lines are subjected to the same analog processing as in the case of the first embodiment and digitized by the A / D converter 4 and then input to the digital signal processing section 5. In the embodiment, a data processing process as shown in FIG. 4 is performed. First, when the image data that has been subjected to normal digital signal processing is made to correspond to the display mode, the upper 75 lines corresponding to the output period of each line, the area formed by the black level line data, the center Of 330
The line portion is an area composed of the read horizontal scanning line data, and the lower 75 lines is an area composed of the black level line data. The image area includes the line obtained from the image stabilization area of the solid-state image sensor 2
It is composed of 30 horizontal scanning line data, and the image data is read from the solid-state image pickup device 2 by the interlaced read method every other line, so that it can be displayed at the same resolution as a normal field image. However, since there are 480 lines per frame, the image area becomes horizontally long compared to the standard aspect ratio (3: 4) of the display screen.

Therefore, in this embodiment, the digital signal processing unit 5 targets the intermediate portion in the horizontal scanning direction so that the image area relating to the horizontal scanning line data for the central 330 lines has an aspect ratio of 3: 4. The clipping processing is performed by the sampling frequency conversion described above, and the pixel data of both side areas other than the clipping area is rewritten to the black level. In this case, since the solid-state image sensor 2 uses a 630,000 pixel CCD image sensor, the number of pixels on the horizontal scanning line is 720, but 112 to 113 pixels on both sides of each horizontal scanning line are respectively used. The black level is rewritten, and as a result, the image area is composed of 330 lines × 495 pixels.

Then, the frame data after the above processing is written into the field memory 9 through the memory controller 8, and when the read instruction is issued, the memory controller 8 reads every other line in two field periods. By interlacing the read signal with a television receiver, an image in the "commemorative photo mode" can be displayed. That is, an image having an aspect ratio of 3: 4 is displayed on the screen in a form surrounded by a white frame. In the conventional "Memorial photo mode",
Image data for one field stored in the frame memory
An image is formed by repeatedly interlacing (240 lines × 720 pixels) and the periphery of the image is erased by a white frame area formed of black level data. According to this, an image can be obtained at a resolution equivalent to that of a normal moving image shooting mode, and the horizontal scanning line obtained from the solid-state image sensor 2 can be used as a display image without waste, and the fineness of image quality and image data It is far superior in terms of effective use. If the aspect ratio is not corrected by the clipping process and the data is used as it is, a still image in a so-called "cinema mode" in which the horizontal direction is the entire screen and the vertical upper and lower parts are white areas is displayed. It may be displayed and the "commemorative photo mode" and "cinema mode" may be switched.

[Embodiment 4] This embodiment relates to a method for obtaining a still image in the "divided picture mode". For example, as shown in FIG. It relates to a method for obtaining an image including nine still images in series. When the still image mode is instructed by the operation button (not shown) during operation in the moving image shooting mode, (A) in FIG.
Signals are read from the solid-state image sensor 2 at the timings shown in (B) and (C). The signal reading in the present embodiment is characterized in that the same still image output state as that in the first embodiment is set nine times with a fixed interval period after the instruction input of the still image mode is made. That is, in each still image output state, 330 horizontal scanning lines are read from the entire area including the image stabilization area of the solid-state image sensor 2 by the interlaced read method, and then 150 black level lines are read. .

In each still image output state, the analog signal processing and the A / D converted line data are subjected to normal signal processing by the digital signal processing section 5. However, in the present embodiment, As shown in FIG. 6, the digital signal processing unit 5 executes vertical and horizontal compression processing and addition of a black level frame area. First, as in the first embodiment, the black level lines in the read line data are discarded, and 140 lines are formed by evenly thinning out 330 horizontal scanning lines. That is, about 42.5% is compressed by thinning out the lines at a ratio of about 2.36. Next, although each horizontal scanning line is composed of data of 720 pixels, each line is composed of 210 pixels by evenly thinning out pixels. That is, about 29% compression is performed by thinning out pixels at a ratio of about 3.43 pixels to one pixel. The image data of 140 lines × 210 pixels obtained by the compression in the vertical / horizontal direction has an aspect ratio of 3: 4 when displayed on the screen.

Further, the digital signal processing unit 5 blacks the compressed 140 line × 210 pixel image data by 10 lines in each of the upper and lower areas in the vertical direction and 15 lines in each of the left and right areas in the horizontal direction. Frame data composed of level pixels is added. As a result, 16
Image data with a frame of 0 line × 240 pixels is formed, and the digital signal processing unit 5 writes the image data in a predetermined area of the field memory 9 via the memory controller 8. In that case, the writing address is set in the writing area to the field memory 9 so as not to sequentially overlap in correspondence with the still image output states for a total of 9 times, and as a result, the storage state as shown in FIG. 7 is configured. . Specifically, the framed image data relating to the still image output state from the first time to the third time is written in a manner that they are horizontally adjacent to each other in the arrangement relationship of scenes 1 to 3, and similarly from the fourth time. The framed image data relating to the still image output state up to the 6th time is further related to the arrangement relations of the scenes 4 to 6 in which the interruption shifts, and the framed image data relating to the 7th to 9th still image output state is further The field memory 9 stores the data of 480 lines x 720 pixels at the stage when the 9th framed image data is finally written in the field memory 9 after being written in the arrangement relationship of the shifted scenes 7-9. State (FULL
State).

When a read instruction is issued, the first
The still image data for one frame is read by the memory controller 8 every other line in a two-field period, and the read signal is interlaced by a television receiver to display an image in which the display mode of FIG. 7 is replaced. . In that case, the image of each scene is an image taken at each of the above-mentioned interval periods, and the subject is displayed in the regions of scenes 1 to 9 as an image in which the subject changes in time series, and the display region of each scene is horizontal. 20 lines, and 30 pixels in the vertical direction are separated and displayed by a white strip frame.

In the present embodiment, the image of each scene is a compressed image, but the original image data is read from the entire area of the solid-state image sensor 2 including the image stabilization area 33.
It is created based on 0 horizontal scanning lines, and is superior in resolution to the case where similar image data is created using 240 horizontal scanning lines in the moving image shooting mode. Further, in the present embodiment, the still image output state is set 9 times during the interval period to display images for 9 scenes, but the number of times is 2
The number of times to be set more than once is arbitrary, and in that case, the setting of the compression ratio, the frame area giving condition, and the write address for the field memory 9 is appropriately changed in accordance with the selected number of times. By doing so, it becomes possible to display the set number of time-series still images with a frame in one screen.

Although the above embodiments have been described on the premise of the NTSC system, it goes without saying that the present invention can be applied to any television system such as PAL.

[0038]

The "method of creating still image data in a video camera" of the present invention has the above-mentioned configuration, and therefore has the following effects. The invention of claim 1 is
In a video camera with a camera shake correction function that has a solid-state image sensor with a camera shake correction area added to the image capture area for one frame, in the still image mode, it is an interlaced readout method from the entire area of the solid-state image sensor including the camera shake correction area. Since horizontal scanning lines are read out and one frame of still image data is obtained by line interpolation processing using all the read out line data, horizontal scanning line data for one field is simply repeated as in the conventional case. It is possible to significantly improve the resolution as compared with a still image obtained by interlacing the image and display a high-quality still image. According to a second aspect of the present invention, in the video camera with a camera shake correction function, when the horizontal scanning lines are read from the entire area of the solid-state image pickup device including the camera shake correction area by the interlaced reading method, the horizontal scanning lines are arranged between the horizontal scanning lines. The black level lines of the number of lines short of the number of horizontal scanning lines for two fields are evenly inserted, and the black level line data is converted into interpolation lines by line interpolation processing. The same effect as that of the first aspect of the invention can be obtained, and still image data with little deterioration in image quality can be created for the reason that interpolation processing can be performed before color separation processing. According to a third aspect of the present invention, in the video camera with the image stabilization function, the so-called "commemorative photo mode" is used by directly using the horizontal scanning line read from the entire area of the solid-state image sensor including the image stabilization area by the interlaced read method. "
It is possible to display a still image with a frame in, and the resolution is compared to the case where a still image in "commemorative photo mode" is obtained by the method of deleting the frame area of the image data for one field as in the past. It has the advantage that the obtained image data can be used more effectively. According to a fourth aspect of the present invention, in the video camera with the image stabilization function, the time-series changes of the subject in each interval period are arranged in one frame of image data as a plurality of compressed still image data. It is possible to display changes in a subject in the form of a plurality of disassembled photographs on one screen. Further, although each still image is compressed, in the present invention as well, the horizontal scanning line data read by the interlaced read method from the entire area of the solid-state image pickup device including the image stabilization area is used. It is possible to obtain a still image having a higher resolution than the case where similar image data is obtained using the image data for one field.

[Brief description of drawings]

FIG. 1 is a signal timing chart showing a signal read state from a solid-state image sensor according to Examples 1 to 3 of “Method of creating still image data in video camera” of the present invention. Incidentally, (A) shows a vertical synchronizing signal, (B) shows a charge read pulse, (C) shows the first embodiment, (D) shows the second embodiment,
(E) shows a signal read state corresponding to the third embodiment.

FIG. 2 is a conceptual diagram showing data processing contents of the first embodiment.

FIG. 3 is a conceptual diagram showing the signal processing contents of the second embodiment.

FIG. 4 is a conceptual diagram showing the signal processing contents of the third embodiment.

FIG. 5 is a signal timing chart showing a signal read state from the solid-state imaging device according to the fourth embodiment. In addition, (A) shows a vertical synchronizing signal, (B) shows a charge read pulse, and
(C) shows a signal read state.

FIG. 6 is a conceptual diagram showing the signal processing contents of the fourth embodiment.

FIG. 7 is a diagram showing a final storage state of a field memory in the fourth embodiment.

FIG. 8 is a block circuit diagram of a camera-integrated VTR according to each embodiment.

[Explanation of symbols]

1 ... Optical lens unit, 2 ... Solid-state image sensor with image stabilization area, 3 ... Analog signal processing unit, 4 ... A / D converter, 5 ... Digital signal processing unit, 6 ... D / A converter, 7 ... Signal recording Reproducing unit, 8 ... Memory controller, 9 ... Field memory (storage means), 10 ... Solid-state image sensor driving unit.

Claims (4)

[Claims] 1. A solid-state image sensor having an image stabilization area added to an image-capturing area for one frame, and a digital signal for an image signal output from all areas of the solid-state image sensor in an interlaced read mode in a moving image shooting mode. The processed image data is temporarily stored in the storage means, and the read control from the solid-state image sensor is performed based on the amount of camera shake correction obtained by analyzing the image data. In a video camera with an image stabilization function for recording and / or outputting the field data after the digital signal processing, the storage capacity of the storage means is set to a storage capacity capable of storing image data for at least two fields, and a still image mode is set. Then, the procedure to stop the image stabilization function and the reading period for 2 fields in the movie shooting mode. A procedure of reading horizontal scanning line signals from all areas of the solid-state image pickup device by interlaced reading within a space, and a step of writing each line data to the storage means before or after writing normal digital signal processing. After reading from the stored state or the stored state, the horizontal scanning line data of the number of lines short of the horizontal scanning lines for two fields is created by the line interpolation method, and the procedure of uniform interpolation is executed to execute one frame of A method for creating still image data in a video camera, characterized by obtaining still image data. 2. The video camera with a camera shake correction function according to claim 1, wherein the storage capacity of the storage means is a storage capacity capable of storing at least two fields of image data, and the camera shake correction function is stopped in the still image mode. The horizontal scanning line for two fields is read between the horizontal scanning lines while the horizontal scanning line signal is read out from the entire area of the solid-state image pickup device by the interlaced reading method within the reading period for two fields in the moving image shooting mode. The number of black level lines which is insufficient in number is evenly inserted, and the memory state before or after writing each line data into the memory means after performing normal digital signal processing, or its memory state After reading from, the procedure for converting the black level line data into interpolated image data using the line interpolation method is implemented. A method for creating still image data in a video camera, characterized in that one frame of still image data is obtained. 3. The video camera with a camera shake correction function according to claim 1, wherein the storage capacity of the storage means is a storage capacity capable of storing image data for at least two fields, and the camera shake correction function is stopped in the still image mode. The horizontal scanning line signal is read out from the entire area of the solid-state image pickup device by the interlaced reading method in the intermediate time zone of the reading period for two fields in the moving image shooting mode, and the horizontal scanning lines corresponding to the time zones before and after that. Is read as a black level line, and after the normal digital signal processing is performed, each line data is written in the storage means, or after being read from the storage state after the writing or after reading from the storage state, in the intermediate time zone. The image data relating to the read horizontal scanning line has a predetermined aspect ratio when displayed in relation to the number of horizontal scanning lines. Still image data in a video camera, characterized in that a central section is cut out so as to form a frame ratio and a procedure for converting area data other than the central section into a black level is performed to obtain image data of one frame as a whole. How to create. 4. The video camera with a camera shake correction function according to claim 1, wherein the storage capacity of the storage means is a storage capacity capable of storing at least two fields of image data, and the camera shake correction function is stopped in the still image mode. The procedure for scanning, the procedure for reading horizontal scanning line signals from the entire area of the solid-state image sensor by the interlaced readout method within the readout period for two fields in the moving image shooting mode, and each line data after performing normal digital signal processing. Before writing into the storage means, the read horizontal scanning lines are compressed in the vertical direction so that the number of lines becomes half or less, and a predetermined aspect ratio is displayed in relation to the number of horizontal scanning lines after the compression. To uniformly thin out the pixel data of each horizontal scanning line so as to configure A series of operations consisting of a procedure for writing the subsequent image data in a predetermined area of the storage means is repeated a predetermined number of times with one or more field reading periods as interval times, and a plurality of reduced stationary images with timing deviations are executed. A method of creating still image data in a video camera, characterized in that image data of one frame in which image data is arranged in a proper place is obtained.