KR970010392B1 - High definition image pick-up device and recorder and reproduction device for high definition picture information - Google Patents

Abstract

None.

Description

High-definition imaging device and high-definition image information recording and reproducing device

1 is a diagram showing one embodiment of a high-definition imaging device according to the present invention.

2 is a diagram showing one embodiment of a high definition still picture recording and reproducing apparatus according to the present invention.

3 is a diagram showing spatial sampling points and pixels of a two-dimensional image picked up in the above embodiment.

4 is a diagram showing the timing of a high definition video signal captured and output in the above embodiment.

5 is a diagram showing spatial sampling points and pixel interpolation of a two-dimensional image photographed according to another embodiment of the present invention.

6 is a diagram showing the timing of a high definition video signal captured and output according to another embodiment of the present invention.

7 is a diagram showing one embodiment of signal processing according to another embodiment of the present invention.

8 is a diagram showing spatial sampling points and pixel interpolation of a two-dimensional image picked up in the embodiment.

* Explanation of symbols for main parts of the drawings

10 lens 20 optical filter

30a, 30b, 30c: prism 40, 50, 60: solid state imaging device

70: color filter 80: signal processing circuit

100: HD camera 200a: HD still image recording unit

210a: recording signal processing circuit 220a: digital recording circuit

300a: recording medium 400a: HD still image playback unit

410a: digital reproduction circuit 420a: reproduction signal processing circuit

500: signal conversion circuit

The present invention relates to a solid-state imaging device for imaging a high-definition image, a recording and reproducing apparatus for high-definition image information, or a transmission apparatus using the same.

As a solid state imaging camera corresponding to the current television system (NTSC system or the like), a MOS type or CCD type solid state imaging irradiation of 200,000 to 400,000 pixels is already commercialized and commercialized.

On the other hand, as a high-definition solid-state imaging camera that captures images of four times higher definition than conventional ones, such as high-definition television (High Definition Televisson) devices, so-called high-vision television, for example, the document As described in Technical Report V.16, N.18-Technical Report Related to Solid State Imaging, the use of 1.5 to 2 million pixel solid-state image pickup devices has already been reported.

However, in the technical reports and start examples so far, considerations and studies for realizing a high-definition solid-state imaging camera as a self-contained and early implementation are not necessarily sufficient.

As described above, the reality of a high-definition solid-state imaging camera is indispensable to realize a large-sized device having a pixel count of four times or more that of a solid-state imaging device. Thus, new device development is required and development cost and There is a problem that it is difficult to make early practical use due to the time required for practical use, and the device size is also increased, which increases the cost of the device and makes it difficult to reduce the cost of the device.

SUMMARY OF THE INVENTION An object of the present invention has been made in view of the above-described problems, and therefore high-definition imaging is performed using, for example, a 400,000-pixel solid state imaging device used in a conventional television system without increasing the number of pixels of the solid state imaging device. And a device capable of recording / reproducing (or transmitting) a high-definition image at a relatively low cost so that it can be supplied early.

In general, when recording (or telegraphing) a high-definition video signal photographed and outputted by a high-definition camera roll having a pixel number of four times or more, the number of pixels by using human visual characteristics is used. Even if not all of them are recorded (or transmitted), it is possible to effectively record (or transmit) the number of pixels by effectively reducing the number of pixels by using a kind of band compression method.

The present invention focuses on this human visual characteristic to reduce the number of appeals for effective imaging. In other words, two space sampling points including nH spaces (nH / 2 as horizontal space cycles) and nV spaces (nV / 2 as vertical space cycles) in the horizontal direction are included. With respect to the dimensional space, for example, the first and second two solid-state image pickup devices having (nH × nV) / 4 pixel numbers are imaged in a positional relationship in which the spatial sampling points are offset from each other in the horizontal and vertical directions (nH The luminance signal Y including the effective pixel predetermined information regarding the x nV) / number of luminance information is obtained.

The third solid-state image pickup device having the number of (nH × nV) / 4 pixels obtains the color signal C including the effective pixel information about the (nH × nV) / 4 color information. This imaging reduces the number of pixels and compresses the video signal consisting of the luminance signal Y and the color signal C, in which the information amount is compressed, for example, without processing the pixel, and appropriately processes and records (or transmits) the information amount with compression, In the reproduction, a portion of the (nH × nV) spatial sampling points, which is not imaged and reduced, is reproduced by pixel interpolation to obtain a high-definition image in which pixel information of all sampling points is restored.

By using the above-described pixel reduction method and pixel restoration method, for example, a high-definition solid-state imaging camera capable of capturing a high-definition image equivalent to 1.6 million pixels, which is four times that of a conventional 400,000-pixel solid-state imaging device, can be realized. Can be. In addition, this imaging reduces the number of pixels and obtains a high-definition image that is information-compressed into a narrow band, so that the signal band of the recording (or transmission) system can be greatly extruded, thereby realizing a recording (or transmission) device. It becomes easy and can implement | achieve in low cost. In addition, the recording (transmission) capacity of the image information in the recording (or transmission) medium, for example, when recording a still image, can increase the number of recordings of the still image, and when recording a moving image, The recording time can be increased. In addition, in the case of image transmission, the transmission rate of the high definition image information can be reduced, thereby reducing the transmission time, and the secondary effect of reducing the running cost of the recording (or transmission) medium can be obtained.

EMBODIMENT OF THE INVENTION Hereinafter, the Example of this invention is described using drawing. FIG. 1 is a diagram showing one embodiment of a high-definition imaging device (hereinafter referred to as an HD camera) 100 according to the present invention, and FIG. 2 is an aspect ratio of using an HD camera 100 to view 16: FIG. 1 is a diagram showing one embodiment when the apparatus is applied to an apparatus for recording and reproducing a still image of a wide range of high definition (hereinafter, referred to as an HD still camera). 3 is a diagram schematically showing the relationship between a horizontal pixel, a vertical scanning line (hereinafter referred to as a line), a line number, and a linear sequential color signal of a two-dimensional image captured by the HD camera 100. to be. 4 is a diagram showing an example of the timing of a high definition video signal captured and output by the HD camera 100. FIG.

In Fig. 1, reference numeral 10 denotes a lens, 20 denotes an optical filter having optical lowpass characteristics, and 30a, 30b, and 30c are prisms. (40), (50), and (60) are two-dimensional solid-state image pickup devices, and in this embodiment, charges having 800 pixels in the horizontal direction and 518 total 800 × 518 (about 400,000 pixels) in the vertical direction as the effective pixel number Each of the solid state imaging elements of the transfer element CCD type is used. The optical images passing through the optical systems 10, 20, 30a, 30b, and 30c are simultaneously liquids of 16: 9 on the three CCDs 40, 50, and 60. It is imaged by a spectra and is imaged.

In the dual CCDSs 40 and 50, imaging relating to luminance information is performed. Therefore, the color filters do not necessarily need to be used for the CCDs 40 and 50. However, although not shown as described below, a G filter for extracting, for example, green information G as the first color information C1 may be provided in the light receiving portions of the CCDs 40 and 50.

As shown in Figs. 3A and 3B, the two CCDs 40 and 50 are equal to 1/2 pitch in the horizontal direction and 1/2 pitch in the vertical direction, respectively, at pixel pitch intervals of the respective CC Ds. Attached to the prisms 30b and 30c, respectively, in a state where they are separated in a spatially separated state, and in this CCD 40, line numbers 1, 2, 3,... 518 'pixels (hereinafter referred to as pixels in the odd field (the first field shown in FIG. 3 (b))) are read, and in the CCD 50, FIGS. Line numbers 1 ', 2', 3 ',. 518 'pixel (hereinafter referred to as pixel of even field (second field shown in FIG. 3B)) is read.

On the other hand, imaging of color information is performed in the CCD 60, and therefore, the color filter 70 for separating the color information is provided in the light receiving portion of the CCD 60. In this embodiment, the B filter for extracting the blue information B as the second color information C2 and the R filter for extracting the red information R as the third color information C3 are, for example, striped in the horizontal direction. The color filter 70 formed in the shape is used. Specifically, as shown in FIG. 3A, each pixel of the CCD 60 is attached to the prism 30a in a positional relationship substantially spatially coincident with the pixels of the table of the CCD 40, and the same. Radix lines 1, 3, 5,... 517 corresponds to the B filter, and lines 2, 4, 6,. In 518, the stripe-shaped color filter 70 is attached to the light receiving portion of the CC D 60 in a positional relationship to which the R filter corresponds.

According to the above configuration, spatial sampling of nH = 800 × 2 = 1600 in the horizontal direction and nV = 518 × 2 = 1036 in total in the horizontal direction and 1600 × 1036 (approximately 1.6 million pixels) in one vertical direction. An imaging area having a dot is secured, of which about 400,000 pixels, which is 1/4 of each CCD, are actually read. Hereinafter, this is called one frame.

In general, the image of this one frame is composed of two fields interlaced with each other, that is, two images of the first field indicated by the solid lines in FIGS. 3A and 3B and the second field indicated by the dotted lines.

As for the luminance information Y, about 800,000 pixels, which are a total of 1/2 of the total number of pixels per frame in the two CCDs 40 and 50, are effectively picked up and read. Regarding the color information C, two color information B and R are imaged and read in linear order at about 200,000 pixels, which are 1/8 per frame, respectively.

The syringe intervals of the leads of the CCDs 40, 50, and 60 of this two-dimensional image frame are taken as T, and as shown in the timing diagram of FIG. Pixels in a line (800,000 pixels in total for 518 x lines) are read. In this embodiment, as shown in FIG. 4A, in the CCD 40, pixels (Y1, Y3, Y5, ..., 200,000 pixels of Y518) of luminance from the odd line are independently read in the period T / 2. In the next T / 2 period, the pixels of the luminance from the even line (200,000 pixels of Y2, Y4, Y6, ..., Y518) are independently read, and accordingly, in the CCD 40, T per frame A total of 400,000 pixels are read in the period. Similarly, as shown in FIG. 4B, in the CCD 50, the pixels Y'1, Y3 ', Y5', ..., 200,000 pixels of Y517 'are independent from the odd line in the period T / 2. In the next half of T / 2, pixels (200,000 pixels of Y2 ', Y4', Y6 ', ..., Y518') from the even line are read independently, and thus the CCD 50 ), A total of 400,000 pixels are read in a T period per frame. In this manner, about the luminance information Y, all of 800,000 pixels (100,000 lines of 518 lines per field) for 1036 lines are read.

Therefore, the appeal of 1/2 of the two-dimensional spatial sampling points (nH x nV) to be picked up is reduced to obtain a luminance signal in which the signal band is compressed.

On the other hand, with respect to the color information, since the optical image passing through the B filter and the R filter of the color filter 70 alternately in line units is captured by the CCD 60, the blue information B and the red eye beam R are respectively described. Pixels of one-half line (259 lines) in the case of the luminance information Y are read. In this embodiment, as shown in FIG. 4C, in the CCD 60, the pixels B1, B3, B5, ..., 200,000 pixels of B517 of blue information from the odd lines are independently read in the period T / 2. In the next T / 2 period, the pixels R2, R4, 46, ..., 200,000 pixels of R518 from the even line are independently read.

In this way, the blue information B of 20,000 lines of 259 lines per frame is read as the second color information C2, and the red color of 200,000 pixels of all 259 lines per frame as the third color information C3 is read. Information R is read. In this embodiment, in order to reduce the number of pixels of the color information, the color information is read only in one field (field shown in FIG. 3A) as described above, and the signal is read in the second field (dashed field in FIG. 3A). Does not run. Therefore, these color information B and R are reduced in the amount of information by 1/4 compared with the luminance information Y, so that the signal band is output by compressing the signal band of the luminance information Y in 1/4.

According to the above arrangement, the linear sequential reads alternately output the color information B and R in units of scanning lines for each frame (B1, R2, B3, R4, as indicated by the linear sequential color numbers in FIG. 3A). ..., B517, the method of reading in order of B518) is easily implemented.

The luminance information Y and the color information B and R respectively read by the CCD in units of one frame of the image are supplied to the signal processing circuit 80 to be appropriately processed. In this embodiment, as shown in FIG. 4D or FIG. 4E, a single channel video signal is converted and output.

In the case of FIG. 4D, the signal processing circuit 80 converts the output time-series sequence in units of lines, and sets the basic period of one frame of the video signal to be output as T 'in the first T' / 3 period. Luminance signals of Y1, Y2, Y3, Y4,. , Y517, Y518 are output, and in the next T '/ 3 period, the luminance signals Y1', Y2 ', Y3', Y4 ', ... in the second field. , Y517 'and Y518' are output. In addition, in the next T '/ 6 interpolation, the blue signals B1, B3, B5,... , B517 is output, and in the next T '/ 6 period, the red signals R2, R4, R7, ... of the first field. , R518 is output. The video signal converted into the single channel is output from the terminal 90.

In the case of FIG. 4E, the output time sequence of the line unit is converted in the signal processing circuit 80, and the lines L1, L2, L3, L4,... Are in the period of the first T '/ 2 first field. , L517, L518, and the following second field of T '/ 2 in the period L1', L2 ', L3', L4 ',... L517 'and L518' are output in this order. At this time, the time axis of line-by-line is converted as shown in the 4f also in the signal processing circuit 80, a luminance signal (hereinafter referred to, this P _B signal) Y and the signal related to the color difference signal BY, and a color difference signal in the RY A related signal (hereinafter referred to as a P _R signal) is converted into a time-division multiplexed single channel signal (hereinafter referred to as time-division multiplexing signal) on a line-by-line basis and output from the output terminal 90. More specifically, as shown in FIG. 4F, in general, the line L2-1 in the radix (2n-1) th line of the first field outputs a time-division multiplexed signal of the color signal P _B and the luminance signal Y, and is excellent (2n). In the second line L2, a time-division multiplexed signal of the color signal P _R and the luminance signal Y is output. Similarly, a signal obtained by time division multiplexing the color signal P _B ′ and the luminance signal Y is output from the radix (2n-1) '-th line L201' of the second field, and the color signal P from the even (2n) 'th line L2'. _A signal obtained by time division multiplexing _R 'and the luminance signal Y is output. In this embodiment, since the color information of the second field is not read as described above, the odd number 2n− of the first field is shown in the signal processing circuit 80 as shown in FIG. 1) th color signal P _B 2-1 with solid (2n) th color signal P _R 2 a second "second color signal of the odd number (2n-1) of the field P _B 2-1 with solid (2n, respectively) of the second color signal Process to output by interpolating to the same signal as P _R 2 ′. In addition, predetermined time-synchronization information, such as horizontal synchronization information, burst information, and vertical synchronization information S (signal shown by S in FIG. 4f) is multiplexed and outputted to this time division multiplex signal.

The signals shown in FIG. 4D or FIG. 4E are all output as signals of a single channel. Therefore, in this embodiment, the terminal 90 can be connected to other devices with only one connection, thereby simplifying interlacing with the devices. The secondary effect can be obtained.

According to the above-described reading method of the luminance information Y, the number of pixels at the time of imaging is reduced by half, and the band compression is performed, and independent reading of all the pixels of all the lines of each CCD can be performed within one frame. By performing the conversion in which the time sequence of the lines is changed and output by the signal processing circuit 80, substantial reads are realized in sequential scanning in each CCD for each field, and substantial reads in interlaced scanning between the fields are realized. Can be. Therefore, even if a CCD element having a conventionally known structure is used for the CCDs 40 and 50, the effect of easily realizing the read which combines sequential scanning and interlaced scanning can be obtained.

Incidentally, in the present invention, the present invention is not limited to the above-mentioned pseudo-sequential scanning, and is not limited to regular line numbers 1, 2, 3, 4, 5,... , 517, 518 may be used a sequential scanning type image pickup device, which eliminates the need for signal processing for converting the chronological sequence of lines in the signal processing circuit 80 described above. Signal processing can be simplified.

In addition, according to the reading method of the color information (B and R), it is possible to easily realize the band-sequential line sequential reading, and to convert the time axis of the line unit in the signal processing circuit 80 as described above. This makes it possible to easily obtain a signal obtained by time division multiplexing color information and luminance information by band-compression.

In addition, since the reading of the above-mentioned color information is carried out for each line and the reading of the signal is realized, so-called vertical sampling is performed, which may cause vertical disturbance to cause deterioration in image quality. This problem can be solved by reducing the influence by the following lead method.

The first method is to provide optical filter elements of diffraction grating type or crystal birefringence type in the color filter 70 attached to the light receiving portion of the CCD 60 to limit the band in the optically vertical direction. By this method, luminance information is not limited in band but only color information is band-limited, and only the feedback disturbance in the vertical direction according to the above line sequence can be eliminated without degrading the resolution.

The second is when the color information is read using a BR filter having a stripe structure in the vertical direction instead of the BR filter having a stripe structure in the horizontal direction to the color filter 70 attached to the light receiving portion of the CCD 60. This method adds two lines.

Specifically, lines L1 and L2, L3 and L4, L5 and L6,... Is a method of separately outputting B and R from pixel information of color sequence obtained by adding L517 and L518 respectively.

By the effect of the vertical filter limiting the band in the vertical direction before the predifference with this two-line addition lead method, the feedback disturbance is reduced and the effect can be made not visible.

This two-line addition lead method may be used for reading the luminance information Y. When the color information is read by two-line addition as described above, the center of the color information is shifted by 1/2 pitch in the vertical direction. Therefore, the brightness information is also read by the two-line addition. Since the center of the color information can be completely matched by 1/2 pitch shift, good image quality can be obtained without removing feedback disturbance.

The third is a checkered pattern which alternately interleaves the B filter and the R filter in pixel units in each of the horizontal and vertical directions in the light receiving portion of the CCD 60, as shown in FIGS. 8A to 8G to be described later. The B color filter 70 is used to read B and R in pixel order for each line, and then output B and R separately.

In this method of using the checkered BR color filter, the horizontal and vertical bidirectional feedback disturbances are reduced in the two-dimensional sampling structure, thereby obtaining an effect that can be visually inconspicuous.

In the above embodiment, the case where only 200,000 pixels of color information B and R are read by the CCD 60 only in the first field per image frame has been described, but in order to double the read color information, the CCD ( 60 images are taken twice per frame T, and all the pixels (400,000 pixels) of the first field of the solid line of FIG. 3a are read in the period of the first T / 2 of FIG. 4c, for example, the first of FIG. 4f. The color information P _B and P _R of the field are output, and the color information B and R of the field of the same solid line is used as the color information B and R of the second field even in the next T / 2 period (400,000 pixels). ) May be read and output as, for example, the color information P _B ′ and P _R ′ in the second field of FIG. 4 (f). According to this read method, the lead color information can be easily doubled without increasing the image pickup device, and a large economic effect is obtained.

Next, in the HD still camera of FIG. 2, reference numeral 200a denotes an HD still image recording unit for recording the video signal output from the HD camera 100 on the recording medium 300a in units of one frame or one field. And 400a are HD still image reproducing units for reproducing still image video signals recorded on the recording medium 300a.

The HD camera 100 of FIG. 1 and the still image recording unit 200a of FIG. 2 are combined in a detachable structure mechanically, and are captured by the HD camera 100 while the two units are connected. An HD still camera for recording still images on the recording medium 300a is constructed. In the following embodiment, the operation will be described for the case where magneto-optical recording of one frame or one field still image video signal is performed on this recording medium 300a, for example, using an optical magnetic disk.

The still picture video signal of one frame output from the terminal 90 of the HD camera 100 is a time-division multiplex signal of a single channel of the type shown in Figs. 4D, 4E, and 4F as described above. The still picture video signal Va is supplied to the recording signal processing circuit 210a via the terminal 230a, and is processed appropriately and converted into a digital signal in the PCM format. Specifically, the digital camera converts an 8-bit digital signal in pixel units captured by the HD camera 100. Thus, for example, the luminance information Y per frame in the signal formats of FIGS. Has an amount of information of 800,000 pixels x 8 bits (= 0.8 MB: 1B (byte) is 8 bits), color information B is 400,000 pixels x 8 bits (= 0.4 MB), and color information R is equally 400,000 pixels x It has an information amount of 8 bits (= 0.4 MB), and has an information amount of 1.6 MB per frame and 0.8 MB per field. In addition to this, redundant codes such as synchronization information and error correction code for digital recording are added, for example, with about 13% redundancy, 1.8MB per frame (about 14Mbit), 0.9MB per field (about 7Mbit). A PCM signal having an information amount of? Is output from this recording signal processing circuit 210a.

Further, in the signal format of FIG. 4d, color information is reduced by about 0.4 MB than that of the signal formats of FIG. 4e and 4f, so that the information amount is 1.2MB per frame and 0.68MB in total per field.

The PCM signal from the recording signal processing circuit 210a is digitally recorded, for example, in a single channel on the disk 300a via the digital recording circuit 220a. If the recording rate of the PCM signal on the disc 300a is 14 Mbps, the still picture of one frame can be recorded for about 1 second and the still picture of one field can be recorded for about 0.5 seconds. If the disc 300a is used for example, a 180-inch recordable 2.5-inch disc, about 100 still images of one frame and 200 times that of a single field can be recorded. It is possible to supply new media capable of recording large-capacity, high-definition still images with high definition by digital recording.

In the recording signal processing circuit 210a, either the first recording mode for recording the video signal from the HE camera 100 in units of one frame or the second recording mode for recording in units of one field is used. Selected and processed appropriately. When the second recording mode is selected, either one of the first field and the second field shown in FIG. 4E is automatically selected and recorded. Further, a predetermined blanking in which the mode identification signal for identifying whether it has been recorded in the first recording mode or the second recording mode together with the still picture video signal does not include, for example, the still picture video signal. Is recorded in the period.

Here, the imaging period T (T / 2 per field) per frame in the HD camera 100 is arbitrarily set. When T is set small, color high-speed imaging is possible, and when T is set large High sensitivity photography with longer exposure time is now possible. In addition, by optically only the optical images from the CCDs 40 and 50, black and white photography, black and white high-speed photography, black and white high-sensitivity photography, and the like can also be easily performed, and various imaging can be coped with.

In addition, when the first recording mode is set to the high quality 1x recording mode, the 2nd recording mode can easily realize a double recording mode that can double the number of still image recordings, thereby reducing the running cost of the recording medium. Economic effects can be achieved.

Further, in the signal processing circuit 80 of the HD camera 100, a digital signal in the form of, for example, a bitstream, in which a predetermined number of bits is appropriately allocated to each of the pixels captured in advance is directly outputted, so that the HD still image recording unit is output. In the case of being connected to 200a, the above digital coding process in the recording signal processing circuit 210a becomes unnecessary, and only the addition of the redundant code is executed.

Next, in the HD still image reproducing unit 400a of FIG. 2, the still image video signal digitally recorded on the disc 300a is reproduced through the digital reproducing circuit 410a, and its output is reproduced by the reproducing signal processing circuit 420a. Supplied to. Of the reproduction signal processing circuit still picture video signal and reading out the in (420a) (claim 4e also, the 4f-degree time-division multiplex signal) in time division multiplexing is sequenced in the line color signal P _B, P _R, the luminance signal Y For the luminance signal Y in which the separation and the time unit conversion of the line unit are performed, and the number of pixels is reduced, the pixel period is executed and the luminance signal Y repeated in the field period T as shown in FIG. In the order of Y1, Y2, Y3, ..., Y518, and in the second field, Y1 ', Y2', Y3 ', ..., Y518') are restored and output to the terminal 430a. The line sequenced color signal P _B, the interpolation of line run for the P _R The 4h help claim 4i also repeated in a field period T, as shown in, the two color signals synchronized P _B, P _R is (the P _B 1, P _B 2, P _B 3, ... P _B 518 and P _R 1 _, P _R 2, P _R 3, ..., P _R 518 in the first field, and P _B 1 ', in the second field. P _B 2 ′, P _B 3 ′,… P _B 518 ′ and P _R 1 ′, P _R 2 ′, P _R 3 ′,…, P _R 518 ′) to restore the terminals 440a and ( 450a).

Although these output video signals are not shown, when connected to and displayed with a high definition television receiver, the reproduction signal processing circuit 420a is converted into a signal in a format conforming to the television system, and then the terminal 430a, Output to 440a and 450a, respectively.

As a specific example, the reproduction signal processing circuit 420a uses the first signal when displaying 1125 scanning lines, a field frequency 60 Hz, a frame frequency 30 Hz, and a high definition television system (hi-vision) having an aspect ratio of 16: 9. When one recording mode is identified, the field period T is set to be equal to 1/60, and 1036 lines of effective scanning lines (frame 518 and first field) per frame captured and recorded by the HD camera 100 and reproduced. A blanking signal of 89 lines is added to the video information (the luminance information Y and the two color information P _B , P _R ) of the second field 518, and changed into a video signal of the 1: 1 interface of 1125 lines. Are output from the terminals 430a, 440a, and 450a together with the synchronization information.

When reproducing in this first reproducing mode, the pixels represented by the x solid and dashed lines of the luminance information Y in the reproduction signal processing circuit 420a are interpolated by pixels in the < RTI ID = 0.0 > Then, a total of 1.6 million pixels per frame is restored.

Therefore, the maximum resolution of the luminance information Y corresponding to 800 in the horizontal direction and 1036 in the vertical direction can be obtained. In this pixel interpolation method, when the pixels of each line x table are added and averaged interpolated by the pixels of the upper and lower lines adjacent thereto, that is, the pixels of the x table of the solid line (first field) are arranged on the upper and lower dotted lines (second field). The interpolation is performed by adding the average of the pixels in the table, and interpolating the pixels of the X table in the dotted line (second field) with the average of the pixels of the ○ table in the solid line (first field) in the upper and lower lines to maximize the horizontal resolution. Can be.

In addition, when the pixels of the X table of each line are interpolated by pixels on the left and right adjacent to each other, that is, the pixels of the X table of the solid line (first field) are replaced by the pixels of the left and right sides of the same solid line (first field). Interpolated by the mean value (or the values of the pixels in the left and right circles), and the pixels in the left and right tables on the same dotted line (second field) are added and averaged to the pixels in the x table on the dotted line (second field). (Or the values of the pixels in the left and right sides of the table), the vertical resolution can be maximized.

In addition, you may interpolate the pixel of the X table | surface of each line to the value which added and averaged the four pixels of the image left and right adjacent to it.

In the above first reproduction mode, the following processing for converting the color signals P _B and P _R which have been serialized into the same equation is executed.

That is, a signal obtained by adding and averaging two adjacent lines L2- and L2 + 1 to a linear sequence color signal P _B 2-1 reproduced as color information of the odd-numbered line of each field (or the two lines). a signal line of one) is interpolated as the color signal of the even-th line in the P _B 2 is output.

A signal obtained by adding and averaging two adjacent lines L2 and L2 + 2 to a linear sequence color signal P _R2 reproduced as color information of the even-numbered line (or a signal of one of the two lines). ) Is interpolated and output as the color signal P _R 2+ of the odd-numbered line.

Next, when the second recording mode is identified in the reproduction signal processing circuit 420a, the field period T is set to be equal to 1/60, and 518 effective scanning lines per field to be recorded and reproduced for each field period T. A blanking signal corresponding to 44 lines (or 45 lines) is added to the video information of the luminance information Y and the two color information P _B and P _R , respectively, and 1 of the total 562 lines (or 563 lines) per field: A non-interlaced video signal is output from the terminals 430a, 440a, and 450a together with predetermined synchronization information.

In the case of the reproduction in the second reproduction mode, the horizontal resolution is increased by interpolating the pixels of the X table of each line for each field to the value (or the values of the left and right pixels) that are added and averaged by the left and right pixels adjacent thereto. You can,

When reproducing in the second reproducing mode, instead of outputting the 1: 1 non-interlace signal, a blanking signal of 44.5 lines is added to the video information of the first field of the effective scanning line 518 lines for each field period T. A 2: 1 interlaced signal of 562.5 lines per field and 1125 lines per frame may be converted and output together with predetermined synchronization information.

According to the method of converting and outputting into a 2: 1 interlaced signal, scanning line interference can be significantly reduced than when displaying in 1: 1 non-interlace, and a high-quality image with improved texture can be obtained.

Also, as a method of generating a signal of the second field interlaced with the first field, a method of interpolating and generating the signal of the first field as it is (that is, the lines L1, L2, L3, ..., L518 of the first field). The signal may be output as it is as the signals of the lines L1 ', L2', L3 ', ..., L 518' of the second field, respectively, but instead, the signals are added and averaged for each two adjacent lines in the first field. A method of outputting a signal as a signal of a second field (i.e., a signal obtained by adding and averaging the lines L1, L2, L2, L3, L3, L4, ..., L517, and L518 of the first field to the line of the second field, respectively. L1 ', L2', L3 ', ..., L 517' outputting), according to the latter method, the vertical filter effect can reduce the amount of fricker generated when the interlaced scanning is performed. It is possible to get rid of tingling in the image and obtain a visually stable image.

The video signal of the format conforming to the high definition television system (Hivision) to the terminals 430a, 440a and 450a is converted into the video signal of the format conforming to the current television system (NTSC, etc.). The conversion and aspect ratio conversion may be performed to output to the terminals 430a, 440a, 450a, or a terminal provided separately from the terminals.

Next, in Fig. 2, reference numeral 500 denotes a signal conversion circuit for converting a scanning line and an aspect ratio of an external video signal (for example, a video signal of a conventional television system) input to the terminal 510. Specifically, NTSC video signals with 525 scanning lines, field frequency 59.94Hz, frame frequency 29.97Hz, 2: 1 interface, and aspect ratio 4: 3 are input to the terminal 510, and the NTSC video signals are input. Is converted into a 525 scan lines and a 1: 1 non-interlaced signal with an aspect ratio of 16: 9, of which seven lines of the vertical blanking period are removed so that the video signal Va (from the HD camera 100 per field) (Fig. 4D or 4c, the time division multiplexing signal shown in FIG. 4f), and the time division multiplexing signal V 'of the luminance signal Y and the two color signals P _B and P _R are generated and output in a linear order.

The converted video signal V 'is supplied to the recording signal processing circuit 210a via the terminal 240a as a recording video signal of the second mode, and the second video signal Va from the HD camera 100 The same processing as that in the recording mode is executed and recorded on the disc 300a via the digital recording circuit 220a. When the recording of the video signal V 'from the terminal 240a is specified in the recording signal processing circuit 210a, the second recording mode for recording in units of fields is set, and therefore T as the recording time of the one field. The signal of any one field to be recorded in the video signal V is set to "/2=1/59.94" is extracted, and the same recording processing as described above is executed, and the mode identification for designating this second recording mode is made. The signal is recorded on the disc 300a together with the signal.

In the reproduction of the video signal V 'recorded in the second mode, the reproduction signal processing circuit 420a executes the reproduction processing in the same field unit as that of the second reproduction mode so that the terminals 430a and 440a are executed. ) And (450a), video signals of a high definition television system (high vision) having 1125 scanning lines, a field frequency of 60 Hz, a frame frequency of 30 Hz, and an aspect ratio of 16: 9 are output and displayed on a television receiver.

As described above, according to the present invention, signals having different scanning lines, aspect ratios, field frequencies, and the like can be recorded on the recording medium in the same format, and in any case, they can be displayed on a television in a wide range of high definition modes. It can be realized.

A dubbing output capable of digital copying or editing by outputting a reproduced video signal from the disc 300a as a digital signal to the still picture reproducing unit 400a and interconnecting the still picture recording unit 220a. The terminal 460a is provided separately. The digital signal reproduced and output from the reproduction signal processing circuit 420a is connected to the dubbing input terminal 250a of the still picture recording unit 220a via the dubbing output terminal 460a together with the mode identification signal to record the data. Supplied to the signal processing circuit 210a, the same recording process as described above is executed in accordance with the identification of the first mode or the second mode, and the mode identification signal to the disc 300a via the digital recording circuit 220a. Are digitally recorded together.

When the above digital copy or the like is executed, the reproduced digital signal from the disc 300a is subjected to error correction in the reproduced signal processing circuit 420a by using the error correction code included therein. It is converted into a signal in the same format as that in the case of recording which is not executed and the number of pixels is reduced, and is output.

The terminal 460a can also be used as an output terminal for transmission digital signals for image transmission using a predetermined transmission line such as a telephone line.

The still picture reproducing unit 400a outputs a reproduced video signal from the disc 300a as, for example, a digital signal in a bitstream format, but is not shown but interconnected with a high definition still picture printer unit. A copy output terminal 460a capable of hard copying is separately provided.

In addition, although the example of using the element of 400,000 pixels of the said CCD (40), (50), and (60) was demonstrated in embodiment of FIG. 1 above, this invention is not limited to this, The number of elements is arbitrary. .

Incidentally, the embodiment of Fig. 1 shows a case where reading of luminance information is performed without providing color filters in the CCDs 40 and 50, but the present invention is not limited thereto. Although not shown, a G filter for extracting green information G as the first color information C1 as described above is provided to the light receiving sections of the CCDs 40 and 50, and the CCDs 40 and (obtained by this imaging) ( The luminance information Y and the two colors by the predetermined matrix operation in the signal processing circuit 80 in the three primary color information of the green information G from 50) and the blue information B and red information R from the CCD 60; information P _B, may be configured to produce the P _R, the same effect is obtained.

In this case, matrix operation in the signal processing circuit 80 will be described using the first embodiment of FIGS. 5A to 5F.

In order to generate the luminance information Y from the three primary color information G, B, and R by matrix operation, it is necessary to equalize the number of pixels. That is, 200,000 pixels read from the CCD 60 with respect to 800,000 pixels of green information G (corresponding to the pixels in the ○ and ● tables in FIG. 3A) read from the CCDs 40 and 50 per frame. Similar to the blue information B (pixels in the table ○ in FIG. 5A), the redundancy information R (pixels in the table in FIG. 5D) of 200,000 pixels is interpolated, respectively, so that the signals B and R both have 800,000 pixels (figure 5c and 5f). Is converted to).

Specifically, the first field is a value obtained by adding the average value of 200,000 pixels of blue information B (the odd lines 2n-1 of the first field and 2n + 1) of the pixel 60 which are read from the CCD 60. Interpolate with the pixel of the even line 2n of FIG. 5A ((2n) of FIG. 5A), and two adjacent pixels on the even line 2n and two adjacent pixels on the odd line 2n-1 obtained by this interpolation. The average value is added to interpolate pixels of the even line 2n-1 'of the second field, and two adjacent pixels on the even line 2n and two adjacent pixels on the odd line 2n + 1 are added. The average value is interpolated as the pixels of the even line 2n 'of the second field (FIG. 5C) to restore all 800,000 pixels per frame.

Similarly, the odd line of the first field is obtained by adding the average of the even lines 2n and (2n + 2) of the first field in the red information R (figure 5b) of the 200,000 pixels read from the CCD 60. Interpolate with (2n + 1) pixels (figure 5e) and add the average value of two adjacent pixels on odd line 2n + 1 and two adjacent pixels on even line 2n obtained by this interpolation. Interpolated with pixels of the even line 2n 'of the second field, and adding two adjacent pixels on the odd line 2n + 1 and two adjacent pixels on the even line 2n + 2 to an average value. The total 800,000 pixels per frame are reconstructed by interpolating the pixels of the odd lines 2n + 1 'of two fields (FIG. 5C).

The matrix operation is performed with predetermined coefficients in the blue information B and the red information R, in which all 800,000 pixels are restored by the pixel interpolation of the above-mentioned green information G, which has a total of 800,000 pixels, and has a total of 800,000 pixels per frame. Desired luminance information Y is generated. The luminance information Y obtained by the above pixel interpolation and matrix operation can be approximately matched with the luminance information Y obtained in the embodiment of FIG. 1, and there is no degradation in resolution, and luminance information is generated from the three primary color information. Even when the brightness changes, good color balance imaging can be obtained.

Incidentally, in the above embodiment, the case where the CCD 40, 50, and 60 has an imaging area with aspect ratio 16: 9 is described, but the present invention is not limited thereto. In the case of using an element having an arbitrary aspect ratio, for example, a 4: 3 aspect ratio as in the conventional television vision system, for the CCDs 40, 50, and 60, an optical image of 16: 9 Is reduced to 4: 3 in the horizontal direction, by using a large anamorphic lens instead of the lens 10 or by providing it at the front of the lens 10, a wide range of high sharpness of 16: 9 can be obtained. It can implement | achieve and all follow the meaning of this invention.

In addition, the format of the output video signal from the HD camera 100 is not limited to a single channel as described above. For example, the CCDs 40, 4A, 4C, and 4C shown in FIGS. The readouts in which the pixels from (50) and (60) are reduced may be directly output, or the pixel interpolation in the reproduction signal processing circuit 420a may be used for the readout in which the pixels from the respective CCDs are reduced. The same process may be performed to obtain the luminance signal Y and the color signals P _B and P _R which have been once restored to pixels, or may be processed by a predetermined matrix to obtain the three primary color signals G, B and R and output them in three channels. , All fall within the scope of the present invention.

In addition, although not shown, a conventionally known variable-angle prism is provided in the front or rear portion of the lens 10, and the blur of the image picked up by the signal processing circuit 80 is detected in accordance with the detection signal. The image blur can be corrected without deteriorating the image quality by perturbing the variable right-angle prism and changing the optical axes formed on the CCDs 40, 50, and 60.

When a semiconductor memory such as an IC card or a flash memory is used for the recording medium of 300a, output from the recording signal processing circuit 210a without using special recording means such as the digital recording circuit 220a. Alternatively, the video signal from the HD camera 100 can be directly recorded in the semiconductor memory.

The HD still image reproducing unit 400a has means for reproducing a signal recorded in this semiconductor memory and means for reproducing the reproduction output on the optical disc, for example, in the same apparatus. It is possible to provide a new filing system that sequentially edits and records recorded still images on a large-capacity optical disc, thereby realizing new added value instead of a conventional album.

In addition, the signal format of the video signal recorded on the recording medium 300a is not limited to the time division multiplex signal as in the above embodiment, and the number of channels to be recorded is not limited to one channel, and in general, arbitrary signal formats. Can record to any channel. For example, in the signal processing circuit 80 of the HD camera 100, the pixel units from the CCDs 40, 50, and 60 shown in Figs. 4A, 4B, and 4C are shown. A predetermined number of bits are sequentially assigned in the pixel unit to convert the read output into a digital signal, and the digital signal is output from the signal processing circuit 80 as a three-channel signal, for example, and the three-channel digital signal is output to the recording signal. The processing circuit 210a may be configured to perform recording processing for each channel and to record three channels on the recording medium 300a via the digital recording circuit 220a.

In the above embodiment, the recording signal processing circuit 210a shows a case where 8 bits are allocated to the pixel unit of the luminance signal and the color signal captured by the HD camera 100 and converted into digital signals. The number of bits to be allocated is not limited, and the number of allocated bits is reduced to 1/2 or less using, for example, a bit compression method such as DPCM (differential PCM) or DCT (discrete cosine transform) conventionally known. In this case, the number of recordings of the still image on the recording medium 300a can be increased by more than two times, and a large economic effect can be obtained, such as a decrease in running cost or a memory capacity in the case of the semiconductor memory.

In addition, a recording video signal obtained by reducing the amount of information by this bit compression is recorded in the recording medium 300a together with a mode identification signal for identifying the mode as a third recording mode, and the reproduction signal during reproduction. The processing circuit 420a identifies the third recording mode as the basis of the mode identification signal, restores the amount of information reduced by the bit compression, and executes the same pixel restoration as above to restore the entire appeal. May be output to the terminals 430a, 440a, and 450a.

Next, another embodiment of the high-definition video signal output method picked up by the HD camera 100 will be described using the timing diagram of FIG.

In the fourth embodiment, the CCDs 40, 50, and 60 are all photographed in units of scanning periods of one frame. However, in the embodiments of FIGS. 6A to 6E, each CCD is shown. A case where imaging is carried out in units of scanning cycles of one field is shown.

Namely, in the CCD 40 in the first T / 4 period of the first field, the luminance information Y1, Y3, Y5,... , Y517 is read, and in the CCD 60, blue information B1, B3, B5,... , B517 is read.

In the CCD 40 in the second T / 4 period of the next first field, the luminance information Y2, Y4, Y6,... , Y518 is read, and in the CCD 60, red information R2, R4, R6,... R518 is read.

In the T / 4 period of the first half of the next second field, the luminance information Y1 ', Y3', Y5 ',... , Y517 'is read, and in the CCD 60, blue information B1, B3, B5,... B517 is read. In the period T / 4 of the next second field, the luminance information Y2 ', Y4', Y6 ', ... from the even-numbered line in the CCD 50 is used. , Y518 'is read, and in the CCD 60, red information R2, R4, R6,... R518 is read.

As shown in FIG. 6D, the readout output from each CCD is converted into a sequence in line unit output at the signal processing circuit 80, and the initial period of one frame of the output image signal is T as the first. In the period T '/ 2 of one field, the lines L1, L2, L3, L4,... , L517, L518, and in the next period T '/ 2 of the second field, the lines L1', L2 ', L3', L4 ', ...; , L517 'and L518' are output in this order. In this signal processing circuit 80, as shown in FIG. 6C, the time axis in units of lines is converted, and the luminance signal Y and the color signals P _B and P _R are converted into signals of a time-division multiplexing channel in units of lines. And print it out.

In the embodiment of FIG. 2, the HD camera 100 is applied to a still picture recording and reproducing apparatus. However, the present invention is not limited thereto, and the present invention is not limited to this, but a device for recording and reproducing a moving image such as a video tape recorder (VTR) can be used. Of course, it can be applied. When the HD camera 100 of the present embodiment is connected to this VTR to record a motion image, for example, shown in FIGS. 4A, 4B, 4C, 6A, 6B, and 6C. The frame or field unit is set by setting the imaging period T of one frame to a value such as the frame period (1/30 second) or the field period (1/60 second) of the high definition television system (high vision) described above. Continuous shooting at < RTI ID = 0.0 >, < / RTI > for example, at field period T '/ 2 (= 160 seconds) of the same type as the time division multiple signal shown in FIG. 4D, 4E, 4F or 6D, 6E. A continuous motion picture video signal Va is obtained from the signal processing circuit 80 of the HD camera 100. The motion picture video signal Va is not shown, but magnetic tape recording and reproduction are performed.

Next, as another embodiment of the present invention, an image pickup device having a sequential stock is used for the CCDs 40, 50, and 60 of FIG. 1, and a G filter is applied to the CCDs 40 and 50 as a color filter. The video signal processing in the case where the checkered B / R filter is used in the CCD 60 will be described using the block diagram of the signal processing circuit 80 shown in FIG. The operation of the color imaging system when the checkered B / R filter is used will be described using FIGS. 8A to 8G.

First, the CCD 40 and the 50 are simultaneously imaged by sequential scanning in two beams, and green information G1 (pixels in the? Table of the first field of the solid lines in FIGS. 3A and 3B) and G2 (the first line of dotted lines) are respectively obtained in each. 2 fields of pixels of the table) are read out and output from the read circuit 801 as a red field G 'of a two-field simultaneous type. As shown in FIG. 3, this two-field simultaneous signal G 'has a five-eye pixel array only in two-dimensional space.

Next, as shown in FIG. 8A, the B filter and the R filter are imaged by scanning in a sequential scan through the BR filter alternately arranged in a checkered pattern, and alternately blue information (? The pixels of the table) and the red information) (the pixels of the table) are separated from the read circuit 802 and output as the blue signal B0 and the red signal R0, respectively, as shown in FIGS. 8B and 8C. The separated signals B0 and R0 are pixel-interpolated in the pixel interpolation circuits 803 and 804, respectively, and output as signals B 'and R', respectively. More specifically, the separated signals B0 and R0 are not shown in the first field of the solid line as shown in FIGS. 8D and 8E, for example, based on the neighboring pixels adjacent thereto. The interpolation is performed by the addition average value of the adjacent pixels on the top, bottom, left, and right side in the same field as indicated by the arrow of. In addition, as shown in FIG. 8F and FIG. 8G, the second field of the dotted line which has not been captured is based on the pixels of the first field, for example, as shown by the arrows in the same drawing. It is interpolated as an added average value of the pixels. The signal B 'and the signal R' obtained by the pixel interpolation described above have a multi-eye pixel array in a two-dimensional space, as shown in Figs. 8f and 8g, and the same pixel arrangement as the signal G 'described above. Has

The green signal G 'from the circuit 801, the blue signal B' from the circuit 803, and the red signal R 'from the circuit 804 are matrix-calculated in the matrix circuit 805, and the luminance signal Y' is generated. Thrust. The luminance signal Y 'is subjected to the same pixel interpolation in the pixel interpolation circuit 808 as shown in Figs. 3A and 3B to generate the luminance signal Y including the entire pixels. This signal Y is further suitably processed by the signal conversion circuit 811 and output to the terminal 91 as the output luminance signal Y.

On the other hand, the blue signal B0 and the red signal R0 from the circuit 802 are subjected to matrix operations based on the luminance signal Y 'from the circuit 805 in the matrix circuits 806 and 807, respectively, and the color difference signals are respectively performed. R _{B '} and P _R' are generated and output. The matrix operations in the circuits 806 and 807 are executed at least in the imaged pixel units shown in Figs. 8B and 8C. Therefore, the color difference signals R _{B '} and P _R' are generated by the above-described signal G '(or G1), the signal B0 and the signal R0, but not shown in the above embodiment, or the above-described signal G' ( Alternatively, the signal may be generated from the signal B 'and the signal R'. In the case of generating only the imaged pixel units based on the signals B0 and R0 described above, since the color difference signal is generated only in the first field of the solid line, the first pixel interpolation circuits 809 and 810 respectively have their first colors. The color difference signal of the dotted second field is interpolated based on the color difference signal of the field. Note that the pixel interpolation circuits 809 and 810 are not necessarily required when all the pixels are generated based on the interpolated signal B ', the signal R' and the signal Y '(or G'). By the above, the color difference signals generated by appropriately pixel interpolation in the circuits 809 and 810 are output as P _B and P _R, respectively. These signals P _B and P _R are also properly processed by the signal conversion circuit 811, and then the terminals 92 and 93 are output as the output color difference signals P _B and P _R , respectively.

In this embodiment, as described above, three CCDs 40, 50, and 60 are simultaneously imaged by sequential scanning, so that the above-described processing results in the luminance signal Y and the color difference signals P _B and P _{R being} 1. The imaging of the first (field) causes the signals of the first field (field of solid line) and the second field (field of dashed line) to be obtained simultaneously. Thus, in Y, P _B, P _R of the second field of simultaneous expression if the output by the signal Y, P _B, P _R of the interlaced scanning type, such as a conventional television system is said by the signal conversion circuit 811 1 Scanning conversion is performed in which the field signal and the second field signal are alternately switched in the field period and converted into an interlaced signal. Further, depending on the field, the signal conversion circuit 811 performs time division multiplexing of these signals based on the signals Y, P _B , P _R or signals Y, P _B , P _R (for example, The signal is converted to the signal shown in FIG. 4F or FIG. 6E and output to the terminal 90.

While the terminals 90 can be used for connection to a recording device or the like as shown in the above embodiment, the terminals 91, 92, and 93 are used for a monitor television of a captured image or general high definition. It can be used for connection with an image display device such as a camera television receiver.

When the color difference signals P _B and P _R are serialized in the circuit 811 and output from the terminal 90 to a single channel by, for example, the time division multiplexing signal, feedback is performed according to the linear ordering. In order to eliminate the interference, the band limit in the vertical direction is executed in advance in the circuit 811.

As described above, according to the present invention, a high-definition image having a pixel number of four times or more using a solid-state image pickup device having a relatively small number of pixels used in a conventional television camera or the like without increasing the number of pixels of the solid state image pickup device and A device capable of recording / reproducing (or transmitting) the image of high definition can be provided at a relatively low cost and supplied early.

In particular, by applying this imaging device to a playback device for still or moving pictures, it is possible to record a wide and high definition image with high fidelity and high fidelity, and to record a large capacity in a narrow band by reducing the sample signal band. Therefore, the package and the device as the recording medium can be miniaturized, and various functions such as color photographing, black and white photographing, high speed photographing, and high sensitivity photographing can be realized, so that digital copy, hard copy or editing can be easily performed. It is possible to provide a device with a new added value which is not present.

Claims (16)

A high-definition imaging device configured to output a high-definition image information signal by imaging a two-dimensional space including at least nH space sampling points in the horizontal direction and nV systems (nH × nV) in the vertical direction. The two-dimensional solid-state image pickup devices having the two-dimensional first and second solid-state imaging elements each having nH / 2 in the horizontal direction and nV / 2 in the vertical direction (nH × nV) / 4 pixel arrays, respectively In the horizontal direction and 1/2 in the vertical direction, and at least one field or one frame (nH × nV) / 2 or less depending on the readout from each solid state image pickup device. First imaging means for outputting a first imaging signal including any one of the luminance information and the picked up pixel information relating to the first color information, nH / 2 in the horizontal direction, nV / in the vertical direction From a three-dimensional solid-state image pickup device having two systems (nH × nV) / 4 pixel arrays Image picked pixels associated with (nH × nV) / 8 or less second color information and (nH × nV) / 8 or less third color information per screen of at least one field or one frame, depending on the readout Second image pickup means for outputting second and third image pickup signals including information, and first image pickup signals from the first image pickup means and second and third image pickups from the second image pickup means. And a signal output means for generating and outputting a predetermined information signal in accordance with an image pickup signal. The signal of claim 1, wherein the first image pickup means outputs at least one of the pixel arrays of the first and second solid state image pickup devices every other line in an interlace scan format. A high-definition imaging device comprising a means for converting and outputting a time axis. The signal according to claim 1, wherein the first image pickup means adds an output of an interlace scan format obtained by adding at least one of the pixel arrays of the first and second solid state image pickup devices every two lines. And a means for outputting a time axis converted to the output. 2. The apparatus according to claim 1, wherein the first image pickup means includes means for sequentially reading at least one of the first and second solid state image pickup elements from line to line in a sequential scan format. High-definition imaging device. The second solid-state image pickup device includes a third solid-state image pickup device, wherein the second image pickup means includes means for alternately picking up pixel information related to the second and third color information for each pixel in a line. High-definition imaging device characterized in that the. A high-definition imaging device configured to output a high-definition image information signal by imaging a two-dimensional space including at least nH space sampling points in the horizontal direction and nV systems (nH × nV) in the vertical direction. The two-dimensional solid-state image pickup devices having the two-dimensional first and second solid-state imaging elements each having nH / 2 in the horizontal direction and nV / 2 in the vertical direction (nH × nV) / 4 pixel arrays, respectively In the horizontal direction and 1/2 in the vertical direction, and at least one field or one frame (nH × nV) / 2 or less depending on the readout from each solid state image pickup device. First imaging means for outputting a first imaging signal including any one of the luminance information and the picked up pixel information relating to the first color information, nH / 2 in the horizontal direction, nV / in the vertical direction 3D solid-state image pickup device having two systems (nH × nV) / 4 pixel arrays (NHxnV) / 8 or less of third color information per (nHxnV) / 8 or less of second color information per screen of at least one field or one frame according to a readout of Second image pickup means for outputting second and third image pickup signals each including pixel information, and first image pickup signals from the first image pickup means and second and third images from the second image pickup means. A high-definition imaging device having signal output means for generating and outputting a predetermined information signal in accordance with an image pickup signal of the present invention, signal generation means for generating a signal of a first mode according to the information signal from the signal output means, and And recording means for recording the output from the signal generating means onto a recording medium. 7. A signal according to claim 6, wherein said signal generating means comprises means for generating a signal of a second mode, which is reduced by 1/2 or less of an information amount than a signal of said first mode, and at least the signal of said first mode. And any one of the signals of the second mode. 7. The signal generating means according to claim 6, wherein the signal generating means is connected to a signal converting unit for converting a predetermined external video signal into a signal of a second mode, via a connection terminal, and input means for inputting a signal of the second mode. And at least one of the signal of the first mode and the signal of the second mode from the input means. 7. The digital signal processing apparatus according to claim 6, wherein said signal generating means includes means for generating a digital signal which adds a predetermined margin of redundancy to the information signal from said signal output means, and said recording means is configured to record this digital signal. And a high definition image information recording apparatus. NH / 2 in the horizontal direction and nV / 2 in the vertical direction (nH × nV) for a two-dimensional space including at least nH in the horizontal direction and nV systems in the vertical direction (nH × nV) Two solid-state two-dimensional solid-state image pickup devices having four pixel arrays are arranged in a state where they are shifted 1/2 in the horizontal direction and 1/2 in the vertical direction at the pixel pitch interval thereof. At least one field or one frame per screen (nH × nV) / 2 luminance information corresponding to the readout from the image pickup device, and any one of the imaged pixel information associated with the first color information. At least one in accordance with the readout from the second three-dimensional solid-state image pickup device having the first image pickup signal and nH / 2 system (nH × nV) / 4 pixel arrays in the horizontal direction and nH / 2 in the horizontal direction Information signal generated according to the second and third imaging signals of (nH × nV) / 8 or less per field or one frame A high definition image information reproducing apparatus configured to reproduce a recording medium having recorded thereon, comprising: reproducing means for reproducing the information signal on the recording medium and generating a predetermined video signal in accordance with a reproducing signal from the reproducing means, And a signal output means for outputting, the apparatus for reproducing high definition image information. The horizontal direction per screen of claim 10, wherein the signal output means interpolates and reproduces a pixel corresponding to a spatial sampling point not captured by at least the imaging of a reproduction signal from the reproduction means. High-definition image, comprising: signal processing means for reproducing a video signal including effective pixel information relating to luminance information of nH and nV systems (nH × nV) or less in the vertical direction Information playback device. 11. The apparatus according to claim 10, wherein said signal output means has a digital output means for outputting a digital signal in accordance with a reproduction signal from said reproduction means, and is configured to record the output from said digital output means on a predetermined recording medium. And a high definition image information reproducing apparatus. A high-definition imaging device configured to output a high-definition image information signal by imaging a two-dimensional space including at least nH space sampling points in the horizontal direction and nV systems (nH × nV) in the vertical direction. The two-dimensional solid-state image pickup devices having the two-dimensional first and second solid-state imaging devices each having nH / 2 in the horizontal direction and nV / 2 in the vertical direction (nH × nV) / 4 pixel arrays are arranged at the pixel pitch intervals. At least one field or one frame (nH × nV) / 2 or less luminance, depending on the readout from the respective solid-state imaging devices, arranged in a state shifted 1/2 in the horizontal direction and 1/2 in the vertical direction. First imaging means for outputting a first imaging signal including any one of the information and the picked up pixel information relating to the first color information, nH / 2 in the horizontal direction, nV / 2 in the vertical direction From a three-dimensional solid-state image pickup device having two systems (nH × nV) / 4 pixel arrays Image picked pixels associated with at least one (nH × nV) / 8 or less second color information per screen or per frame and (nH × nV) / 8 or less third color information depending on the output Second image pickup means for outputting second and third image pickup signals each including information, and at least one field or one frame per screen (nH ×) by interpolating and reproducing at least the non-imaged pixels of the first image pickup signal. first signal generating means for generating a first information signal including nV) or less effective pixel information, and at least one field or the like by interpolating and reproducing at least the non-imaged pixels of the second and third image pickup signals; Second signal generating means for generating second and third information signals including (nH × nV) / 4 or less effective pixel information per screen of one frame, and first from the first signal generating means According to the information signal and the second and third information signals from the second signal generating means. Imaging device of high brightness, characterized in that comprises a signal output means for outputting to generate a predetermined image signal. 14. The apparatus according to claim 13, wherein said first signal generating means is a signal according to a first imaging signal from said first imaging means and a signal according to second and third imaging signals from said second imaging means. And means for generating a luminance signal by a predetermined matrix operation, and configured to interpolate and output at least pixels of the luminance signal. 14. The signal processing apparatus according to claim 13, wherein the second signal generating means comprises a signal according to a first imaging signal from the first imaging means and a signal according to second and third imaging signals from the second imaging means. Means for generating the first and second color difference signals by a predetermined matrix operation, and configured to interpolate and output at least pixels of the first and second color difference signals. Imaging device. A high-definition imaging device configured to output a high-definition image information signal by imaging a two-dimensional space including at least nH space sampling points in the horizontal direction and nV systems (nH × nV) in the vertical direction. The two-dimensional solid-state image pickup devices having the two-dimensional first and second solid-state imaging devices each having nH / 2 in the horizontal direction and nV / 2 in the vertical direction (nH × nV) / 4 pixel arrays are arranged at the pixel pitch intervals. The first image pickup means, nH / 2 in the horizontal direction, nV / 2 in the vertical direction, and nV / 2 systems (nH × nV) / 4 In a two-dimensional third solid-state imaging device having two pixel arrays, (nH × nV) / 8 or less of second color information and (nH × nV) per screen of at least one field, depending on the output read by sequential scanning. A second for outputting third and fourth image pickup signals each including imaged pixel information relating to 8 or less pieces of third color information At least one field per screen (nH × nV) / interpolation is performed by interpolating and reproducing the non-imaged pixel of the first image pickup signal from the image pickup means and at least the first image pickup means according to the imaged pixel of the second image pickup signal. A first signal generating means for generating a first information signal including two or less effective pixel information, and at least an unimaged pixel of the second image pickup signal from the first image pickup means; Second signal generating means for interpolating and reproducing according to the picked-up pixel of the pick-up signal to generate a second information signal including at least one (nH × nV) / 2 effective pixel information per screen, at least the A third information signal including (nH × nV) / 4 or less effective pixel information per screen of at least one field is interpolated by interpolating and reproducing an unimaged pixel of the third image pickup signal from the second image pickup means. Generating third signal generating means, red Fourth information including (nH / nV) / 4 or less effective pixel information per screen of at least one field by interpolating and reproducing an unphotographed pixel of the fourth image pickup signal from the second image pickup means; And fourth video signal generating means for generating a signal and video signal output means for generating and outputting a luminance signal and two color difference signals in accordance with the first, second, third and fourth information signals. High-definition imaging device.