JP2986659B2 - Stereoscopic image imaging and display system - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a stereoscopic image pickup / display system capable of photographing and displaying a stereoscopic image or a wide image, and more particularly to a compound-eye camera device having a plurality of image pickup units and a small display device mounted and fixed on the head. 3D image pickup / display comprising a display device which enables observation of a virtual image screen in which an image is enlarged
Related to display systems.

[0002]

2. Description of the Related Art In recent years, there has been a demand for images with a high sense of reality, and compound eye cameras capable of shooting stereoscopic images and images wide in the horizontal direction have been provided.

[0003] Various stereoscopic image display devices for displaying images taken by these compound-eye cameras have been proposed. Among these stereoscopic image display devices, there is a display device capable of observing a virtual image screen in which an image is enlarged by a small display device mounted and fixed on the head, a so-called head mounted display (hereinafter abbreviated as HMD). .

In such a photographing / display system mainly composed of a compound-eye camera and an HMD, a photographed image, which is not merely a way of photographing a landscape and appreciating it as in the past,
Display systems have been proposed. For example, conventional USP2,
711, 594, USP3, 205, 303, USP
3, 670, and 097. In these, a sensor for detecting the moving direction of the observer's face is provided on the HMD which is a display device, and the moving direction information from this sensor is sent to a control device for controlling the posture of the camera, and the field of view of the camera is changed. To follow the direction of the movement. With this configuration, simply turning the face in the direction that the observer wants to see, the camera turns in that direction, sends the external image in that direction to the observer's HMD as a photographing signal, and the observer can see the image in that direction. it can.

[0005] Further, as a similar one, a compound eye camera is provided to a robot equipped with a manipulator at a remote place or a dangerous place, and a stereoscopic video signal from the camera is received and displayed on an HMD of an observer. Teleexistence systems that allow remote work are being studied.

Further, the present applicant has already proposed a compound eye camera capable of shooting a three-dimensional image and a wide image in the horizontal direction (Japanese Patent Application No. 5-212777).
No. “Compound eye imaging device”). Further, the present applicant has already proposed an HMD display device capable of displaying a three-dimensional image and displaying a wide image in the horizontal direction (Japanese Patent Application No. Hei 5 (1993) -195).
-92113).

[0007]

In the above-mentioned conventional example, although the system configuration of the compound-eye camera and the HMD display device is used, the remote control while controlling the posture of the camera and monitoring with a stereoscopic image is only proposed. No new imaging and display technology has been proposed as a three-dimensional video imaging and display system.

Further, the conventional stereoscopic image photographing image / display system has the following problems. 1) Since a change in shooting conditions such as a convergence angle at the time of shooting cannot be reproduced on the display device, the intention of the photographer cannot be reflected on the display image, and an unnatural three-dimensional image may be viewed. Physiological fatigue occurs during long viewing. 2) Since a stereoscopic image taken with a compound-eye camera cannot be displayed on the spot as a stereoscopic image that matches the shooting conditions and shooting intentions, the photographer himself must confirm that the shooting intentions are correctly reflected. Can not.

Further, from the present applicant, a compound-eye photographing camera capable of capturing a wide two-dimensional image together with a three-dimensional image, and an HMD capable of displaying not only a three-dimensional image but also a wide two-dimensional image in a horizontal direction. Although a display device has been proposed, a system utilizing the features of the photographing camera and the HMD display device has not been proposed.

An object of the present invention is to provide a stereoscopic image pickup / display system capable of displaying a video image that accurately reflects the intention of a photographer.

[0011]

According to the present invention, there is provided a stereoscopic image pick-up and / or
The display system includes a stereoscopic image capturing camera device having an image capturing unit that generates a plurality of video signals corresponding to optical images from different viewpoints, and a pair of images displayed on the pair of video display units. The optical system guides both eyes of the observer,
A display device that enables an enlarged virtual image of the pair of images to be observed by each eye, and displays a plurality of video signals from the stereoscopic image capturing camera device on a pair of video display means of the display device and observes them. A stereoscopic image capturing / display system, or a stereoscopic image capturing camera apparatus having an image capturing unit that generates a plurality of video signals corresponding to optical images from different viewpoints, and a pair of images displayed on the pair of video display units. A pair of projection optical systems guides the pair of images to both eyes of the observer, and an enlarged virtual image of the pair of images can be observed with each eye, and the position of the display device with respect to the projection optical system or the connection of the projection optical system. A display device capable of controlling the spatial position of the two virtual image planes from two overlapping states to an adjacent juxtaposed state by controlling an image state, and a plurality of video signals from the stereoscopic image capturing camera apparatus. In the stereoscopic imaging and display system in which the display on the display means of a pair of display device is observed,
In addition to the plurality of video signals from the three-dimensional image capturing camera device, control information of the three-dimensional image capturing camera device is provided to the display device, and the pair of enlarged virtual images of the display device are provided in accordance with the control information. It is characterized in that the relative spatial position is changed.

Further, the stereoscopic image pickup / display system of the present invention comprises a stereoscopic image pickup camera device having image pickup means for generating a plurality of video signals corresponding to optical images from different viewpoints, A video information recording device for recording a plurality of video signals from an image capturing camera device;
A pair of images displayed on the pair of image display means is guided to both eyes of the observer by a pair of projection optical systems, and a display device that enables an enlarged virtual image of the pair of images to be observed by each eye. A plurality of video signals reproduced from the video information recording medium in the video information recording device are displayed on a pair of display means in the display device, and a stereoscopic image capturing / display system for observation or from a different viewpoint. A stereoscopic image capturing camera device having image capturing means for generating a plurality of video signals corresponding to an optical image; a video information recording device for recording a plurality of video signals from the stereoscopic image capturing camera device on a video information recording medium; The pair of images displayed on the pair of image display means are guided to both eyes of the observer by a pair of projection optical systems, and an enlarged virtual image of the pair of images is made observable by each eye. Position with respect to the projection optical system, or Comprises a display device capable of controlling the image forming state of the projection optical system to control the spatial position of the two virtual image planes from two overlapping states to adjacent juxtaposed states, and the video information recording apparatus A plurality of video signals reproduced from the video information recording medium in the display device are displayed on a pair of display means in the display device, and in the stereoscopic image capturing / display system for observation, in addition to the plurality of video signals, Recording control information of the image capturing camera device on a video information recording medium in the video information recording device, providing a plurality of video signals reproduced from the video information recording medium and the control information to the display device, The relative spatial position of the pair of enlarged virtual images of the display device is changed according to the following.

[0013]

The present invention has already been proposed by the present applicant.
A system that utilizes the features of a compound-eye camera capable of capturing a wide two-dimensional image together with a three-dimensional image system, and an HMD display device capable of displaying not only a three-dimensional image but also a wide two-dimensional image in a horizontal direction. The above problem is intended to be solved by configuring a photographed image / display system as follows.

That is, according to the present invention, the control of the compound eye camera at the time of shooting is transmitted to the HMD display device together with the transmission of the video signal, and based on this control information, the position of the display in the HMD display device is controlled or the HMD display is performed. By controlling the image forming state of the projection optical system in the apparatus, a three-dimensional image display that accurately reflects the photographer's intention is performed, and the problems 1) and 2) to be solved by the invention will be solved. It is assumed that.

Further, the present invention provides a control for indicating whether a compound eye camera is taking a wide two-dimensional image or a stereo image (three-dimensional image) at the time of transmitting a video signal and taking a picture. The information is sent to the HMD display device, and based on the control information, the position of the display unit in the HMD display device is controlled, or the imaging state of the projection optical system in the HMD display device is controlled, and a wide two-dimensional image display is performed. By switching between the three-dimensional image display and the three-dimensional image display within the HMD, it is possible to display an image that accurately reflects the intention of the photographer, and to display a three-dimensional image, a wide two-dimensional image, or a new image in which both are mixed. It is intended to be able to enjoy the device.

[0016]

FIG. 1 is a block diagram showing a stereoscopic image pickup / display system according to a first embodiment of the present invention. The stereoscopic image capturing / display system according to the present embodiment includes an imaging unit 101, an output unit 102 that outputs a video signal and control information, a transmission unit 103 that transmits a video signal and control information, and an input of a video signal and control information. An input unit 104, a display unit 105, a recording unit 106 including a circuit for recording video signals and control information,
It comprises a recording medium 108, a reproducing unit 107 composed of a circuit for reproducing a video signal and control information from the recording medium 108, and a system controller 109 for controlling the entire system. Although not shown in FIG. 1, it is assumed that the system controller 109 is connected to each block in the figure.

The signal flow in FIG. 1 will be described below.

The control information is sent from the imaging unit 101 to the output unit 102 together with the video signal. This control information includes information such as the mutual optical positional relationship of the imaging units of the imaging unit 101 and the imaging conditions of the individual imaging units. Here, the information on the mutual optical positional relationship between the plurality of imaging units is, for example, information on the intersection angle of the optical axes of the two imaging units, that is, information on the convergence angle, and the imaging conditions of the individual imaging units. , Aperture information, distance information, zoom (focal length) information, and the like. The output unit 102 has a function of adjusting a time axis shift or the like between the video signal from the imaging unit and the control information. The output unit 102 adjusts the correspondence between the two signals, and A signal is output to the recording unit 106. In addition,
In this figure, the video signal is displayed on two lines and the control signal is displayed on one output line. However, the output unit 102 may output the video signal with some or all of the control information added to the video signal. good. Further, the video signal may be converted into a single system signal by an operation such as time axis compression or thinning.
The transmission unit 103 is usually configured by a cable for transmitting a signal, but the imaging unit 101 and the output unit 1
When 02 is in a remote place, it has a circuit that modulates and demodulates it to a form suitable for transmission. The input unit 104 includes the transmission unit 103 and the reproduction unit 1
07, and has a function of switching between both input systems as necessary. If control information is added to the video signal, the control information is separated and separated into the original video signal and control information. The display unit 105 processes the video signal into a form suitable for display, and controls each congestion of the plurality of display units based on the control information. On the other hand, the imaging unit 101
Is temporarily recorded on the recording medium 108,
The recording unit 106 converts the signal into a form suitable for recording and records the signal on the recording medium 108. Here, the recording medium 108 may use a medium such as a magnetic tape when recording a moving image, or a magnetic disk or a magneto-optical disk when recording a short-time moving image or a still image. Etc. can be used. In the reproducing unit 107, the recording medium 10
The signal (video signal, control information) from the terminal 8 is reproduced and sent to the input unit 104.

Prior to transmission and recording, image data may be compressed (for example, JPEG, MPEG, etc. may be used).

FIG. 2 shows the image pickup unit 101 and the output unit 102 of FIG.
It is a block diagram of the compound-eye camera part 110 consisting of. The imaging systems 201 and 202 of the compound-eye camera are optical systems 201, respectively.
a, 202a and image sensors 201b, 202b. Also, 201c and 202c are imaging systems 20 respectively.
Reference numeral 1202 denotes an imaging optical axis. The arms 203 and 204 support the imaging systems 201 and 202, respectively, and are rotatable about a shaft 205 fixed to a compound-eye camera body (not shown). The axis 205 is equidistant from the imaging optical axes 201c and 202c. Actuators 206 and 207 respectively rotate arms 203 and 204 about axis 205. In this figure, since imaging systems 201 and 202 are focused to infinity, the convergence angle of imaging systems 201 and 202 is zero. °, that is, the imaging systems 201 and 202 are parallel to each other. The signal processing units 210 and 209 are signal processing units for converting the imaging signals of the imaging systems 201 and 202 into appropriate video signals. When the image pickup devices 201b and 202b are single-chip color image pickup devices, processes such as sample hold, color separation, and gamma exchange are performed in this portion. In the embodiment shown in FIG. 2, since the video signal is converted into a composite video signal of, for example, the NTSC system by the signal processing units 209 and 210, the video signal is output as one system signal line. May be output as a component color signal such as an RGB signal. The control unit 211 controls the aperture, focus, and convergence angle of the imaging systems 201 and 202. The system controller 214 includes a signal processing unit 209,
The control unit 210 and the control unit 211 are controlled.

FIG. 3 is a diagram showing a case where the convergence angle of the image pickup unit 101 is θ.

FIG. 4 shows an image pickup system 201, 20 of the compound eye camera.
2 is a schematic diagram showing another configuration of the mechanical system. Reference numeral 231 denotes a subject, and 232 and 233 denote first and second image pickup optical systems having equivalent specifications, and generally a zoom lens is used. Similarly, reference numerals 234 and 235 denote image sensors having equivalent specifications, and use an image pickup tube such as a saticon or a solid-state image pickup device such as a CCD.

Each of the imaging optical systems 232 and 233 can be moved in the horizontal direction by a slide mechanism 238.
Thereby, the base line length is adjusted. Further, the optical axes 236 and 237 of the imaging optical systems 232 and 233 can be rotated about F ₁ and F ₂ , respectively.
The imaging optical systems 232 and 233 can be independently rotated. In FIG. 4, the angles formed by the axes 236 and 237 passing through the subject 231 and the perpendiculars of the lines connecting F ₁ and F ₂ are θ ₁ and θ ₂ . ing.

FIG. 5 shows the input unit 104 and the display unit 105 of FIG.
Is a block diagram of the HMD unit 111, which shows a display arrangement of a stereoscopic image. The main body (not shown) is molded into a goggle shape from plastic and is attached to the head with a belt, and has a transparent protective window (not shown) on the front surface. 333 and 334 are left and right display units. Left and right display units 333, 3
A liquid crystal panel (hereinafter referred to as LC) 34 is illuminated by backlight light sources 341 and 342, each of which comprises a cold cathode tube.
The display images of 339 and 340 are enlarged and displayed as distant virtual images for the left and right eyes independently by the relay optical systems 337 and 338 and the virtual image forming optical elements 335 and 336. The virtual image forming optical elements 335 and 336 are aspherical half mirrors.
It functions as a combiner that allows the images from 39 and 340 to be superimposed and observed. Backlight light sources 341 and 342
When LCD339,340 is along by an actuator 357 to be described later becomes left and right integrally with the rotation guide (not shown), is rotated left and right eye center O _L, O _R and the optically equivalent positions in the heart You. Note that, for simplification of the mechanism, a configuration may be adopted in which linear movement is performed in a direction perpendicular to the optical axis. The virtual image forming optical element 33
The present invention can be practiced with a spherical lens system, a hologram, or the like as 5,336, and a configuration in which a virtual image is enlarged and displayed only by a transmission type optical element instead of a reflection type can be adopted. The relay optical systems 337 and 338 can have functions of correcting residual aberration, condensing light beams from a display, and forming intermediate images. Left and right virtual images 361 and 362 are in the position of the image of each eye centers magnitude in H O _L, O _R than the distance a. 363,36
Reference numeral 4 denotes a line connecting the left and right virtual image screen centers and the observer's pupil center, which are perpendicular to the virtual images 361 and 362, respectively, and intersect at the right and left virtual image centers M and M '. 365, both eyeballs center O _L, a vertical bisector of the base line connecting the O _R O _L O _R (length L), the angle between both axes 363, 364 and ± theta. The signal processing units 351 and 352 are LCDs 339 and 34, respectively.
This is a signal processing unit for converting the video signal input to 0 into a form suitable for LCD display. RG composite signal
This block includes a decoding circuit for converting into B, an inverse γ-conversion circuit for adjusting gradation characteristics, and the like. LCD33
The 9,340 drive circuits 353 and 354 include a polarity inversion circuit for performing inversion driving, a circuit for providing an offset voltage, and the like. Inverter circuits 355 and 356 drive backlight light sources 341 and 342, respectively. The actuators 357 and 358 are driven by a control signal from the control unit 303, and each of the display units 33
3,334 is rotated. System controller 360
Controls the HMD unit 111. Note that an audio signal transmitted by an audio signal device (not shown) is amplified, and stereo sound corresponding to an image is reproduced by a headphone speaker (not shown).

FIGS. 6 and 7 show backlight light sources 341 and 34, respectively.
2 and the operations of the LCDs 339 and 340. Generally, standing
The body vision consists of two images (stereo pair) with binocular parallax.
This is possible by independently presenting them to the left and right eyes. HMD section
Present at 111 so that the positions of the two virtual images overlap
Then, fusion of the stereo pair becomes easy. As shown in FIGS.
As described above, the centers M and M 'of the left and right virtual images are almost vertical.
The backlight source 34 reaches a position on the bisecting surface 365.
1, 342 and LCDs 339, 340 are moved. left
The virtual image on the right forms an image symmetrically across the surface 365. Left and right
The optical axis of the eyeball is the table of the display units 333 and 334, respectively.
The fusion of the stereo pair is complete when it matches the center axis of the displayed image
I do. FIG. 7 shows a view of an object at a short distance compared to the case of FIG.
And θ ₁ Angle of convergence. In the case of FIG. 6, the case of FIG.
When looking at an object at a long distance,_Two With a convergence angle of
Looks like This convergence angle θ₁ , Θ_Two Is usually compound eye camera 1
Is controlled to reproduce the convergence angle when the image was taken at 10.
You.

FIG. 8 shows the compound eye camera-H described with reference to FIGS.
The operation of the MD system will be described with reference to the flowchart of FIG. Unless otherwise specified, the operation is performed by the system controller 109, and the left and right video signals are almost synchronized. further,
If the image data is compressed at the time of shooting or recording, the image data is expanded at the time of display. First, when a power switch (not shown) is turned on, the imaging systems 201 and 201 are turned on.
02, an image pickup signal is output (step S101).
The imaging signal is input to the system controller 214,
The aperture and the focus of both the imaging systems 201 and 202 are controlled (step S102). Further, the image pickup signal is also input to the HMD unit 111 and is displayed (step S103). The system controller 214 calculates the control amount of the convergence angle from the focus information, and based on the calculation result, rotates the arms 203 and 204 supporting the imaging systems 201 and 202 around the axis 205. The actuators 206 and 207 are rotated by a predetermined amount (step S104). Information on the convergence angle of the compound eye camera is transmitted to the system controller 360 of the HMD unit 111, and the control unit 303 controls the actuators 357 and 358.
To rotate the display units 339, 341, 340, 342 by a predetermined amount (step S105). Then, a selection is made as to whether or not a shooting start switch (not shown) has been operated (step S106). If the shooting start switch has been operated, recording of the video signal and control information in the recording / reproducing block 112 is started (step S107). ).

FIG. 9 is a block diagram showing a second embodiment of the present invention.

This embodiment is constructed so that not only a stereoscopic image but also a panoramic image can be picked up and displayed. Detailed description of the camera system is omitted because information such as an image and a convergence angle given to the display device is sufficient, and the display device will be described with reference to FIG. Description of the components in FIG. 9 common to those in FIGS. 2 to 4 will be omitted.
In FIG. 9, a 2D3D detection circuit 401 is newly added. This circuit 401 is for discriminating, based on the control information sent from the compound-eye camera unit, whether the image has been stereoscopically photographed (3D photographed) or panoramic photographed (2D photographed). Normally 2D or 3D in compound eye camera
The control information is transmitted with information for identifying whether or not it is transmitted. If the information is not added, a determination is made based on convergence angle information and focal length information. The control unit 303 is 2
Switching between a stereoscopic display state and a panoramic display state is performed based on the determination result of the D3D detection circuit 401. At the time of the panoramic display, the display device needs to be adjacent to each other so that no virtual image for the left and right eyes forms a gap on the surface 365 as shown in FIG. Therefore, the convergence angle is adjusted so that the left end of the virtual image for the right eye and the right end of the virtual image for the right eye are in contact at a point N on the surface 365. As shown, the angle of view of the virtual images 361 and 362 is set to ω (ω>
0), base O _L O _R is connecting the left and right eyeballs center straight line
The straight line O _L N, the respective angles between the _{O R N α (α> 0} )
Then, θ = 90 ° −ω−α. Where ω = t
an ^-1 (H / 2a), α = cos ^-1 (Lcos ω / 2
a). In this embodiment, as a result of calculation based on information from the compound eye camera, L = 65 mm, H = 1219.2 mm,
Since a = 1500 mm, θ = −20.97 °. The display unit 33 sets the convergence angle θ to this angle.
The arrangement of 3,334 is adjusted. When observing a panoramic image by the above means, the apparent angle of view is about 4
ω = 88.48 °, and an image with a very wide angle of view could be provided. However, since the human eye does not normally rotate outward, the axis of the observer's line of sight at this time faces a method different from the convergence angle.

FIG. 10 is an example of left and right images displayed on the LCDs 339 and 340. FIGS. 10A and 10B show images to be displayed on the left and right display units, respectively. This is viewed as a panorama with the present system, and as shown in FIG.
As shown in (3), the cubic images 502 and 503 separated into two are connected into one like 505, and the images 501, 505 and 504 having a very wide angle of view as a whole are obtained.
Can be obtained.

In the above description, the case where the HMD projection optical system changes the LCD and backlight positions to follow the convergence angle, or switches between panoramic display and stereoscopic display has been described. The present invention is not limited to this, and similar effects can be achieved by other means as already described in Japanese Patent Application No. 5-92113, which has already been proposed by the present applicant. That is, 1) the display and the projection optical system are rotated as a whole in the horizontal direction around the center of the pupil of the observer while maintaining the relative positional relationship between the display and the projection optical system.

2) The display and the projection optical system are moved in the horizontal direction.

3) With the display fixed, only the projection optical system is moved in the horizontal direction.

4) Optical deflecting means or movable reflecting optical means is provided between the observer's pupil and the display, and the virtual image position is moved in the horizontal direction by the optical deflecting means or movable reflecting optical means.

5) With the display and the projection optical system fixed, the displayed image is electrically moved in the horizontal direction.

The effects of the present invention can be achieved by such a method.

In the description so far, whether the left and right virtual image planes projected on the HMD completely overlap,
Although the case of contacting without overlapping at all has been described, as described in Japanese Patent Application No. 5-92113, the convergence angle can be followed even in a state where the two virtual image planes partially overlap.

[0037]

As described above, the present invention has the following effects. (1) According to the first, second, fifth, and sixth aspects of the present invention, control information of the stereoscopic image capturing camera device is provided to the display device in addition to the video signal, and a pair of enlargement in the display device is performed based on the control information. By changing the relative spatial position of the virtual image, it is possible to display an image that correctly reflects the intention of the photographer. (2) According to the third and seventh aspects of the present invention, in addition to a video signal, a set of a plurality of video signals from a three-dimensional image capturing camera is distinguished from a two-dimensional video image or a stereo video image (three-dimensional video image) By providing the information to the display device and controlling the spatial position state of the two virtual image planes of the display device based on this information, the user can enjoy the video expression of a three-dimensional image, a two-dimensional image, or an image in which both are mixed. be able to.

[Brief description of the drawings]

FIG. 1 is a block diagram of a stereoscopic image capturing and displaying system according to a first embodiment of the present invention.

FIG. 2 is a block diagram of an imaging unit 101.

FIG. 3 is a diagram illustrating the imaging unit 101 when the convergence angle is θ.

FIG. 4 is a diagram illustrating another configuration of an imaging system and a mechanical system of the compound-eye camera.

FIG. 5 is a block diagram of the HMD unit 111.

FIG. 6 shows backlight sources 341 and 342 and LCD3.
It is a figure which shows the mode of operation | movement of 39,340.

FIG. 7: backlight light sources 341 and 342 and LCD3
It is a figure which shows the mode of operation | movement of 39,340.

FIG. 8 is a flowchart showing the operation of the stereoscopic image capturing and displaying system of FIGS. 1 to 5;

FIG. 9 is a block diagram of a stereoscopic image capturing and displaying system according to a second embodiment of the present invention.

FIG. 10 is a diagram showing an example of left and right images displayed on LCDs 339 and 340.

[Explanation of symbols]

 Reference Signs List 101 imaging unit 102 output unit 103 transmission unit 104 input unit 105 output unit 106 recording unit 107 reproduction unit 108 recording medium 109 system controller 110 camera unit 111 HMD unit 112 recording / reproduction block 201, 202 imaging system 201a, 202a optical system 201b, 202b Image sensor 201c, 202c Imaging optical axis 203, 204 Arm 205 Axis 206, 207 Actuator 209, 210 Signal processing unit 211 Control unit 214 System controller 231 Subject 232, 233 Imaging optical system 234, 235 Image sensor 236, 237 Optical axis 238 Slide Mechanism 333, 334 Display unit 337, 338 Relay optical system 339, 340 Liquid crystal panel (LCD) 341, 342 Back light source 351, 352 Signal processing Parts 353 and 354 liquid crystal driving circuit 355, 356 a backlight driving circuit 357, 358 actuator 360 system controller 361, 362 a virtual image 363, 364 line 365 perpendicular bisector 401 2D3D detecting circuit 501-505 image S101~S107 step

──────────────────────────────────────────────────続 き Continuing on the front page (72) Katsumi Iijima 3-30-2 Shimomaruko, Ota-ku, Tokyo Canon Inc. (72) Inventor Nobuo Fukushima 3-30-2 Shimomaruko, Ota-ku, Tokyo Canon (72) Inventor Shigeki Okauchi 3-30-2 Shimomaruko, Ota-ku, Tokyo Inside Canon Inc. (72) Inventor Jun Tomitsu 3-30-2 Shimomaruko, Ota-ku, Tokyo Inside Canon Inc. ( 56) References JP-A-4-34512 (JP, A) JP-A-5-130646 (JP, A) JP-A-3-48233 (JP, A) JP-A-63-261978 (JP, A) (58) ) Surveyed fields (Int.Cl. ⁶ , DB name) G03B 35/00-35/26 G03B 37/00-37/06 G02B 27/02 G02B 27/22-27/26 H04N 13/00-13/04

Claims (8)

(57) [Claims] 1. A stereoscopic image capturing camera device having image capturing means for generating a plurality of video signals corresponding to optical images from different viewpoints, and a pair of images displayed on a pair of video display means is converted into a pair of images. A display device for guiding the pair of images to the observer's eyes with the projection optical system and enabling the enlarged virtual images of the pair of images to be observed with each eye, and displaying the plurality of video signals from the stereoscopic image capturing camera device. In a stereoscopic image capturing and displaying system for displaying and observing on a pair of video display means of the device, the control information of the stereoscopic image capturing camera device is displayed in addition to a plurality of video signals from the stereoscopic image capturing camera device. A stereoscopic image pickup / display system, which is provided to a device and changes a relative spatial position of the pair of enlarged virtual images of the display device according to the control information. 2. A stereoscopic image capturing camera device having image capturing means for generating a plurality of video signals corresponding to optical images from different viewpoints, and a pair of images displayed on a pair of video display means is converted into a pair of images. Guided by the projection optical system to both eyes of the observer, the enlarged virtual image of the pair of images can be observed by each eye, and the position of the display device with respect to the projection optical system, or the imaging state of the projection optical system Controlling the spatial positions of the two virtual image planes from two overlapping states to adjacent juxtaposed states, and displaying a plurality of video signals from the three-dimensional image capturing camera device on the display. In a stereoscopic image capturing and displaying system for displaying and observing on a pair of display means of the device, in addition to a plurality of video signals from the stereoscopic image capturing camera device, control information of the stereoscopic image capturing camera device is displayed. It is given to the display device, in accordance with the control information, the stereoscopic imaging and display system characterized by varying the relative spatial position of the enlarged virtual image of the pair of the display device. 3. The control information includes at least information for distinguishing whether a set of a plurality of video signals from the stereoscopic image capturing camera device is a two-dimensional image or a stereo image, and based on the information. The stereoscopic image capturing and displaying system according to claim 2, wherein a spatial position state of two virtual image planes of the display device is controlled. 4. The stereoscopic image pickup / display system according to claim 2, wherein the information includes at least convergence angle information formed by a plurality of image pickup optical systems from the stereoscopic image pickup camera device. 5. A stereoscopic image capturing camera device having image capturing means for generating a plurality of video signals corresponding to optical images from different viewpoints, and transmitting a plurality of video signals from the stereoscopic image capturing camera device to a video information recording medium. A video information recording device for recording, and a pair of images displayed on a pair of video display means.
A display device for guiding the pair of images to the observer's eyes with a pair of projection optical systems and enabling the enlarged virtual image of the pair of images to be observed with each eye, and reproducing from the video information recording medium in the video information recording device. A plurality of video signals to be displayed on a pair of display means in the display device for observation and observation, wherein the three-dimensional image is added to the plurality of video signals from the three-dimensional image capturing camera device. The control information of the imaging camera device is recorded on a video information recording medium in the video information recording device, and a plurality of video signals reproduced from the video information recording medium and the control information are provided to the display device. A stereoscopic image pickup / display system, wherein a relative spatial position of the pair of enlarged virtual images of the display device is changed in response to the change. 6. A stereoscopic image capturing camera device having image capturing means for generating a plurality of video signals corresponding to optical images from different viewpoints, and transmitting a plurality of video signals from the stereoscopic image capturing camera device to a video information recording medium. A video information recording device for recording, and a pair of images displayed on a pair of video display means.
A pair of projection optical systems guides the pair of images to both eyes of an observer, and enables an enlarged virtual image of the pair of images to be observed with each eye, and a position of the display device with respect to the projection optical system or an image of the projection optical system. A display device capable of controlling the spatial position of the two virtual image planes from two overlapping states to adjacent juxtaposed states by controlling the state, and reproducing from a video information recording medium in the video information recording apparatus. A plurality of video signals to be displayed on a pair of display means in the display device, and a stereoscopic image capturing / display system for observing the video signal. In addition to the plurality of video signals, control information of the stereoscopic image capturing camera device is displayed. Recorded on a video information recording medium in the video information recording device, a plurality of video signals reproduced from the video information recording medium and the control information to the display device, according to the control information, A stereoscopic image pickup / display system, wherein a relative spatial position of the pair of enlarged virtual images of the display device is changed. 7. The control information includes at least information for distinguishing whether a set of a plurality of video signals from the three-dimensional image capturing camera device is a two-dimensional image or a stereo image, based on the information. 7. The stereoscopic image capturing and displaying system according to claim 6, wherein a spatial position state of two virtual image planes of the display device is controlled. 8. The stereoscopic image pickup / display system according to claim 6, wherein the information includes at least convergence angle information formed by a plurality of image pickup optical systems from the stereoscopic image pickup camera device.