JP2557406B2 - 3D image display device - Google Patents

Description

Description: TECHNICAL FIELD The present invention relates to a three-dimensional image display device for reproducing a three-dimensional image of a landscape, a person, etc. without a pair of glasses and giving a stereoscopic effect. .

(Prior Art) Conventionally, there are various three-dimensional image devices,
As a typical device that gives a stereoscopic effect without glasses, there are a device using a varifocal mirror and a device using a lenticular lens.

FIG. 5 shows a conceptual diagram of an apparatus using the former varifocal mirror. The vibrating mirror 1 is made concave by the speaker 2,
It uses the fact that the focal length changes due to deformation such as a flat surface or a convex surface.
That is, according to the deformation of the vibrating mirror, the image on the CRT 3 becomes the stereoscopically visible virtual image 4 displayed by the broken line, and is observed by the observer 5. This method has a simple structure, but the virtual image 4
Has a drawback that the field of application is limited because it becomes a semi-transparent image.

Further, FIG. 6 shows a conceptual diagram of the latter device using the lenticular lens. The lenticular lens sheet 6 is an assembly of semi-cylindrical lenticular lenses 7, and each lenticular lens forms an image displayed on the display 8 on an observation surface 9 that separates a space so that an observer 5 can stereoscopically view the image. Seventh
The figure is an explanatory view of the principle of stereoscopic vision when this FIG. 6 is cut along a horizontal plane at the eye level of the observer 5 and viewed vertically downward from the upper part. As shown in the figure, when the right-eye image (R1, R2, R3) and the left-eye image (L1, L2, L3) are displayed on the display 8 in a line in the vertical direction, the right eye located on the observation surface 9 is displayed. The image for the right eye enters and the image for the left eye enters the left eye, enabling stereoscopic viewing. As a means for displaying an image on the display, it is sufficient if the display 8 itself may be a light emitting type such as a CRT, but it is also possible to use an external projection type. FIG. 8 shows an example of a projection type configuration, in which 2
The same effect can be obtained by arranging the projectors 10 on a stand and projecting an image on the display 8 by the projectors. Furthermore, the same effect can be obtained by projecting from the back of the display using a transmissive display. Further, even if a directional lens such as a fly's eye lens or a cat's eye lens having a large number of minute convex lenses is used, the same effect as that of the lenticular lens can be obtained. Therefore, when the term “lenticular lens” is used below, these directional lenses and the like are included. The method using the lenticular lens can obtain an opaque reproduced image, but the stereoscopically visible range is fixed, so stereoscopic viewing may not be possible if the observer moves the face slightly left and right. It was a drawback.

(Object of the Invention) In order to eliminate the drawbacks of the device using the lenticular lens described above, an object of the present invention is to displace an image displayed on a display according to the movements of both eyes of an observer to enable stereoscopic viewing. To do.

(Structure of the Invention) (Differences between Features of the Invention and Prior Art) In order to achieve the above object, the present invention displays a twin-lens camera for photographing a three-dimensional object and information photographed by the twin-lens camera. In a three-dimensional image display device comprising a display for display and a directional lens represented by a lenticular lens arranged on the surface of the display, a means for detecting the movement of both eyes of an observer and the detected binocular And a means for displacing the image displayed on the display according to the movement of the binoculars, and a means for controlling the attitude of the twin-lens camera according to the detected movements of both eyes.

In the above-described conventional three-dimensional image display device using the lenticular lens, the range in which stereoscopic vision is possible is fixed, so that it is impossible for the observer to move the face slightly left and right, but stereoscopic vision is impossible. The present invention differs from the prior art in that the recognition device detects the amount of movement according to the movements of both eyes of an observer and enables stereoscopic vision associated with the movement.

(Embodiment) FIG. 1 is an explanatory view of the principle on which the present invention is based. For convenience of explanation, the scale ratio is changed between the solid lenticular lens 7 in FIG. 7 and the observer 5 with an auxiliary line as a boundary. It is shown. This is characterized in that a device 11 for recognizing the movements of both eyes of this observer is arranged on the side of the observer 5 as shown in the figure.

Next, the operation in this case will be described. Now, it is assumed that the observer 5 horizontally moves both eyes to the right. At this time, the recognition device 11 detects the amount of movement of both eyes, calculates the display position of the right eye image / left eye image on the display 8 from the focal length of the lenticular lens 7 and the distance between the display 8 and the observation surface 9, The image is displayed at a position where each image is surely input to both eyes after the movement. Further, when the observer's head rotates in the horizontal direction, it is possible to move the right-eye image and the left-eye image onto the display 8 which the observer can newly see, if necessary. Needless to say. The movement of both eyes of the observer described here includes not only horizontal movement and rotation movement but also the case where the head does not move and only the viewpoint moves, and the case where these are combined. As a method of recognizing the movement of both eyes, the head of an observer is photographed by a TV camera and the output image signal is processed to recognize the positions of both eyes, and from the recognition of the light spot on the black eye, the direction of the line of sight is recognized. An example is a method of calculating Further, as another example, by imaging the head from the upper side and estimating the positions of both eyes from the statistical positional relationship of the human head, it is possible to follow horizontal and rotational movements of both eyes. . However, in this case, it is difficult to follow the movement of only the line of sight. As described above, there are various methods for recognizing the movements of both eyes, but it is clear that any method can be used as long as it can be recognized. Although the recognition device 11 is arranged in front of the observer in the present embodiment, it may be arranged above, below, or behind the observer, and the point may be determined according to the recognition accuracy.

FIG. 2 is an explanatory view of the principle applied to the projection type three-dimensional image display. This places the projector 10 above the observer,
The projector 10 is controlled above the movement of both eyes recognized by the recognition device 11 so that the right eye image / left eye image is accurately incident on both eyes of the observer. In addition, when a transmissive display is used, it is natural that the projector 10 may be arranged on the back surface of the display.

FIG. 3 is an explanatory view of an embodiment of the present invention, and 12 is a camera for picking up a right-eye image and a left-eye image. The figures drawn on the upper right are general scenes such as mountains and lakes, meaning all that can be visually recognized. An observer 5 surrounded by a broken line is observing the image displayed on the display at a different position and does not exist at the position of the camera, but is shown for the sake of explanation. Now, when an observer 5 who is observing an image at a remote place moves or rotates his / her head, the recognition device 11 recognizes the movements of both eyes and controls the camera 12 so that both eyes of the observer are recognized. An image corresponding to the eye movement is sent to the viewer's display.

FIG. 4 is an example in which the present invention is applied to a video conference.
In the figure, 13 is the other party (person) of the video conference, 8'is the display of the other side, 10 'is a projector for projecting an image on the display of the other side, as described in the embodiment of the figure. , A device that recognizes the movement of both eyes of the other party 13 of the video conference
The projector 10 'is controlled so that it is detected by 11' and moves accordingly. The observer surrounded by the broken line is in a remote place as in the previous embodiment, and is shown for the sake of explanation. Now
When an observer 5 observing an image at a remote location moves or rotates his / her head, the recognition device 11 recognizes the movements of both eyes and controls the camera 12 so that the two eyes of the observer can be controlled. An image corresponding to the movement is sent to the viewer's display. That is, when the observer 5 observing the image on the display at a remote location makes a motion such as moving or rotating the head, the recognition device 11 located at the remote location recognizes the movement of both eyes. As a result, as in the case of FIG. 3, the twin-lens cameras 12, 12 placed at the location of the other party (person) in the video conference are controlled, and the twin-lens cameras 12, 12 are The scene of the other party corresponding to the movement of both eyes of the observer 5 is captured and displayed on the observation surface 9 on which the observer 5 is observing. At this time, when the observer observes the observation surface 9, it is needless to say that it is displayed on the observation surface so that the observer 5 can see the stereoscopic image correctly, as described with reference to FIG.

In this way, the observer can see the image of the desired place. Here, for both the observer side and the other side,
By arranging the display, the lenticular sheet, the projector, the camera, and the recognition device, which have been described in the embodiments, the three-dimensional video conference can be performed mutually.

(Effects of the Invention) As described above, according to the present invention, even if there is movement of both eyes of the observer, the movement is detected by the recognition device to enable stereoscopic vision. In addition, since a display device capable of moving the field of view can be realized, it is possible to configure a video system with a sense of presence without glasses.

[Brief description of drawings]

1 and 2 are explanatory views of the principle on which the present invention is based, FIG. 3 and FIG. 4 are examples of the present invention, and FIG. 5 is a conventional example using a varifocal mirror. Display device, 6th
FIGS. 1 to 8 show a conventional display device using a lenticular lens, and FIG. 7 is a plan view of FIG. 6 cut horizontally. 1 ... Vibration mirror, 2 ... Speaker, 3 ... CRT, 4 ... Virtual image, 5 ... Observer, 6 ... Lenticular lens sheet,
7 ... Lenticular lens, 8 ... Display, 9 ...
… Observation plane, 10 …… Projector, 11 …… Recognition device, 12 …… Camera, 13 …… Video conference partner.

 ─────────────────────────────────────────────────── ─── Continuation of front page (56) Reference JP-A-60-222839 (JP, A) JP-A-60-236394 (JP, A) JP-A-57-200030 (JP, A) JP-A-50- 147333 (JP, A) JP-B 55-728 (JP, B1) JP-B 50-25772 (JP, B1) JP-B 58-7981 (JP, B2) JP-B 4-39836 (JP, B2) Japanese Patent Sho 52-20268 (JP, B2) Japanese Official Sho 62-13052 (JP, Y2)

Claims (1)

(57) [Claims] 1. A twin-lens camera for photographing a three-dimensional object, a display for displaying information photographed by the twin-lens camera, and a directional lens represented by a lenticular lens arranged on the surface of the display. In the three-dimensional image display device described above, means for detecting movement of both eyes of an observer, means for displacing an image displayed on a display according to the detected movement of both eyes, and the detected both eyes A three-dimensional image display device comprising means for controlling the posture of the twin-lens camera according to the movement of the camera.