JPH07154829A - Eyeglass type image display device - Google Patents

Abstract

(57) [Summary] [Purpose] A good binocular parallax effect can be achieved without being affected by the deviation during wearing and the individual difference in the distance between the left and right eyes by displaying the image according to the eyeball position of the observer. To get. An eyeball position calculation circuit 116 calculates the eyeball position of the observer based on the outputs of the eyeball position detection sensors 108 and 109, and outputs the deviation of the eyeball position of the observer with respect to the image display panels 101 and 102. The input images from the image input terminals 117 and 118 are variable delay circuits 119 and 120 based on the amount of the shift.
Delay at. The switch control circuit 125 controls the switches 123 and 124 so that the signal from the signal generator 122 is input to an unnecessary portion of the screen caused by the delay. The outputs of the switches 123 and 124 are displayed on the image display panels 101 and 102.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a spectacle type image display device having display means for each of the right eye and the left eye.

[0002]

2. Description of the Related Art A block diagram of a conventional eyeglass-type image display device is shown in FIG. 6, in which 600 is a display panel for the left eye,
01 is a display panel for the right eye, 602 is the left eye (eyeball) of the observer, 603
Is the observer's right eye (eyeball), 604 and 605 are the left-eye image and the right-eye image displayed on the left-eye display panel 600 and the right-eye display panel 601, respectively, 606 is the image 604 and
The objects virtually observed by the observer by 605, α and β are the convergence angles of the left and right eyes when the images 604 and 605 are focused.

In the conventional spectacle-type image display device configured as described above, the observer views the left-eye image 604 with the left eye,
When the right-eye image 605 is observed with the right eye, the object 6
Looks like there is 06. This is because parallax is given to both eyes of the observer to give a sense of depth. Left eye display panel
This depth amount changes depending on the shift amount of the image displayed on the display panel 601 for the right eye and 600. That is, in FIG. 6, when the vergence angles α and β increase, the object 606 appears in front, and conversely, when the vergence angles α and β decrease, the object 606 appears distant. In this way, the positions of the objects that the observer can see are determined by the positional relationship between the images 604 and 605 and the left eye (eyeball) 602 and the right eye (eyeball) 603 of the observer. An image is obtained.

[0004]

However, in the conventional eyeglass-type image display device configured as described above, since there is individual difference in the distance between the two eyes, the positional relationship between the two eyes and the display image is deviated. There is a problem that the depth amount felt by each observer changes.

Further, there is also a problem that a good binocular parallax effect does not appear if the mounting position is different for each observer at the time of mounting.

The present invention has been made in view of such conventional problems, and always produces a good stereoscopic image even if the distance between the eyes of the observer is different or the observer is mounted at a displaced position. An object of the present invention is to provide a spectacle-type image display device capable of displaying.

[0007]

The first invention of the present invention is as follows:
A display device that displays an image on both eyes of the observer, an eyeball position detection sensor that detects the eyeball position of the observer, and the eyeball position of the observer is calculated from the output of this eyeball position detection sensor of the display device. An eyeball position calculation circuit that outputs the amount of deviation between the central part and the observer's eyeball position, an image input terminal that inputs a display image, and the image position from the image input terminal is moved based on the output of the eyeball position calculation circuit. And an image position conversion circuit for controlling the image position.

A second aspect of the present invention is a display device for displaying an image on both eyes of an observer, an eyeball position detecting sensor for detecting an eyeball position of the observer, and an observer from the output of the eyeball position detecting sensor. An eyeball position calculation circuit that calculates the binocular eyeball position and outputs the amount of deviation between the center part of the display device and the observer's eyeball position, an image input terminal that inputs a display image, and a device that drives the display device. And a display device control circuit that controls a device that drives the display device based on an output of the eyeball position calculation circuit.

[0009]

According to the first aspect of the present invention, the eyeball position detecting sensor and the eyeball position calculating circuit calculate the eyeball positions of both eyes of the observer, and calculate the deviation amount of the eyeball position from the center position of the display device. Output. From the image input terminal, the images projected on the left and right eyes are input. The variable image delay circuit can change the position of the input image from the image input terminal based on the output of the eyeball position calculation circuit, and can always observe the image at a constant position according to the eyeball positions of both eyes. .

Further, according to the second aspect of the present invention, the eyeball position detecting sensor and the eyeball position calculating circuit calculate the eyeball positions of both eyes of the observer, and the amount of deviation of the eyeball position from the center position of the display device. Is output. From the image input terminal, the images projected on the left and right eyes are input. The display device control circuit outputs a control signal for controlling the movement amount of the display device based on the output of the eyeball position calculation circuit, and by driving the display device by the drive device of the display device, depending on the eyeball positions of both eyes. The image can always be observed at a fixed position.

[0011]

(Embodiment 1) FIG. 1 is a block diagram showing the overall configuration of an eyeglass-type image display device according to Embodiment 1 of the present invention. Figure 1
In, 100 is an image display unit of the eyeglass-type video display device, 101
And 102 are the image display panels for the left eye and the image display panel for the right eye, 103 and 104 are the left eye (eyeball) and the right eye (eyeball) of the observer A, and 105 and 106 are the image display panels 101 and 102, respectively. , 107 is an object observed by the viewer A by the display images 105 and 106, and 108 and 109 are eyeball position detection sensors for the left and right eyes, respectively.

Observers 110 and 111 are displayed on the image display unit 100 by the observer B.
Left eye (eyeball) and right eye (eyeball) when wearing, 112 is an object observed by the observer B by the display images 105 and 106, 113 and 114 are for the left eye displayed for the observer B And a display image for the right eye, and 115 is an object observed by the observer B by the display images 113 and 114.

Reference numeral 116 denotes an eyeball position calculation circuit that calculates and outputs the displacement between the eyeball and the image display panels 101 and 102 from the outputs of the eyeball position detection sensors 108 and 109, and 117 and 118 denote right eye and left eye images. An image input terminal for the right eye and an image input terminal for the left eye for inputting.

Reference numerals 119 to 125 are configuration examples of an image position conversion circuit that changes the display position of the input images from the image input terminals 117 and 118, and 119 and 120 are the right eye image input terminal 117 and the left eye. A variable delay circuit that variably delays the input image from the image input terminal 118 with respect to the horizontal synchronizing signal, and 121 is a delay amount that controls the delay amounts of the variable delay circuits 119 and 120 based on the output of the eye position calculation circuit 116. Control circuit,
122 is a signal generator that outputs a black level video signal, and 123 and 124 are right eye switches that switch between the inputs from the variable delay circuits 119 and 120 and the input from the signal generator 122 to output one of them, and The switch for the left eye, 125 is a switch control circuit for controlling the switches 123 and 124.

The operation of the eyeglass-type image display device of the first embodiment constructed as described above will be described. When the observer A wears the image display unit 100 as desired, that is, the center positions of the left eye (eyeball) 103 and the right eye (eyeball) 104 of the observer A,
A case in which the center position of the image display unit 100 matches will be described. When observing the object 107 in front of the observer A as a display image, the display images 105 and 106 are displayed on the image display panels 101 and 102, and the observer A mounts the image display unit at a desired position. Therefore, the observer A can observe the object 107 in front of himself as shown in FIG.

Next, the case where the observer B wears the image display unit 100 in a state slightly displaced from the desired position will be described. When the display images 105 and 106 are displayed on the image display panels 101 and 102 in order to observe the object 107 in front of the observer B in the same manner as described above, the left eye (eyeball) and the right eye (eyeball) of the observer B are 11
Since 0 and 111 are at the positions shown by the broken lines, the observer B observes the object 112, and the observer B cannot observe the object in front. Then, the eyeball position of the observer is detected and an image is displayed at a desired position.

The eyeball position detecting sensors 108 and 109 are sensors which output according to the eyeball position of the observer, and are, for example, CCDs.
It can be realized with a sensor. The output of the CCD sensor is shown in FIG. In FIG. 2, 200 and 201 are outputs of the CCD sensors for the right and left eyes, 202 and 203 are CCs.
The central positions of the D sensor, 204 and 205 are the right and left eyes of the observer, and 206 and 207 are the central positions of the black eyes of the right and left eyes of the observer.

The CCD sensor has its central positions 202 and 2
03 so as to match the desired eyeball position, that is, when the image display unit 100 is mounted at the desired position, the sensor center position 2
Center positions of 02 and 203 and the observer's right and left eyes (eyeballs) 20
It is fixed to the image display unit 100 in advance so that 6 and 207 match. The outputs of the eyeball position detection sensors 108 and 109 are input to the eyeball position calculation circuit 116. In the eyeball position calculation circuit 116, first, the central position 206 of the black eye of the observer is detected.
And 207 are detected. This central position 206 and 20
7 is obtained, for example, by extracting a continuous black area and calculating the barycentric position thereof. The positional relationships between the black eye center positions 206 and 207 thus calculated and the desired CCD sensor center positions 202 and 203 are calculated, respectively. By calculating this positional relationship between the left and right eyes,
A shift in the positions of both eyes of the observer with respect to the image display panels 101 and 102 is detected.

When the amount of shift between the left and right eyes calculated by the eyeball position calculation circuit 116 is input to the delay amount control circuit 121, the input images from the image input terminals 117 and 118 are horizontally adjusted according to the amount of shift. The delay amount for delaying the synchronization signal is output, and the variable delay circuits 119 and 120 delay the input image. When the delay is performed, a signal-free area occurs during the delay period from the horizontal synchronizing signal. Since a signal of a constant level is input to this area, processing is performed in the signal generator 122, the switches 123 and 124, and the switch control circuit 125. This state is shown in FIG.

FIG. 3 shows the output of the CCD sensor and the state of image delay, taking the right eye as an example. (A) shows the output of the CCD sensor, 300 shows the output of the CCD sensor 109,
301 is the central position of the CCD sensor, and 302 is the central position of the observer's right eye. (b) shows an input image from the image input terminal 117, 303 is an input range of the input image, and 304 is an object of the input image. (c) shows the output of the variable delay circuit 119, 305 is the output image of the variable delay circuit, and 306 is the image input terminal.
Reference numeral 117 is an input image frame, 307 is a position of the input image 304, 308 is a delayed image, and 309 is a portion where the input image is missing as a result of the delay. (d) is an output image of the switch 123, and 310 is a portion where a signal of a constant level is input to the missing portion 309 of the input image.

It is assumed that the output 300 of the CCD sensor 109 is such that the right eye is as shown in the figure. Eye position calculation circuit 116
In, the center position 302 of the right eye (black eye) is detected, and the shift amount between the center position 301 of the CCD sensor and the center position 302 of the right eye (black eye) is output. An image is input to the input range 303 from the image input terminal 117 for the right eye, and the object 3 is included in the input image.
Suppose you have 04. In the delay amount control circuit 121, the delay amount of the image is determined according to the amount of deviation of the eyeball output from the eyeball position calculation circuit 116. For example, if the displacement of the eyeball is d (x,
y), the image shift, that is, the output image 305
The amount of shift between the input image frame 306 and the input image frame 306 is proportionally determined, and is expressed by α · d (x, y) when expressed using a constant α. The delay amount of the image according to the amount of this shift is output from the delay amount control circuit 121, and the variable delay circuit 119 delays.
The output image at this time is 305.

However, due to this delay, the signal of the missing portion 309 of the input image is a discontinuous signal and an unnecessary signal. Therefore, in order to input a constant level signal to this portion, a signal from the signal generator 122, for example, a constant black level signal is input. The switch 123 and the switch control circuit 125 are used to input the signal from the signal generator 122 to the missing portion 309 of the input image. Switch control circuit 125
Detects a missing portion 309 of the input image from the output of the delay amount control circuit 121, and switches the switch 123 so as to input the signal of the signal generator 122 to this portion. By this operation, a constant level signal is input as shown at 310 in the output image (d) of the switch 123 and the black level signal is filled.

Similar processing is performed for the left eye, and the images are displayed on the image display panels 101 and 102, respectively.
That is, for the observer B, when the object is displayed as shown in the display images 113 and 114, the observer B observes the object 115 at the position indicated by the broken line, and the observer A
You can observe the object in the same direction that you are looking.

Although the eyeball position detecting sensor is realized by using the CCD sensor in this embodiment, another eyeball position detecting method, for example, a line sensor or an infrared sensor may be used. The eye position calculation circuit receives the output of the eye position detection sensor as an input and outputs a ROM (Read On) value that outputs the amount of eye deviation.
ly Memory). Also, eye position calculation circuit 11
6, the delay amount control circuit 121, the variable delay circuits 119 and 120, the switch control circuit 125, and the switches 123 and 124 may be realized by a DSP or the like.

(Embodiment 2) FIG. 4 is a block diagram showing the overall structure of an eyeglass-type image display device according to Embodiment 2 of the present invention. The same reference numerals as those in FIG. 1 indicate the same operation, and thus detailed description thereof will be omitted. In FIG. 4, 400 is a display panel drive device for the left eye, 401 is a display panel drive device for the right eye, 402 is a display panel control circuit for controlling the display panel drive device, 403 and 4
04 is the display panel after driving, and 405 and 406 are display images 105 and 106 of the object after driving the display panel.

When the outputs of the eyeball position detecting sensors 108 and 109 are input to the eyeball position calculating circuit 116, the amount of deviation of the eyeball position of the observer is calculated and output. Display panel control circuit
In 402, the image display panel 1 is adjusted according to the amount of displacement of the eyeball position.
A signal for driving 01 and 102 to a desired position is output.
This operation will be described with reference to FIGS. 2 and 5.

It is assumed that the position of the eyeball of the observer is the position shown in FIG. As described in the first embodiment, the eyeball position calculation circuit 116 outputs d (x, y) for each of the left and right eyes. In the display panel control circuit 402, d (x,
The signal for driving the display panel is output based on y). For example, d (x, y) is changed proportionally, and using the constant β,
A signal for moving the display panel by β · d (x, y) is output. Based on this signal, the display panel driving devices 400 and 4
01 drives the display panel. In FIG. 5, reference numeral 500 is a left-eye display panel, 501 is a right-eye display panel, 502 is an input image from the left-eye image input terminal 118, 503 is an input image from the right-eye image input terminal 117, 504 and Reference numeral 505 is an image displayed on the left-eye and right-eye display panels after driving, and 506 and 507 are images displayed on the left-eye and right-eye display panels.

Display panel drive devices 400 and 4 shown in FIG.
01 is the output of the display panel control circuit 402, that is, β · d
The image display panels 101 and 102 are moved by (x, y). Explaining this situation, when the observer A observes, the observer A
The eyeball positions of the images are 103 and 104, which are the desired positions, so the images 105 displayed on the image display panels 101 and 102 are
By and 106, the object 107 can be observed at the position indicated by the solid line. On the other hand, when the observer B observes, since the eyeball positions of the observer B are 110 and 111, the object 112 is observed at the position of the broken line by the image display panels 101 and 102. You will observe the object at different positions.

However, in the display panel control circuit 402, the image display panels 101 and 102 are displaced by β · d (x, y) by moving the display panel driving devices 400 and 401, and 403
And the display image of the object as it moves to the position indicated by 404 1
The images 05 and 106 are displayed at the positions 405 and 406, so that the observer B can observe the object at the position 115, and the observer A can observe the object in the same direction as the observer A observes. it can.

[0030]

As described above, the eyeglass-type image display device of the present invention detects the eyeball position of the observer by the eyeball position detection sensor and the eyeball position calculation circuit, and displays an image corresponding to the eyeball position of the observer. By presenting, it is possible to obtain a good three-dimensional image without being affected by wearing deviation at the time of wearing and individual differences.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of an eyeglass-type image display device according to a first embodiment of the present invention.

FIG. 2 is an output example diagram of an eyeball position detection sensor of FIG.

FIG. 3 is a diagram showing a state of image delay in FIG. 1.

FIG. 4 is a block diagram showing a configuration of an eyeglass-type image display device according to a second embodiment of the present invention.

5 is an explanatory diagram of driving the display device of FIG. 4. FIG.

FIG. 6 is a configuration diagram of a conventional eyeglass-type image display device.

[Explanation of symbols]

100 ... Image display part of eyeglass type image display device, 101, 102 ...
Image display panels for left eye and right eye, 103, 104 ... Left eye, right eye (eyeball) of observer A, 105, 106, 113, 114 ... Display image, 107 ... Object observed by observer A, 108,109 ... Eyeball position detection sensors for left eye and right eye, 110, 111 ... Left eye, right eye (eyeball) of observer B, 112, 115 ... Object observed by observer B, 116 ... Eyeball position Operation circuit, 117, 118 ... Image input terminal, 119, 120 ... Variable delay circuit, 121 ... Delay amount control circuit, 122 ... Signal generator, 123, 124 ... Left eye,
Right eye changeover switch, 125 ... switch control circuit, 400, 401 ... display panel drive device, 402 ... display panel control circuit.

Claims (3)

[Claims] 1. A display device for displaying an image on both eyes of an observer, an eyeball position detecting sensor for detecting an eyeball position of the observer, and eyeball position information of both eyes of the observer from the output of the eyeball position detecting sensor. And an image input terminal for inputting a display image, an image input terminal for inputting a display image, and the image input based on the output of the eye position calculation circuit. An eyeglass-type image display device, comprising: an image position conversion circuit that moves an image position of a terminal. 2. The image position conversion circuit includes a variable delay circuit that delays an input signal from the image input terminal based on a horizontal synchronizing signal, and a delay amount of the variable delay circuit based on an output of the eyeball position calculation circuit. A delay amount control circuit for controlling, a signal generator that outputs a black level video signal, and an output of the eyeball position detection circuit, and a constant level signal from the output of the variable delay circuit and the signal generator. The eyeglass-type image display device according to claim 1, further comprising: a switch circuit for switching the switch circuit and the display device for displaying an output of the switch circuit. 3. A display device for displaying an image on both eyes of an observer, an eyeball position detecting sensor for detecting an eyeball position of the observer, and an eyeball position of the observer calculated from an output of the eyeball position detecting sensor, An eyeball position calculation circuit that outputs the amount of deviation between the central part of the display device and the observer's eyeball position, an image input terminal that inputs a display image, a device that drives the display device, and an eyeball position calculation circuit. A spectacle-type image display device, comprising: a display device control circuit that controls a device that drives the display device based on an output.