JP7316615B2 - Multi-view stereoscopic aerial image display device and its method - Google Patents

Description

The present invention relates to a multi-view stereoscopic aerial image display device and method.

For example, Non-Patent Document 1 discloses a technique of forming an image of an object displayed on a display in the air by a lens and displaying the object as an aerial image floating in the air.

Tatsuya Okawa, 2 others, "Proposal of a Symmetrical Optical System for Displaying an Aerial Image Larger than an Imaging Device", Proceedings of the 23rd Annual Conference of the Virtual Reality Society of Japan, September 2018

However, in the technique disclosed in Non-Patent Document 1, since the image displayed on the display is formed in the air, there is no parallax in the aerial image, and only a two-dimensional aerial image can be presented. Therefore, if the presentation of the depth cue is insufficient, or if it is desired to present the three-dimensional effect of the subject, it is not possible to present a sufficient realism.

In order to realize binocular parallax, a method of using a naked-eye 3D display such as an integral display or a lenticular lens for the display is conceivable. However, the use of these special displays and special lenses poses a problem that the system configuration is complicated and the cost is high.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a multi-viewpoint stereoscopic aerial image display device and method capable of displaying a stereoscopic aerial image having binocular parallax at low cost. .

A multi-viewpoint stereoscopic aerial image display device according to an aspect of the present invention comprises: a display unit for displaying at least three viewpoint images having different parallaxes in a horizontal direction in a staggered manner in front and rear two stages on a plane; A second display having a focal length f1 and a height equal to the focal length _f1 arranged vertically _from the front of the viewpoint image in the latter stage and between the viewpoint images in the front and rear two stages of the display unit. 1 convex lens, a first plane mirror fixed at an angle of 45 degrees between the upper end of the first convex lens and the end of the display unit in the depth direction, and the first plane mirror and the first convex lens interposed therebetween. and a plurality of second half mirrors having a diameter equal to the width of the viewpoint image displayed on the display unit across the half mirror and having a focal length of _f2 arranged parallel to the viewpoint image. a convex lens; a second plane mirror arranged opposite to the viewpoint image of the second convex lens and facing the viewpoint image; a plurality of optical filters having a light transmittance of 100% at a position corresponding to the central portion and linearly decreasing toward the outer peripheral portion; ₁ and a focal length _f2 , and a third convex lens having a focal length _f2 having a diameter that covers the range of light arriving after being transmitted and reflected by the half mirror; , observing an aerial image having binocular parallax through the third convex lens.

Further, a multi-viewpoint stereoscopic aerial image display method according to an aspect of the present invention is a multi-viewpoint stereoscopic aerial image display method performed by the above-described multi-viewpoint stereoscopic aerial image display device, wherein the display unit has different parallaxes in the horizontal direction. a display step of staggering and displaying at least three of said viewpoint images having a binocular parallax on a plane on a plane; and a multi-viewpoint stereoscopic aerial image observation step.

According to the present invention, a multi-viewpoint aerial image having binocular parallax can be displayed at low cost.

1 is a plan view schematically showing a configuration example of a multi-viewpoint stereoscopic aerial image display device according to a first embodiment of the present invention; FIG. FIG. 2 is a diagram schematically showing a configuration example of the multi-viewpoint stereoscopic aerial image display device shown in FIG. 1 viewed from the side; FIG. 10 is a plan view schematically showing a configuration example of part including a display unit of a multi-viewpoint stereoscopic aerial image display device according to a second embodiment of the present invention; 2 is a flowchart showing a processing procedure of a multi-viewpoint stereoscopic aerial image display method performed by the multi-viewpoint stereoscopic aerial image display device shown in FIG. 1;

An embodiment of the present invention will be described below with reference to the drawings. The same reference numerals are given to the same items in multiple drawings, and the description will not be repeated.

[First Embodiment]
FIG. 1 is a plan view schematically showing a configuration example of a multi-viewpoint stereoscopic aerial image display device according to a first embodiment of the present invention. In FIG. 1, the top is defined as the x (horizontal) direction, the left is defined as the y (back and forth) direction, and the front is defined as the z (height) direction.

A multi-viewpoint stereoscopic aerial image display device 100 shown in FIG. 1 is a device that projects a multi-viewpoint stereoscopic aerial image having motion parallax and binocular parallax without using a special component such as an integral display or a lenticular lens. A multi-viewpoint stereoscopic aerial image display device 100 includes a display unit 10, a first convex lens 20, a first plane mirror 30 (not shown in FIG. 1), a half mirror 40 (not shown in FIG. 1), a plurality of second convex lenses 50, a second A plane mirror 70 (not shown in FIG. 1), a plurality of optical filters 60 (only one is shown in FIG. 1), and a third convex lens 80 are provided. Observer H observes a multi-viewpoint stereoscopic aerial image having binocular parallax through the third convex lens 80 .

FIG. 2 is a diagram schematically showing a configuration example of the multi-viewpoint stereoscopic aerial image display device 100 shown in FIG. 1 viewed from the side. The first plane mirror 30, the half mirror 40, and the second plane mirror 70, which are omitted in FIG. 1, are shown.

(composition)
The configuration of the multi-viewpoint stereoscopic aerial image display device 100 will be described with reference to FIGS. 1 and 2. FIG.

The display unit 10 displays at least three viewpoint images having different parallaxes in the horizontal direction by alternately arranging them in front and rear two stages on a plane. The display unit 10 may be configured using, for example, the display of the mobile terminal as it is. Of course, for example, an organic EL panel or a liquid crystal panel may be used to form a dedicated display unit 10 .

The three viewpoint videos are a viewpoint video 11 indicated by a square B, a viewpoint video 12 indicated by a square A, and a viewpoint video 13 indicated by a square C on the display unit 10 . The viewpoint image 11 is an image obtained by photographing an object (not shown) to be displayed from the front. The viewpoint image 12 is an image of the object photographed from the left. The viewpoint image 13 is an image of the object photographed from the right direction.

Each of the viewpoint images 11 to 13 is an image shot so that the images overlap each other. That is, when the line of sight is moved from the front left to the front right of the object, the viewpoint image changes in the order of viewpoint image 12 →viewpoint image 11 →viewpoint image 13 .

The viewpoint images 11 to 13 are arranged alternately in front and rear two stages and displayed. As shown in FIG. 2, the viewpoint image 12 seen from the left is the front left side (front left) on the xy plane of the display unit 10, and the viewpoint image 13 seen from the right is the front right side (front left) on the same xy plane. front right), and the viewpoint images 11 seen from the front are arranged and displayed in the center of the back of the same xy plane (rear center).

The first convex lens 20 has _a focal length of f1 and is arranged vertically from the center of the front and rear two stages of the display unit 10 in front of the rear viewpoint image 11 in the front and rear two stages and the focal length f. A lens with a height equal to _one . The first convex lens 20 is a common convex lens.

As shown in FIG. 2, the first plane mirror 30 is fixed at an angle of 45 degrees between the upper end of the first convex lens 20 and the rear end of the display unit 10 in the front-rear direction. The notation of the structure for fixing the first plane mirror 30 is omitted. The fixing structure is common and many are conceivable.

The half mirror 40 is arranged symmetrically with the first plane mirror 30 with the first convex lens 20 interposed therebetween. The half mirror 40 can be fixed with the same structure as the first plane mirror 30 .

The plurality of second convex lenses 50 and 51 have diameters corresponding to the widths of the viewpoint images 12 and 13 displayed on the display unit 10 with the half mirror 40 interposed therebetween, and are arranged parallel to the viewpoint images 12 and 13 . The second convex lens 50 is horizontally disposed separated from the viewpoint image 12 by the diameter of the first convex lens 20 with the viewpoint image 12 and the half mirror 40 interposed therebetween. The second convex lens 51 is arranged in the same manner as the second convex lens 50 with the viewpoint image 13 and the half mirror 40 interposed therebetween. The focal length of the second convex lenses 50 and 51 is _f2 .

The second plane mirror 70 is arranged on the side opposite to the viewpoint images 12 and 13 of the second convex lenses 50 and 51 so as to face the viewpoint images 12 and 13 . The second plane mirror 70 may be composed of two separate mirrors corresponding to each of the viewpoint images 12 and 13, or may be composed of one mirror. In this embodiment, the second plane mirror 70 is composed of, for example, one mirror.

The optical filter 60 is arranged in front of the first convex lens 20 and the second convex lenses 50 and 51. The light transmittance at the position corresponding to the center of each lens is 100%, and the transmittance is linear toward the outer periphery. is a filter that drops to In the case of this embodiment, three lenses are provided corresponding to each lens.

The optical filter 60 may be formed on each surface of the first convex lens 20 and the second convex lenses 50 and 51 by vapor deposition, sputtering, or the like. In that case, the optical filter 60 need not be provided as a discrete component.

The third convex lens 80 is arranged in front of the first convex lens 20 and in front of the first convex lens 20 by the sum of the focal lengths _f1 and _f2 , and covers the range of light transmitted and reflected by the half mirror 40. is a lens of focal length f ₂ with a diameter of . The third convex lens 80 is a common convex lens.

The distance between the third convex lens 80 and the first convex lens 20 must be focal length f ₁ +focal length f ₂ , but the centers of the lenses do not need to coincide. The third convex lens 80 may be arranged so as to cover the range of light transmitted through and reflected from the half mirror 40 .

As described above, the multi-viewpoint stereoscopic aerial image display device 100 according to the present embodiment has the display unit 10 that displays at least three viewpoint images having different parallaxes in the horizontal direction by alternately arranging them in front and back two stages on a plane. and the focal length f ₁ that is arranged vertically from between the two front and rear viewpoint images 11 and 12 on the display unit 10 in front of _the rear viewpoint image 11 in the two front and rear rows. a first plane mirror 30 fixed at an angle of 45 degrees between the upper end of the first convex lens 20 and the end of the display unit 10 in the depth direction; A half mirror 40 is arranged symmetrically with the mirror 30 and the first convex lens 20 interposed therebetween, and the width of the viewpoint images 12 and 13 displayed on the display unit 10 with the half mirror 40 interposed therebetween is defined as a diameter. A plurality of second convex lenses 50 and 51 having a focal length of _f2 arranged in parallel, and a second convex lens arranged opposite to the viewpoint images 12 and 13 of the second convex lenses 50 and 51 so as to face the viewpoint images 12 and 13 . The transmittance of light at the positions corresponding to the centers of the two plane mirrors 70, the first convex lens 20, and the second convex lenses 50 and 51 is 100%, and the transmittance is 100% toward the outer periphery. and a plurality of optical filters 60 that linearly decrease through the half mirror 40, and are arranged in front of the first convex lens 20 at a distance of the sum of the focal length _f1 and the focal length _f2 from the first convex lens 20, and pass through the half mirror 40. and a third convex lens 80 of focal length _f2 with a diameter covering the range of incoming reflected light.

(action)
The light of the viewpoint image 11 displayed in the rear center (y direction) of the xy plane of the display unit 10 is reflected by the first plane mirror 30, passes through the first convex lens 20, passes through the half mirror 40, It passes through the third convex lens 80 . The light transmitted through the third convex lens 80 reaches the observer H's eyes.

Further, the lights of the viewpoint images 12 and 13 displayed in front of the xy plane (-y direction) of the display unit 10 pass through the half mirror 40, pass through the second convex lenses 50 and 51, and pass through the second convex lenses 50 and 51. Reflected by the two-plane mirror 70 . The light reflected by the second plane mirror 70 is reflected by the half mirror 40 and enters the third convex lens 80 .

The light of the viewpoint image 12 passes through the second convex lens 50 twice. Therefore, assuming that the focal length f ₂ is twice the focal length f ₁ (2f ₁ ), the light of the viewpoint image 12 has the same focal length f ₁ as that of the viewpoint image 11 . In other words, the viewpoint images 11 and 12 displayed in two stages in the horizontal direction are formed at the position of the focal length _f1 from the first convex lens 20 . The same applies to the viewpoint video 13 displayed side by side with the viewpoint video 12 .

However, the brightness of the viewpoint images 12 and 13 is half that of the viewpoint image 11 because the light is transmitted and reflected once by the half mirror 40 and is incident on the third convex lens 80 . This brightness difference can be easily matched by adjusting the brightness of the display unit 10 .

An observer H positioned on the opposite side of the first convex lens 20 across the third convex lens 80 sees the viewpoint images 11 to 13 through the third convex lens. Then, the observer H can observe the virtual images 10A, 10B, and 10C of the viewpoint images 11 to 13 at the position of the focal length _f1 behind the first convex lens 20. FIG.

The virtual images 10A to 10C can be observed as stereoscopic aerial images having motion parallax and binocular parallax. This is because each of the viewpoint videos 11 to 13, which are the bases of the virtual images 10A to 10C, has a parallax in the horizontal direction.

As shown in FIG. 1, the focus _F20 of the first convex lens 20 and the focus F80 of the third convex lens ₈₀ coincide. Light of the viewpoint image 11 passing through the focal point F ₈₀ is incident on the third convex lens 80 . The light of the viewpoint image 11 that has passed through the focal point F ₈₀ passes through the third convex lens 80 and becomes light rays α and β parallel to the lens axis 80 j of the third convex lens 80 .

On the other hand, the other rays γ and δ forming the viewpoint image 11 at the position of the focal length _f1 from the first convex lens 20 are refracted by the third convex lens 80 so as to approach the lens axis 80j. A light ray passing through the lens center of the third convex lens 80, which is omitted for the sake of complicating the notation of the drawing, travels straight. The number of these rays is innumerable.

These countless light beams intersect at a distance of the focal length _f2 of the third convex lens 80 on the observer H side. As a result, an aerial image 90 having a size expressed by f ₂ /f ₁ is formed at that position.

An observer H observes an aerial image 90 at a distance d from the third convex lens 80 as shown in the following equation.

Since the aerial image 90B by the viewpoint image 11 shown in FIG. 1 is an aerial image by light that has passed through the filter 60 arranged in front of the first convex lens 20, the front is the brightest. When the observer H moves the viewpoint left and right, the aerial image 90B darkens due to the action of the optical filter 60 . This state is schematically represented by a dashed-dotted triangle.

The same applies to an aerial image 90A based on another viewpoint image 12 and an aerial image 90C based on another viewpoint image 13. FIG. The viewpoint video 12 and the viewpoint video 11 overlap in half in the horizontal direction (x direction). Also, the viewpoint video 13 and the viewpoint video 11 overlap in half in the horizontal direction (x direction).

In this way, the aerial images 90A, 90B, and 90C that overlap in the horizontal direction are multi-viewpoints having a plurality of motion parallaxes and binocular parallaxes corresponding to different viewpoints due to a visual mechanism called linear blending for the observer H. It will be perceived as a stereoscopic aerial image.

[Second embodiment]
FIG. 3 is a plan view schematically showing a configuration example of part including the display unit 10 of the multi-viewpoint stereoscopic aerial image display device according to the second embodiment of the present invention.

The display unit 10 shown in FIG. 3 differs from the above embodiment in that seven viewpoint images are displayed. The effects of the multi-viewpoint stereoscopic aerial image display device including the display unit 10 shown in FIG. 3 are the same as those of the above embodiment.

Thus, the number of viewpoint videos is not limited to three. Three or more viewpoint images may be used.

(Multi-viewpoint stereoscopic aerial image display method)
FIG. 4 is a flow chart showing the processing procedure of the multi-viewpoint stereoscopic aerial image display method performed by the multi-viewpoint stereoscopic aerial image display device 100 described above.

The multi-viewpoint stereoscopic aerial image display method according to the present embodiment is a stereoscopic aerial image display method performed by the multi-viewpoint stereoscopic aerial image display device 100. The multi-viewpoint stereoscopic aerial image display device 100 has different parallaxes in the horizontal direction. A display unit 10 that displays at least three viewpoint images 11 to 13 alternately arranged in front and rear two stages on a plane, and a display unit 10 in front of the viewpoint images 11 in the rear stage of the front and rear two stages and in the front and rear two stages of the display unit 10. A first convex lens 20 having a focal length _f1 and a height equal to the focal length _f1 , and the depth between the upper end of the first convex lens 20 and the display unit 10. A first plane mirror 30 fixed at an angle of 45 degrees between the ends of the direction, a half mirror 40 arranged symmetrically with the first plane mirror 30 and the first convex lens 20 interposed therebetween, and a half mirror 40 A plurality of second convex lenses 50 and 51 having a focal length of _f2 arranged parallel to the viewpoint images 12 and 13, and the second convex lens 50, having a diameter corresponding to the width of the viewpoint images 12 and 13 displayed on the display unit 10. , 51 on the opposite side of the viewpoint images 12 and 13 and facing the viewpoint images 12 and 13; a plurality of optical filters 60 having a light transmittance of 100% at a position corresponding to the central portion of the lens and the transmittance linearly decreasing toward the outer peripheral portion; a _third convex lens 80 having a focal length of _f2 and having a diameter that covers the range of light arriving after being transmitted and reflected by the half mirror 40 and disposed in front of the lens ₂₀ by the sum of the focal lengths f1 and f2; The display unit 10 has a display step (step S1) for displaying at least three viewpoint images 11 to 13 having different parallaxes in the horizontal direction, arranged alternately in front and back two stages on a plane, and the observer H , and a multi-viewpoint stereoscopic aerial image observation step (step S2) of observing a multi-viewpoint aerial image having binocular parallax through a third convex lens. As a result, a multi-viewpoint aerial image having binocular parallax can be displayed at low cost.

As described above, according to the stereoscopic aerial image display device 100 and the method thereof according to the present embodiment, a multi-viewpoint stereoscopic display having motion parallax and binocular parallax can be achieved with a simple and low-cost configuration combining general convex lenses. An aerial image can be displayed.

Note that the position where the multi-viewpoint stereoscopic aerial image can be observed is not limited to the pinpoint position of the distance d. Within the focal depth range of the first convex lens 20, the second convex lenses 50 and 51, and the third convex lens 80, a multi-viewpoint stereoscopic aerial image can be observed with a width in the front-rear (y) direction.

The present invention is not limited to the above-described embodiments, and modifications can be made within the scope of the gist of the present invention. For example, the number of viewpoint videos is not limited to three. Also, the third convex lens 80 may be composed of a large-diameter plano-convex condenser lens.

Thus, the present invention naturally includes various embodiments and the like not described here. Therefore, the technical scope of the present invention is defined only by the matters specified in the scope of claims that are valid from the above description.

10: Display unit 20: First convex lens 30: First plane mirror 40: Half mirrors 50, 51: Second convex lens 60: Optical filter 70: Second plane mirror 80: Third convex lens 90: Aerial image 100: Multi-viewpoint stereo Aerial image display device H: Observer

Claims (3)

a display unit that displays at least three viewpoint images having different parallaxes in the horizontal direction by alternately arranging them in front and back two stages on a plane;
A focal length of f1 and a height equal to the focal length _f1 , which is vertically erected from between the front _and rear two stages of the viewpoint images on the display unit in front of the rear two stages of the viewpoint images. a first convex lens having
a first plane mirror fixed at an angle of 45 degrees between the upper end of the first convex lens and the end of the display unit in the depth direction;
a half mirror arranged symmetrically across the first plane mirror and the first convex lens;
a plurality of second convex lenses having a diameter corresponding to the width of the viewpoint image displayed on the display unit with the half mirror interposed therebetween and having a focal length of _f2 arranged parallel to the viewpoint image;
a second plane mirror arranged opposite to the viewpoint image of the second convex lens and facing the viewpoint image;
A plurality of lights arranged in front of the first convex lens and the second convex lens, the transmittance of which is 100% at the position corresponding to the center of each lens and the transmittance decreases linearly toward the outer periphery. a filter;
It is arranged in front of the first convex lens, in front of the first convex lens by the sum of the focal length _f1 and the focal length _f2 , and has a diameter that covers the range of light arriving after being transmitted and reflected by the half mirror and a third convex lens having a focal length f ₂ with
A multi-viewpoint stereoscopic aerial image display device in which an observer observes an aerial image having binocular parallax formed through the third convex lens. The observer observes the aerial image at the following distance d from the third convex lens
2. The multi-viewpoint stereoscopic aerial image display device according to claim 1. A multi-viewpoint stereoscopic aerial image display method performed by a multi-viewpoint stereoscopic aerial image display device, comprising:
The multi-viewpoint stereoscopic aerial image display device comprises:
a display unit that displays at least three viewpoint images having different parallaxes in the horizontal direction by alternately arranging them in front and back two stages on a plane;
A focal length of f1 and a height equal to the focal length _f1 , which is vertically erected from between the front _and rear two stages of the viewpoint images on the display unit in front of the rear two stages of the viewpoint images. a first convex lens having
a first plane mirror fixed at an angle of 45 degrees between the upper end of the first convex lens and the end of the display unit in the depth direction;
a half mirror arranged symmetrically across the first plane mirror and the first convex lens;
a plurality of second convex lenses having a diameter corresponding to the width of the viewpoint image displayed on the display unit with the half mirror interposed therebetween and having a focal length of _f2 arranged parallel to the viewpoint image;
a second plane mirror arranged opposite to the viewpoint image of the second convex lens and facing the viewpoint image;
A plurality of lights arranged in front of the first convex lens and the second convex lens, the transmittance of which is 100% at the position corresponding to the center of each lens and the transmittance decreases linearly toward the outer periphery. a filter;
It is arranged in front of the first convex lens, in front of the first convex lens by the sum of the focal length _f1 and the focal length _f2 , and has a diameter that covers the range of light arriving after being transmitted and reflected by the half mirror and a third convex lens having a focal length f ₂ with
a display step in which the display unit displays at least three of the viewpoint images having different parallaxes in a horizontal direction by alternately arranging them in the front and rear two stages on a plane;
and a multi-viewpoint stereoscopic aerial image observation step in which an observer observes a multi-viewpoint aerial image having binocular parallax formed through the third convex lens .

Images