CN108051917A - Augmented reality display optical system and augmented reality display methods - Google Patents

Abstract

The invention provides an augmented reality display optical system and an augmented reality display method. The augmented reality display optical system includes a light source module, a light guide module, a transparent transmissive spatial light modulator and an electrically controlled optical phase modulation module with the light modulation function of converting plane waves into spherical waves. The light guide module includes horizontal light guides and vertical light guides. The light source module is located on the incident light path of the vertical light guide, the horizontal light guide is located on the outgoing light path of the vertical light guide, the spatial light modulator is located on the outgoing light path of the horizontal light guide, and the electronically controlled optical phase modulation module is located on the outgoing light path of the spatial light modulator. The spatial light modulator of the augmented reality display optical system does not need to be placed at the near focal plane of the electronically controlled optical phase modulation module, and has a compact structure, small size, and light weight; and based on the principle of retinal imaging, it can Clear imaging, short-sighted or far-sighted users can clearly receive the image information to be displayed without wearing corrective glasses.

Description

Augmented reality display optical system and augmented reality display method

technical field

The present invention relates to the technical field of optical display, in particular to an augmented reality display optical system and an augmented reality display method.

Background technique

At present, the augmented reality display optical system generally places the display screen at the focal plane position of the focusing lens (such as a spherical lens or an aspheric lens or a Fresnel lens), and uses a semi-reflective and semi-transparent plane mirror, and the in-focus point objects pass through the focusing lens The resulting enlarged virtual image is transmitted to the human eye through the semi-reflective and semi-transparent plane mirror, and the enlarged and upright virtual image of the display screen is projected in front of the user's eyes, while the external ambient light is received by the human eye through the semi-reflective and semi-transparent plane mirror, realizing the real world Enhanced display. The augmented reality display device adopting this method needs to place the display screen at the near focal plane of the focusing lens, which has a large volume and heavy weight and poor wearing comfort. Moreover, for myopia or hyperopia users need to wear myopia or hyperopia correction glasses to see the display content of the augmented reality display device clearly, or need to add additional focusing lenses to the augmented reality display device so that myopia or hyperopia users do not wear myopia or hyperopia glasses. The hyperopia correction glasses can also clearly see the display content of the augmented reality display device.

Contents of the invention

In view of this, the object of the present invention is to provide an augmented reality display optical system and an augmented reality display method that are small in size and light in weight and enable nearsighted or hyperopic users to see the displayed content clearly without wearing correction glasses, so as to solve the above problems .

To achieve the above object, the present invention provides the following technical solutions:

A preferred embodiment of the present invention provides an augmented reality display optical system, including: a light source module, a light guide module, a spatial light modulator, and an electronically controlled optical phase modulation module with the light modulation function of converting a plane wave into a spherical wave. The light guide module includes a horizontal light guide and a vertical light guide, and the spatial light modulator is transparent and transmissive;

The light source module is located on the incident light path of the vertical light guide, the horizontal light guide is located on the outgoing light path of the vertical light guide, the spatial light modulator is located on the outgoing light path of the horizontal light guide, and the electrically controlled optical The phase modulation module is located on the outgoing optical path of the spatial light modulator;

When the electronically controlled optical phase modulation module and the spatial light modulator are in the working state, the collimated or near-collimated illumination beam provided by the light source module passes through the vertical light guide and the horizontal light guide respectively for vertical and After transmission and expansion in the horizontal direction, a collimated wide beam or a near-collimated wide beam is formed, and the spatial light modulator performs pixel-level modulation to obtain collimated thin beams or near-collimated thin beams corresponding to the pixel points of the image to be displayed, and the electro-optical phase modulation module Straight thin beams are converged and directly imaged on the retina of the human eye;

When the electro-optical phase modulation module and the spatial light modulator are in a non-working state, the real ambient light enters the human eye after passing through the horizontal light guide, the spatial light modulator and the electro-optic phase modulation module The image is received on the retina.

Optionally, the light source module includes a light emitting unit, a light collimator, a light beam combiner, a coupling fiber, and a collimator lens group.

Optionally, the light source module further includes a speckle dissipating device.

Optionally, the horizontal light guide includes at least two inclined prisms, or includes at least two transparent and reflective plane mirrors arranged obliquely.

Optionally, the horizontal light guide is composed of a reflective element and a diffractive element, and the diffractive element is located between the reflective element and the spatial light modulator.

Optionally, the horizontal light guide further includes a transmissive and reflective layer, and the transmissive and reflective layer is located between the reflective element and the diffractive element.

Optionally, the horizontal light guide is composed of a base and a diffractive element, and the side of the base away from the diffractive element plays a reflective role.

Optionally, the augmented reality display optical system further includes an angle-controlled microstructure element that narrows the outgoing angle of the light beam.

Another preferred embodiment of the present invention provides an augmented reality display method, which is applied to the aforementioned augmented reality display optical system, and the method includes:

Perform chromatic aberration pre-correction for each frame of image information to be displayed;

Dividing the preset display time of one frame of the image to be displayed into a first time period and a second time period;

In the first time period, sending a frame of the image information to be displayed to the spatial light modulator, and controlling the electro-optic phase modulation module, the light source module and the spatial light modulator to be in a working state;

During the second period of time, the electro-optic phase modulation module and the spatial light modulator are controlled to be in a non-working state.

Another preferred embodiment of the present invention provides an augmented reality display method, which is applied to the aforementioned augmented reality display optical system, and the method includes:

Dividing the preset display time of one frame of image to be displayed into a first time period and a second time period;

pre-processing a preset frame of images to be displayed into multiple frames of monochrome images corresponding to the light beams of various wavelengths output by the light source module;

Divide the first time period into a plurality of sub-time periods, each sub-time period controls the light source module to output a light beam of a wavelength, and sends a frame of monochromatic images corresponding to the light beam of this wavelength to the spatial light A modulator, controlling the electronically controlled optical phase modulation module to be in a working state, so that the converging points of the converging light beams converged by the electronically controlled optical phase modulation module in each sub-time period are at the same position;

During the second period of time, the electro-optic phase modulation module and the spatial light modulator are controlled to be in a non-working state.

The augmented reality display optical system provided by the present invention makes the spatial light modulator (display screen) no need to be placed on the electric Controlling the near focal plane of the optical phase modulation module (focusing lens), the structure is more compact, the volume is smaller, the weight is lighter, and it is more comfortable to wear; and based on the principle of retinal imaging, it can clearly image in the entire display field of view. For myopia or hyperopia users, they can clearly receive the image information to be displayed without wearing myopia or hyperopia correction glasses.

The augmented reality display method provided by the present invention is applied to the aforementioned augmented reality display optical system, thus having similar beneficial effects.

Description of drawings

In order to illustrate the technical solutions of the embodiments of the present invention more clearly, the following will briefly introduce the drawings used in the embodiments. It should be understood that the following drawings only show some embodiments of the present invention, and therefore should not be regarded as limiting the scope. For those of ordinary skill in the art, they can also make From these drawings other related drawings are obtained.

Fig. 1 is a schematic structural diagram of an augmented reality display optical system provided by a preferred embodiment of the present invention.

Fig. 2 is a schematic structural diagram of a light source module provided by a preferred embodiment of the present invention.

Fig. 3 is a schematic structural diagram of a horizontal light guide provided by a preferred embodiment of the present invention.

Fig. 4 is a schematic structural diagram of another horizontal light guide provided by a preferred embodiment of the present invention.

FIG. 5 is a schematic diagram of the transmission and expansion of light by the horizontal light guide shown in FIG. 4 .

Fig. 6 is a schematic structural diagram of another horizontal light guide provided by a preferred embodiment of the present invention.

FIG. 7 is a schematic diagram of the transmission and expansion of light by the horizontal light guide shown in FIG. 6 .

Fig. 8 is a schematic structural diagram of another horizontal light guide provided by a preferred embodiment of the present invention.

FIG. 9 is a structural relationship diagram between a display area to display an image and the light guide module shown in FIG. 1 .

FIG. 10 is a schematic diagram of the size of a non-rectangular image display area to be displayed.

Fig. 11 is a comparison diagram between an augmented reality display optical system provided by a preferred embodiment of the present invention and a traditional augmented reality display optical system.

Figure 12 is a schematic diagram of the chromatic aberration in the virtual image when the same voltage or current is applied to the electro-optical phase modulation module.

Fig. 13 is a schematic structural diagram of another augmented reality display optical system provided by a preferred embodiment of the present invention.

Fig. 14 is a schematic structural diagram of another augmented reality display optical system provided by a preferred embodiment of the present invention.

Fig. 15 is a schematic structural diagram of another augmented reality display optical system provided by a preferred embodiment of the present invention.

FIG. 16 is a schematic diagram of the optical path of the augmented reality display optical system shown in FIG. 15 for imaging virtual images of human eyes.

Fig. 17 is a flowchart of an augmented reality display method provided by a preferred embodiment of the present invention.

Fig. 18 is a flowchart of another augmented reality display method provided by a preferred embodiment of the present invention.

Icons: 1-augmented reality display optical system; 10-light source module; 20-light guide module; 30-spatial light modulator; 40-electrically controlled optical phase modulation module; 11-light emitting unit; 12-light collimation 13-light beam combiner; 14-coupling optical fiber; 15-collimating mirror group; 16-dissipation speckle device; 21-vertical light guide; 22-horizontal light guide; 221-tilted prism; - reflective element; 224 - diffractive element; 225 - transparent and reflective layer; 226 - substrate; 50 - angle control microstructure element; 60 - infrared emitting device; 70 - infrared camera module; 80 - infrared diffractive element

Detailed ways

The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the drawings in the embodiments of the present invention. Apparently, the described embodiments are only some of the embodiments of the present invention, not all of them. The components of the embodiments of the invention generally described and illustrated in the figures herein may be arranged and designed in a variety of different configurations.

Accordingly, the following detailed description of the embodiments of the invention provided in the accompanying drawings is not intended to limit the scope of the claimed invention, but merely represents selected embodiments of the invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without making creative efforts belong to the protection scope of the present invention.

It should be noted that like numerals and letters denote similar items in the following figures, therefore, once an item is defined in one figure, it does not require further definition and explanation in subsequent figures. In the description of the present invention, the terms "first", "second", "third", "fourth" and so on are only used for distinguishing descriptions, and should not be interpreted as merely or implying relative importance.

Please refer to FIG. 1 , which is a schematic structural diagram of an augmented reality display optical system 1 provided by an embodiment of the present invention. As shown in FIG. 1 , the augmented reality display optical system 1 includes: a light source module 10 , a light guide module 20 , a spatial light modulator 30 and an electro-optical phase modulation module 40 .

The light source module 10 is located on the incident light path of the light guide module 20 and provides the light guide module 20 with collimated or near-collimated illumination beams. Optionally, please refer to FIG. 2 . In this embodiment, the light source module 10 includes a light emitting unit 11 , a light collimator 12 , a light beam combiner 13 , a coupling fiber 14 and a collimator lens group 15 . The light emitting unit 11 may adopt a laser light source, an LED light source, or the like. Optionally, in this embodiment, the light emitting unit 11 is an LD laser light source, such as a laser generating device. The laser emitting device may include a fast red laser emitting unit 11 , a green laser generating unit and a blue laser emitting unit 11 . In other embodiments, the color of each laser generating unit in the laser generating device can be set according to actual needs, so as to meet the needs of actual situations, and no limitation is made here. The optical collimator 12 can be an optical collimator lens in the known technology, which is used to reduce the divergence angle of the light beam emitted by the laser generating device. The light beam combiner 13 can be a light combining prism in the known technology, which will not be described in detail here. Coupling fiber 14 may be a multimode fiber or a single mode fiber. The input end of the coupling fiber 14 can be fused with a ball lens, which is used to increase the diameter of the laser beam that the coupling fiber 14 can couple, so that the combined beam after passing through the optical beam combiner 13 can be easily coupled into the coupling fiber 14 . The output end of the coupling fiber 14 can be processed into a tapered shape, which is used to reduce the beam waist radius of the outgoing beam at the output end and increase the numerical aperture of the outgoing beam, so that the coupling optical fiber 14 outputs a light beam with a small spot and a large exit angle. The collimating lens group 15 is used to collimate the light beam output by the coupling fiber 14 with a small spot and a large exit angle, so as to obtain a collimated light beam or a near-collimated light beam with better directivity. Usually, after passing through the collimator lens group 15, a collimated beam or a near-collimated beam with an outgoing angle in the range of 0°-0.5° can be obtained. In a specific implementation, the beam waist of the beam output by the coupling fiber 14 is set at or near the focal plane of the collimator lens group 15, so as to obtain a collimated beam or a near-collimated beam.

When the emitting unit is a laser light source, the light source module 10 may further include a speckle elimination device 16 . The speckle elimination device 16 interferes with the coherence characteristic of the laser beam by changing the instantaneous phase of the laser beam, thereby weakening the speckle effect existing in the laser beam, so that the energy distribution of the beam provided by the light source module 10 is more uniform. The speckle elimination device 16 can be a liquid crystal phase modulator or a vibrating phase plate in the known technology, which is not limited here.

The light guide module 20 includes a vertical light guide 21 and a horizontal light guide 22 . The vertical light guide 21 is used for vertically transmitting and expanding the light beam entering the vertical light guide 21 . The horizontal light guide 22 is used for horizontally transmitting and expanding the light beam entering the horizontal light guide 22 . The collimated or near-collimated beam output by the light source module 10 is expanded vertically and horizontally by the vertical light guide 21 and the horizontal light guide 22 respectively to form a collimated wide beam or a near-collimated wide beam.

The horizontal light guide 22 may include at least two inclined prisms 221, as shown in FIG. 1 . Alternatively, as shown in FIG. 3 , the horizontal light guide 22 may include at least two transmissive and reflective plane mirrors 222 arranged obliquely. Each permeable and reversible plane mirror 222 arranged obliquely can be fixed by some transparent mounts. Or the horizontal light guide 22 may include both an inclined prism 221 and an obliquely arranged transmissive and reflective plane mirror 222 .

The horizontal light guide 22 includes at least two inclined surfaces. When the real ambient light passes through the horizontal light guide 22, the inclined surface of the horizontal light guide 22 will affect the transmission of the real ambient light. Lots of talk. In order to solve the above problems, the horizontal light guide 22 can also be a structure as shown in FIG. 4 , FIG. 6 and FIG. 8 .

As shown in FIG. 4 , the horizontal light guide 22 may be composed of a reflective element 223 and a diffractive element 224 , and the diffractive element 224 is located between the reflective element 223 and the spatial light modulator 30 . FIG. 5 is a schematic diagram of the transmission and expansion of light by the horizontal light guide 22 shown in FIG. 4 . As shown in Figure 5, the light entering the horizontal light guide 22 is reflected by the reflective element 223 to the diffractive element 224, a part of the light is transmitted and diffracted by the diffractive element 224 into the spatial light modulator 30, and the other part of the light is reflected by the diffractive element 224 to the reflective element 223 , is reflected by the reflective element 223 to the diffractive element 224 again. Part of the light reflected by the reflective element 223 to the diffractive element 224 is transmitted and diffracted by the diffractive element 224 to enter the spatial light modulator 30 , and the other part is reflected by the diffractive element 224 to the reflective element 223 . By analogy, the light beam entering the horizontal light guide 22 is transmitted and expanded in the horizontal direction.

As shown in FIG. 6 , the horizontal light guide 22 further includes a transmissive and reflective layer 225 located between the reflective element 223 and the diffractive element 224 . FIG. 7 is a schematic diagram of the transmission and expansion of light by the horizontal light guide 22 shown in FIG. 6 . As shown in Figure 7, the light entering the horizontal light guide 22 is reflected by the reflective element 223 to the transmissive and reflective layer 225, a part of the light passes through the transmissive and reflective layer 225 and enters the diffractive element 224, and the other part of the light is transmitted by the transmissive and reflective layer 225. reflected to reflective element 223. The light entering the diffraction element 224 is transmitted and diffracted by the diffraction element 224 to enter the spatial light modulator 30 . After the light reflected by the transmissive and reflective layer 225 to the reflective element 223 is reflected by the reflective element 223 to the transmissive and reflective layer 225 again, part of the light passes through the transmissive and reflective layer 225 and enters the diffractive element 224, and the other part of the light is transmitted by the transmissive and reflective layer 225. The reflective layer 225 is reflective to the reflective element 223 . The light entering the diffraction element 224 is transmitted and diffracted by the diffraction element 224 to enter the spatial light modulator 30 . By analogy, the light beam entering the horizontal light guide 22 is transmitted and expanded in the horizontal direction.

As shown in FIG. 8 , the horizontal light guide 22 can also be composed of a base 226 and a diffractive element 224 . The diffraction element 224 may be a pattern with a diffraction function engraved on the side of the substrate 226 facing the spatial light modulator 30 . Or the diffraction element 224 is an element with a diffraction pattern etched on a transparent substrate, and the diffraction element 224 and the base 226 are optically bonded. At this time, the side of the base 226 away from the diffraction element 224 acts as a reflection, similar to the reflection element 223 in FIG. 4 . Since the principle of transmission and expansion of the light entering the horizontal light guide 22 is similar to that of FIG. 4 , no further description is given here.

Optionally, in the horizontal light guide 22 shown in FIG. 4 , FIG. 6 , and FIG. 8 , the exit optical axis of the diffraction element 224 and the optical axis of the spatial light modulator 30 are substantially coaxial or parallel, so that the electro-optical phase modulation Module 40 is easy to design. Substantially parallel or coaxial means nearly parallel or coaxial. When the exit optical axis of the diffractive element 224 and the optical axis of the spatial light modulator 30 have a small angle deviation within an acceptable range, they are also substantially parallel or coaxial.

The structure of the vertical light guide 21 may be the same as that of the horizontal light guide 22, but the placement methods are different. That is, the structure of the vertical light guide 21 can be as shown in FIG. 1, FIG. 2, FIG. 4, FIG. 6, and FIG. Since the real ambient light may not pass through the vertical light guide 21 when it enters the human eye, when the vertical light guide 21 is the structure shown in Fig. 1 and Fig. When , the image formed by the real environment in the human eye will not be cut into multiple channels.

When the horizontal light guide 22 and the vertical light guide 21 are the structure shown in Fig. 1 or Fig. 2, the number of the inclined prisms 221 or the obliquely arranged transmissible and reversible plane mirrors 222 included in the horizontal light guide 22 and the vertical light guide 21 are respectively preset. The size of the display area of the image to be displayed in the horizontal direction and the vertical direction, and the height of the horizontal light guide 22 and the vertical light guide 21 are determined. For example, as shown in FIG. 9 , the shape of the preset display area of the image to be displayed is a rectangle, the long side of which is a and the wide side is b. Wherein, the horizontal direction is defined as the long side direction of the rectangle, and the vertical direction is defined as the wide side direction of the rectangle. The height of the horizontal light guide 22 is h1, and the height of the vertical light guide 21 is h2. Then the number of the inclined prisms 221 that the horizontal light guide 22 includes or the transparent and reflective flat mirrors 222 that are arranged obliquely should not be less than a/h1, the number of the inclined prisms 221 that the vertical light guide 21 includes or the transparent and reversible flat mirrors 222 that are arranged obliquely The quantity should not be less than b/h2. The height of the vertical light guide 21 and the horizontal light guide 22 largely determines the size and volume of the augmented reality display optical system 1, the smaller the height of the vertical light guide 21 and the horizontal light guide 22, the larger the size and volume of the augmented reality display optical system 1. The smaller it is, the more oblique prisms 221 or obliquely arranged transmissive and reversible plane mirrors 222 are required, and the higher the requirements for manufacturing, processing, assembling and other processes. In actual implementation, the height of the vertical light guide 21 and the horizontal light guide 22 and the number of included inclined prisms 221 or obliquely arranged transmissive and reversible plane mirrors 222 can be comprehensively selected according to different focus points.

It should be noted that the preset display area of the image to be displayed is not limited to a rectangle, but may also be a circle, an ellipse or other shapes, as shown in FIG. 10 . For the case where the cross-sectional shape is non-rectangular, the above-mentioned dimensions in the vertical and horizontal directions refer to the long side a and the wide side b of the smallest rectangle that can completely envelop the cross-sectional shape.

Since the light guide module 20 is used to expand the beam aperture in the vertical and horizontal directions of the light beam output by the light source module 10, the light source module 10 does not need to output a collimated wide beam or a nearly collimated wide beam, so that the light source module The optical system structure of 10 is simpler. At the same time, as shown in FIG. 11, compared with the traditional augmented reality display optical system 1, the augmented reality display optical system 1 provided by the present invention does not need to place the spatial light modulator 30 (display screen) on the electronically controlled optical phase modulation module 40. (Focus lens) near the focal plane, so the structure is more compact, the volume is smaller, the weight is lighter, and the wearing comfort is improved. In FIG. 11 , 2 represents a traditional augmented reality display optical system 1 , A represents a display screen, and B represents a focusing lens.

Please refer to FIG. 1 again. The spatial light modulator 30 is used to modulate the light energy of the collimated wide beam or the near-collimated wide beam output by the light guide module 20 at the pixel level according to the information of the image to be displayed, so as to obtain A point corresponds to a collimated beamlet or a near-collimated beamlet. The spatial light modulator 30 is a transparent transmissive pixel-level light modulation device. When the light source module 10 outputs a single-wavelength light beam, the spatial light modulator 30 is mainly composed of a vertical polarizer, TFT glass, liquid crystal and a horizontal polarizer. When the light source module 10 outputs beams of multiple wavelengths (such as red, green, and blue wavelengths), the spatial light modulator 30 is mainly composed of vertical polarizers, TFT glass, liquid crystals, color filters and horizontal polarizers. Each pixel of the spatial light modulator 30 is composed of sub-pixels corresponding to each wavelength (for example, three sub-pixels of red, green, and blue), and the color filter includes a color filter corresponding to each wavelength (for example, includes Red, green, and blue color filters), respectively sample the combined beams of multiple (for example, three) wavelengths output by the light source module 10, and then perform color mixing to form a color display screen.

The electronically controlled optical phase modulation module 40 can be controlled by electric drive, so that it has or does not have the light modulation function of converting plane waves into spherical waves. For example, when a voltage or current is applied, it is in a working state and has a light modulation function that converts a plane wave into a spherical wave. When the voltage or current is removed, it is in a non-working state and has no light modulation function. When the electro-optical phase modulation module 40 is in the working state, it has the light modulation function of converting the plane wave into a spherical wave, and the collimated thin beam or near-collimated light beam modulated by the spatial light modulator 30 corresponding to the pixel point of the image to be displayed The straight beamlets are converged so that the collimated beamlets or near-collimated beamlets corresponding to the pixel points of the image to be displayed have different convergence angles. The collimated or near-collimated thin beams with different convergence angles corresponding to the pixel points of the image to be displayed are directly imaged on the retina of the human eye.

When the electronically controlled optical phase modulation module 40 is in the non-working state, the spatial light modulator 30 can also be controlled to be in the non-working state, so as to prevent the spatial light modulator 30 from modulating the real ambient light and affecting the observation of the real environment by the human eye . When both the electro-optical phase modulation module 40 and the spatial light modulator 30 are in the non-working state, the real ambient light enters the human eye after passing through the horizontal light guide 22, the spatial light modulator 30 and the electro-optic phase modulation module 40 The image is received on the retina. At this stage, when the light source module 10 is still in the working state, since the light modulator does not perform energy modulation on the light beam, the light beam output by the light source module 10 is expanded and enters the human eye. It is uniform light energy, forming a background with uniform brightness, reducing the contrast of the external environment, but it does not affect the human eye's reception of real ambient light. When the light source module 10 is in a non-working state, it will not affect the contrast of the real environment received by human eyes.

Since the spatial light modulator 30 modulates the pixel-level collimated wide light beam carrying the image information to be displayed, the electro-optic phase modulation module 40 converges the pixel-level collimated thin beam modulated by the spatial light modulator 30, and The imaging process of the converging light beams converged by the electro-optic phase modulation module 40 in the human eye is a kind of retinal imaging, so images can be clearly imaged within the entire display field of view. Moreover, for myopia or hyperopia users, they can clearly receive the image information to be displayed without wearing myopia or hyperopia correction glasses, which improves wearing comfort.

Optionally, in this embodiment, the electronically controlled optical phase modulation module 40 can also change the voltage or current to enable it to have equivalent optical modulation capabilities for beams of different wavelengths, so that the collimation width corresponding to multiple wavelengths The converging point of the converging beam after the beam is modulated is at the same position, eliminating the chromatic aberration of the virtual image. For example, as shown in Figure 12, when the light source module 10 outputs light beams with three wavelengths of red, green and blue, if the electro-optic phase modulation module 40 uses the same voltage or current, due to the refraction of the liquid crystal medium to different wavelengths The efficiency is different, so the converging position of the modulated spherical wave corresponding to the collimated thin beams corresponding to each wavelength is different. In the figure, OR is the converging point of the red band beam, OB is the converging point of the blue band beam, and OG is the green band At the beam convergence point, the human eye receives three beams of converging beams with different phases, and there is a certain chromatic aberration in the image formed on the retina, that is, the virtual image observed by the human eye has chromatic aberration. Therefore, different voltages or currents can be applied to the electro-optical phase modulation module 40 to eliminate chromatic aberration.

It should be understood that in other implementation manners, eliminating the chromatic aberration of the virtual image may also be performed by pre-correcting the chromatic aberration of the image to be displayed, instead of changing the voltage or current of the electro-optic phase modulation module 40 . For example, pre-store the color difference data of the multi-wavelength light waves output by the electro-optical phase modulation module 40 to the light source module 10 in the working state, and the image information to be displayed is sent to the spatial light modulator 30 according to The color difference data stored in advance is pre-corrected for the color difference of the image information to be displayed.

The electronically controlled optical phase modulation module 40 may be an electrically controlled liquid crystal lens or an electrically controlled liquid crystal phase grating or any combination thereof. Optionally, in this embodiment, the electronically controlled optical phase modulation module 40 is an electronically controlled liquid crystal lens.

As shown in FIG. 13 , the above-mentioned augmented reality display optical system 1 may further include an angle-controlled microstructure element 50 . The angle control microstructure element 50 is an optical element sensitive to the angle of incidence. When the included angle between the incident vector of the light beam and the normal of the working plane of the angle control microstructure element 50 meets the designed angle value, the light beam can pass through the angle. Control the microstructure element 50. The collimated light beam or near-collimated light beam output by the light source module 10 does not have only one direction (for example, the output of the collimated light beam or near-collimated light beam in the range of 0°～0.5° as mentioned above), which will affect the human eye. The resolution of the received virtual display image. By setting the angle control microstructure element 50, the outgoing angle of the light beam passing through the angle control microstructure element 50 can be reduced, thereby improving the resolution of the virtual display image. For example, the designed angle range of the angle control microstructure element 50 is -0.1°-0.1°. In the actual implementation process, the angle design value of the angle control microstructure element 50 can be designed and selected according to the visual effect requirements of the actual application. Obviously, the angle control microstructure element 50 can be arranged at any position between the light source module 10 and the electro-optical phase modulation module 40 . For example, the angle control microstructure element 50 is arranged between the light source module 10 and the vertical light guide 21 for selecting the light beam output by the light source module 10; the angle control microstructure element 50 is arranged between the vertical light guide 21 and the horizontal light guide 22 for selecting the beam output by the vertical light guide 21; the angle control microstructure element 50 is arranged between the horizontal light guide 22 and the spatial light modulator 30 for selecting the beam output by the horizontal light guide 22; The angle control microstructure element 50 is arranged between the spatial light modulator 30 and the electro-optic phase modulation module 40 , and is used for selecting the light beam output by the spatial light modulator 30 . Optionally, in this embodiment, the angle control microstructure element 50 is disposed between the horizontal light guide 22 and the spatial light modulator 30 .

Similarly, there may be more than one angle control microstructure element 50, such as two, three, four, etc. When there are more than one angle control microstructure elements 50, each angle control microstructure element 50 can be arranged at intervals. For example, there are two angle control microstructure elements 50, one angle control microstructure element 50 is arranged between the horizontal light guide 22 and the spatial light modulator 30, and the other angle control microstructure element 50 is arranged on the vertical light guide 21 and the horizontal light guide 22.

In the actual implementation process, the angle control microstructure element 50 can first make a master plate with a microstructure pattern, transfer the pattern on the master plate to a special soft film by a graphic transfer method, and then The angle control microstructure element 50 in the form of a soft film is pasted on the plane of the light source module 10, the horizontal light guide 22, the vertical light guide 21, the spatial light modulator 30 or the optical phase modulation module with optical glue to reduce the angle control microstructure. Assembly complexity of element 50 . For example, when the angle control microstructure element 50 is disposed between the horizontal light guide 22 and the spatial light modulator 30 , the angle control microstructure element 50 can be attached to the plane of the horizontal light guide 22 near the spatial light modulator 30 .

As shown in FIG. 14 , in a possible implementation manner, the augmented reality display optical system 1 further includes an infrared emitting device 60 and an infrared camera module 70 . The infrared emitting device 60 may be an infrared light source such as an infrared LED light source or an infrared LD light source, which is not limited here. The infrared emitting device 60 can be placed anywhere in the display optical system. In the actual implementation process, it is only necessary to ensure that the light beam emitted by the infrared emitting device 60 can cover the range of human eyes and will not block the projected imaging field of view and the preset external environment observation field of view. The infrared camera module 70 is used for receiving infrared images of human eyes and storing image data. The infrared camera module 70 can also be connected to the processor, and the processor can detect the eyeballs according to the stored data, identify the position of the eyeballs, the state of the gaze direction, etc., and perform different eye control operations according to information such as the gaze direction of the eyeballs. . For example, if it is recognized that the gaze point of the human eye remains on a certain control on the image interface within a set period of time, perform system operations corresponding to this control, etc.

As shown in FIG. 15, in another possible implementation manner, the above-mentioned augmented reality display optical system 1 further includes an infrared diffraction element 80, and the infrared diffraction element 80 is arranged on the electronically controlled optical phase modulation module 40 close to the human eye. On one side, at the same time, the optical axis LK of the infrared camera module 70 is substantially parallel or coaxial with the outgoing optical axis OG of the infrared diffraction element 80 . By arranging the infrared diffraction element 80 and making the optical axis LK of the infrared camera module 70 substantially parallel or coaxial with the outgoing optical axis OG of the infrared diffraction element 80, a virtual image of the human eye is formed, and the virtual image of the human eye is outside the camera module The group distance falls within the working range of the external camera module to be acquired by the external camera module, as shown in Figure 16. In this way, the external camera module can obtain a clear front-eye image without facing the human eye directly, without interfering with the user's reception of ambient light in the real world, and can be used for eye tracking, iris recognition authentication, etc. Wherein, the ortho-eye image refers to an image of a human eye that is equivalent to a shooting angle directly facing the human eye.

In order to meet certain specific functional requirements, the components of the above-mentioned augmented reality display optical system 1 may optionally be coated with anti-reflection coatings, hard coatings, anti-fog coatings and other functional coatings, which are not limited here. Moreover, when the augmented reality display optical system 1 is applied to augmented reality glasses, the augmented reality glasses also include wearing parts (such as temples) and structural parts connecting the components included in the above augmented reality display optical system 1 .

Please refer to FIG. 17 , an embodiment of the present invention also provides an augmented reality display method, which is applied to the above-mentioned augmented reality display optical system 1 . The method includes: step S110, step S130 and step S150.

Step S110, dividing the preset display time of one frame of image to be displayed into a first time period and a second time period.

Step S130, in the first time period, send a frame of the image information to be displayed to the spatial light modulator 30, and control the electro-optic phase modulation module 40, the light source module 10 and the spatial light modulator Modulator 30 is in working state.

From the foregoing analysis, it can be seen that in the first time period, the image to be displayed is enlarged and projected to human eyes to form virtual image information.

Step S150, controlling the electro-optical phase modulation module 40 and the spatial light modulator 30 to be in a non-working state during a second time period.

According to the above analysis, in the second time period, the real ambient light enters the human eye after passing through the horizontal light guide 22 , the spatial light modulator 30 and the electro-optical phase modulation module 40 and is received and imaged on the retina. In the second time period, the light source module 10 may be in the working state or in the non-working state, which is not limited here.

Wherein, the duration of the first time period and the second time period may be the same or different. For example, the preset refresh rate of a frame of image to be displayed is 60Hz, and its display time is set to 1/60s. The first time period can be set to 1/120s, 1/180s or others. Correspondingly, the second time period is 1/120s, 1/90s or others. The duration of the first time period only needs to ensure that within this time period, the spatial light modulator 30 can complete the flipping of the liquid crystal molecules to achieve the purpose of modulating the beam energy, and the electronically controlled optical phase modulation module 40 can Complete the transition between working state and non-working state.

Optionally, when the light source module 10 outputs light beams of multiple wavelengths, before each frame of the image information to be displayed is sent to the spatial light modulator 30, the method further includes step S170.

Step S170, perform color difference pre-correction on each frame of image information to be displayed.

It can be seen from the foregoing analysis that when the light source module 10 outputs light beams of multiple wavelengths, if the electronically controlled optical phase modulation module 40 uses the same voltage or current, the light beams of each wavelength will be outputted by the electronically controlled optical phase modulation module 40. Different converging positions of the modulated spherical waves will cause chromatic aberration in the virtual image observed by human eyes. In order to eliminate chromatic aberration, the chromatic aberration data of the multi-wavelength light waves output by the electro-optic phase modulation module 40 to the light source module 10 in the working state can be stored in advance, and when the image information to be displayed is sent to the space Before the light modulator 30, color difference pre-correction is performed on the image information to be displayed according to the pre-stored color difference data.

Please refer to FIG. 18 , an embodiment of the present invention also provides an augmented reality display method, which is applied to the aforementioned augmented reality display optical system 1 . When the light source module 10 outputs light beams of multiple wavelengths, the method includes: step S210, step S230, step S250 and step S270.

Step S210, dividing the preset display time of one frame of image to be displayed into a first time period and a second time period.

Similarly, the durations of the first time period and the second time period may be the same or different. For example, the preset refresh rate of a frame of image to be displayed is 60Hz, and its display time is set to 1/60s. The first time period can be set to 1/120s, 1/180s or others. Correspondingly, the second time period is 1/120s, 1/90s or others.

Step S230 , pre-processing a preset frame of images to be displayed into multiple frames of monochrome images corresponding to the light beams of various wavelengths output by the light source module 10 .

Wherein, the number of frames of the monochromatic image is the same as the number of wavelengths of the light beams output by the light source module 10 . For example, when the light source module 10 outputs light beams with three wavelengths of red, green, and blue, a preset frame of images to be displayed is pre-processed into three frames of monochrome frames corresponding to light beams with three wavelengths of red, green, and blue respectively. The images are denoted as the first frame monochrome image, the second frame monochrome image and the third frame monochrome image.

Step S250, dividing the first time period into multiple sub-time periods, each sub-time period controls the light source module 10 to output a light beam of a wavelength, and sends a frame of monochromatic images corresponding to the light beam of this wavelength to The spatial light modulator 30 controls the electronically controlled optical phase modulation module 40 to be in a working state, so that the converging point of the converging light beam converged by the electronically controlled optical phase modulation module 40 in each sub-time period is at the same location.

For example, the first time period is divided into three sub-time periods, which are recorded as the first sub-time period, the second sub-time period and the third sub-time period. The first sub-time period controls the light source module 10 to output a light beam of red wavelength, sends the first monochrome image to the spatial light modulator 30, and controls the electronically controlled optical phase modulation module 40 to work in the first mode. state. The second sub-time period controls the light source module 10 to output a light beam of green wavelength, sends a second frame of monochrome image to the spatial light modulator 30, and controls the electronically controlled optical phase modulation module 40 to work in the second mode. state. The third sub-time period controls the light source module 10 to output a blue-wavelength light beam, sends the third monochrome image to the spatial light modulator 30, and controls the electronically controlled optical phase modulation module 40 to work in the third mode. state. Wherein, when the electronically controlled optical phase modulation module 40 is in the first working state, the second working state and the third working state, the convergence of the converging light beams converged by the electronically controlled optical phase modulating module 40 point at the same position to eliminate the color difference of the virtual image. Similarly, the duration of each sub-time period can be the same or different. That is, the durations of the first sub-time period, the second sub-time period and the third sub-time period may be the same or different.

Step S270, during the second time period, controlling the electro-optic phase modulation module 40 and the spatial light modulator 30 to be in a non-working state.

Similarly, in the second time period, the real ambient light enters the human eye after passing through the horizontal light guide 22 , the spatial light modulator 30 and the electro-optic phase modulation module 40 and is received and imaged on the retina. In the second time period, the light source module 10 may be in the working state or in the non-working state, which is not limited here.

The augmented reality display optical system 1 provided by the embodiment of the present invention makes the spatial light modulator 30 (Display screen) does not need to be placed at the near focal plane of the electronically controlled optical phase modulation module 40 (focusing lens), and has a more compact structure, smaller volume, lighter weight, and is more comfortable to wear; and based on the principle of retinal imaging, it can be used in the entire Displays clear images within the field of view. For myopia or hyperopia users, they can clearly receive the image information to be displayed without wearing myopia or hyperopia correction glasses. At the same time, the augmented reality display optical system 1 provided by the embodiment of the present invention can also include an infrared emitting device 60 and an infrared camera module 70 to obtain infrared images of human eyes; A clear orthographic image can be obtained for the human eye without interfering with the user's reception of ambient light in the real world. It can be used for eye tracking, iris recognition authentication, etc.

It should be understood that the augmented reality display method provided by the embodiment of the present invention is applied to the aforementioned augmented reality display optical system 1 and thus has similar beneficial effects.

Any feature disclosed in this specification (including any appended claims, abstract and drawings), unless expressly stated otherwise, may be replaced by alternative features which are equivalent or serve a similar purpose. That is, unless expressly stated otherwise, each feature is one example only of a series of equivalent or similar features.

The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and changes. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention shall be included within the protection scope of the present invention.

Claims (10)

1. a kind of augmented reality display optical system, which is characterized in that including：Light source module group, light guide module, spatial light modulator And have the function of plane wave be converted to the light modulation of spherical wave automatically controlled optical phase modulate module, the light guide module include water Zero diopter is led and vertical light guides, and the spatial light modulator is transparent transmission-type；

The light source module group is located in the input path of the vertical light guides, and the horizontal light guide is located at going out for the vertical light guides It penetrates in light path, the spatial light modulator is located on the emitting light path of the horizontal light guide, the automatically controlled optical phase modulation mould Group is on the emitting light path of the spatial light modulator；

When the automatically controlled optical phase modulation module and the in running order spatial light modulator, the light source module group carries The collimation of confession or nearly collimated illumination light beam carry out both vertically and horizontally respectively by the vertical light guides and horizontal light guide Ground is transmitted with after extension, forming collimation angle pencil of ray or closely collimating angle pencil of ray, and the spatial light modulator is believed according to image to be displayed It modulates with ceasing the Pixel-level to the collimation angle pencil of ray or nearly collimation angle pencil of ray progress light energy, obtains and image to be displayed pixel The corresponding collimation light pencil of point closely collimates light pencil, and the automatically controlled optical phase modulation module is to described and image to be displayed picture The corresponding collimation light pencil of vegetarian refreshments or nearly collimation light pencil carry out being focused at the upper direct imaging of human eye retina；

When the automatically controlled optical phase modulation module and the spatial light modulator are in off working state, true environment light View is imaged in through being received after the horizontal light guide, spatial light modulator and automatically controlled optical phase modulation module into human eye On film.

2. augmented reality display optical system according to claim 1, which is characterized in that the light source module group is sent out including light Penetrate unit, optical collimator, combiner device, coupling optical fiber and collimation microscope group.

3. augmented reality display optical system according to claim 2, which is characterized in that the light source module group, which further includes, to disappear Speckle device.

4. augmented reality display optical system according to claim 1, which is characterized in that the horizontal light guide is included at least The tilting prisms of two or including at least two oblique arrangements can thoroughly can antiplane mirror.

5. augmented reality display optical system according to claim 1, which is characterized in that the horizontal light guide is by reflector Part and diffraction element are formed, and the diffraction element is between the reflecting element and spatial light modulator.

6. augmented reality display optical system according to claim 5, which is characterized in that the horizontal light guide further includes can Thoroughly can anti-layer, it is described can thoroughly can anti-layer between the reflecting element and diffraction element.

7. augmented reality display optical system according to claim 1, which is characterized in that the horizontal light guide by substrate and Diffraction element is formed, and reflex is played in one side of the substrate away from diffraction element.

8. according to claim 1-7 any one of them augmented reality display optical systems, which is characterized in that the augmented reality Display optical system further includes the angle control micro-structured component for reducing beam exit angle.

9. a kind of augmented reality display methods, which is characterized in that shown applied to any one augmented reality described in claim 1-8 Show optical system, the described method includes：

Aberration precorrection is carried out to every frame image to be displayed information；

The display time of image to be displayed described in a default frame is divided into first time period and second time period；

In first time period, image to be displayed information described in a frame is sent to the spatial light modulator, controls the automatically controlled light It is in running order to learn phase-modulation module, the light source module group and the spatial light modulator；

In second time period, the control control automatically controlled optical phase modulation module and the spatial light modulator are in inoperative State.

10. a kind of augmented reality display methods, which is characterized in that applied to any one augmented reality described in claim 1-8 Display optical system, the described method includes：

The display time of default frame image to be displayed is divided into first time period and second time period；

The light beam that default frame image to be displayed is anticipated to the multi-wavelength to be exported with the light source module group is corresponding Multiframe monochrome image；

The first time period is divided into multiple sub- periods, each sub- period controls the light source module group to export a kind of ripple Long light beam sends frame monochrome image corresponding with the light beam of this kind of wavelength to the spatial light modulator, controls the electricity Control optical phase modulation module is in a kind of working condition, makes each sub- period by the automatically controlled optical phase modulation module The convergent point of convergent beam after convergence is in same position；

In second time period, the control control automatically controlled optical phase modulation module and the spatial light modulator are in inoperative State.