CN118605032A - A near-eye display system with side-entry projection at the edge of the lens - Google Patents

Abstract

The invention relates to a near-to-eye display system for side-in projection of an edge of a lens, and belongs to the field of augmented reality. The device comprises a micro-display module, a light regulating and controlling module, an eye-entering coupling module, an eyeball tracking module and a compensation module. The micro display module comprises a micro display screen, a control chip and a driving circuit; the light modulation and control module comprises a light shaping lens group; the eye-entering coupling module is a multidirectional prismatic table with a reflection diffraction light path function; the eyeball tracking module consists of a camera and an image processing chip; the compensation module can compensate distortion of the incident light caused by reflection and diffraction functions of the incident coupling module. The micro display screen is arranged on the side edge of the lens, the light regulating and controlling module is arranged in front of the micro display screen to regulate and control light beams, the eye-entering coupling module is arranged at the center of the lens, or the micro display screen is arranged at the position aligned with the center of the pupil according to the wearing position of eyes, and the camera is arranged on the lens frame. The invention has the advantages of light weight, high light transmission efficiency and can be used for display equipment of augmented reality, virtual reality and mixed reality.

Description

A near-eye display system with side-entry projection at the edge of the lens

Technical Field

The invention belongs to the field of augmented reality, and in particular relates to a near-eye display system with side-entry projection at the edge of a lens.

Background Art

Near-eye display technology currently includes augmented reality and virtual reality. Augmented reality (AR) display technology is a technology that superimposes virtual digital content onto the real world to create an enhanced visual experience. Virtual reality, on the other hand, completely immerses the user in a virtual environment. The goal of AR technology is to combine virtual information with the user's environment, allowing the user to interact with the real world and digital content. These digital contents can include images, videos, 3D models, sounds, or other computer-generated information.

At present, the mainstream solutions of AR technology mainly include free-form surface structure, Birdbath structure, semi-transparent and semi-reflective mirror structure and optical waveguide structure, etc. Birdbath structure, free-form surface structure and semi-transparent and semi-reflective structure are large in size, but have high light transmission efficiency; optical waveguide structure has a light and thin style, but has low light utilization rate.

Summary of the invention

The purpose of the present invention is to fill the gap in the prior art and provide a near-eye display system for side-entry projection at the edge of a lens, comprising: a micro-display module, a light control module, an eye coupling module, and an eye tracking module.

To achieve the above purpose, the technical solution of the present invention is: a near-eye display system for side-entry projection at the edge of a lens, comprising a micro-display module, a light control module, an eye coupling module, and an eye tracking module. The system emits an image from the micro-display module on the side of the lens, shapes the light through the light control module, and then the light is incident on the multi-directional prism of the eye coupling module to be reflected and focused into the eye, which can not only realize retinal projection, but also magnify the micro-display image to form a virtual image at a distance for human eye observation.

The micro-display module includes a micro-display screen, a control chip and a driving circuit. At least one group of micro-display modules should be distributed along the edge of the lens. They are distributed inside the edge of the lens or outside the edge of the complete lens. They are evenly distributed or unevenly distributed along the edge of the lens. The screen light emission direction should point to the center of the lens. When evenly distributed, the micro-display modules are evenly distributed along the perimeter of the edge of the lens. When unevenly distributed, the positions of the micro-display modules can be distributed according to demand. The micro-display modules include but are not limited to micro-light-emitting diodes Micro-LED, organic light-emitting diodes OLED, nano-light-emitting diodes Nano-LED, silicon-based liquid crystals LCoS and other micro-monochrome or color micro-display screens. Each micro-display module includes at least one corresponding light control module;

The light control module includes a beam shaping lens group, and may also include a polarization converter as needed. The polarization rotator generally includes a linear polarizer and a quarter wave plate. The light shaping lens group in the light control module includes but is not limited to liquid crystal lenses, metasurface structures, Fresnel lenses, microlens arrays, superlenses and holographic optical elements. When the lens group is a lens group with a beam shaping function, the lens composition includes but is not limited to a free combination of liquid crystal lenses, metasurface structures, Fresnel lenses, microarray lenses, superlenses and holographic optical elements. In actual application, a suitable lens group is selected according to different parameter indicators to meet the beam shaping requirements of the micro display screen. When the eye coupling module is a reflective surface with polarization selectivity, the light control module may also include a polarization conversion module, so that the light control module only works on circularly polarized light in one direction without affecting the transmission of ambient light. The polarization conversion module is generally composed of a linear polarizer and a quarter wave plate. The linear polarizer decomposes the light from the micro display module into two linearly polarized lights with perpendicular vibration directions, and then the phase of the linear polarized light in one direction is advanced or delayed by a quarter of a cycle through a quarter wave plate, so that it can be converted into circularly polarized light in different directions.

The eye coupling module is located in the center of the lens, or is placed in a position aligned with the center of the pupil according to the wearing position of the human eye. It includes at least a multi-directional prism with a refracting and reflecting light path function. The side of the multi-directional prism is a reflective surface or a refracting and reflecting surface. Different structural design schemes can be used to regulate the light to be observed in the viewer's pupil; the eye coupling module includes but is not limited to a polarization volume holographic surface, a volume holographic surface, a metasurface, an embossed diffraction surface, an off-axis reflection optical surface, etc., and a variety of materials can be used in the same system; when the eye coupling module is a holographic surface with polarization characteristics, the light regulation module can include a polarization converter to convert the light from the microdisplay into left/right circularly polarized light; the holographic surface is generally made by light alignment polarization holography, in which two beams of circularly polarized light interfere on the light orientation material, and only respond to circularly polarized light with the same rotation direction as its own material, and can reflect a beam of circularly polarized light incident at a certain angle as a circularly polarized light that can be converged and emitted in other directions without affecting the environment The circularly polarized light of another rotation direction contained in the light passes through; according to the reflection path set when the holographic surface is manufactured, the holographic surface can focus the collimated light beam from the light control module into a viewpoint to form a projection picture; when the reflection surface of the eye coupling module is a polarizer holographic surface, the light enters the eye through Bragg diffraction, and the liquid crystal molecules in the surface rotate along their own optical axis, which can diffract circularly polarized light with the same rotation direction as their own liquid crystal molecules, and the light emitted by the light control module enters the eye through diffraction; when the eye coupling module of the system is an off-axis curved optical system that normally reflects light, such as a free-form surface, an off-axis parabolic mirror, etc., the reflection surface is curved with a certain curvature. When the curvature curve of the curved surface is represented by a parabolic function, it is an off-axis parabolic mirror, and the curvature curve of the curved surface can be defined by a free-form surface; the collimated light beam transmitted by the light control module can be focused by the off-axis reflection surface to form a projection. Since the angle of reflection of each point of the off-axis reflection surface is different, the light can be converged or diverged into the eye through design.

The eye tracking module is placed above the lens or other places where the pupil position can be captured. It is composed of a camera and an image processing chip. The camera is used to capture the user's eye position and transmit the data to the chip. After data processing, it controls the switch of the micro display module. When the eye is projected into the eye by retinal projection, since the image of each micro display is focused at a different position, after the camera captures the position information of the eye, the image recognition system uses image recognition technology to identify the current pupil position and controls the micro display screen whose corresponding viewpoint can fall into the current pupil position to turn on; the eye tracking module includes but is not limited to infrared eye tracking, optical eye tracking, transparent image sensor, etc.; since this system is designed with multiple micro displays, each micro display has a different corresponding focus position, thereby achieving the effect of pupil expansion and having a larger eye movement range.

In one embodiment of the present invention, the light of multiple micro-display modules can be focused to the center of the pupil to form a plurality of viewpoints arranged in a tiled manner by adjusting the inclination angle of the side reflection surface of the eye coupling module; the light of multiple micro-display modules can also be focused to different depth positions or to the same point by adjusting the material properties of the side surface of the eye coupling module, such as the degree of curvature, the internal structure of the holographic element, etc.; the light divergence function of the side surface of the eye coupling module can also be used to magnify the micro-display image to form a virtual image in the distance; when a plurality of viewpoints are arranged in a tiled manner, if one of the viewpoints falls into the pupil range, the complete image can be observed, and the plurality of viewpoints realize the expansion of the exit pupil, which greatly improves the eye movement range; when different When different viewpoints are used, different pupil distances can be met; when focusing on the same point, the device has only one viewpoint, but the brightness of the viewpoint is superimposed, or different monochromatic lights can be displayed in different micro-display modules to achieve multi-color superposition at the same position, or the image splicing method can be used, with each micro-display module displaying a different position of an image, and then the light is converged at one point to achieve image splicing; when using virtual image plane projection, each micro-display module uses the corresponding eye coupling module to make the corresponding light diverge to different degrees, forming virtual images of different depths, so that the wearer's line of sight does not have to be focused on one plane all the time, alleviating the convergence conflict and improving the wearer's experience

In one embodiment of the present invention, the shape of the lens of the projection system can be a circle or a polygon with certain symmetrical features such as a quadrilateral or hexagon. The number of micro display screens is not limited. It is only necessary that each micro display screen has a corresponding side surface of a central module to reflect light, thereby ensuring that the light of each micro display module can enter the eye in an appropriate manner; the micro display module, the beam shaping lens group module, and the eye coupling module can be packaged together in the lens, wherein the lens material includes but is not limited to glass, plastic, resin, crystal material, etc., and each module can also be installed in a suitable place outside the lens, as long as the light can be reasonably shaped by the light control module and coupled into the eye by the eye coupling module.

In one embodiment of the present invention, micro display screens at different positions can be designed to reflect to any position within a certain range, including lateral positions and various depth positions, according to different geometric shapes of the eye coupling module; the geometric shape of the eye coupling module is a multi-directional prism, which can be a symmetrical multi-directional prism or an asymmetrical multi-directional prism; the top and bottom of the multi-directional prism are both polygonal geometric surfaces, and the size of the top polygon is smaller than the bottom polygon, and the edges of the top and bottom polygons are parallel to each other. When the reflective surface is a non-curved surface, the specific horizontal position of the upper plane is determined according to the required inclination angle of each reflective surface; when the reflective surface is a curved surface, the specific position of the upper plane is determined according to the designed free-form surface or off-axis parabola, and the geometric shape of the eye coupling module is a curved-edge prism; after determining the geometric shape, a corresponding optical element film is manufactured on the side surface, including but not limited to a metasurface, a holographic surface, a volume holographic surface, an off-axis parabolic reflective surface film, a free-form reflective surface film, etc.; the field of view of the entire system is restricted by the size of the coupled eye module and the inclination or curvature of the corresponding reflective side surface, and different field of view angles can be customized according to the wearer's needs.

In one embodiment of the present invention, when the system is applied to the retinal projection of a holographic surface, the distance from the reflective surface to the viewpoint of the eye is called f1. When making a holographic reflective surface, two beams of light are simultaneously irradiated on the substrate to form a light orientation pattern. One beam of light is parallel light, representing a collimated light beam emitted from the light control module, and the other beam of light is parallel light with the same intensity, which passes through a lens with a focal length of f1 and then irradiates the substrate. The distance between the lens and the substrate is 2f1. At this time, the simulated phase profile at each point on the substrate is It can be expressed by the formula: Where λ represents the wavelength of the incident light, x, y represent the coordinates of the point on the substrate, f represents the focal length, i.e. f1, and θ represents the inclination angle of the substrate compared to the vertical direction. When the system is applied to the multi-virtual image plane entry method of holographic surface reflection, the distance from the reflection surface to the virtual focus is called f2. When making a holographic reflection surface, two beams of light are simultaneously irradiated on the substrate to form an interference pattern. One beam of light is parallel light, representing the collimated light beam emitted from the light control module, and the other beam of light is parallel light of the same intensity passing through a lens with a focal length of f2 and then irradiated on the substrate. The distance between the lens and the substrate is 2f2. At this time, the phase at each point on the substrate can also be expressed by the above formula. When the system is applied to the reflection of non-holographic surface into the eye, the system needs to satisfy the equal optical path of the light from the micro display module to the final eye. Assuming that there are two points (x1, y1, z1) and (x2, y2, z2) on the micro display module, the light emitted by these two points passes through (x3, y3, z3) and (x4, y4, z4) on the eye coupling module respectively, and finally focuses on the point (x5, y5, z5), then it should satisfy Where n1 represents the refractive index of the lens, and n2 represents the refractive index of air; if it is a reverse virtual image entering the eye, then (x5, y5, z5) is the point where the virtual image is focused.

In one embodiment of the present invention, when the material used for the coupling-into-eye module is a polarization holographic surface, a free-form surface, or an off-axis reflector, the coupling-into-eye module will not affect the transmission of ambient light; when a polarization holographic surface is used, since the coupling-into-eye module only reflects circularly polarized light in a certain direction, other components of the ambient light can be transmitted unaffected; when the coupling-into-eye module uses a curved off-axis reflection system, the reflection method used is to coat a layer of semi-transparent and semi-reflective thin film material, which will have a certain reflection effect on the ambient light; when the coupling-into-eye module uses a metasurface, a surface relief diffraction surface, etc. to realize the diffraction of light through the tiny geometric shapes of the reflective surface, the coupling-into-eye module will have a partial refraction effect on the ambient light. At this time, a compensation module needs to be added at the corresponding place of the coupling-into-eye module to compensate for the ambient light distorted by the coupling-into-eye module.

In one embodiment of the present invention, the non-collimated stray light when the light control module cannot completely achieve ideal collimation can be transmitted through the lens as a waveguide to the coupling module into the eye, and finally enter the eye, so that the light utilization rate is maximized; in addition, when the light emitted by the micro display screen is not parallel to the lens, but has a certain angle with the lens, the light can be totally internally reflected through the lens as a waveguide to realize the propagation of the light beam in the form of an optical waveguide. At this time, the eye coupling module still acts as a waveguide coupling module to reflect the light into the eye.

In one embodiment of the present invention, when this structure is used in a VR system, the system no longer needs to consider the propagation of external ambient light, and a sunshade can be used to shield the front end of the lens, or the system can be applied to a head-mounted virtual reality display device. The micro-display module no longer needs to be fixed in the lens, but instead emits light at a suitable position in the head-mounted device, which is then reflected into the eye by the eye coupling module. The way of entering the eye is still the same as when applied to augmented reality.

In one embodiment of the present invention, the optical structure can be combined with special lenses such as infrared cameras and zoom cameras to switch and display infrared images, distant images, close-up images, etc., and can be applied to military tactical helmets, etc.; head-mounted near-eye display devices made of the optical structure, such as smart glasses, smart helmets, etc., can be combined with sensors and cameras to capture iris information and realize functions such as identity authentication and health monitoring; in the above applications, the optical structure can be used alone or in combination with both eyes. When used in a binocular structure, the optical structures of the left and right eyes are the same. The difference is that the left and right eye images displayed by the micro-display module are slightly different, so as to form a stereoscopic image in the human eye vision.

Compared with the prior art, the present invention has the following beneficial effects: the present invention regulates the light from the micro-display module through the light regulation module, the eye coupling module reflects or diffracts the light beam from the light regulation module into the pupil, and the eye tracking module tracks the eye position, which facilitates the pupil expansion function, and the present invention adopts the form of retinal projection or virtual image plane to alleviate the convergence conflict. This system has the advantages of being light and thin and having high light efficiency, and can be applied to near-eye display devices such as AR glasses and VR helmets. While having high light efficiency, it greatly reduces the size and weight of the system and improves the user experience.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG1 is a monocular stereoscopic diagram of a near-eye display system with side-entry projection of the lens edge of the present invention.

FIG. 2 is a binocular stereoscopic diagram of a near-eye display system with side-entry projection of the lens edge of the present invention.

FIG3 is a front view of a monocular near-eye display system of the present invention with side-entry projection at the edge of the lens.

FIG. 4 is a monocular side view of a near-eye display system of the present invention that projects the retina into the eye from the edge of the lens.

FIG5 is a monocular side view of a near-eye display system of the present invention with side-entry projection of the lens edge with multiple virtual image planes entering the eye.

Figure 6 shows the types of eye-into-eye coupling modules of the present invention and their three-dimensional stereograms: (a) the retina projected into the eye by holographic surface reflection, (b) the multiple virtual image planes reflected by the holographic surface enter the eye, (c) the retina projected into the eye by free-form surface reflection, and (d) the multiple virtual image planes reflected by the free-form surface enter the eye.

In the figure: 101: human eye, 102: micro display module light, 103: ambient light, 104: micro display module, 105: light control module, 106: eye coupling module, 107: eye tracking module, 108: virtual image plane, 109: compensation module.

DETAILED DESCRIPTION

The technical solution of the present invention is described in detail below in conjunction with the accompanying drawings.

The present invention provides preferred embodiments, which are only used to further illustrate the present invention, and should not be considered to be limited to the embodiments set forth herein, nor can they be understood as limiting the scope of protection of the present invention. The following detailed descriptions are exemplary and are intended to provide further explanation of the present application. Unless otherwise specified, all technical and scientific terms used herein have the same meanings as those commonly understood by those of ordinary skill in the art to which the present application belongs. It should be noted that the terms used herein are only for describing specific embodiments and are not intended to limit the exemplary embodiments according to the present application. As used herein, unless the context clearly indicates otherwise, the singular form is also intended to include the plural form. In addition, it should be understood that when the terms "comprising" and/or "including" are used in this specification, it indicates the presence of features, steps, operations, devices, components and/or combinations thereof.

The present invention provides a near-eye display system for side-entry projection at the edge of a lens, comprising a micro-display module, a light control module, an eye coupling module, an eye tracking module and a compensation module; wherein:

The micro display modules are distributed inside the edge of the lens or outside the edge of the complete lens, and at least one group of micro display modules is evenly or unevenly distributed along the edge of the lens, and the light emission direction of the micro display module screen points to the center of the lens;

The light control module includes a beam shaping lens group, which performs shaping functions including collimation, convergence and divergence on the light beam according to the requirements of the eye coupling module;

The eye coupling module is placed at the symmetrical center of the lens, or at a position aligned with the center of the pupil according to the wearing position of the human eye. The eye coupling module is provided with a reflective surface, and adopts different structural design schemes to adjust the light to be observed in the pupil of the human eye;

The eye tracking module is placed above the lens or somewhere else where it can capture the position of the pupil.

The following are specific implementation examples of the present invention.

Embodiment 1

As shown in Figures 1-4, the present invention provides a near-eye display system for side-entry projection on the edge of a lens, comprising the following modules: a micro-display module, a light control module, an eye coupling module, an eye tracking module and a compensation module; the micro-display module 104 is composed of a micro-display screen and its control chip and control circuit, and can display monochrome images or color images. The light control module 105 is composed of a light shaping lens group or a polarizer, which can shape the light emitted by the micro-display module or apply a polarization state. The eye coupling module 106 is a geometric body of a polygonal prism or a curved prism, wherein the side surface of the geometric body can be various optical surfaces that can reflect and diffract light. The eye tracking module 107 can track the position of the eyeball, providing a basis for pupil expansion.

The micro display module 104 of this embodiment is used to display images, and includes a micro display, a control chip, and a driving power supply. The display screen includes but is not limited to micro light-emitting diodes Micro-led, organic light-emitting diodes OLED, nano light-emitting diodes Nano-led, silicon-based liquid crystals LCoS and other micro monochrome or color micro display screens. The micro display screen can display full-screen monochrome images, full-screen color images, and spliced images. In this embodiment, it is mainly used to realize full-screen monochrome or color images.

The light control module 105 of this embodiment is used to shape the light and apply the polarization state to the light according to the demand. The light control module includes a beam shaping lens group, and may also include a polarization converter as needed. The polarization converter generally includes a linear polarizer and a quarter wave plate; the composition of the beam shaping lens group in the light control module includes but is not limited to a liquid crystal lens, a super surface structure, a Fresnel lens, a micro lens array, a super lens and a holographic optical element; when the lens group is a lens group with a beam shaping function, the lens composition includes but is not limited to a free combination of liquid crystal lenses, super surface structures, Fresnel lenses, micro array lenses, super lenses and holographic optical elements; when the eye coupling module is a reflective surface with polarization selectivity, the light control module needs to include a polarization conversion module, so that the light control module only works on circularly polarized light in one direction without affecting the transmission of natural light; the polarization conversion module is generally composed of a linear polarizer and a quarter wave plate. The linear polarizer decomposes the light from the micro display module into two orthogonal linear polarized lights, and then the phase of the linear polarized light in one direction is advanced or delayed by a quarter of a cycle through the quarter wave plate, so that it can be converted into circularly polarized light in the corresponding direction.

The eye coupling module 106 of this embodiment is used to reflect or diffract the light of the micro display screen into the pupil, and project it around the pupil to form a viewpoint. The eye coupling module 106 is located in the center of the lens, or is placed in a position aligned with the center of the pupil according to the wearing position of the human eye. It includes at least one multi-directional prism with a refracting and reflecting light path function. The side of the multi-directional prism is a reflective surface or a refracting and reflecting surface. Different structural design schemes can be used to control the light to be observed in the viewer's pupil; the reflective surface material of the eye coupling module 106 includes but is not limited to a polarized volume holographic surface, a volume holographic surface, a metasurface, an embossed diffraction surface, an off-axis reflective optical surface, etc., and multiple materials can be used in the same system; when the eye coupling module is a holographic surface with polarization characteristics, the light control module needs to include a polarization converter that can convert the light from the micro display into left/right circularly polarized light; when the reflective surface of the eye coupling module is a polarized When the system is a holographic surface, the liquid crystal molecules in the surface rotate along their own optical axis, and can Bragg diffract the circularly polarized light with the same rotation direction as the liquid crystal molecules themselves, so as to diffract the light emitted by the light control module into the eye; when the eye coupling module of the system is an off-axis curved optical system that normally reflects light, such as a free-form surface, an off-axis parabolic mirror, etc., the reflecting surface is curved with a certain curvature. When the curvature curve of the curved surface can be represented by a parabolic function, it is an off-axis parabolic mirror. When the curvature curve of the curved surface is difficult to represent by a function, it is a free-form surface reflecting surface; the collimated light beam transmitted by the light control module can be focused by the off-axis reflecting surface to form a projection. Since the angle of reflected light at each point of the off-axis reflecting surface is different, the light can be converged or diverged into the eye through design.

The eye tracking module 107 of this embodiment is used to track the eye position and control the switch of the micro display screen corresponding to the current eye position. After the design of the eye coupling module 106, the light of each micro display module 104 is projected to the viewpoints at different positions around the pupil. After the eye tracking module 107 captures the eye position information, the micro display screen whose corresponding viewpoint falls within the current pupil range is controlled to turn on, and the other display screens are turned off, so as to realize dynamic eye tracking.

When the optical structure of this embodiment is applied to a head-mounted near-eye display device, the optical structure can be a group to display images to the left eye or the right eye separately; at the same time, the optical structure can also be two groups to display images to both the left eye and the right eye.

The display system is started, the micro display module 104 projects the image to the light control module 105 for light shaping, and projects the light of each micro display module to different viewpoints around the pupil through the coupling eye module 106, and cooperates with the eye tracking module 107 to achieve pupil expansion, so as to obtain a larger eye movement range. At the same time, the ambient light can also be normally transmitted to the pupil through the compensation module 109.

Embodiment 2

As shown in Figures 1 and 4, the present invention provides a near-eye display system for side-entry projection at the edge of a lens, comprising: a micro-display module, a light control module, an eye coupling module, an eye tracking module and a compensation module. The micro-display module, the light control module and the eye coupling module are encapsulated together in the lens, and the lens material includes but is not limited to glass, plastic, resin, crystal material, etc.

The optical structural features referred to in this embodiment are similar to those in the first embodiment and will not be repeated here.

The micro-display modules in this embodiment may not display the entire screen image, but each display a part of the complete image, and project it to the same viewpoint in the pupil, splice to form a complete image, and perform retinal projection; the specific way of segmenting the image is determined by the display form of the image. If the graphic displayed on the micro-display is a rectangular image, the image can be divided into four parts along the diagonal, each part is a triangular display area, and the corresponding images are displayed by four micro-display modules distributed on the upper, lower, left and right inner edges of the lens. A monochrome complete image can also be displayed, using three micro-displays to display a monochrome image of RGB three colors and project it to the same viewpoint to form a full-color complete image. At this time, the three micro-displays can be distributed in any three of the four positions of the upper, lower, left and right of the edge of the lens; or they can all display a complete full-color image and project it to the same viewpoint to form a brighter image.

The display system is started, the micro display module 104 projects the image to the light control module 105 for light shaping, and projects the light of each micro display module to the same viewpoint through the coupling into the eye module 106. At the same time, the ambient light can also be normally transmitted to the pupil through the compensation module 109.

Embodiment 3

As shown in Figure 5, the present invention provides a near-eye display system for side-entry projection at the edge of a lens, the system comprising: a micro-display module, a light control module, an eye coupling module, an eye tracking module and a compensation module. The micro-display module, the light control module and the eye coupling module are encapsulated together in the lens, wherein the lens material includes but is not limited to glass, plastic, resin, crystal material, etc.

The optical structural features referred to in this embodiment are similar to those in the first embodiment and will not be repeated here.

The eye coupling module 106 in this embodiment no longer projects light onto the pupil to form a viewpoint, but diverges and amplifies the incident light from the light control module 105, and focuses it in the opposite direction on the side of the lens away from the pupil to form a virtual image. The side reflection surface of the eye coupling module 106 includes but is not limited to polarization volume holographic surface, volume holographic surface, metasurface, relief diffraction surface, off-axis reflection optical surface, etc., and multiple materials can be used in the same system; when the eye coupling module is a holographic surface with polarization selectivity, the light control module 105 can include a polarization converter that can convert light from the microdisplay into left/right circularly polarized light; the holographic surface is made by light alignment polarization holography, in which two beams of circularly polarized light interfere on the light alignment material, and it only responds to circularly polarized light in one rotation direction, and can reflect a beam of collimated circularly polarized light incident at a certain angle as convergent circularly polarized light emitted in other directions, while not affecting another circularly polarized light contained in the ambient light. The circular polarized light of the rotating direction passes through; according to the reflection path set when manufacturing the holographic surface, the holographic surface can reflect and diverge the collimated light beam from the light control module to form a virtual projection image surface in the opposite direction; when the eye coupling module of the system is an off-axis curved optical system that normally reflects light, such as a free-form surface, an off-axis parabolic mirror, etc., the reflection surface is curved with a certain curvature. When the curvature curve of the curved surface can be represented by a parabolic function, it is an off-axis parabolic mirror. When the curvature curve of the curved surface is difficult to represent by a function, it is a free-form reflective surface; the collimated light beam transmitted by the light control module can be focused by the off-axis reflection surface to form a projection. Since the angle of the reflected light at each point of the off-axis reflection surface is different, the light can be diverged by design. Since the light divergence degree of the eye coupling module corresponding to each micro-display is different, each micro-display module can form a virtual image of different depths, forming a multi-image projection, and alleviating the convergence conflict. When the side surface of the eye coupling module 106 is an off-axis reflective optical surface, the ambient light passing through the module will be distorted to a certain extent, and a compensation module needs to be used to compensate for it.

The display system is started, the micro display module 104 projects the image to the light control module 105 for light beam shaping, and diverges the light of each micro display module through the coupling into the eye module 106, and forms a virtual image plane in the opposite direction. At the same time, the ambient light can also be normally transmitted to the pupil through the compensation module 109.

Figure 6 shows the types of eye-into-eye coupling modules of the present invention and their three-dimensional stereograms: (a) the retina projected into the eye by holographic surface reflection, (b) the multiple virtual image planes reflected by the holographic surface enter the eye, (c) the retina projected into the eye by free-form surface reflection, and (d) the multiple virtual image planes reflected by the free-form surface enter the eye.

The above are preferred embodiments of the present invention. Any changes made according to the technical solution of the present invention, as long as the resulting functions do not exceed the scope of the technical solution of the present invention, belong to the protection scope of the present invention.

Claims (10)

1. A near-eye display system with side-entry projection at the edge of a lens, characterized in that it comprises a micro-display module, a light control module, an eye coupling module, an eye tracking module and a compensation module; wherein: The micro display modules are distributed inside the edge of the lens or outside the edge of the complete lens, and at least one group of micro display modules is evenly or unevenly distributed along the edge of the lens, and the light emission direction of the micro display module screen points to the center of the lens; The light control module includes a beam shaping lens group, which performs shaping functions including collimation, convergence and divergence on the light beam according to the requirements of the eye coupling module; The eye coupling module is placed at the symmetrical center of the lens, or at a position aligned with the center of the pupil according to the wearing position of the human eye. The eye coupling module is provided with a reflective surface, and adopts different structural design schemes to adjust the light to be observed in the pupil of the human eye; The eye tracking module is placed above the lens or somewhere else where it can capture the position of the pupil. 2. A near-eye display system with side-entry projection on the edge of a lens according to claim 1, characterized in that the system emits an image from a micro-display module on the side of the lens, shapes the light through a light control module, and then the light is incident on a multi-directional prism of an eye coupling module to be reflected and focused into the eye, thereby realizing retinal projection and also being able to magnify the micro-display image to form a virtual image at a distance for human eye observation. 3. A near-eye display system for side-entry projection on the edge of a lens according to claim 1 or 2, characterized in that the light of multiple micro-display modules is focused to the center of the pupil to form a plurality of viewpoints arranged in a tiled manner by adjusting the inclination angle of the reflective surface of the eye coupling module; or can be focused to different depth positions or the same point by adjusting the material properties of the reflective surface of the eye coupling module; or can utilize the light divergence function of the reflective surface of the eye coupling module to magnify the micro-display image and project it on a distant virtual image plane to form a virtual image; when a plurality of viewpoints are arranged in a tiled manner, if one of the viewpoints falls into the pupil range, the complete image can be observed, and multiple viewpoints achieve pupil expansion, thereby improving the eye movement range; when When forming viewpoints of different depths, different pupil distances are met; when focusing on the same point, the system has only one viewpoint, but the brightness of the viewpoint is superimposed, and different monochromatic lights can be displayed in different micro-display modules, and multi-color superposition can be achieved at the same position, or the method of splicing images can be used, with each micro-display module displaying a different position of an image, and then the light is converged at one point to achieve image stitching; when using virtual image plane projection, each micro-display module uses the corresponding eye coupling module to make the corresponding light diverge to different degrees, forming virtual images of different depths, so that the wearer's line of sight does not have to be focused on one plane all the time, alleviating convergence conflicts and improving the wearer's experience. 4. A near-eye display system for side-entry projection on the edge of a lens according to claim 1, characterized in that the reflective surface material of the eye coupling module includes a polarized volume holographic surface, a volume holographic surface, a metasurface, an embossed diffraction surface, and an off-axis reflective optical surface, and multiple materials can be used in the same system; when the reflective surface of the eye coupling module is a holographic surface with polarization selectivity, the light regulation module also includes a polarization converter capable of converting light from the micro-display module into left/right circularly polarized light; the holographic surface is formed by interference of two beams of circularly polarized light on a photopolymer material, and only responds to circularly polarized light of one rotation direction, and can reflect a beam of collimated circularly polarized light incident at a predetermined angle as a circularly polarized light that can be emitted in other directions and can be converged, while not affecting the passage of circularly polarized light of another rotation direction contained in the ambient light; according to the reflective surface set when the holographic surface is manufactured path, the holographic surface can focus the collimated light beam from the light control module into a viewpoint to form a projection picture; when the reflective surface of the eye coupling module is a polarizer holographic surface, the light enters the eye through Bragg diffraction, and the liquid crystal molecules in the surface rotate along their own optical axis, and can diffract circularly polarized light with the same rotation direction as their own liquid crystal molecules, and diffract the light emitted by the light control module into the eye; when the eye coupling module is an off-axis curved optical system that normally reflects light, the reflective surface of the eye coupling module is bent with a predetermined curvature, and when the curvature curve of the curved surface can be represented by a parabolic function, it is an off-axis parabolic mirror, and the curvature curve of the curved surface can also be defined by a free surface; the collimated light beam transmitted by the light control module can be focused by the off-axis reflective surface to form a projection, and since the angle of reflected light at each point of the off-axis reflective curved surface is different, the light can be converged or diverged into the eye through design. 5. A near-eye display system for side-entry projection at the edge of a lens according to claim 1, characterized in that the beam shaping lens group is composed of a liquid crystal lens, a metasurface structure, a Fresnel lens, a microlens array, a superlens and a holographic optical element; when the beam shaping lens group is a lens group with a beam shaping function, the lens composition includes a free combination of a liquid crystal lens, a metasurface structure, a Fresnel lens, a microarray lens, a superlens and a holographic optical element; in actual application, the beam shaping lens group is selected according to different parameter indicators to ensure that the light emitted by the micro display module can be shaped; when the reflection surface of the eye coupling module is a reflection surface with polarization selectivity, the light regulation module also includes a polarization conversion module that enables the eye coupling module to only work on circularly polarized light in one direction without affecting the transmission of ambient light; the polarization conversion module is composed of a linear polarizer and a quarter wave plate, the linear polarizer decomposes the light from the micro display screen into two linear polarized lights with perpendicular vibration directions, and then the phase of the linear polarized light in one direction is advanced or delayed by a quarter of a cycle through the quarter wave plate, so as to be converted into circularly polarized light with different rotation directions. 6. A near-eye display system for side-entry projection at the edge of a lens according to claim 4, characterized in that the shape of the lens includes a circular or quadrilateral, hexagonal polygon with symmetrical features, each micro-display module has a corresponding reflection surface of the eye coupling module to reflect light, ensuring that the light of each micro-display module can enter the eye; the micro-display module, the light regulation module, and the eye coupling module are encapsulated together in the lens, wherein the lens material includes glass, plastic, resin, and crystal material, or the micro-display module, the light regulation module, and the eye coupling module are not encapsulated together in the lens, so that the light can be regulated by the light regulation module and projected into the eye by the eye coupling module; the images emitted by the micro-display modules at different positions are designed to be projected to any viewpoint position within a predetermined range according to the different geometric shapes of the eye coupling module; the eye coupling module The geometric shape of the module is a multi-directional pyramid, the top and bottom of the multi-directional pyramid are both polygonal geometric faces, and the area of the top polygon is smaller than that of the bottom polygon, and the sides of the top and bottom polygons are parallel to each other; when the reflective surface is a plane, the specific horizontal position of the upper plane is determined according to the required inclination angle of each reflective surface; when the reflective surface is a curved surface, the specific position of the upper plane is determined according to the designed free-form surface or off-axis parabola, and the geometric shape of the eye-in coupling module is a curved-edge pyramid; after determining the geometric shape, the corresponding optical element film is manufactured on the reflective surface, including a metasurface film, a holographic surface film, a volume holographic surface film, an off-axis parabolic reflective surface film, and a free-form reflective film; the field of view of the entire system is restricted by the size of the eye-in coupling module and the inclination or curvature of the corresponding reflective surface, and different field of view angles can be customized according to the wearer's needs. 7. A near-eye display system for side-entry projection of lens edge according to claim 1, characterized in that when the system is applied to the holographic surface reflection retinal projection into the eye, the distance from the reflection surface to the viewpoint of the eye is called f1, and when the holographic reflection surface is made, two beams of light are simultaneously irradiated on the substrate to interfere and form a light orientation pattern, one beam of light is collimated parallel light, representing the collimated light beam emitted from the light regulation module, and the other beam of light is collimated parallel light with the same intensity, which passes through a lens with a focal length of f1 and then irradiates the substrate, and the distance between the lens and the substrate is 2f1. At this time, the simulated phase profile at each point on the substrate is Expressed as a formula: Where λ represents the wavelength of the incident light, x, y represent the coordinates of the point on the substrate, f represents the focal length, i.e. f1, and θ represents the inclination angle of the substrate compared to the vertical direction. When the system is applied to the multi-virtual image plane of holographic surface reflection, the distance from the reflection surface to the virtual focus is called f2. When making a holographic reflection surface, two beams of light are simultaneously irradiated on the substrate to form an interference pattern. One beam of light is parallel light, representing the collimated light beam emitted from the light control module, and the other beam of light is parallel light of the same intensity and then irradiates on the substrate through a lens with a focal length of f2. The distance between the mirror and the substrate is 2f2. At this time, the phase at each point on the substrate can also be expressed by the above formula. When the system is applied to the reflection of non-holographic surface into the eye, the system needs to satisfy the equal optical path of the light from the micro display module to the final eye. Assuming that there are two points (x1, y1, z1) and (x2, y2, z2) on the micro display module, the light emitted by these two points passes through the points (x3, y3, z3) and (x4, y4, z4) on the eye coupling module respectively, and finally focuses on the point (x5, y5, z5), then it should satisfy: Where n1 represents the refractive index of the lens, and n2 represents the refractive index of air; if it is a reverse virtual image entering the eye, then (x5, y5, z5) is the coordinate of the point where the virtual image is focused. 8. According to a near-eye display system with side-entry projection on the edge of a lens as described in claim 1, it is characterized in that the eye tracking module is composed of a camera and an image processing chip, and the camera is located close to the lens and is used to capture the position of the eyeball; when the eye-entry method is retinal projection, since the image of each micro-display module is projected at a different viewpoint, after the camera captures the position information of the eyeball, the image processing chip identifies the current pupil position through image recognition technology, and controls the micro-display module whose corresponding viewpoint falls into the current pupil position to turn on. 9. A near-eye display system for side-entry projection on the edge of a lens according to claim 1, characterized in that, when the eye coupling module adopts a curved off-axis reflection system, the reflection method adopted is to coat a layer of semi-transparent and semi-reflective thin film material, which will have a reflection effect on the ambient light. At this time, the system also includes a compensation module for compensating for the external ambient light distorted by the coupled eye module; when the eye coupling module adopts a metasurface, a surface relief diffraction surface and a tiny geometric shape of the reflective surface to realize the diffraction of light, the eye coupling module will have a partial refraction effect on the ambient light. At this time, the system also includes a compensation module for compensating for the external ambient light distorted by the coupled eye module. 10. A near-eye display system with side-entry projection on the edge of a lens according to claim 1, characterized in that when the system is used in a VR system, it is no longer necessary to consider the propagation of ambient light, and the front end of the lens is shielded by a sunshade, or the system is applied to a head-mounted virtual reality display device, and the micro-display module no longer needs to be fixed in the lens, but emits light at a corresponding position in the head-mounted device, and is reflected into the eye by an eye-entry coupling module; the system is combined with special lenses including infrared cameras and zoom cameras to switch and display infrared images, distant images, and close-up images, and can be applied to military tactical helmets; the head-mounted near-eye display device made by the system can be combined with sensors and cameras to capture iris information to achieve functions including identity authentication and health monitoring; the system can be used for a single eye alone or for both eyes. When used for binoculars, the optical structure of the left and right eyes is consistent, and the difference is that the left and right eye images displayed by the micro-display module are slightly different, so as to form a stereoscopic image in human vision.