CN108072978A - A kind of augmented reality wears display device - Google Patents

Abstract

The invention discloses an augmented reality head-mounted display device, comprising: an objective lens group, a spatial light modulator, used to modulate the incident light of the external scene, so as to block the part that needs to be blocked; a first eyepiece lens group, configured to magnify the modulated image of the external scene from the spatial light modulator; a first optical waveguide configured to conduct the magnified modulated image from the first eyepiece lens group; an array of fiber optic scanners configured to construct the desired displayed light a field image, a second eyepiece lens set configured to magnify the light field image; a second optical waveguide configured to conduct the magnified light field image from the second eyepiece lens set and the modulated image from the first optical waveguide , the light field image is combined with the modulated image to generate a combined image and transmitted to the human eye. The invention realizes that the light field image can cover the light corresponding to the real physical environment, and improves the user's visual experience.

Description

An augmented reality head-mounted display device

technical field

The present invention relates to the field of augmented reality technology, in particular to an augmented reality head-mounted display device.

Background technique

Augmented reality (English: Augmented Reality; abbreviation: AR) is a technology that uses virtual objects or information to enhance the reality of real scenes. Augmented reality technology is usually based on the real physical environment images obtained by image acquisition equipment such as cameras, through computer system recognition analysis and query retrieval, the virtual generated enhanced images such as associated text content, image content or image models are displayed on the real physical environment. In the environment image, users can obtain related extended information such as annotations and descriptions of real objects in the real physical environment, or experience the three-dimensional, highlighted and enhanced visual effects of real objects in the real physical environment.

However, when the enhanced image is displayed in the real physical environment image, since the light corresponding to the real physical environment covered by the enhanced image is not blocked, this part of the light will still enter the human eye. If the part of the light is strong , it will make the contrast of the area where the enhanced image is located is low, so that the user cannot recognize the content of the enhanced image, or the recognition effect is poor, and finally the visual experience provided by the augmented reality technology to the user is poor.

Therefore, in the prior art, because the augmented reality technology does not block the light corresponding to the real physical environment covered by the enhanced image, the visual experience provided by the augmented reality technology to the user is poor.

Contents of the invention

An embodiment of the present invention provides an augmented reality head-mounted display device, which is used to solve the technical problem that the augmented reality technology provides users with poor visual experience because the augmented reality technology does not block the light corresponding to the real physical environment covered by the augmented image. .

In order to achieve the purpose of the above invention, the present invention provides an augmented reality head-mounted display device, including:

an objective lens group configured to receive incident light from an external scene in the real world and focus the light onto the spatial light modulator;

a spatial light modulator, configured to modulate the incident light of the external scene to block the part that needs to be blocked;

a first eyepiece lens set configured to magnify the modulated image of the external scene from the spatial light modulator;

a first optical waveguide configured to conduct the magnified modulated image from the first eyepiece lens set;

an array of light scanners for constructing the light field image to be displayed,

a second eyepiece lens group configured to magnify the light field image;

a second optical waveguide configured to transmit the magnified light field image from the second eyepiece lens set and the modulated image from the first optical waveguide, the light field image and the modulated image are combined to produce a combined image and It is transmitted to human eyes, and the user observes the combined image of the enlarged modulated image and the enlarged light field image.

In the present invention, the image of the external scene is modulated on demand, the part of the image of the external scene that needs to be blocked is blocked by the spatial light modulator, and the modulated image is transmitted through the first optical waveguide and the second optical waveguide in sequence; At the same time, the light field image to be displayed by the optical scanner array structure is transmitted through the second optical waveguide, so that the modulated image is combined with the light field image, and the light field image can cover the light corresponding to the real physical environment, Improve the user's visual experience.

Therefore, preferably, the part to be blocked is the part to be blocked corresponding to the light field image.

Optionally, the spatial light modulator is a reflective spatial light modulator.

Further optionally, the reflectivity of the reflective spatial light modulator is controlled so as to only reflect light from parts of the external scene that do not need to be blocked; the augmented reality head-mounted display device further includes a polarized The beam splitter is configured to: receive the incident light of the external scene from the objective lens group, and direct the incident light of the external scene to the spatial light modulator; and receive the modulated image of the external scene from the spatial light modulator and project it to the second An eyepiece lens set. Therefore, only the light of the image that does not need to be blocked is reflected and enters the subsequent optical element for imaging, so that the part that needs to be blocked is not imaged.

Further optionally, the reflective spatial light modulator is used to perform polarization conversion on the external scene light; the augmented reality head-mounted display device also includes a polarizing beam splitter configured to: receive light from the objective lens The incident light of the external scene is grouped, and the incident light of the external scene is directed to the spatial light modulator; and the modulated image of the external scene received from the spatial light modulator is directed to the first eyepiece lens group.

Further preferably, the polarizing beam splitter is a plane mirror capable of reversing P polarization and reversible S polarization or a plane mirror capable of reversing P polarization and reversing S polarization.

Further preferably, the objective lens group includes:

an imaging lens group configured to receive incident light from an external scene in the real world and focus the light;

The light turning mirror group is configured to receive the light emitted by the imaging mirror group and direct the light to the polarizing beam splitter.

Optionally, the spatial light modulator is a transmissive spatial light modulator whose opacity is controlled to block light from part of the external scene.

Further preferably, the objective lens group includes:

an imaging lens group configured to receive incident light from an external scene in the real world and focus the light;

The light turning mirror group is configured to receive the light emitted by the imaging mirror group and send the light to the spatial light modulator.

The array of light scanners is capable of constructing images with different depths.

Preferably, the part to be blocked is a part to be blocked corresponding to the light field image. Therefore, in the image observed by the user at the exit pupil position, the enlarged light field image blocks the enlarged modulated image.

One or more technical solutions in the embodiments of the present invention have at least the following technical effects or advantages:

In the present invention, the image of the external scene is modulated on demand, the part of the image of the external scene that needs to be blocked is blocked by the spatial light modulator, and the modulated image is transmitted through the first optical waveguide and the second optical waveguide in sequence; At the same time, the light field image to be displayed by the optical scanner array structure is transmitted through the second optical waveguide, so that the modulated image is combined with the light field image, and the light field image can cover the light corresponding to the real physical environment, Improve the user's visual experience.

Description of drawings

Fig. 1 is a structural representation of an embodiment of the present invention;

Fig. 2 is a schematic structural diagram of another embodiment of the present invention.

In the figure,

1-objective lens group, 101-imaging mirror group, 1021-first plane mirror, 1022-second plane mirror, 1023-third plane mirror, 2-spatial light modulator, 201-reflective spatial light modulation device, 202-transmissive spatial light modulator, 3-first eyepiece lens group, 4-first optical waveguide, 5-ray scanner array, 6-second eyepiece lens group, 7-second optical waveguide, 8- Polarizing Beamsplitter.

Detailed ways

The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

The embodiments of the present invention provide a solution to the technical problem that the augmented reality technology provides users with poor visual experience because the augmented reality technology does not block the light corresponding to the real physical environment covered by the enhanced image.

As shown in FIG. 1, an embodiment of the present invention provides an augmented reality head-mounted display device, including:

The objective lens group 1 is configured to receive incident light from an external scene in the real world, and focus the light onto the spatial light modulator;

A spatial light modulator 2, configured to modulate the incident light of the external scene to block the part that needs to be blocked;

The first eyepiece lens group 3 is configured to amplify the modulated image of the external scene from the spatial light modulator;

a first optical waveguide 4 configured to conduct the amplified modulated image from the first eyepiece lens set;

The light scanner array 5 is used to construct the light field image to be displayed,

The second eyepiece lens group 6 is configured to magnify the light field image;

The second optical waveguide 7 is configured to transmit the enlarged light field image from the second eyepiece lens group and the modulated image from the first optical waveguide, the light field image and the modulated image are combined to generate a combined image and transmitted to human eyes, and the user observes the combined image of the amplified modulation image and the amplified light field image.

In the present invention, the image of the external scene is modulated on demand, the part of the image of the external scene that needs to be blocked is blocked by the spatial light modulator 2, and the modulated image passes through the first optical waveguide 4 and the second optical waveguide 7 in sequence At the same time, the light field image to be displayed by the optical scanner array 5 is transmitted through the second optical waveguide 7, so that the modulated image is combined with the light field image, and the light field image can cover the real physical The light corresponding to the environment improves the user's visual experience.

Therefore, preferably, the part to be blocked is the part to be blocked corresponding to the light field image, so that the enlarged light field image in the image observed by the user blocks the enlarged modulated image.

Optionally, as shown in FIG. 1 , the spatial light modulator is a reflective spatial light modulator 201 .

In some embodiments of the present invention, the reflectivity of the reflective spatial light modulator 201 is controlled so as to only reflect light from parts of the external scene that do not need to be blocked; the augmented reality head-mounted display device Also includes a polarizing beam splitter 8, which is configured to: receive the incident light of the external scene from the objective lens group 1, and direct the incident light of the external scene to the reflective spatial light modulator 201; and receive the incident light from the reflective spatial light modulator 201; The modulated image of the external scene of the modulator 201 is directed to the first eyepiece lens group 3 . Therefore, only the light of the image that does not need to be blocked is reflected and enters the subsequent optical element for imaging, so that the part that needs to be blocked is not imaged.

In other embodiments of the present invention, the reflective spatial light modulator 201 is used to perform polarization conversion on the external scene light; the augmented reality head-mounted display device further includes a polarizing beam splitter 8, which is It is configured to: receive the incident light of the external scene from the objective lens group 1, and direct the incident light of the external scene to the reflective spatial light modulator 201; and receive the modulated image of the external scene from the reflective spatial light modulator 201 to project 3 toward the first eyepiece lens group.

The reflective spatial light modulator 201 converts P-polarized light into S-polarized light, or converts S-polarized light into P-polarized light. Then the polarizing beam splitter 8 can be a polarizing beam splitter. In the specific implementation process, the polarizing beam splitting mirror 8 can be a P-polarized, S-polarized, and reversible plane mirror or a P-polarized, S-polarized, and reversible plane mirror. In the illustration, the polarizing beam splitter 8 is an example of a P-polarization-transmitting S-polarization-reversible plane mirror. Specifically, the external ambient light includes both P-polarized light and S-polarized light, and the P-polarized and S-polarized reversible plane mirror can pass through the P-polarized light, but cannot pass through the S-polarized light. Therefore, the S-polarized light in the external ambient light The light cannot pass through the polarizing beam splitter 8 and is reflected into the reflective spatial light modulator 201 . The P-polarized light can pass through the polarizing beam splitter 8 and cannot enter the reflective spatial light modulator 201 .

In the embodiment of the present invention, after the S-polarized light is incident on the reflective spatial light modulator 201, the reflective spatial light modulator 201 does not perform polarization conversion on the external ambient light of the part to be shielded. Therefore, the external ambient light of the part to be shielded It is still S-polarized light, and other ambient light that does not need to be shielded is converted into P-polarized light. Therefore, the P-polarized light emitted by the reflective spatial light modulator 201 is imaged through the polarizing beam splitter 8, while the ambient light in the part to be blocked is still S-polarized light that cannot pass through the polarizing beam splitter 8, so it does not need to be blocked The light of the image is reflected and made to enter the subsequent optical elements for imaging, so that the part that needs to be blocked is not imaged.

Further preferably, the objective lens group includes:

The imaging lens group 101 is configured to receive incident light from an external scene in the real world and focus the light;

The light turning mirror group is configured to receive the light emitted by the imaging mirror group and direct the light to the polarizing beam splitter.

As shown in Figure 1, it is a typical layout structure of the light turning mirror group when the reflective spatial light modulator 201 is used. A plane reflector 1021 and a second plane reflector 1022 that reflects the vertically upwardly transmitted light into the polarized beam splitter 8 horizontally. Therefore, the light beam is horizontally arranged with the polarizing beam splitter 8 at an angle of 45° to the horizontal plane, and the polarizing beam splitter 8 reflects the S light to the reflective spatial light modulator 201 above it, and the reflective spatial light modulator 201 does not need The shielded part of ambient light is converted into P-polarized light, and the P-polarized light passes through the polarizing beam splitter 8 and enters the first eyepiece lens group 3 for imaging.

In some embodiments of the present invention, as shown in FIG. 2 , the spatial light modulator is a transmissive spatial light modulator 202 whose opacity is controlled to block light from part of the external scene. Specifically, the transmissive spatial light modulator 202 only transmits the light of images that do not need to be blocked, and makes it enter subsequent optical elements for imaging, and the transmissive spatial light modulator 202 does not transmit light that needs to be blocked. The light of the image, so that this part of the light cannot enter the subsequent optical elements and cannot be imaged, so as to achieve the technical effect of not imaging the part that needs to be blocked.

Further preferably, the objective lens group includes:

The imaging lens group 101 is configured to receive incident light from an external scene in the real world and focus the light;

The light turning mirror group is configured to receive the light emitted by the imaging mirror group and send the light to the transmissive spatial light modulator 202 .

As shown in Fig. 2, it is a typical layout structure of the light turning mirror group when the transmission type spatial light modulator 202 is used. The third plane reflector 1023 , so that the light is vertically incident on the transmissive spatial light modulator 202 located below the third plane reflector 1023 . The transmissive spatial light modulator 202 only transmits the light of the image that does not need to be blocked, and makes it enter the subsequent optical element for imaging, but does not transmit the light of the image that needs to be blocked, so that this part of the light No access to subsequent optics, no imaging.

The light scanner array 5 is capable of constructing images with different depths. Specifically, the optical scanner array 5 includes a plurality of optical scanners, and the optical scanner array 5 can construct images with different depths, that is, light field images. Specifically, the optical scanner array 5 includes multiple The augmented reality head-mounted display device can control the scanning parameters of each light scanner according to the enhanced image to be displayed, so as to scan the light corresponding to the enhanced image into the space through multiple light scanners, When the light enters the human eye, it looks like the light emitted by a real object.

It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" or "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention can be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means can be embodied by one and the same item of hardware. The use of the words first, second, third, etc. does not indicate any order, and these words may be interpreted as augmented reality headsets.

All features disclosed in this specification, or steps in all methods or processes disclosed, may be combined in any manner, except for mutually exclusive features and/or steps.

Any feature disclosed in this specification (including any appended claims, abstract and drawings), unless expressly stated otherwise, may be replaced by alternative features which are equivalent or serve a similar purpose. That is, unless expressly stated otherwise, each feature is one example only of a series of equivalent or similar features.

The present invention is not limited to the foregoing specific embodiments. The present invention extends to any new feature or any new combination disclosed in this specification, and any new method or process step or any new combination disclosed.

It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" or "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. In a unit claim enumerating several means, several of these means can be embodied by one and the same item of hardware. The use of the words first, second, third, etc. does not indicate any order, and these words may be interpreted as augmented reality headsets.

One or more technical solutions in the embodiments of the present invention have at least the following technical effects or advantages:

In the present invention, the image of the external scene is modulated on demand, the part of the image of the external scene that needs to be blocked is blocked by the spatial light modulator, and the modulated image is transmitted through the first optical waveguide and the second optical waveguide in sequence; At the same time, the light field image to be displayed by the optical scanner array structure is transmitted through the second optical waveguide, so that the modulated image is combined with the light field image, and the light field image can cover the light corresponding to the real physical environment, Improve the user's visual experience.

All the features disclosed in this specification, except mutually exclusive features and/or steps, can be combined in any way.

Any feature disclosed in this specification (including any appended claims, abstract and drawings), unless expressly stated otherwise, may be replaced by alternative features which are equivalent or serve a similar purpose. That is, unless expressly stated otherwise, each feature is one example only of a series of equivalent or similar features.

The present invention is not limited to the foregoing specific embodiments. The present invention extends to any new feature or any new combination disclosed in this specification, and any new method or process step or any new combination disclosed.

Claims (10)

1. a kind of augmented reality wears display device, which is characterized in that including：

Object lens microscope group, is configured as receiving the incident light of the outer scene in real world, and the light is focused on sky Between on optical modulator；

Spatial light modulator, for modulating the incident light of the outer scene, to block the part for needing to be blocked；

First eyepiece microscope group is configured as the modulation image of outer scene of the amplification from spatial light modulator；

First fiber waveguide is configured as amplified modulation image of the conduction from the first eyepiece microscope group；

Light scanning device array, for constructing the light field image of required display,

Second eyepiece microscope group is configured as amplifying the light field image；

Second fiber waveguide is configured as conducting amplified light field image from the second eyepiece microscope group and from the first fiber waveguide Modulation image, the light field image merges with the modulation image to be generated the image combined and is transferred to human eye.

2. a kind of augmented reality as described in claim 1 wears display device, which is characterized in that the spatial light modulator For reflective slms.

3. a kind of augmented reality as claimed in claim 2 wears display device, which is characterized in that the reflective spatial light The reflectivity of modulator is controlled to only reflect the light of the part that need not be blocked from the outer scene, the increasing Strong reality wears display device and further includes polarization-type spectroscope, is configured as：Receive the outer scene from object lens microscope group Incident light, will be in the incident light directive spatial light modulator of outer scene；And receive the outer scene from spatial light modulator Modulation image directive the first eyepiece microscope group.

4. a kind of augmented reality as claimed in claim 2 wears display device, which is characterized in that the reflective spatial light Modulator is used to carry out polarization conversion to the outer scene light；The augmented reality wears display device and further includes polarization Type spectroscope, is configured as：The incident light of the outer scene from object lens microscope group is received, by the incident light directive of outer scene In spatial light modulator；And receive modulation image directive the first eyepiece microscope group of the outer scene from spatial light modulator.

5. a kind of augmented reality as described in claim 3 or 4 wears display device, which is characterized in that the polarization-type light splitting Mirror for P polarization can thoroughly S-polarization can antiplane mirror or P polarization can anti-S-polarization can saturating plane mirror.

6. a kind of augmented reality as described in claim 1 wears display device, which is characterized in that the spatial light modulator For transmissive spatial light modulator, opacity is controlled to block the light from the part of the outer scene.

7. a kind of augmented reality as described in any one in claim 1 or 6 wears display device, which is characterized in that described Object lens microscope group includes：

Microscope group is imaged, is configured as receiving the incident light of the outer scene in real world, and the light is focused on；

Light ray bending microscope group is configured as receiving the light that imaging microscope group projects and by the smooth directive spatial light modulator.

8. a kind of augmented reality as described in any one in claim 3-5 wears display device, which is characterized in that the object Mirror microscope group includes：

Microscope group is imaged, is configured as receiving the incident light of the outer scene in real world, and the light is focused on；

Light ray bending microscope group is configured as receiving the light that imaging microscope group projects and by the smooth directive polarization-type spectroscope.

9. a kind of augmented reality as described in any one in claim 1-8 wears display device, which is characterized in that described Light scanning device array can construct the image with different depth.

10. a kind of augmented reality as described in any one in claim 1-9 wears display device, which is characterized in that described The part that is blocked of needs treat shield portions to be corresponding with the light field image.