CN114326104A - Augmented reality glasses with structured light detection - Google Patents

Abstract

The present invention provides augmented reality glasses with structured light detection function, comprising a laser projector, glasses lenses, at least one first diffractive optical element film, an invisible light camera and a second diffractive optical element film. The laser projector is used for emitting at least one invisible beam and an image beam. The at least one first diffractive optical element film is disposed on the spectacle lens. The first diffractive optical element is used for diffracting the invisible light beam into a structured light beam, wherein the structured light beam is transmitted to the object to be tested, so as to form a light pattern on the object to be tested. Invisible light cameras are used to capture light patterns on the object to be tested. The second diffractive optical element film is disposed on the spectacle lens, and the second diffractive optical element film is used to transmit the image beam to the eye.

Description

Augmented reality glasses with structured light detection

technical field

The present invention relates to an augmented reality display, in particular to augmented reality glasses with a structured light detection function.

Background technique

With the progress of display technology, virtual reality display technology and augmented reality display technology are gradually popularized and fully researched and developed. The virtual reality display technology allows users to immerse themselves in the virtual world displayed on the monitor, and can display stereoscopic images. Augmented reality display technology not only allows users to see images in the virtual world, but also objects in the real world, and even enables the images of the virtual world to interact with objects in the real world.

When the display provides the user's eyes with an image of the virtual world (ie, a virtual image), if the system can know the position and rotation angle of the eyes, the corresponding virtual image can be provided, resulting in a better display effect. However, when an eye tracker is to be added to an augmented reality display device, the number of components is too large and the system is too complicated.

SUMMARY OF THE INVENTION

The present invention is directed to augmented reality glasses with a structured light detection function, which integrates a light source of structured light into a laser projector for displaying images, so that it can have a simpler structure and a smaller number of components.

An embodiment of the present invention provides augmented reality glasses with structured light detection function, which are suitable for wearing in front of eyes. Augmented reality glasses with structured light detection function include a laser projector, glasses lenses, at least one first diffractive optical element (DOE) film, an invisible light camera and a second diffractive optical element film. The laser projector is used for emitting at least one invisible beam and an image beam, and the spectacle lenses are arranged on the paths of the invisible beam and the image beam. The at least one first diffractive optical element film is disposed on the spectacle lens and is located on the path of the invisible light beam. The first diffractive optical element is used for diffracting the invisible light beam into a structured light beam, wherein the structured light beam is transmitted to the object to be tested, so as to form a light pattern on the object to be tested. Invisible light cameras are used to capture light patterns on the object to be tested. The second diffractive optical element film is disposed on the spectacle lens and is located on the path of the image beam, and the second diffractive optical element film is used to transmit the image beam to the eye.

In the augmented reality glasses with structured light detection function according to the embodiment of the present invention, the laser projector not only emits an image beam, but also emits an invisible beam, and the invisible beam is diffracted by the first diffractive optical element. A structured light beam is formed, which is used to detect the object to be tested. That is to say, the embodiment of the present invention integrates the light source of structured light into the laser projector for displaying images, so the augmented reality glasses with structured light detection function can have a simpler structure and a smaller number of components , and at the same time achieve the functions of displaying images and detecting objects to be tested.

Description of drawings

1 is a schematic diagram of an optical path of augmented reality glasses with structured light detection function according to an embodiment of the present invention;

FIG. 2 is a schematic diagram of the optical path of the laser projector in FIG. 1;

3 is a schematic view of the structured light beam of FIG. 1 forming a light pattern on the eye;

Fig. 4 shows the scanning paths and positions of the red light beam, the green light beam, the blue light beam and the infrared light beam of Fig. 2 on the spectacle lens;

5 is a schematic perspective view of an embodiment of the first diffractive optical element film in FIG. 1;

6 is a schematic perspective view of another embodiment of the first diffractive optical element in FIG. 1;

7 is a schematic diagram of an optical path of augmented reality glasses with a structured light detection function according to another embodiment of the present invention;

FIG. 8 is a schematic front view of the spectacle lens in FIG. 7 as viewed from the line of sight of the eye;

FIG. 9 is a schematic diagram of the optical path of the laser projector in FIG. 7;

10 is a schematic front view of a spectacle lens in the augmented reality glasses with structured light detection function according to another embodiment, looking from the line of sight of the eye;

11 is a schematic front view of a spectacle lens in the augmented reality glasses with structured light detection function according to yet another embodiment, looking from the line of sight of the eye;

12 is a schematic diagram of an optical path of augmented reality glasses with a structured light detection function according to yet another embodiment of the present invention.

Description of reference numerals

50: eyes

60: External Objects

100, 100b, 100d: Augmented reality glasses with structured light detection

110: glasses lenses

112: Surface

120, 120a, 120b, 120c, 120d, 124b, 124c, 126b, 126c, 128c, 129c: first diffractive optical element film

122, 122a: Microstructure

130: Invisible light camera

140: Second diffractive optical element film

150: glasses frame

160: Processor

200: Laser Projector

201: Light Patterns

202, 202b, 2021, 2022: Invisible Beams

202': Infrared beam

203: Structured Beam

204: Image Beam

210: Infrared laser source

220: Laser source

221: red beam

222: red laser source

223: Green Beam

224: Green laser source

225: blue beam

226: blue laser source

230: Combined light module

232, 234, 236: Dichroic mirror

240: Scanning mirror

I1: light spot

I2: red light scan path

I3: Green light scan path

I4: Blu-ray scan path

Detailed ways

Reference will now be made in detail to the exemplary embodiments of the present invention, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numerals are used in the drawings and description to refer to the same or like parts.

1 is a schematic diagram of the optical path of augmented reality glasses with structured light detection function according to an embodiment of the present invention, FIG. 2 is a schematic diagram of the optical path of the laser projector in FIG. 1 , and FIG. 3 is a diagram of the structured light beam of FIG. Schematic diagram of forming a glazing pattern. Referring to FIGS. 1 to 3 , the augmented reality glasses 100 with structured light detection function of the present embodiment are suitable to be worn in front of the eyes 50 , and the augmented reality glasses 100 with structured light detection function include a laser projector 200 , a spectacle lens 110 , at least one first diffractive optical element film 120 (in FIG. 1 , a first diffractive optical element film 120 is taken as an example), an invisible light camera 130 and a second diffractive optical element film 140 . The laser projector 200 is used to emit at least one invisible beam 202 (in FIG. 1 , an invisible beam 202 is emitted as an example) and an image beam 204 , and the spectacle lens 110 is arranged on the path of the invisible beam 202 and the image beam 204 . The first diffractive optical element film 120 is disposed on the spectacle lens 110 and is located on the path of the invisible light beam 202 . The first diffractive optical element 120 is used to diffract the invisible light beam 202 into a structured light beam 203 , such as reflection diffraction, wherein the structured light beam 203 is transmitted to the object to be tested to form a light pattern on the object to be tested. In this embodiment, the object to be tested is the eye 50 , and the structured light beam 203 forms a light pattern 201 on the eye 50 .

The invisible light camera 130 is used for photographing the light pattern 201 on the object to be tested. The second diffractive optical element film 140 is disposed on the spectacle lens 110 and is located on the path of the image beam 204. The second diffractive optical element film 140 is used to transmit the image beam 204 to the eye 50, for example, diffract it to the eye 50, so that the The eye 50 sees the image to be displayed by the laser projector 200 , which is presented as a virtual image located in front of the eye 50 . The diffraction of the image beam 204 by the second diffractive optical element film 140 is, for example, reflection diffraction. In addition, in this embodiment, the first diffractive optical element film 120 and the second diffractive optical element film 140 are disposed on the surface 112 of the spectacle lens 110 facing the eye 50 . In addition, the second diffractive optical element film 140 may be a general diffractive optical element film or a holographic optical element (HOE) film.

In this embodiment, the laser projector includes an infrared laser light source 210 , a plurality of laser light sources 220 of different colors, a light combining module 230 and a scanning mirror 240 . The infrared light laser source 210 is used for emitting infrared light beams 202', and these different color laser light sources 220 are used for emitting a plurality of different color light beams. In this embodiment, the laser sources 220 of different colors include a red laser source 222 , a green laser source 224 and a blue laser source 226 , respectively emitting a red beam 221 , a green beam 223 and a blue beam 225 . In this embodiment, the infrared laser light source 210 and the laser light sources 220 of different colors are both laser diodes, and the light beams they emit are all laser beams.

The light combining module 230 is configured on the paths of the infrared light beam 202' and the light beams of different colors (such as the red light beam 221, the green light beam 223 and the blue light beam 225), so as to combine the paths of the infrared light beam 202' and the light beams of these different colors. The scanning mirror 240 is configured on the path of the infrared beam 202 ′ from the light combining module 230 and the light beams of different colors, wherein the scanning mirror 240 is suitable for rotation, so that the infrared beam 202 ′ is formed to illuminate the first diffractive optical element film 120 The invisible light beams 202 are formed, and the image light beams 204 scanned on the second diffractive optical element film 140 are formed by these light beams of different colors. In addition, in this embodiment, the invisible light camera 130 is, for example, an infrared light camera.

FIG. 4 shows the scanning paths and positions of the red light beam, the green light beam, the blue light beam and the infrared light beam of FIG. 2 on the spectacle lens. Please refer to FIG. 1, FIG. 2 and FIG. 4, by the rotation of the scanning mirror 240, when the scanning mirror 240 is rotated to an appropriate angle, the infrared light laser source 210 can emit the infrared light beam 202' at this time, but these different colors The laser light source 220 does not emit the red light beam 221 , the green light beam 223 and the blue light beam 225 . At this time, the infrared light beam 202 ′ is the invisible light beam 202 irradiated on the first diffractive optical element film 120 . A light spot I1 is formed thereon, and then the first diffractive optical element film 120 diffracts the infrared light beam 202 ′ into a structured light beam 203 . In addition, during most of the time, the scanning mirror 240 is continuously rotated at other angles. At this time, the laser sources 220 of different colors can emit the red light beam 221, the green light beam 223 and the blue light beam 225, and the infrared light laser source 210 does not emit the infrared light beam 202 ′, then the red light beam 221 , the green light beam 223 and the blue light beam 225 can respectively form a red light scanning path I2 , a green light scanning path I3 and a blue light scanning path I4 on the second diffractive optical element film 140 . In addition, with the continuous rotation of the scanning mirror 240, the respective intensities of the red light beam 221, the green light beam 223 and the blue light beam 225 can be continuously changed, so that the color and brightness on these scanning paths can be changed. The element film 140 then diffracts the red light beam 221 , the green light beam 223 and the blue light beam 225 to the eye 50 , so that the eye 50 can see the color image.

In addition, the eye 50 can see the outside scene through the spectacle lens 110 in addition to the color image, so as to achieve the effect of augmented reality. The spectacle lens 110 is, for example, a myopic spectacle lens, a hyperopic spectacle lens, a reading spectacle lens, or a plain spectacle lens.

In this embodiment, the light combining module 230 may include multiple dichroic mirrors or multiple dichroic prisms. For example, the light combining module 230 includes a dichroic mirror 232, a dichroic mirror 234 and a dichroic mirror 236, wherein the dichroic mirror 232 is adapted to transmit the infrared light beam 202' to the dichroic mirror 234, and the dichroic mirror 232 is adapted to reflect blue light beam 225 to dichroic mirror 234. The dichroic mirror 234 is adapted to transmit the infrared light beam 202 ′ and the blue light beam 225 to the dichroic mirror 236 , and the dichroic mirror 234 is adapted to reflect the green light beam 223 to the dichroic mirror 236 . The dichroic mirror 236 is adapted to transmit the infrared light beam 202 ′, the blue light beam 225 and the green light beam 223 to the scanning mirror 240 , and the dichroic mirror 236 is adapted to reflect the red light beam 221 to the scanning mirror 240 . In this way, the light combining module 230 can combine the paths of the red light beam 221, the green light beam 223, the blue light beam 225 and the infrared light beam 202'.

In this embodiment, the augmented reality glasses 100 with structured light detection function further include a glasses frame 150 , and the laser projector 200 , the glasses lens 110 and the invisible light camera 130 are disposed on the glasses frame 150 , wherein the laser projector 200 The invisible light camera 130 may be disposed on the temple of the eyeglass frame 150 , and the invisible light camera 130 may be disposed near the center of the eyeglass frame 150 near the nose pad. In addition, in this embodiment, the augmented reality glasses 100 with the structured light detection function further includes a processor 160 , which is electrically connected to the invisible light camera 130 and is used for the light pattern 201 captured by the invisible light camera 130 according to the light pattern 201 . (as shown in FIG. 3 ) the position of the object to be measured (the eye 50 in this embodiment) is calculated, for example, the position of the eye 50 and its gaze direction are calculated. Since the light pattern 201 is deformed or shifted with the concave-convex curved surface of the eye 50 , the processor 160 can calculate the position of each position on the eye in the three-dimensional space according to the deformation or shift. The processor 160 may also be disposed on the spectacle frame 150 , for example, on the temple of the spectacle frame 150 .

In one embodiment, the processor 160 is, for example, a central processing unit (CPU), a microprocessor (microprocessor), a digital signal processor (DSP), a programmable controller, a programmable controller, or a programmable controller. The present invention is not limited to a logic device (programmable logic device, PLD) or other similar devices or a combination of these devices. Furthermore, in one embodiment, the various functions of the processor 160 may be implemented as multiple program codes. These program codes will be stored in a memory and executed by the processor 160 . Alternatively, in one embodiment, the functions of processor 160 may be implemented as one or more circuits. The present invention does not limit the implementation of the functions of the processor 160 by means of software or hardware.

In the augmented reality glasses 100 with structured light detection function of this embodiment, the laser projector 200 emits an invisible beam 202 in addition to the image beam 204 , and the invisible beam 202 passes through the first diffractive optical element 120 A structured light beam 203 is formed by the diffraction effect, which is used to detect the object to be tested. That is to say, the present embodiment integrates the light source of the structured light 203 into the laser projector 200 for displaying images, that is, integrates the light source of the eye tracker into the laser projector 200 , thus having structured light The augmented reality glasses 100 with detection function can have a relatively simple structure and a smaller number of components, and can simultaneously achieve the functions of displaying images and detecting objects to be tested.

FIG. 5 is a schematic perspective view of one embodiment of the first diffractive optical element film in FIG. 1 , and FIG. 6 is a schematic perspective view of another embodiment of the first diffractive optical element in FIG. 1 . Referring to FIGS. 1 and 5 first, the first diffractive optical element film 120 may have a plurality of microstructures 122 , such as bar-shaped protrusions in FIG. 5 . The microstructures 122 can be arranged along the horizontal direction of FIG. 1 , and the light pattern thus generated is, for example, a striped light pattern. Referring to FIGS. 1 and 6 again, in another embodiment, the first diffractive optical element film 120 a of FIG. 6 may be used instead of the first diffractive optical element film 120 of FIG. 5 . The first diffractive optical element film 120a of FIG. 6 has a plurality of microstructures 122a arranged in two dimensions, and these microstructures 122a are, for example, point-like protrusions, and the light pattern thus generated is, for example, the point-like arrangement of the array in FIG. 3 . Light pattern 201 . The first diffractive optical element film 120 of FIG. 5 and the first diffractive optical element film 120a of FIG. 6 are, for example, diffraction gratings.

7 is a schematic diagram of an optical path of augmented reality glasses with structured light detection function according to another embodiment of the present invention, FIG. 8 is a schematic front view of the glasses lens in FIG. 7 viewed from the line of sight of the eye, and FIG. 9 is Schematic diagram of the optical path of the laser projector in FIG. 7 . Referring to FIGS. 7 to 9 , the augmented reality glasses 100 b with structured light detection function of this embodiment are similar to the augmented reality glasses 100 with structured light detection function of FIG. 1 , and the main differences between the two are as follows described. The augmented reality glasses 100b with structured light detection function in this embodiment include two first diffractive optical element films 120b respectively disposed on both sides of the second diffractive optical element film 140, for example, located in the second diffractive optical element film 140 The first diffractive optical element film 124b on the right side and the first diffractive optical element film 126b on the left side of the second diffractive optical element film 140. In addition, when the scanning mirror 240 of the laser projector 200 turns to two different angles at different times, the infrared light laser source 210 emits the infrared beam 202', and the scanning mirrors at two different angles at two different times 240 respectively reflects the infrared light beams 202 ′ in different directions to form two invisible light beams 202 b transmitted in different directions, such as the invisible light beam 2021 and the invisible light beam 2022 . The invisible light beam 2021 is irradiated on the first diffractive optical element film 124b to form a structured light beam 203, while the invisible light beam 2022 is irradiated on the first diffractive optical element film 126b to form another structured light beam 203, and the two The structured light beams 203 are each delivered to the eye 50 to form two light patterns on the eye. The two light patterns may cover more angles of the eye 50, allowing the processor 160 to be more precise in calculating the position of the eye 50 and its gaze direction.

FIG. 10 is a schematic front view of a spectacle lens in the augmented reality glasses with a structured light detection function according to another embodiment as viewed from the line of sight of the eye. Please refer to FIG. 7 , FIG. 8 and FIG. 10 , the augmented reality glasses with structured light detection function of the embodiment of FIG. 10 are similar to the augmented reality glasses 100 b with structured light detection function of FIG. The difference is that the first diffractive optical element film 124b and the first diffractive optical element film 126b in the embodiment of FIG. 10 are respectively disposed on the upper side and the lower side of the second diffractive optical element film 140, and the invisible light beam 2021 and the invisible light beam 2021 are not visible. The light beam 2022 is respectively irradiated on the first diffractive optical element film 124b and the first diffractive optical element film 126b.

FIG. 11 is a schematic front view of a spectacle lens in the augmented reality glasses with structured light detection function according to another embodiment as viewed from the line of sight of the eye. Please refer to FIG. 7 , FIG. 8 and FIG. 11 , the augmented reality glasses with structured light detection function of the embodiment of FIG. 11 are similar to the augmented reality glasses 100 b with structured light detection function of FIG. The difference is that the augmented reality glasses with structured light detection function in the embodiment of FIG. 11 have four first diffractive optical element films 120c respectively disposed around the second diffractive optical element film 140, for example, respectively disposed on the first diffractive optical element film 120c. The first diffractive optical element films 124c, 126c, 128c and 129c on the right, left, upper and lower sides of the two diffractive optical element films 140, while the scanning mirror of the laser projector rotates to four at four different times The infrared beams are reflected in four different directions at different angles to form four invisible beams irradiating the first diffractive optical element films 124c, 126c, 128c and 129c respectively. The first diffractive optical element films 124c, 126c, 128c, and 129c diffract the four invisible light beams into four structured light beams, all of which are delivered to the eye to form four light patterns on the eye. The four light patterns may cover more angles of the eye 50 to allow the processor 160 to be more precise in calculating the position of the eye 50 and its gaze direction.

12 is a schematic diagram of an optical path of augmented reality glasses with a structured light detection function according to yet another embodiment of the present invention. Referring to FIG. 12 , the augmented reality glasses 100 d with structured light detection function of this embodiment is similar to the augmented reality glasses 100 with structured light detection function of FIG. 1 , and the differences between the two are as follows. In the augmented reality glasses 100 d with structured light detection function of the present embodiment, the object to be detected is the external object 60 , wherein the glasses lens 110 is located between the external object 60 and the eye 50 . In addition, the first diffractive optical element film 120d diffracts the invisible light beam 202 to the outside into a structured light beam 203, and the diffraction is, for example, transmission diffraction. The structured light beam 203 is delivered to the foreign object 60 to form a light pattern on the foreign object 60 . Using the invisible light camera 130 to capture the light pattern, the processor 160 can calculate the position of the external object 60 . In this embodiment, there may be a plurality of invisible light cameras 130 , for example, two, which are respectively disposed at the center and one side of the spectacle frame 150 . However, the present invention does not limit the number of invisible light cameras 130 . In another embodiment, the number of invisible light cameras 130 may also be one.

To sum up, in the augmented reality glasses with structured light detection function according to the embodiment of the present invention, the laser projector not only emits the image beam, but also emits the invisible beam, and the invisible beam passes through the first diffractive optics The diffraction effect of the element forms a structured light beam, which is used to detect the object to be tested. That is to say, the embodiment of the present invention integrates the light source of structured light into the laser projector for displaying images, so the augmented reality glasses with structured light detection function can have a simpler structure and a smaller number of components , and at the same time achieve the functions of displaying images and detecting objects to be tested.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, but not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: The technical solutions described in the foregoing embodiments can still be modified, or some or all of the technical features thereof can be equivalently replaced; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the technical solutions of the embodiments of the present invention. scope.

Claims (10)

1. Augmented reality eyewear having a structured light detection function adapted to be worn in front of an eye, the augmented reality eyewear having a structured light detection function comprising:

a laser projector for emitting at least one invisible light beam and an image light beam;

a spectacle lens disposed on a path of the invisible light beam and the image light beam;

at least one first diffractive optical element film disposed on the spectacle lens and located on a path of the invisible light beam, the first diffractive optical element being configured to diffract the invisible light beam into a structured light beam, wherein the structured light beam is transmitted to an object to be measured to form a light pattern on the object to be measured;

the invisible light camera is used for shooting the light pattern on the object to be detected; and

a second diffractive optical element film disposed on the eyewear lens and in a path of the image beam, the second diffractive optical element film for transmitting the image beam to the eye.

2. The augmented reality eyewear having a structured light detection function of claim 1, wherein the object to be measured is the eye.

3. The augmented reality eyewear having a structured light detection function of claim 1, wherein the object to be measured is an external object, wherein the eyewear lens is located between the external object and the eye.

4. The augmented reality eyewear having a structured light detection function of claim 1, wherein the first diffractive optical element film and the second diffractive optical element film are disposed on a surface of the eyewear lens facing the eye.

5. The augmented reality glasses with structured light detection as recited in claim 1, wherein the laser projector comprises:

an infrared light laser source for emitting an infrared beam;

a plurality of laser sources of different colors for emitting a plurality of light beams of different colors;

the light combining module is configured on the paths of the infrared light beams and the light beams with different colors so as to combine the paths of the infrared light beams and the light beams with different colors; and

and a scanning mirror disposed on the paths of the infrared light beam from the light combining module and the light beams of different colors, wherein the scanning mirror is adapted to rotate so that the infrared light beam forms the at least one invisible light beam irradiated on the at least one first diffractive optical element film and the light beams of different colors form the image light beam scanned on the second diffractive optical element film.

6. The augmented reality eyewear with a structured light detection function of claim 1, wherein the at least one first diffractive optical element film is two first diffractive optical element films respectively disposed on both sides of the second diffractive optical element film, and the at least one invisible light beam is two invisible light beams respectively irradiated on the two first diffractive optical element films.

7. The augmented reality eyewear with a structured light detection function of claim 1, wherein the at least one first diffractive optical element film is four first diffractive optical element films respectively disposed on the periphery of the second diffractive optical element film, and the at least one invisible light beam is four invisible light beams respectively irradiated on the four first diffractive optical element films.

8. The augmented reality eyewear having a structured light detection function of claim 1, wherein the second diffractive optical element film is a holographic optical element film.

9. The augmented reality eyewear with structured light detection as claimed in claim 1, further comprising a processor electrically connected to the invisible light camera for calculating the position of the object according to the light pattern captured by the invisible light camera.

10. The augmented reality glasses with structured light detection as claimed in claim 1, further comprising a spectacle frame, wherein the laser projector and the spectacle lens are configured on the spectacle frame.

Images