TWI793462B - Head mounted display - Google Patents

Abstract

An embodiment of the present disclosure provides a head mounted display. The head mounted display includes a frame, a lens on the frame, a transparent substrate having a first surface bonding to the lens and a second surface opposed to the first surface, a plurality of infrared micro LEDs arranged in an array on the second surface, a plurality of micro optical sensing elements arranged in an array on the second surface, and a micro integrated circuit on the second surface. The infrared micro LEDs and the micro optical sensing elements are electrically connected to the micro integrated circuit. The infrared micro LEDs are configured to emit infrared light to user's eyeball, and the micro optical sensing elements are configured to sense the infrared light reflected by the user's eyeball and collect an image of the user's eyeball, and the micro integrated circuit is configured to determine the user's eyeball rotation according to the image of the user's eyeball s position.

Description

head mounted display

The present invention relates to the field of display technology, in particular to a head-mounted display.

As shown in FIG. 4 , in a conventional head-mounted display 1 , the display 2 , the lens assembly 3 , and the eye-tracking camera 4 are arranged at intervals and designed independently. Therefore, the conventional head-mounted display 1 has a low integration level and a large volume.

One aspect of the present invention provides a head-mounted display, which includes: a frame; a lens disposed on the frame; a transparent substrate, which has a first surface and a second surface opposite to each other, the first surface and the lens Bonding; a plurality of infrared micro LEDs arranged in an array on the second surface; a plurality of micro optical sensing elements arranged in an array on the second surface; and a micro integrated circuit arranged on the second surface above, the infrared micro-LED and the micro-optical sensing element are electrically connected to the micro-integrated circuit; Wherein, the infrared micro LED is used to emit infrared light to the user's eyeball, and the micro optical sensing element is used to sense the infrared light reflected back by the user's eyeball and collect the image of the user's eyeball, so The micro-integrated circuit is used to determine the rotational position of the user's eyeball according to the image of the user's eyeball.

In the head-mounted display, one surface of the substrate is bonded to the lens, and infrared micro LEDs, micro optical sensing elements, and micro integrated circuits are arranged on the other surface. Compared with displays, lens elements, and eye tracking cameras, etc. The method of separate setting and independent design reduces the volume of the optical path of the head-mounted display, which is conducive to the thinning of the entire product and high integration.

100, 1: Head-mounted display

10: frame

12: Supporting part

20: lens

22: left lens

24: right lens

202: The third surface

204: The fourth surface

30: Substrate

302: first surface

304: second surface

40:Infrared Micro LED

50: Miniature optical sensing element

60: Micro integrated circuits

2: Display

3: Lens assembly

4: Eye tracking camera

5: eyes

FIG. 1 is a three-dimensional schematic diagram of a head-mounted display according to an embodiment of the present invention.

FIG. 2 is a schematic diagram of the relative positions of the user's eyes, the substrate and the lens when the head-mounted display according to an embodiment of the present invention is in use.

3 is a schematic diagram of distribution of infrared micro-LEDs, micro-optical sensing elements and micro-integrated circuits on a substrate in a head-mounted display according to an embodiment of the present invention.

FIG. 4 is a schematic structural diagram of a conventional head-mounted display.

FIG. 1 is a three-dimensional schematic diagram of a head-mounted display 100 according to an embodiment of the present invention. The head-mounted display 100 acts as an enhanced display in front of the eyes and can be connected to a personal computer, smart phone or other types of computing platforms to provide users with highly realistic images and an immersive experience.

As shown in FIG. 1 , the head-mounted display 100 includes a frame 10 and components such as a lens 20 disposed on the frame 10 . The lens 20 includes a left lens 22 corresponding to the user's left eye and a right lens 24 corresponding to the user's right eye. The frame 10 includes a support portion 12 corresponding to the bridge of the nose of the user, for abutting against the bridge of the nose of the user when wearing it. In addition, the frame 10 may further include a strap (not shown) for wearing by the user, and the strap may wrap around the head of the user for wearing.

As shown in FIG. 2 , the head mounted display 100 further includes a substrate 30 . The substrate 30 is transparent and has a first surface 302 and a second surface 304 opposite to each other. The first surface 302 is attached to the lens 20 . The substrate 30 is closer to the user's eye 5 than the lens 20 .

As shown in FIG. 3 , a plurality of infrared micro LEDs 40 , a plurality of micro optical sensing elements 50 and a micro integrated circuit 60 (micro integrated circuit, referred to as micro IC or μ IC) are disposed on the second surface 304 of the substrate 30 . A plurality of infrared miniature LEDs 40 are arrayed on the second surface 304 to form a plurality of rows and columns. A plurality of micro-optical sensing elements 50 are also arrayed on the second surface 304 of the substrate 30 to form a plurality of rows and columns.

In FIG. 3 , a row of micro-optical sensing elements 50 is disposed between two adjacent rows of infrared micro-LEDs 40 , and a row of infrared micro-LEDs 40 is disposed between two adjacent rows of micro-optical sensing elements 50 . In other embodiments, the arrangement of the infrared micro LEDs 40 and the micro optical sensing elements 50 on the substrate 30 is not limited thereto.

The infrared micro-LED 40 and the micro-optical sensor 50 are electrically connected to the micro-integrated circuit 60 . Wherein, the infrared miniature LED 40 is used to emit infrared light to the user's eyeball, and the miniature optical sensing element 50 is used to sense the infrared light reflected back by the user's eyeball and collect an image of the user's eyeball, The micro-integrated circuit 60 is used to determine the rotational position of the user's eyeball according to the image of the user's eyeball. In this way, the head-mounted display 100 has an eye tracking function.

In the head-mounted display 100, one surface of the substrate 30 is bonded to the lens 20, and the other surface is arranged with infrared micro-LEDs 40, micro-optical sensing elements 50, and micro-integrated circuits 60. Compared with displays, lens elements and The eye-tracking cameras and the like are set separately and designed independently, which reduces the optical path volume of the head-mounted display 100 , which is conducive to the thinning of the entire product and high integration. Further, the manufacturing process is simplified and the cost is reduced.

In one embodiment, the micro-integrated circuit 60 can determine the user's eye movement, such as eye swaying, gaze, smooth tracking, blinking, etc., according to the position of the user's eyeball rotation. Thereby, the head-mounted display 100 can give the user different feedbacks (for example, display different images) according to the user's eye movement.

Please continue to refer to FIG. 2 , the infrared micro LED 40 , the micro optical sensing element 50 and the micro integrated circuit 60 are disposed on the second surface 304 of the substrate 30 . That is, the infrared micro-LED 40 , the micro-optical sensing element 50 and the micro-integrated circuit 60 are arranged on the surface of the substrate 30 close to the user's eyes 5 , and the lens 20 The circuit 60 is further away from the user's eyes 5 . Thereby, the infrared light sensed by the micro-optical sensing element 50 and reflected by the user's eyeball will not be affected by the lens 20, and the image of the user's eyeball collected by the micro-optical sensing element 50 will not be affected by the lens. 20, thereby preventing image distortion caused by the lens 20.

Please continue to refer to FIG. 2 , the lens 20 has a third surface 202 and a fourth surface 204 opposite to each other, and the third surface 202 is closer to the substrate 30 than the fourth surface 204 . That is, the third surface 202 of the lens 20 is attached to the first surface 302 of the substrate 30 .

In one embodiment, a half-wave plate (not shown) is provided on the third surface 202, and a reflective linear polarizer (not shown) is provided on the fourth surface 204, so as to protect people from the outside. Polarize and/or reflect the light from the eyes 5, so as to prevent unnecessary stray light from affecting the user's perception of the image. look. In other embodiments, the third surface 202 and the fourth surface 204 of the lens 20 may also be provided with other film layers that affect external light, such as refraction layers, filter layers, quarter-wave plates, etc., but are not limited thereto. .

In one embodiment, all the infrared micro-LEDs 40 jointly track the user's left eye and right eye. The left lens 22 and the right lens 24 are attached to the same substrate 30, and all the infrared micro-LEDs 40 on the substrate 30 jointly track the user's left and right eyeballs.

In another embodiment, all the infrared micro-LEDs 40 are divided into two groups according to positions, one group tracks the user's left eyeball, and the other group tracks the user's right eyeball. The left lens 22 and the right lens 24 are bonded to a substrate 30 respectively, and all the infrared miniature LEDs 40 on the substrate 30 bonded to the left lens 22 form a group, which is used to track the user's left eye, and All the infrared micro-LEDs 40 on the substrate 30 attached to the right lens 24 are another group for tracking the user's right eye. That is, the infrared miniature LED 40 on the substrate 30 bonded to the left lens 22 is used to receive the reflected infrared rays from the user's left eye, and the infrared micro LED 40 on the substrate 30 bonded to the right lens 24 is used to receive the reflected infrared rays from the user's right eye. Reflected infrared. Correspondingly, the micro-optical sensing element 50 on the substrate 30 attached to the left lens 22 is used to sense the infrared light reflected back by the user's left eye, and collect the image of the user's left eye, and the right lens 24 The micro-optical sensing element 50 on the bonded substrate 30 is used to sense the infrared light reflected by the user's right eye, and collect an image of the user's right eye. The micro integrated circuit 60 respectively judges the rotation of the user's left eye and right eye according to the image of the left eye and the image of the right eye, and then realizes the function of eye tracking.

In yet another embodiment, all the infrared micro-LEDs 40 are divided into two groups according to positions, one group tracks the user's left eyeball, and the other group tracks the user's right eyeball. The left lens 22 and the right lens 24 are still attached to the same substrate 30, and all the infrared miniature LEDs 40 on the substrate 30 are in accordance with each other. The positions are roughly divided into two groups, the group close to the user's left eye is used to track the user's left eyeball, and the group close to the user's right eye is used to track the user's right eyeball.

In one embodiment, the infrared micro LED 40 has a size ranging from 1 micron to 100 microns, and the micro optical sensing element 50 has a size ranging from 1 micron to 100 microns. That is, the infrared micro-LED 40 , the micro-optical sensing element 50 , and the micro-integrated circuit 60 are all on the micron scale, and the substrate 30 is transparent. In this way, the transmittance of external light incident on human eyes 5 through the lens 20 , the substrate 30 , and the infrared micro-LEDs 40 , micro-optical sensing elements 50 , and micro-integrated circuits 60 on the substrate 30 is very high.

In one embodiment, the substrate 30 is made of transparent glass or transparent plastic. Wherein, the transparent plastic can be, for example, polyimide (PI).

In one embodiment, the head-mounted display 100 further includes a plurality of pixel micro-LEDs (not shown) arranged in an array on the substrate 30, and the pixel micro-LEDs are electrically connected to the micro-integrated body circuit 60 , and image display is performed under the control of the micro-integrated circuit 60 . In this way, the head-mounted display 100 has both a transparent display function and an eye tracking function.

In one embodiment, the head-mounted display 100 includes a data transmission interface (not shown), through which the head-mounted display 100 is connected to a host (such as a personal computer, a smart phone) or other types of computing platforms) to transmit eyeball dynamic data (eg, the image of the user's eyeball collected by the micro-optical sensing element 50 ) to the main control terminal for the main control terminal to track the user's eyeball. In addition, the head-mounted display 100 can also obtain the image data to be played (for example, the image to be viewed by the right eye and the image to be viewed by the right eye) through the data transmission interface, and the image data can be controlled by the micro-integrated circuit 60. Pixel micro LEDs for playback. In other embodiments, the head-mounted display 100 is connected to the host via Bluetooth.

In one embodiment, the pixel micro-LEDs include a plurality of pixel micro-LEDs that emit light of different colors, for example, red micro-LEDs that emit red light, green micro-LEDs that emit green light, and blue micro-LEDs that emit blue light, By mixing the three primary colors of red, green and blue to emit white light, the display function is realized.

In one embodiment, the size of the pixel micro-LEDs ranges from 1 micron to 100 microns, which has the advantages of high luminance, low power consumption, high reliability, and short response time. Moreover, the micron-scale pixel micro-LED also has a higher transmittance for light transmission.

In one embodiment, the infrared micro-LED 40 , the micro-optical sensing element 50 and the pixel micro-LED are all electrically connected to the micro-integrated circuit 60 through transparent leads (not shown in the figure), In order to further increase the transmittance of external light entering the human eye. The material of the lead is, for example, Indium Tin Oxide (ITO).

In one embodiment, the miniature optical sensing device 50 is a Complementary Metal Oxide Semiconductor (CMOS) device. The micro-integrated circuit 60 may include CMOS performance and embedded memory (eg, non-volatile memory).

The above embodiments are only used to illustrate the technical solutions of the present invention without limitation. Although the present invention has been described in detail with reference to preferred embodiments, those skilled in the art should understand that the technical solutions of the present invention can be modified or equivalently replaced. Without departing from the spirit and scope of the technical solutions of the present invention.

20: lens

202: The third surface

204: The fourth surface

30: Substrate

302: first surface

304: second surface

5: eyes

Claims (10)

A head-mounted display, which is improved in that it includes: a frame; at least one lens, disposed on the frame; at least one transparent substrate, which has a first surface and a second surface opposite, and the first surface and the second surface are opposite to each other. The lens is bonded; a plurality of infrared micro-LEDs are arranged in an array on the second surface; a plurality of micro-optical sensing elements are arranged in an array on the second surface; and at least one micro-integrated circuit is arranged on the second surface. On the surface, the micro-integrated circuit is micron-scale, and the infrared micro-LEDs and the micro-optical sensing elements are electrically connected to the micro-integrated circuit; wherein, the infrared micro-LEDs are used to emit Infrared light, these miniature optical sensing elements are used to sense the infrared light reflected back by the user's eyeball and collect the image of the user's eyeball, and the micro-integrated circuit is used to Determine where the user's eyeballs are turning. The head-mounted display as claimed in claim 1, wherein when the user wears the head-mounted display, the substrate is closer to the eyes of the user than the lens. The head-mounted display as claimed in claim 1, wherein the lens has an opposite third surface and a fourth surface, the third surface is closer to the substrate than the fourth surface, wherein the third A half-wave plate is arranged on the surface, and a reflective linear polarizer is arranged on the fourth surface. The head-mounted display as described in claim 1, wherein the lens includes a left lens corresponding to the user's left eye and a right lens corresponding to the user's right eye, the left lens and the right lens Laminating with the same one of the substrates, all the infrared micro-LEDs on the substrate jointly track the user's left and right eyeballs. The head-mounted display as described in claim 1, wherein the lens includes a left lens corresponding to the user's left eye and a right lens corresponding to the user's right eye, and the left lens and the right lens are respectively connected to a The substrate is bonded, the infrared micro-LED on the substrate bonded to the left lens tracks the user's left eyeball, and the infrared micro-LED on the substrate bonded to the right lens tracks the user's right eyeball. The head-mounted display as described in claim 1, wherein the head-mounted display further includes a plurality of pixel micro-LEDs arranged in an array on the substrate, and the pixel micro-LEDs are electrically connected to the micro-integrated circuit, And image display is performed under the control of the micro integrated circuit. The head-mounted display according to claim 1, wherein the infrared micro-LEDs and the micro-optical sensing elements are electrically connected to the micro-integrated circuit through at least one transparent lead. The head-mounted display as claimed in claim 1, wherein the miniature optical sensing element is a complementary metal oxide semiconductor element. The head-mounted display according to claim 1, wherein the size of the infrared micro-LEDs is 1 micron to 100 microns. The head-mounted display according to claim 1, wherein the substrate is made of glass or plastic.

Images