CN114690403B - Head-mounted eye tracking system - Google Patents

Abstract

The present invention discloses a head-mounted eye tracking system, which includes a light combiner, an eye tracker and a signal processor. The light combiner includes an optical coupling component. The eye tracker is at least partially disposed on the light combiner and is suitable for sensing the eyeball of the wearer. The eye tracker includes a plurality of light emitting components and a plurality of sensing components. The plurality of light emitting components are suitable for emitting tracking light beams. The plurality of sensing components are suitable for receiving tracking light beams reflected by the eyeball of the wearer. The signal processor is connected to the eye tracker signal.

Description

Head-mounted eye tracking system

Technical Field

The present invention relates to a tracking system, and in particular to a head-mounted eye tracking system.

Background technique

In order to provide higher quality audio and video effects, technologies such as Virtual Reality (VR), Augmented Reality (AR) and Mixed Reality (MR) have become one of the research and development focuses of the new generation of display technology, and the head-mounted eye tracking system is one of the means to realize these technologies.

Generally speaking, a head-mounted eye tracking system tracks the movement of the eyeballs through an eye tracker installed therein, and adjusts the displayed image according to the line of sight to enhance the reality effect. Taking the existing eye tracker as an example, it tracks and determines the position of the eyeballs through a camera for dynamic images. However, such tracking methods are often limited by the frame rate of the camera. In addition, due to the high complexity, large size and/or heavy weight of the camera, it often affects the wearer's comfort in use.

Summary of the invention

The present invention is directed to a head-mounted eye tracking system adapted to sense the wearer's eyes.

According to an embodiment of the present invention, a head-mounted eye tracking system includes a light combiner, an eye tracker, and a signal processor. The light combiner includes an optical coupling. The eye tracker is at least partially disposed on the light combiner and is adapted to sense the eyeball of the wearer. The eye tracker includes a plurality of light emitting components and a plurality of sensing components. The plurality of light emitting components are adapted to emit tracking light beams. The plurality of sensing components are adapted to receive tracking light beams reflected by the eyeball of the wearer. The signal processor is signal-connected to the eye tracker.

In order to make the above features and advantages of the present invention more clearly understood, embodiments are given below with reference to the accompanying drawings for detailed description.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG1A is a partial perspective schematic diagram of a head-mounted eye tracking system according to a first embodiment of the present invention;

FIG1B is a partial top view of a head-mounted eye tracking system according to the first embodiment of the present invention;

FIG1C is a partial front view schematic diagram of a head-mounted eye tracking system according to the first embodiment of the present invention;

FIG. 1D is a schematic diagram of an arrangement of light emitting components and sensing components of a head-mounted eye tracking system according to an embodiment of the present invention;

FIG. 1E is a schematic diagram of an arrangement of light emitting components and sensing components of another head-mounted eye tracking system according to an embodiment of the present invention;

FIG. 1F is a schematic diagram of an arrangement of light emitting components and sensing components of another head-mounted eye tracking system according to an embodiment of the present invention;

FIG2 is a partial front view schematic diagram of a head-mounted eye tracking system according to a second embodiment of the present invention;

FIG3 is a partial front view schematic diagram of a head-mounted eye tracking system according to a third embodiment of the present invention;

FIG4 is a partial front view schematic diagram of a head-mounted eye tracking system according to a fourth embodiment of the present invention;

FIG5 is a partial front view schematic diagram of a head-mounted eye tracking system according to a fifth embodiment of the present invention;

6A is a partial top view of a head-mounted eye tracking system according to a sixth embodiment of the present invention;

FIG6B is a partial front view of a head-mounted eye tracking system according to a sixth embodiment of the present invention;

FIG7 is a partial front view schematic diagram of a head-mounted eye tracking system according to a seventh embodiment of the present invention;

FIG8 is a partial front view schematic diagram of a head-mounted eye tracking system according to an eighth embodiment of the present invention;

FIG9A is a partial top view of a head-mounted eye tracking system according to a ninth embodiment of the present invention;

FIG9B is a partial stereoscopic schematic diagram of a head-mounted eye tracking system according to a ninth embodiment of the present invention;

FIG9C is a partial front view of a head-mounted eye tracking system according to a ninth embodiment of the present invention;

FIG10 is a partial front view schematic diagram of a head-mounted eye tracking system according to a tenth embodiment of the present invention;

FIG11 is a partial front view schematic diagram of a head-mounted eye tracking system according to an eleventh embodiment of the present invention;

FIG. 12 is a partial front view schematic diagram of a head-mounted eye tracking system according to a twelfth embodiment of the present invention.

Description of reference numerals:

100, 200, 300, 400, 500, 600, 700, 800, 900, 1000, 1100, 1200: head-mounted eye tracking system;

110, 610: light combiner;

114, 614: optical coupling element;

120, 220, 320, 420, 520, 620, 920, 1020, 1120, 1220: eye tracker;

124, 224, 324, 424, 524, 924: light emitting components;

124R, 924R: tracking beam;

125, 225, 325, 425, 525, 625, 925, 1025, 1125, 1225: sensing components;

125R: reflected beam;

130, 930: display;

131, 931: display components;

130R, 930R: Display beam;

140: light guide;

650, 750: signal processor;

651: component layer;

652: signal line;

753: Processing components;

161: light-transmitting substrate;

162: frame;

90: Wearer;

91: Eyeball;

ER: external beam;

P5: spacing;

L2, L9: distance;

D1: first arrangement direction;

D2: second arrangement direction;

SU1, SU2, SU3: sensing units;

R1, R2, R3: range.

Detailed ways

In the drawings, for the sake of clarity, the size of some components or film layers may be enlarged or reduced. In addition, for the sake of clarity, some components or film layers may be omitted or marked in the drawings. In addition, the numerical values expressed in the specification may include the numerical values and deviation values within the deviation range acceptable to those of ordinary skill in the art.

In the following embodiments or corresponding drawings, the same or similar components are represented by the same or similar reference numerals and have the same or similar functions, and the description thereof is omitted. In addition, for the sake of clarity, not all light emitting components, sensing components and/or other similar components may be marked or shown one by one in the drawings.

FIG. 1A is a partial stereoscopic schematic diagram of a head-mounted eye tracking system according to a first embodiment of the present invention. FIG. 1B is a partial top view schematic diagram of a head-mounted eye tracking system according to a first embodiment of the present invention. FIG. 1C is a partial front view schematic diagram of a head-mounted eye tracking system according to a first embodiment of the present invention. In addition, for the sake of clarity, not all light emitting components 124, sensing components 125, and/or display components 131 are labeled or shown one by one in FIG. 1A to FIG. 1C.

Please refer to Figures 1A to 1C. The head-mounted eye tracking system 100 includes an optical combiner 110 and an eye tracker 120. The optical combiner 110 includes an optical coupler 114. The number and arrangement of the optical couplers 114 can be adjusted and designed according to actual usage requirements, and are not limited in the present invention. The eye tracker 120 is disposed on the optical combiner 110. The eye tracker 120 is suitable for sensing the eyeball 91 of the wearer 90. In this embodiment, the wearer 90 is not limited to a human.

In this embodiment, the optical coupling element 114 may include a coupler mirror, but the present invention is not limited thereto. In one embodiment, the optical coupling element similar to the optical coupling element 114 may include an optical grating coupler. In one embodiment, the optical coupling element similar to the optical coupling element 114 may include a volume holographic grating (VHG), a surface relief grating, or a liquid crystal film coupling component.

In this embodiment, the head-mounted eye tracking system 100 may further include a light-transmitting substrate 161. The light combiner 110 may be disposed on one side of the light-transmitting substrate 161. In one embodiment, the light-transmitting substrate 161 may include glass, polymer (such as polyimide (PI), polyethylene terephthalate (PET, but not limited to) or other suitable light-transmitting materials. In one embodiment, the light-transmitting substrate 161 may be embedded in the frame 162, but the present invention is not limited thereto.

In this embodiment, the head-mounted eye tracking system 100 may further include a display 130. The display 130 is adapted to emit a display light beam 130R. The display light beam 130R may be irradiated to the eyeball 91 of the wearer 90 via the optical coupling element 114 of the light combiner 110.

In one embodiment, the display 130 may include one or more display components 131. The display component 131 of the display 130 may be, for example, a light emitting diode, a micro light emitting diode, an organic light emitting diode or a laser diode that can emit a corresponding display light beam 130R, and a person familiar with the technology may choose to use it according to actual needs. The display light beam 130R may include, for example, red light, green light, blue light or other suitable light visible to the wearer 90. The display light beam 130R emitted from the display 130 may be transmitted to the light combiner 110 via a suitable light guide 140. The external light beam ER and the display light beam 130R may be irradiated to the eyeball 91 of the wearer 90 via the optical coupling component 114 of the light combiner 110. In other words, the eyeball 91 of the wearer 90 may receive the external light beam ER and the display light beam 130R via the optical coupling component 114. In addition, the external light beam ER may include ambient light or light emitted by other displays not shown.

In one embodiment, the display component 131 of the display 130 may include a light emitting diode, but the present invention is not limited thereto. For example, the display component 131 may include a micro light emitting diode (micro LED; μLED) having a size of substantially (5 micrometers (μm) to 100 μm)×(5 μm to 100 μm).

In FIG. 1B , only one type of light guide 140 is shown by way of example, but the present invention is not limited thereto. In one embodiment, the light guide 140 may include a reflector, a refraction member and/or other suitable light guide members. For example, the light guide 140 may include a mirror, a prism, a lens, an optical fiber and/or a light pipe.

In this embodiment, the eye tracker 120 may include a plurality of light emitting components 124 and a plurality of sensing components 125 .

In one embodiment, a plurality of light emitting components 124 and/or a plurality of sensing components 125 may be disposed on the light-transmitting substrate 161 and located on the other side relative to the light combiner 110 , but the present invention is not limited thereto.

The light emitting element 124 of the eye tracker 120 is adapted to emit a tracking beam 124R directly or indirectly to the eyeball 91 of the wearer 90. The tracking beam 124R may include, for example, infrared light or other suitable light that is invisible to the wearer 90 and/or less likely to damage the tissue of the eyeball 91. The luminous intensity of the tracking beam 124R may be adjusted according to design requirements and must comply with biosafety regulations, which is not limited in the present invention.

The sensing element 125 of the eye tracker 120 includes, for example, a reverse-biased LED, a photodiode (PD), or a photosensitive element under a planar optical layer with a diffraction pattern (such as a muramask, but not limited to). After the tracking beam 124R irradiates the eyeball 91 of the wearer 90, corresponding reflections can be generated in corresponding areas or directions according to corresponding eyeball tissues (such as iris, pupil, lens, cornea, etc.). For example, under the irradiation of the tracking beam 124R of substantially the same wavelength of light, the eyeball tissue can have light reflections of different directions and/or intensities at different locations. In this way, the tracking beam (which can be referred to as a reflected beam 125R) reflected by the eyeball 91 of the wearer 90 can be received through the sensing element 125, and the movement of the eyeball 91 can be tracked. In other words, compared with a tracker having an optical component for focusing for imaging, the eye tracker 120 can track the movement of the eyeball 91 without imaging.

In one embodiment, the sensor component 125 can track the movement of the eyeball 91 through high-frequency sampling. For example, the sampling frequency of the sensor component 125 can be higher than the frame rate of a general dynamic image. In one embodiment, the sampling frequency of the sensor component 125 can be greater than or equal to 250 Hz, which can be determined by the circuit design of the sensor, but the present invention is not limited thereto.

In this embodiment, among the plurality of sensing components 125, the spacing P5 between two adjacent ones is between 1 millimeter (mm) and 30 mm. In one embodiment, among the plurality of sensing components 125, the spacing P5 between two adjacent ones is between 3 mm and 15 mm.

In this embodiment, the light emitting component 124 may be a micro LED (micro LED; μLED) having a size of substantially (5 μm-100 μm)×(5 μm-100 μm). In this way, part or all of the light emitting component 124 may at least partially overlap (i.e., partially overlap or completely overlap) with the optical coupling element 114. In other words, part or all of the light emitting component 124 may at least partially overlap with the visible area of the eyeball 91 of the wearer 90.

In this embodiment, the sensing component 125 may be a micro-reverse μLED or a photodiode (PD) having a size of (5 μm to 100 μm)×(5 μm to 100 μm). In this way, part or all of the sensing component 125 may be partially or completely overlapped with the optical coupling element 114. In other words, part or all of the sensing component 125 may at least partially overlap with the visible area of the eyeball 91 of the wearer 90.

In one embodiment, the aforementioned micro LED can emit light or perform light detection at different timings through different operating bias voltages.

In this embodiment, a plurality of light emitting elements 124 or a plurality of sensing elements 125 surround the optical coupling element 114 , but the invention is not limited thereto.

In the present embodiment, in the first arrangement direction D1 , a portion of the plurality of light emitting elements 124 and a portion of the plurality of sensing elements 125 are arranged alternately with each other, but the present invention is not limited thereto.

1D as an example, in one embodiment, in a closed range R1 in the front view state, the adjacent light emitting components 124 and sensing components 125 can be integrated into a sensing unit SU1. In the aforementioned sensing unit SU1, the light emitting components 124 and the sensing components 125 can be arranged alternately.

Taking FIG. 1E as an example, in one embodiment, within a closed range R2 in the front-view state, the light emitting component 124 and the plurality of sensing components 125 can be integrated into a sensing unit SU2. In the aforementioned sensing unit SU2, the light emitting component 124 and the sensing component 125 can be arranged in an interlaced manner as shown in FIG. 1E.

Taking FIG. 1F as an example, in one embodiment, in a closed range R3 in the front-view state, a plurality of light-emitting components 124 and a plurality of sensing components 125 can be integrated into a sensing unit SU3. In the aforementioned sensing unit SU3, one of the light-emitting components 124 and one of the sensing components 125 can be arranged in an alternating manner as shown in FIG. 1E.

In one embodiment, within a sensing unit, the number of sensing components 125 may be greater than or equal to the number of light emitting components 124 .

In this embodiment, in the second arrangement direction D2 perpendicular to the first arrangement direction D1 , some of the plurality of light emitting elements 124 and some of the plurality of sensing elements 125 are arranged alternately with each other, but the invention is not limited thereto.

In this embodiment, the number of light emitting components 124 and the number of sensing components 125 can be staggered and adjusted according to actual use requirements, and can be a regular staggered design or an irregular staggered design, as shown in FIG. 1C to FIG. 5 , but the present invention is not limited thereto. In this embodiment, the number of sensing components 125 can be greater than or equal to the number of light emitting components 124.

FIG. 2 is a partial front view schematic diagram of a head-mounted eye tracking system according to a second embodiment of the present invention.

In this embodiment, the head-mounted eye tracking system 200 includes a light combiner 110 and an eye tracker 220. The eye tracker 220 may include a plurality of light emitting components 224 and a plurality of sensing components 225. The light emitting components 224 may be the same as or similar to the light emitting components 124 of the aforementioned embodiment. The sensing components 225 may be the same as or similar to the sensing components 125 of the aforementioned embodiment.

In this embodiment, the plurality of light emitting elements 224 may surround the optical coupling element 114 , and the plurality of sensing elements 225 may be arranged in a cross shape.

FIG. 3 is a partial front view schematic diagram of a head-mounted eye tracking system according to a third embodiment of the present invention.

In this embodiment, the head-mounted eye tracking system 300 includes a light combiner 110 and an eye tracker 320. The eye tracker 320 may include a plurality of light emitting components 324 and a plurality of sensing components 325. The light emitting components 324 may be the same as or similar to the light emitting components 124 of the aforementioned embodiment. The sensing components 325 may be the same as or similar to the sensing components 125 of the aforementioned embodiment.

In this embodiment, some of the multiple light-emitting components 324 and some of the multiple sensing components 325 can be arranged alternately with each other in the first arrangement direction D1, some of the multiple light-emitting components 324 and some of the multiple sensing components 325 can be arranged alternately with each other in the second arrangement direction D2, and the multiple light-emitting components 324 and the multiple sensing components 325 can be arranged alternately with each other in an array.

FIG. 4 is a partial front view schematic diagram of a head-mounted eye tracking system according to a fourth embodiment of the present invention.

In this embodiment, the head-mounted eye tracking system 400 includes a light combiner 110 and an eye tracker 420. The eye tracker 420 may include a plurality of light emitting components 424 and a plurality of sensing components 425. The light emitting components 424 may be the same as or similar to the light emitting components 124 of the aforementioned embodiment. The sensing components 425 may be the same as or similar to the sensing components 125 of the aforementioned embodiment.

In this embodiment, the plurality of light emitting components 424 may surround the sensing components 425 and the optical coupling element 114 , and the plurality of sensing components 425 may be arranged in an array.

FIG. 5 is a partial front view schematic diagram of a head-mounted eye tracking system according to a fifth embodiment of the present invention.

In this embodiment, the head-mounted eye tracking system 500 includes a light combiner 110 and an eye tracker 520. The eye tracker 520 may include a plurality of light emitting components 524 and a plurality of sensing components 525. The light emitting components 524 may be the same as or similar to the light emitting components 124 of the aforementioned embodiment. The sensing components 525 may be the same as or similar to the sensing components 125 of the aforementioned embodiment.

In this embodiment, a plurality of light emitting components 524 and/or a plurality of sensing components 525 may be disposed on the frame 162 .

In this embodiment, a plurality of light emitting components 524 or a plurality of sensing components 525 may surround the optical coupling element 114 .

Fig. 6A is a partial top view schematic diagram of a head-mounted eye tracking system according to a sixth embodiment of the present invention. Fig. 6B is a partial front view schematic diagram of a head-mounted eye tracking system according to a sixth embodiment of the present invention.

In this embodiment, the head-mounted eye tracking system 600 includes a light combiner 610 and an eye tracker 620. The eye tracker 620 may include a plurality of light emitting components (not directly shown, which may be the same as or similar to the light emitting components 124 of the previous embodiment) and a plurality of sensing components 625. The light combiner 610 includes an optical coupling element 614. The optical coupling element 614 may include a grating coupling element.

In this embodiment, the head-mounted eye tracking system 600 may further include a signal processor 650. The signal processor 650 may be signal-connected to the eye tracker 620. For example, the optical signal or the corresponding electronic signal received by the sensing component 625 of the eye tracker 620 may be transmitted to the signal processor 650. For example, the signal processor 650 may transmit the electronic signal to the light emitting component (not directly shown, which may be the same as or similar to the light emitting component 124 of the previous embodiment) to drive it to emit light.

In this embodiment, the signal processor 650 may be connected to the eye tracker 620 via a signal line 652 in the component layer 651 in a wired signal transmission manner, but the present invention is not limited thereto.

In FIG. 6A and FIG. 6B , only the signal connection manner between the signal processor 650 and part of the sensing component 625 is exemplarily shown, but the present invention is not limited thereto.

In one embodiment, the signal processor 650 may include a processing chip, but the present invention is not limited thereto. For example, the signal processor 650 may include a computer or other processing systems (eg, a cloud processing system).

In this embodiment, the component layer 651 may include corresponding conductive film layers, insulating film layers and/or semiconductor film layers. The aforementioned conductive film layers, insulating film layers and/or semiconductor film layers may constitute corresponding active devices, passive devices and/or circuits (e.g., signal lines 652).

In this embodiment, the signal line 652 may be at least composed of a portion of the conductive pattern in the component layer 651, but the present invention is not limited thereto. In other words, the signal line 652 may include a portion of the conductive pattern in the component layer 651 (e.g., the conductive film layer included in the component layer 651). The conductive pattern may be located on the light-transmitting substrate 161. In this embodiment, the conductive pattern and the sensing component 625 may be located on the same side of the light-transmitting substrate 161.

In this embodiment, the film layers, components and/or wiring (layout) in the component layer 651 can be formed or arranged by a commonly used method in the art, which will not be elaborated herein.

FIG7 is a partial front view schematic diagram of a head-mounted eye tracking system according to a seventh embodiment of the present invention. The head-mounted eye tracking system 700 of this embodiment is similar to the head-mounted eye tracking system 600 of the sixth embodiment, and similar components thereof are denoted by the same reference numerals and have similar functions, and description thereof is omitted. In addition, for the sake of clarity, not all sensing components 625, signal lines 652, and/or processing components 753 are labeled or shown one by one in FIG7.

In this embodiment, the head-mounted eye tracking system 700 includes a light combiner (not directly shown, which may be the same as or similar to the light combiner 110 or the light combiner 610 of the aforementioned embodiment), an eye tracker 620 and a signal processor 750 .

In this embodiment, the signal processor 750 may be similar to the signal processor 650 of the aforementioned embodiment. The signal processor 750 may further include a processing component 753. The processing component 753 may be signal-connected (or electrically connected) to the corresponding sensing component 625 and/or light-emitting component (not directly shown, which may be the same as or similar to the light-emitting component 124 of the aforementioned embodiment). The processing component 753 may include, for example, an IC or a μIC, but the present invention is not limited thereto.

In this embodiment, the processing component 753 may be disposed on the light-transmitting substrate 161 , and the processing component 753 of the signal processor 750 may be disposed between the light combiner 610 and the sensing component 625 (shown in FIG. 6A ).

In this embodiment, the processing component 753 of the signal processor 750 may at least partially overlap the sensing component 625 of the eye tracker 620 , but the present invention is not limited thereto.

FIG8 is a partial front view schematic diagram of a head-mounted eye tracking system according to an eighth embodiment of the present invention. The head-mounted eye tracking system 800 of this embodiment is similar to the head-mounted eye tracking system 700 of the seventh embodiment, and similar components thereof are denoted by the same reference numerals and have similar functions, and description thereof is omitted. In addition, for the sake of clarity, not all sensing components 625, signal lines 652, and/or processing components 753 are labeled or shown one by one in FIG8.

In this embodiment, the processing components of the signal processor 750 may not overlap with the sensing components 625 of the eye tracker 620. In other words, the processing components of the signal processor 750 may be far away from the sensing components 625 of the eye tracker 620.

FIG. 9A is a partial top view schematic diagram of a head-mounted eye tracking system according to a ninth embodiment of the present invention. FIG. 9B is a partial stereoscopic schematic diagram of a head-mounted eye tracking system according to a ninth embodiment of the present invention. FIG. 9C is a partial front view schematic diagram of a head-mounted eye tracking system according to a ninth embodiment of the present invention. The head-mounted eye tracking system 900 of this embodiment is similar to the head-mounted eye tracking system 100 of the first embodiment, and similar components thereof are denoted by the same reference numerals and have similar functions, and description thereof is omitted. In addition, for the sake of clarity, not all light emitting components 924 and/or sensing components 925 are labeled or shown one by one in FIGS. 9A to 9C.

9A to 9C , in this embodiment, the head-mounted eye tracking system 900 includes a light combiner 110, an eye tracker 920, and a display 930. The eye tracker 920 may include a plurality of light emitting components 924 and a plurality of sensing components 925. The light emitting components 924 may be the same as or similar to the light emitting components 124 of the aforementioned embodiment. The sensing components 925 may be the same as or similar to the sensing components 125 of the aforementioned embodiment. The display 930 may be similar to the display 130 of the aforementioned embodiment.

In this embodiment, the light emitting component 924 and the sensing component 925 of the eye tracker 920 may be disposed at different locations. That is, the light emitting component 924 and the sensing component 925 of the eye tracker 920 may be away from each other. For example, the sensing component 925 of the eye tracker 920 may be disposed on the light combiner 110, and the light emitting component 924 of the eye tracker 920 may be disposed on the display 930. The tracking light beam 924R emitted from the light emitting component 924 of the eye tracker 920 may be conducted to the light combiner 110 via a suitable light guide 140. The external light beam ER, the display light beam 930R, and the tracking light beam 924R may be irradiated to the eyeball 91 of the wearer 90 via the optical coupling component 114 of the light combiner 110.

In this embodiment, the display components 931 of the display 930 and the light emitting components 924 of the eye tracker 920 may be arranged in an array, but the present invention is not limited thereto.

In this embodiment, the light emitting component 924 of the eye tracker 920 may not be disposed on the light combiner 110 , but the present invention is not limited thereto.

In this embodiment, the sensing element 925 of the eye tracker 920 surrounds the optical coupling element 114 , but the invention is not limited thereto.

FIG10 is a partial front view schematic diagram of a head-mounted eye tracking system according to the tenth embodiment of the present invention. The head-mounted eye tracking system 1000 of this embodiment is similar to the head-mounted eye tracking system 900 of the ninth embodiment, and similar components thereof are denoted by the same reference numerals and have similar functions, and description thereof is omitted. In addition, for the sake of clarity, not all sensing components 1025 are labeled or shown one by one in FIG10 .

In this embodiment, the head-mounted eye tracking system 1000 includes a light combiner 110, an eye tracker 1020, and a display (not directly shown, which may be the same as or similar to the display 930 of the previous embodiment). The eye tracker 1020 may include a plurality of light emitting components (not directly shown, which may be the same as or similar to the light emitting component 924 of the previous embodiment) and a plurality of sensing components 1025. The sensing component 1025 may be the same as or similar to the sensing component 125 of the previous embodiment.

In this embodiment, the plurality of sensing components 1025 may be arranged in a cross shape.

FIG11 is a partial front view schematic diagram of a head-mounted eye tracking system according to the eleventh embodiment of the present invention. The head-mounted eye tracking system 1100 of this embodiment is similar to the head-mounted eye tracking system 900 of the ninth embodiment, and similar components thereof are denoted by the same reference numerals and have similar functions, and description thereof is omitted. In addition, for the sake of clarity, not all sensing components 1125 are labeled or shown one by one in FIG11 .

In this embodiment, the head-mounted eye tracking system 1100 includes a light combiner 110, an eye tracker 1120, and a display (not directly shown, which may be the same as or similar to the display 930 of the previous embodiment). The eye tracker 1120 may include a plurality of light emitting components (not directly shown, which may be the same as or similar to the light emitting component 924 of the previous embodiment) and a plurality of sensing components 1125. The sensing component 1125 may be the same as or similar to the sensing component 125 of the previous embodiment.

In this embodiment, the plurality of sensing components 1125 may be arranged in an array.

FIG12 is a partial front view of a head-mounted eye tracking system according to a twelfth embodiment of the present invention. The head-mounted eye tracking system 1200 of this embodiment is similar to the head-mounted eye tracking system 900 of the ninth embodiment, and similar components thereof are denoted by the same reference numerals and have similar functions, and description thereof is omitted. In addition, for the sake of clarity, not all sensing components 1225 are labeled or shown one by one in FIG12 .

In this embodiment, the head-mounted eye tracking system 1200 includes a light combiner 110, an eye tracker 1220, and a display (not directly shown, which may be the same as or similar to the display 930 of the previous embodiment). The eye tracker 1220 may include a plurality of light emitting components (not directly shown, which may be the same as or similar to the light emitting component 924 of the previous embodiment) and a plurality of sensing components 1225. The sensing component 1225 may be the same as or similar to the sensing component 125 of the previous embodiment.

In this embodiment, a plurality of sensing components 1225 may be disposed on the frame 162 .

In this embodiment, a plurality of sensing components 1225 may surround the optical coupling element 114 .

In summary, the head-mounted eye tracking system of the present invention is suitable for sensing the wearer's eyes.

In summary, in the head-mounted eye tracking system of the present invention, the eye tracker can track the movement of the eyeball without imaging. In this way, the sampling frequency of the sensing component can be increased accordingly, the power consumption of the head-mounted eye tracking system during operation can be reduced, and the integration with other components or devices can be improved.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein by equivalents. However, these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims (10)

1. A head-mounted eye tracking system, comprising: A light-transmitting substrate adapted to be disposed at a specific position relative to a pupil in an eyeball; a light combiner, integrated in the light-transmitting substrate to project a light beam in a specific direction, the light combiner comprising an optical coupling element; An eye tracker is at least partially disposed on the light combiner and is adapted to sense the wearer's eyeball, and the eye tracker comprises: A plurality of light emitting components adapted to emit tracking light beams; and a plurality of sensing components adapted to receive the tracking beam reflected by the eyeball of the wearer, wherein the plurality of light emitting components and the plurality of sensing components are arranged in a first arrangement direction and a second arrangement direction perpendicular to each other, and the plurality of light emitting components and the plurality of sensing components at least partially overlap the optical coupling member along a third direction perpendicular to the first arrangement direction and the second arrangement direction; and A signal processor is signal-connected to the eye tracker, wherein the optical coupling element of the light combiner and the eye tracker are suitable for being arranged in the visual direction of the eyeball of the wearer. 2. The head-mounted eye tracking system according to claim 1, further comprising: The display is adapted to emit a display light beam, wherein the display light beam is irradiated to the eyeball of the wearer via the light combiner. 3. The head-mounted eye tracking system according to claim 2, wherein the plurality of sensing components are disposed on the light combiner, and the plurality of light-emitting components are disposed on the display. 4. The head-mounted eye tracking system according to claim 1, wherein the plurality of light-emitting components or the plurality of sensing components are disposed on the light combiner. 5. The head-mounted eye tracking system according to claim 1, wherein the spacing between two adjacent sensing components is between 1 mm and 30 mm. 6. The head-mounted eye tracking system according to claim 1, wherein the plurality of light-emitting components or the plurality of sensing components surround the optical coupling element. 7. The head-mounted eye tracking system according to claim 1, wherein the plurality of light-emitting components or the plurality of sensing components are arranged in an array. 8. The head-mounted eye tracking system according to claim 1, wherein in the first arrangement direction, part of the plurality of light-emitting components and part of the plurality of sensing components are arranged alternately with each other. 9. The head-mounted eye tracking system according to claim 8, wherein in the second arrangement direction, part of the plurality of light-emitting components and part of the plurality of sensing components are arranged alternately with each other. 10. The head-mounted eye tracking system according to claim 1, wherein at least one of the plurality of light-emitting components and at least one of the plurality of sensing components are integrated into a sensing unit.