[go: up one dir, main page]

CN110727111A - Head-mounted display optical system and head-mounted display equipment - Google Patents

Head-mounted display optical system and head-mounted display equipment Download PDF

Info

Publication number
CN110727111A
CN110727111A CN201911013961.5A CN201911013961A CN110727111A CN 110727111 A CN110727111 A CN 110727111A CN 201911013961 A CN201911013961 A CN 201911013961A CN 110727111 A CN110727111 A CN 110727111A
Authority
CN
China
Prior art keywords
unit
optical unit
image
optical
head
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201911013961.5A
Other languages
Chinese (zh)
Inventor
闫姝君
朱耀明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Hui Niu Technology Co Ltd
Original Assignee
Shenzhen Hui Niu Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Hui Niu Technology Co Ltd filed Critical Shenzhen Hui Niu Technology Co Ltd
Priority to CN201911013961.5A priority Critical patent/CN110727111A/en
Publication of CN110727111A publication Critical patent/CN110727111A/en
Priority to PCT/CN2020/117507 priority patent/WO2021077980A1/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B27/0172Head mounted characterised by optical features
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)

Abstract

本发明公开一种头戴显示光学系统及头戴显示设备,其中头戴显示光学系统包括投影显示装置和眼动追踪装置。其中,眼动追踪装置,用于识别人眼的注视点及注视深度信息,并将所述注视点及注视深度信息反馈给所述投影显示装置;所述投影显示装置,用于虚拟成像,以及用于根据所述眼动跟踪装置反馈的所述注视点及注视深度信息调节虚拟成像距离,使虚拟成像距离与所述眼动追踪装置检测到的人眼注视深度相匹配。本发明通过理解人眼的注视点、注视深度等信息,调节虚拟成像距离,使虚拟成像距离与人眼注视深度相匹配,以实现更好的沉浸体验和人机交互体验。眼动追踪装置与投影显示装置融合,减小显示模组体积,利于增强现实显示设备小型化和轻薄化。

Figure 201911013961

The invention discloses a head-mounted display optical system and a head-mounted display device, wherein the head-mounted display optical system includes a projection display device and an eye tracking device. Wherein, an eye tracking device is used to identify the gaze point and gaze depth information of human eyes, and feed back the gaze point and gaze depth information to the projection display device; the projection display device is used for virtual imaging, and The virtual imaging distance is adjusted according to the gaze point and gaze depth information fed back by the eye tracking device, so that the virtual imaging distance matches the gaze depth of the human eye detected by the eye tracking device. The invention adjusts the virtual imaging distance by understanding the gaze point, gaze depth and other information of the human eye, so that the virtual imaging distance matches the gaze depth of the human eye, so as to achieve better immersion experience and human-computer interaction experience. The eye tracking device is integrated with the projection display device to reduce the volume of the display module, which is conducive to the miniaturization and thinning of the augmented reality display device.

Figure 201911013961

Description

一种头戴显示光学系统及头戴显示设备A head-mounted display optical system and a head-mounted display device

技术领域technical field

本发明涉及显示设备技术领域,尤其涉及一种头戴显示光学系统及头戴显示设备。The present invention relates to the technical field of display devices, and in particular, to a head-mounted display optical system and a head-mounted display device.

背景技术Background technique

随着科学技术的不断发展,越来越多的显示设备被广泛应用于人们的日常生活以及工作当中,为人们的日常生活以及工作带来了巨大的便利,成为当今人们不可或缺的重要工具。其中头戴显示技术作为一种由光学、电子学、软件交互等多种领域相结合的新型技术也得到了突飞猛进的发展。With the continuous development of science and technology, more and more display devices are widely used in people's daily life and work, bringing great convenience to people's daily life and work, and becoming an indispensable tool for people today . Among them, head-mounted display technology has also developed by leaps and bounds as a new technology that combines optics, electronics, software interaction and other fields.

头戴式显示器(HMD)中的微型显示器和光学系统将来自微型显示器的图像投射到用户眼睛并允许用户看到真实世界。头戴式显示器具有许多实用性的应用和休闲的应用,例如航空和航天应用领域允许飞行员看见重要的飞行控制信息而不必使他们的眼睛离开飞行路径;公共安全领域应用包括地图和热成像的战术显示;其他领域的应用还包括视频游戏、交通运输和无线电通信等。Microdisplays and optical systems in head mounted displays (HMDs) project images from the microdisplays to the user's eyes and allow the user to see the real world. Head-mounted displays have many practical and recreational applications, such as aviation and aerospace applications that allow pilots to see important flight control information without taking their eyes off the flight path; public safety applications include tactical maps and thermal imaging display; other applications include video games, transportation, and radio communications.

随着HMD技术的发展,人与环境、虚拟内容间的理解和交互,逐渐成为一个关键的需求,人体视觉感官的交互也成为一个研究热点。利用眼动追踪技术获取眼球运动信息,通过追踪眼球及周边特征变化、虹膜角度变化或虹膜反射特征等信息之一获取眼球的注视、汇聚、转动及瞳孔变化情况,从而实现对人体视觉感官的理解,并反馈给显示内容处理单元进行相应的匹配,提升整体的视觉沉浸感。在头戴式显示设备的应用领域,眼动追踪成为其使用过程中重要的交互方式。With the development of HMD technology, the understanding and interaction between people and the environment and virtual content has gradually become a key requirement, and the interaction of human visual senses has also become a research hotspot. Use eye tracking technology to obtain eye movement information, and obtain eye gaze, convergence, rotation and pupil changes by tracking one of the information such as eye and peripheral feature changes, iris angle changes or iris reflection characteristics, so as to realize the understanding of human visual senses , and feedback it to the display content processing unit for corresponding matching to enhance the overall visual immersion. In the application field of head-mounted display devices, eye tracking has become an important interaction method during its use.

利用眼动追踪,能够理解人眼的关注点、视距以及应激反应等,实时调节HMD显示内容,增强用户视觉的沉浸感。在一类已知的应用中,眼动追踪可实现注视点渲染,即对人眼注视的区域进行高清渲染,周边视野降低渲染率,以降低处理单元成本。在一种已知的非接触式光学眼动追踪技术中,光源发出红外光,红外光从眼睛反射并由图像传感器接收,通过分析由图像传感器感测的信息,以从反射光的变化中获知注视方向或瞳孔位置等眼动情况。Using eye tracking, it can understand the focus of the human eye, viewing distance, and stress response, adjust the HMD display content in real time, and enhance the user's visual immersion. In a known class of applications, eye tracking enables foveated rendering, that is, high-definition rendering of the area where the human eye is fixed, and the peripheral field of view reduces the rendering rate to reduce processing unit costs. In one known non-contact optical eye-tracking technique, a light source emits infrared light, which is reflected from the eye and received by an image sensor, and the information sensed by the image sensor is analyzed to learn from changes in the reflected light Eye movements such as gaze direction or pupil position.

近几年随着科技的发展,国内外皆有推出装有眼动追踪技术的虚拟现实头戴式显示设备,在虚拟的环境中捕获眼动行为进行数据分析,或者通过眼动设备与虚拟环境的事物进行交互。传统头戴显示设备中引入眼动追踪功能也主要用于通过注视点跟踪来扩展视场,针对提升用户沉浸体验和人机交互体验方面研究较少,而且额外增加到头戴显示模组中的眼动追踪光学元件对显示模组的小型化和美观也会带来很大难题。In recent years, with the development of science and technology, virtual reality head-mounted display devices equipped with eye-tracking technology have been launched at home and abroad to capture eye-movement behavior in a virtual environment for data analysis, or through eye-tracking devices and virtual environments. things interact. The eye-tracking function introduced into traditional head-mounted display devices is mainly used to expand the field of view through gaze tracking. There is little research on improving user immersion experience and human-computer interaction experience, and additionally added to the head-mounted display module. Eye tracking optics will also bring great challenges to the miniaturization and aesthetics of the display module.

因此,现有技术存在不足,需要改进。Therefore, the existing technology has shortcomings and needs to be improved.

发明内容SUMMARY OF THE INVENTION

本发明的目的是克服现有技术的不足,提供一种头戴显示光学系统及头戴显示设备。The purpose of the present invention is to overcome the deficiencies of the prior art and provide a head-mounted display optical system and a head-mounted display device.

本发明的技术方案如下:提供一种头戴显示光学系统,包括投影显示装置和眼动追踪装置。The technical solutions of the present invention are as follows: a head-mounted display optical system is provided, which includes a projection display device and an eye tracking device.

所述眼动追踪装置,用于识别人眼的注视点及注视深度信息,并将所述注视点及注视深度信息反馈给所述投影显示装置。The eye tracking device is used for identifying the gaze point and gaze depth information of human eyes, and feeding back the gaze point and gaze depth information to the projection display device.

所述投影显示装置,用于虚拟成像,以及用于根据所述眼动跟踪装置反馈的所述注视点及注视深度信息调节虚拟成像距离,使虚拟成像距离与所述眼动追踪装置检测到的人眼注视深度相匹配。The projection display device is used for virtual imaging, and is used for adjusting the virtual imaging distance according to the gaze point and gaze depth information fed back by the eye tracking device, so that the virtual imaging distance is the same as that detected by the eye tracking device. Human eye gaze depth matches.

进一步地,所述投影显示装置包括:图像产生单元、第一光学单元、第二光学单元。Further, the projection display device includes: an image generating unit, a first optical unit, and a second optical unit.

所述图像产生单元,用于产生和发射携带图像信息的光束。The image generating unit is used for generating and emitting a light beam carrying image information.

所述第一光学单元用于将所述图像产生单元发射的光束反射至所述第二光学单元,所述第二光学单元用于对所述第一光学单元反射来的光束进行反射,经所述第二光学单元反射后的光束再回到所述第一光学单元,并经所述第一光学单元透射后进入用户眼睛。The first optical unit is used for reflecting the light beam emitted by the image generating unit to the second optical unit, and the second optical unit is used for reflecting the light beam reflected by the first optical unit, The light beam reflected by the second optical unit returns to the first optical unit, and enters the user's eyes after being transmitted through the first optical unit.

进一步地,所述眼动追踪装置包括:红外光源、透反镜单元、热反射镜和图像接收单元。Further, the eye tracking device includes: an infrared light source, a transmissive mirror unit, a thermal mirror and an image receiving unit.

所述红外光源用于产生红外光束,所述红外光束经由所述透反镜单元透射至所述热反射镜,并经所述热反射镜反射到所述第一光学单元,以及经所述第一光学单元反射进入所述第二光学单元,再经所述第二光学单元反射回所述第一光学单元,最后经所述第一光学单元透射进入用户眼睛。The infrared light source is used to generate an infrared light beam, the infrared light beam is transmitted to the thermal mirror through the transflective mirror unit, reflected to the first optical unit through the thermal mirror, and passed through the first optical unit. An optical unit is reflected into the second optical unit, then reflected back to the first optical unit through the second optical unit, and finally transmitted through the first optical unit into the user's eyes.

进入用户眼睛的红外光束由用户眼睛反射回所述第一光学单元,经所述第一光学单元透射进入所述第二光学单元,并依次经所述第二光学单元及所述第一光学单元反射至所述热反射镜,以及经所述热反射镜反射至所述透反镜单元,最后经所述透反镜单元反射至所述图像接收单元。The infrared light beam entering the user's eye is reflected back to the first optical unit by the user's eye, transmitted through the first optical unit and enters the second optical unit, and sequentially passes through the second optical unit and the first optical unit Reflected to the hot mirror, and reflected to the lenticular unit through the thermal mirror, and finally reflected to the image receiving unit through the lenticular unit.

所述图像接收单元根据接收的用户眼睛反射的红外光束识别人眼的注视点及注视深度信息,并将所述注视点及注视深度信息反馈给所述图像产生单元。The image receiving unit identifies the gaze point and gaze depth information of the human eye according to the received infrared beam reflected by the user's eyes, and feeds back the gaze point and gaze depth information to the image generating unit.

进一步地,所述图像产生单元发射携带图像信息的光束,具体经所述热反射镜透射后进入所述第一光学单元。Further, the image generating unit emits a light beam carrying image information, and enters the first optical unit after being transmitted through the thermal mirror.

所述图像产生单元,还用于根据所述图像接收单元反馈的所述注视点及注视深度信息调整虚拟成像的距离,使虚拟成像距离与所述眼动追踪装置检测到的人眼注视深度相匹配。The image generating unit is further configured to adjust the virtual imaging distance according to the gaze point and gaze depth information fed back by the image receiving unit, so that the virtual imaging distance is consistent with the gaze depth of the human eye detected by the eye tracking device. match.

进一步地所述图像产生单元包括图像源、微致动结构和第一透镜单元,所述微致动结构用于调节所述图像源或所述第一透镜单元的位置,从而调制投影图像面的焦深或调整所述投影显示装置的有效焦距。或,Further, the image generating unit includes an image source, a micro-actuating structure and a first lens unit, and the micro-actuating structure is used to adjust the position of the image source or the first lens unit, thereby modulating the projection image surface. Focus depth or adjust the effective focal length of the projection display device. or,

所述图像产生单元包括图像源和第二透镜单元,所述第二透镜单元用于透射所述图像源产生的光束并调整所述投影显示装置的有效焦距。The image generating unit includes an image source and a second lens unit, and the second lens unit is configured to transmit the light beam generated by the image source and adjust the effective focal length of the projection display device.

进一步地,所述第二透镜单元为可调焦透镜单元,由至少一片可调焦准直透镜组成,所述图像源与所述第二透镜单元共轴。Further, the second lens unit is an adjustable focus lens unit, which is composed of at least one adjustable focus collimating lens, and the image source is coaxial with the second lens unit.

进一步地,所述第一光学单元的表面设置有透反膜,所述透反膜的透射率与反射率的比例为1:1。Further, the surface of the first optical unit is provided with a transflective film, and the ratio of transmittance to reflectivity of the transflective film is 1:1.

所述第二光学单元的表面设置有透反膜,所述透反膜的透射率与反射率的比例为1:1,所述第二光学单元的面型为球面、非球面、自由曲面中的任一种。The surface of the second optical unit is provided with a transflective film, the ratio of transmittance to reflectivity of the transflective film is 1:1, and the surface type of the second optical unit is spherical, aspherical, or free-form surface. any of the.

所述第一光学单元的中心轴与所述投影显示装置的图像产生单元的中心轴成45°夹角。The central axis of the first optical unit forms an included angle of 45° with the central axis of the image generating unit of the projection display device.

所述第二光学单元的中心轴与所述图像产生单元的中心轴成90°夹角。The central axis of the second optical unit forms an included angle of 90° with the central axis of the image generating unit.

进一步地,所述图像产生单元的中心轴与所述第二光学单元的中心轴垂直相交于所述第一光学单元。Further, the central axis of the image generating unit and the central axis of the second optical unit are perpendicular to the first optical unit.

进一步地,所述透反镜单元为半透半反镜,所述透反镜单元表面镀有滤光膜,仅对红外光束响应。Further, the mirror unit is a half mirror, the surface of the mirror unit is coated with a filter film, and only responds to infrared light beams.

所述图像接收单元为红外图像传感器。The image receiving unit is an infrared image sensor.

所述热反射镜的中心轴与所述投影显示装置的图像产生单元的中心轴成45夹角°。The central axis of the thermal mirror and the central axis of the image generating unit of the projection display device form an included angle of 45°.

所述透反镜单元的中心轴与所述红外光源发射光束的中心轴成45°夹角。The central axis of the lens unit and the central axis of the light beam emitted by the infrared light source form an included angle of 45°.

本发明还提供一种头戴显示设备,包括如上所述的头戴显示光学系统。The present invention also provides a head-mounted display device including the above-mentioned head-mounted display optical system.

采用上述方案,本发明的有益效果在于:通过理解人眼的注视点、注视深度等信息,调节虚拟成像距离,使虚拟成像距离与人眼注视深度相匹配,以实现更好的沉浸体验和人机交互体验。眼动追踪光学系统与投影显示光学融合,减小显示模组体积,利于增强现实显示设备小型化和轻薄化。By adopting the above scheme, the beneficial effect of the present invention is that: by understanding the gaze point, gaze depth and other information of the human eye, the virtual imaging distance is adjusted so that the virtual imaging distance matches the gaze depth of the human eye, so as to achieve a better immersive experience and human computer interaction experience. The eye tracking optical system is optically integrated with the projection display to reduce the volume of the display module, which is conducive to the miniaturization and thinning of the augmented reality display device.

附图说明Description of drawings

图1为本发明头戴显示光学系统的结构示意图;1 is a schematic structural diagram of a head-mounted display optical system of the present invention;

图2为本发明头戴显示光学系统一实施例的结构示意图;2 is a schematic structural diagram of an embodiment of a head-mounted display optical system according to the present invention;

图3为本发明头戴显示光学系统另一实施例的结构示意图。FIG. 3 is a schematic structural diagram of another embodiment of the head-mounted display optical system of the present invention.

具体实施方式Detailed ways

为了使本发明所要解决的技术问题、技术方案及有益效果更加清楚明白,以下结合附图及实施例,对本发明进行进一步详细说明。应当理解,此处所描述的具体实施例仅用以解释本发明,并不用于限定本发明。In order to make the technical problems, technical solutions and beneficial effects to be solved by the present invention clearer, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention, but not to limit the present invention.

需要说明的是,当元件被称为“设置于”另一个元件,它可以直接在另一个元件上或者间接在该另一个元件上。当一个元件被称为是“连接于”另一个元件,它可以是直接连接到另一个元件或间接连接至该另一个元件上。此外,术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征。在本发明的描述中,“多个”的含义是两个或两个以上,除非另有明确具体的限定。It should be noted that when an element is referred to as being "disposed on" another element, it can be directly on the other element or indirectly on the another element. When an element is referred to as being "connected to" another element, it can be directly connected to the other element or indirectly connected to the other element. In addition, the terms "first" and "second" are only used for descriptive purposes, and should not be construed as indicating or implying relative importance or implying the number of indicated technical features. Thus, a feature defined as "first" or "second" may expressly or implicitly include one or more of that feature. In the description of the present invention, "plurality" means two or more, unless otherwise expressly and specifically defined.

请参阅图1至图3,本发明提供一种头戴显示光学系统,包括投影显示装置和眼动追踪装置。所述眼动追踪装置,用于识别人眼的注视点及注视深度信息,并将注视点及注视深度信息反馈给所述投影显示装置。所述投影显示装置,用于虚拟成像,同时能够根据所述眼动跟踪装置反馈的注视点及注视深度信息调节虚拟成像距离,使虚拟成像距离与眼动追踪装置检测到的人眼注视深度相匹配。Referring to FIGS. 1 to 3 , the present invention provides a head-mounted display optical system, including a projection display device and an eye tracking device. The eye tracking device is used for identifying the gaze point and gaze depth information of human eyes, and feeding the gaze point and gaze depth information back to the projection display device. The projection display device is used for virtual imaging, and at the same time, the virtual imaging distance can be adjusted according to the gaze point and gaze depth information fed back by the eye tracking device, so that the virtual imaging distance is consistent with the human eye gaze depth detected by the eye tracking device. match.

具体地,所述投影显示装置包括:图像产生单元1、第一光学单元2和第二光学单元3,所述图像产生单元1用于产生和发射携带图像信息的光束,同时用于根据所述眼动跟踪装置反馈的所述注视点及注视深度信息调整虚拟成像的距离,使虚拟成像距离与所述眼动追踪装置检测到的人眼注视深度相匹配;所述第一光学单元2用于将所述图像产生单元1发射的光束反射至所述第二光学单元3,所述第二光学单元3用于对所述第一光学单元2 反射来的光束进行反射,经所述第二光学单元3反射后的光束再回到所述第一光学单元2,并经所述第一光学单元2透射后进入用户眼睛4。所述第一光学单元2的中心轴与所述图像产生单元1的中心轴成45°夹角,所述第一光学单元2的表面设置有透反膜,所述第一光学单元2的透射率与反射率的比例为1:1,或其他特殊比例设定的透反膜;所述第二光学单元3的中心轴与所述图像产生单元1的中心轴成90°夹角,所述第二光学单元3的表面设置有透反膜,所述第二光学单元3的透射率与反射率的比例为1:1,或其他特殊比例设定的透反膜,具体地,所述第二光学单元为球面、非球面、自由曲面结构中的任一种。具体地,本实施例中,所述第二光学单元3的中心轴为X轴,所述图像产生单元1的中心轴为Y轴,所述X轴与所述Y 轴相互垂直,具体地,本实施例中,所述图像产生单元1的中心轴与所述第二光学单元3的中心轴垂直相交于所述第一光学单元2。Specifically, the projection display device includes: an image generating unit 1, a first optical unit 2 and a second optical unit 3, the image generating unit 1 is used for generating and emitting light beams carrying image information, The gaze point and gaze depth information fed back by the eye tracking device adjusts the virtual imaging distance, so that the virtual imaging distance matches the gaze depth of the human eye detected by the eye tracking device; the first optical unit 2 is used for Reflecting the light beam emitted by the image generating unit 1 to the second optical unit 3, the second optical unit 3 is used for reflecting the light beam reflected by the first optical unit 2, The light beam reflected by the unit 3 returns to the first optical unit 2 and enters the user's eye 4 after being transmitted through the first optical unit 2 . The central axis of the first optical unit 2 forms an included angle of 45° with the central axis of the image generating unit 1 , the surface of the first optical unit 2 is provided with a transflective film, and the transmission of the first optical unit 2 The ratio of ratio to reflectivity is 1:1, or a transflective film set in other special ratios; the central axis of the second optical unit 3 forms an included angle of 90° with the central axis of the image generating unit 1, and the The surface of the second optical unit 3 is provided with a transflective film, and the ratio of the transmittance to the reflectivity of the second optical unit 3 is 1:1, or a transflective film set in other special ratios. The two optical units are any of spherical, aspherical and free-form surface structures. Specifically, in this embodiment, the central axis of the second optical unit 3 is the X axis, the central axis of the image generating unit 1 is the Y axis, and the X axis and the Y axis are perpendicular to each other. Specifically, In this embodiment, the central axis of the image generating unit 1 and the central axis of the second optical unit 3 are perpendicular to the first optical unit 2 .

所述眼动追踪装置包括:红外光源L、透反镜单元M2、热反射镜M1、图像接收单元C。所述红外光源L用于产生红外光束,所述红外光束经由所述透反镜单元M2透射至所述热反射镜M1,并经所述热反射镜M1反射到所述第一光学单元2,以及经所述第一光学单元2反射进入所述第二光学单元3,再经所述第二光学单元3反射回所述第一光学单元2,最后经所述第一光学单元2透射进入用户眼睛4。进入用户眼睛4的红外光束由用户眼睛4反射回所述第一光学单元2,经所述第一光学单元2透射进入所述第二光学单元3,并依次经所述第二光学单元3及所述第一光学单元2反射至所述热反射镜M1,以及经所述热反射镜M1反射至所述透反镜单元M2,最后经所述透反镜单元M2反射至所述图像接收单元C。所述图像接收单元C 根据接收的用户眼镜4反射的红外光束识别人眼的注视点及注视深度信息,并将所述注视点及注视深度信息反馈给所述图像产生单元1。具体地,本实施例中,所述透反镜单元M2为半透半反镜,所述透反镜单元M2表面镀有滤光膜,仅对红外光束响应,所述透反镜单元M2的中心轴与所述红外光源 L发射光束的中心轴成45°夹角,所述热反射镜M1的中心轴与所述图像产生单元1的中心轴成45°夹角。The eye tracking device includes: an infrared light source L, a transmissive mirror unit M2, a thermal mirror M1, and an image receiving unit C. The infrared light source L is used to generate an infrared light beam, and the infrared light beam is transmitted to the thermal mirror M1 through the transmissive mirror unit M2, and reflected to the first optical unit 2 through the thermal mirror M1, and reflected by the first optical unit 2 into the second optical unit 3 , and then reflected back to the first optical unit 2 by the second optical unit 3 , and finally transmitted through the first optical unit 2 into the user eyes 4. The infrared light beam entering the user's eye 4 is reflected back to the first optical unit 2 by the user's eye 4, transmitted through the first optical unit 2 and enters the second optical unit 3, and passes through the second optical unit 3 and The first optical unit 2 is reflected to the hot mirror M1, reflected to the mirror unit M2 by the hot mirror M1, and finally reflected to the image receiving unit by the mirror unit M2 C. The image receiving unit C identifies the gaze point and gaze depth information of the human eye according to the received infrared beam reflected by the user's glasses 4 , and feeds the gaze point and gaze depth information back to the image generating unit 1 . Specifically, in this embodiment, the lens unit M2 is a half mirror, the surface of the lens unit M2 is coated with a filter film, and only responds to infrared light beams. The central axis forms an angle of 45° with the central axis of the beam emitted by the infrared light source L, and the central axis of the thermal mirror M1 forms an angle of 45° with the central axis of the image generating unit 1 .

请参阅图1,本发明提供的头戴显示光学系统的工作原理如下:Referring to FIG. 1, the working principle of the head-mounted display optical system provided by the present invention is as follows:

图像投影过程:图像产生单元1产生和发射携带图像信息的光束a,到达第一光学单元2之后,由第一光学单元2对光束a反射至第二光学单元3,经第二光学单元3反射后光束a回到第一光学单元2,且经第一光学单元2 透射后进入用户的视野,即用户眼睛4。Image projection process: the image generating unit 1 generates and emits a light beam a carrying image information, and after reaching the first optical unit 2, the first optical unit 2 reflects the light beam a to the second optical unit 3, and is reflected by the second optical unit 3 The rear light beam a returns to the first optical unit 2 and is transmitted through the first optical unit 2 into the user's field of view, that is, the user's eyes 4 .

眼动追踪过程:红外光源L产生红外光束b,经由透反镜单元M2透射至热反射镜M1,并经热反射镜M1反射到第一光学单元2,以及经第一光学单元2反射进入第二光学单元3,再经第二光学单元3反射回第一光学单元2,最后经第一光学单元2透射进入用户眼睛4。进入用户眼睛4的红外光束b由用户眼睛4反射回所述第一光学单元2,经第一光学单元2透射进入第二光学单元3,并依次经第二光学单元3及第一光学单元2反射至热反射镜M1,以及经热反射镜M1反射至透反镜单元M2,最后经透反镜单元 M2反射至图像接收单元C。图像接收单元C根据接收的用户眼镜4反射的红外光束b识别人眼的注视点及注视深度信息,并将所述注视点及注视深度信息反馈给所述图像产生单元1,图像产生单元1根据接收到的注视点及注视深度信息调节投影显示装置的虚拟成像距离,并使虚拟成像距离与眼动追踪装置检测的人眼注视深度相匹配。Eye tracking process: the infrared light source L generates an infrared beam b, which is transmitted to the thermal mirror M1 through the mirror unit M2, reflected to the first optical unit 2 by the thermal mirror M1, and reflected by the first optical unit 2 into the first optical unit 2. The second optical unit 3 is reflected back to the first optical unit 2 through the second optical unit 3 , and finally transmitted through the first optical unit 2 into the user's eye 4 . The infrared light beam b entering the user's eye 4 is reflected back to the first optical unit 2 by the user's eye 4 , transmitted through the first optical unit 2 into the second optical unit 3 , and passed through the second optical unit 3 and the first optical unit 2 in turn It is reflected to the hot mirror M1, reflected to the lenticular mirror unit M2 through the thermal mirror M1, and finally reflected to the image receiving unit C through the lenticular mirror unit M2. The image receiving unit C identifies the gaze point and gaze depth information of the human eye according to the received infrared beam b reflected by the user's glasses 4, and feeds back the gaze point and gaze depth information to the image generating unit 1, and the image generating unit 1 according to The received gaze point and gaze depth information adjusts the virtual imaging distance of the projection display device, and makes the virtual imaging distance match the gaze depth of the human eye detected by the eye tracking device.

请参阅图1与图2,为本发明的一实施例,本实施例中所述图像产生单元1包括图像源DS、微致动结构A1和第一透镜单元5。所述图像源DS能够产生和发射携带图像信息的光束,所述图像源DS为微显示器,具体地,本实施例中所述图像源DS为OLED显示器、或LCD显示器、或LCOS显示器。所述微致动结构A1用于调节所述图像源DS的位置,从而调制投影图像面的焦深,或用于调节所述第一透镜单元5的位置,进而调整所述投影显示装置的有效焦距,进而实现虚拟成像距离的调节。具体地,本实施例中,所述微致动结构A1为电磁、MEMS、压电材料以及记忆金属可致动微结构中的任一种,所述图像源DS包括一处理芯片,所述处理芯片与所述微致动结构A1信号连接进而控制所述微致动结构A1调节所述图像源DS 或所述第一透镜单元5的位置。所述第一透镜单元5同时可以透射所述图像源DS产生的光束,所述第一透镜单元5包括至少一片透镜,所述透镜为准直透镜。本实施例中,所述图像源DS与所述第一透镜单元5共轴。本实施例中,所述第一光学单元2的中心轴与所述图像产生单元1的中心轴成 45°夹角,所述第二光学单元3的中心轴与所述图像产生单元1的中心轴成 90°夹角,所述图像产生单元1的中心轴与所述第二光学单元3的中心轴垂直相交于所述第一光学单元2,所述热反射镜M1的中心轴与所述图像产生单元1的中心轴成45°夹角,所述透反镜单元M2的中心轴与所述红外光源 L发射光束的中心轴成45°夹角。Please refer to FIG. 1 and FIG. 2 , which are an embodiment of the present invention. In this embodiment, the image generating unit 1 includes an image source DS, a micro-actuating structure A1 and a first lens unit 5 . The image source DS can generate and emit light beams carrying image information, and the image source DS is a microdisplay. Specifically, in this embodiment, the image source DS is an OLED display, an LCD display, or an LCOS display. The micro-actuating structure A1 is used to adjust the position of the image source DS, so as to modulate the focal depth of the projected image surface, or to adjust the position of the first lens unit 5, thereby adjusting the effectiveness of the projection display device. focal length, and then adjust the virtual imaging distance. Specifically, in this embodiment, the micro-actuating structure A1 is any one of electromagnetic, MEMS, piezoelectric material, and memory metal actuable micro-structures, and the image source DS includes a processing chip. The chip is signal-connected to the micro-actuating structure A1 to control the micro-actuating structure A1 to adjust the position of the image source DS or the first lens unit 5 . At the same time, the first lens unit 5 can transmit the light beam generated by the image source DS, and the first lens unit 5 includes at least one lens, and the lens is a collimating lens. In this embodiment, the image source DS and the first lens unit 5 are coaxial. In this embodiment, the central axis of the first optical unit 2 and the central axis of the image generating unit 1 form an included angle of 45°, and the central axis of the second optical unit 3 and the center of the image generating unit 1 The axes form an included angle of 90°, the central axis of the image generating unit 1 and the central axis of the second optical unit 3 perpendicularly intersect with the first optical unit 2, and the central axis of the thermal mirror M1 and the The central axis of the image generating unit 1 forms an included angle of 45°, and the central axis of the lens unit M2 forms an included angle of 45° with the central axis of the light beam emitted by the infrared light source L.

本实施例提供的头戴显示光学系统的工作原理如下:The working principle of the head-mounted display optical system provided in this embodiment is as follows:

图像投影过程:图像源DS产生和发射携带图像信息的光束a,经过第一透镜单元5准直后到达热反射镜M1,经热反射镜M1的透射后到达第一光学单元2。再由第一光学单元2对光束a进行反射,到达第二光学单元3,经第二光学单元3反射的光束a回到第一光学单元2,并经第一光学单元2 透射后进入用户的视野,即用户眼睛4。Image projection process: the image source DS generates and emits a light beam a carrying image information, which is collimated by the first lens unit 5 and then reaches the thermal mirror M1 , and is transmitted by the thermal mirror M1 to reach the first optical unit 2 . The light beam a is reflected by the first optical unit 2 and reaches the second optical unit 3. The light beam a reflected by the second optical unit 3 returns to the first optical unit 2, and is transmitted through the first optical unit 2 into the user's camera. The field of view, ie the user's eyes 4 .

眼动追踪过程:红外光源L产生红外光束b,经由透反镜单元M2透射至热反射镜M1,并经热反射镜M1反射到第一光学单元2,以及经第一光学单元2反射进入第二光学单元3,再经第二光学单元3反射回第一光学单元2,最后经第一光学单元2透射进入用户眼睛4。进入用户眼睛4的红外光束b由用户眼睛4反射回所述第一光学单元2,经第一光学单元2透射进入第二光学单元3,并依次经第二光学单元3反射后到达第一光学单元2,再经第一光学单元2反射至热反射镜M1,以及经热反射镜M1反射至透反镜单元M2,最后经透反镜单元M2反射至图像接收单元C(本实施例采用红外图像传感器),图像接收单元C识别人眼的注视点及注视深度信息,并将所述注视点及注视深度信息反馈给图像产生单元1的处理芯片,所述处理芯片根据接收到的注视点及注视深度信息调制微致动结构A1,进而调整所述图像源DS或所述第一透镜单元5的位置,从而调节投影显示装置的虚拟成像距离,并使虚拟成像距离与眼动追踪装置检测的人眼注视深度相匹配。Eye tracking process: the infrared light source L generates an infrared beam b, which is transmitted to the thermal mirror M1 through the mirror unit M2, reflected to the first optical unit 2 by the thermal mirror M1, and reflected by the first optical unit 2 into the first optical unit 2. The second optical unit 3 is reflected back to the first optical unit 2 through the second optical unit 3 , and finally transmitted through the first optical unit 2 into the user's eye 4 . The infrared light beam b entering the user's eye 4 is reflected back to the first optical unit 2 by the user's eye 4, transmitted through the first optical unit 2 and enters the second optical unit 3, and is reflected by the second optical unit 3 in turn to reach the first optical unit The unit 2 is then reflected to the thermal mirror M1 by the first optical unit 2, and reflected to the mirror unit M2 by the thermal mirror M1, and finally reflected to the image receiving unit C by the mirror unit M2 (in this embodiment, infrared image sensor), the image receiving unit C identifies the gaze point and gaze depth information of the human eye, and feeds back the gaze point and gaze depth information to the processing chip of the image generation unit 1, and the processing chip is based on the received gaze point and The gaze depth information modulates the micro-actuating structure A1, and then adjusts the position of the image source DS or the first lens unit 5, so as to adjust the virtual imaging distance of the projection display device, and make the virtual imaging distance and the distance detected by the eye tracking device. Human eye gaze depth matches.

请参阅图1与图3,为本发明的另一实施例,本实施例中,所述图像产生单元1包括图像源DS和第二透镜单元6,所述第二透镜单元6用于透射所述图像源DS产生的光束并调整所述投影显示装置的有效焦距。具体地,所述第二透镜单元6为可调焦准直透镜,由至少一片透镜组成,所述图像源DS包括一处理芯片,所述处理芯片与所述可调焦准直透镜信号连接进而控制所述可调焦准直透镜进行焦距的调节,所述可调焦准直透镜具体采用能够实现上述调焦功能的现有技术即可,例如移动透镜组中镜片的位置或使用可通过电致变形驱动、压电驱动等方式能够改变自身形状实现变焦的一种透镜。本实施例中,所述图像源与所述第二透镜单元6共轴。本实施例中,所述第一光学单元2的中心轴与所述图像产生单元1的中心轴成45°夹角,所述第二光学单元3的中心轴与所述图像产生单元1的中心轴成90°夹角,所述图像产生单元1的中心轴与所述第二光学单元3的中心轴垂直相交于所述第一光学单元2,所述热反射镜M1的中心轴与所述图像产生单元1的中心轴成45°夹角,所述透反镜单元M2的中心轴与所述红外光源L 发射光束的中心轴成45°夹角。Please refer to FIG. 1 and FIG. 3, which are another embodiment of the present invention. In this embodiment, the image generating unit 1 includes an image source DS and a second lens unit 6, and the second lens unit 6 is used to transmit all The beam generated by the image source DS and adjust the effective focal length of the projection display device. Specifically, the second lens unit 6 is an adjustable focus collimating lens, which is composed of at least one lens, and the image source DS includes a processing chip, and the processing chip is signal-connected to the adjustable focus collimating lens and then The focus-adjustable collimating lens is controlled to adjust the focal length, and the adjustable-focus collimating lens can specifically adopt the existing technology that can realize the above-mentioned focusing function, such as moving the position of the lens in the lens group or using an electronically adjustable lens. A type of lens that can change its shape to achieve zooming by means of deformation drive, piezoelectric drive, etc. In this embodiment, the image source and the second lens unit 6 are coaxial. In this embodiment, the central axis of the first optical unit 2 and the central axis of the image generating unit 1 form an included angle of 45°, and the central axis of the second optical unit 3 and the center of the image generating unit 1 The axes form an included angle of 90°, the central axis of the image generating unit 1 and the central axis of the second optical unit 3 perpendicularly intersect with the first optical unit 2, and the central axis of the thermal mirror M1 and the The central axis of the image generating unit 1 forms an included angle of 45°, and the central axis of the lens unit M2 and the central axis of the light beam emitted by the infrared light source L form an included angle of 45°.

本实施例提供的头戴显示光学系统的工作原理如下:The working principle of the head-mounted display optical system provided in this embodiment is as follows:

图像投影过程:图像源DS产生和发射携带图像信息的光束a,经过第二透镜单元6准直后到达热反射镜M1,经热反射镜M1透射后到达第一光学单元2。第一光学单元2将光束a反射至第二光学单元3,经第二光学单元3反射的光束a回到第一光学单元2,且经第一光学单元2透射后进入用户的视野,即用户眼睛4。Image projection process: the image source DS generates and emits a light beam a carrying image information, which is collimated by the second lens unit 6 and then reaches the thermal mirror M1 , and is transmitted through the thermal mirror M1 to reach the first optical unit 2 . The first optical unit 2 reflects the light beam a to the second optical unit 3, and the light beam a reflected by the second optical unit 3 returns to the first optical unit 2, and enters the user's field of vision after being transmitted by the first optical unit 2, that is, the user eyes 4.

眼动追踪过程:红外光源L产生红外光束b,经由透反镜单元M2透射至热反射镜M1,并经热反射镜M1反射到第一光学单元2,以及经第一光学单元2反射进入第二光学单元3,再经第二光学单元3反射回第一光学单元2,最后经第一光学单元2透射进入用户眼睛4。进入用户眼睛4的红外光束b由用户眼睛4反射回所述第一光学单元2,经第一光学单元2透射进入第二光学单元3,并依次经第二光学单元3及第一光学单元2反射至热反射镜M1,以及经热反射镜M1反射至透反镜单元M2,最后经透反镜单元 M2反射至图像接收单元C(本实施例采用红外图像传感器),图像接收单元C识别人眼的注视点及注视深度信息,并将所述注视点及注视深度信息反馈给图像产生单元1的处理芯片,处理芯片根据接收到的信息调制可调焦准直透镜的焦距,从而调节投影显示装置的虚拟成像距离,并使虚拟成像距离与眼动追踪装置检测的人眼注视深度相匹配。Eye tracking process: the infrared light source L generates an infrared beam b, which is transmitted to the thermal mirror M1 through the mirror unit M2, reflected to the first optical unit 2 by the thermal mirror M1, and reflected by the first optical unit 2 into the first optical unit 2. The second optical unit 3 is reflected back to the first optical unit 2 through the second optical unit 3 , and finally transmitted through the first optical unit 2 into the user's eye 4 . The infrared light beam b entering the user's eye 4 is reflected back to the first optical unit 2 by the user's eye 4 , transmitted through the first optical unit 2 into the second optical unit 3 , and passed through the second optical unit 3 and the first optical unit 2 in turn Reflected to the thermal mirror M1, and reflected to the mirror unit M2 through the thermal mirror M1, and finally reflected to the image receiving unit C (the infrared image sensor is used in this embodiment) through the mirror unit M2, and the image receiving unit C recognizes the person. The gaze point and gaze depth information of the eyes are fed back to the processing chip of the image generation unit 1, and the processing chip modulates the focal length of the adjustable focus collimating lens according to the received information, thereby adjusting the projection display The virtual imaging distance of the device, and match the virtual imaging distance with the gaze depth of the human eye detected by the eye tracking device.

本发明还提供一种头戴显示设备,包括如上所述的头戴显示光学系统。The present invention also provides a head-mounted display device including the above-mentioned head-mounted display optical system.

综上所述,本发明的有益效果在于:通过理解人眼的注视点、注视深度等信息,调节虚拟成像距离,使虚拟成像距离与人眼注视深度相匹配,以实现更好的沉浸体验和人机交互体验。眼动追踪光学系统与投影显示光学融合,减小显示模组体积,利于增强现实显示设备小型化和轻薄化。To sum up, the beneficial effects of the present invention are: by understanding the gaze point, gaze depth and other information of the human eye, the virtual imaging distance is adjusted so that the virtual imaging distance matches the gaze depth of the human eye, so as to achieve a better immersive experience and Human-computer interaction experience. The eye tracking optical system is optically integrated with the projection display to reduce the volume of the display module, which is conducive to the miniaturization and thinning of the augmented reality display device.

以上仅为本发明的较佳实施例而已,并不用于限制本发明,凡在本发明的精神和原则之内所作的任何修改、等同替换和改进等,均应包含在本发明的保护范围之内。The above are only preferred embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent replacements and improvements made within the spirit and principles of the present invention shall be included in the protection scope of the present invention. Inside.

Claims (10)

1. A head-mounted display optical system comprising a projection display device and an eye tracking device,
the eye movement tracking device is used for identifying the fixation point and the fixation depth information of the human eyes and feeding back the fixation point and the fixation depth information to the projection display device;
the projection display device is used for virtual imaging and adjusting the virtual imaging distance according to the gaze point and gaze depth information fed back by the eye tracking device, so that the virtual imaging distance is matched with the gaze depth of the human eyes detected by the eye tracking device.
2. The head-mounted display optical system according to claim 1, wherein the projection display device comprises: the image generation unit, the first optical unit, the second optical unit;
the image generating unit is used for generating and emitting light beams carrying image information;
the first optical unit is used for reflecting the light beam emitted by the image generating unit to the second optical unit, the second optical unit is used for reflecting the light beam reflected by the first optical unit, and the light beam reflected by the second optical unit returns to the first optical unit and enters the eyes of the user after being transmitted by the first optical unit.
3. The head-mounted display optical system according to claim 2, wherein the eye tracking device comprises: the infrared light source, the transflective mirror unit, the heat reflecting mirror and the image receiving unit;
the infrared light source is used for generating an infrared light beam, the infrared light beam is transmitted to the heat reflecting mirror through the transflective mirror unit, reflected to the first optical unit through the heat reflecting mirror, reflected to the second optical unit through the first optical unit, reflected to the first optical unit through the second optical unit, and transmitted to the eyes of the user through the first optical unit;
infrared light beams entering the eyes of the user are reflected back to the first optical unit by the eyes of the user, transmitted into the second optical unit by the first optical unit, reflected to the heat reflector by the second optical unit and the first optical unit in sequence, reflected to the transflective mirror unit by the heat reflector, and finally reflected to the image receiving unit by the transflective mirror unit;
the image receiving unit identifies the fixation point and the fixation depth information of the human eyes according to the received infrared beams reflected by the eyes of the user, and feeds the fixation point and the fixation depth information back to the image generating unit.
4. The head-mounted display optical system according to claim 3,
the image generation unit emits a light beam carrying image information, and specifically enters the first optical unit after being transmitted by the heat reflecting mirror;
the image generating unit is further configured to adjust a virtual imaging distance according to the gaze point and gaze depth information fed back by the image receiving unit, so that the virtual imaging distance matches with the eye gaze depth detected by the eye tracking device.
5. The head-mounted display optical system according to any one of claims 2 to 4, wherein the image generation unit comprises an image source, a micro-actuation structure and a first lens unit, the micro-actuation structure is used for adjusting the position of the image source or the first lens unit so as to modulate the focal depth of a projection image plane or adjust the effective focal length of the projection display device; or the like, or, alternatively,
the image generating unit comprises an image source and a second lens unit, and the second lens unit is used for transmitting light beams generated by the image source and adjusting the effective focal length of the projection display device.
6. The head-mounted display optical system of claim 5, wherein the second lens unit is a focus-adjustable lens unit consisting of at least one piece of focus-adjustable collimating lens, and the image source is coaxial with the second lens unit.
7. The head-mounted display optical system according to any one of claims 2 to 4, wherein a surface of the first optical unit is provided with a transflective film having a ratio of transmittance to reflectance of 1: 1;
the surface of the second optical unit is provided with a transflective film, the ratio of the transmittance to the reflectance of the transflective film is 1:1, and the surface type of the second optical unit is any one of a spherical surface, an aspheric surface and a free-form surface;
the central axis of the first optical unit and the central axis of the image generating unit of the projection display device form an included angle of 45 degrees;
the central axis of the second optical unit forms an included angle of 90 degrees with the central axis of the image generating unit.
8. The head-mounted display optical system according to claim 7, wherein a central axis of the image generation unit and a central axis of the second optical unit perpendicularly intersect with the first optical unit.
9. The head-mounted display optical system according to any one of claims 3 to 4, wherein the transflective mirror unit is a half-mirror, and the transflective mirror unit is coated with a filter film and responds only to infrared light beams;
the image receiving unit is an infrared image sensor;
the central axis of the heat reflecting mirror and the central axis of the image generating unit of the projection display device form an included angle of 45 degrees;
and the central axis of the transflective mirror unit and the central axis of the infrared light source emission beam form an included angle of 45 degrees.
10. A head-mounted display apparatus comprising the head-mounted display optical system according to any one of claims 1 to 9.
CN201911013961.5A 2019-10-23 2019-10-23 Head-mounted display optical system and head-mounted display equipment Pending CN110727111A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201911013961.5A CN110727111A (en) 2019-10-23 2019-10-23 Head-mounted display optical system and head-mounted display equipment
PCT/CN2020/117507 WO2021077980A1 (en) 2019-10-23 2020-09-24 Head-mounted display optical system and head-mounted display device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911013961.5A CN110727111A (en) 2019-10-23 2019-10-23 Head-mounted display optical system and head-mounted display equipment

Publications (1)

Publication Number Publication Date
CN110727111A true CN110727111A (en) 2020-01-24

Family

ID=69221880

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911013961.5A Pending CN110727111A (en) 2019-10-23 2019-10-23 Head-mounted display optical system and head-mounted display equipment

Country Status (2)

Country Link
CN (1) CN110727111A (en)
WO (1) WO2021077980A1 (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111338081A (en) * 2020-03-12 2020-06-26 京东方科技集团股份有限公司 AR optical system and AR display device
CN111830714A (en) * 2020-07-24 2020-10-27 闪耀现实(无锡)科技有限公司 Image display control method, image display control device, and head-mounted display device
CN111929893A (en) * 2020-07-24 2020-11-13 闪耀现实(无锡)科技有限公司 Augmented reality display device and equipment thereof
WO2021077980A1 (en) * 2019-10-23 2021-04-29 深圳惠牛科技有限公司 Head-mounted display optical system and head-mounted display device
CN112866672A (en) * 2020-12-30 2021-05-28 深圳卡乐星球数字娱乐有限公司 Augmented reality system and method for immersive cultural entertainment
CN112946895A (en) * 2021-02-02 2021-06-11 业成科技(成都)有限公司 Head-mounted display device
CN113296347A (en) * 2021-04-12 2021-08-24 北京计算科学研究中心 Naked eye display device
CN113325947A (en) * 2020-02-28 2021-08-31 北京七鑫易维信息技术有限公司 Display method, display device, terminal equipment and storage medium
CN113433628A (en) * 2021-06-23 2021-09-24 河南鑫宇光科技股份有限公司 Low-crosstalk single-wavelength optical device
CN113589532A (en) * 2021-07-30 2021-11-02 歌尔光学科技有限公司 Display calibration method and device of head-mounted equipment, head-mounted equipment and storage medium
WO2022247482A1 (en) * 2021-05-27 2022-12-01 华为技术有限公司 Virtual display device and virtual display method
CN115670368A (en) * 2021-07-23 2023-02-03 京东方科技集团股份有限公司 Imaging adjusting device and method, wearable device and storage medium
WO2023116541A1 (en) * 2021-12-22 2023-06-29 华为技术有限公司 Eye tracking apparatus, display device, and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6433760B1 (en) * 1999-01-14 2002-08-13 University Of Central Florida Head mounted display with eyetracking capability
CN103792661A (en) * 2013-12-20 2014-05-14 香港应用科技研究院有限公司 Integrated dual-sensing optical architecture for head-mounted displays
CN204595327U (en) * 2014-12-26 2015-08-26 成都理想境界科技有限公司 Head-mounted display apparatus
CN106199958A (en) * 2015-05-07 2016-12-07 尚立光电股份有限公司 Automatic focusing head-mounted display device
CN210573016U (en) * 2019-10-23 2020-05-19 深圳惠牛科技有限公司 Head-mounted display optical system and head-mounted display equipment

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101587542A (en) * 2009-06-26 2009-11-25 上海大学 Field depth blending strengthening display method and system based on eye movement tracking
US9304319B2 (en) * 2010-11-18 2016-04-05 Microsoft Technology Licensing, Llc Automatic focus improvement for augmented reality displays
JP2015087581A (en) * 2013-10-31 2015-05-07 株式会社東芝 Display device
US11263794B2 (en) * 2015-01-21 2022-03-01 Chengdu Idealsee Technology Co., Ltd. Binocular see-through AR head-mounted display device and information displaying method thereof
CN109766820A (en) * 2019-01-04 2019-05-17 北京七鑫易维信息技术有限公司 A kind of eyeball tracking device, headset equipment and eyes image acquisition methods
CN110727111A (en) * 2019-10-23 2020-01-24 深圳惠牛科技有限公司 Head-mounted display optical system and head-mounted display equipment

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6433760B1 (en) * 1999-01-14 2002-08-13 University Of Central Florida Head mounted display with eyetracking capability
CN103792661A (en) * 2013-12-20 2014-05-14 香港应用科技研究院有限公司 Integrated dual-sensing optical architecture for head-mounted displays
CN204595327U (en) * 2014-12-26 2015-08-26 成都理想境界科技有限公司 Head-mounted display apparatus
CN106199958A (en) * 2015-05-07 2016-12-07 尚立光电股份有限公司 Automatic focusing head-mounted display device
CN210573016U (en) * 2019-10-23 2020-05-19 深圳惠牛科技有限公司 Head-mounted display optical system and head-mounted display equipment

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021077980A1 (en) * 2019-10-23 2021-04-29 深圳惠牛科技有限公司 Head-mounted display optical system and head-mounted display device
CN113325947A (en) * 2020-02-28 2021-08-31 北京七鑫易维信息技术有限公司 Display method, display device, terminal equipment and storage medium
US12099187B2 (en) 2020-03-12 2024-09-24 Beijing Boe Optoelectronics Technology Co., Ltd. AR optical system and AR display device
CN111338081A (en) * 2020-03-12 2020-06-26 京东方科技集团股份有限公司 AR optical system and AR display device
WO2021179786A1 (en) * 2020-03-12 2021-09-16 京东方科技集团股份有限公司 Ar optical system and ar display device
US12393035B2 (en) 2020-07-24 2025-08-19 Matrixed Reality Technology Co., Ltd. Augmented reality display apparatus
CN111830714A (en) * 2020-07-24 2020-10-27 闪耀现实(无锡)科技有限公司 Image display control method, image display control device, and head-mounted display device
US12078808B2 (en) 2020-07-24 2024-09-03 Matrixed Reality Technology Co., Ltd. Augmented reality display apparatus and augmented reality display device comprising same
CN111830714B (en) * 2020-07-24 2024-03-29 闪耀现实(无锡)科技有限公司 Image display control method, image display control device and head-mounted display device
US11889050B2 (en) 2020-07-24 2024-01-30 Matrixed Reality Technology Co., Ltd. Image display control method, image display control apparatus, and head-mounted display device
CN111929893A (en) * 2020-07-24 2020-11-13 闪耀现实(无锡)科技有限公司 Augmented reality display device and equipment thereof
WO2022017447A1 (en) * 2020-07-24 2022-01-27 闪耀现实(无锡)科技有限公司 Image display control method, image display control apparatus, and head-mounted display device
CN115390256A (en) * 2020-07-24 2022-11-25 闪耀现实(无锡)科技有限公司 Augmented reality display device and equipment thereof
EP4160298A4 (en) * 2020-07-24 2023-11-29 Matrixed Reality Technology Co., Ltd. AUGMENTED REALITY DISPLAY DEVICE AND AUGMENTED REALITY DISPLAY DEVICE THEREFOR
EP4160299A4 (en) * 2020-07-24 2023-11-22 Matrixed Reality Technology Co., Ltd. IMAGE DISPLAY CONTROL METHOD, IMAGE DISPLAY CONTROL DEVICE AND HEAD-MOUNTED DISPLAY DEVICE
CN112866672A (en) * 2020-12-30 2021-05-28 深圳卡乐星球数字娱乐有限公司 Augmented reality system and method for immersive cultural entertainment
CN112946895A (en) * 2021-02-02 2021-06-11 业成科技(成都)有限公司 Head-mounted display device
CN113296347A (en) * 2021-04-12 2021-08-24 北京计算科学研究中心 Naked eye display device
WO2022247482A1 (en) * 2021-05-27 2022-12-01 华为技术有限公司 Virtual display device and virtual display method
CN113433628A (en) * 2021-06-23 2021-09-24 河南鑫宇光科技股份有限公司 Low-crosstalk single-wavelength optical device
CN115670368A (en) * 2021-07-23 2023-02-03 京东方科技集团股份有限公司 Imaging adjusting device and method, wearable device and storage medium
CN113589532A (en) * 2021-07-30 2021-11-02 歌尔光学科技有限公司 Display calibration method and device of head-mounted equipment, head-mounted equipment and storage medium
WO2023116541A1 (en) * 2021-12-22 2023-06-29 华为技术有限公司 Eye tracking apparatus, display device, and storage medium

Also Published As

Publication number Publication date
WO2021077980A1 (en) 2021-04-29

Similar Documents

Publication Publication Date Title
CN110727111A (en) Head-mounted display optical system and head-mounted display equipment
CN111433660B (en) Compact polychromatic beam combiner using geometric phase lenses
US8810600B2 (en) Wearable display device calibration
CN104956252B (en) Peripheral display for near-eye display device
CN112136084A (en) Optical assembly with polarizer holographic element
CN113454504B (en) Holographic pattern generation for Head Mounted Display (HMD) eye tracking using diffractive optical elements
CN101336089A (en) eye tracker device
TWI775240B (en) Intelligent virtual display device
CN210573016U (en) Head-mounted display optical system and head-mounted display equipment
US20170308160A1 (en) Off-Axis Eye Tracker
CN107003520A (en) See-Through Display Optical Structure
US11644673B2 (en) Near-eye optical system
US12001030B1 (en) Shadow-matched Fresnel lens doublet for reduced optical artifacts
US20230360567A1 (en) Virtual reality display system
CN113168013A (en) Optical system for augmented reality head-mounted device and design and manufacturing method
TW202334702A (en) Display systems with collection optics for disparity sensing detectors
WO2023158654A1 (en) Hybrid waveguide to maximize coverage in field of view (fov)
CN118591753A (en) Display system having a grating oriented to reduce the appearance of ghost images
US11366298B1 (en) Eye tracking based on telecentric polarization sensitive grating
CN105212890B (en) Eye tracker equipment
TWI738407B (en) Head mounted display device
US10634916B2 (en) Wearable display device
CN220627014U (en) Computing system with head-mounted display
US20240036318A1 (en) System to superimpose information over a users field of view
WO2020036681A1 (en) Backside reinforcement structure design for mirror flatness

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20200124

RJ01 Rejection of invention patent application after publication