CN110727111A - Head-mounted display optical system and head-mounted display equipment - Google Patents
Head-mounted display optical system and head-mounted display equipment Download PDFInfo
- Publication number
- CN110727111A CN110727111A CN201911013961.5A CN201911013961A CN110727111A CN 110727111 A CN110727111 A CN 110727111A CN 201911013961 A CN201911013961 A CN 201911013961A CN 110727111 A CN110727111 A CN 110727111A
- Authority
- CN
- China
- Prior art keywords
- unit
- optical unit
- image
- optical
- head
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
Abstract
本发明公开一种头戴显示光学系统及头戴显示设备,其中头戴显示光学系统包括投影显示装置和眼动追踪装置。其中,眼动追踪装置,用于识别人眼的注视点及注视深度信息,并将所述注视点及注视深度信息反馈给所述投影显示装置;所述投影显示装置,用于虚拟成像,以及用于根据所述眼动跟踪装置反馈的所述注视点及注视深度信息调节虚拟成像距离,使虚拟成像距离与所述眼动追踪装置检测到的人眼注视深度相匹配。本发明通过理解人眼的注视点、注视深度等信息,调节虚拟成像距离,使虚拟成像距离与人眼注视深度相匹配,以实现更好的沉浸体验和人机交互体验。眼动追踪装置与投影显示装置融合,减小显示模组体积,利于增强现实显示设备小型化和轻薄化。
The invention discloses a head-mounted display optical system and a head-mounted display device, wherein the head-mounted display optical system includes a projection display device and an eye tracking device. Wherein, an eye tracking device is used to identify the gaze point and gaze depth information of human eyes, and feed back the gaze point and gaze depth information to the projection display device; the projection display device is used for virtual imaging, and The virtual imaging distance is adjusted according to the gaze point and gaze depth information fed back by the eye tracking device, so that the virtual imaging distance matches the gaze depth of the human eye detected by the eye tracking device. The invention adjusts the virtual imaging distance by understanding the gaze point, gaze depth and other information of the human eye, so that the virtual imaging distance matches the gaze depth of the human eye, so as to achieve better immersion experience and human-computer interaction experience. The eye tracking device is integrated with the projection display device to reduce the volume of the display module, which is conducive to the miniaturization and thinning of the augmented reality display device.
Description
技术领域technical field
本发明涉及显示设备技术领域,尤其涉及一种头戴显示光学系统及头戴显示设备。The present invention relates to the technical field of display devices, and in particular, to a head-mounted display optical system and a head-mounted display device.
背景技术Background technique
随着科学技术的不断发展,越来越多的显示设备被广泛应用于人们的日常生活以及工作当中,为人们的日常生活以及工作带来了巨大的便利,成为当今人们不可或缺的重要工具。其中头戴显示技术作为一种由光学、电子学、软件交互等多种领域相结合的新型技术也得到了突飞猛进的发展。With the continuous development of science and technology, more and more display devices are widely used in people's daily life and work, bringing great convenience to people's daily life and work, and becoming an indispensable tool for people today . Among them, head-mounted display technology has also developed by leaps and bounds as a new technology that combines optics, electronics, software interaction and other fields.
头戴式显示器(HMD)中的微型显示器和光学系统将来自微型显示器的图像投射到用户眼睛并允许用户看到真实世界。头戴式显示器具有许多实用性的应用和休闲的应用,例如航空和航天应用领域允许飞行员看见重要的飞行控制信息而不必使他们的眼睛离开飞行路径;公共安全领域应用包括地图和热成像的战术显示;其他领域的应用还包括视频游戏、交通运输和无线电通信等。Microdisplays and optical systems in head mounted displays (HMDs) project images from the microdisplays to the user's eyes and allow the user to see the real world. Head-mounted displays have many practical and recreational applications, such as aviation and aerospace applications that allow pilots to see important flight control information without taking their eyes off the flight path; public safety applications include tactical maps and thermal imaging display; other applications include video games, transportation, and radio communications.
随着HMD技术的发展,人与环境、虚拟内容间的理解和交互,逐渐成为一个关键的需求,人体视觉感官的交互也成为一个研究热点。利用眼动追踪技术获取眼球运动信息,通过追踪眼球及周边特征变化、虹膜角度变化或虹膜反射特征等信息之一获取眼球的注视、汇聚、转动及瞳孔变化情况,从而实现对人体视觉感官的理解,并反馈给显示内容处理单元进行相应的匹配,提升整体的视觉沉浸感。在头戴式显示设备的应用领域,眼动追踪成为其使用过程中重要的交互方式。With the development of HMD technology, the understanding and interaction between people and the environment and virtual content has gradually become a key requirement, and the interaction of human visual senses has also become a research hotspot. Use eye tracking technology to obtain eye movement information, and obtain eye gaze, convergence, rotation and pupil changes by tracking one of the information such as eye and peripheral feature changes, iris angle changes or iris reflection characteristics, so as to realize the understanding of human visual senses , and feedback it to the display content processing unit for corresponding matching to enhance the overall visual immersion. In the application field of head-mounted display devices, eye tracking has become an important interaction method during its use.
利用眼动追踪,能够理解人眼的关注点、视距以及应激反应等,实时调节HMD显示内容,增强用户视觉的沉浸感。在一类已知的应用中,眼动追踪可实现注视点渲染,即对人眼注视的区域进行高清渲染,周边视野降低渲染率,以降低处理单元成本。在一种已知的非接触式光学眼动追踪技术中,光源发出红外光,红外光从眼睛反射并由图像传感器接收,通过分析由图像传感器感测的信息,以从反射光的变化中获知注视方向或瞳孔位置等眼动情况。Using eye tracking, it can understand the focus of the human eye, viewing distance, and stress response, adjust the HMD display content in real time, and enhance the user's visual immersion. In a known class of applications, eye tracking enables foveated rendering, that is, high-definition rendering of the area where the human eye is fixed, and the peripheral field of view reduces the rendering rate to reduce processing unit costs. In one known non-contact optical eye-tracking technique, a light source emits infrared light, which is reflected from the eye and received by an image sensor, and the information sensed by the image sensor is analyzed to learn from changes in the reflected light Eye movements such as gaze direction or pupil position.
近几年随着科技的发展,国内外皆有推出装有眼动追踪技术的虚拟现实头戴式显示设备,在虚拟的环境中捕获眼动行为进行数据分析,或者通过眼动设备与虚拟环境的事物进行交互。传统头戴显示设备中引入眼动追踪功能也主要用于通过注视点跟踪来扩展视场,针对提升用户沉浸体验和人机交互体验方面研究较少,而且额外增加到头戴显示模组中的眼动追踪光学元件对显示模组的小型化和美观也会带来很大难题。In recent years, with the development of science and technology, virtual reality head-mounted display devices equipped with eye-tracking technology have been launched at home and abroad to capture eye-movement behavior in a virtual environment for data analysis, or through eye-tracking devices and virtual environments. things interact. The eye-tracking function introduced into traditional head-mounted display devices is mainly used to expand the field of view through gaze tracking. There is little research on improving user immersion experience and human-computer interaction experience, and additionally added to the head-mounted display module. Eye tracking optics will also bring great challenges to the miniaturization and aesthetics of the display module.
因此,现有技术存在不足,需要改进。Therefore, the existing technology has shortcomings and needs to be improved.
发明内容SUMMARY OF THE INVENTION
本发明的目的是克服现有技术的不足,提供一种头戴显示光学系统及头戴显示设备。The purpose of the present invention is to overcome the deficiencies of the prior art and provide a head-mounted display optical system and a head-mounted display device.
本发明的技术方案如下:提供一种头戴显示光学系统,包括投影显示装置和眼动追踪装置。The technical solutions of the present invention are as follows: a head-mounted display optical system is provided, which includes a projection display device and an eye tracking device.
所述眼动追踪装置,用于识别人眼的注视点及注视深度信息,并将所述注视点及注视深度信息反馈给所述投影显示装置。The eye tracking device is used for identifying the gaze point and gaze depth information of human eyes, and feeding back the gaze point and gaze depth information to the projection display device.
所述投影显示装置,用于虚拟成像,以及用于根据所述眼动跟踪装置反馈的所述注视点及注视深度信息调节虚拟成像距离,使虚拟成像距离与所述眼动追踪装置检测到的人眼注视深度相匹配。The projection display device is used for virtual imaging, and is used for adjusting the virtual imaging distance according to the gaze point and gaze depth information fed back by the eye tracking device, so that the virtual imaging distance is the same as that detected by the eye tracking device. Human eye gaze depth matches.
进一步地,所述投影显示装置包括:图像产生单元、第一光学单元、第二光学单元。Further, the projection display device includes: an image generating unit, a first optical unit, and a second optical unit.
所述图像产生单元,用于产生和发射携带图像信息的光束。The image generating unit is used for generating and emitting a light beam carrying image information.
所述第一光学单元用于将所述图像产生单元发射的光束反射至所述第二光学单元,所述第二光学单元用于对所述第一光学单元反射来的光束进行反射,经所述第二光学单元反射后的光束再回到所述第一光学单元,并经所述第一光学单元透射后进入用户眼睛。The first optical unit is used for reflecting the light beam emitted by the image generating unit to the second optical unit, and the second optical unit is used for reflecting the light beam reflected by the first optical unit, The light beam reflected by the second optical unit returns to the first optical unit, and enters the user's eyes after being transmitted through the first optical unit.
进一步地,所述眼动追踪装置包括:红外光源、透反镜单元、热反射镜和图像接收单元。Further, the eye tracking device includes: an infrared light source, a transmissive mirror unit, a thermal mirror and an image receiving unit.
所述红外光源用于产生红外光束,所述红外光束经由所述透反镜单元透射至所述热反射镜,并经所述热反射镜反射到所述第一光学单元,以及经所述第一光学单元反射进入所述第二光学单元,再经所述第二光学单元反射回所述第一光学单元,最后经所述第一光学单元透射进入用户眼睛。The infrared light source is used to generate an infrared light beam, the infrared light beam is transmitted to the thermal mirror through the transflective mirror unit, reflected to the first optical unit through the thermal mirror, and passed through the first optical unit. An optical unit is reflected into the second optical unit, then reflected back to the first optical unit through the second optical unit, and finally transmitted through the first optical unit into the user's eyes.
进入用户眼睛的红外光束由用户眼睛反射回所述第一光学单元,经所述第一光学单元透射进入所述第二光学单元,并依次经所述第二光学单元及所述第一光学单元反射至所述热反射镜,以及经所述热反射镜反射至所述透反镜单元,最后经所述透反镜单元反射至所述图像接收单元。The infrared light beam entering the user's eye is reflected back to the first optical unit by the user's eye, transmitted through the first optical unit and enters the second optical unit, and sequentially passes through the second optical unit and the first optical unit Reflected to the hot mirror, and reflected to the lenticular unit through the thermal mirror, and finally reflected to the image receiving unit through the lenticular unit.
所述图像接收单元根据接收的用户眼睛反射的红外光束识别人眼的注视点及注视深度信息,并将所述注视点及注视深度信息反馈给所述图像产生单元。The image receiving unit identifies the gaze point and gaze depth information of the human eye according to the received infrared beam reflected by the user's eyes, and feeds back the gaze point and gaze depth information to the image generating unit.
进一步地,所述图像产生单元发射携带图像信息的光束,具体经所述热反射镜透射后进入所述第一光学单元。Further, the image generating unit emits a light beam carrying image information, and enters the first optical unit after being transmitted through the thermal mirror.
所述图像产生单元,还用于根据所述图像接收单元反馈的所述注视点及注视深度信息调整虚拟成像的距离,使虚拟成像距离与所述眼动追踪装置检测到的人眼注视深度相匹配。The image generating unit is further configured to adjust the virtual imaging distance according to the gaze point and gaze depth information fed back by the image receiving unit, so that the virtual imaging distance is consistent with the gaze depth of the human eye detected by the eye tracking device. match.
进一步地所述图像产生单元包括图像源、微致动结构和第一透镜单元,所述微致动结构用于调节所述图像源或所述第一透镜单元的位置,从而调制投影图像面的焦深或调整所述投影显示装置的有效焦距。或,Further, the image generating unit includes an image source, a micro-actuating structure and a first lens unit, and the micro-actuating structure is used to adjust the position of the image source or the first lens unit, thereby modulating the projection image surface. Focus depth or adjust the effective focal length of the projection display device. or,
所述图像产生单元包括图像源和第二透镜单元,所述第二透镜单元用于透射所述图像源产生的光束并调整所述投影显示装置的有效焦距。The image generating unit includes an image source and a second lens unit, and the second lens unit is configured to transmit the light beam generated by the image source and adjust the effective focal length of the projection display device.
进一步地,所述第二透镜单元为可调焦透镜单元,由至少一片可调焦准直透镜组成,所述图像源与所述第二透镜单元共轴。Further, the second lens unit is an adjustable focus lens unit, which is composed of at least one adjustable focus collimating lens, and the image source is coaxial with the second lens unit.
进一步地,所述第一光学单元的表面设置有透反膜,所述透反膜的透射率与反射率的比例为1:1。Further, the surface of the first optical unit is provided with a transflective film, and the ratio of transmittance to reflectivity of the transflective film is 1:1.
所述第二光学单元的表面设置有透反膜,所述透反膜的透射率与反射率的比例为1:1,所述第二光学单元的面型为球面、非球面、自由曲面中的任一种。The surface of the second optical unit is provided with a transflective film, the ratio of transmittance to reflectivity of the transflective film is 1:1, and the surface type of the second optical unit is spherical, aspherical, or free-form surface. any of the.
所述第一光学单元的中心轴与所述投影显示装置的图像产生单元的中心轴成45°夹角。The central axis of the first optical unit forms an included angle of 45° with the central axis of the image generating unit of the projection display device.
所述第二光学单元的中心轴与所述图像产生单元的中心轴成90°夹角。The central axis of the second optical unit forms an included angle of 90° with the central axis of the image generating unit.
进一步地,所述图像产生单元的中心轴与所述第二光学单元的中心轴垂直相交于所述第一光学单元。Further, the central axis of the image generating unit and the central axis of the second optical unit are perpendicular to the first optical unit.
进一步地,所述透反镜单元为半透半反镜,所述透反镜单元表面镀有滤光膜,仅对红外光束响应。Further, the mirror unit is a half mirror, the surface of the mirror unit is coated with a filter film, and only responds to infrared light beams.
所述图像接收单元为红外图像传感器。The image receiving unit is an infrared image sensor.
所述热反射镜的中心轴与所述投影显示装置的图像产生单元的中心轴成45夹角°。The central axis of the thermal mirror and the central axis of the image generating unit of the projection display device form an included angle of 45°.
所述透反镜单元的中心轴与所述红外光源发射光束的中心轴成45°夹角。The central axis of the lens unit and the central axis of the light beam emitted by the infrared light source form an included angle of 45°.
本发明还提供一种头戴显示设备,包括如上所述的头戴显示光学系统。The present invention also provides a head-mounted display device including the above-mentioned head-mounted display optical system.
采用上述方案,本发明的有益效果在于:通过理解人眼的注视点、注视深度等信息,调节虚拟成像距离,使虚拟成像距离与人眼注视深度相匹配,以实现更好的沉浸体验和人机交互体验。眼动追踪光学系统与投影显示光学融合,减小显示模组体积,利于增强现实显示设备小型化和轻薄化。By adopting the above scheme, the beneficial effect of the present invention is that: by understanding the gaze point, gaze depth and other information of the human eye, the virtual imaging distance is adjusted so that the virtual imaging distance matches the gaze depth of the human eye, so as to achieve a better immersive experience and human computer interaction experience. The eye tracking optical system is optically integrated with the projection display to reduce the volume of the display module, which is conducive to the miniaturization and thinning of the augmented reality display device.
附图说明Description of drawings
图1为本发明头戴显示光学系统的结构示意图;1 is a schematic structural diagram of a head-mounted display optical system of the present invention;
图2为本发明头戴显示光学系统一实施例的结构示意图;2 is a schematic structural diagram of an embodiment of a head-mounted display optical system according to the present invention;
图3为本发明头戴显示光学系统另一实施例的结构示意图。FIG. 3 is a schematic structural diagram of another embodiment of the head-mounted display optical system of the present invention.
具体实施方式Detailed ways
为了使本发明所要解决的技术问题、技术方案及有益效果更加清楚明白,以下结合附图及实施例,对本发明进行进一步详细说明。应当理解,此处所描述的具体实施例仅用以解释本发明,并不用于限定本发明。In order to make the technical problems, technical solutions and beneficial effects to be solved by the present invention clearer, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention, but not to limit the present invention.
需要说明的是,当元件被称为“设置于”另一个元件,它可以直接在另一个元件上或者间接在该另一个元件上。当一个元件被称为是“连接于”另一个元件,它可以是直接连接到另一个元件或间接连接至该另一个元件上。此外,术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征。在本发明的描述中,“多个”的含义是两个或两个以上,除非另有明确具体的限定。It should be noted that when an element is referred to as being "disposed on" another element, it can be directly on the other element or indirectly on the another element. When an element is referred to as being "connected to" another element, it can be directly connected to the other element or indirectly connected to the other element. In addition, the terms "first" and "second" are only used for descriptive purposes, and should not be construed as indicating or implying relative importance or implying the number of indicated technical features. Thus, a feature defined as "first" or "second" may expressly or implicitly include one or more of that feature. In the description of the present invention, "plurality" means two or more, unless otherwise expressly and specifically defined.
请参阅图1至图3,本发明提供一种头戴显示光学系统,包括投影显示装置和眼动追踪装置。所述眼动追踪装置,用于识别人眼的注视点及注视深度信息,并将注视点及注视深度信息反馈给所述投影显示装置。所述投影显示装置,用于虚拟成像,同时能够根据所述眼动跟踪装置反馈的注视点及注视深度信息调节虚拟成像距离,使虚拟成像距离与眼动追踪装置检测到的人眼注视深度相匹配。Referring to FIGS. 1 to 3 , the present invention provides a head-mounted display optical system, including a projection display device and an eye tracking device. The eye tracking device is used for identifying the gaze point and gaze depth information of human eyes, and feeding the gaze point and gaze depth information back to the projection display device. The projection display device is used for virtual imaging, and at the same time, the virtual imaging distance can be adjusted according to the gaze point and gaze depth information fed back by the eye tracking device, so that the virtual imaging distance is consistent with the human eye gaze depth detected by the eye tracking device. match.
具体地,所述投影显示装置包括:图像产生单元1、第一光学单元2和第二光学单元3,所述图像产生单元1用于产生和发射携带图像信息的光束,同时用于根据所述眼动跟踪装置反馈的所述注视点及注视深度信息调整虚拟成像的距离,使虚拟成像距离与所述眼动追踪装置检测到的人眼注视深度相匹配;所述第一光学单元2用于将所述图像产生单元1发射的光束反射至所述第二光学单元3,所述第二光学单元3用于对所述第一光学单元2 反射来的光束进行反射,经所述第二光学单元3反射后的光束再回到所述第一光学单元2,并经所述第一光学单元2透射后进入用户眼睛4。所述第一光学单元2的中心轴与所述图像产生单元1的中心轴成45°夹角,所述第一光学单元2的表面设置有透反膜,所述第一光学单元2的透射率与反射率的比例为1:1,或其他特殊比例设定的透反膜;所述第二光学单元3的中心轴与所述图像产生单元1的中心轴成90°夹角,所述第二光学单元3的表面设置有透反膜,所述第二光学单元3的透射率与反射率的比例为1:1,或其他特殊比例设定的透反膜,具体地,所述第二光学单元为球面、非球面、自由曲面结构中的任一种。具体地,本实施例中,所述第二光学单元3的中心轴为X轴,所述图像产生单元1的中心轴为Y轴,所述X轴与所述Y 轴相互垂直,具体地,本实施例中,所述图像产生单元1的中心轴与所述第二光学单元3的中心轴垂直相交于所述第一光学单元2。Specifically, the projection display device includes: an
所述眼动追踪装置包括:红外光源L、透反镜单元M2、热反射镜M1、图像接收单元C。所述红外光源L用于产生红外光束,所述红外光束经由所述透反镜单元M2透射至所述热反射镜M1,并经所述热反射镜M1反射到所述第一光学单元2,以及经所述第一光学单元2反射进入所述第二光学单元3,再经所述第二光学单元3反射回所述第一光学单元2,最后经所述第一光学单元2透射进入用户眼睛4。进入用户眼睛4的红外光束由用户眼睛4反射回所述第一光学单元2,经所述第一光学单元2透射进入所述第二光学单元3,并依次经所述第二光学单元3及所述第一光学单元2反射至所述热反射镜M1,以及经所述热反射镜M1反射至所述透反镜单元M2,最后经所述透反镜单元M2反射至所述图像接收单元C。所述图像接收单元C 根据接收的用户眼镜4反射的红外光束识别人眼的注视点及注视深度信息,并将所述注视点及注视深度信息反馈给所述图像产生单元1。具体地,本实施例中,所述透反镜单元M2为半透半反镜,所述透反镜单元M2表面镀有滤光膜,仅对红外光束响应,所述透反镜单元M2的中心轴与所述红外光源 L发射光束的中心轴成45°夹角,所述热反射镜M1的中心轴与所述图像产生单元1的中心轴成45°夹角。The eye tracking device includes: an infrared light source L, a transmissive mirror unit M2, a thermal mirror M1, and an image receiving unit C. The infrared light source L is used to generate an infrared light beam, and the infrared light beam is transmitted to the thermal mirror M1 through the transmissive mirror unit M2, and reflected to the first optical unit 2 through the thermal mirror M1, and reflected by the first optical unit 2 into the second optical unit 3 , and then reflected back to the first optical unit 2 by the second optical unit 3 , and finally transmitted through the first optical unit 2 into the user eyes 4. The infrared light beam entering the user's eye 4 is reflected back to the first optical unit 2 by the user's eye 4, transmitted through the first optical unit 2 and enters the second optical unit 3, and passes through the second optical unit 3 and The first optical unit 2 is reflected to the hot mirror M1, reflected to the mirror unit M2 by the hot mirror M1, and finally reflected to the image receiving unit by the mirror unit M2 C. The image receiving unit C identifies the gaze point and gaze depth information of the human eye according to the received infrared beam reflected by the user's glasses 4 , and feeds the gaze point and gaze depth information back to the
请参阅图1,本发明提供的头戴显示光学系统的工作原理如下:Referring to FIG. 1, the working principle of the head-mounted display optical system provided by the present invention is as follows:
图像投影过程:图像产生单元1产生和发射携带图像信息的光束a,到达第一光学单元2之后,由第一光学单元2对光束a反射至第二光学单元3,经第二光学单元3反射后光束a回到第一光学单元2,且经第一光学单元2 透射后进入用户的视野,即用户眼睛4。Image projection process: the
眼动追踪过程:红外光源L产生红外光束b,经由透反镜单元M2透射至热反射镜M1,并经热反射镜M1反射到第一光学单元2,以及经第一光学单元2反射进入第二光学单元3,再经第二光学单元3反射回第一光学单元2,最后经第一光学单元2透射进入用户眼睛4。进入用户眼睛4的红外光束b由用户眼睛4反射回所述第一光学单元2,经第一光学单元2透射进入第二光学单元3,并依次经第二光学单元3及第一光学单元2反射至热反射镜M1,以及经热反射镜M1反射至透反镜单元M2,最后经透反镜单元 M2反射至图像接收单元C。图像接收单元C根据接收的用户眼镜4反射的红外光束b识别人眼的注视点及注视深度信息,并将所述注视点及注视深度信息反馈给所述图像产生单元1,图像产生单元1根据接收到的注视点及注视深度信息调节投影显示装置的虚拟成像距离,并使虚拟成像距离与眼动追踪装置检测的人眼注视深度相匹配。Eye tracking process: the infrared light source L generates an infrared beam b, which is transmitted to the thermal mirror M1 through the mirror unit M2, reflected to the first optical unit 2 by the thermal mirror M1, and reflected by the first optical unit 2 into the first optical unit 2. The second optical unit 3 is reflected back to the first optical unit 2 through the second optical unit 3 , and finally transmitted through the first optical unit 2 into the user's eye 4 . The infrared light beam b entering the user's eye 4 is reflected back to the first optical unit 2 by the user's eye 4 , transmitted through the first optical unit 2 into the second optical unit 3 , and passed through the second optical unit 3 and the first optical unit 2 in turn It is reflected to the hot mirror M1, reflected to the lenticular mirror unit M2 through the thermal mirror M1, and finally reflected to the image receiving unit C through the lenticular mirror unit M2. The image receiving unit C identifies the gaze point and gaze depth information of the human eye according to the received infrared beam b reflected by the user's glasses 4, and feeds back the gaze point and gaze depth information to the
请参阅图1与图2,为本发明的一实施例,本实施例中所述图像产生单元1包括图像源DS、微致动结构A1和第一透镜单元5。所述图像源DS能够产生和发射携带图像信息的光束,所述图像源DS为微显示器,具体地,本实施例中所述图像源DS为OLED显示器、或LCD显示器、或LCOS显示器。所述微致动结构A1用于调节所述图像源DS的位置,从而调制投影图像面的焦深,或用于调节所述第一透镜单元5的位置,进而调整所述投影显示装置的有效焦距,进而实现虚拟成像距离的调节。具体地,本实施例中,所述微致动结构A1为电磁、MEMS、压电材料以及记忆金属可致动微结构中的任一种,所述图像源DS包括一处理芯片,所述处理芯片与所述微致动结构A1信号连接进而控制所述微致动结构A1调节所述图像源DS 或所述第一透镜单元5的位置。所述第一透镜单元5同时可以透射所述图像源DS产生的光束,所述第一透镜单元5包括至少一片透镜,所述透镜为准直透镜。本实施例中,所述图像源DS与所述第一透镜单元5共轴。本实施例中,所述第一光学单元2的中心轴与所述图像产生单元1的中心轴成 45°夹角,所述第二光学单元3的中心轴与所述图像产生单元1的中心轴成 90°夹角,所述图像产生单元1的中心轴与所述第二光学单元3的中心轴垂直相交于所述第一光学单元2,所述热反射镜M1的中心轴与所述图像产生单元1的中心轴成45°夹角,所述透反镜单元M2的中心轴与所述红外光源 L发射光束的中心轴成45°夹角。Please refer to FIG. 1 and FIG. 2 , which are an embodiment of the present invention. In this embodiment, the
本实施例提供的头戴显示光学系统的工作原理如下:The working principle of the head-mounted display optical system provided in this embodiment is as follows:
图像投影过程:图像源DS产生和发射携带图像信息的光束a,经过第一透镜单元5准直后到达热反射镜M1,经热反射镜M1的透射后到达第一光学单元2。再由第一光学单元2对光束a进行反射,到达第二光学单元3,经第二光学单元3反射的光束a回到第一光学单元2,并经第一光学单元2 透射后进入用户的视野,即用户眼睛4。Image projection process: the image source DS generates and emits a light beam a carrying image information, which is collimated by the
眼动追踪过程:红外光源L产生红外光束b,经由透反镜单元M2透射至热反射镜M1,并经热反射镜M1反射到第一光学单元2,以及经第一光学单元2反射进入第二光学单元3,再经第二光学单元3反射回第一光学单元2,最后经第一光学单元2透射进入用户眼睛4。进入用户眼睛4的红外光束b由用户眼睛4反射回所述第一光学单元2,经第一光学单元2透射进入第二光学单元3,并依次经第二光学单元3反射后到达第一光学单元2,再经第一光学单元2反射至热反射镜M1,以及经热反射镜M1反射至透反镜单元M2,最后经透反镜单元M2反射至图像接收单元C(本实施例采用红外图像传感器),图像接收单元C识别人眼的注视点及注视深度信息,并将所述注视点及注视深度信息反馈给图像产生单元1的处理芯片,所述处理芯片根据接收到的注视点及注视深度信息调制微致动结构A1,进而调整所述图像源DS或所述第一透镜单元5的位置,从而调节投影显示装置的虚拟成像距离,并使虚拟成像距离与眼动追踪装置检测的人眼注视深度相匹配。Eye tracking process: the infrared light source L generates an infrared beam b, which is transmitted to the thermal mirror M1 through the mirror unit M2, reflected to the first optical unit 2 by the thermal mirror M1, and reflected by the first optical unit 2 into the first optical unit 2. The second optical unit 3 is reflected back to the first optical unit 2 through the second optical unit 3 , and finally transmitted through the first optical unit 2 into the user's eye 4 . The infrared light beam b entering the user's eye 4 is reflected back to the first optical unit 2 by the user's eye 4, transmitted through the first optical unit 2 and enters the second optical unit 3, and is reflected by the second optical unit 3 in turn to reach the first optical unit The unit 2 is then reflected to the thermal mirror M1 by the first optical unit 2, and reflected to the mirror unit M2 by the thermal mirror M1, and finally reflected to the image receiving unit C by the mirror unit M2 (in this embodiment, infrared image sensor), the image receiving unit C identifies the gaze point and gaze depth information of the human eye, and feeds back the gaze point and gaze depth information to the processing chip of the
请参阅图1与图3,为本发明的另一实施例,本实施例中,所述图像产生单元1包括图像源DS和第二透镜单元6,所述第二透镜单元6用于透射所述图像源DS产生的光束并调整所述投影显示装置的有效焦距。具体地,所述第二透镜单元6为可调焦准直透镜,由至少一片透镜组成,所述图像源DS包括一处理芯片,所述处理芯片与所述可调焦准直透镜信号连接进而控制所述可调焦准直透镜进行焦距的调节,所述可调焦准直透镜具体采用能够实现上述调焦功能的现有技术即可,例如移动透镜组中镜片的位置或使用可通过电致变形驱动、压电驱动等方式能够改变自身形状实现变焦的一种透镜。本实施例中,所述图像源与所述第二透镜单元6共轴。本实施例中,所述第一光学单元2的中心轴与所述图像产生单元1的中心轴成45°夹角,所述第二光学单元3的中心轴与所述图像产生单元1的中心轴成90°夹角,所述图像产生单元1的中心轴与所述第二光学单元3的中心轴垂直相交于所述第一光学单元2,所述热反射镜M1的中心轴与所述图像产生单元1的中心轴成45°夹角,所述透反镜单元M2的中心轴与所述红外光源L 发射光束的中心轴成45°夹角。Please refer to FIG. 1 and FIG. 3, which are another embodiment of the present invention. In this embodiment, the
本实施例提供的头戴显示光学系统的工作原理如下:The working principle of the head-mounted display optical system provided in this embodiment is as follows:
图像投影过程:图像源DS产生和发射携带图像信息的光束a,经过第二透镜单元6准直后到达热反射镜M1,经热反射镜M1透射后到达第一光学单元2。第一光学单元2将光束a反射至第二光学单元3,经第二光学单元3反射的光束a回到第一光学单元2,且经第一光学单元2透射后进入用户的视野,即用户眼睛4。Image projection process: the image source DS generates and emits a light beam a carrying image information, which is collimated by the second lens unit 6 and then reaches the thermal mirror M1 , and is transmitted through the thermal mirror M1 to reach the first optical unit 2 . The first optical unit 2 reflects the light beam a to the second optical unit 3, and the light beam a reflected by the second optical unit 3 returns to the first optical unit 2, and enters the user's field of vision after being transmitted by the first optical unit 2, that is, the user eyes 4.
眼动追踪过程:红外光源L产生红外光束b,经由透反镜单元M2透射至热反射镜M1,并经热反射镜M1反射到第一光学单元2,以及经第一光学单元2反射进入第二光学单元3,再经第二光学单元3反射回第一光学单元2,最后经第一光学单元2透射进入用户眼睛4。进入用户眼睛4的红外光束b由用户眼睛4反射回所述第一光学单元2,经第一光学单元2透射进入第二光学单元3,并依次经第二光学单元3及第一光学单元2反射至热反射镜M1,以及经热反射镜M1反射至透反镜单元M2,最后经透反镜单元 M2反射至图像接收单元C(本实施例采用红外图像传感器),图像接收单元C识别人眼的注视点及注视深度信息,并将所述注视点及注视深度信息反馈给图像产生单元1的处理芯片,处理芯片根据接收到的信息调制可调焦准直透镜的焦距,从而调节投影显示装置的虚拟成像距离,并使虚拟成像距离与眼动追踪装置检测的人眼注视深度相匹配。Eye tracking process: the infrared light source L generates an infrared beam b, which is transmitted to the thermal mirror M1 through the mirror unit M2, reflected to the first optical unit 2 by the thermal mirror M1, and reflected by the first optical unit 2 into the first optical unit 2. The second optical unit 3 is reflected back to the first optical unit 2 through the second optical unit 3 , and finally transmitted through the first optical unit 2 into the user's eye 4 . The infrared light beam b entering the user's eye 4 is reflected back to the first optical unit 2 by the user's eye 4 , transmitted through the first optical unit 2 into the second optical unit 3 , and passed through the second optical unit 3 and the first optical unit 2 in turn Reflected to the thermal mirror M1, and reflected to the mirror unit M2 through the thermal mirror M1, and finally reflected to the image receiving unit C (the infrared image sensor is used in this embodiment) through the mirror unit M2, and the image receiving unit C recognizes the person. The gaze point and gaze depth information of the eyes are fed back to the processing chip of the
本发明还提供一种头戴显示设备,包括如上所述的头戴显示光学系统。The present invention also provides a head-mounted display device including the above-mentioned head-mounted display optical system.
综上所述,本发明的有益效果在于:通过理解人眼的注视点、注视深度等信息,调节虚拟成像距离,使虚拟成像距离与人眼注视深度相匹配,以实现更好的沉浸体验和人机交互体验。眼动追踪光学系统与投影显示光学融合,减小显示模组体积,利于增强现实显示设备小型化和轻薄化。To sum up, the beneficial effects of the present invention are: by understanding the gaze point, gaze depth and other information of the human eye, the virtual imaging distance is adjusted so that the virtual imaging distance matches the gaze depth of the human eye, so as to achieve a better immersive experience and Human-computer interaction experience. The eye tracking optical system is optically integrated with the projection display to reduce the volume of the display module, which is conducive to the miniaturization and thinning of the augmented reality display device.
以上仅为本发明的较佳实施例而已,并不用于限制本发明,凡在本发明的精神和原则之内所作的任何修改、等同替换和改进等,均应包含在本发明的保护范围之内。The above are only preferred embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent replacements and improvements made within the spirit and principles of the present invention shall be included in the protection scope of the present invention. Inside.
Claims (10)
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911013961.5A CN110727111A (en) | 2019-10-23 | 2019-10-23 | Head-mounted display optical system and head-mounted display equipment |
| PCT/CN2020/117507 WO2021077980A1 (en) | 2019-10-23 | 2020-09-24 | Head-mounted display optical system and head-mounted display device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911013961.5A CN110727111A (en) | 2019-10-23 | 2019-10-23 | Head-mounted display optical system and head-mounted display equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110727111A true CN110727111A (en) | 2020-01-24 |
Family
ID=69221880
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911013961.5A Pending CN110727111A (en) | 2019-10-23 | 2019-10-23 | Head-mounted display optical system and head-mounted display equipment |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN110727111A (en) |
| WO (1) | WO2021077980A1 (en) |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111338081A (en) * | 2020-03-12 | 2020-06-26 | 京东方科技集团股份有限公司 | AR optical system and AR display device |
| CN111830714A (en) * | 2020-07-24 | 2020-10-27 | 闪耀现实(无锡)科技有限公司 | Image display control method, image display control device, and head-mounted display device |
| CN111929893A (en) * | 2020-07-24 | 2020-11-13 | 闪耀现实(无锡)科技有限公司 | Augmented reality display device and equipment thereof |
| WO2021077980A1 (en) * | 2019-10-23 | 2021-04-29 | 深圳惠牛科技有限公司 | Head-mounted display optical system and head-mounted display device |
| CN112866672A (en) * | 2020-12-30 | 2021-05-28 | 深圳卡乐星球数字娱乐有限公司 | Augmented reality system and method for immersive cultural entertainment |
| CN112946895A (en) * | 2021-02-02 | 2021-06-11 | 业成科技(成都)有限公司 | Head-mounted display device |
| CN113296347A (en) * | 2021-04-12 | 2021-08-24 | 北京计算科学研究中心 | Naked eye display device |
| CN113325947A (en) * | 2020-02-28 | 2021-08-31 | 北京七鑫易维信息技术有限公司 | Display method, display device, terminal equipment and storage medium |
| CN113433628A (en) * | 2021-06-23 | 2021-09-24 | 河南鑫宇光科技股份有限公司 | Low-crosstalk single-wavelength optical device |
| CN113589532A (en) * | 2021-07-30 | 2021-11-02 | 歌尔光学科技有限公司 | Display calibration method and device of head-mounted equipment, head-mounted equipment and storage medium |
| WO2022247482A1 (en) * | 2021-05-27 | 2022-12-01 | 华为技术有限公司 | Virtual display device and virtual display method |
| CN115670368A (en) * | 2021-07-23 | 2023-02-03 | 京东方科技集团股份有限公司 | Imaging adjusting device and method, wearable device and storage medium |
| WO2023116541A1 (en) * | 2021-12-22 | 2023-06-29 | 华为技术有限公司 | Eye tracking apparatus, display device, and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6433760B1 (en) * | 1999-01-14 | 2002-08-13 | University Of Central Florida | Head mounted display with eyetracking capability |
| CN103792661A (en) * | 2013-12-20 | 2014-05-14 | 香港应用科技研究院有限公司 | Integrated dual-sensing optical architecture for head-mounted displays |
| CN204595327U (en) * | 2014-12-26 | 2015-08-26 | 成都理想境界科技有限公司 | Head-mounted display apparatus |
| CN106199958A (en) * | 2015-05-07 | 2016-12-07 | 尚立光电股份有限公司 | Automatic focusing head-mounted display device |
| CN210573016U (en) * | 2019-10-23 | 2020-05-19 | 深圳惠牛科技有限公司 | Head-mounted display optical system and head-mounted display equipment |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101587542A (en) * | 2009-06-26 | 2009-11-25 | 上海大学 | Field depth blending strengthening display method and system based on eye movement tracking |
| US9304319B2 (en) * | 2010-11-18 | 2016-04-05 | Microsoft Technology Licensing, Llc | Automatic focus improvement for augmented reality displays |
| JP2015087581A (en) * | 2013-10-31 | 2015-05-07 | 株式会社東芝 | Display device |
| US11263794B2 (en) * | 2015-01-21 | 2022-03-01 | Chengdu Idealsee Technology Co., Ltd. | Binocular see-through AR head-mounted display device and information displaying method thereof |
| CN109766820A (en) * | 2019-01-04 | 2019-05-17 | 北京七鑫易维信息技术有限公司 | A kind of eyeball tracking device, headset equipment and eyes image acquisition methods |
| CN110727111A (en) * | 2019-10-23 | 2020-01-24 | 深圳惠牛科技有限公司 | Head-mounted display optical system and head-mounted display equipment |
-
2019
- 2019-10-23 CN CN201911013961.5A patent/CN110727111A/en active Pending
-
2020
- 2020-09-24 WO PCT/CN2020/117507 patent/WO2021077980A1/en not_active Ceased
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6433760B1 (en) * | 1999-01-14 | 2002-08-13 | University Of Central Florida | Head mounted display with eyetracking capability |
| CN103792661A (en) * | 2013-12-20 | 2014-05-14 | 香港应用科技研究院有限公司 | Integrated dual-sensing optical architecture for head-mounted displays |
| CN204595327U (en) * | 2014-12-26 | 2015-08-26 | 成都理想境界科技有限公司 | Head-mounted display apparatus |
| CN106199958A (en) * | 2015-05-07 | 2016-12-07 | 尚立光电股份有限公司 | Automatic focusing head-mounted display device |
| CN210573016U (en) * | 2019-10-23 | 2020-05-19 | 深圳惠牛科技有限公司 | Head-mounted display optical system and head-mounted display equipment |
Cited By (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2021077980A1 (en) * | 2019-10-23 | 2021-04-29 | 深圳惠牛科技有限公司 | Head-mounted display optical system and head-mounted display device |
| CN113325947A (en) * | 2020-02-28 | 2021-08-31 | 北京七鑫易维信息技术有限公司 | Display method, display device, terminal equipment and storage medium |
| US12099187B2 (en) | 2020-03-12 | 2024-09-24 | Beijing Boe Optoelectronics Technology Co., Ltd. | AR optical system and AR display device |
| CN111338081A (en) * | 2020-03-12 | 2020-06-26 | 京东方科技集团股份有限公司 | AR optical system and AR display device |
| WO2021179786A1 (en) * | 2020-03-12 | 2021-09-16 | 京东方科技集团股份有限公司 | Ar optical system and ar display device |
| US12393035B2 (en) | 2020-07-24 | 2025-08-19 | Matrixed Reality Technology Co., Ltd. | Augmented reality display apparatus |
| CN111830714A (en) * | 2020-07-24 | 2020-10-27 | 闪耀现实(无锡)科技有限公司 | Image display control method, image display control device, and head-mounted display device |
| US12078808B2 (en) | 2020-07-24 | 2024-09-03 | Matrixed Reality Technology Co., Ltd. | Augmented reality display apparatus and augmented reality display device comprising same |
| CN111830714B (en) * | 2020-07-24 | 2024-03-29 | 闪耀现实(无锡)科技有限公司 | Image display control method, image display control device and head-mounted display device |
| US11889050B2 (en) | 2020-07-24 | 2024-01-30 | Matrixed Reality Technology Co., Ltd. | Image display control method, image display control apparatus, and head-mounted display device |
| CN111929893A (en) * | 2020-07-24 | 2020-11-13 | 闪耀现实(无锡)科技有限公司 | Augmented reality display device and equipment thereof |
| WO2022017447A1 (en) * | 2020-07-24 | 2022-01-27 | 闪耀现实(无锡)科技有限公司 | Image display control method, image display control apparatus, and head-mounted display device |
| CN115390256A (en) * | 2020-07-24 | 2022-11-25 | 闪耀现实(无锡)科技有限公司 | Augmented reality display device and equipment thereof |
| EP4160298A4 (en) * | 2020-07-24 | 2023-11-29 | Matrixed Reality Technology Co., Ltd. | AUGMENTED REALITY DISPLAY DEVICE AND AUGMENTED REALITY DISPLAY DEVICE THEREFOR |
| EP4160299A4 (en) * | 2020-07-24 | 2023-11-22 | Matrixed Reality Technology Co., Ltd. | IMAGE DISPLAY CONTROL METHOD, IMAGE DISPLAY CONTROL DEVICE AND HEAD-MOUNTED DISPLAY DEVICE |
| CN112866672A (en) * | 2020-12-30 | 2021-05-28 | 深圳卡乐星球数字娱乐有限公司 | Augmented reality system and method for immersive cultural entertainment |
| CN112946895A (en) * | 2021-02-02 | 2021-06-11 | 业成科技(成都)有限公司 | Head-mounted display device |
| CN113296347A (en) * | 2021-04-12 | 2021-08-24 | 北京计算科学研究中心 | Naked eye display device |
| WO2022247482A1 (en) * | 2021-05-27 | 2022-12-01 | 华为技术有限公司 | Virtual display device and virtual display method |
| CN113433628A (en) * | 2021-06-23 | 2021-09-24 | 河南鑫宇光科技股份有限公司 | Low-crosstalk single-wavelength optical device |
| CN115670368A (en) * | 2021-07-23 | 2023-02-03 | 京东方科技集团股份有限公司 | Imaging adjusting device and method, wearable device and storage medium |
| CN113589532A (en) * | 2021-07-30 | 2021-11-02 | 歌尔光学科技有限公司 | Display calibration method and device of head-mounted equipment, head-mounted equipment and storage medium |
| WO2023116541A1 (en) * | 2021-12-22 | 2023-06-29 | 华为技术有限公司 | Eye tracking apparatus, display device, and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2021077980A1 (en) | 2021-04-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110727111A (en) | Head-mounted display optical system and head-mounted display equipment | |
| CN111433660B (en) | Compact polychromatic beam combiner using geometric phase lenses | |
| US8810600B2 (en) | Wearable display device calibration | |
| CN104956252B (en) | Peripheral display for near-eye display device | |
| CN112136084A (en) | Optical assembly with polarizer holographic element | |
| CN113454504B (en) | Holographic pattern generation for Head Mounted Display (HMD) eye tracking using diffractive optical elements | |
| CN101336089A (en) | eye tracker device | |
| TWI775240B (en) | Intelligent virtual display device | |
| CN210573016U (en) | Head-mounted display optical system and head-mounted display equipment | |
| US20170308160A1 (en) | Off-Axis Eye Tracker | |
| CN107003520A (en) | See-Through Display Optical Structure | |
| US11644673B2 (en) | Near-eye optical system | |
| US12001030B1 (en) | Shadow-matched Fresnel lens doublet for reduced optical artifacts | |
| US20230360567A1 (en) | Virtual reality display system | |
| CN113168013A (en) | Optical system for augmented reality head-mounted device and design and manufacturing method | |
| TW202334702A (en) | Display systems with collection optics for disparity sensing detectors | |
| WO2023158654A1 (en) | Hybrid waveguide to maximize coverage in field of view (fov) | |
| CN118591753A (en) | Display system having a grating oriented to reduce the appearance of ghost images | |
| US11366298B1 (en) | Eye tracking based on telecentric polarization sensitive grating | |
| CN105212890B (en) | Eye tracker equipment | |
| TWI738407B (en) | Head mounted display device | |
| US10634916B2 (en) | Wearable display device | |
| CN220627014U (en) | Computing system with head-mounted display | |
| US20240036318A1 (en) | System to superimpose information over a users field of view | |
| WO2020036681A1 (en) | Backside reinforcement structure design for mirror flatness |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200124 |
|
| RJ01 | Rejection of invention patent application after publication |
