CN204595329U - Head-mounted display apparatus - Google Patents

Abstract

The utility model provides a kind of head-mounted display apparatus, comprises housing and is installed on one group of optical system in housing; Wherein, optical system comprises image display panel, optical amplifier lens combination and can instead can lens, and image display panel is positioned at above optical amplifier lens combination, can instead can be positioned at below optical amplifier lens combination by lens; The light path of optical system is: the image light information that image display panel sends after the transmission of optical amplifier lens combination by can instead can reflection from lens to human eye; And the surround lighting information of head-mounted display apparatus outside is by instead can being transmitted through human eye by lens.The utility model provide a kind of structure simple, wear comfortable head-mounted display apparatus, enable user enjoy the visual experience with augmented reality effect easily.

Description

Head Mounted Display

technical field

The utility model relates to the technical field of optics and image display, in particular to a head-mounted display device.

Background technique

Augmented Reality (AR for short) is a technology that uses virtual objects or information to enhance the reality of real scenes. Augmented reality technology is usually based on the real physical environment images obtained by image acquisition equipment such as cameras, through computer system recognition analysis and query retrieval, the virtual generated extended information or virtual scene display of associated text content, image content or image models, etc. In the real physical environment image, so that users can obtain related extended information such as annotations and descriptions of real objects in the real physical environment or experience the three-dimensional and highlighted enhanced visual effects of real objects in the real physical environment . Augmented reality technology can effectively provide users with extended information or image display effects to recognize the surrounding real environment by fully integrating virtual objects and real environments, and at the same time realize information interaction between users and the surrounding real environment.

Existing augmented reality systems can be divided into two types: video see-through and optical see-through according to the way of display. With the optical see-through augmented reality system, the light from the real environment can reach the user's eyes through the optical lens group, so the user can directly Observing the surrounding real environment can effectively improve the time delay phenomenon that exists after superimposing and fusing the real environment image and virtual environment information in the video see-through augmented reality system. At the same time, due to the complex optical system structure of the optical see-through augmented reality system, there are problems such as fixed system structure and large volume, which have become technical problems to be solved urgently in the process of optical see-through augmented reality device technology development and popularization.

Utility model content

Based on at least one of the above technical problems, the purpose of this utility model is to provide a head-mounted display device with a simple structure and easy to carry, so as to provide users with an augmented reality experience.

In view of this, in order to achieve the above purpose, the utility model provides a head-mounted display device, which includes a casing and a group of optical systems installed in the casing; the optical system includes an image display screen, an optical magnifying lens group and Reversible lens, the image display screen is located above the optical magnification lens group, the reversible lens is located below the optical magnification lens group; the optical path of the optical system is: the image sent by the image display screen The light information transmitted by the optical magnifying lens group is reflected to the human eye by the reflective lens; and the ambient light information outside the head-mounted display device is transmitted to the human eye through the reflective lens.

Preferably, the head-mounted display device further includes an image acquisition module for acquiring external images of the head-mounted display device, and the image acquisition module includes one or more cameras.

Preferably, the image acquisition module includes a depth-of-field camera for acquiring an external depth image of the head-mounted display device.

Preferably, the head-mounted display device further includes a line-of-sight tracking module for determining eye-sight information of the human eye by detecting eye movement state of the human eye, and the line-of-sight tracking module includes a camera for collecting images of the human eye.

Preferably, the head-mounted display device further includes a pixel shielding layer, the pixel shielding layer is located on the side of the reflective lens away from the human eye, and is used to adjust the pixel position according to the projection position of the image content displayed on the image display screen in the reflective lens. The light transmittance of the corresponding area of the masking layer.

Preferably, the head-mounted display device further includes an interaction control module, and the interaction control module includes one or a combination of the following: a gesture interaction unit, configured to connect with the image acquisition module, and identify and determine the gesture interaction command according to the gesture image acquired by the image acquisition module The eye movement interaction unit is used to connect with the eye movement tracking module, and to identify and determine the eye movement interaction command according to the eye movement state of the human eye obtained by the eye movement tracking module; The acquired body movement information is used to identify and determine the somatosensory interaction command; the voice interaction unit is used to collect voice information through a microphone, and to identify and determine the voice interaction command according to the acquired voice information.

Preferably, the head-mounted display device further includes a power supply module, which is connected to the image display screen, the image acquisition module, the gaze tracking module and the interactive control module through a circuit, and supplies power to the head-mounted display device through a built-in or external power supply.

Preferably, the optical magnification lens group consists of one or more Fresnel lenses, or consists of one or more spherical lenses and/or aspheric lenses, or consists of one or more Fresnel lenses and spherical lenses and/or composed of aspheric lenses.

Preferably, the image display screen displays image content in split screens.

Preferably, the head-mounted display device further includes a head-mounted stretchable strap or a support frame connected to the casing.

With the head-mounted display device of the utility model, the user's eyes are located behind the reversible lens in the optical system, that is, at the exit of the optical system. The reversible lens receives ambient light information outside the head-mounted display device, and after the two sets of light information are transmitted through the optical path of the optical system, images are superimposed on the retinas of both eyes of the user. At the same time, by identifying and analyzing the environment and object images in front of the head-mounted display device acquired by the image acquisition module, the relevant content can be displayed on the image display screen and superimposed and fused into the real environment image, so that the user can use the head-mounted display device of the utility model. When the real environment and objects are observed by the type display device, extended information related to the real environment and objects and images of other virtual objects can be fused and displayed within the user's field of vision, presenting an image with an augmented reality effect.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description These are only some embodiments of the present utility model. For those of ordinary skill in the art, other drawings can also be obtained according to these drawings on the premise of not paying creative work:

Fig. 1 shows the first schematic diagram of the structure of the head-mounted display device according to the embodiment of the present invention;

FIG. 2 shows a second schematic diagram of the structure of the head-mounted display device according to the embodiment of the present invention;

FIG. 3 shows a third schematic diagram of the structure of the head-mounted display device according to the embodiment of the present invention;

Fig. 4 shows the first schematic diagram of the optical system structure of the head-mounted display device according to the embodiment of the present invention;

FIG. 5 shows a second schematic diagram of the optical system structure of the head-mounted display device according to the embodiment of the present invention;

FIG. 6 shows a third schematic diagram of the optical system structure of the head-mounted display device according to the embodiment of the present invention;

FIG. 7 shows a fourth schematic diagram of the optical system structure of the head-mounted display device according to the embodiment of the present invention.

Detailed ways

In order to understand the purpose, features and advantages of the utility model more clearly, the utility model will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be noted that, in the case of no conflict, the embodiments of the present application and the features in the embodiments can be combined with each other.

In the following description, a lot of specific details have been set forth in order to fully understand the utility model, but these are only some embodiments of the utility model, and the utility model can also be implemented in other ways different from those described here, so However, the protection scope of the present utility model is not limited by the specific embodiments disclosed below.

FIG. 1 shows a first schematic diagram of the structure of a head-mounted display device according to an embodiment of the present invention.

The head-mounted display device of the embodiment of the utility model includes a housing 1 and a group of optical systems installed in the housing 1; Can lens 4, image display screen 2 is positioned at the top of optical magnification lens group 3, and reversible lens 4 is positioned at the bottom of optical magnification lens group 3; After being transmitted, it is reflected by the reflective lens 4 to the human eye 21 ; and, the ambient light information outside the head-mounted display device is transmitted to the human eye 21 through the reflective lens 4 .

In this embodiment, the reversible lens 4 is located below the optical magnifying lens group 3, forming an angle of 30-60 degrees with the image display screen 2, and the image light information sent by the image display screen 2 is transmitted through the optical magnifying lens group 3 , reflected by the reversible lens 4 to the human eye 21, forming a magnified virtual image on the retina of the human eye.

In this embodiment, the head-mounted display device also includes an image acquisition module for acquiring external images of the head-mounted display device. As shown in FIG. 1 , the image acquisition module includes one or more cameras, wherein RGB cameras 51 and RGB camera 52 to collect external environmental images of the head-mounted display device, analyze the environmental images to obtain ambient light information, and object position and distance information, or cooperate with the RGB camera 51 and depth-of-field camera 52 to perform external environmental images of the head-mounted display device The collection of objects, distance measurement of environmental objects, acquisition of three-dimensional images of objects, and capture of user gestures, etc.

In this embodiment, the head-mounted display device can obtain the information content related to the environment or the object through image recognition and analysis according to the environment image acquired by the image acquisition module, including the environment light information, the position of the object and the depth of field information, etc. Send the information content to the image display screen for display, for example, identify the buildings contained in the environmental image, obtain the introduction content related to the buildings in the environmental image, and send it to the image display screen for display; it can also be displayed according to the environmental image information and the depth of field information of the object, further obtain the image or text content that can be fused with the environmental image, and send it to the image display screen for display. The image of the ship is sent to the image display screen for display; the display interface and/or user interaction interface of the functional application can also be superimposed and displayed on the environment image according to the color information, brightness information, etc. of the environment image, for example, the call interface, mail interface , SMS interface, schedule reminder interface, etc. are displayed through the image display screen.

The head-mounted display device of the embodiment of the utility model forms two optical paths through the optical system, and the external environment image and the image displayed on the image display screen can be transmitted to the user's eyes through the two optical paths, and superimposed and fused on the retina of the user's eyes , so that the user of the head-mounted display device can obtain the content related to the real environment image displayed on the image display screen or other content that can be integrated with the external environment image while viewing the real environment outside with a normal field of vision, and the superimposed display has enhanced Realistic display effect.

The head-mounted display device according to the embodiment of the present invention further includes a line-of-sight tracking module for determining the line-of-sight information of the human eye by detecting the movement state of the human eye. The line-of-sight tracking module includes a camera for collecting images of the human eye.

In this embodiment, as shown in FIG. 2 , the gaze tracking module in the head-mounted display device can collect images of the areas near the eyeballs of the left and right eyes through the camera 61 and the camera 62 respectively. When the user's eyes gaze at different directions or different When the object is far away, the eye will produce subtle changes, and these changes will produce eye features that can be extracted. Through image recognition (such as pupil positioning, eye corner point detection, etc.) to extract eye image features for human eye positioning tracking and eyeball Based on the analysis of the motion state of the user, the direction of the user's line of sight is estimated based on the line of sight model, and the position of the target object that the user is looking at is calculated according to the angle between the lines of sight of the two eyes. It is also possible to continuously acquire infrared rays reflected from the cornea and pupils of the human eye through the camera 61 and the camera 62 to record changes in the line of sight. Specifically, the human face is irradiated by an auxiliary infrared light source to form a reflective bright spot on the surface of the cornea of the human eye, and the human eye is watching. The eyeball rotates correspondingly at different positions, and the sight tracking module determines the change of the human eye's line of sight and the position of gaze according to the change of the relative position of the reflective bright spot on the human eye cornea and the center of the human pupil, and realizes the purpose of sight tracking.

The head-mounted display device of the embodiment of the utility model can accurately determine the object in the real environment that the user is looking at according to the external image and object depth information obtained by the image acquisition module, combined with the human eye sight information obtained by the sight tracking module. Through image recognition and information acquisition, the image display screen is controlled to display the content related to the object currently watched by the user at the corresponding position. After being transmitted through the two optical paths of the optical system of the head-mounted display device, the content displayed on the image display screen The fusion is displayed in the user's real field of view, so that when the user looks at the real environment object, he can view the content related to the real environment object in the field of view (such as the vicinity of the real object) at the same time, which has the display effect of augmented reality.

In any of the above-mentioned embodiments, as shown in FIG. 5 , the head-mounted display device of the present invention further includes a pixel shielding layer 7, and the pixel shielding layer 7 is located on the side of the reversible lens 4 away from the human eye, and is used for displaying according to the image. The projection position of the image content displayed on the screen in the reversible lens 4 adjusts the light transmittance of the corresponding area of the pixel shielding layer 7 . Specifically, the pixel shielding layer 7 can be a light-adjustable liquid crystal screen or a light-adjustable liquid crystal film. By changing the arrangement and distribution order of liquid crystal droplets under the action of an external electric field, light transmittance adjustment at the pixel level can be realized.

In the head-mounted display device of the utility model, the pixel shielding layer is located on the side of the reversible lens away from human eyes, and the external environment light information reaches the reflective lens after passing through the pixel shielding layer. The head-mounted display device adjusts the light transmittance of the area corresponding to the position in the pixel shielding layer according to the projection position of the image content displayed on the image display screen in the reflective lens after being transmitted by the optical magnifying lens group. When the external ambient light is strong, the transmittance of the corresponding area in the pixel shielding layer decreases, reducing the light transmittance of the position area; when the external ambient light is weak, the light transmittance of the corresponding area in the pixel shielding layer increases, increasing the The amount of light transmitted, so as to adjust the light intensity of the corresponding area in the pixel shielding layer in the projection position of the reversible lens. When the content displayed on the image display screen is fused with the user's real visual image, the light intensity caused by the external environment is reduced. The impact of external ambient light caused by too strong or too weak on the visibility and display effect of the displayed content in the image display. Furthermore, the light transmittance of the entire region of the pixel shielding layer can be adjusted according to environmental conditions or usage requirements. For example, the pixel shielding layer can be adjusted to an opaque state as a whole, completely blocking the external ambient light from reaching through the reflective lens. The human eye, so that the human eye only receives the image light information from the image display screen.

In any of the above examples, the head-mounted display device of the present invention also includes an interactive control module, and the interactive control module includes one or a combination of the following: a gesture interaction unit, connected to the image acquisition module, which acquires gesture images through the image acquisition module, and According to the gesture image acquired by the image acquisition module, identify and determine the gesture interaction command; the eye movement interaction unit is connected with the line of sight tracking module, and obtains the eye movement state image of the human eye through the line of sight tracking module, and according to the eye movement state image obtained by the line of sight tracking module, Recognize and determine the eye movement interaction command; the somatosensory interaction unit collects the body movement information of the human body through the sensor, and recognizes and determines the somatosensory interaction instruction according to the acquired body movement information; the voice interaction unit collects voice information through the microphone, and recognizes the Determine the voice interaction command.

The head-mounted display device of the utility model acquires the user's interactive control instructions through the interactive control unit, including gesture interaction instructions, eye movement interaction instructions, somatosensory interaction instructions and/or voice interaction instructions. The wearable display device is controlled and operated, for example, adjusting the brightness of the image display screen, controlling the switching and adjustment of the display content of the image display screen, and performing interactive operations according to the user interaction interface displayed on the image display screen.

In any of the above-mentioned embodiments, the head-mounted display device of the present invention also includes a power supply module, which is connected to the image display screen, image acquisition module, line-of-sight tracking module and interactive control module through a circuit, and the head-mounted display device is powered by a built-in or external power supply. The display unit is powered.

In any of the above-mentioned embodiments, the optical magnifying lens group of the head-mounted display device of the present invention can be a single Fresnel lens or a combination of multiple Fresnel lenses, or it can be a spherical lens, an aspheric lens or a multiple A combination of spherical and/or aspheric lenses, or a combination of Fresnel lenses and spherical lenses and/or aspheric lenses.

In any of the above-mentioned embodiments, the image display screen of the head-mounted display device of the present invention displays the image in left and right split screens. eye to receive. Wherein, the split-screen display in the image display screen may be a left-right split-screen image with the same format, or a left-right split-screen image with a preset parallax. Specifically, when the image displayed on the split screen in the image display screen is a left-right split-screen image with the same format, what the user sees is a flat image; When viewing images on the screen, what the user sees is a stereoscopic image with a 3D effect.

The image display screen of the head-mounted display device of the present utility model can also be two independent image display screens corresponding to the user's eyes, and the image content is displayed on the two image display screens respectively, and the images displayed in the two image display screens After the content is transmitted through the light path of the optical system, it is received by the left and right eyes of the user respectively. Wherein, the images displayed on the two image display screens may be images with the same format, or images with preset parallax. Specifically, when the images with the same format are displayed on the two image display screens, the user sees a flat image; when the images with preset parallax are displayed on the two image display screens, the user sees What is a stereoscopic image with a 3D effect.

In any of the above-mentioned embodiments, as shown in Figure 3, the reversible lens of the head-mounted display device of the present invention may be composed of two independent reversible lenses respectively corresponding to the left and right eyes, or may be a single reversible lens. The retro-lens is shared by both eyes.

In another embodiment, as shown in Figure 6, the reversible lens is replaced by two cemented right-angle prisms 41 and 42, the slope of the right-angle prism 41 or the right-angle prism 42 is coated with a reflective and transparent film, coated with The oblique surface of the rectangular prism of the reversible and transparent film forms an included angle of 30-60 degrees with the image display screen.

In another preferred embodiment, as shown in FIG. 7, the head-mounted display device is equipped with a light-transmitting sheet 81 and a light-transmitting sheet 82 on the side close to the human eye and the side away from the human eye, respectively, and the light-transmitting sheet 81 and the light-transmitting sheet 82 may be an optical quartz plate, and the surface of the light-transmitting plate is flat or curved, which has good light transmission and can form a relatively closed space to protect the optical elements in the optical system.

In another preferred embodiment, the near-eye side of the head-mounted display device is also equipped with a diopter adjustment structure, the diopter adjustment structure can adjust the diopter of the optical system within a certain range, and the user of the head-mounted display device can normal use of the head-mounted display device under the circumstances.

The head-mounted display device in each embodiment of the utility model, according to the needs of superimposition and fusion display of the display content of the image display screen and the user's real field of vision, the reversible lens can have different reflective transmittances, specifically, the reversible lens The surface can be coated with reflective and transmissive films with different reflective and transmissive ratios, and the ratio of light transmission and reflection can be adjusted through different reflective and transmissive films. For example, the reflective and transmissive lens can be a half-reflective and half-lens.

The head-mounted display device in each embodiment of the utility model can be connected and fixed on the user's head by means of a head-wearing telescopic belt, a support frame, a helmet bracket, a hat, etc. The head-mounted stretchable belt 9 of the utility model embodiment head-mounted display device.

The head-mounted display device of each embodiment of the utility model, according to the needs of installing and fixing various optical system components, a variety of supporting and fixing structures can be designed inside the housing according to specific conditions, which are used to install and fix the optical components to form a corresponding optical system. The system is not limited here, and the shape of the housing can also be designed and adjusted according to needs, as long as it meets the requirements for accommodating and fixing the optical components of the head-mounted display device according to the embodiment of the present utility model.

It is stated again that all features disclosed in this specification, or steps in all methods or processes disclosed, can be combined in any way except for mutually exclusive features and/or steps.

Any feature disclosed in this specification (including any appended claims, abstract and drawings), unless expressly stated otherwise, may be replaced by alternative features which are equivalent or serve a similar purpose. That is, unless expressly stated otherwise, each feature is one example only of a series of equivalent or similar features.

The utility model is not limited to the aforementioned specific embodiments. The utility model can be extended to any new feature or any new combination disclosed in this specification, as well as the steps of any new method or process or any new combination disclosed.

Claims (10)

1. A head-mounted display device, characterized in that the head-mounted display device comprises: a casing and a group of optical systems installed in the casing; wherein, The optical system includes an image display screen, an optical magnification lens group and a reversible lens, the image display screen is located above the optical magnification lens group, and the reversible lens is located below the optical magnification lens group; The optical path of the optical system is: the image light information emitted by the image display screen is transmitted by the optical magnifying lens group and then reflected to the human eye by the reflective lens; and the environment outside the head-mounted display device Light information is transmitted to human eyes through the reflective lens. 2 . The head-mounted display device according to claim 1 , further comprising an image acquisition module for acquiring external images of the head-mounted display device, and the image acquisition module includes one or more cameras. 3. The head-mounted display device according to claim 2, wherein the image acquisition module comprises a depth-of-field camera for acquiring an external depth image of the head-mounted display device. 4. The head-mounted display device according to claim 3, further comprising a line-of-sight tracking module for determining the line-of-sight information of the human eye by detecting the eye movement state of the human eye, and the line-of-sight tracking module includes collecting human eye images camera. 5. The head-mounted display device according to any one of claims 1 to 4, further comprising a pixel shielding layer, the pixel shielding layer is located on the side of the reversible lens away from the human eye, for According to the projection position of the image content displayed on the image display screen in the reversible lens, the light transmittance of the corresponding area of the pixel shielding layer is adjusted. 6. The head-mounted display device according to claim 5, further comprising an interactive control module, the interactive control module comprising one or a combination of the following: A gesture interaction unit, configured to be connected to the image acquisition module, and identify and determine a gesture interaction instruction according to the gesture image acquired by the image acquisition module; An eye movement interaction unit, configured to connect with the gaze tracking module, and identify and determine an eye movement interaction instruction according to the eye movement state of the human eye acquired by the gaze tracking module; The somatosensory interaction unit is used to collect body movement information through sensors, and identify and determine somatosensory interaction instructions according to the acquired body movement information; The voice interaction unit is configured to collect voice information through a microphone, and recognize and determine a voice interaction instruction according to the acquired voice information. 7. The head-mounted display device according to claim 6, further comprising a power supply module, the power supply module is connected with the image display screen, the image acquisition module, the gaze tracking module and the interactive control module through a circuit, The head-mounted display device is powered by a built-in or external power supply. 8. The head-mounted display device according to claim 5, wherein the optical magnification lens group is composed of one or more Fresnel lenses, or is composed of one or more spherical lenses and/or aspheric lenses Composed of, or composed of one or more Fresnel lenses and spherical lenses and/or aspheric lenses. 9. The head-mounted display device according to claim 5, wherein the image display screen displays the image content in split screens. 10 . The head-mounted display device according to claim 5 , further comprising a head-mounted stretchable strap or a support frame connected to the housing. 11 .