CN106405832A - Head-mounted display device capable of eliminating color difference - Google Patents

Abstract

The invention provides a head-mounted display device capable of eliminating color difference. The head-mounted display device includes a display screen, an optical assembly, an adjusting device, and a color separating device, the display screen is arranged on the head-mounted display device and used for displaying at least one frame of image; the optical assembly is used for transmitting the at least one frame of image presented on the display screen to a user's eyes; the adjusting device is used for determining the area to be adjusted of at least one frame of image, and the area to be adjusted of at least one frame of image is a preset area on the screen of the head-mounted display device or an area determined by the selection of a user; and the color separating device is used for displaying the image in the area to be adjusted on the screen of the head-mounted display device in a color separation manner to adjust the color difference of the head-mounted display device. The display device can significantly improve the color difference phenomenon generated during the use of the head-mounted display device, and greatly improves the user experience.

Description

A head-mounted display device capable of eliminating chromatic aberration

technical field

The invention relates to the field of consumer and device electronics, in particular, to a head-mounted display device capable of eliminating chromatic aberration.

Background technique

A head mounted display device (head mounted display) is a new technology developed in recent years, and its specific applications can be mainly divided into two types: virtual reality (virtual reality) and augmented reality (augmented reality).

Human 3D vision is experimented with the cooperation of two eyes. When a person sees an actual 3D object, the image seen by the left eye and the image seen by the right eye will have slight differences in perspective. The optic nerve of the human brain mixes the images of the left and right eyes to form 3D vision. The head-mounted display device can simulate 3D vision by displaying different images on the display screen close to the eyes, the left eye can only see the left display area, and the right eye can only see the right display area. If during this process, the head-mounted display device blocks the light and images of the external area at the same time, and when the human eye can only see the display screen, a virtual reality effect will be produced.

In some existing designs, a projection display device related to lateral chromatic aberration compensation is disclosed, and the device uses relatively complicated optical elements to realize lateral chromatic aberration compensation. But specifically for the head-mounted display device, for the consideration of user comfort, the head-mounted display device cannot be too heavy. Therefore, the optical imaging elements in the head-mounted display device usually use relatively simple optical imaging elements to reduce the weight of the head-mounted display device. At the same time, for the sake of cost control, relatively simple optical imaging elements are usually used as optical imaging elements. However, a simple optical imaging element has a relatively poor ability to correct image chromatic aberration, so it is easy to generate lateral chromatic aberration, which makes the image on the display screen of the head-mounted display device relatively blurred. In addition to the lateral chromatic aberration caused by the optical components of the display, the glasses worn by the human eye, and even the physiological optical components inside the human eye will also cause lateral chromatic aberration and color ghosting. The above phenomenon is particularly obvious in the display of off-axis images, especially when the user turns the eyeballs, the illusion of color ghosting is particularly serious in the edge area of the head-mounted display device, and the user experience is very unsatisfactory.

Contents of the invention

An embodiment of the present invention provides a head-mounted display device capable of eliminating chromatic aberration, including:

The display screen is arranged on the head-mounted display device and is used to present at least one frame of image; the optical component is used to transmit the at least one frame of image presented on the display screen to the user's eyes; the adjustment device uses For determining the area to be adjusted of the at least one frame of image, the area to be adjusted of the at least one frame of image is a preset area on the screen of the head-mounted display device or an area determined according to a user's selection; The color device is used to display the image in the area to be adjusted in color separation on the screen of the head-mounted display device to adjust the color difference of the head-mounted display device. Through the embodiments of the present invention, the chromatic aberration phenomenon generated by the head-mounted display device can be effectively reduced, so that the user experience is greatly improved.

The invention proposes a head-mounted display device capable of eliminating chromatic aberration.

In the first aspect, the embodiment of the present invention proposes a head-mounted display device capable of eliminating chromatic aberration, including: a display screen, arranged on the head-mounted display device, for presenting at least one frame of image; The at least one frame of image presented on the display screen is transmitted to the user's eyes; the adjusting device is configured to determine an area to be adjusted of the at least one frame of image, and the area to be adjusted of the at least one frame of image is the The preset area on the screen of the head-mounted display device or the area determined according to the user's selection; the color separation device is used to display the image in the area to be adjusted on the screen of the head-mounted display device Color separation display to adjust the color difference of the HMD.

With reference to the first aspect, in the first implementation manner of the first aspect, the adjustment device is further configured to: determine an image color difference adjustment parameter according to the area to be adjusted of the at least one frame of image, and the image color difference adjustment parameter is used for Adjust the degree of color separation display of the image in the area to be adjusted; use the image color difference adjustment parameter to perform color separation display adjustment on at least one frame of the subsequent image to be presented or drive the color separation device to use the image color difference adjustment parameter to at least A subsequent image to be presented is adjusted in color separation.

With reference to the first aspect, in the second implementation manner of the first aspect, the adjustment device is configured to: determine the image for the area to be adjusted of the at least one frame of image according to the result of automatic detection or according to the input of the user A color difference adjustment parameter, the image color difference adjustment parameter is used to adjust the degree of color separation display of the image in the area to be adjusted; use the image color difference adjustment parameter to perform color separation display adjustment on at least one frame of subsequent images to be presented or drive the The color separation device uses the image color difference adjustment parameters to perform color separation display adjustment on at least one frame of subsequent images to be presented.

With reference to the first aspect or its first and second implementation manners, in the third implementation manner of the first aspect, the user input includes at least one of the following methods: physical keyboard input, virtual keyboard input, mouse input or touch screen enter.

With reference to the first aspect or its first, second, and third implementation manners, in a fourth implementation manner of the first aspect, the adjustment device is further configured to: aim at the user's left eye, according to the at least one frame of image For the user's right eye, determine the image color difference adjustment parameters for the right eye according to the area to be adjusted of the at least one frame of image.

With reference to the first aspect or the first to third implementation manners thereof, in a fifth implementation manner of the first aspect, the adjusting device is further configured to: identify the dominant eye and the inferior eye among the left and right eyes of the user; For the dominant eye and the inferior eye of the user, image color difference adjustment parameters are respectively determined according to the area to be adjusted of the at least one frame of image.

With reference to the first aspect or its first to fifth implementation manners, in the sixth implementation manner of the first aspect, it further includes a storage device for determining the image color difference adjustment parameter according to the area to be adjusted of the at least one frame of image , saving the determined image color difference adjustment parameters.

With reference to the first aspect or its first to sixth implementations, in the seventh implementation of the first aspect, it further includes associating means for associating the saved and determined image color difference adjustment parameters with the user .

With reference to the first aspect or its first to seventh implementations, in the eighth implementation of the first aspect, the area to be adjusted of the at least one frame of image includes: the upper right corner, the lower right corner, the upper left corner, the lower left corner or At least one of any other off-axis areas on the screen of the head-mounted display device.

With reference to the first aspect or its first to eighth implementations, in the ninth implementation of the first aspect, the shape of the region to be adjusted of the at least one frame of image includes: at least one of a cross, a box, and an ellipse .

With reference to the first aspect or its first to ninth implementations, in the tenth implementation of the first aspect, a refractive correction device is further provided between the user and the optical assembly, and the refractive correction device is used for It is used to correct the vision of the human eye.

With reference to the first aspect or the first to tenth implementation manners thereof, in an eleventh implementation manner of the first aspect, the refractive correction device is a detachable structure. The user can put on or take off the refractive correction device of the device according to needs.

With reference to the first aspect or its first to eleventh implementations, in a twelfth implementation of the first aspect, the color separation device is configured to display the image in the area to be adjusted on the head-mounted The screen of the display device is decomposed into a plurality of images of different colors for display.

With reference to the first aspect or its first to twelfth implementations, in a thirteenth implementation of the first aspect, the color separation device is configured to display the image in the area to be adjusted on the head-mounted The screen of the display device is decomposed into images of three primary colors of red, green and blue for display.

An embodiment of the present invention also provides a method for eliminating chromatic aberration. The method is applied to a head-mounted display device, and is characterized in that it includes: presenting at least one frame image; based on optical components, transmit the at least one frame image presented on the display screen to the user's eyes; The adjustment area is a preset area on the screen of the head-mounted display device or an area determined according to the user's selection; based on the color separation device, the image in the area to be adjusted is displayed on the head-mounted display device color-separated display on the screen to adjust the color difference of the head-mounted display device. Through the embodiments of the present invention, the chromatic aberration phenomenon generated by the head-mounted display device can be effectively reduced, so that the user experience is greatly improved.

Description of drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following will briefly introduce the accompanying drawings required in the embodiments of the present invention. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For Those of ordinary skill in the art can also obtain other drawings based on these drawings without making creative efforts.

FIG. 1 is a partial schematic diagram of a head-mounted display device according to an embodiment of the present invention (some components of the head-mounted display device are not shown).

FIG. 2 is a schematic diagram of the color difference generated by a head-mounted display device when the adjustment device and the color separation device are not working in the embodiment of the present invention.

FIG. 3 is a schematic diagram of an effect felt by a user's eyes by a head-mounted display device corresponding to FIG. 2 .

FIG. 4 is a schematic diagram of a head-mounted display device for eliminating color difference when the adjustment device and the color separation device are working in the embodiment of the present invention.

FIG. 5 is a schematic diagram of the effect felt by the user's eyes by a head-mounted display device corresponding to FIG. 4 .

Fig. 6 is a schematic diagram of a user adjustment mechanism of an image color difference adjustment parameter according to an embodiment of the present invention.

FIG. 7 is a schematic diagram of an effect of a user adjustment mechanism of an image color difference adjustment parameter corresponding to FIG. 6 .

FIG. 8 shows the process of performing chromatic aberration correction on both eyes of the user respectively.

FIG. 9 shows the process of selecting the saved color separation profile associated with the user.

FIG. 10 is a partial structural schematic diagram of a head-mounted display device according to an embodiment of the present invention.

detailed description

The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts shall fall within the protection scope of the present invention.

FIG. 1 is a partial schematic diagram of a head-mounted display device according to an embodiment of the present invention (some components of the head-mounted display device are not shown). FIG. 1 discloses a display screen, which is set on the head-mounted display device and used to present at least one frame of image. The display screen can be a large display screen divided into display areas for the left and right eyes respectively, or it can be two small display screens on the left and right sides. Also disclosed in FIG. 1 is an optical assembly for transmitting the at least one frame of image presented on the display screen to the user's eyes. Specifically, the optical component may be an ordinary lens, or a reflective mirror with focusing capability, or a diffractive optical element (such as a Fresnel lens) with focusing capability. Fig. 1 also discloses a refractive correction device, it should be noted that if the human eye has refractive errors (myopia, hyperopia, astigmatism, or other situations that require wearing a refractive correction device), the human eye will wear the device, Human eyes do not need to wear the device if they have no refractive error. Specifically, the device may be glasses. In addition, it should be added that the refraction correction device can also be arranged on the head-mounted display device as a component of the head-mounted display device. The embodiments of the present invention do not limit the foregoing implementation manners. A color separation device (not shown in Figure 1), which is connected to the above-mentioned display screen, is used to display the image in the area to be adjusted in color separation on the screen of the head-mounted display device to adjust the head-mounted display device. The color difference of the display device. An adjustment device (not shown in FIG. 1 ), connected to the color separation device and/or the above-mentioned display screen, is used to determine the area to be adjusted of the at least one frame of image, and the area to be adjusted of the at least one frame of image is the head-mounted The preset area on the screen of the type display device or the area determined according to the user's selection.

Preferably, the adjustment device is further used to: determine an image color difference adjustment parameter according to the area to be adjusted of the at least one frame of image, and the image color difference adjustment parameter is used to adjust the degree of color separation display of the image in the area to be adjusted; use the image The color difference adjustment parameter performs color separation display adjustment on at least one frame of subsequent images to be presented or drives the color separation device to use the image color difference adjustment parameters to perform color separation display adjustment on at least one frame of subsequent images to be presented. It should be noted that when it is necessary to determine the color difference adjustment parameters of the current image based on multiple frames of images, the area to be adjusted in each frame of the multi-frame images can be determined first, and the area to be adjusted in each frame of image is automatically detected or adjusted according to User input to determine the color difference adjustment parameters of the current image. For example, image color difference adjustment parameters may be determined for each frame of image first, and then the final image color difference adjustment parameters may be determined by weighted average, and the final image color difference adjustment parameters may be used as the current image color difference adjustment parameters. It should be noted that the so-called image color difference adjustment parameter can be a specific numerical value or a state value, etc., and the image color difference adjustment parameter can be used to adjust the color separation display degree of the image in the area to be adjusted. For example, the adjustment parameter may indicate the degree of color separation of the pattern of three crosses in FIG. 6 . It should be noted that the determined image color difference adjustment parameters can be used to adjust the color separation and display of at least one subsequent frame of image to be presented, or it can be based on user input or automatic detection when the next frame of image arrives, and based on the new In the coming next frame of image, the image color difference adjustment parameter is re-determined, so as to update the above-mentioned current image color difference adjustment parameter. It should also be noted that the area to be adjusted of the at least one frame of image is a preset area on the screen of the head-mounted display device or an area determined according to a user's selection. For example, for the off-axis edge area where lateral chromatic aberration is usually relatively easy to occur, this area can be set as a preset area. This preset area is also related to the size of the display screen. If the size of the display screen is large, the edge area The preset range could also be a bit larger. Alternatively, the user may flexibly select an area that the user considers to be serious in chromatic aberration as the area to be adjusted.

Preferably, the adjustment device is configured to: determine an image color difference adjustment parameter for the area to be adjusted of the at least one frame of image according to the result of automatic detection or according to the user's input, and the image color difference adjustment parameter is used to adjust the area to be adjusted. The degree of color separation display of the image; use the image color difference adjustment parameter to perform color separation display adjustment on at least one frame of subsequent image to be presented or drive the color separation device to use the image color difference adjustment parameter to perform at least one subsequent frame of image to be presented Separation display adjustment. It should be noted that the adjustment device can automatically detect the presented image to determine whether there is a phenomenon of lateral chromatic aberration. For example, according to a preset threshold, when it is determined that the color separation or ghosting of the image exceeds a certain preset threshold, it is determined that lateral chromatic aberration has occurred, and thus it is necessary to further determine image color aberration adjustment parameters. The adjustment device can detect the area where the lateral chromatic aberration occurs, and use this area as the area to be adjusted. Preferably, the user's input includes at least one of the following ways, physical keyboard input, virtual keyboard input, mouse input or touch screen input. It should be known that the above specific implementation manners obtained by way of examples are only some embodiments of the present invention, and the present invention does not limit other adjustment manners of user input. However, it is preferable to use the slider to adjust the image color difference adjustment parameters, which is easy to give the user a better personal experience.

The visual acuity of the two eyes of the user may be different. Preferably, the adjustment device is also used to: determine the image color difference adjustment parameters of the left eye according to the area to be adjusted of the at least one frame of image for the left eye of the user; The right eye of the right eye is determined according to the area to be adjusted of the at least one frame of image, and the image color difference adjustment parameter for the right eye is determined. The advantage of separate adjustments is that it can make the user experience better. It should be particularly noted that the aforementioned determination of the image color difference adjustment parameters for the user's eyes can also be performed according to the result of automatic detection or according to the input of the user.

On the basis of distinguishing the user's left and right eyes, preferably, the adjustment device can also be used to: identify the dominant eye and inferior eye in the user's left and right eyes; The area to be adjusted of a frame of image determines the image color difference adjustment parameter. In this way, the image color difference adjustment parameters can be adjusted more finely.

In order to save the user the trouble of adjusting the image color difference adjustment parameters before each use, preferably, the head-mounted display device further includes a storage device for determining the image color difference adjustment parameters according to the area to be adjusted of the at least one frame of image to save the determined color difference adjustment parameters of the image. When multiple users share one head-mounted display device, preferably, the head-mounted display device further includes associating means for associating the saved and determined image color difference adjustment parameter with the user. In this way, different user parameters are well differentiated. When the head-mounted display device is used next time, different user parameters stored before can be recalled according to different users. In addition, in the embodiment of the present invention, a user detection device can also be provided, such as adding a face recognition module, so that the identity of the user can be automatically confirmed and associated user parameters can be selected. Of course, in this embodiment of the present invention, the associated user parameters may also be manually selected by the user. The embodiments of the present invention are not limited here.

Preferably, the area to be adjusted of the at least one frame of image includes: at least one of the upper right corner, the lower right corner, the upper left corner, the lower left corner or any other off-axis area on the screen of the head-mounted display device. The so-called axis refers to virtualizing or marking the horizontal line and vertical line in the middle of a frame of image as the horizontal axis or the vertical axis. Typically, off-axis regions are more prone to lateral chromatic aberration. The embodiment of the present invention does not specifically limit this area. Adjust the images in the upper right corner, lower right corner, upper left corner, lower left corner or any other off-axis area on the screen of the head-mounted display device. In this way, the different color difference amounts in different areas of the entire screen can be effectively adjusted through the function. Of course, it is also possible to adjust only one area. The invention is not limited here.

It should be noted that, for some specific images, it is easier to adjust parameters of image color difference. Preferably, the shape of the region to be adjusted of the at least one frame of image includes: at least one of a cross, a box, and an ellipse. However, this embodiment of the present invention does not limit the shape of the region to be adjusted, and the shape of the region to be adjusted may also be other shapes.

Preferably, the head-mounted display device further includes: a refraction correction device is arranged between the user and the optical assembly, and the refraction correction device is used to correct the vision of human eyes. Exemplarily, the refractive correction device includes myopia glasses, reading glasses and the like. Preferably, the refractive correction device is a detachable structure. The user can put on or take off the refractive correction device of the device according to needs.

Preferably, the color separation device is configured to decompose the image in the area to be adjusted into multiple images of different colors on the screen of the head-mounted display device for display. For example, the color separation device can be used to decompose the image in the area to be adjusted into images of three primary colors of red, green and blue on the screen of the head-mounted display device for display. It should be noted that it can also be decomposed into images of other colors conforming to the principle of color mixing. This embodiment of the present invention does not limit it.

FIG. 2 is a schematic diagram of a head-mounted display device capable of eliminating chromatic aberration according to an embodiment of the present invention. As shown in Figure 2, it is assumed that neither the adjustment device nor the color separation device is working at this time. The display screen is presenting at least one frame of image on the display screen, and the image is perceived by the user's eyes as a color double image after passing through the optical component and the refractive correction device. This is because the central vision and peripheral vision of the human eye are very different. When the user observes the central image (the position in the middle of the screen), although the color ghosting caused by lateral chromatic aberration also exists, it is because the peripheral vision is relatively poor. , which cannot be felt by the human eye. However, when the user wants to observe the image at the edge of the screen carefully, the human eye will rotate to observe the edge image with the central vision, and such color ghosting will be perceived. FIG. 3 is a schematic diagram of an effect felt by a user's eyes by a head-mounted display device corresponding to FIG. 2 . For example, at this time, there is a cross pattern displayed on the upper right corner of the screen, but the pattern perceived by the user's eyes is actually three crosses next to each other, thus producing color ghosting.

FIG. 4 is a schematic diagram of a head-mounted display device for eliminating color difference when the adjustment device and the color separation device are working in the embodiment of the present invention. A display screen is disclosed in FIG. 4 , the display screen is set on the head-mounted display device, and at this time at least one frame of image is being presented. Also disclosed in FIG. 4 is an optical assembly for transmitting the at least one frame of image presented on the display screen to the user's eyes. Figure 4 also discloses a refractive correction device. An adjustment device (not shown in FIG. 4 ), connected to the color separation device and/or the above-mentioned display screen, is used to determine the area to be adjusted of the at least one frame of image, and the area to be adjusted of the at least one frame of image is the head-mounted The preset area on the screen of the type display device or the area determined according to the user's selection. Specifically, the adjustment device detects that at least one frame of image is being presented at this time to determine the area to be adjusted, and the area to be adjusted of the at least one frame of image is a preset area on the screen of the head-mounted display device or is determined according to the user's The area determined by the selection. It is assumed that in this embodiment, the range of the image edge area is preset. The color separation device (not shown in FIG. 4 ) is used to perform reverse color separation display of the image in the preset area on the screen of the head-mounted display device. The image after the color separation display is perceived by the human eye after the optical component and the refractive correction device. The image perceived by the human eye is clear, and the existence of double images will not be felt. FIG. 5 is a schematic diagram of the effect felt by the user's eyes by a head-mounted display device corresponding to FIG. 4 . For example, the adjustment device is working at this time, and it is detected that at least one frame of image is being presented at this time, and finally the pattern of the cross in the upper right corner of the display screen is determined as the area to be adjusted. is preset. Correspondingly, the color separation device performs color-separation display of the pattern of the cross in the upper right corner of the display screen on the screen of the head-mounted display device, and finally displays it as three crosses next to each other. At this time, although there are three cross patterns displayed on the upper right corner of the display screen, the pattern perceived by the user's eyes is indeed a cross pattern, so the ghost image is eliminated.

Fig. 6 is a schematic diagram of a user adjustment mechanism of an image color difference adjustment parameter according to an embodiment of the present invention. As shown in Figure 6, the adjustment device can determine the image color difference adjustment parameters for the area to be adjusted in the at least one frame of image according to the user's input, and the image color difference adjustment parameters are used to adjust the color separation display of the image in the area to be adjusted The degree of the image color difference adjustment parameter is used to adjust the color separation display of at least one frame of subsequent images to be presented or to drive the color separation device to use the image color difference adjustment parameters to perform color separation display adjustment of at least one frame of subsequent images to be presented. Specifically, the user may determine the image color difference adjustment parameters for the region to be adjusted of the at least one frame of image through physical keyboard input, virtual keyboard input, mouse input, or touch screen input. For example, the cross pattern in the upper right corner area of the display screen can be adjusted by means of a sliding bar. For example, it can be stipulated that when the user slides the bar to the left, the cross pattern in the upper right corner of the display screen is divided into three cross patterns with different colors, and when the user slides the bar to the left, the cross pattern between the three cross patterns The greater the distance is; when the user slides the bar to the right, the three cross patterns in the upper right corner of the display screen will merge into one cross pattern, and when the user slides the bar to the right, the three cross patterns in the upper right corner of the display the tighter. The above adjustments are made until the user is satisfied. For example, at this time, the user's eyes feel that the crosses have completely overlapped and the ghost image has been completely eliminated. FIG. 7 is a schematic diagram of an effect of a user adjustment mechanism of an image color difference adjustment parameter corresponding to FIG. 6 . As shown in Figure 7, the three cross patterns in the upper right corner of the display screen observed by human eyes have completely overlapped, and the ghost image has been completely eliminated so far. At this time, preferably, the user can save the result of adjusting the parameters this time. It should be noted that the way of adjusting through the sliding bar is only exemplary, and the present invention may also include other methods capable of achieving the purpose of adjustment.

FIG. 8 shows the process of performing chromatic aberration correction on both eyes of the user respectively. It should be noted that the vision of the human eye is composed of the vision of the left and right eyes. Therefore, in order to better adapt to the strength of the user, the embodiment of the present invention proposes to determine the image color difference adjustment parameters for the left eye of the user according to the area to be adjusted of the at least one frame of image; for the right eye of the user, according to the at least The area to be adjusted of a frame of image determines the image color difference adjustment parameter for the right eye. The advantage of separate adjustment is that it can correct the chromatic aberration of the user's two colors in a targeted manner, and pay more attention to the user experience. As shown in FIG. 8 , the display screen is divided into a left-eye display area and a right-eye display area. When adjusting the right eye, set the display area of the left eye to a black screen state, at this time, the adjustment method introduced in Figure 6 can be used for adjustment. When adjusting the left eye, set the display area of the right eye to a black screen state, at this time, the adjustment method introduced in Figure 6 can be used for adjustment.

In addition, for the human eyes, when the optic nerve processes information, the visual information of one eye will be selected as the main information, and the information of the other eye will be used as auxiliary information. The eye that provides the main information is called the dominant eye, and the other eye is called the inferior eye. If lateral chromatic aberration correction is performed on both eyes at the same time, the effect of correction will be mainly applied to the dominant eye, while the inferior eye will still see a little color ghosting. In addition, the embodiment of the present invention can also detect whether the user's left eye or right eye is the dominant eye. When the adjustment device determines the image color difference adjustment parameters for the area to be adjusted in the at least one frame of image according to the automatic detection result, because at this time If the adjustment result is not determined by the user himself, it is also possible to assign certain weights to the dominant eye and the inferior eye from the adjustment algorithm to achieve a more ideal adjustment effect.

FIG. 9 shows the process of selecting the saved color separation profile associated with the user. The above-mentioned head-mounted display device may further include a storage device for saving the determined image color difference adjustment parameter after the image color difference adjustment parameter is determined according to the region to be adjusted of the at least one frame of image. Specifically, when the left and right eyes of the user are satisfied, the color separation display configuration file can be saved respectively, and the configuration file can include the color separation configuration information of the left and right eyes. Different users can have different profiles. It should be noted that when the same head-mounted display device has multiple users, the head-mounted display device further includes associating means for associating the saved and determined image color difference adjustment parameters with the users. The same user can also save different configuration files when using different refractive correction devices (glasses or contact lenses). When the user uses the head-mounted display next time, the corresponding configuration file can be selected.

Fig. 10 is a schematic diagram of a partial structure of a head-mounted display device according to an embodiment of the present invention. The schemes of the above-mentioned embodiments of the present invention can be set on the head-mounted display device shown in Fig. 10 , and the head-mounted display device Some other components not mentioned in the above-mentioned embodiments of the present invention are also provided. The head-mounted display device can facilitate the user to perform physical exercise (such as equipped with a heart rate monitor, etc.) to meet the user's exercise needs. It should be noted that the embodiment of the present invention does not limit the application of the head-mounted display device. Corresponding components can also be matched according to other needs of users. Specifically, the head-mounted display device 310 shown in FIG. 1 is used to determine the position of the user's head, generate position data and head movement data, and send the position data and head movement data to the data processing device. The head-mounted display device is also used to receive the image and/or sound sent by the data processing device and present it to the user. Preferably, the head-mounted display device 310 is wearable glasses. The head-mounted display device 310 includes: a head-mounted display 311 and/or an earphone 315, used to receive the image and/or sound sent by the data processing device and present it to the user; a positioning device 313, used to determine the position of the user's head position, generate position data and head movement data, and send the position data and head movement data to the data processing device. Preferably, the positioning device is at least one camera, a microwave (RF) sensor and/or an inertial measurement unit. , it should be noted that the microwave (RF) sensor determines the position by measuring the time difference between microwave sending and receiving. Preferably, the head-mounted display device 310 also includes a heartbeat meter 312, which is installed at the root of the ear of the glasses. Setting it at the above position can not only improve the accuracy of detection, but also make the product beautiful. The heart rate meter can be used to record the user's heart rate and generate the user's heart rate data; the head-mounted display device sends the generated user's heart rate data to the data processing device, so that the data processing device can also do corresponding processing according to the user's heart rate data. Adjustments (e.g., adjust exercise intensity of connected fitness equipment, etc.). The data processing device also automatically adjusts the image and/or sound sent to the head-mounted display device according to the heart rate data of the user. Preferably, the head-mounted display device 310 further includes a sweat-absorbing device 314, which is disposed on at least a partial area of the inner wall of the spectacle frame, and the sweat-absorbing device is used to absorb sweat generated by the user when exercising. Preferably, the sweat absorbing device is also used to record the user's sweating degree and generate the user's sweating data; the head-mounted display device sends the generated user's sweating data to the data processing device, so that the data processing device can also Make corresponding adjustments according to the user's sweating data (for example, adjust the exercise intensity of the connected fitness equipment, etc.). Preferably, the sweat-absorbing device is detachable. Preferably, the sweat-absorbing device includes a sweat-absorbing material, and the sweat-absorbing material is a disposable sweat-absorbing material or a reusable material. It should be noted that the positioning device can be arranged on the head-mounted display device. Specifically, it is a camera. It should be noted that the positioning device can also be implemented in the following ways: one way is to install an infrared LED array on the head-mounted display device, and then install a fixed position relative to the ground on the connected fitness equipment (such as the operating table). Infrared camera, the infrared LED array captured by the camera determines the position of the head through image processing; the other way is just the opposite, the camera is installed on the head-mounted display device, and the LED array is fixed on the connected fitness equipment (for example, on the operating table. ). Both of the above two methods have some components installed on the fitness equipment and the head-mounted display device. It should be noted that both the position of the user's head and the data of the head movement state (velocity/angular velocity, acceleration/angular acceleration, etc.) can be used to determine the settings of the fitness equipment. For example, when the user raises his head twice during exercise, the head-mounted display device captures the position of the user's head and head movement state data, and sends the position data and head movement data to the data processing device, The data processing device can increase the level of difficulty (or exercise intensity) etc. according to the above data. It should be known that, in each embodiment of the present invention, the data collected by the head-mounted display device and the data collected by the fitness equipment can interact with each other.

The embodiment of the present invention also discloses a method for eliminating chromatic aberration, which is applied to a head-mounted display device, and is characterized in that it includes: presenting at least one frame of image based on a display screen set on the head-mounted display device ; Based on the optical component, transmit the at least one frame of image presented on the display screen to the user's eyes; Based on the adjustment device, determine the area to be adjusted of the at least one frame of image, the area to be adjusted of the at least one frame of image is the head-mounted The preset area on the screen of the head-mounted display device or the area determined according to the user's selection; based on the color separation device, the image in the area to be adjusted is displayed in color separation on the screen of the head-mounted display device to adjust Chromatic aberration of head-mounted display devices.

Preferably, the method further includes: determining an image color difference adjustment parameter according to the area to be adjusted of the at least one frame of image, and the image color difference adjustment parameter is used to adjust the degree of color separation display of the image in the area to be adjusted; using the image color difference adjustment parameter Perform color separation display adjustment on at least one frame of subsequent images to be presented or drive the color separation device to perform color separation display adjustment on at least one frame of subsequent images to be presented by using the image color difference adjustment parameters.

Preferably, the image color difference adjustment parameter is determined according to the area to be adjusted of the at least one frame of image, and the image color difference adjustment parameter is used to adjust the degree of color separation display of the image in the area to be adjusted, including: according to the result of automatic detection or according to the The user's input determines the image color difference adjustment parameter for the area to be adjusted of the at least one frame of image, and the image color difference adjustment parameter is used to adjust the degree of color separation display of the image in the area to be adjusted.

Preferably, the user's input includes at least one of the following ways, physical keyboard input, virtual keyboard input, mouse input or touch screen input.

Preferably, the determining the image color difference adjustment parameter according to the area to be adjusted of the at least one frame of image includes: for the user's left eye, determining the image color difference adjustment parameter for the left eye according to the area to be adjusted of the at least one frame of image; For the right eye, an image color difference adjustment parameter for the right eye is determined according to the area to be adjusted of the at least one frame of image.

Preferably, the method further includes: identifying the dominant eye and inferior eye of the user's left and right eyes; and determining image color difference adjustment parameters for the user's dominant eye and inferior eye respectively according to the area to be adjusted of the at least one frame of image.

Preferably, the method further includes: after determining the image color difference adjustment parameter according to the area to be adjusted of the at least one frame of image, saving the determined image color difference adjustment parameter.

Preferably, the area to be adjusted of the at least one frame of image includes: at least one of the upper right corner, the lower right corner, the upper left corner, the lower left corner or any other off-axis area on the screen of the head-mounted display device.

Preferably, the shape of the region to be adjusted of the at least one frame of image includes: at least one of a cross, a box, and an ellipse.

Preferably, the method further includes: correcting the vision of the human eye based on a refractive correction device arranged between the user and the optical assembly.

Preferably, the refractive correction device is detachable.

Preferably, the color-separated display of the image in the area to be adjusted on the screen of the head-mounted display device to adjust the color difference of the head-mounted display device includes: displaying the image in the area to be adjusted on the head-mounted display device The screen of the display device is decomposed into multiple images of different colors for display.

Preferably, decomposing the image in the area to be adjusted into a plurality of images of different colors on the screen of the head-mounted display device includes: displaying the image in the area to be adjusted in the head-mounted display device On the screen, it is decomposed into images of three primary colors of red, green and blue for display.

As used herein, the terms "component," "system," "module," and the like are intended to refer to computer-related entities, which may be hardware, software, software in execution, firmware, middleware, microcode, and / or any combination thereof. For example, a module may be, but is not limited to being, a process running on a processor, a processor, an object, an executable, a thread of execution, a program, a device, and/or a computer. One or more modules can reside within a process, or thread of execution; and a module can be localized on one electronic device or distributed between two or more electronic devices. In addition, these modules can execute from various computer readable media having various data structures stored thereon. These modules can be communicated via, for example, according to a signal with one or more data packets (for example, data from a component interacting with another component in a local system, a distributed system, or in a signal across such as the Internet network to interact with other systems) to communicate locally or remotely. In addition, as those of ordinary skill in the art understand, the components or modules of the system of the present application can be rearranged, or other components/modules/systems can supplement the components or modules of the system of the present application, so as to realize the various functions described for it. aspects, objects, advantages, etc., and components or modules of the system of the present application are not limited to the precise configurations presented in a given figure.

In one or more exemplary embodiments, the functions of the present application may be implemented by hardware, software, firmware, middleware, microcode or any suitable combination thereof. When implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage media may be any physical media that can be accessed by a computer. By way of example and not limitation, such computer storage media may include RAM, ROM,

EEPROM, CD-ROM or other optical disk storage, magnetic disk storage media or other magnetic storage devices, smart cards and flash memory devices (e.g., cards, sticks, key drives, etc.), or devices capable of carrying or storing instructions or data in the form of structures desired program code and any other medium that can be accessed by a computer. For example, if the software is transmitted from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or wireless technologies such as infrared, wireless, and microwave, then the same Coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, wireless, and microwave are included in the definition of the medium. As used in this application, disk and disc include compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk, and blu-ray disc, where disks usually reproduce data magnetically and Optical discs use laser light to optically reproduce data. Combinations of the above should also be included within the scope of computer-readable media.

For hardware implementations, the various exemplary logic, logic blocks, modules, and circuits of the processing unit described in conjunction with aspects disclosed herein may be implemented in one or more ASIC, DSP, DSPD, PLD, FPGA, discrete gate, or transistor logic implemented or performed in a device, discrete hardware components, general purpose processors, controllers, microcontrollers, microprocessors, other electronic units for performing the functions described herein, or combinations thereof. A general-purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, several microprocessors, one or more microprocessors in combination with a DSP core, or any other such architecture. Additionally, at least one processor may comprise one or more modules operable to perform one or more of the steps and/or actions described herein. Furthermore, various aspects or features described herein may be implemented as a method, apparatus, or article of manufacture using standard programming and/or engineering techniques. In addition, the steps and/or actions of the method or algorithm described in conjunction with the aspects disclosed in this application may be directly embodied as hardware, a software module executed by a processor, or a combination of the two. Furthermore, in some aspects, the steps or actions of a method or algorithm may reside on a machine-readable medium or computer-readable medium as at least one or any combination of a code set or a set of instructions, where the machine-readable medium or computer-readable medium may incorporated into a computer program product. The term "article of manufacture" as used in this application is intended to cover a computer program accessible from any suitable computer-readable device or medium. Additionally, this application uses the word "exemplary" to mean serving as an example, illustration, or illustration.

It should be understood that the solution described in each claim of the present invention should also be regarded as an embodiment, and the features in the claims can be combined, such as the steps of different branches executed after the judgment step in the present invention Can be used as different embodiments.

Those skilled in the art can appreciate that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present invention.

Those skilled in the art can clearly understand that for the convenience and brevity of description, some of the principles and devices described above are only illustrative, and should not be construed as limiting the claims.

In the several embodiments provided in this application, it should be understood that the device embodiments described above are only illustrative. For example, the division of the unit is only a schematic division, and may be different in actual implementation. Another way of dividing,

The above is only a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Anyone familiar with the technical field can easily think of changes or replacements within the technical scope disclosed in the present invention. covered within the protection scope of the present invention. Therefore, the protection scope of the present invention should be determined by the protection scope of the claims.

Claims (28)

1. A head-mounted display device capable of eliminating chromatic aberration, characterized in that it comprises: A display screen, set on the head-mounted display device, for presenting at least one frame of image; an optical assembly for transmitting the at least one frame of image presented on the display screen to the user's eyes; An adjusting device, configured to determine an area to be adjusted of the at least one frame of image, the area to be adjusted of the at least one frame of image is a preset area on the screen of the head-mounted display device or is determined according to a user's selection Area; The color separation device is used to display the image in the area to be adjusted in color separation on the screen of the head-mounted display device to adjust the color difference of the head-mounted display device. 2. The head-mounted display device according to claim 1, wherein the adjusting device is further used for: Determine an image color difference adjustment parameter according to the area to be adjusted of the at least one frame of image, and the image color difference adjustment parameter is used to adjust the degree of color separation display of the image in the area to be adjusted; Using the image color difference adjustment parameters to perform color separation display adjustment on at least one frame of subsequent images to be presented or driving the color separation device to use the image color difference adjustment parameters to perform color separation display adjustments on at least one frame of subsequent images to be presented. 3. The head-mounted display device according to claim 2, wherein the adjustment device is configured to adjust the at least one frame of image according to the result of automatic detection or according to the input of the user. The area determines the image color difference adjustment parameter, and the image color difference adjustment parameter is used to adjust the degree of color separation display of the image in the area to be adjusted; Using the image color difference adjustment parameters to perform color separation display adjustment on at least one frame of subsequent images to be presented or driving the color separation device to use the image color difference adjustment parameters to perform color separation display adjustments on at least one frame of subsequent images to be presented. 4 . The head-mounted display device according to claim 3 , wherein the user's input includes at least one of the following methods: physical keyboard input, virtual keyboard input, mouse input or touch screen input. 5. The head-mounted display device according to any one of claims 1-4, wherein the adjusting device is further used for: For the user's left eye, determine an image color difference adjustment parameter for the left eye according to the area to be adjusted of the at least one frame of image; For the right eye of the user, an image color difference adjustment parameter for the right eye is determined according to the area to be adjusted of the at least one frame of image. 6. The head-mounted display device according to claim 5, wherein the adjusting device is further used for: Identifying the dominant eye and inferior eye of the user's left and right eyes; determining image color difference adjustment parameters for the user's dominant eye and inferior eye respectively according to the area to be adjusted of the at least one frame of image. 7. The head-mounted display device according to any one of claims 1-4, further comprising a storage device, configured to, after determining the image color difference adjustment parameters according to the area to be adjusted of the at least one frame of image, The determined image color difference adjustment parameters are saved. 8. The head-mounted display device according to claim 7, further comprising, associating means for associating the saved and determined image color difference adjustment parameters with the user. 9. The head-mounted display device according to any one of claims 1-8, wherein the area to be adjusted of the at least one frame of image comprises: At least one of the upper right corner, the lower right corner, the upper left corner, the lower left corner or any other off-axis area on the screen of the head-mounted display device. 10. The head-mounted display device according to any one of claims 1-9, wherein the shape of the region to be adjusted of the at least one frame of image includes: at least one of a cross, a box, and an ellipse. 11. The head-mounted display device according to any one of claims 1-10, further comprising: A refraction correction device is also arranged between the user and the optical assembly, and the refraction correction device is used to correct the vision of the human eye. 12. The head-mounted display device according to claim 11, wherein the refractive correction device is a detachable structure. 13. The head-mounted display device according to any one of claims 1-12, characterized in that the color separation device is used to display the image in the area to be adjusted on the head-mounted display device The screen is decomposed into multiple images of different colors for display. 14. The head-mounted display device according to claim 13, wherein the color separation device is configured to decompose the image in the area to be adjusted into red and red on the screen of the head-mounted display device. , green, blue three primary colors of the image for display. 15. A method capable of eliminating chromatic aberration, said method being applied to a head-mounted display device, comprising: Presenting at least one frame of image based on a display screen disposed on the head-mounted display device; transmitting said at least one frame of image presented on said display screen to an eye of a user based on an optical assembly; Determine the area to be adjusted of the at least one frame of image based on the adjustment device, the area to be adjusted of the at least one frame of image is a preset area on the screen of the head-mounted display device or is determined according to a user's selection area; Based on the color separation device, the image in the area to be adjusted is displayed in color separation on the screen of the head-mounted display device to adjust the color difference of the head-mounted display device. 16. The method of claim 15, further comprising: Determine an image color difference adjustment parameter according to the area to be adjusted of the at least one frame of image, and the image color difference adjustment parameter is used to adjust the degree of color separation display of the image in the area to be adjusted; Using the image color difference adjustment parameters to perform color separation display adjustment on at least one frame of subsequent images to be presented or driving the color separation device to use the image color difference adjustment parameters to perform color separation display adjustments on at least one frame of subsequent images to be presented. 17. The method according to claim 16, wherein the image color difference adjustment parameter is determined according to the region to be adjusted of the at least one frame of image, and the image color difference adjustment parameter is used to adjust the component of the image in the region to be adjusted. The degree of color display, including: According to the result of automatic detection or according to the input of the user, an image color difference adjustment parameter is determined for the area to be adjusted of the at least one frame of image, and the image color difference adjustment parameter is used to adjust the degree of color separation display of the image in the area to be adjusted . 18. The method according to claim 1, wherein the user's input includes at least one of the following methods: physical keyboard input, virtual keyboard input, mouse input or touch screen input. 19. The method according to any one of claims 15-18, wherein the determining the image color difference adjustment parameters according to the area to be adjusted of the at least one frame of image comprises: For the user's left eye, determine an image color difference adjustment parameter for the left eye according to the area to be adjusted of the at least one frame of image; For the right eye of the user, an image color difference adjustment parameter for the right eye is determined according to the area to be adjusted of the at least one frame of image. 20. The method of claim 19, further comprising: Identifying the dominant eye and inferior eye of the user's left and right eyes; determining image color difference adjustment parameters for the user's dominant eye and inferior eye respectively according to the area to be adjusted of the at least one frame of image. 21. The method according to any one of claims 15-18, further comprising: after determining the image color difference adjustment parameters according to the area to be adjusted of the at least one frame of image, saving the determined image color difference adjustment parameter. 22. The method according to claim 21, further comprising: associating the saved and determined image color difference adjustment parameters with the user. 23. The method according to any one of claims 15-22, wherein the area to be adjusted of the at least one frame of image comprises: At least one of the upper right corner, the lower right corner, the upper left corner, the lower left corner or any other off-axis area on the screen of the head-mounted display device. 24. The method according to any one of claims 15-23, wherein the shape of the area to be adjusted of the at least one frame of image comprises: at least one of a cross, a box, and an ellipse. 25. The method of any one of claims 15-24, further comprising: The vision of the human eye is corrected based on a refractive correction device disposed between the user and the optical assembly. 26. The method of claim 25, wherein the refractive correction device is removable. 27. The method according to any one of claims 15-26, wherein the image in the area to be adjusted is displayed in color separation on the screen of the head-mounted display device to adjust the head-mounted display device. The color difference of the display device, including: The image in the area to be adjusted is decomposed into a plurality of images of different colors on the screen of the head-mounted display device for display. 28. The method according to claim 27, wherein the decomposing the image in the area to be adjusted into a plurality of images of different colors on the screen of the head-mounted display device for display comprises: The image in the area to be adjusted is decomposed on the screen of the head-mounted display device into images of three primary colors of red, green, and blue for display.