CN104020565B - Display system with optical lens and display screen and image display method thereof - Google Patents
Display system with optical lens and display screen and image display method thereof Download PDFInfo
- Publication number
- CN104020565B CN104020565B CN201410275482.1A CN201410275482A CN104020565B CN 104020565 B CN104020565 B CN 104020565B CN 201410275482 A CN201410275482 A CN 201410275482A CN 104020565 B CN104020565 B CN 104020565B
- Authority
- CN
- China
- Prior art keywords
- image
- color components
- pixel
- distortion
- kinds
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000003287 optical effect Effects 0.000 title claims abstract description 64
- 238000000034 method Methods 0.000 title claims abstract description 42
- 230000008569 process Effects 0.000 claims abstract description 9
- 238000004364 calculation method Methods 0.000 claims description 15
- 238000012935 Averaging Methods 0.000 claims 3
- 238000010586 diagram Methods 0.000 description 5
- 230000000007 visual effect Effects 0.000 description 3
- 230000004075 alteration Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 2
- 239000003086 colorant Substances 0.000 description 2
- 239000006185 dispersion Substances 0.000 description 2
- 238000007792 addition Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008092 positive effect Effects 0.000 description 1
- 210000001525 retina Anatomy 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Landscapes
- Image Processing (AREA)
Abstract
Description
技术领域technical field
本发明属于图像处理技术领域,具体地说,是涉及一种具有光学透镜和显示屏的显示系统及其图像显示方法。The invention belongs to the technical field of image processing, and in particular relates to a display system with an optical lens and a display screen and an image display method thereof.
背景技术Background technique
头戴显示器(HMD)作为近几年新兴的技术,是一种放大超微显示屏上的图像,将影像投射于用户视网膜上,进而呈现于观看者眼中大屏幕图像。头戴显示器目前在工业、军事、文艺、娱乐等多方面具有广泛的应用。As an emerging technology in recent years, head-mounted display (HMD) is a kind of enlarged image on the ultra-micro display screen, which projects the image on the user's retina, and then presents a large-screen image in the eyes of the viewer. Head-mounted displays are currently widely used in many aspects such as industry, military affairs, literature and art, and entertainment.
图1是目前头戴显示器的光路示意图,如图1所示,其中,人眼100透过目镜102能够观看到成像在直板型平面显示器101上的图像。由于光线经过目镜102的折射后,会产生一定的畸变,如图2、图3所示,其中,图2为显示器正常显示输出的图像,图3是经过目镜102后投入至人眼中所呈现的畸变图像,投影图像的畸变不仅会影响观察的舒适感,甚至会造成用户对重要信息的误判,导致不必要的损失。FIG. 1 is a schematic diagram of the optical path of the current head-mounted display, as shown in FIG. 1 , wherein the human eye 100 can watch the image imaged on the straight flat panel display 101 through the eyepiece 102 . Due to the refraction of the light through the eyepiece 102, certain distortion will occur, as shown in Figure 2 and Figure 3, wherein Figure 2 is the normal display output image of the display, and Figure 3 is the image presented by the eyepiece 102 and thrown into the human eye Distorted image, the distortion of the projected image will not only affect the comfort of observation, but even cause the user to misjudge important information, resulting in unnecessary losses.
此外,由于三原色RGB的波长各不相同,经过目镜102的折射角度也不同,参见图4所示,投影在人眼中,体现为三种颜色图像互不重合,会造成模糊或重影的视觉效果,同样会造成影响观察的舒适感以及用户对信息的误判。In addition, since the wavelengths of the three primary colors RGB are different, the angles of refraction through the eyepiece 102 are also different. As shown in FIG. , which will also affect the comfort of observation and the user's misjudgment of information.
发明内容Contents of the invention
本发明为了解决现有头戴显示器的视觉效果出现畸变以及图像模糊或重影的问题,提供了一种具有光学透镜和显示屏图像显示方法,可以克服上述问题。The present invention provides an image display method with an optical lens and a display screen to overcome the above-mentioned problems in order to solve the problems of distortion of visual effects and blurred images or double images of the existing head-mounted displays.
为了解决上述技术问题,本发明采用以下技术方案予以实现:In order to solve the above-mentioned technical problems, the present invention adopts the following technical solutions to achieve:
一种具有光学透镜和显示屏的图像显示方法,包括以下步骤:An image display method with an optical lens and a display screen, comprising the following steps:
(1)、根据所述光学透镜的光学参数虚拟地反转所述光学透镜,得到一个虚拟的反转透镜,所述反转透镜的物像与所述光学透镜的物像是反转的;(1), virtually inverting the optical lens according to the optical parameters of the optical lens to obtain a virtual inversion lens, the object image of the inversion lens and the object image of the optical lens are inverted;
(2)、根据反转透镜的光学参数分别计算出RGB三种颜色分量经过所述反转透镜后的畸变系数,为a1、a2、a3;(2), according to the optical parameters of the reverse lens, calculate the distortion coefficients of the RGB three color components after the reverse lens, which are a1, a2, a3;
(3)、将一预显示图像各像素点分别进行放大a1、a2、a3倍的处理,得到所述各像素点畸变后的RGB三种颜色分量,形成补偿图像;(3), each pixel point of a pre-display image is respectively enlarged a1, a2, a3 times of processing, obtains RGB three kinds of color components after described each pixel point distortion, forms compensation image;
(4)、所述补偿图像输出至所述显示屏上显示后,经过所述光学透镜而显示为正常图像。(4) After the compensated image is output to the display screen for display, it passes through the optical lens and is displayed as a normal image.
进一步的,步骤(2)中,畸变系数的计算方法为:Further, in step (2), the calculation method of the distortion coefficient is:
建立一个反转透镜前的图像物面坐标系,其中,物面坐标系中像素点(x1,y1)的像高l为该像素点至坐标系中心点的距离 Establish an image object plane coordinate system in front of the reverse lens, where the image height l of a pixel point (x1, y1) in the object plane coordinate system is the distance from the pixel point to the center point of the coordinate system
获得该像素点经过反转透镜后的RGB三种颜色分量的像高分别为L,L′,L〞;Obtain the image heights of the RGB three color components of the pixel point after the inversion lens is L, L', L" respectively;
则RGB三种颜色分量经过所述反转透镜后的畸变系数为:Then the distortion coefficients of the RGB three color components after passing through the inversion lens are:
R:
G:
B:
又进一步的,步骤(2)中,不同像素点的畸变系数不同,所述a1、a2、a3为常数数组。Still further, in step (2), the distortion coefficients of different pixels are different, and the a1, a2, and a3 are constant arrays.
又进一步的,获得像素点(x1,y1)经过反转透镜后的RGB三种颜色分量的像高L,L′,L〞的步骤包括:Still further, the step of obtaining the image heights L, L', L" of the RGB three color components of the pixel point (x1, y1) after passing through the inversion lens includes:
根据所述反转透镜的光学参数模拟出所述反转透镜的物像对应关系;Simulating the object-image correspondence of the inversion lens according to the optical parameters of the inversion lens;
依据所述对应关系输出RGB三种颜色分量在物面坐标系中的原像高以及经过反转透镜后的新像高;Output the original image height of the RGB three color components in the object plane coordinate system and the new image height after the inversion lens according to the corresponding relationship;
依据RGB三种颜色分量的原像高l0和新像高L0、L0′、L0〞拟合出RGB三种颜色分量的新像高关于原像高的函数关系,即RGB三种颜色分量畸变前与畸变后像高的函数关系According to the original image height l 0 and the new image height L 0 , L 0 ′, L 0 of the RGB three color components, the functional relationship between the new image height of the RGB three color components and the original image height is fitted, that is, the RGB three color components Functional relationship between color component image height before distortion and after distortion
R:L0=f(l0);R: L 0 =f(l 0 );
G:L0′=f1(l0);G:L 0 ′=f 1 (l 0 );
B:L0″=f2(l0);B:L 0 ″=f 2 (l 0 );
依据所述物面坐标系中像素点(x1,y1)的像高以及所述函数关系,获得该像素点经过反转透镜后的RGB三种颜色分量的像高,分别为L=f(l),L′=f1(l),L〞=f2(l)。According to the image height of the pixel point (x1, y1) in the object plane coordinate system And the functional relationship, obtain the image height of the RGB three color components after the pixel passes through the inversion lens, which are respectively L=f(l), L'=f 1 (l), L"=f 2 (l ).
再进一步的,在步骤(3)中还包括填补遗漏点的步骤,对补偿图像中各像素点的RGB三种颜色分量分别进行查找,若出现部分像素点缺少X值,则对该像素点的X值进行填补,其中,X为RGB三种颜色分量的其中一种。Still further, in step (3), also include the step of filling missing point, the RGB three kinds of color components of each pixel point in the compensated image are searched respectively, if part pixel point lacks X value, then the pixel point The X value is filled, where X is one of the three color components of RGB.
再进一步的,对X值进行填补的方法为:将与该像素点相近邻的至少两个像素点对应的X值进行求平均计算,并将求平均计算的结果填补为该像素点的X值。Further, the method of filling the X value is: average the X values corresponding to at least two adjacent pixels to the pixel, and fill the result of the average calculation as the X value of the pixel .
进一步的,在步骤(3)中,得到所述各像素点畸变后的RGB三种颜色分量之后,形成补偿图像之前,还包括针对重叠点进行处理的步骤,对得到的各像素点畸变后的RGB三种颜色分量分别进行查找,若出现部分像素点其中一种颜色分量具有多个值,则将该多个值处理成一个值。Further, in step (3), after obtaining the RGB three color components after the distortion of each pixel point, before forming the compensation image, it also includes the step of processing the overlapping points, and distorting the obtained pixel points The three color components of RGB are searched separately. If there are some pixels where one of the color components has multiple values, the multiple values are processed into one value.
优选的,所述的针对重叠点进行处理的方法为,将所述的多个值进行求平均值计算。Preferably, the method for processing the overlapping points is to calculate the average value of the multiple values.
基于上述的一种具有光学透镜和显示屏的图像显示方法,本发明同时提供了一种图像显示方法的显示系统,包括光学透镜,设置于光学透镜前的显示屏以及连接所述显示屏的图像调整模块,所述图像调整模块包括:Based on the above-mentioned image display method with an optical lens and a display screen, the present invention also provides a display system for an image display method, including an optical lens, a display screen arranged in front of the optical lens, and an image connected to the display screen An adjustment module, the image adjustment module includes:
虚拟反转透镜单元,用于根据所述光学透镜的光学参数虚拟地反转所述光学透镜,得到一个虚拟的反转透镜,所述反转透镜的物像与所述光学透镜的物像是反转的;A virtual inversion lens unit, configured to virtually invert the optical lens according to the optical parameters of the optical lens to obtain a virtual inversion lens, the object image of the inversion lens is the same as the object image of the optical lens reversed;
畸变系数计算单元,用于根据反转透镜的光学参数分别计算出RGB三种颜色分量经过所述反转透镜后的畸变系数,为a1、a2、a3;A distortion coefficient calculation unit, which is used to calculate the distortion coefficients of the RGB three color components after passing through the inversion lens according to the optical parameters of the inversion lens, which are a1, a2, and a3;
图像调整单元,用于接收预显示图像,将所述预显示图像各像素点分别进行放大a1、a2、a3倍的处理,得到所述各像素点畸变后的RGB三种颜色分量,形成补偿图像,输出至所述显示屏。The image adjustment unit is used to receive the pre-display image, and respectively amplify each pixel of the pre-display image by a1, a2, and a3 times to obtain distorted RGB three color components of each pixel to form a compensation image , output to the display screen.
进一步的,所述图像调整单元还用于在将所述补偿图像输出至所述显示屏之前对补偿图像中各像素点的RGB三种颜色分量分别进行查找,填补遗漏的RGB三种颜色分量;和/或,Further, the image adjustment unit is further configured to search for the RGB three color components of each pixel in the compensated image before outputting the compensated image to the display screen, and fill in the missing RGB three color components; and / or,
所述图像调整单元还用于在得到所述各像素点畸变后的RGB三种颜色分量之后,形成补偿图像之前,对得到的各像素点畸变后的RGB三种颜色分量分别进行查找,对重叠点进行处理。The image adjustment unit is also used to search the obtained RGB three color components after each pixel distortion after obtaining the RGB three color components after each pixel distortion and before forming the compensation image, and to search for the overlapping RGB three color components respectively. Click to process.
与现有技术相比,本发明的优点和积极效果是:本发明的具有光学透镜和显示屏的图像显示方法,通过将图像RGB三种颜色分量分别进行畸变补偿,解决了由于三种颜色波长不同而畸变程度不同,若采用统一标准补偿的话处理后的图像会模糊或重影的问题,通过对显示器原图像按照畸变系数做逆运算进行补偿,可以抵消图像经过目镜折射产生的畸变,最终呈现在用户眼中的是清楚、无畸变的图像,视觉效果好,此外,对于固定的目镜其畸变系数也是固定的,因此,相应的参数只需计算一次即可适用于对显示器输出所有图像的补偿,快速、便捷。Compared with the prior art, the advantages and positive effects of the present invention are: the image display method with an optical lens and a display screen of the present invention solves the problem caused by the three color wavelengths by compensating the distortion of the RGB three color components of the image respectively. Different degrees of distortion are different. If a unified standard is used for compensation, the processed image will be blurred or ghosted. By performing inverse calculation on the original image of the display according to the distortion coefficient to compensate, the distortion caused by the refraction of the image through the eyepiece can be offset, and finally presented What the user sees is a clear, undistorted image with good visual effects. In addition, the distortion coefficient is also fixed for a fixed eyepiece. Therefore, the corresponding parameters only need to be calculated once to apply to the compensation of all images output by the display. Fast and convenient.
结合附图阅读本发明实施方式的详细描述后,本发明的其他特点和优点将变得更加清楚。Other features and advantages of the present invention will become more apparent after reading the detailed description of the embodiments of the present invention in conjunction with the accompanying drawings.
附图说明Description of drawings
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. Those skilled in the art can also obtain other drawings based on these drawings without creative work.
图1是背景技术中目前头戴显示器的光路示意图;Fig. 1 is a schematic diagram of the optical path of the current head-mounted display in the background technology;
图2是背景技术中显示器正常显示输出的图像;Fig. 2 is the image of normal display output of monitor in the background technology;
图3是背景技术中经过目镜102后的畸变图像;Fig. 3 is the distorted image after passing through the eyepiece 102 in the background technology;
图4是背景技术中经过目镜102后RGB三种颜色分量分离的示意图;FIG. 4 is a schematic diagram of the separation of RGB three color components after passing through the eyepiece 102 in the background technology;
图5是本发明的实施例一中显示器输出的经过补偿的图像;Fig. 5 is a compensated image output by the display in Embodiment 1 of the present invention;
图6(a)是本发明的实施例一中R颜色分量的畸变前与畸变后像高的函数关系曲线;Fig. 6 (a) is the functional relationship curve of the image height before and after distortion of the R color component in Embodiment 1 of the present invention;
图6(b)是本发明的实施例一中G颜色分量的畸变前与畸变后像高的函数关系曲线;Fig. 6 (b) is the functional relationship curve of the image height before and after distortion of the G color component in Embodiment 1 of the present invention;
图6(c)是本发明的实施例一中B颜色分量的畸变前与畸变后像高的函数关系曲线;Fig. 6 (c) is the functional relationship curve of the image height before and after the distortion of the B color component in Embodiment 1 of the present invention;
图7是本发明的实施例一中具有光学透镜和显示屏的图像显示方法流程图;7 is a flowchart of an image display method with an optical lens and a display screen in Embodiment 1 of the present invention;
图8是本发明所提出的图像显示系统的一种实施例结构示意图;Fig. 8 is a schematic structural diagram of an embodiment of the image display system proposed by the present invention;
图9是图8所示的显示系统的显示图像过程的示意图。FIG. 9 is a schematic diagram of an image display process of the display system shown in FIG. 8 .
具体实施方式detailed description
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.
实施例一,本实施例提供了一种具有光学透镜和显示屏的图像显示方法,参见图7和图8、9所示,包括以下步骤:Embodiment 1. This embodiment provides an image display method with an optical lens and a display screen, as shown in FIG. 7 and FIG. 8 and 9, including the following steps:
S1、根据所述光学透镜的光学参数虚拟地反转所述光学透镜,得到一个虚拟的反转透镜,所述反转透镜的物像与所述光学透镜的物像是反转的;S1. Virtually reverse the optical lens according to the optical parameters of the optical lens to obtain a virtual reverse lens, the object image of the reverse lens and the object image of the optical lens are reversed;
S2、根据反转透镜的光学参数分别计算出RGB三种颜色分量经过所述反转透镜后的畸变系数,为a1、a2、a3;S2. According to the optical parameters of the inversion lens, respectively calculate the distortion coefficients of the RGB three color components after passing through the inversion lens, which are a1, a2, and a3;
S3、将一预显示图像各像素点分别进行放大a1、a2、a3倍的处理,得到所述各像素点畸变后的RGB三种颜色分量,形成补偿图像;S3. Enlarge each pixel of a pre-display image by a1, a2, and a3 times, respectively, to obtain the RGB three color components after the distortion of each pixel, and form a compensated image;
S4、所述补偿图像输出至所述显示屏上显示后,经过所述光学透镜而显示为正常图像。S4. After the compensated image is output to the display screen for display, it passes through the optical lens and is displayed as a normal image.
本实施例的具有光学透镜和显示屏的图像显示方法工作原理是,首先,由于RGB三种颜色波长不同而畸变程度不同,也即体现为畸变系数不同,本实施例中通过将图像RGB三种颜色分量分别进行畸变补偿,解决了现有若采用统一标准补偿的话处理后的图像会模糊或重影的问题。其次,通过计算畸变前后的畸变系数,对显示器原图像按照畸变系数做逆运算进行补偿,可以抵消图像经过目镜折射产生的畸变,最终呈现在用户眼中的是清楚、无畸变的图像,视觉效果好,此外,对于固定的目镜其畸变系数也是固定的,因此,相应的参数只需计算一次即可适用于对显示器输出所有图像的补偿,快速、便捷。The working principle of the image display method with an optical lens and a display screen in this embodiment is that firstly, due to the different wavelengths of the three colors of RGB, the degree of distortion is different, that is, it is reflected in different distortion coefficients. Distortion compensation is performed on the color components separately, which solves the existing problem that the processed image will be blurred or ghosted if a unified standard compensation is adopted. Secondly, by calculating the distortion coefficient before and after the distortion, the original image of the display is compensated according to the inverse calculation of the distortion coefficient, which can offset the distortion caused by the refraction of the image through the eyepiece, and finally present a clear and distortion-free image in the eyes of the user, with good visual effect , in addition, for a fixed eyepiece, its distortion coefficient is also fixed, therefore, the corresponding parameters only need to be calculated once to apply to the compensation of all images output by the display, which is fast and convenient.
需要说明的是,由于畸变之前的原图像各像素RGB三种颜色分量坐标是重合的,因此,原图像中坐标为(x1,y1)的像素点的RGB三种颜色分量坐标值均相同。It should be noted that since the RGB three color component coordinates of each pixel in the original image before distortion are coincident, the RGB three color component coordinate values of the pixel with coordinates (x1, y1) in the original image are all the same.
作为一个优选实施例,通过对比图2、图3可知,畸变前与畸变后的图像的一些像素至中心点的距离发生变化,也即,像高的值直接反应了畸变程度,因此,为了更精准的对图像进行补偿,本实施例中的畸变系数由像高计算出,所述步骤S1中,畸变系数的计算方法为:As a preferred embodiment, by comparing Figure 2 and Figure 3, it can be seen that the distance from some pixels to the center point of the image before and after distortion changes, that is, the value of the image height directly reflects the degree of distortion, therefore, in order to To accurately compensate the image, the distortion coefficient in this embodiment is calculated from the image height. In the step S1, the calculation method of the distortion coefficient is:
建立一个反转透镜前的图像物面坐标系,其中,物面坐标系中像素点(x1,y1)的像高l为该像素点至坐标系中心点的距离 Establish an image object plane coordinate system in front of the reverse lens, where the image height l of a pixel point (x1, y1) in the object plane coordinate system is the distance from the pixel point to the center point of the coordinate system
获得该像素点经过反转透镜后的RGB三种颜色分量的像高分别为L,L′,L〞;Obtain the image heights of the RGB three color components of the pixel point after the inversion lens is L, L', L" respectively;
则RGB三种颜色分量经过所述反转透镜后的畸变系数为:Then the distortion coefficients of the RGB three color components after passing through the inversion lens are:
R:
G:
B:
通过对比图2、图3同样可知,不同像素点的畸变系数不同,越靠近中心点变化越小,因此,在各颜色分量不同坐标的像素点的畸变系数是不同的,若采用统一的畸变系数进行补偿,无法实现对每个像素的畸变进行补偿,因此,需要分别计算出各像素点在各颜色分量的畸变系数,形成畸变系数的常数数组,也即,所述步骤S1中,所述a1、a2、a3为常数数组。By comparing Figure 2 and Figure 3, it can also be seen that the distortion coefficients of different pixels are different, and the closer to the center point, the smaller the change. Therefore, the distortion coefficients of pixels with different coordinates in each color component are different. If a uniform distortion coefficient is used Compensation cannot realize the compensation for the distortion of each pixel. Therefore, it is necessary to calculate the distortion coefficients of each pixel point in each color component separately to form a constant array of distortion coefficients, that is, in the step S1, the a1 , a2, a3 are constant arrays.
由于本方法最终适用于工业产品使用,无法像在实验室环境下可以逐个像素点测试畸变后的像高,因此,优选提前找出像高畸变前与畸变后像高的函数关系,所述畸变后像素点的RGB三种颜色分量的像高的计算方法为:Since this method is ultimately applicable to industrial products, it is impossible to test the distorted image height pixel by pixel in a laboratory environment. Therefore, it is preferable to find out the functional relationship between the image height before distortion and the distorted image height in advance, and the distortion The calculation method of the image height of the RGB three color components of the rear pixel is:
又进一步的,获得像素点(x1,y1)经过反转透镜后的RGB三种颜色分量的像高L,L′,L〞的步骤包括:Still further, the step of obtaining the image heights L, L', L" of the RGB three color components of the pixel point (x1, y1) after passing through the inversion lens includes:
根据所述反转透镜的光学参数模拟出所述反转透镜的物像对应关系;Simulating the object-image correspondence of the inversion lens according to the optical parameters of the inversion lens;
依据所述对应关系输出RGB三种颜色分量在物面坐标系中的原像高以及经过反转透镜后的新像高;Output the original image height of the RGB three color components in the object plane coordinate system and the new image height after the inversion lens according to the corresponding relationship;
依据RGB三种颜色分量的原像高l0和新像高L0、L0′、L0〞拟合出RGB三种颜色分量的新像高关于原像高的函数关系,即RGB三种颜色分量畸变前与畸变后像高的函数关系According to the original image height l 0 and the new image height L 0 , L 0 ′, L 0 of the RGB three color components, the functional relationship between the new image height of the RGB three color components and the original image height is fitted, that is, the RGB three color components Functional relationship between color component image height before distortion and after distortion
R:L0=f(l0);R: L 0 =f(l 0 );
G:L0′=f1(l0);G:L 0 ′=f 1 (l 0 );
B:L0″=f2(l0);B:L 0 ″=f 2 (l 0 );
依据所述物面坐标系中像素点(x1,y1)的像高以及所述函数关系,获得该像素点经过反转透镜后的RGB三种颜色分量的像高,分别为L=f(l),L′=f1(l),L〞=f2(l)。According to the image height of the pixel point (x1, y1) in the object plane coordinate system And the functional relationship, obtain the image height of the RGB three color components after the pixel passes through the inversion lens, which are respectively L=f(l), L'=f 1 (l), L"=f 2 (l ).
由于执行步骤S3时,对原图像的所有像素点进行补偿,因此各个像素点的坐标是确定的,因此,对于任一坐标为(x1,y1)的像素点,其像高为:所以通过上述函数公式可以很容易的计算出畸变后的像高,进而很容易计算出畸变系数。Since step S3 is performed, all pixels of the original image are compensated, so the coordinates of each pixel are determined. Therefore, for any pixel whose coordinates are (x 1 , y 1 ), its image height is: Therefore, the image height after distortion can be easily calculated through the above function formula, and then the distortion coefficient can be easily calculated.
本实施例给出了测得的其中一种目镜的函数关系,其中,L0=f(l0)曲线可参见图6(a)所示,L0′=f1(l0)曲线可参见图6(b)所示,L0″=f2(l0)曲线可参见图6(c)所示,上述三幅曲线图中,横轴表示畸变前的像高,纵轴表示畸变后的像高。利用畸变前像素点的像高l0计算畸变后像素点RGB三种颜色分量的像高L0、L0′、L0〞,再根据直角坐标关系,可分别计算出补偿后图像RGB三颜色分量的坐标值(x2,y2),(x2′,y2′),(x2〞,y2〞):This embodiment gives the measured functional relationship of one of the eyepieces, wherein, the curve of L 0 =f(l 0 ) can be seen in Figure 6(a), and the curve of L 0 ′=f 1 (l 0 ) can be See Figure 6(b), the L 0 ″=f 2 (l 0 ) curve can be seen in Figure 6(c), in the above three graphs, the horizontal axis represents the image height before distortion, and the vertical axis represents the distortion Image height after distortion. Use the image height l 0 of the pixel point before distortion to calculate the image height L 0 , L 0 ′, L 0 "of the RGB three color components of the pixel point after distortion, and then calculate the compensation according to the rectangular coordinate relationship Coordinate values (x 2 , y 2 ), (x 2 ′, y 2 ′), (x 2 ″, y 2 ″) of the RGB three-color components of the image after:
由于该图像的畸变和色散值刚好与头戴显示器的目镜相反,将该图通过显示器显示,再透过头戴显示器的目镜观看时,畸变和色差都可以得到补偿,最终人眼看到的效果,是如图2中没有任何畸变的正常画面。Since the distortion and dispersion value of the image is just opposite to the eyepiece of the head-mounted display, the image is displayed on the display, and then viewed through the eyepiece of the head-mounted display, the distortion and chromatic aberration can be compensated, and the final effect seen by the human eye is, It is a normal picture without any distortion as shown in Figure 2.
若根据上述对应关系直接将原图像中(x1,y1)坐标点中的R、G、B值分别存入其对应坐标点(x2,y2),(x2′,y2′),(x2〞,y2〞)中,则在新的图像中可能会出现某些点没有原图的对应关系,体现在图像显示中,这些像素点缺少某种颜色分量,因此在所述步骤(3)中还包括填补遗漏点的步骤,对补偿图像中各像素点的RGB三种颜色分量分别进行查找,若出现部分像素点缺少X值,则对该像素点的X值进行填补,其中,X为RGB三种颜色分量的其中一种。补偿后的图像更加还原其真实色彩,避免了图像处理过程中丢失颜色分量的现象。If the R, G, and B values in the (x1, y1) coordinate point in the original image are directly stored in their corresponding coordinate points (x 2 , y 2 ), (x 2 ′, y 2 ′) according to the above corresponding relationship, (x 2 ″, y 2 ″), there may be some points in the new image that do not have the correspondence of the original image, which is reflected in the image display, these pixels lack a certain color component, so in the steps (3) also includes the step of filling the missing point, the RGB three color components of each pixel point in the compensation image are searched respectively, if some pixels lack the X value, then the X value of the pixel point is filled, wherein , X is one of the three color components of RGB. The compensated image restores its true color more, avoiding the phenomenon of losing color components in the process of image processing.
作为一个优选实施例,为了简化计算方法,提高计算速度,本实施例中优选采用平均值法,也即,对X值进行填补的方法为:将该像素点至少两个相邻点对应的X值进行求平均计算,并将计算结果填补作为该像素点的X值。As a preferred embodiment, in order to simplify the calculation method and improve the calculation speed, the average value method is preferably used in this embodiment, that is, the method of filling the X value is: the X corresponding to at least two adjacent points of the pixel point Values are averaged, and the calculation result is filled as the X value of the pixel.
同样道理的,若根据上述对应关系直接将原图像中(x1,y1)坐标点中的R、G、B值分别存入其对应坐标点(x2,y2),(x2′,y2′),(x2〞,y2〞)中,则在新的图像中可能会出现某些像素点的其中一种颜色分量具有多个值,也即出现了重叠点,为了不影响显示,在所述步骤(3)中,得到所述各像素点畸变后的RGB三种颜色分量之后,形成补偿图像之前,还包括针对重叠点进行处理的步骤,对得到的各像素点畸变后的RGB三种颜色分量分别进行查找,若出现部分像素点其中一种颜色分量具有多个值,则将该多个值处理成一个值。In the same way, if the R, G, and B values in the (x1, y1) coordinate point in the original image are directly stored in the corresponding coordinate point (x 2 , y 2 ), (x 2 ′, y 2 ′), (x 2 ″, y 2 ″), then in the new image, one of the color components of some pixels may have multiple values, that is, overlapping points appear, in order not to affect the display , in the step (3), after obtaining the RGB three color components after the distortion of each pixel, before forming the compensated image, it also includes the step of processing the overlapping points, and distorting the obtained pixels The three color components of RGB are searched separately. If there are some pixels where one of the color components has multiple values, the multiple values are processed into one value.
同样作为一个优选实施例,为了简化计算方法,提高计算速度,本实施例中优选采用平均值法,也即,所述的针对重叠点进行处理的方法为,将所述的多个值进行求平均值计算。通过将多个重叠点处理成一个点,可以防止显示输出程序出错,使其输出每幅图像都具有唯一对应的值。Also as a preferred embodiment, in order to simplify the calculation method and increase the calculation speed, the average value method is preferably used in this embodiment, that is, the method for processing overlapping points is to calculate the multiple values Average calculation. By processing multiple overlapping points into one point, errors in the display output program can be prevented, so that each image output has a unique corresponding value.
实施例二,基于实施例一中的一种具有光学透镜和显示屏的图像显示方法,本实施例提供了一种图像显示方法的显示系统,如图8和9所示,包括光学透镜102,设置于光学透镜102前的显示屏101以及连接所述显示屏101的图像调整模块103,所述图像调整模块103包括:Embodiment 2, based on an image display method with an optical lens and a display screen in Embodiment 1, this embodiment provides a display system for an image display method, as shown in FIGS. 8 and 9 , including an optical lens 102, The display screen 101 arranged in front of the optical lens 102 and the image adjustment module 103 connected to the display screen 101, the image adjustment module 103 includes:
虚拟反转透镜单元,用于根据所述光学透镜的光学参数虚拟地反转所述光学透镜,得到一个虚拟的反转透镜,所述反转透镜的物像与所述光学透镜的物像是反转的;A virtual inversion lens unit, configured to virtually invert the optical lens according to the optical parameters of the optical lens to obtain a virtual inversion lens, the object image of the inversion lens is the same as the object image of the optical lens reversed;
畸变系数计算单元,用于根据反转透镜的光学参数分别计算出RGB三种颜色分量经过所述反转透镜后的畸变系数,为a1、a2、a3;A distortion coefficient calculation unit, which is used to calculate the distortion coefficients of the RGB three color components after passing through the inversion lens according to the optical parameters of the inversion lens, which are a1, a2, and a3;
图像调整单元,用于接收预显示图像,将所述预显示图像各像素点分别进行放大a1、a2、a3倍的处理,得到所述各像素点畸变后的RGB三种颜色分量,形成补偿图像,输出至所述显示屏。The image adjustment unit is used to receive the pre-display image, and respectively amplify each pixel of the pre-display image by a1, a2, and a3 times to obtain distorted RGB three color components of each pixel to form a compensation image , output to the display screen.
由于对图像的补偿与该图像经过光学透镜102时的畸变和色散相反,因此,如图9所示,补偿图像经过光学透镜102后,畸变和色差都可以得到补偿,最终人眼看到的效果,是如图9中没有任何畸变和色差的正常画面。Since the compensation for the image is opposite to the distortion and dispersion when the image passes through the optical lens 102, as shown in FIG. It is a normal picture without any distortion and chromatic aberration as shown in Figure 9.
进一步的,所述图像调整单元还用于在将所述补偿图像输出至所述显示屏之前对补偿图像中各像素点的RGB三种颜色分量分别进行查找,填补遗漏的RGB三种颜色分量;和/或,Further, the image adjustment unit is further configured to search for the RGB three color components of each pixel in the compensated image before outputting the compensated image to the display screen, and fill in the missing RGB three color components; and / or,
所述图像调整单元还用于在得到所述各像素点畸变后的RGB三种颜色分量之后,形成补偿图像之前,对得到的各像素点畸变后的RGB三种颜色分量分别进行查找,对重叠点进行处理。通过本实施例的填补遗漏的RGB三种颜色分量以及对重叠点进行处理,补偿后的图像更加还原其真实色彩,避免了图像处理过程中丢失颜色分量的现象。The image adjustment unit is also used to search the obtained RGB three color components after each pixel distortion after obtaining the RGB three color components after each pixel distortion and before forming the compensation image, and to search for the overlapping RGB three color components respectively. Click to process. By filling the missing RGB three color components and processing overlapping points in this embodiment, the compensated image can more restore its true color, avoiding the loss of color components during image processing.
本系统也可应用在头戴显示器等近眼显示设备中,但本发明的保护范围不限定本系统的应用环境。This system can also be applied to near-eye display devices such as head-mounted displays, but the protection scope of the present invention does not limit the application environment of this system.
当然,上述说明并非是对本发明的限制,本发明也并不仅限于上述举例,本技术领域的普通技术人员在本发明的实质范围内所做出的变化、改型、添加或替换,也应属于本发明的保护范围。Of course, the above descriptions are not intended to limit the present invention, and the present invention is not limited to the above examples. Changes, modifications, additions or substitutions made by those skilled in the art within the scope of the present invention shall also belong to protection scope of the present invention.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410275482.1A CN104020565B (en) | 2014-06-19 | 2014-06-19 | Display system with optical lens and display screen and image display method thereof |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410275482.1A CN104020565B (en) | 2014-06-19 | 2014-06-19 | Display system with optical lens and display screen and image display method thereof |
Publications (2)
Publication Number | Publication Date |
---|---|
CN104020565A CN104020565A (en) | 2014-09-03 |
CN104020565B true CN104020565B (en) | 2016-03-23 |
Family
ID=51437412
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201410275482.1A Active CN104020565B (en) | 2014-06-19 | 2014-06-19 | Display system with optical lens and display screen and image display method thereof |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN104020565B (en) |
Families Citing this family (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105979252A (en) * | 2015-12-03 | 2016-09-28 | 乐视致新电子科技(天津)有限公司 | Test method and device |
CN106127714B (en) * | 2016-07-01 | 2019-08-20 | 南京睿悦信息技术有限公司 | A kind of measurement method of virtual reality head-mounted display equipment distortion parameter |
JP6762807B2 (en) * | 2016-08-30 | 2020-09-30 | マクセル株式会社 | Information display device |
CN106791754B (en) * | 2016-12-22 | 2018-08-21 | 歌尔科技有限公司 | A kind of equipment chromatic aberration correction method and system |
CN107219629B (en) | 2017-07-14 | 2021-01-08 | 惠州Tcl移动通信有限公司 | Method, storage medium and device for preventing VR device dispersion by RGB superposition |
CN113222862B (en) * | 2021-06-04 | 2024-09-17 | 黑芝麻智能科技(上海)有限公司 | Image distortion correction method, device, electronic equipment and storage medium |
CN113920076B (en) * | 2021-09-29 | 2025-07-18 | 武汉精立电子技术有限公司 | VR module detection method and device |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5604630A (en) * | 1995-06-30 | 1997-02-18 | Itt Corporation | Night vision monocular with balanced optics |
US5914818A (en) * | 1996-11-29 | 1999-06-22 | Texas Instruments Incorporated | Offset projection lens for use with reflective spatial light modulators |
CN2718608Y (en) * | 2004-07-28 | 2005-08-17 | 刘琳 | Stereo-glasses for virtual cinema |
CN103018907A (en) * | 2012-12-19 | 2013-04-03 | 虢登科 | Display method and head-mounted display |
-
2014
- 2014-06-19 CN CN201410275482.1A patent/CN104020565B/en active Active
Also Published As
Publication number | Publication date |
---|---|
CN104020565A (en) | 2014-09-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN104020565B (en) | Display system with optical lens and display screen and image display method thereof | |
CN111476104B (en) | AR-HUD image distortion correction method, device and system under dynamic eye position | |
US11854171B2 (en) | Compensation for deformation in head mounted display systems | |
CN107071382B (en) | Stereoscopic image display device | |
CN103026367B (en) | For rendering system and method for the display to compensate the vision impairment of beholder | |
WO2016115849A1 (en) | Image brightness adjustment method and adjustment device, and display device | |
US20110122144A1 (en) | Automatically Adaptive Display Eliminating Need For Vision Correction Aids | |
WO2019184251A1 (en) | Rendering method, computer product and display apparatus | |
CN105825840B (en) | A kind of optical compensation method, optical compensating member and display panel | |
US12265224B2 (en) | Near eye display apparatus | |
CN103237227B (en) | Method for reducing crosstalk of stereoscopic image and display system thereof | |
CN102053367B (en) | Image calibration method for binocular helmet display | |
CN111061373A (en) | Eyeball tracking calibration method and device and wearable equipment | |
CN105404011A (en) | 3D image correction method of head up display and head up display | |
US20110084966A1 (en) | Method for forming three-dimension images and related display module | |
WO2021227969A1 (en) | Data processing method and device thereof | |
US10672110B2 (en) | Information processing system, information processing apparatus, output apparatus, program, and recording medium | |
CN105979252A (en) | Test method and device | |
CN103559688B (en) | distortion correction method based on wavefront image compensation | |
CN110035273A (en) | A kind of distortion correction method, device and the display equipment using it | |
US11521297B2 (en) | Method and device for presenting AR information based on video communication technology | |
CN102508405A (en) | Direct passive stereo realization device for cubic screen and correction method for image | |
US20040179271A1 (en) | Electronic correction device for optical distortions in a collimated imaging obtained from a matrix display | |
CN118714277B (en) | 3D (three-dimensional) calibration effect evaluation method of 3D camera and computer storage medium | |
TWI520570B (en) | Image processing method for stereoscopic images |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant | ||
TR01 | Transfer of patent right | ||
TR01 | Transfer of patent right |
Effective date of registration: 20201010 Address after: 261031 north of Yuqing street, east of Dongming Road, high tech Zone, Weifang City, Shandong Province (Room 502, Geer electronic office building) Patentee after: GoerTek Optical Technology Co.,Ltd. Address before: International Exhibition Center of wealth 18 No. 266061 Shandong province Qingdao city Laoshan District Qinling Mountains Road No. 3 Building 4 layer 401-436 Patentee before: Qingdao GoerTek Technology Co.,Ltd. |