[go: up one dir, main page]

CN104020565B - Display system with optical lens and display screen and image display method thereof - Google Patents

Display system with optical lens and display screen and image display method thereof Download PDF

Info

Publication number
CN104020565B
CN104020565B CN201410275482.1A CN201410275482A CN104020565B CN 104020565 B CN104020565 B CN 104020565B CN 201410275482 A CN201410275482 A CN 201410275482A CN 104020565 B CN104020565 B CN 104020565B
Authority
CN
China
Prior art keywords
image
color components
pixel
distortion
kinds
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201410275482.1A
Other languages
Chinese (zh)
Other versions
CN104020565A (en
Inventor
赵博刚
王晨阳
杨春
周宏伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Goertek Optical Technology Co Ltd
Original Assignee
Qingdao Goertek Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Goertek Co Ltd filed Critical Qingdao Goertek Co Ltd
Priority to CN201410275482.1A priority Critical patent/CN104020565B/en
Publication of CN104020565A publication Critical patent/CN104020565A/en
Application granted granted Critical
Publication of CN104020565B publication Critical patent/CN104020565B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Image Processing (AREA)

Abstract

The invention discloses a kind of display system and the method for displaying image thereof with optical lens and display screen, comprise the following steps: (1), reverse according to the optical parametric of optical lens described optical lens virtually, obtain a virtual counter-rotating lens, the image of counter-rotating lens and the image of described optical lens reverse; (2), according to the optical parametric of counter-rotating lens calculating the distortion factor of RGB tri-kinds of color components after described counter-rotating lens respectively, is a1, a2, a3; (3), by each pixel of a pre-display image carry out respectively amplifying a1, a2, a3 process doubly, obtain the RGB tri-kinds of color components after the distortion of each pixel, formed and compensate image; (4), after described compensation image exports described display screen display to, normal picture is shown as through described optical lens.Display system and the method for displaying image thereof with optical lens and display screen of the present invention, solving image can the problem of fuzzy or ghost image and distortion, and algorithm is quick, convenient.

Description

具有光学透镜和显示屏的显示系统及其图像显示方法Display system with optical lens and display screen and image display method thereof

技术领域technical field

本发明属于图像处理技术领域,具体地说,是涉及一种具有光学透镜和显示屏的显示系统及其图像显示方法。The invention belongs to the technical field of image processing, and in particular relates to a display system with an optical lens and a display screen and an image display method thereof.

背景技术Background technique

头戴显示器(HMD)作为近几年新兴的技术,是一种放大超微显示屏上的图像,将影像投射于用户视网膜上,进而呈现于观看者眼中大屏幕图像。头戴显示器目前在工业、军事、文艺、娱乐等多方面具有广泛的应用。As an emerging technology in recent years, head-mounted display (HMD) is a kind of enlarged image on the ultra-micro display screen, which projects the image on the user's retina, and then presents a large-screen image in the eyes of the viewer. Head-mounted displays are currently widely used in many aspects such as industry, military affairs, literature and art, and entertainment.

图1是目前头戴显示器的光路示意图,如图1所示,其中,人眼100透过目镜102能够观看到成像在直板型平面显示器101上的图像。由于光线经过目镜102的折射后,会产生一定的畸变,如图2、图3所示,其中,图2为显示器正常显示输出的图像,图3是经过目镜102后投入至人眼中所呈现的畸变图像,投影图像的畸变不仅会影响观察的舒适感,甚至会造成用户对重要信息的误判,导致不必要的损失。FIG. 1 is a schematic diagram of the optical path of the current head-mounted display, as shown in FIG. 1 , wherein the human eye 100 can watch the image imaged on the straight flat panel display 101 through the eyepiece 102 . Due to the refraction of the light through the eyepiece 102, certain distortion will occur, as shown in Figure 2 and Figure 3, wherein Figure 2 is the normal display output image of the display, and Figure 3 is the image presented by the eyepiece 102 and thrown into the human eye Distorted image, the distortion of the projected image will not only affect the comfort of observation, but even cause the user to misjudge important information, resulting in unnecessary losses.

此外,由于三原色RGB的波长各不相同,经过目镜102的折射角度也不同,参见图4所示,投影在人眼中,体现为三种颜色图像互不重合,会造成模糊或重影的视觉效果,同样会造成影响观察的舒适感以及用户对信息的误判。In addition, since the wavelengths of the three primary colors RGB are different, the angles of refraction through the eyepiece 102 are also different. As shown in FIG. , which will also affect the comfort of observation and the user's misjudgment of information.

发明内容Contents of the invention

本发明为了解决现有头戴显示器的视觉效果出现畸变以及图像模糊或重影的问题,提供了一种具有光学透镜和显示屏图像显示方法,可以克服上述问题。The present invention provides an image display method with an optical lens and a display screen to overcome the above-mentioned problems in order to solve the problems of distortion of visual effects and blurred images or double images of the existing head-mounted displays.

为了解决上述技术问题,本发明采用以下技术方案予以实现:In order to solve the above-mentioned technical problems, the present invention adopts the following technical solutions to achieve:

一种具有光学透镜和显示屏的图像显示方法,包括以下步骤:An image display method with an optical lens and a display screen, comprising the following steps:

(1)、根据所述光学透镜的光学参数虚拟地反转所述光学透镜,得到一个虚拟的反转透镜,所述反转透镜的物像与所述光学透镜的物像是反转的;(1), virtually inverting the optical lens according to the optical parameters of the optical lens to obtain a virtual inversion lens, the object image of the inversion lens and the object image of the optical lens are inverted;

(2)、根据反转透镜的光学参数分别计算出RGB三种颜色分量经过所述反转透镜后的畸变系数,为a1、a2、a3;(2), according to the optical parameters of the reverse lens, calculate the distortion coefficients of the RGB three color components after the reverse lens, which are a1, a2, a3;

(3)、将一预显示图像各像素点分别进行放大a1、a2、a3倍的处理,得到所述各像素点畸变后的RGB三种颜色分量,形成补偿图像;(3), each pixel point of a pre-display image is respectively enlarged a1, a2, a3 times of processing, obtains RGB three kinds of color components after described each pixel point distortion, forms compensation image;

(4)、所述补偿图像输出至所述显示屏上显示后,经过所述光学透镜而显示为正常图像。(4) After the compensated image is output to the display screen for display, it passes through the optical lens and is displayed as a normal image.

进一步的,步骤(2)中,畸变系数的计算方法为:Further, in step (2), the calculation method of the distortion coefficient is:

建立一个反转透镜前的图像物面坐标系,其中,物面坐标系中像素点(x1,y1)的像高l为该像素点至坐标系中心点的距离 Establish an image object plane coordinate system in front of the reverse lens, where the image height l of a pixel point (x1, y1) in the object plane coordinate system is the distance from the pixel point to the center point of the coordinate system

获得该像素点经过反转透镜后的RGB三种颜色分量的像高分别为L,L′,L〞;Obtain the image heights of the RGB three color components of the pixel point after the inversion lens is L, L', L" respectively;

则RGB三种颜色分量经过所述反转透镜后的畸变系数为:Then the distortion coefficients of the RGB three color components after passing through the inversion lens are:

R: a 1 = L l ; R: a 1 = L l ;

G: a 2 = L ′ l ; G: a 2 = L ′ l ;

B: a 3 = L ′ ′ l . B: a 3 = L ′ ′ l .

又进一步的,步骤(2)中,不同像素点的畸变系数不同,所述a1、a2、a3为常数数组。Still further, in step (2), the distortion coefficients of different pixels are different, and the a1, a2, and a3 are constant arrays.

又进一步的,获得像素点(x1,y1)经过反转透镜后的RGB三种颜色分量的像高L,L′,L〞的步骤包括:Still further, the step of obtaining the image heights L, L', L" of the RGB three color components of the pixel point (x1, y1) after passing through the inversion lens includes:

根据所述反转透镜的光学参数模拟出所述反转透镜的物像对应关系;Simulating the object-image correspondence of the inversion lens according to the optical parameters of the inversion lens;

依据所述对应关系输出RGB三种颜色分量在物面坐标系中的原像高以及经过反转透镜后的新像高;Output the original image height of the RGB three color components in the object plane coordinate system and the new image height after the inversion lens according to the corresponding relationship;

依据RGB三种颜色分量的原像高l0和新像高L0、L0′、L0〞拟合出RGB三种颜色分量的新像高关于原像高的函数关系,即RGB三种颜色分量畸变前与畸变后像高的函数关系According to the original image height l 0 and the new image height L 0 , L 0 ′, L 0 of the RGB three color components, the functional relationship between the new image height of the RGB three color components and the original image height is fitted, that is, the RGB three color components Functional relationship between color component image height before distortion and after distortion

R:L0=f(l0);R: L 0 =f(l 0 );

G:L0′=f1(l0);G:L 0 ′=f 1 (l 0 );

B:L0″=f2(l0);B:L 0 ″=f 2 (l 0 );

依据所述物面坐标系中像素点(x1,y1)的像高以及所述函数关系,获得该像素点经过反转透镜后的RGB三种颜色分量的像高,分别为L=f(l),L′=f1(l),L〞=f2(l)。According to the image height of the pixel point (x1, y1) in the object plane coordinate system And the functional relationship, obtain the image height of the RGB three color components after the pixel passes through the inversion lens, which are respectively L=f(l), L'=f 1 (l), L"=f 2 (l ).

再进一步的,在步骤(3)中还包括填补遗漏点的步骤,对补偿图像中各像素点的RGB三种颜色分量分别进行查找,若出现部分像素点缺少X值,则对该像素点的X值进行填补,其中,X为RGB三种颜色分量的其中一种。Still further, in step (3), also include the step of filling missing point, the RGB three kinds of color components of each pixel point in the compensated image are searched respectively, if part pixel point lacks X value, then the pixel point The X value is filled, where X is one of the three color components of RGB.

再进一步的,对X值进行填补的方法为:将与该像素点相近邻的至少两个像素点对应的X值进行求平均计算,并将求平均计算的结果填补为该像素点的X值。Further, the method of filling the X value is: average the X values corresponding to at least two adjacent pixels to the pixel, and fill the result of the average calculation as the X value of the pixel .

进一步的,在步骤(3)中,得到所述各像素点畸变后的RGB三种颜色分量之后,形成补偿图像之前,还包括针对重叠点进行处理的步骤,对得到的各像素点畸变后的RGB三种颜色分量分别进行查找,若出现部分像素点其中一种颜色分量具有多个值,则将该多个值处理成一个值。Further, in step (3), after obtaining the RGB three color components after the distortion of each pixel point, before forming the compensation image, it also includes the step of processing the overlapping points, and distorting the obtained pixel points The three color components of RGB are searched separately. If there are some pixels where one of the color components has multiple values, the multiple values are processed into one value.

优选的,所述的针对重叠点进行处理的方法为,将所述的多个值进行求平均值计算。Preferably, the method for processing the overlapping points is to calculate the average value of the multiple values.

基于上述的一种具有光学透镜和显示屏的图像显示方法,本发明同时提供了一种图像显示方法的显示系统,包括光学透镜,设置于光学透镜前的显示屏以及连接所述显示屏的图像调整模块,所述图像调整模块包括:Based on the above-mentioned image display method with an optical lens and a display screen, the present invention also provides a display system for an image display method, including an optical lens, a display screen arranged in front of the optical lens, and an image connected to the display screen An adjustment module, the image adjustment module includes:

虚拟反转透镜单元,用于根据所述光学透镜的光学参数虚拟地反转所述光学透镜,得到一个虚拟的反转透镜,所述反转透镜的物像与所述光学透镜的物像是反转的;A virtual inversion lens unit, configured to virtually invert the optical lens according to the optical parameters of the optical lens to obtain a virtual inversion lens, the object image of the inversion lens is the same as the object image of the optical lens reversed;

畸变系数计算单元,用于根据反转透镜的光学参数分别计算出RGB三种颜色分量经过所述反转透镜后的畸变系数,为a1、a2、a3;A distortion coefficient calculation unit, which is used to calculate the distortion coefficients of the RGB three color components after passing through the inversion lens according to the optical parameters of the inversion lens, which are a1, a2, and a3;

图像调整单元,用于接收预显示图像,将所述预显示图像各像素点分别进行放大a1、a2、a3倍的处理,得到所述各像素点畸变后的RGB三种颜色分量,形成补偿图像,输出至所述显示屏。The image adjustment unit is used to receive the pre-display image, and respectively amplify each pixel of the pre-display image by a1, a2, and a3 times to obtain distorted RGB three color components of each pixel to form a compensation image , output to the display screen.

进一步的,所述图像调整单元还用于在将所述补偿图像输出至所述显示屏之前对补偿图像中各像素点的RGB三种颜色分量分别进行查找,填补遗漏的RGB三种颜色分量;和/或,Further, the image adjustment unit is further configured to search for the RGB three color components of each pixel in the compensated image before outputting the compensated image to the display screen, and fill in the missing RGB three color components; and / or,

所述图像调整单元还用于在得到所述各像素点畸变后的RGB三种颜色分量之后,形成补偿图像之前,对得到的各像素点畸变后的RGB三种颜色分量分别进行查找,对重叠点进行处理。The image adjustment unit is also used to search the obtained RGB three color components after each pixel distortion after obtaining the RGB three color components after each pixel distortion and before forming the compensation image, and to search for the overlapping RGB three color components respectively. Click to process.

与现有技术相比,本发明的优点和积极效果是:本发明的具有光学透镜和显示屏的图像显示方法,通过将图像RGB三种颜色分量分别进行畸变补偿,解决了由于三种颜色波长不同而畸变程度不同,若采用统一标准补偿的话处理后的图像会模糊或重影的问题,通过对显示器原图像按照畸变系数做逆运算进行补偿,可以抵消图像经过目镜折射产生的畸变,最终呈现在用户眼中的是清楚、无畸变的图像,视觉效果好,此外,对于固定的目镜其畸变系数也是固定的,因此,相应的参数只需计算一次即可适用于对显示器输出所有图像的补偿,快速、便捷。Compared with the prior art, the advantages and positive effects of the present invention are: the image display method with an optical lens and a display screen of the present invention solves the problem caused by the three color wavelengths by compensating the distortion of the RGB three color components of the image respectively. Different degrees of distortion are different. If a unified standard is used for compensation, the processed image will be blurred or ghosted. By performing inverse calculation on the original image of the display according to the distortion coefficient to compensate, the distortion caused by the refraction of the image through the eyepiece can be offset, and finally presented What the user sees is a clear, undistorted image with good visual effects. In addition, the distortion coefficient is also fixed for a fixed eyepiece. Therefore, the corresponding parameters only need to be calculated once to apply to the compensation of all images output by the display. Fast and convenient.

结合附图阅读本发明实施方式的详细描述后,本发明的其他特点和优点将变得更加清楚。Other features and advantages of the present invention will become more apparent after reading the detailed description of the embodiments of the present invention in conjunction with the accompanying drawings.

附图说明Description of drawings

为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. Those skilled in the art can also obtain other drawings based on these drawings without creative work.

图1是背景技术中目前头戴显示器的光路示意图;Fig. 1 is a schematic diagram of the optical path of the current head-mounted display in the background technology;

图2是背景技术中显示器正常显示输出的图像;Fig. 2 is the image of normal display output of monitor in the background technology;

图3是背景技术中经过目镜102后的畸变图像;Fig. 3 is the distorted image after passing through the eyepiece 102 in the background technology;

图4是背景技术中经过目镜102后RGB三种颜色分量分离的示意图;FIG. 4 is a schematic diagram of the separation of RGB three color components after passing through the eyepiece 102 in the background technology;

图5是本发明的实施例一中显示器输出的经过补偿的图像;Fig. 5 is a compensated image output by the display in Embodiment 1 of the present invention;

图6(a)是本发明的实施例一中R颜色分量的畸变前与畸变后像高的函数关系曲线;Fig. 6 (a) is the functional relationship curve of the image height before and after distortion of the R color component in Embodiment 1 of the present invention;

图6(b)是本发明的实施例一中G颜色分量的畸变前与畸变后像高的函数关系曲线;Fig. 6 (b) is the functional relationship curve of the image height before and after distortion of the G color component in Embodiment 1 of the present invention;

图6(c)是本发明的实施例一中B颜色分量的畸变前与畸变后像高的函数关系曲线;Fig. 6 (c) is the functional relationship curve of the image height before and after the distortion of the B color component in Embodiment 1 of the present invention;

图7是本发明的实施例一中具有光学透镜和显示屏的图像显示方法流程图;7 is a flowchart of an image display method with an optical lens and a display screen in Embodiment 1 of the present invention;

图8是本发明所提出的图像显示系统的一种实施例结构示意图;Fig. 8 is a schematic structural diagram of an embodiment of the image display system proposed by the present invention;

图9是图8所示的显示系统的显示图像过程的示意图。FIG. 9 is a schematic diagram of an image display process of the display system shown in FIG. 8 .

具体实施方式detailed description

下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

实施例一,本实施例提供了一种具有光学透镜和显示屏的图像显示方法,参见图7和图8、9所示,包括以下步骤:Embodiment 1. This embodiment provides an image display method with an optical lens and a display screen, as shown in FIG. 7 and FIG. 8 and 9, including the following steps:

S1、根据所述光学透镜的光学参数虚拟地反转所述光学透镜,得到一个虚拟的反转透镜,所述反转透镜的物像与所述光学透镜的物像是反转的;S1. Virtually reverse the optical lens according to the optical parameters of the optical lens to obtain a virtual reverse lens, the object image of the reverse lens and the object image of the optical lens are reversed;

S2、根据反转透镜的光学参数分别计算出RGB三种颜色分量经过所述反转透镜后的畸变系数,为a1、a2、a3;S2. According to the optical parameters of the inversion lens, respectively calculate the distortion coefficients of the RGB three color components after passing through the inversion lens, which are a1, a2, and a3;

S3、将一预显示图像各像素点分别进行放大a1、a2、a3倍的处理,得到所述各像素点畸变后的RGB三种颜色分量,形成补偿图像;S3. Enlarge each pixel of a pre-display image by a1, a2, and a3 times, respectively, to obtain the RGB three color components after the distortion of each pixel, and form a compensated image;

S4、所述补偿图像输出至所述显示屏上显示后,经过所述光学透镜而显示为正常图像。S4. After the compensated image is output to the display screen for display, it passes through the optical lens and is displayed as a normal image.

本实施例的具有光学透镜和显示屏的图像显示方法工作原理是,首先,由于RGB三种颜色波长不同而畸变程度不同,也即体现为畸变系数不同,本实施例中通过将图像RGB三种颜色分量分别进行畸变补偿,解决了现有若采用统一标准补偿的话处理后的图像会模糊或重影的问题。其次,通过计算畸变前后的畸变系数,对显示器原图像按照畸变系数做逆运算进行补偿,可以抵消图像经过目镜折射产生的畸变,最终呈现在用户眼中的是清楚、无畸变的图像,视觉效果好,此外,对于固定的目镜其畸变系数也是固定的,因此,相应的参数只需计算一次即可适用于对显示器输出所有图像的补偿,快速、便捷。The working principle of the image display method with an optical lens and a display screen in this embodiment is that firstly, due to the different wavelengths of the three colors of RGB, the degree of distortion is different, that is, it is reflected in different distortion coefficients. Distortion compensation is performed on the color components separately, which solves the existing problem that the processed image will be blurred or ghosted if a unified standard compensation is adopted. Secondly, by calculating the distortion coefficient before and after the distortion, the original image of the display is compensated according to the inverse calculation of the distortion coefficient, which can offset the distortion caused by the refraction of the image through the eyepiece, and finally present a clear and distortion-free image in the eyes of the user, with good visual effect , in addition, for a fixed eyepiece, its distortion coefficient is also fixed, therefore, the corresponding parameters only need to be calculated once to apply to the compensation of all images output by the display, which is fast and convenient.

需要说明的是,由于畸变之前的原图像各像素RGB三种颜色分量坐标是重合的,因此,原图像中坐标为(x1,y1)的像素点的RGB三种颜色分量坐标值均相同。It should be noted that since the RGB three color component coordinates of each pixel in the original image before distortion are coincident, the RGB three color component coordinate values of the pixel with coordinates (x1, y1) in the original image are all the same.

作为一个优选实施例,通过对比图2、图3可知,畸变前与畸变后的图像的一些像素至中心点的距离发生变化,也即,像高的值直接反应了畸变程度,因此,为了更精准的对图像进行补偿,本实施例中的畸变系数由像高计算出,所述步骤S1中,畸变系数的计算方法为:As a preferred embodiment, by comparing Figure 2 and Figure 3, it can be seen that the distance from some pixels to the center point of the image before and after distortion changes, that is, the value of the image height directly reflects the degree of distortion, therefore, in order to To accurately compensate the image, the distortion coefficient in this embodiment is calculated from the image height. In the step S1, the calculation method of the distortion coefficient is:

建立一个反转透镜前的图像物面坐标系,其中,物面坐标系中像素点(x1,y1)的像高l为该像素点至坐标系中心点的距离 Establish an image object plane coordinate system in front of the reverse lens, where the image height l of a pixel point (x1, y1) in the object plane coordinate system is the distance from the pixel point to the center point of the coordinate system

获得该像素点经过反转透镜后的RGB三种颜色分量的像高分别为L,L′,L〞;Obtain the image heights of the RGB three color components of the pixel point after the inversion lens is L, L', L" respectively;

则RGB三种颜色分量经过所述反转透镜后的畸变系数为:Then the distortion coefficients of the RGB three color components after passing through the inversion lens are:

R: a 1 = L l ; R: a 1 = L l ;

G: a 2 = L ′ l ; G: a 2 = L ′ l ;

B: a 3 = L ′ ′ l . B: a 3 = L ′ ′ l .

通过对比图2、图3同样可知,不同像素点的畸变系数不同,越靠近中心点变化越小,因此,在各颜色分量不同坐标的像素点的畸变系数是不同的,若采用统一的畸变系数进行补偿,无法实现对每个像素的畸变进行补偿,因此,需要分别计算出各像素点在各颜色分量的畸变系数,形成畸变系数的常数数组,也即,所述步骤S1中,所述a1、a2、a3为常数数组。By comparing Figure 2 and Figure 3, it can also be seen that the distortion coefficients of different pixels are different, and the closer to the center point, the smaller the change. Therefore, the distortion coefficients of pixels with different coordinates in each color component are different. If a uniform distortion coefficient is used Compensation cannot realize the compensation for the distortion of each pixel. Therefore, it is necessary to calculate the distortion coefficients of each pixel point in each color component separately to form a constant array of distortion coefficients, that is, in the step S1, the a1 , a2, a3 are constant arrays.

由于本方法最终适用于工业产品使用,无法像在实验室环境下可以逐个像素点测试畸变后的像高,因此,优选提前找出像高畸变前与畸变后像高的函数关系,所述畸变后像素点的RGB三种颜色分量的像高的计算方法为:Since this method is ultimately applicable to industrial products, it is impossible to test the distorted image height pixel by pixel in a laboratory environment. Therefore, it is preferable to find out the functional relationship between the image height before distortion and the distorted image height in advance, and the distortion The calculation method of the image height of the RGB three color components of the rear pixel is:

又进一步的,获得像素点(x1,y1)经过反转透镜后的RGB三种颜色分量的像高L,L′,L〞的步骤包括:Still further, the step of obtaining the image heights L, L', L" of the RGB three color components of the pixel point (x1, y1) after passing through the inversion lens includes:

根据所述反转透镜的光学参数模拟出所述反转透镜的物像对应关系;Simulating the object-image correspondence of the inversion lens according to the optical parameters of the inversion lens;

依据所述对应关系输出RGB三种颜色分量在物面坐标系中的原像高以及经过反转透镜后的新像高;Output the original image height of the RGB three color components in the object plane coordinate system and the new image height after the inversion lens according to the corresponding relationship;

依据RGB三种颜色分量的原像高l0和新像高L0、L0′、L0〞拟合出RGB三种颜色分量的新像高关于原像高的函数关系,即RGB三种颜色分量畸变前与畸变后像高的函数关系According to the original image height l 0 and the new image height L 0 , L 0 ′, L 0 of the RGB three color components, the functional relationship between the new image height of the RGB three color components and the original image height is fitted, that is, the RGB three color components Functional relationship between color component image height before distortion and after distortion

R:L0=f(l0);R: L 0 =f(l 0 );

G:L0′=f1(l0);G:L 0 ′=f 1 (l 0 );

B:L0″=f2(l0);B:L 0 ″=f 2 (l 0 );

依据所述物面坐标系中像素点(x1,y1)的像高以及所述函数关系,获得该像素点经过反转透镜后的RGB三种颜色分量的像高,分别为L=f(l),L′=f1(l),L〞=f2(l)。According to the image height of the pixel point (x1, y1) in the object plane coordinate system And the functional relationship, obtain the image height of the RGB three color components after the pixel passes through the inversion lens, which are respectively L=f(l), L'=f 1 (l), L"=f 2 (l ).

由于执行步骤S3时,对原图像的所有像素点进行补偿,因此各个像素点的坐标是确定的,因此,对于任一坐标为(x1,y1)的像素点,其像高为:所以通过上述函数公式可以很容易的计算出畸变后的像高,进而很容易计算出畸变系数。Since step S3 is performed, all pixels of the original image are compensated, so the coordinates of each pixel are determined. Therefore, for any pixel whose coordinates are (x 1 , y 1 ), its image height is: Therefore, the image height after distortion can be easily calculated through the above function formula, and then the distortion coefficient can be easily calculated.

本实施例给出了测得的其中一种目镜的函数关系,其中,L0=f(l0)曲线可参见图6(a)所示,L0′=f1(l0)曲线可参见图6(b)所示,L0″=f2(l0)曲线可参见图6(c)所示,上述三幅曲线图中,横轴表示畸变前的像高,纵轴表示畸变后的像高。利用畸变前像素点的像高l0计算畸变后像素点RGB三种颜色分量的像高L0、L0′、L0〞,再根据直角坐标关系,可分别计算出补偿后图像RGB三颜色分量的坐标值(x2,y2),(x2′,y2′),(x2〞,y2〞):This embodiment gives the measured functional relationship of one of the eyepieces, wherein, the curve of L 0 =f(l 0 ) can be seen in Figure 6(a), and the curve of L 0 ′=f 1 (l 0 ) can be See Figure 6(b), the L 0 ″=f 2 (l 0 ) curve can be seen in Figure 6(c), in the above three graphs, the horizontal axis represents the image height before distortion, and the vertical axis represents the distortion Image height after distortion. Use the image height l 0 of the pixel point before distortion to calculate the image height L 0 , L 0 ′, L 0 "of the RGB three color components of the pixel point after distortion, and then calculate the compensation according to the rectangular coordinate relationship Coordinate values (x 2 , y 2 ), (x 2 ′, y 2 ′), (x 2 ″, y 2 ″) of the RGB three-color components of the image after:

xx 22 == LL 00 ll 00 xx 11 ;; ythe y 22 == LL 00 ll 00 ythe y 11 ;;

xx 22 ′′ == LL 00 ′′ ll 00 xx 11 ;; ythe y 22 ′′ == LL 00 ′′ ll 00 ythe y 11 ;;

xx 22 ′′ ′′ == LL 00 ′′ ′′ ll 00 xx 11 ;; ythe y 22 ′′ ′′ == LL 00 ′′ ′′ ll 00 ythe y 11 ;;

由于该图像的畸变和色散值刚好与头戴显示器的目镜相反,将该图通过显示器显示,再透过头戴显示器的目镜观看时,畸变和色差都可以得到补偿,最终人眼看到的效果,是如图2中没有任何畸变的正常画面。Since the distortion and dispersion value of the image is just opposite to the eyepiece of the head-mounted display, the image is displayed on the display, and then viewed through the eyepiece of the head-mounted display, the distortion and chromatic aberration can be compensated, and the final effect seen by the human eye is, It is a normal picture without any distortion as shown in Figure 2.

若根据上述对应关系直接将原图像中(x1,y1)坐标点中的R、G、B值分别存入其对应坐标点(x2,y2),(x2′,y2′),(x2〞,y2〞)中,则在新的图像中可能会出现某些点没有原图的对应关系,体现在图像显示中,这些像素点缺少某种颜色分量,因此在所述步骤(3)中还包括填补遗漏点的步骤,对补偿图像中各像素点的RGB三种颜色分量分别进行查找,若出现部分像素点缺少X值,则对该像素点的X值进行填补,其中,X为RGB三种颜色分量的其中一种。补偿后的图像更加还原其真实色彩,避免了图像处理过程中丢失颜色分量的现象。If the R, G, and B values in the (x1, y1) coordinate point in the original image are directly stored in their corresponding coordinate points (x 2 , y 2 ), (x 2 ′, y 2 ′) according to the above corresponding relationship, (x 2 ″, y 2 ″), there may be some points in the new image that do not have the correspondence of the original image, which is reflected in the image display, these pixels lack a certain color component, so in the steps (3) also includes the step of filling the missing point, the RGB three color components of each pixel point in the compensation image are searched respectively, if some pixels lack the X value, then the X value of the pixel point is filled, wherein , X is one of the three color components of RGB. The compensated image restores its true color more, avoiding the phenomenon of losing color components in the process of image processing.

作为一个优选实施例,为了简化计算方法,提高计算速度,本实施例中优选采用平均值法,也即,对X值进行填补的方法为:将该像素点至少两个相邻点对应的X值进行求平均计算,并将计算结果填补作为该像素点的X值。As a preferred embodiment, in order to simplify the calculation method and improve the calculation speed, the average value method is preferably used in this embodiment, that is, the method of filling the X value is: the X corresponding to at least two adjacent points of the pixel point Values are averaged, and the calculation result is filled as the X value of the pixel.

同样道理的,若根据上述对应关系直接将原图像中(x1,y1)坐标点中的R、G、B值分别存入其对应坐标点(x2,y2),(x2′,y2′),(x2〞,y2〞)中,则在新的图像中可能会出现某些像素点的其中一种颜色分量具有多个值,也即出现了重叠点,为了不影响显示,在所述步骤(3)中,得到所述各像素点畸变后的RGB三种颜色分量之后,形成补偿图像之前,还包括针对重叠点进行处理的步骤,对得到的各像素点畸变后的RGB三种颜色分量分别进行查找,若出现部分像素点其中一种颜色分量具有多个值,则将该多个值处理成一个值。In the same way, if the R, G, and B values in the (x1, y1) coordinate point in the original image are directly stored in the corresponding coordinate point (x 2 , y 2 ), (x 2 ′, y 2 ′), (x 2 ″, y 2 ″), then in the new image, one of the color components of some pixels may have multiple values, that is, overlapping points appear, in order not to affect the display , in the step (3), after obtaining the RGB three color components after the distortion of each pixel, before forming the compensated image, it also includes the step of processing the overlapping points, and distorting the obtained pixels The three color components of RGB are searched separately. If there are some pixels where one of the color components has multiple values, the multiple values are processed into one value.

同样作为一个优选实施例,为了简化计算方法,提高计算速度,本实施例中优选采用平均值法,也即,所述的针对重叠点进行处理的方法为,将所述的多个值进行求平均值计算。通过将多个重叠点处理成一个点,可以防止显示输出程序出错,使其输出每幅图像都具有唯一对应的值。Also as a preferred embodiment, in order to simplify the calculation method and increase the calculation speed, the average value method is preferably used in this embodiment, that is, the method for processing overlapping points is to calculate the multiple values Average calculation. By processing multiple overlapping points into one point, errors in the display output program can be prevented, so that each image output has a unique corresponding value.

实施例二,基于实施例一中的一种具有光学透镜和显示屏的图像显示方法,本实施例提供了一种图像显示方法的显示系统,如图8和9所示,包括光学透镜102,设置于光学透镜102前的显示屏101以及连接所述显示屏101的图像调整模块103,所述图像调整模块103包括:Embodiment 2, based on an image display method with an optical lens and a display screen in Embodiment 1, this embodiment provides a display system for an image display method, as shown in FIGS. 8 and 9 , including an optical lens 102, The display screen 101 arranged in front of the optical lens 102 and the image adjustment module 103 connected to the display screen 101, the image adjustment module 103 includes:

虚拟反转透镜单元,用于根据所述光学透镜的光学参数虚拟地反转所述光学透镜,得到一个虚拟的反转透镜,所述反转透镜的物像与所述光学透镜的物像是反转的;A virtual inversion lens unit, configured to virtually invert the optical lens according to the optical parameters of the optical lens to obtain a virtual inversion lens, the object image of the inversion lens is the same as the object image of the optical lens reversed;

畸变系数计算单元,用于根据反转透镜的光学参数分别计算出RGB三种颜色分量经过所述反转透镜后的畸变系数,为a1、a2、a3;A distortion coefficient calculation unit, which is used to calculate the distortion coefficients of the RGB three color components after passing through the inversion lens according to the optical parameters of the inversion lens, which are a1, a2, and a3;

图像调整单元,用于接收预显示图像,将所述预显示图像各像素点分别进行放大a1、a2、a3倍的处理,得到所述各像素点畸变后的RGB三种颜色分量,形成补偿图像,输出至所述显示屏。The image adjustment unit is used to receive the pre-display image, and respectively amplify each pixel of the pre-display image by a1, a2, and a3 times to obtain distorted RGB three color components of each pixel to form a compensation image , output to the display screen.

由于对图像的补偿与该图像经过光学透镜102时的畸变和色散相反,因此,如图9所示,补偿图像经过光学透镜102后,畸变和色差都可以得到补偿,最终人眼看到的效果,是如图9中没有任何畸变和色差的正常画面。Since the compensation for the image is opposite to the distortion and dispersion when the image passes through the optical lens 102, as shown in FIG. It is a normal picture without any distortion and chromatic aberration as shown in Figure 9.

进一步的,所述图像调整单元还用于在将所述补偿图像输出至所述显示屏之前对补偿图像中各像素点的RGB三种颜色分量分别进行查找,填补遗漏的RGB三种颜色分量;和/或,Further, the image adjustment unit is further configured to search for the RGB three color components of each pixel in the compensated image before outputting the compensated image to the display screen, and fill in the missing RGB three color components; and / or,

所述图像调整单元还用于在得到所述各像素点畸变后的RGB三种颜色分量之后,形成补偿图像之前,对得到的各像素点畸变后的RGB三种颜色分量分别进行查找,对重叠点进行处理。通过本实施例的填补遗漏的RGB三种颜色分量以及对重叠点进行处理,补偿后的图像更加还原其真实色彩,避免了图像处理过程中丢失颜色分量的现象。The image adjustment unit is also used to search the obtained RGB three color components after each pixel distortion after obtaining the RGB three color components after each pixel distortion and before forming the compensation image, and to search for the overlapping RGB three color components respectively. Click to process. By filling the missing RGB three color components and processing overlapping points in this embodiment, the compensated image can more restore its true color, avoiding the loss of color components during image processing.

本系统也可应用在头戴显示器等近眼显示设备中,但本发明的保护范围不限定本系统的应用环境。This system can also be applied to near-eye display devices such as head-mounted displays, but the protection scope of the present invention does not limit the application environment of this system.

当然,上述说明并非是对本发明的限制,本发明也并不仅限于上述举例,本技术领域的普通技术人员在本发明的实质范围内所做出的变化、改型、添加或替换,也应属于本发明的保护范围。Of course, the above descriptions are not intended to limit the present invention, and the present invention is not limited to the above examples. Changes, modifications, additions or substitutions made by those skilled in the art within the scope of the present invention shall also belong to protection scope of the present invention.

Claims (10)

1. there is a method for displaying image for optical lens and display screen, it is characterized in that, comprise the following steps:
(1), according to the optical parametric of described optical lens reverse described optical lens virtually, and obtain a virtual counter-rotating lens, the image of described counter-rotating lens and the image of described optical lens reverse;
(2), according to the optical parametric of counter-rotating lens calculating the distortion factor of RGB tri-kinds of color components after described counter-rotating lens respectively, is a1, a2, a3;
(3), by each pixel of a pre-display image carry out respectively amplifying a1, a2, a3 process doubly, obtain the RGB tri-kinds of color components after described each pixel distortion, formed and compensate image;
(4), after described compensation image exports described display screen display to, normal picture is shown as through described optical lens.
2. method for displaying image according to claim 1, is characterized in that, in step (2), the computing method of distortion factor are:
Set up the image object plane coordinate system before a counter-rotating lens, wherein, in object plane coordinate system, the image height l of pixel (x1, y1) is the distance of this pixel to coordinate system central point,
The image height obtaining the RGB tri-kind color components of this pixel after counter-rotating lens is respectively L, L ', L 〞;
Then the distortion factor of RGB tri-kinds of color components after described counter-rotating lens is:
R : a 1 = L l ;
G : a 2 = L ′ l ;
B : a 3 = L ′ ′ l .
3. method for displaying image according to claim 2, is characterized in that, in step (2), the distortion factor of different pixels point is different, and described a1, a2, a3 are constant array.
4. method for displaying image according to claim 2, is characterized in that, obtain the image height L of pixel (x1, y1) the RGB tri-kinds of color components after counter-rotating lens, the step of L ', L 〞 comprises:
The image corresponding relation of described counter-rotating lens is simulated according to the optical parametric of described counter-rotating lens;
High and the new image height after counter-rotating lens of the preimage of RGB tri-kinds of color components in object plane coordinate system is exported according to described corresponding relation;
According to the preimage height l of RGB tri-kinds of color components 0with new image height L 0, L 0', L 0the new image height that 〞 simulates RGB tri-kinds of color components about the high funtcional relationship of preimage, namely before RGB tri-kinds of color components distortion with distortion after the funtcional relationship of image height
R:L 0=f(l 0);
G:L 0′=f 1(l 0);
B:L 0〞=f 2(l 0);
According to the image height of pixel (x1, y1) in described object plane coordinate system and described funtcional relationship, obtain the image height of the RGB tri-kind color components of this pixel after counter-rotating lens, be respectively L=f (l), L '=f 1(l), L 〞=f 2(l).
5. the method for displaying image according to any one of claim 1-4 claim, it is characterized in that, the step also comprising before compensating image and fill up and omit point is formed in step (3), the RGB tri-kinds of color components compensating each pixel in image are searched respectively, if occur, partial pixel point lacks X value, then fill up the X value of this pixel, wherein, X is the wherein a kind of of RGB tri-kinds of color components.
6. method for displaying image according to claim 5, it is characterized in that, to the method that X value is filled up be: the X value corresponding with at least two pixels of this pixel phase neighbour is averaging calculating, and the result being averaging calculating is filled up the X value into this pixel.
7. the method for displaying image according to any one of claim 1-4 claim, it is characterized in that, in step (3), after obtaining the RGB tri-kinds of color components after described each pixel distortion, formed and compensate before image, also comprise and carry out for overlap point the step that processes, the RGB tri-kinds of color components after each pixel distortion obtained are searched respectively, if occur partial pixel point wherein a kind of color component there is multiple value, then the plurality of value is processed into a value.
8. method for displaying image according to claim 7, is characterized in that, the described method carrying out processing for overlap point is that described multiple values are carried out calculating of averaging.
9. the display system of the method for displaying image of an application rights requirement according to any one of 1 to 8, it is characterized in that, comprise optical lens, be arranged at the display screen before optical lens and connect the image adjustment module of described display screen, described image adjustment module comprises:
Virtual counter-rotating lens unit, for the described optical lens that reverses virtually according to the optical parametric of described optical lens, obtain a virtual counter-rotating lens, the image of described counter-rotating lens and the image of described optical lens reverse;
Distortion factor computing unit, for calculating the distortion factor of RGB tri-kinds of color components after described counter-rotating lens respectively according to the optical parametric of counter-rotating lens, is a1, a2, a3;
Image control unit, for receiving pre-display image, carries out each pixel of described pre-display image amplifying a1, a2, a3 process doubly respectively, obtains the RGB tri-kinds of color components after described each pixel distortion, is formed and compensate image, export described display screen to.
10. display system as claimed in claim 9, it is characterized in that, described image control unit also for searching respectively the RGB tri-kinds of color components compensating each pixel in image before exporting described compensation image to described display screen, fills up RGB tri-kinds of color components of omission; And/or,
Described image control unit also for after the RGB tri-kinds of color components after obtaining described each pixel distortion, is formed before compensating image, searches respectively, process overlap point the RGB tri-kinds of color components after each pixel distortion obtained.
CN201410275482.1A 2014-06-19 2014-06-19 Display system with optical lens and display screen and image display method thereof Active CN104020565B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410275482.1A CN104020565B (en) 2014-06-19 2014-06-19 Display system with optical lens and display screen and image display method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410275482.1A CN104020565B (en) 2014-06-19 2014-06-19 Display system with optical lens and display screen and image display method thereof

Publications (2)

Publication Number Publication Date
CN104020565A CN104020565A (en) 2014-09-03
CN104020565B true CN104020565B (en) 2016-03-23

Family

ID=51437412

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410275482.1A Active CN104020565B (en) 2014-06-19 2014-06-19 Display system with optical lens and display screen and image display method thereof

Country Status (1)

Country Link
CN (1) CN104020565B (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105979252A (en) * 2015-12-03 2016-09-28 乐视致新电子科技(天津)有限公司 Test method and device
CN106127714B (en) * 2016-07-01 2019-08-20 南京睿悦信息技术有限公司 A kind of measurement method of virtual reality head-mounted display equipment distortion parameter
JP6762807B2 (en) * 2016-08-30 2020-09-30 マクセル株式会社 Information display device
CN106791754B (en) * 2016-12-22 2018-08-21 歌尔科技有限公司 A kind of equipment chromatic aberration correction method and system
CN107219629B (en) 2017-07-14 2021-01-08 惠州Tcl移动通信有限公司 Method, storage medium and device for preventing VR device dispersion by RGB superposition
CN113222862B (en) * 2021-06-04 2024-09-17 黑芝麻智能科技(上海)有限公司 Image distortion correction method, device, electronic equipment and storage medium
CN113920076B (en) * 2021-09-29 2025-07-18 武汉精立电子技术有限公司 VR module detection method and device

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5604630A (en) * 1995-06-30 1997-02-18 Itt Corporation Night vision monocular with balanced optics
US5914818A (en) * 1996-11-29 1999-06-22 Texas Instruments Incorporated Offset projection lens for use with reflective spatial light modulators
CN2718608Y (en) * 2004-07-28 2005-08-17 刘琳 Stereo-glasses for virtual cinema
CN103018907A (en) * 2012-12-19 2013-04-03 虢登科 Display method and head-mounted display

Also Published As

Publication number Publication date
CN104020565A (en) 2014-09-03

Similar Documents

Publication Publication Date Title
CN104020565B (en) Display system with optical lens and display screen and image display method thereof
CN111476104B (en) AR-HUD image distortion correction method, device and system under dynamic eye position
US11854171B2 (en) Compensation for deformation in head mounted display systems
CN107071382B (en) Stereoscopic image display device
CN103026367B (en) For rendering system and method for the display to compensate the vision impairment of beholder
WO2016115849A1 (en) Image brightness adjustment method and adjustment device, and display device
US20110122144A1 (en) Automatically Adaptive Display Eliminating Need For Vision Correction Aids
WO2019184251A1 (en) Rendering method, computer product and display apparatus
CN105825840B (en) A kind of optical compensation method, optical compensating member and display panel
US12265224B2 (en) Near eye display apparatus
CN103237227B (en) Method for reducing crosstalk of stereoscopic image and display system thereof
CN102053367B (en) Image calibration method for binocular helmet display
CN111061373A (en) Eyeball tracking calibration method and device and wearable equipment
CN105404011A (en) 3D image correction method of head up display and head up display
US20110084966A1 (en) Method for forming three-dimension images and related display module
WO2021227969A1 (en) Data processing method and device thereof
US10672110B2 (en) Information processing system, information processing apparatus, output apparatus, program, and recording medium
CN105979252A (en) Test method and device
CN103559688B (en) distortion correction method based on wavefront image compensation
CN110035273A (en) A kind of distortion correction method, device and the display equipment using it
US11521297B2 (en) Method and device for presenting AR information based on video communication technology
CN102508405A (en) Direct passive stereo realization device for cubic screen and correction method for image
US20040179271A1 (en) Electronic correction device for optical distortions in a collimated imaging obtained from a matrix display
CN118714277B (en) 3D (three-dimensional) calibration effect evaluation method of 3D camera and computer storage medium
TWI520570B (en) Image processing method for stereoscopic images

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20201010

Address after: 261031 north of Yuqing street, east of Dongming Road, high tech Zone, Weifang City, Shandong Province (Room 502, Geer electronic office building)

Patentee after: GoerTek Optical Technology Co.,Ltd.

Address before: International Exhibition Center of wealth 18 No. 266061 Shandong province Qingdao city Laoshan District Qinling Mountains Road No. 3 Building 4 layer 401-436

Patentee before: Qingdao GoerTek Technology Co.,Ltd.