CN107333122B - A projection type multi-picture stereoscopic display and playback system and method - Google Patents
A projection type multi-picture stereoscopic display and playback system and method Download PDFInfo
- Publication number
- CN107333122B CN107333122B CN201710502102.7A CN201710502102A CN107333122B CN 107333122 B CN107333122 B CN 107333122B CN 201710502102 A CN201710502102 A CN 201710502102A CN 107333122 B CN107333122 B CN 107333122B
- Authority
- CN
- China
- Prior art keywords
- projection
- picture
- group
- video
- stereoscopic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B35/00—Stereoscopic photography
- G03B35/18—Stereoscopic photography by simultaneous viewing
- G03B35/20—Stereoscopic photography by simultaneous viewing using two or more projectors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/243—Image signal generators using stereoscopic image cameras using three or more 2D image sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/324—Colour aspects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/327—Calibration thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N2013/40—Privacy aspects, i.e. devices showing different images to different viewers, the images not being viewpoints of the same scene
- H04N2013/405—Privacy aspects, i.e. devices showing different images to different viewers, the images not being viewpoints of the same scene the images being stereoscopic or three dimensional
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
本发明公开了一种投影式多画立体显示播放系统及方法,包括多画投影阵列、基于GPU的实时混编‑拼接‑渲染模块与多画面立体眼镜,其中,所述多画投影阵列包括多组投影组合,每组投影组合播放多路独立的立体视频流,基于GPU的实时混编‑拼接‑渲染模块将每组的多路立体视频进行实时渲染、混合编码和校正,将生成的多路立体视频流连接至每组投影组合上进行投影播放,控制所述多画面立体眼镜的液晶镜片开闭时序,使其与多路立体视频流相对应,能够独立收看多路立体视频流,实现多组投影形成多人多画面立体播放。
The invention discloses a projection-type multi-picture stereoscopic display and playback system and method, including a multi-picture projection array, a GPU-based real-time mixing-splicing-rendering module and multi-picture stereo glasses, wherein the multi-picture projection array includes a multi-picture projection array. Group projection combination, each group of projection combination plays multiple independent stereo video streams, and the GPU-based real-time mixing-splicing-rendering module performs real-time rendering, mixing encoding and correction of the multi-channel stereoscopic video of each group. The stereoscopic video stream is connected to each group of projection combination for projection and playback, and the opening and closing sequence of the liquid crystal lens of the multi-screen stereoscopic glasses is controlled so that it corresponds to the multi-channel stereoscopic video stream, and the multi-channel stereoscopic video stream can be viewed independently. Group projection forms multi-person multi-screen stereo playback.
Description
技术领域technical field
本发明涉及一种投影式多画立体显示播放系统及方法。The invention relates to a projection type multi-picture stereoscopic display and playback system and method.
背景技术Background technique
立体影像是当今影视作品及虚拟现实内容中常见的一直播放显示形式,可以使观众产生一种强烈的身临其境的感受。而通过人机交互与意图理解,又可以使立体视频内容能够按照用户的移动方位进行实时渲染,产生符合用户移动视角的立体视觉效果,让用户感到自己就是主角,很大程度上增强了用户的存在感与沉浸感。Stereoscopic image is a common form of always-playing display in today's film and television works and virtual reality content, which can make the audience feel a strong immersive experience. Through human-computer interaction and intention understanding, the stereoscopic video content can be rendered in real time according to the user's moving position, resulting in a stereoscopic visual effect that conforms to the user's moving perspective, making the user feel that he is the protagonist, and greatly enhancing the user's experience. Presence and immersion.
但是目前在电影、电视中使用3D立体显示播放技术都是基于单一视点绘制的,当多组用户同时观看并与系统交互时,屏幕区域中只能播放和显示一组固定视点的立体影像,无法使群体用户同时产生真实的沉浸感觉。However, at present, the 3D stereoscopic display and playback technology used in movies and TV are all drawn based on a single viewpoint. When multiple groups of users watch and interact with the system at the same time, only a set of stereoscopic images with a fixed viewpoint can be played and displayed in the screen area. Make group users have a real sense of immersion at the same time.
发明内容SUMMARY OF THE INVENTION
本发明为了解决上述问题,提出了一种投影式多画立体显示播放系统及方法,本发明通过投影仪阵列在同一屏幕区域中同时投影播放多组不同的立体视频,而处于不同组别、不同视角的用户通过佩戴特制的快门式液晶立体眼镜,可以独立收看自己的专属对应的一组立体视频,具有简单、方便、易操作、沉浸感强等优点,可以与相关的体感人机交互技术进行组合,实现各类多人多画的交互式虚拟现实系统。In order to solve the above problems, the present invention proposes a projection-type multi-picture stereoscopic display and playback system and method. The present invention simultaneously projects and plays multiple groups of different stereoscopic videos in the same screen area through a projector array, which are in different groups, different By wearing special shutter-type liquid crystal stereo glasses, users with a viewing angle can independently watch their own set of corresponding stereoscopic videos, which are simple, convenient, easy to operate, and have a strong sense of immersion. Combination to realize various types of interactive virtual reality systems with multiple people and multiple paintings.
为了实现上述目的,本发明采用如下技术方案:In order to achieve the above object, the present invention adopts the following technical solutions:
一种投影式多画立体显示播放系统,包括多画投影阵列、基于GPU的实时混编-拼接-渲染模块与多画面立体眼镜,其中,所述多画投影阵列包括多组投影组合,每组投影组合播放多路独立的立体视频流,基于GPU的实时混编-拼接-渲染模块将每组的多路立体视频进行实时渲染、混合编码和校正,将生成的多路立体视频流连接至每组投影组合上进行投影播放,控制所述多画面立体眼镜的液晶镜片开闭时序,使其与多路立体视频流相对应,能够独立收看多路立体视频流,实现多组投影形成多人多画面立体播放。A projection type multi-picture stereoscopic display and playback system includes a multi-picture projection array, a GPU-based real-time mixing-splicing-rendering module and multi-picture stereo glasses, wherein the multi-picture projection array includes multiple sets of projection combinations, each The projection combination plays multiple independent stereo video streams, and the GPU-based real-time mixing-splicing-rendering module performs real-time rendering, mixing coding and correction for each group of multi-channel stereo videos, and connects the generated multi-channel stereo video streams to each Projection and playback are performed on the group projection combination, and the opening and closing sequence of the liquid crystal lens of the multi-screen stereo glasses is controlled to correspond to the multi-channel stereo video streams, and the multi-channel stereo video streams can be watched independently, and the formation of multiple groups of projections to form multiple Stereoscopic playback of the screen.
所述多画投影阵列与多画面立体眼镜之间设置有水平偏振片与垂直偏振片。A horizontal polarizer and a vertical polarizer are arranged between the multi-picture projection array and the multi-picture stereo glasses.
优选的,将3台投影仪编为一组,在第一个投影时段中,使3台投影仪分别投射出第一路立体视频图像的R、G、B三个位面图像,形成完整的彩色图像,而在第二个投影时段及第三个投影时段中,使3台投影仪分别投射出第二路及第三路立体视频图像的R、G、B三个位面图像,使得在三个不同的投影时段中,屏幕上依次唯一地显示出三路不同的视频图像,实现三路立体视频的独立分时播放。Preferably, three projectors are grouped into a group, and in the first projection period, the three projectors are made to project three plane images of R, G, and B of the first stereoscopic video image respectively to form a complete color images, and in the second projection period and the third projection period, the three projectors are made to project the R, G, B three-dimensional images of the second and third stereoscopic video images respectively, so that in the In three different projection periods, three different video images are uniquely displayed on the screen in sequence, so as to realize the independent time-sharing playback of the three-way stereoscopic video.
进一步的,为实现上述功能,将每组的投影组合的第一台投影仪的色轮保持固有RGB顺序不变,第二台投影仪的色轮改造为BRG顺序,第三台投影仪的色轮改造为GBR顺序。Further, in order to realize the above functions, the color wheel of the first projector of each group of projection combination keeps the original RGB order unchanged, the color wheel of the second projector is transformed into BRG order, and the color wheel of the third projector is in BRG order. Wheels are retrofitted to GBR order.
在多画投影阵列的安装时,采用垂直排列布局,将阵列中的各个立体投影仪按照上中下顺序摆置,并调整每组投影的位置,保证每组投影组合的各个投影仪的投影画面区域大致重合。During the installation of the multi-projection array, a vertical arrangement is adopted, the three-dimensional projectors in the array are placed in the upper, middle and lower order, and the position of each group of projections is adjusted to ensure the projection images of each projector in each group of projection combinations. The regions roughly coincide.
所述基于GPU的实时混编-拼接-渲染模块通过设置多组虚拟立体相机来获取多路立体视频,其中每一组虚拟立体相机中包含左、右两个虚拟相机,用于获取对应用户的左、右眼图像。The GPU-based real-time mixing-splicing-rendering module obtains multi-channel stereo video by setting multiple groups of virtual stereo cameras, wherein each group of virtual stereo cameras includes two virtual cameras, left and right, for obtaining the corresponding user's data. Left and right eye images.
所述基于GPU的实时混编-拼接-渲染模块将多路独立立体视频的R、G、B位面图像进行混编组合,成为新的立体视频,以保证通过每组投影组合的各个投影仪组合播放多路立体视频。The GPU-based real-time mixing-splicing-rendering module mixes and combines the R, G, and B plane images of the multi-channel independent stereoscopic video to become a new stereoscopic video, so as to ensure that each projector combined by each group of projections is combined. Combined playback of multi-channel stereoscopic video.
所述基于GPU的实时混编-拼接-渲染模块,对每组投影组合的各个投影仪进行几何投影拼接校正,保证各个投影仪的投影画面达到像素重合,从而在屏幕上拼接为正确的立体视频影像。The GPU-based real-time mixing-splicing-rendering module performs geometric projection splicing correction on each projector in each group of projection combinations to ensure that the projection images of each projector achieve pixel coincidence, thereby splicing a correct stereoscopic video on the screen image.
所述多画面立体眼镜对应每组投影组合的组别区分不同类型的立体眼镜,以正确收看对应组别的立体视频,同时屏蔽掉其他的视频流。The multi-screen stereoscopic glasses correspond to each group of projection combinations to distinguish different types of stereoscopic glasses, so as to correctly watch the stereoscopic video of the corresponding group, and at the same time block other video streams.
所述多画面立体眼镜缩短液晶镜片的开启时间,由原先持续多个投影时段的开启时间缩短为1个投影时段,同时要根据眼镜类型及对应的视频序号,控制液晶镜片的开闭时序,由传统的等占空比开闭时序,变为不等占空比开闭时序,保证多画面立体眼镜的液晶镜片的开/闭时序与相应组别立体视频的播放时序相同步,从而收看到对应的立体视频流。The multi-screen stereo glasses shorten the opening time of the liquid crystal lens from the original opening time that lasts for multiple projection periods to one projection period. At the same time, the opening and closing sequence of the liquid crystal lens should be controlled according to the type of glasses and the corresponding video serial number. The traditional equal duty cycle opening and closing sequence has been changed into an unequal duty cycle opening and closing sequence, which ensures that the opening/closing sequence of the liquid crystal lens of the multi-screen stereo glasses is synchronized with the playback sequence of the corresponding group of stereo videos, so that you can watch the corresponding stereoscopic video stream.
多画面立体眼镜的镜片开闭周期的占空比不相等。The duty ratios of the lens opening and closing cycles of the multi-view stereo glasses are not equal.
基于上述系统的实现方法,将多组投影组合形成多画投影阵列,每组投影组合播放多路独立的立体视频流,利用基于GPU的实时混编-拼接-渲染模块将每组的多路立体视频进行实时渲染、混合编码和校正,将生成的多路立体视频流连接至每组投影组合上进行投影播放,控制多画面立体眼镜的液晶镜片开闭时序,使其与多路立体视频流相对应,能够独立收看多路立体视频流,实现多组投影形成多人多画面立体播放。Based on the implementation method of the above system, multiple groups of projections are combined to form a multi-picture projection array, each group of projections is combined to play multiple independent stereo video streams, and the The video is rendered in real time, mixed with encoding and correction, and the generated multi-channel stereo video stream is connected to each group of projection combinations for projection playback, and the opening and closing timing of the LCD lens of the multi-screen stereo glasses is controlled to match the multi-channel stereo video stream. Correspondingly, it is possible to independently watch multi-channel stereo video streams, and realize multi-group projection to form multi-person multi-screen stereo playback.
与现有技术相比,本发明的有益效果为:Compared with the prior art, the beneficial effects of the present invention are:
(1)本发明能够实现多人多画立体显示播放功能,具有简单、方便、易操作、沉浸感强等优点,可以与相关的体感人机交互技术进行组合,实现各类多人多画的交互式虚拟现实系统;(1) The present invention can realize the multi-person multi-picture stereoscopic display and playback function, and has the advantages of simplicity, convenience, easy operation, strong immersion, etc. Interactive virtual reality system;
(2)本发明通过投影仪阵列在同一屏幕区域中同时投影播放多组不同的立体视频,而处于不同组别、不同视角的用户通过佩戴特制的快门式液晶立体眼镜,可以独立收看自己的专属对应的一组立体视频;(2) The present invention simultaneously projects and plays multiple groups of different stereoscopic videos in the same screen area through a projector array, and users in different groups and different viewing angles can independently watch their own exclusive glasses by wearing special shutter-type liquid crystal stereoscopic glasses. A corresponding set of stereoscopic videos;
(3)以本发明提出的多画显示播放系统为基础,可以通过设计和配置各类体感交互技术,实现多人多画交互式影院及虚拟现实系统,可以使群体用户同时产生真实的沉浸感觉。(3) Based on the multi-picture display and playback system proposed by the present invention, various somatosensory interaction technologies can be designed and configured to realize multi-person multi-picture interactive theater and virtual reality system, which can make group users produce a real immersive feeling at the same time .
附图说明Description of drawings
构成本申请的一部分的说明书附图用来提供对本申请的进一步理解,本申请的示意性实施例及其说明用于解释本申请,并不构成对本申请的不当限定。The accompanying drawings that form a part of the present application are used to provide further understanding of the present application, and the schematic embodiments and descriptions of the present application are used to explain the present application and do not constitute improper limitations on the present application.
图1为多画立体显示播放系统的总体结构图;Fig. 1 is the overall structure diagram of multi-picture stereoscopic display and playback system;
图2为专用多画立体投影仪的色轮器件;Figure 2 is a color wheel device of a dedicated multi-picture stereo projector;
图3为普通DLP立体投影仪的播放时序示意图;3 is a schematic diagram of a playback sequence of a common DLP stereo projector;
图4为专用多画立体投影仪的播放时序示意图;4 is a schematic diagram of a playback sequence of a dedicated multi-picture stereo projector;
图5多画立体显示播放系统的实时渲染模块功能流程图;Fig. 5 is a functional flow chart of the real-time rendering module of the multi-picture stereoscopic display and playback system;
图6为专用多画立体液晶眼镜开闭时序示意图。FIG. 6 is a schematic diagram showing the opening and closing timing of the dedicated multi-image stereoscopic liquid crystal glasses.
具体实施方式:Detailed ways:
下面结合附图与实施例对本发明作进一步说明。The present invention will be further described below with reference to the accompanying drawings and embodiments.
应该指出,以下详细说明都是例示性的,旨在对本申请提供进一步的说明。除非另有指明,本文使用的所有技术和科学术语具有与本申请所属技术领域的普通技术人员通常理解的相同含义。It should be noted that the following detailed description is exemplary and intended to provide further explanation of the application. Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs.
需要注意的是,这里所使用的术语仅是为了描述具体实施方式,而非意图限制根据本申请的示例性实施方式。如在这里所使用的,除非上下文另外明确指出,否则单数形式也意图包括复数形式,此外,还应当理解的是,当在本说明书中使用术语“包含”和/或“包括”时,其指明存在特征、步骤、操作、器件、组件和/或它们的组合。It should be noted that the terminology used herein is for the purpose of describing specific embodiments only, and is not intended to limit the exemplary embodiments according to the present application. As used herein, unless the context clearly dictates otherwise, the singular is intended to include the plural as well, furthermore, it is to be understood that when the terms "comprising" and/or "including" are used in this specification, it indicates that There are features, steps, operations, devices, components and/or combinations thereof.
正如背景技术所介绍的,现有技术中目前在电影、电视中使用3D立体显示播放技术都是基于单一视点绘制的,当多组用户同时观看并与系统交互时,屏幕区域中只能播放和显示一组固定视点的立体影像,无法使群体用户同时产生真实的沉浸感觉的不足,为了解决如上的技术问题,本申请提出了一种投影式多画面立体显示播放系统的设计与实现方法,可在同一屏幕区域内同时为6组不同用户播放6路不同的立体视频,用户按组别可独立收看到对应的立体影像。该系统可与体感人机交互设备配套组合成各类多人多画的交互式虚拟现实系统。As described in the background art, the 3D stereoscopic display and playback technology currently used in movies and TVs in the prior art are all drawn based on a single point of view. When multiple groups of users watch and interact with the system at the same time, only the Displaying a group of stereoscopic images with fixed viewpoints cannot make group users feel real immersive at the same time. In order to solve the above technical problems, the present application proposes a design and implementation method of a projection type multi-screen stereoscopic display and playback system, which can In the same screen area, 6 different stereoscopic videos are played for 6 groups of different users at the same time, and users can watch the corresponding stereoscopic images independently by group. The system can be combined with somatosensory human-computer interaction equipment to form a variety of interactive virtual reality systems with multiple people and multiple paintings.
本发明设计了一种投影式6人6画立体显示系统,通过投影仪阵列在同一屏幕区域中同时投影播放6组不同的立体视频,而处于不同组别、不同视角的用户通过佩戴特制的快门式液晶立体眼镜,可以独立收看自己的专属对应的一组立体视频。以本发明提出的多画显示播放系统为基础,可以通过设计和配置各类体感交互技术,实现多人多画交互式影院及虚拟现实系统。本发明首先对投影仪结构与投影顺序进行重新设计,形成专用多画投影阵列,再设计实现基于GPU的实时混编-拼接-渲染模块,用于将各组独立的视频流转换为多画视频流格式,最后对快门式液晶立体眼镜的控制电路进行重新设计,实现按组别观看多画立体视频,这三部分设计组合而成多画立体显示播放系统。The present invention designs a projection-type 6-person 6-picture stereoscopic display system, in which 6 groups of different stereoscopic videos are simultaneously projected and played in the same screen area through a projector array, and users in different groups and different viewing angles wear special shutters. Type LCD stereoscopic glasses, you can watch your own exclusive corresponding set of stereoscopic videos independently. Based on the multi-picture display and playback system proposed by the present invention, a multi-person multi-picture interactive cinema and virtual reality system can be realized by designing and configuring various somatosensory interaction technologies. The present invention firstly redesigns the projector structure and projection sequence to form a dedicated multi-picture projection array, and then designs and implements a GPU-based real-time mixing-splicing-rendering module for converting each group of independent video streams into multi-picture videos Finally, the control circuit of the shutter-type liquid crystal stereo glasses is redesigned to realize the viewing of multi-picture stereo video by group. These three parts are designed and combined to form a multi-picture stereo display and playback system.
本发明提出了一种投影式多画面立体显示播放系统与方法,实现6人6画立体显示播放功能,具有简单、方便、易操作、沉浸感强等优点,可以与相关的体感人机交互技术进行组合,实现各类多人多画的交互式虚拟现实系统。The present invention proposes a projection type multi-screen stereoscopic display and playback system and method, which realizes the function of 6-person 6-picture stereoscopic display and playback, and has the advantages of simplicity, convenience, easy operation, strong immersion and the like, and can be combined with related somatosensory human-computer interaction technology Combination to realize various types of interactive virtual reality systems with multiple people and multiple paintings.
本发明所提出的多画立体显示播放系统由三个模块组成:专用多画投影阵列、基于GPU的实时混编-拼接-渲染模块与专用多画面快门式立体眼镜设备。具体技术方案如下:The multi-picture stereoscopic display and playback system proposed by the present invention consists of three modules: a dedicated multi-picture projection array, a GPU-based real-time mixing-splicing-rendering module and a dedicated multi-picture shutter stereo glasses device. The specific technical solutions are as follows:
本发明提出的多人多画立体显示播放系统使用6台DLP型3D投影仪组成投影播放阵列,进行立体视频播放。首先实现3人3画播放功能,即6台投影仪按每3台为一组分为两组,通过对投影仪结构及播放模式的重新设计,使每一组中的3台投影仪组合投影播放出3路独立的立体视频流,而通过对快门式液晶立体眼镜控制时序进行重新设计,改变液晶镜片开闭时序,制作出3类专用多画快门立体眼镜,能够对应独立收看3路立体视频流,然后结合偏振立体模式,在两组投影仪及快门式立体眼镜前加挂水平偏振片与垂直偏振片,将两组3人3画面立体播放系统组合为6人6画面立体播放系统,系统结构图如图1所示。The multi-person multi-picture stereoscopic display and playback system proposed by the present invention uses 6 DLP-type 3D projectors to form a projection and playback array to perform stereoscopic video playback. First realize the 3-person 3-picture playback function, that is, 6 projectors are divided into two groups according to each group of 3, and through the redesign of the projector structure and playback mode, the 3 projectors in each group can be combined to project Playing out 3 independent stereoscopic video streams, and by redesigning the control sequence of the shutter-type liquid crystal stereoscopic glasses, changing the opening and closing timing of the liquid crystal lens, and producing 3 types of special multi-picture shutter stereoscopic glasses, which can watch 3-channel stereoscopic video independently. Then combined with the polarization stereo mode, a horizontal polarizer and a vertical polarizer were added in front of the two sets of projectors and shutter-type stereo glasses, and the two groups of 3-person 3-screen stereo playback systems were combined into a 6-person 6-screen stereo playback system. The structure diagram is shown in Figure 1.
本发明提出的多画立体显示播放系统的基本模块是实现3人3画立体显示,我们采用3台DLP型3D投影仪组成专用多画投影阵列,同时在GPU平台上将原有3路独立的立体视频流转换为专用的多画立体视频流格式,通过多画投影阵列组合地播放出3路独立立体视频,为实现此目的,就需要在硬件设备上对投影仪及快门式立体眼镜的结构、播放模式及控制时序进行重新设计。为了能够清楚地叙述设备的工作原理与流程,首先对现有DLP型3D投影仪的播放原理进行介绍,然后依次对多画立体显示系统的显示模块、实时渲染模块及主控模块的实现原理及设备组成进行叙述。The basic module of the multi-picture stereoscopic display and playback system proposed by the present invention is to realize 3-person 3-picture stereoscopic display. We use 3 DLP-type 3D projectors to form a dedicated multi-picture projection array. The stereoscopic video stream is converted into a dedicated multi-picture stereoscopic video stream format, and 3 independent stereoscopic videos are played through a combination of multi-picture projection arrays. , playback mode and control timing are redesigned. In order to clearly describe the working principle and process of the device, the playing principle of the existing DLP type 3D projector is firstly introduced, and then the realization principle of the display module, real-time rendering module and main control module of the multi-picture stereoscopic display system is introduced in turn. The composition of the equipment is described.
目前的数字投影技术主要分为DLP型与LCD型两类,前者是反射式投影,后者是透射式投影,DLP投影技术因其投影亮度高的优势,广泛用于大范围播放场合,如互动影院与交互娱乐设施。LCD投影仪通过调整数字微镜(DMD)的反射角度,对光源入射强度进行反射调制,按像素产生不同的明暗反射效果,形成投影影像的明暗变化。而在实现彩色影像投影时,DLP投影仪采用了三原色分时投影、合成播放的模式,其方式是在白色光源前面安装一个玻璃质圆形色轮,圆形色轮上按三原色顺序分成了红(R)-绿(G)-蓝(B)三个色段,用于对光源进行分色。色轮在电机驱动下高速旋转,当红(R)-绿(G)-蓝(B)三个色段依次旋转到白色光源前面时,光源依次变为红光-绿光-蓝光投射到数字微镜上,与此同时数字微镜根据数字图像红、绿、蓝三个位面值,对入射光进行反射调制,将数字图像的红(R)、绿(G)、蓝(B)三个位面依次投影到屏幕上,再通过视觉暂留现象在人的视觉系统中形成完整的彩色图像。The current digital projection technology is mainly divided into two types: DLP type and LCD type. The former is reflective projection and the latter is transmissive projection. DLP projection technology is widely used in large-scale playback occasions due to its high projection brightness. Cinema and interactive entertainment facilities. The LCD projector modulates the incident intensity of the light source by adjusting the reflection angle of the digital micromirror (DMD). When realizing color image projection, the DLP projector adopts the mode of time-sharing projection and composite playback of three primary colors. The method is to install a glass circular color wheel in front of the white light source, and the circular color wheel is divided into red in the order of the three primary colors. (R)-green (G)-blue (B) three color segments for color separation of light sources. The color wheel rotates at a high speed under the drive of the motor. When the three color segments of red (R)-green (G)-blue (B) rotate to the front of the white light source in turn, the light source becomes red light-green light-blue light in turn and projected to the digital micro. On the mirror, at the same time, the digital micromirror reflects and modulates the incident light according to the three bit plane values of red, green and blue of the digital image, and converts the three bits of red (R), green (G) and blue (B) of the digital image. The planes are projected onto the screen in turn, and then a complete color image is formed in the human visual system through the phenomenon of persistence of vision.
为了后面说明本发明中专用多画立体眼镜的工作原理,需要对DLP投影仪3D立体视频播放的技术原理进行叙述。当投影仪置于3D播放模式时,投影仪的图像刷新率为120Hz,即每秒钟播放120帧图像,其中含有左眼图像与右眼图像各60帧,按照左-右-左-右的顺序,即所谓帧序列格式投影到屏幕上,形成立体视频。而观众需要佩戴快门式立体眼镜来收看立体视频,快门立体眼镜的两个镜片由液晶镜片构成,左右眼的液晶镜片按照立体视频流的左右眼图像播放时序,同步地进行镜片的开闭控制,从而使观众产生立体视觉效果。在此过程中,重要的一点是实现液晶镜片的开闭时序与左右眼图像播放时序的同步,目前DLP型3D投影仪的光电立体同步基本采用TI公司的DLP-LINK标准,其原理是在每一帧图像投影结束之后,投影仪通过DMD芯片的反射,在屏幕上投射出一个亮度极高的瞬时光脉冲,由于脉冲持续时间极短,所以人眼无法感知,但通过光电二极管器件,可以将光脉冲信号转换为电脉冲信号,用作同步信号来控制液晶镜片的开闭时序,DLP型投影仪发出的立体同步光脉冲频率为120Hz,与投影仪的图像刷新率相同,而脉冲宽度约为2μs。屏幕上,再通过视觉暂留现象在人的视觉系统中合成为完整的彩色图像。In order to explain the working principle of the special multi-picture stereo glasses in the present invention later, it is necessary to describe the technical principle of the 3D stereo video playback of the DLP projector. When the projector is placed in 3D playback mode, the image refresh rate of the projector is 120Hz, that is, 120 frames of images are played per second, including 60 frames for the left eye image and 60 frames for the right eye image. Sequential, the so-called frame sequence format is projected onto the screen to form a stereoscopic video. The audience needs to wear shutter-type stereoscopic glasses to watch the stereoscopic video. The two lenses of the shutter stereoscopic glasses are composed of liquid crystal lenses. So that the audience has a stereoscopic visual effect. In this process, the important point is to realize the synchronization of the opening and closing timing of the liquid crystal lens and the image playback timing of the left and right eyes. At present, the photoelectric stereo synchronization of DLP type 3D projectors basically adopts the DLP-LINK standard of TI company. After the projection of a frame of image, the projector projects an instantaneous light pulse with extremely high brightness on the screen through the reflection of the DMD chip. Due to the extremely short duration of the pulse, the human eye cannot perceive it. The optical pulse signal is converted into an electrical pulse signal, which is used as a synchronization signal to control the opening and closing timing of the liquid crystal lens. The three-dimensional synchronization optical pulse frequency emitted by the DLP type projector is 120Hz, which is the same as the image refresh rate of the projector, and the pulse width is about 2μs. On the screen, it is synthesized into a complete color image in the human visual system through the phenomenon of persistence of vision.
下面分别说明多画立体显示播放系统中三个模块的设计方法:The following describes the design methods of the three modules in the multi-picture stereoscopic display and playback system:
(一)专用多画投影阵列的设计(1) Design of a dedicated multi-picture projection array
根据上述对DLP投影仪投影成像原理的介绍,单片DLP型投影仪对彩色图像的投影成像过程是分为3个时段进行的,配合着色轮的旋转周期,在每个时段中分别投影出数字影像的R、G、B三个位面图像,最终利用视觉暂离现象形成彩色图像。而基于DLP型投影仪的多画面显示原理就是根据这种分时投影、合成成像的过程,对投影仪的色轮结构与播放模式进行重新设计:将3台DLP型投影仪编为一组,在第一个投影时段中,使3台投影仪分别投射出第一路立体视频图像的R、G、B三个位面图像,形成完整的彩色图像,而在第二个投影时段及第三个投影时段中,使3台投影仪分别投射出第二路及第三路立体视频图像的R、G、B三个位面图像,这样就使得在三个不同的投影时段中,屏幕上依次唯一地显示出三路不同的视频图像,实现了三路立体视频的独立分时播放。在这种播放模式下,虽然每一路视频图像的投影成像时间由三个时段缩短为一个时段,但三台投影仪同时投射却使单位时间内的投影光强增加,抵消了投影时间变短,使每一路视频仍能基本保证原始亮度。According to the above introduction to the projection imaging principle of the DLP projector, the projection imaging process of the color image by the single-chip DLP type projector is divided into 3 time periods. In accordance with the rotation period of the color wheel, digital images are projected in each time period. The three plane images of R, G and B of the image are finally used to form a color image by the phenomenon of visual temporal detachment. The multi-screen display principle based on the DLP projector is to redesign the color wheel structure and playback mode of the projector according to the process of time-sharing projection and composite imaging: 3 DLP projectors are grouped into a group, In the first projection period, three projectors are made to project the R, G, and B three-dimensional images of the first stereoscopic video image to form a complete color image, and in the second projection period and the third In each projection period, three projectors are used to project the R, G, and B three-dimensional images of the second and third stereoscopic video images respectively, so that in three different projection periods, the It uniquely displays three different video images, and realizes independent time-sharing playback of three-way stereoscopic video. In this playback mode, although the projection imaging time of each video image is shortened from three time periods to one time period, the simultaneous projection of three projectors increases the projection light intensity per unit time, which offsets the shortening of the projection time. So that each channel of video can still basically guarantee the original brightness.
为了实现上述功能,首先需要对色轮结构进行重新设计,以改变投影仪彩色投影顺序,从而保证彩色图像的正确合成。首先对投影仪色轮结构进行改造:第一台投影仪的色轮保持固有RGB顺序不变,如图2左侧的色轮;而第二台投影仪的色轮改造为GBR顺序,如图2中间的色轮;第三台投影仪的色轮改造为BRG顺序,如图2右侧的色轮(需要说明的是,在目前DLP投影仪常见色轮模式中,除RGB三原色色段外,还附加了白色、青色共5个色段,其中白色段与青色段用于对投影画面进行色彩饱和度补偿,并不影响上述的影像投影模式)。In order to realize the above functions, the structure of the color wheel needs to be redesigned first to change the color projection sequence of the projector, so as to ensure the correct synthesis of color images. First, transform the color wheel structure of the projector: the color wheel of the first projector keeps the inherent RGB order unchanged, as shown in the color wheel on the left side of Figure 2; while the color wheel of the second projector is transformed into the GBR order, as shown in the figure 2 The color wheel in the middle; the color wheel of the third projector is transformed into BRG order, as shown in the color wheel on the right side of Figure 2 (it should be noted that in the current common color wheel mode of DLP projectors, except for the RGB three primary color segments , and also add a total of 5 color segments of white and cyan, of which the white segment and the cyan segment are used to compensate the color saturation of the projected image and do not affect the above-mentioned image projection mode).
在对投影仪色轮进行上述重新设计之后,在第一个投影时段中,三台投影仪所处的色段分别为R-G-B;在第二个投影时段中,三台投影仪所处的色段分别为G-B-R;在第三个投影时段中,三台投影仪所处的色段分别为B-R-G,使得每一个投影时段中都有R、G、B三原色投影,以保证彩色图像的正确合成。为了说明这一过程,采用图3与图4进行对比说明。图3表示了未更换色轮时,三台投影仪的色轮都保持RGB顺序,按照原始播放模式进行视频播放,可以看到在这种情况下,每一个投影时段中,屏幕上同时出现了三路视频画面的对应位面图像,这三路视频画面在屏幕上始终是混叠的,无法独立播放与收看。图4表示了在重新设计投影仪色轮之后,三台投影仪组成的阵列所呈现的投影效果,由于改变了色轮结构,使得在每一个投影时段中,屏幕上都唯一地显示出一路独立的视频图像,从而实现了三路视频的独立分时播放。在多画投影阵列具体安装时,采用垂直排列布局,将阵列中的三台立体投影仪按照上中下顺序摆置,并微调三台投影仪的位置,保证三台投影仪的投影画面区域大致重合。After the above redesign of the projector color wheel, in the first projection period, the color segments where the three projectors are located are R-G-B respectively; in the second projection period, the color segments where the three projectors are located are They are G-B-R respectively; in the third projection period, the color segments where the three projectors are located are B-R-G, so that each projection period has three primary colors of R, G, and B projected to ensure the correct synthesis of color images. In order to illustrate this process, FIG. 3 and FIG. 4 are used for comparison and description. Figure 3 shows that when the color wheel is not replaced, the color wheels of the three projectors keep the RGB order, and the video is played according to the original playback mode. It can be seen that in this case, in each projection period, the screen appears at the same time. The corresponding plane images of the three-channel video images, the three-channel video images are always aliased on the screen, and cannot be played and watched independently. Figure 4 shows the projection effect presented by an array of three projectors after redesigning the color wheel of the projector. Due to the change of the color wheel structure, in each projection period, the screen uniquely displays an independent channel The video image, thus realizing the independent time-sharing playback of the three-channel video. During the specific installation of the multi-picture projection array, a vertical arrangement is adopted, the three stereo projectors in the array are placed in the upper, middle and lower order, and the positions of the three projectors are fine-tuned to ensure that the projected image area of the three projectors is roughly coincide.
基于GPU的实时混编-拼接-渲染模块GPU-based real-time mixing-splicing-rendering module
为配合专用多画投影阵列,还需要对三路视频画面进行实时混编-拼接处理,并进行实时渲染,形成多画立体视频流格式。首先,与原有的每台投影仪只负责投影播放一路视频的模式不同,在3画投影阵列的播放模式中,每一台投影仪所播放的画面不再是由单一画面的3个位面组成,而是分别从三路视频画面中抽取一个位面后混合而成;其次,投影阵列中垂直摆放的三台投影仪的投影画面只能大致重合,无法真确拼接为完整的彩色视频影像。因此,需要进行几何投影拼接校正,保证三台投影仪的投影画面达到像素重合,从而在屏幕上拼接为正确的立体视频影像。为保证视频的实时渲染的时效性,上述功能的实现是基于显示卡GPU加速完成的,这是本发明中需要解决的第二个技术问题。其解决方式如下:In order to cooperate with the dedicated multi-picture projection array, it is also necessary to perform real-time mixing and splicing processing on the three-channel video images, and perform real-time rendering to form a multi-picture stereoscopic video stream format. First of all, different from the original mode in which each projector is only responsible for projecting and playing one video, in the playback mode of the 3-picture projection array, the picture played by each projector is no longer composed of 3 planes of a single picture. Instead, they extract one plane from the three-channel video images and then mix them together. Secondly, the projection images of the three projectors placed vertically in the projection array can only be roughly overlapped, and cannot be truly spliced into a complete color video image. . Therefore, it is necessary to perform geometric projection splicing correction to ensure that the projection images of the three projectors achieve pixel coincidence, so that they can be spliced into a correct stereoscopic video image on the screen. In order to ensure the timeliness of the real-time rendering of the video, the realization of the above functions is completed based on the GPU acceleration of the display card, which is the second technical problem to be solved in the present invention. The solution is as follows:
多画立体显示播放系统的实时混编-拼接-渲染模块实现的功能包括下列三个方面:(1)三路立体视频的实时渲染生成;(2)三路立体视频画面的混合编码;(3)三路立体视频画面的拼合校正。最终生成的三路立体视频流通过多屏分路显示硬件分别连接到三台DLP投影仪进行投影播放。多画立体显示播放系统的实时渲染模块如图5所示。The functions realized by the real-time mixing-splicing-rendering module of the multi-picture stereoscopic display and playback system include the following three aspects: (1) real-time rendering and generation of three-way stereoscopic video; (2) mixed coding of three-way stereoscopic video images; (3) ) Combined correction of three-way stereoscopic video images. The final generated three-way stereoscopic video flow is connected to three DLP projectors for projection and playback with multi-screen split display hardware. The real-time rendering module of the multi-picture stereoscopic display and playback system is shown in Figure 5.
其中功能(1)可以在虚拟现实/游戏制作软件平台中,通过设置3组虚拟立体相机来获取3路立体视频,其中每一组虚拟立体相机中包含左、右两个虚拟相机,用于获取对应用户的左、右眼图像。Among them, function (1) can obtain 3-channel stereo video by setting 3 groups of virtual stereo cameras in the virtual reality/game production software platform, wherein each group of virtual stereo cameras includes two virtual cameras, left and right, for obtaining Corresponding to the user's left and right eye images.
功能(2)实现三路立体视频画面的混合编码,其目的是将三路独立立体视频的R、G、B位面图像进行混编组合,按照图4中所列出的三路图像混编形式组合成为新的立体视频,以保证通过三台DLP投影仪阵列组合播放三路立体视频。为保证实时渲染,这一功能通过CG语言编写Shader代码,通过GPU进行实时处理。Function (2) Realize the mixed coding of three-way stereoscopic video images, the purpose of which is to mix and combine the R, G, and B bit-plane images of the three-way independent stereoscopic video, and mix the three-way images listed in Figure 4. The form is combined into a new stereoscopic video to ensure that the three-way stereoscopic video is played through the combination of three DLP projector arrays. In order to ensure real-time rendering, this function writes Shader code in CG language and performs real-time processing through GPU.
功能(3)中三路立体视频画面的拼合校正是多画立体视频播放的最后一个环节,用于对三路混编的立体视频画面进行拼合校正。由于投影仪阵列中,每一路视频画面的RGB三个位面图像时分别由三台投影仪投射到屏幕上的,这就需要对每一台投影仪所投影播放的图像都进行几何校正,保证在屏幕上实现位面画面重合,从而正确合成彩色图像。这一过程首先需要拍摄三台投影仪分别投射的标准棋盘格定标图像,根据三幅棋盘格定标图像中对应角点位置确定拼合变形参数,并将变形参数作为CG语言编写Shader代码的输入,通过GPU进行3路视频画面的实时变形校正。为保证图像校正的实时性,需要通过GPU加速实现。In function (3), the stitching correction of the three-channel stereoscopic video images is the last link of the multi-picture stereoscopic video playback, and is used for stitching and correcting the three-channel mixed stereoscopic video images. Since in the projector array, the RGB three-plane images of each channel of video are projected onto the screen by three projectors respectively, it is necessary to perform geometric correction on the images projected and played by each projector to ensure that Realize the overlapping of the planes on the screen to correctly synthesize color images. In this process, the standard checkerboard calibration images projected by three projectors need to be taken first, and the deformation parameters of the stitching are determined according to the corresponding corner points in the three checkerboard calibration images, and the deformation parameters are used as the input of the Shader code written in CG language. , real-time distortion correction of 3-channel video images through GPU. In order to ensure the real-time performance of image correction, it needs to be accelerated by GPU.
(三)专用多画快门式立体眼镜的设计(3) Design of special multi-picture shutter stereo glasses
在通过投影仪阵列实现三路视频的分时独立播放后,还需要相应地设计专用多画立体眼镜的控制电路,按组别设计出三种不同类型的快门立体眼镜,用于正确收看对应组别的立体视频,同时屏蔽掉另外两路视频流。这需要实现两个功能,首先是缩短液晶镜片的开启时间,由原先持续3个投影时段的开启时间缩短为1个投影时段,同时要根据眼镜类型及对应的视频序号,控制液晶镜片的开闭时序,由传统的等占空比开闭时序,变为不等占空比开闭时序,保证快门眼镜液晶镜片的开/闭时序与相应组别立体视频的播放时序相同步,从而收看到对应的立体视频流。为说明本发明中所设计的专用多画立体液晶眼镜工作原理,在图6中对比了普通快门式液晶眼镜及专用多画立体眼镜的开闭工作时序。After realizing the time-sharing and independent playback of the three-channel video through the projector array, it is also necessary to design the control circuit of the special multi-picture stereo glasses accordingly, and design three different types of shutter stereo glasses according to the group to correctly watch the corresponding group. For other stereoscopic videos, the other two video streams are blocked at the same time. This needs to achieve two functions. The first is to shorten the opening time of the liquid crystal lens, from the original opening time of 3 projection periods to 1 projection period. At the same time, it is necessary to control the opening and closing of the liquid crystal lens according to the type of glasses and the corresponding video serial number. The timing is changed from the traditional equal duty cycle opening and closing sequence to the unequal duty cycle opening and closing sequence to ensure that the opening/closing sequence of the liquid crystal lens of the shutter glasses is synchronized with the playback sequence of the corresponding group of stereo video, so as to watch the corresponding stereoscopic video stream. In order to illustrate the working principle of the special multi-picture stereoscopic liquid crystal glasses designed in the present invention, FIG. 6 compares the opening and closing working sequence of the ordinary shutter type liquid crystal glasses and the special multi-picture stereoscopic glasses.
在图6中,第一行为120Hz的DLP LINK光脉冲同步信号,是与投影仪的立体视频播放时序同步的,是快门式立体眼镜镜片开闭时序的同步基准。第二行及第三行是普通快门眼镜的左眼及右眼镜片的开闭时序,左右眼镜片交替开闭,开闭频率为120Hz,开闭周期为等占空比,时长都为8.34ms,包含了RGB三个投影时段,能够正确观看普通的单路立体视频。图中第4-6行为改造后的多画快门眼镜左眼镜片的开闭时序,第7-9行为改造后的多画快门眼镜右眼镜片的开闭时序,改造后的多画快门眼镜分为3类(1、2、3号),液晶镜片依次在第一、第二及第三个投影时段开启,从而观看到对应时段中播放的立体视频。这里需要着重说明两点:一是改造后的多画快门眼镜,其镜片开闭周期的占空比不再相等。这是由于多画快门镜片的开闭需要与对应的投影时段同步所致,这是与普通快门眼镜的重要不同之处。二是在图5中,液晶镜片的开启时间为1.7ms,即投影仪的RGB三个投影时段分别为1.7ms,共5.1ms,并没有填充满一个单眼画面的8.3ms的播放周期。这是因为目前的DLP型投影仪大多实际采用RGBCWY(红绿蓝青白黄)6段色轮,其中RGB三段色轮仍对应着画面的R、G、B三个位面图像的播放,而在CWY(青白黄)这三个附加色段投影仪并不投射任何图像信号,而只是单纯地向屏幕投射三补色青、白、黄光,用以改善DLP投影仪的色彩保真度。在改造后的多画快门眼镜的开闭时序中,就要排除附加的CWY(青白黄)三个投影时段。In FIG. 6 , the first row is a 120 Hz DLP LINK optical pulse synchronization signal, which is synchronized with the stereoscopic video playback timing of the projector, and is the synchronization reference for the opening and closing timing of the shutter-type stereoscopic glasses lenses. The second row and the third row are the opening and closing timing of the left eye and right eye lenses of ordinary shutter glasses. The left and right eye lenses open and close alternately. The opening and closing frequency is 120Hz. , including three projection periods of RGB, which can correctly watch ordinary single-channel stereoscopic video. Lines 4-6 in the figure are the opening and closing timings of the left-eye lens of the modified multi-painting shutter glasses, rows 7-9 are the opening and closing timings of the right-eye lens of the modified multi-painting shutter glasses, and the modified multi-painting shutter glasses are divided into Type 3 (No. 1, No. 2, No. 3), the liquid crystal lens is turned on in the first, second and third projection periods in sequence, so that the stereoscopic video played in the corresponding period can be watched. Two points need to be emphasized here: First, the duty ratios of the opening and closing periods of the lenses are no longer equal to the reconstructed multi-paint shutter glasses. This is because the opening and closing of the multi-picture shutter glasses needs to be synchronized with the corresponding projection period, which is an important difference from ordinary shutter glasses. Second, in Figure 5, the opening time of the liquid crystal lens is 1.7ms, that is, the three projection periods of the projector's RGB are 1.7ms respectively, a total of 5.1ms, which does not fill the 8.3ms playback period of a single eye screen. This is because most of the current DLP projectors actually use RGBCWY (red, green, blue, green, white and yellow) 6-segment color wheel, of which the RGB three-segment color wheel still corresponds to the playback of the R, G, and B plane images of the screen, while In the three additional color segments of CWY (cyan, white and yellow), the projector does not project any image signal, but simply projects the three complementary colors of cyan, white and yellow light to the screen to improve the color fidelity of the DLP projector. In the opening and closing sequence of the reconstructed multi-picture shutter glasses, the additional three projection periods of CWY (cyan, white and yellow) should be excluded.
综合上述三个模块的设计,本发明实现了一种投影式多画立体显示播放系统,实现6人6画立体显示播放功能。Combining the designs of the above three modules, the present invention realizes a projection type multi-picture stereoscopic display and playback system, which realizes the function of 6-person and 6-picture stereoscopic display and playback.
本发明相对于现有技术具有很好的优点。Compared with the prior art, the present invention has very good advantages.
德国魏玛-包豪斯大学于2011年的论文C1x6:A Stereoscopic Six-UserDisplayfor Co-located Collaboration in Shared Virtual Environments中提出了一种名为C1x6的投影式多画面立体显示系统,本发明与C1x6系统的区别在于:(1)多路立体画面投影模式不同,C1x6系统中使用6台投影仪,其中3台一组用于显示6用户的左眼视频,另3台一组用于显示6用户的右眼视频,形成立体视频效果,在播放立体图像时必须6台投影仪同时使用;而本发明中以3台投影仪为一组基本立体播放单元,可以独立完成3用户的左右眼立体视频播放,配合光学偏振器件就可以扩展为6用户立体视频播放,与C1x6系统相比使用模式更为灵活。(2)基于(1)中多用户投影成像模式的不同,本发明中采用的多用户立体图像混编算法及多画面快门式立体眼镜的电路工作时序与C1x6完全不同。(3)C1x6系统与本发明都对投影仪结构进行改造,但C1x6系统将投影仪彩色色轮替换为透明色轮,并通过在投影仪镜头前分别外置红-绿-蓝滤光片的方法,将三台彩色投影仪分别改造为对应三原色的单色投影仪,而本发明将投影仪彩色色轮中的色段顺序进行调整,改变三原色位面图像投影顺序,形成多用户彩色图像的分时投影。In the paper C1x6: A Stereoscopic Six-UserDisplay for Co-located Collaboration in Shared Virtual Environments by Weimar-Bauhaus University in Germany in 2011, a projection type multi-screen stereoscopic display system named C1x6 was proposed. The present invention is related to the C1x6 system. The difference is: (1) The multi-channel stereoscopic image projection mode is different, 6 projectors are used in the C1x6 system, of which 3 projectors are used to display the left eye video of 6 users, and the other 3 projectors are used to display the video of 6 users. The right eye video forms a stereoscopic video effect, and 6 projectors must be used at the same time when playing stereoscopic images; and in the present invention, three projectors are used as a group of basic stereoscopic playback units, which can independently complete the left and right eye stereoscopic video playback of 3 users , with the optical polarization device, it can be expanded to 6-user stereoscopic video playback, which is more flexible than the C1x6 system. (2) Based on the difference of the multi-user projection imaging modes in (1), the multi-user stereoscopic image mixing algorithm and the circuit operation timing of the multi-screen shutter stereo glasses used in the present invention are completely different from those of C1x6. (3) Both the C1x6 system and the present invention modify the projector structure, but the C1x6 system replaces the projector color wheel with a transparent color wheel, and uses external red-green-blue filters in front of the projector lens. The method is to transform three color projectors into monochromatic projectors corresponding to three primary colors respectively, and the present invention adjusts the sequence of color segments in the color wheel of the projectors, changes the projection sequence of three primary color bit plane images, and forms a multi-user color image. Time-sharing projection.
以上所述仅为本申请的优选实施例而已,并不用于限制本申请,对于本领域的技术人员来说,本申请可以有各种更改和变化。凡在本申请的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本申请的保护范围之内。The above descriptions are only preferred embodiments of the present application, and are not intended to limit the present application. For those skilled in the art, the present application may have various modifications and changes. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this application shall be included within the protection scope of this application.
上述虽然结合附图对本发明的具体实施方式进行了描述,但并非对本发明保护范围的限制,所属领域技术人员应该明白,在本发明的技术方案的基础上,本领域技术人员不需要付出创造性劳动即可做出的各种修改或变形仍在本发明的保护范围以内。Although the specific embodiments of the present invention have been described above in conjunction with the accompanying drawings, they do not limit the scope of protection of the present invention. Those skilled in the art should understand that on the basis of the technical solutions of the present invention, those skilled in the art do not need to pay creative work. Various modifications or deformations that can be made are still within the protection scope of the present invention.
Claims (9)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710502102.7A CN107333122B (en) | 2017-06-27 | 2017-06-27 | A projection type multi-picture stereoscopic display and playback system and method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710502102.7A CN107333122B (en) | 2017-06-27 | 2017-06-27 | A projection type multi-picture stereoscopic display and playback system and method |
Publications (2)
Publication Number | Publication Date |
---|---|
CN107333122A CN107333122A (en) | 2017-11-07 |
CN107333122B true CN107333122B (en) | 2019-07-05 |
Family
ID=60197358
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710502102.7A Active CN107333122B (en) | 2017-06-27 | 2017-06-27 | A projection type multi-picture stereoscopic display and playback system and method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN107333122B (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110809149B (en) | 2018-08-06 | 2022-02-25 | 苹果公司 | Media compositor for computer-generated reality |
CN110430413A (en) * | 2019-08-13 | 2019-11-08 | 苏州兆见智能科技有限公司 | A kind of method for displaying projection of more people's stereoscopic experiences |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102759848A (en) * | 2012-06-11 | 2012-10-31 | 海信集团有限公司 | Projected display system, projection device and projection display method |
CN104155840A (en) * | 2014-07-01 | 2014-11-19 | 浙江大学 | Device and method for 360-degree full-parallax three dimensional display based on high-speed projector |
CN104202589A (en) * | 2014-09-23 | 2014-12-10 | 长春理工大学 | Multichannel three-dimensional film video synchronous playing method |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080036854A1 (en) * | 2006-08-08 | 2008-02-14 | Texas Instruments Incorporated | Method and system of communicating and rendering stereoscopic and dual-view images |
-
2017
- 2017-06-27 CN CN201710502102.7A patent/CN107333122B/en active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102759848A (en) * | 2012-06-11 | 2012-10-31 | 海信集团有限公司 | Projected display system, projection device and projection display method |
CN104155840A (en) * | 2014-07-01 | 2014-11-19 | 浙江大学 | Device and method for 360-degree full-parallax three dimensional display based on high-speed projector |
CN104202589A (en) * | 2014-09-23 | 2014-12-10 | 长春理工大学 | Multichannel three-dimensional film video synchronous playing method |
Also Published As
Publication number | Publication date |
---|---|
CN107333122A (en) | 2017-11-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7670004B2 (en) | Dual ZScreen® projection | |
US20080036854A1 (en) | Method and system of communicating and rendering stereoscopic and dual-view images | |
CN102272656A (en) | Dual-view stereoscopic display using linear modulator arrays | |
CN103048869B (en) | High-visual angle resolution 360-degree visual field three-dimensional displaying device and method | |
Dodgson et al. | 50-in. time-multiplexed autostereoscopic display | |
TWI502958B (en) | 3d image display apparatus and method thereof | |
CN102075773B (en) | Synchronized method for imaging stereo and planar image mixed signal on super large screen | |
WO2011157052A1 (en) | 3d imaging system and method | |
JP2011242773A (en) | Stereoscopic image display device and driving method for the same | |
US9591293B2 (en) | Stereoscopic field sequential colour display control | |
CN203909462U (en) | Dual-projector 3D projection device and 3D projection system based on laser light source | |
CN107333122B (en) | A projection type multi-picture stereoscopic display and playback system and method | |
CN102186096A (en) | 3D display set-top box of common television set | |
CN201796190U (en) | 3d glasses | |
CN104767988A (en) | Stereoscopic image display system | |
Hutchison et al. | The design and implementation of a stereoscopic microdisplay television | |
CN203444233U (en) | Color separation type 3D display device of laser light source | |
JP2013120328A (en) | Projection-type image display system, 3d glasses, and rotating plate | |
CN111323936B (en) | Projection display system, 3D glasses and projection method | |
CN102868902B (en) | Stereoscopic image display device and method thereof | |
CN111240139A (en) | Projection display system, projection module and 3D glasses | |
Borel et al. | 3D display technologies | |
CN116389705B (en) | Three-dimensional scene realization method and system for augmented reality | |
CN203015043U (en) | Stereoscopic video hardware decoding double-machine polarizing superpose adjusting composite set | |
TWI489856B (en) | Dimensional image processing method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |