[go: up one dir, main page]

CN102036090B - A TV signal conversion device for digital TV terminal - Google Patents

A TV signal conversion device for digital TV terminal Download PDF

Info

Publication number
CN102036090B
CN102036090B CN2010105913840A CN201010591384A CN102036090B CN 102036090 B CN102036090 B CN 102036090B CN 2010105913840 A CN2010105913840 A CN 2010105913840A CN 201010591384 A CN201010591384 A CN 201010591384A CN 102036090 B CN102036090 B CN 102036090B
Authority
CN
China
Prior art keywords
control signal
mode control
signal
digital format
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN2010105913840A
Other languages
Chinese (zh)
Other versions
CN102036090A (en
Inventor
戴琼海
郝伟
陈�峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tsinghua University
Original Assignee
Tsinghua University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tsinghua University filed Critical Tsinghua University
Priority to CN2010105913840A priority Critical patent/CN102036090B/en
Publication of CN102036090A publication Critical patent/CN102036090A/en
Application granted granted Critical
Publication of CN102036090B publication Critical patent/CN102036090B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

本发明提出一种用于数字电视终端的电视信号转换装置,包括:模式控制器,根据用户的配置产生模式控制信号;视频接收器,接收和转换视频以得到数字格式图像;存储控制器,存储数字格式图像并根据模式控制信号对该图像进行控制;计算模块,根据控制信号对该图像进行深度变换;渲染模块,根据模式控制信号对深度图或数字格式图像进行渲染;帧率变换器,接收和变换数字格式图像或渲染图像的帧率;视频发射器,转换所述帧率变换图像的格式。通过该装置,能够将平面视频信号通过一定的算法转化为立体视频信号,同时也能将立体视频信号方便灵活的转变成供普通电视机观看的红绿立体信号,实现了视频信号间的灵活转换。

The present invention proposes a TV signal conversion device for a digital TV terminal, including: a mode controller, which generates a mode control signal according to user configuration; a video receiver, which receives and converts video to obtain a digital format image; a storage controller, which stores The digital format image is controlled according to the mode control signal; the calculation module is used to perform depth transformation on the image according to the control signal; the rendering module is used to render the depth map or digital format image according to the mode control signal; the frame rate converter receives and converting the frame rate of the digitally formatted image or the rendered image; and the video transmitter, converting the format of the frame rate converted image. Through this device, the planar video signal can be converted into a stereoscopic video signal through a certain algorithm, and at the same time, the stereoscopic video signal can be conveniently and flexibly transformed into a red and green stereoscopic signal for ordinary TV sets, realizing the flexible conversion between video signals .

Description

一种用于数字电视终端的电视信号转换装置A TV signal conversion device for digital TV terminal

技术领域 technical field

本发明涉及视觉处理,平面视频转换立体视频技术领域,特别涉及一种用于数字电视终端的电视信号转换装置。The invention relates to the technical field of visual processing and conversion of flat video to stereoscopic video, in particular to a TV signal conversion device for a digital TV terminal.

背景技术 Background technique

随着电视产业的革命日益推进,电视逐步向高质量、高清晰、可交互的方向发展,目前市场上已经出现了很多的具有立体显示功能的电视机,但是目前大部分电视台没有开播立体频道,这些立体显示器只能接收到平面的视频;另一方面,立体电视虽然没有在消费者中大量普及,但是很多消费者也希望能体验到立体视频的效果。这样就带来了如下的几个需求:With the advancement of the revolution in the TV industry, TVs are gradually developing in the direction of high-quality, high-definition, and interactive. At present, there have been many TVs with stereoscopic display functions on the market, but most TV stations currently do not broadcast stereoscopic channels. These stereoscopic displays can only receive flat video; on the other hand, although stereoscopic TVs are not widely popular among consumers, many consumers also hope to experience the effect of stereoscopic video. This brings the following requirements:

1、如果用户拥有了一台立体显示器,那么他希望尽管接收到平面的电视信号,也能看到立体效果。1. If the user has a stereoscopic display, he wishes to see the stereoscopic effect even though he receives a flat TV signal.

2、如果用户只有一台普通的平面的显示器,那么用户希望在平面视频信号的情况下能够观看红绿的立体效果电视节目,而在信号为立体视频信号时,用户也希望可以观看具有红绿的立体效果的电视节目。2. If the user only has a common flat display, the user wishes to watch red and green stereoscopic effect TV programs under the condition of flat video signals, and when the signal is a stereoscopic video signal, the user also hopes to watch red and green TV programs. stereoscopic effect of TV programs.

因此,如何能够根据用户的需求对电视传输系统和电视最终显示终端视频信号之间进行转换已经成为当今社会亟待解决的问题。Therefore, how to convert between the TV transmission system and the video signal of the final display terminal of the TV according to the needs of users has become an urgent problem to be solved in today's society.

发明内容 Contents of the invention

本发明的目的旨在至少解决上述技术缺陷之一。The purpose of the present invention is to solve at least one of the above-mentioned technical drawbacks.

本发明是针对如何能够根据用户的需求对电视传输系统和电视最终显示终端视频信号之间进行转换,而提出的一种用于数字终端的电视信号转换装置。The present invention aims at how to convert between the TV transmission system and the video signal of the final display terminal of the TV according to the needs of users, and proposes a TV signal conversion device for digital terminals.

为达到上述目的,本发明提出的用于数字终端的电视信号转换装置,包括:视频接收器、存储控制器、计算模块、渲染模块、帧率变换器、模式控制器和视频发射器,所述模式控制器根据用户的配置产生模式控制信号,其中,所述模式控制信号对所述存储控制器、所述计算模块和所述渲染模块进行控制;所述视频接收器用于接收和转换视频信号以得到每一帧图像的数字格式图像;所述存储控制器用于存储所述数字格式图像并根据所述模式控制信号对所述数字格式图像进行控制;所述计算模块与所述存储控制器相连,用于根据所述控制信号对所述数字格式图像进行深度变换,以得到深度图像;所述渲染模块分别与所述计算模块和所述存储控制器相连,用于根据所述模式控制信号对所述深度图像或所述数字格式图像进行渲染,以得到渲染图像;所述帧率变换器与所述存储控制器和所述渲染模块相连,用于接收和变换所述数字格式图像和/或所述渲染图像的帧率,以得到帧率变换图像;以及视频发射器,所述视频发射器用于转换所述帧率变换图像的格式以输出格式转换后的视频。In order to achieve the above object, the TV signal conversion device for digital terminals proposed by the present invention includes: a video receiver, a storage controller, a computing module, a rendering module, a frame rate converter, a mode controller and a video transmitter, the The mode controller generates a mode control signal according to the configuration of the user, wherein the mode control signal controls the storage controller, the calculation module and the rendering module; the video receiver is used to receive and convert video signals to Obtain a digital format image of each frame of image; the storage controller is used to store the digital format image and control the digital format image according to the mode control signal; the calculation module is connected to the storage controller, It is used to perform depth transformation on the digital format image according to the control signal to obtain a depth image; the rendering module is respectively connected to the calculation module and the storage controller, and is used to transform the digital format image according to the mode control signal. The depth image or the digital format image is rendered to obtain a rendered image; the frame rate converter is connected to the storage controller and the rendering module, and is used to receive and convert the digital format image and/or the the frame rate of the rendered image to obtain a frame rate converted image; and a video transmitter, configured to convert the format of the frame rate converted image to output a format-converted video.

在本发明的实施例中,所述模式控制信号包括第一模式控制信号、第二模式控制信号、第三模式控制信号和第四模式控制信号,其中,所述第一模式控制信号为平面转立体模式信号,所述第二模式控制信号为平面转红绿立体模式信号,所述第三模式控制信号为立体转红绿模式信号,所述第四模式控制信号为关闭模式信号。In an embodiment of the present invention, the mode control signal includes a first mode control signal, a second mode control signal, a third mode control signal and a fourth mode control signal, wherein the first mode control signal is a planar to Stereo mode signal, the second mode control signal is a plane-to-red-green stereo mode signal, the third mode control signal is a stereo-to-red-green mode signal, and the fourth mode control signal is an off mode signal.

在本发明的实施例中,所述视频信号和格式转后的视频为高清晰度数字多媒体视频信号、分量模拟视频信号或复合模拟视频信号。In an embodiment of the present invention, the video signal and the format-converted video are high-definition digital multimedia video signals, component analog video signals or composite analog video signals.

在本发明的实施例中,所述存储控制器用于存储所述数字格式图像并根据所述模式控制信号对所述数字格式图像进行控制,进一步包括:判断所述模式控制信号的类别;如果所述模式控制信号为第一模式控制信号或者第二模式控制信号,则所述存储控制器将当前帧的数字格式图像和预先缓存的所述当前帧的前一帧的数字格式图像同时发送给所述计算模块;如果所述模式控制信号为第三模式控制信号,则所述存储控制器将所述数字格式图像的左视图和预先缓存的所述数字格式图像的右视图同时发送给所述渲染模块;和如果所述模式控制信号为第四模式控制信号,则所述存储控制器将所述数字格式图像发送给所述帧率变换器。In an embodiment of the present invention, the storage controller is used to store the digital format image and control the digital format image according to the mode control signal, further comprising: judging the type of the mode control signal; if the If the mode control signal is the first mode control signal or the second mode control signal, the storage controller simultaneously sends the digital format image of the current frame and the pre-cached digital format image of the previous frame of the current frame to the the calculation module; if the mode control signal is a third mode control signal, the storage controller simultaneously sends the left view of the digital format image and the pre-cached right view of the digital format image to the rendering modules; and if the mode control signal is a fourth mode control signal, the memory controller sends the digital format image to the frame rate converter.

在本发明的实施例中,所述计算模块根据所述模式控制信号对所述数字格式图像进行深度变换,进一步包括:判断所述模式控制信号的类别;如果所述模式控制信号为第一模式控制信号或者第二模式控制信号,则所述计算模块根据当前帧的数字格式图像和预先缓存的所述当前帧的前一帧的数字格式图像得到所述当前帧的数字格式图像的深度图像,且发送所述深度图像和所述当前帧的数字格式图像至所述渲染模块。In an embodiment of the present invention, the calculation module performs depth conversion on the digital format image according to the mode control signal, further comprising: judging the type of the mode control signal; if the mode control signal is the first mode control signal or the second mode control signal, the calculation module obtains the depth image of the digital format image of the current frame according to the digital format image of the current frame and the pre-cached digital format image of the previous frame of the current frame, And sending the depth image and the digital format image of the current frame to the rendering module.

在本发明的实施例中,所述渲染模块根据所述模式控制信号对所述深度图像或所述数字格式图像进行渲染,进一步包括:判断说书模式控制信号的类别;如果所述模式控制信号为第一模式控制信号,则所述渲染模块对所述深度图像和所述当前帧的数字格式图像进行渲染,以得到并缓存所述当前帧的数字格式图像的左视图和右视图,并依次将所述左视图和右视图发送至所述帧率变换器;如果所述模式控制信号为第二模式控制信号,则所述渲染模块对所述深度图像和所述当前帧的数字格式图像进行渲染,以得到并缓存所述当前帧的数字格式图像的红绿图像,并将所述红绿图像发送至所述帧率变换器;如果所述模式控制信号为第三模式控制信号,则所述渲染模块对所述数字格式图像的左视图和预先缓存的所述数字格式图像的右视图分别提取红色和蓝绿色成分并进行合成,以得到所述数字格式图像的红绿视频图像。In an embodiment of the present invention, the rendering module renders the depth image or the digital format image according to the mode control signal, further comprising: judging the type of the storytelling mode control signal; if the mode control signal is The first mode control signal, the rendering module renders the depth image and the digital format image of the current frame to obtain and cache the left view and right view of the digital format image of the current frame, and sequentially The left view and the right view are sent to the frame rate converter; if the mode control signal is a second mode control signal, the rendering module renders the depth image and the digital format image of the current frame , to obtain and buffer the red-green image of the digital format image of the current frame, and send the red-green image to the frame rate converter; if the mode control signal is a third mode control signal, the The rendering module extracts and synthesizes red and blue-green components respectively from the left view of the digital format image and the pre-cached right view of the digital format image, so as to obtain a red and green video image of the digital format image.

在本发明的实施例中,所述帧率变换器根据不同电视设备的需求对所述数字格式图像和/或所述渲染图像进行相应的帧率变换,并把帧率变换后的图像发送给所述视频发射器。In an embodiment of the present invention, the frame rate converter performs corresponding frame rate conversion on the digital format image and/or the rendered image according to the requirements of different television equipment, and sends the frame rate converted image to The video transmitter.

在本发明的实施例中,所述视频发射器对所述帧率变换后的图像进行格式转换,以得到所述帧率变换后的图像的高清晰度数字多媒体视频信号、分量模拟视频信号或复合模拟视频信号。In an embodiment of the present invention, the video transmitter performs format conversion on the frame rate-converted image to obtain a high-definition digital multimedia video signal, component analog video signal or Composite analog video signal.

通过本发明提出的用于数字电视终端的电视信号转换装置,很好的解决了电视传输系统和电视终端显示之间的不匹配问题,本装置能够将平面视频信号通过一定的算法转化为立体视频信号,同时也能将立体视频信号方便灵活的转变成供普通电视机观看的红绿立体信号,实现了视频信号间的灵活转换,使用户得在观看电视节目或者视频节目的时候有了更好的图像体验效果,增强了视觉效果。The TV signal conversion device for digital TV terminals proposed by the present invention solves the mismatch problem between the TV transmission system and the TV terminal display, and the device can convert plane video signals into stereoscopic video signals through a certain algorithm. At the same time, it can conveniently and flexibly transform the stereoscopic video signal into a red-green stereoscopic signal for ordinary TV sets, realizing the flexible conversion between video signals, so that users have a better experience when watching TV programs or video programs. The image experience effect enhances the visual effect.

本发明附加的方面和优点将在下面的描述中部分给出,部分将从下面的描述中变得明显,或通过本发明的实践了解到。Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.

附图说明 Description of drawings

本发明上述的和/或附加的方面和优点从下面结合附图对实施例的描述中将变得明显和容易理解,其中:The above and/or additional aspects and advantages of the present invention will become apparent and easy to understand from the following description of the embodiments in conjunction with the accompanying drawings, wherein:

图1为本发明实施例的用于电视设备终端的电视信号转换装置的结构图。FIG. 1 is a structural diagram of a television signal conversion device for a television equipment terminal according to an embodiment of the present invention.

具体实施方式 Detailed ways

下面详细描述本发明的全部实施例,所述实施例的示例在附图中示出,其中自始至终相同或类似的标号表示相同或类似的元件或具有相同或类似功能的元件。下面通过参考附图描述的实施例是示例性的,仅用于解释本发明,而不能解释为对本发明的限制。All embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals designate the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary only for explaining the present invention and should not be construed as limiting the present invention.

本发明是针对如何能够根据用户的需求对电视传输系统和电视最终显示终端视频信号之间进行转换,而提出的一种用于数字终端的电视信号转换装置。The present invention aims at how to convert between the TV transmission system and the video signal of the final display terminal of the TV according to the needs of users, and proposes a TV signal conversion device for digital terminals.

以下就结合附图对本发明实施例提出的用于数字终端的电视信号转换装置的工作原理进行详细描述。The working principle of the television signal conversion device for digital terminals proposed in the embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

如图1所示,为本发明实施例的用于电视设备终端的电视信号转换装置的结构图。从图1中能够看出,在本发明的具体实施例中,该用于电视设备终端的电视信号转换装置100包括视频接收器110、模式控制器120、存储控制器130、计算模块140、渲染模块150、帧率变换器160和视频发射器170。As shown in FIG. 1 , it is a structural diagram of a television signal conversion apparatus for a television equipment terminal according to an embodiment of the present invention. It can be seen from FIG. 1 that in a specific embodiment of the present invention, the TV signal conversion device 100 for a TV equipment terminal includes a video receiver 110, a mode controller 120, a storage controller 130, a computing module 140, a rendering module 150 , frame rate converter 160 and video transmitter 170 .

具体地,该用于电视设备终端的电视信号转换装置100具有一个模式控制器120,该模式控制器120可以根据用户的需求,对视频格式进行不同形式的转换配置,在本发明的一个实施例中,包括四种不同形式的配置,分别为第一模式控制信号、第二模式控制信号、第三模式控制信号和第四模式控制信号。该第一模式控制信号为控制平面图像转立体模式图像(主动立体显示)的控制信号,第二模式控制信号为控制平面图像转立体模式图像(红绿立体显示)的控制信号,第三模式控制信号为控制立体图像转红绿模式图像的控制信号,第四模式控制信号为控制关闭模式的控制信号,换句换说第四模式控制信号也就表示对输入的视频不做2d到3d或者3d到2d的转换,而直接输出该视频。Specifically, the TV signal conversion device 100 for a TV equipment terminal has a mode controller 120, and the mode controller 120 can perform different forms of conversion configurations for video formats according to user needs. In an embodiment of the present invention , including four different forms of configurations, namely the first mode control signal, the second mode control signal, the third mode control signal and the fourth mode control signal. The first mode control signal is a control signal for controlling the transformation of a planar image into a stereoscopic mode image (active stereoscopic display), the second mode control signal is a control signal for controlling the transformation of a plane image into a stereoscopic mode image (red and green stereoscopic display), and the third mode controls The signal is the control signal to control the stereoscopic image to red-green mode image, and the fourth mode control signal is the control signal to control the off mode. In other words, the fourth mode control signal means that the input video will not be 2d to 3d or 3d to 2d conversion, and directly output the video.

更为具体地,在本发明的一个实施例中,该用于电视设备终端的电视信号转换装置100首先经过一个视频接受器110(数字视频信号接受器),接收输入视频的每一帧信息,在本发明的具体实施例中,每一帧图像可以为高清晰度数字多媒体视频信号、分量模拟视频信号或复合模拟视频信号,其中,在本发明的一些实施例中,高清晰度数字多媒体视频信号如:HDMI数字格式信号、DVI数字格式信号等数字格式的视频信号。而这些格式信号经过视频接收器110需转变为数字格式的信号,供该用于电视设备终端的电视信号转换装置100使用。对于存储控制器130,首先根据模式控制信号判断当前模式,如果当前模式为平面图像转立体模式图像(主动立体显示,第一模式)或者平面图像转立体模式图像(红绿立体显示,第二模式),每一帧输入的同时会把当前视频帧缓存在存储控制器130中的一个存储器中,之后把当前帧和前一帧图像同时输送给计算模块140,计算模块140根据这两帧信息可以得到当前帧的深度图像。在本发明的优选实施例中,计算模块140生成深度信息采用块匹配算法,具体地,该匹配算法首先对两帧图像进行分块,然后对相邻两帧的块进行匹配,并且计算运动向量,之后根据“快者即近”等原则对当前帧图像赋予相应的深度值,最后经过滤波得到深度图像,在本发明的一个实施例中,采用高斯滤波的方法得到深度图像,当然也可以采用其它滤波方法进行滤波。此外,计算模块140也可以采用其它方法计算当前帧的深度图像,如:光流法、运动估计法、遮挡判断法、轮廓分析法等,但是,本领域的技术人员知道,无论采用何种方法得到深度图像,这些基于本发明思想的变换或改动都应列为本发明的保护范围。然后把深度图像和当前帧输送给渲染模块150,渲染模块150在平面图像转立体模式图像(主动立体显示,第一模式)或者平面图像转立体模式图像(红绿立体显示,第二模式)中的工作方式不同,在第一模式中,渲染模块150对于每一帧原视频,首先缓存该帧的两幅视图,然后依次输出两幅视图,即:左视图和右视图,由此,生成了可供主动式立体显示器显示的视频信号,而在第二模式中,渲染模块150对每一帧源图像只输出单幅的红绿图像,供普通平面显示器显示红绿立体视频信号。对于上述两种模式,得到的经过渲染的视频信号最终发送给帧率变换器160进行帧率变换,变换完成后把该视频发送给视频发射器170(数字视频发送器),视频发射器170把该数字格式的视频信号转换成可供显示设备现实的视频信号之后送出系统,供显示设备播放。在本发明的一个实施例中,转换后的信号可以为HDMI数字格式信号、DVI数字格式信号、分量模拟视频信号或复合模拟视频信号,当然,本领域的技术人员知道,除了上述转换后的视频信号格式外,还可以是供显示设备显示的其它格式的视频信号。More specifically, in one embodiment of the present invention, the TV signal conversion device 100 for a TV equipment terminal first receives each frame of input video information through a video receiver 110 (digital video signal receiver), In specific embodiments of the present invention, each frame of image can be a high-definition digital multimedia video signal, a component analog video signal or a composite analog video signal, wherein, in some embodiments of the present invention, the high-definition digital multimedia video signal Signals such as: HDMI digital format signal, DVI digital format signal and other digital format video signals. These format signals need to be converted into digital format signals by the video receiver 110 for use by the TV signal conversion device 100 for the TV equipment terminal. For the storage controller 130, first judge the current mode according to the mode control signal, if the current mode is a plane image to a stereo mode image (active stereo display, the first mode) or a plane image to a stereo mode image (red and green stereo display, the second mode) ), the current video frame will be cached in a memory in the storage controller 130 while each frame is input, and then the current frame and the previous frame image will be delivered to the calculation module 140 simultaneously, and the calculation module 140 can be based on these two frame information Get the depth image of the current frame. In a preferred embodiment of the present invention, the calculation module 140 generates depth information using a block matching algorithm. Specifically, the matching algorithm first divides two frames of images into blocks, then matches the blocks of two adjacent frames, and calculates the motion vector , and then assign corresponding depth values to the current frame image according to the principle of "the fastest is the closest", and finally the depth image is obtained through filtering. In one embodiment of the present invention, the depth image is obtained by using Gaussian filtering method. Filtering by other filtering methods. In addition, the calculation module 140 can also use other methods to calculate the depth image of the current frame, such as: optical flow method, motion estimation method, occlusion judgment method, contour analysis method, etc. However, those skilled in the art know that no matter what method is used To obtain the depth image, these transformations or changes based on the idea of the present invention should be listed as the protection scope of the present invention. Then the depth image and the current frame are sent to the rendering module 150, and the rendering module 150 converts the plane image into a stereoscopic mode image (active stereoscopic display, the first mode) or the plane image into a stereoscopic mode image (red and green stereoscopic display, the second mode) The working methods are different. In the first mode, for each frame of the original video, the rendering module 150 first caches two views of the frame, and then sequentially outputs two views, namely: the left view and the right view, thereby generating In the second mode, the rendering module 150 only outputs a single red and green image for each frame of the source image, so that the common flat panel display can display the red and green stereoscopic video signal. For the above two modes, the rendered video signal obtained is finally sent to the frame rate converter 160 for frame rate conversion, and after the conversion is completed, the video is sent to the video transmitter 170 (digital video transmitter), and the video transmitter 170 The video signal in the digital format is converted into a video signal that can be displayed by the display device and then sent to the system for playback by the display device. In one embodiment of the present invention, the converted signal can be an HDMI digital format signal, a DVI digital format signal, a component analog video signal or a composite analog video signal. In addition to the signal format, it can also be a video signal in other formats for display by the display device.

在本发明的具体实施例中,对于立体图像转红绿模式图像(第三模式),在利用视频接收器110(数字视频接收器)得到输入立体视频每一帧信号之后,传送给存储控制器130中先缓存此帧信号中的某一个视图的图像信息,在本发明的一个实施例中,缓存的为左视图,但是,本领域的技术人员知道,也可以先缓存右视图,然后把左视图和右视图同时发送给渲染模块,无论缓存左视图或者右视图,这些基于本发明思想的变动都应属于本发明的保护范围。然后就可以同时把每一帧中的两个视图(左视图和右视图)的图像同时输送给渲染模块150来渲染了,渲染模块150只需要取出两幅视图中的红色成分和蓝绿成分进行合成,从而得到单幅的红绿视频信号,最后此红绿视频信号发送给帧率变换器160进行帧率变换,变换完成后把该视频发送给视频发射器170送出系统。In a specific embodiment of the present invention, for a stereoscopic image into a red-green mode image (the third mode), after using the video receiver 110 (digital video receiver) to obtain each frame signal of the input stereoscopic video, it is sent to the storage controller In 130, the image information of a certain view in the frame signal is first cached. In one embodiment of the present invention, the cached image information is the left view. However, those skilled in the art know that the right view can also be cached first, and then the left view can be cached. The view and the right view are sent to the rendering module at the same time, no matter whether the left view or the right view is cached, these changes based on the idea of the present invention shall fall within the scope of protection of the present invention. Then, the images of the two views (left view and right view) in each frame can be sent to the rendering module 150 for rendering at the same time. The rendering module 150 only needs to take out the red component and the blue-green component in the two views for processing. Synthesize to obtain a single red-green video signal. Finally, the red-green video signal is sent to the frame rate converter 160 for frame rate conversion. After the conversion is completed, the video is sent to the video transmitter 170 to be sent out of the system.

在本发明的具体实施例中,在关闭模式(第四模式)下经过由视频接收器110(数字视频信号接收器)得到的视频信息首先发送给存储控制器130中,存储控制器130根据模式控制信号判断当前用户配置的模式为第四模式,此时,用户不需要对视频信号进行转换,所以存储控制器130直接把视频信号发送给帧率变换器160进行帧率变换,变换完成后把该视频发送给视频发射器170送出系统。In a specific embodiment of the present invention, in the closed mode (the fourth mode), the video information obtained by the video receiver 110 (digital video signal receiver) is first sent to the storage controller 130, and the storage controller 130 according to the mode The control signal judges that the mode currently configured by the user is the fourth mode. At this time, the user does not need to convert the video signal, so the storage controller 130 directly sends the video signal to the frame rate converter 160 for frame rate conversion. After the conversion is completed, the The video is sent to the video transmitter 170 out of the system.

以上是对本发明提出的装置功能的整体介绍,以下就分别具体介绍该装置的各个部件的具体功能。The above is an overall introduction to the functions of the device proposed by the present invention, and the specific functions of each component of the device will be specifically introduced below.

参考图1,在本发明的一个实施例中,模式控制器120根据用户的自定义配置为四种方式:1、平面转立体模式(主动立体显示),2、平面转立体模式(红绿立体显示)3、立体转红绿模式4、关闭模式。根据这四种模式生成对其它模块控制的模式控制信号,以使其它模块按照不同模式的方式进行相应的处理。With reference to Fig. 1, in one embodiment of the present invention, mode controller 120 is configured into four modes according to user's self-definition: 1, plane turns stereo mode (active stereo display), 2, plane turns stereo mode (red-green stereo Display) 3. Three-dimensional to red-green mode 4. Off mode. Mode control signals for controlling other modules are generated according to these four modes, so that other modules perform corresponding processing in different modes.

视频接收器110,用于接收前端来的视频信号(可以是HDMI或DVI等数字格式的视频信号,也可以是模拟视频信号),并把这些视频信号转化为适合该用于柿子电视终端的电视信号转换装置100内各模块处理的数字格式,比如一帧一帧按照BT656标准的数字格式的视频信号。Video receiver 110 is used to receive video signals from the front end (can be video signals in digital formats such as HDMI or DVI, or analog video signals), and convert these video signals into TVs suitable for the persimmon TV terminal. The digital format processed by each module in the signal conversion device 100 is, for example, a frame-by-frame digital format video signal according to the BT656 standard.

存储控制器130,用于接收来自于视频接收器110的数字信号,并且负责按照相应的模式规定,平面图像转立体模式图像(主动立体显示,第一模式),平面图像转立体模式图像(红绿立体显示,第一模式),立体图像转红绿模式图像(第三模式),关闭模式(第四模式)的处理方法和流程不同。对当前帧(或者当前视图)进行缓存,并且同时读取上一帧(或者上一个视图)的内容,之后把两帧内容(或者两视图的内容)通时输送给计算模块140中进行相应的计算。The storage controller 130 is used to receive the digital signal from the video receiver 110, and is responsible for converting the planar image into a stereoscopic mode image (active stereoscopic display, the first mode), and converting the planar image into a stereoscopic mode image (red Green stereoscopic display, the first mode), the stereoscopic image is converted into a red-green mode image (the third mode), and the processing method and flow of the off mode (the fourth mode) are different. The current frame (or the current view) is cached, and the content of the previous frame (or the previous view) is read at the same time, and then the content of the two frames (or the content of the two views) is sent to the computing module 140 for corresponding processing. calculate.

计算模块140,在本发明的具体实施例中,该计算模块140首先根据模式控制信号判断当前的模式,如果当前模式为第一模式或者第二模式,计算模块140根据两帧图像得到当前帧的深度信息,而如果当前模式为第三模式或者第四模式,则不经过计算模块140处理该视频信号。Calculation module 140, in a specific embodiment of the present invention, the calculation module 140 first judges the current mode according to the mode control signal, if the current mode is the first mode or the second mode, the calculation module 140 obtains the current frame according to the two frames of images Depth information, and if the current mode is the third mode or the fourth mode, the video signal is not processed through the calculation module 140 .

渲染模块150,首先判断当前工作模式,如果当前工作模式为平面图像转立体模式图像(主动立体显示,第一模式)或者平面图像转立体模式图像(主动立体显示,第二模式),则渲染模块150对经计算模块140发送的深度图和原图进行渲染,得到第一模式对应的主动立体视频信号,或者得到第二模式对应的红绿立体视频信号;当该装置当前工作在第三模式时,渲染模块150对由存储控制器130发送的当前帧视频的两视图(左视图和右视图)进行合并;如果当前工作模式为第四模式,则视频信号直接由存储控制器130直接发送到帧率变换器160中,而不需要经过渲染模块150处理。The rendering module 150 first judges the current working mode, if the current working mode is to turn a plane image into a stereoscopic mode image (active stereoscopic display, the first mode) or a plane image into a stereoscopic mode image (active stereoscopic display, the second mode), then the rendering module 150 renders the depth map and the original image sent by the computing module 140 to obtain an active stereoscopic video signal corresponding to the first mode, or obtain a red-green stereoscopic video signal corresponding to the second mode; when the device is currently working in the third mode , the rendering module 150 merges the two views (left view and right view) of the current frame video sent by the storage controller 130; if the current working mode is the fourth mode, the video signal is directly sent to the frame by the storage controller 130 In the rate converter 160, it does not need to be processed by the rendering module 150.

帧率变换器160,帧率变换器160接收来自于存储控制器130和渲染模块150中的视频信号,当在平面图像转立体模式图像(主动立体显示,第一模式)、平面图像转立体模式图像(红绿立体显示,第二模式)和第三模式时。接收来自于渲染模块150中的视频信号,在第四模式时,接收来自于存储控制器130中的视频信号。而后该帧率变换器160根据当前电视机的需求,对生成的视频的帧率进行变换,接着把帧率得到变换后的视频发送出去。Frame rate converter 160, the frame rate converter 160 receives video signals from the storage controller 130 and the rendering module 150, when the planar image is converted to a stereoscopic mode image (active stereoscopic display, the first mode), and the planar image is converted to a stereoscopic mode Image (red and green stereoscopic display, second mode) and third mode. The video signal from the rendering module 150 is received, and the video signal from the storage controller 130 is received in the fourth mode. Then the frame rate converter 160 converts the frame rate of the generated video according to the requirements of the current TV set, and then sends out the video with the converted frame rate.

视频发射器170,该视频发射器170用于把适合该用于数字电视终端的电视信号转换装置100内各模块处理的数字格式转化为向电视机器输送的视频信号。在本发明的一个实施例中,该转换后的视频信号可以为高清晰度数字多媒体视频信号、(如:HDMI数字格式、DVI数字格式信号)、分量模拟视频信号或复合模拟视频信号,当然,该转换后的视频信号并不局限于上述格式的视频信号,可以为任何能够在现实终端现实的格式信号。A video transmitter 170, the video transmitter 170 is used to convert the digital format suitable for processing by each module in the TV signal conversion device 100 for digital TV terminal into a video signal sent to the TV machine. In one embodiment of the present invention, the converted video signal can be a high-definition digital multimedia video signal, (such as: HDMI digital format, DVI digital format signal), component analog video signal or composite analog video signal, of course, The converted video signal is not limited to the video signal in the above-mentioned format, and may be any format signal that can be realized on a real terminal.

通过本发明提出的用于数字电视终端的电视信号转换装置,很好的解决了电视传输系统和电视终端显示之间的不匹配问题,本装置能够将平面视频信号通过一定的算法转化为立体视频信号,同时也能将立体视频信号方便灵活的转变成供普通电视机观看的红绿立体信号,实现了视频信号间的灵活转换,使用户得在观看电视节目或者视频节目的时候有了更好的图像体验效果,增强了视觉效果,另外,该装置操作简单,整个视频信号有着很高的转换效率。The TV signal conversion device for digital TV terminals proposed by the present invention solves the mismatch problem between the TV transmission system and the TV terminal display, and the device can convert plane video signals into stereoscopic video signals through a certain algorithm. At the same time, it can conveniently and flexibly transform the stereoscopic video signal into a red-green stereoscopic signal for ordinary TV sets, realizing the flexible conversion between video signals, so that users have a better experience when watching TV programs or video programs. The image experience effect enhances the visual effect. In addition, the device is easy to operate, and the entire video signal has a high conversion efficiency.

尽管已经示出和描述了本发明的实施例,对于本领域的普通技术人员而言,可以理解在不脱离本发明的原理和精神的情况下可以对这些实施例进行多种变化、修改、替换和变型,本发明的范围由所附权利要求及其等同限定。Although the embodiments of the present invention have been shown and described, those skilled in the art can understand that various changes, modifications and substitutions can be made to these embodiments without departing from the principle and spirit of the present invention. and modifications, the scope of the invention is defined by the appended claims and their equivalents.

Claims (8)

1. a TV signal conversion equipment that is used for digital TV terminal is characterized in that, comprising: video receiver, storage control, computing module, rendering module, frame per second converter, mode controller and video transmitter,
Said mode controller produces mode control signal according to user's configuration, and wherein, said mode control signal is controlled said storage control, said computing module and said rendering module;
Said video receiver be used to receive with the converting video signal to obtain the digital format images of each two field picture;
Said storage control is used to store said digital format images and according to said mode control signal said digital format images is controlled;
Said computing module links to each other with said storage control, is used for according to said control signal said digital format images being carried out depth conversion, to obtain depth image;
Said rendering module links to each other with said storage control with said computing module respectively, is used for according to said mode control signal said depth image or said digital format images being played up, to obtain rendering image;
Said frame per second converter links to each other with said rendering module with said storage control, is used to receive the frame per second with said digital format images of conversion and/or said rendering image, to obtain the frame per second changing image; And
The vision signal of the form that video transmitter, said video transmitter are used to change said frame per second changing image after with the output format conversion.
2. the TV signal conversion equipment that is used for digital TV terminal as claimed in claim 1; It is characterized in that; Said mode control signal comprises first mode control signal, second mode control signal, three-mode control signal and four-mode control signal; Wherein, said first mode control signal is that the three-dimensional pattern signal is changeed on the plane, and said second mode control signal is that red green three-dimensional pattern signal is changeed on the plane; Said three-mode control signal is the three-dimensional red green pattern signal that changes, and said four-mode control signal is the " shut " mode" signal.
3. the TV signal conversion equipment that is used for digital TV terminal as claimed in claim 1; It is characterized in that the vision signal after said vision signal and the format conversion is high definition digital multimedia video signal, component analog video signal or composite analog video signal.
4. the TV signal conversion equipment that is used for digital TV terminal as claimed in claim 2; It is characterized in that; Said storage control is used to store said digital format images and according to said mode control signal said digital format images is controlled, and further comprises:
Judge the classification of said mode control signal;
If said mode control signal is first mode control signal or second mode control signal, then said storage control with the digital format images of present frame and in advance the digital format images of the former frame of the said present frame of buffer memory send to said computing module simultaneously;
If said mode control signal is the three-mode control signal, then said storage control with the left view of said digital format images and in advance the right view of the said digital format images of buffer memory send to said rendering module simultaneously; With
If said mode control signal is the four-mode control signal, then said storage control sends to said frame per second converter with said digital format images.
5. the TV signal conversion equipment that is used for digital TV terminal as claimed in claim 4 is characterized in that said computing module carries out depth conversion according to said mode control signal to said digital format images, further comprises:
Judge the classification of said mode control signal;
If said mode control signal is first mode control signal or second mode control signal; Then said computing module according to the digital format images of present frame and in advance the digital format images of the former frame of the said present frame of buffer memory obtain the depth image of the digital format images of said present frame, and the digital format images of sending said depth image and said present frame to said rendering module.
6. the TV signal conversion equipment that is used for digital TV terminal as claimed in claim 4 is characterized in that, said rendering module is played up said depth image or said digital format images according to said mode control signal, further comprises:
Judge the classification of said mode control signal;
If said mode control signal is first mode control signal; Then said rendering module is played up the digital format images of said depth image and said present frame; Obtaining and the left view and the right view of the digital format images of the said present frame of buffer memory, and successively said left view and right view are sent to said frame per second converter;
If said mode control signal is second mode control signal; Then said rendering module is played up the digital format images of said depth image and said present frame; Obtaining and the red green image of the digital format images of the said present frame of buffer memory, and said red green image is sent to said frame per second converter;
If said mode control signal is the three-mode control signal; Then said rendering module to the left view of said digital format images and in advance the right view of the said digital format images of buffer memory extract red respectively and blue-green composition and synthesizing, to obtain the red green video image of said digital format images.
7. the TV signal conversion equipment that is used for digital TV terminal as claimed in claim 1; It is characterized in that; Said frame per second converter carries out corresponding frame per second conversion according to the demand of different television equipments to said digital format images and/or said rendering image, and sends to said video transmitter to the image after the frame per second conversion.
8. the TV signal conversion equipment that is used for digital TV terminal as claimed in claim 7; It is characterized in that; The image of said video transmitter after to said frame per second conversion carries out format conversion, to obtain high definition of image digital multimedia vision signal, component analog video signal or the composite analog video signal after the said frame per second conversion.
CN2010105913840A 2010-12-16 2010-12-16 A TV signal conversion device for digital TV terminal Expired - Fee Related CN102036090B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2010105913840A CN102036090B (en) 2010-12-16 2010-12-16 A TV signal conversion device for digital TV terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2010105913840A CN102036090B (en) 2010-12-16 2010-12-16 A TV signal conversion device for digital TV terminal

Publications (2)

Publication Number Publication Date
CN102036090A CN102036090A (en) 2011-04-27
CN102036090B true CN102036090B (en) 2012-05-02

Family

ID=43888309

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2010105913840A Expired - Fee Related CN102036090B (en) 2010-12-16 2010-12-16 A TV signal conversion device for digital TV terminal

Country Status (1)

Country Link
CN (1) CN102036090B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102186096A (en) * 2011-05-20 2011-09-14 南京大学 3D display set-top box of common television set
CN105657486A (en) * 2015-08-21 2016-06-08 乐视致新电子科技(天津)有限公司 Audio/video playing equipment
CN105657489A (en) * 2015-08-21 2016-06-08 乐视致新电子科技(天津)有限公司 Audio/video playing equipment
CN105657488A (en) * 2015-08-21 2016-06-08 乐视致新电子科技(天津)有限公司 Audio/video playing equipment
CN105657490A (en) * 2015-08-21 2016-06-08 乐视致新电子科技(天津)有限公司 Audio/video playing equipment
CN111105766B (en) * 2019-12-04 2022-08-26 昆山龙腾光电股份有限公司 Frequency conversion method, frequency conversion module, time sequence processing device and readable storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101087437A (en) * 2007-06-21 2007-12-12 清华大学 Method for plane video converting to 3D video based on optical stream field
CN101479765A (en) * 2006-06-23 2009-07-08 图象公司 Methods and systems for converting 2D motion pictures for stereoscopic 3D exhibition
CN101483788A (en) * 2009-01-20 2009-07-15 清华大学 Method and apparatus for converting plane video into tridimensional video
CN101400001B (en) * 2008-11-03 2010-06-02 清华大学 A method and system for generating a video frame depth map
CN101795419A (en) * 2010-02-01 2010-08-04 周晓民 Technical scheme for transforming 2D video image signals to 3D video image signals and application thereof

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101506926B1 (en) * 2008-12-04 2015-03-30 삼성전자주식회사 Method and appratus for estimating depth, and method and apparatus for converting 2d video to 3d video

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101479765A (en) * 2006-06-23 2009-07-08 图象公司 Methods and systems for converting 2D motion pictures for stereoscopic 3D exhibition
CN101087437A (en) * 2007-06-21 2007-12-12 清华大学 Method for plane video converting to 3D video based on optical stream field
CN101400001B (en) * 2008-11-03 2010-06-02 清华大学 A method and system for generating a video frame depth map
CN101483788A (en) * 2009-01-20 2009-07-15 清华大学 Method and apparatus for converting plane video into tridimensional video
CN101795419A (en) * 2010-02-01 2010-08-04 周晓民 Technical scheme for transforming 2D video image signals to 3D video image signals and application thereof

Also Published As

Publication number Publication date
CN102036090A (en) 2011-04-27

Similar Documents

Publication Publication Date Title
US20210235065A1 (en) Process and system for encoding and playback of stereoscopic video sequences
US9161023B2 (en) Method and system for response time compensation for 3D video processing
CN102763421B (en) The apparatus and method of process video content
JP5763184B2 (en) Calculation of parallax for 3D images
JP6030230B2 (en) Panorama-based 3D video coding
CN101453662B (en) Stereo video communication terminal, system and method
CN102036090B (en) A TV signal conversion device for digital TV terminal
CN103220543B (en) Real-time 3D video communication system and its realization method based on KINECT
CN103475894B (en) A 3D laparoscopic video processing method
JP2018530952A (en) Method and apparatus for processing an audio signal associated with a video image
JP2012029220A (en) Stereoscopic video output device and backlight control method
CN102291587B (en) Full high-definition 3D (Three Dimensional) video processing method
WO2010099178A2 (en) System and method for displaying multiple images/videos on a single display
CN101047872B (en) Stereo audio vedio device for TV
US20110157302A1 (en) Three-dimensional video display system with multi-stream sending/receiving operation
US9628769B2 (en) Apparatus and method for generating a disparity map in a receiving device
JP6581241B2 (en) Hardware system for 3D video input on flat panel
CN102469324A (en) Three-dimensional image capturing device and control chip thereof
CN101742315B (en) Full HD 3D Video Signal Conversion System
JP2001069530A (en) High-efficiency stereoscopic video coding system
WO2015132957A1 (en) Video device and video processing method
Bondarev et al. On the technology roadmap of free-viewpoint 3DTV receivers
KR101659623B1 (en) A method for processing data and stereo scopic image palying device
CN113891101A (en) Live broadcast method for real-time three-dimensional image display

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20120502