TW201423489A - Three-dimensional stereo display device and method - Google Patents

Abstract

A method for a three-dimensional stereo display device comprises generating a detection result according to an user information, generating a disparity range signal according to the detection signal, a display information and a comfortable model, retrieving a dense disparity map signal of an original display signal, generating an adjusted disparity map signal according to the disparity range signal and the dense disparity map signal, and outputting an adjusted display signal according to the adjusted disparity map signal and the original display signal, so as to process a three-dimensional stereo display operation of the three-dimensional stereo display device.

Description

Three-dimensional stereoscopic display device and method thereof

The present invention relates to a three-dimensional stereoscopic display device and a method thereof, and more particularly to a three-dimensional stereoscopic display device and a method thereof for adjusting an output signal according to a comfort model and a user information.

With the continuous advancement of imaging technology, the size and function of display devices that consumers can choose are increasingly diverse, and in order to meet the needs of different users, manufacturers of display devices have also managed to provide new products with better output performance and better resolution. One of the most noteworthy products is how to use the three-dimensional display technology in a movie scene on a universal or home display device.

The common three-dimensional display technology is based on the human visual system principle, and simultaneously displays image information with different disparity in both left and right eyes, and common techniques are polarized and interlaced. Display mode such as (Interlaced) or time-sharing (Anaglyph). In the process of filming, in order to produce different images for both eyes, two or more cameras are often used and different depth parameters are pre-set for filming, so that all viewers in the cinema can enjoy the vivid three-dimensional image. . However, in order to display the stereoscopic image of the movie, the manner of shooting and the size of the playing field of the movie theater need to be designed corresponding to each other, therefore, if it is desired to reproduce the stereoscopic image of the cinema in a general or small display device It is obviously difficult, and of course, there are post-processing of other images, which are adapted to the specifications of different small-sized display devices, so that a better three-dimensional display image can be obtained on the small-sized display device, but the actual operation is The post-production image effect may sacrifice some of the image resolution, and the user who is viewing may also have the possibility of visual fatigue or dizziness because the image obtained by the post-production is not completely in conformity with the display device. Therefore, it has become an important subject in the art to provide a three-dimensional display device and a method for adjusting an output signal according to a comfort model and a user information.

Therefore, the main object of the present invention is to provide a three-dimensional stereoscopic display device and method for adjusting an output signal according to a comfort model and a user information.

A method for a three-dimensional display device includes: generating a detection result according to a user information; generating a parallax range signal according to the detection result, a display device information, and a comfort model; Extracting a density parallax image signal of the original display signal; generating an adjusted parallax image signal according to the parallax range signal and the density parallax image signal; and outputting the parallax image signal and the original display signal according to the adjusted The display signal is adjusted to cause the three-dimensional display device to perform a three-dimensional display operation.

A three-dimensional display device includes a detection module for generating a detection result according to a user information, and a determination module for using the detection result, a display device information, and a Comfort model, generating a parallax range a receiving module for capturing a density parallax image signal of an original display signal; an adjusting module for generating an adjusted parallax image signal according to the parallax range signal and the density parallax image signal And an output module for outputting an adjusted display signal according to the adjusted parallax image signal and the original display signal, so that the three-dimensional display device performs a three-dimensional stereoscopic display operation.

Please refer to FIG. 1 . FIG. 1 is a schematic diagram of a three-dimensional display device 10 according to an embodiment of the present invention. The internal structure of the three-dimensional display device 10 is simply illustrated. Of course, the three-dimensional display device 10 may also include other Display elements, such as a light guide, a light source generating module, and a display panel, are not intended to limit the scope of the present invention. As shown in FIG. 1 , the three-dimensional display device 10 includes a detection module 100 , a determination module 102 , a receiving module 104 , an adjustment module 106 , and an output module 108 . Preferably, the three-dimensional stereoscopic display device 10 of the present embodiment can reproduce the stereoscopic image of the movie theater on a general-purpose or small-sized display device without sacrificing original image resolution, and for long-time viewing users. It can also reduce visual fatigue or avoid dizziness.

In detail, the detection module 100 is an image detection module (for example, a lens module) for detecting a viewing distance between a user (not shown) and the three-dimensional display device 10. At the same time, the distance D between the two eyes of the user is also detected, and a detection result S_D is generated to the determination module 102. Of course, the detection module 100 can also directly use the Face/Eye tracking technology to obtain the viewing distance instantly/simultaneously. The detection result S_D from V and the distance D between the eyes is also within the scope of the invention. The manner in which the detection module 100 is disposed is well known to those of ordinary skill in the art. As long as the design of the three-dimensional display device 10 is adapted to be disposed on the side of one of the three-dimensional display devices 10, All of them are within the scope of the invention and will not be described here.

The judging module 102 receives or presets a display device information and a comfort model in addition to the detection result S_D. Please refer to FIG. 2 again. FIG. 2 is a user and a three-dimensional stereoscopic display according to an embodiment of the present invention. A schematic diagram of the arrangement between the devices 10. As shown in FIG. 2, the display device information is basic information of the three-dimensional display device 10, for example, one display area W of the display panel, a display parallax P, a resolution R, and a display position of the user and a three-dimensional image. A relative display distance Z, the display panel of the three-dimensional display device 10 further includes a plurality of pixel units, and each pixel unit further includes a pixel unit parallax p. Please refer to FIG. 3 again. FIG. 3 is a schematic diagram of a comfort model according to an embodiment of the present invention. As shown in FIG. 3, the comfort model can be a Panum area model, but it is not used to limit the scope of the present invention, and is used to calculate the relative of the user according to the viewing angle of the user's eyes relative to the display panel. The viewing distance between the three-dimensional display device 10 is suitable for the user to view a three-dimensional image for a long time, and it is not easy to cause visual fatigue or dizziness. In this embodiment, the viewing distance provided by the comfort model is [Z ^- , Z ⁺ ], whereby the viewing distance [Z ^- , Z ⁺ ] can be substituted into the formula. Further, the upper and lower limits of the parallax of the pixel unit are determined as [p ^- , p ⁺ ], so that the determination module 102 can generate a parallax range according to the detection result S_D, the display device information, and the correlation parameter of the comfort model. The signal S_DR (ie, the upper and lower limits of the pixel unit parallax are [p ^- , p ⁺ ]) to the adjustment module 106.

The receiving module 104 receives an original display signal S_IN through a wireless/wired transmission, for example, a television program display signal, and in the embodiment, the original display signal S_IN is an original three-dimensional display image, and includes The plurality of sub-original display signals correspond to a plurality of pixel units of the display panel. In addition, the receiving module 104 further utilizes a stereo matching technology (Stereo matching technology) to capture a density parallax image signal S_DM of the original display signal S_IN, wherein the density parallax image signal S_DM includes a plurality of density parallax signals, and Corresponding to the plurality of sub-original display signals in the original display signal S_IN, respectively, to represent one of the disparity conditions P _{in the} three-dimensional display technology of the original display signal S_IN, and thereby output the density parallax image signal S_DM to the adjustment module 106.

The adjustment module 106 receives the parallax range signal S_DR (ie, the upper and lower limits of the pixel unit parallax are [p ^- , p ⁺ ]) and the density parallax image signal S_DM to output an adjusted parallax image signal S_ADM to the output module. 108. In this embodiment, a maximum density parallax signal P _max and a minimum density parallax signal P _min may be correspondingly obtained in the lower limit range [p ⁻ , p ⁺ ] of the parallax of the pixel unit, according to the three-dimensional display device 10 . The number of pixel units N included in the display panel and the parallax condition P _in corresponding to each pixel unit can be determined by a formula Corresponding to obtain an average density parallax signal τ. Of course, it is also possible to count and sort the plurality of input parallax conditions corresponding to all the pixel units, and accordingly select one of the plurality of input parallax conditions to form another median density parallax signal, and also The scope of the invention. Accordingly, by adjusting the parallax image signal S_ADM, the upper and lower limits of the pixel unit parallax range [p ^- , p ⁺ ], the average density parallax signal τ, the maximum density parallax signal P _{max ,} and the minimum density parallax signal P _min can be substituted into the formula. , the adjusted parallax image signal S_ADM can be obtained as P _out .

Please refer to FIG. 4 again. FIG. 4 is a schematic diagram of an average density parallax signal τ according to an embodiment of the present invention. As shown in FIG. 4, according to the parallax condition corresponding to each pixel unit and the selected different density parallax signal, the adjusted parallax image signal S_ADM (that is, P _out ) and a plurality of input parallax conditions can be correspondingly summarized. The relationship diagram can be further summarized into a lookup table, which is pre-stored in the adjustment module 106, so that the adjustment module 106 can directly according to the density parallax image signal S_DM and the upper and lower limits of the pixel unit parallax are [ p ^- , p ⁺ ], which adjusts the parallax image signal S_ADM to the output module 108 in the lookup table, without the need to obtain the above formula, is also within the scope of the invention.

Finally, the output module 108 receives the original display signal S_IN and adjusts the parallax image signal S_ADM to generate an adjusted display signal S_OUT, so that the three-dimensional display device 10 can perform a three-dimensional display operation. In this embodiment, the output module 108 uses a Depth image based rendering (DIBR) to adjust the display signal S_OUT corresponding to the converted original display signal S_IN, wherein the depth image mapping method further includes performing a noise. Elimination of processing, a three-dimensional image The 3D image warping process and a Hole filling process are performed to output a flat and realistic 3D stereoscopic image on the display panel. Of course, those skilled in the art can also use other image processing to further adjust one of the three-dimensional image color saturation or a frame rate, etc., which is not used in the scope of the present invention.

Briefly, the three-dimensional display device 10 provided in this embodiment receives the original display signal S_IN, and obtains user information corresponding to the user (ie, the viewer of the three-dimensional display device 10) and the original display signal S_IN. After the density parallax image signal S_DM is included, the parallax range signal S_DR is generated by the determining module 102 and the adjusted parallax image signal S_ADM is generated by the adjusting module 106, and finally the outputting module 108 outputs an adjusted display signal S_OUT. The three-dimensional stereoscopic display device 10 can perform a three-dimensional stereoscopic display operation on the display panel to comfortably provide a three-dimensional stereoscopic image equivalent to the movie theater of the user. In this case, the embodiment can adaptively adjust the input three-dimensional stereoscopic image signal according to the relative position of the display panel and the user, and for convenience of description, the determination module 102 and the adjustment mode are drawn in FIG. 1 . The independent block diagrams of the group 106 and the output module 108 clearly illustrate the respective operating mechanisms. Of course, those skilled in the art can further integrate the judging module 102, the adjusting module 106 and the output module 108 to form a single processing. The module enables the three-dimensional display device 10 to directly execute the calculation process corresponding to the determination module 102, the adjustment module 106, and the output module 108 according to the detection result S_D of the user after receiving the original display signal S_IN. The operating mechanism, and finally the corresponding output adjustment display signal S_OUT, is also within the scope of the invention.

In the present embodiment, one of the display operation methods applied to the three-dimensional display device 10 can be further summarized into a three-dimensional display flow 50, as shown in FIG. The three-dimensional display process 50 includes the following steps:

Step 500: Start.

Step 502: The detection module 100 generates a detection result S_D according to the user information.

Step 504: The determining module 102 generates a parallax range signal S_DR according to the detection result S_D, the display device information, and the comfort model.

Step 506: The receiving module 104 captures the density parallax image signal S_DM of the original display signal S_IN.

Step 508: The adjustment module 106 generates the adjusted parallax image signal S_ADM according to the parallax range signal S_DR and the density parallax image signal S_DM.

Step 510: The output module 108 outputs the adjusted display signal S_OUT according to the adjusted parallax image signal S_ADM and the original display signal S_IN, so that the three-dimensional display device 10 performs a three-dimensional stereoscopic display operation.

Step 512: End.

The detailed operation of each step in the three-dimensional display process 50 can be described with reference to the foregoing embodiments in FIGS. 1 to 4 and related paragraphs, and details are not described herein. Preferably, the sequence of operations from step 502 to step 506 can be adjusted according to actual requirements. For example, after the three-dimensional display device 10 is activated, step 506 is first performed, which is regarded as a mechanism for starting the three-dimensional display process 50. In order to determine whether the three-dimensional stereoscopic display device 10 needs to perform a three-dimensional stereoscopic display operation, if it is determined that the three-dimensional stereoscopic display device 10 needs to be performed After the three-dimensional display operation, step 502, step 504, and step 508 to step 510 are sequentially performed, which is also the scope of the present invention. In addition, the three-dimensional stereoscopic display operation provided by the embodiment can be combined with other image processing mechanism processes to provide a user to directly enjoy the three-dimensional stereoscopic image equivalent to the cinema in the naked eye state, and can be used according to different uses. The viewing environment of the user automatically performs an initial correction operation after the first launch of the three-dimensional display device 10, or is also equipped with a user input interface, and is provided with a plurality of comfort models and/or situational models for use. The suitability of the person is also within the scope of the invention.

In summary, the embodiment of the present invention provides a three-dimensional stereoscopic display device and a method thereof, which can adaptively adjust an output signal according to a comfort model and a user information to perform a three-dimensional stereoscopic display operation, as compared with The display device of the prior art may be difficult to completely display the stereoscopic image in the movie theater or sacrifice the image resolution of the part. In this embodiment, the stereoscopic image of the movie theater can be reproduced on a general or small display device, not only Maintaining the original image resolution can also reduce the visual fatigue of the user who is viewing the three-dimensional image for a long time or avoid the possibility of dizziness, thereby improving the application range of the three-dimensional display device.

The above are only the preferred embodiments of the present invention, and all changes and modifications made to the scope of the present invention should be within the scope of the present invention.

10‧‧‧Three-dimensional display device

100‧‧‧Detection module

102‧‧‧Judgement module

104‧‧‧Output device

106‧‧‧Adjustment module

108‧‧‧Output module

50‧‧‧Three-dimensional display process

500, 502, 504, 506, 508, 510, 512 ‧ ‧ steps

D‧‧‧ distance between eyes

S_D‧‧‧Detection results

S_DR‧‧‧parallax range signal

S_IN‧‧‧ original display signal

S_DM‧‧‧Density parallax image signal

S_ADM‧‧‧Adjustment of parallax image signal

S_OUT‧‧‧Adjust the display signal

P‧‧‧display parallax

V‧‧‧ viewing distance

W‧‧‧Display range

Z‧‧‧ relative display distance

τ‧‧‧Average density parallax signal

FIG. 1 is a schematic diagram of a three-dimensional stereoscopic display device according to an embodiment of the present invention.

2 is a schematic diagram of a user and a three-dimensional stereoscopic display device according to an embodiment of the present invention.

FIG. 3 is a schematic diagram of a comfort model according to an embodiment of the present invention.

FIG. 4 is a schematic diagram of an average density parallax signal according to an embodiment of the present invention.

FIG. 5 is a flow chart of a three-dimensional stereoscopic display process according to an embodiment of the present invention.

10‧‧‧Three-dimensional display device

100‧‧‧Detection module

102‧‧‧Judgement module

104‧‧‧Output device

106‧‧‧Adjustment module

108‧‧‧Output module

S_D‧‧‧Detection results

S_DR‧‧‧parallax range signal

S_IN‧‧‧ original display signal

S_DM‧‧‧Density parallax image signal

S_ADM‧‧‧Adjustment of parallax image signal

S_OUT‧‧‧Adjust the display signal

Claims (18)

A method for a three-dimensional display device includes: generating a detection result according to a user information; generating a parallax range signal according to the detection result, a display device information, and a comfort model; a density parallax image signal of the original display signal; generating an adjusted parallax image signal according to the parallax range signal and the density parallax image signal; and outputting an adjustment according to the adjusted parallax image signal and the original display signal The signal is displayed to cause the three-dimensional display device to perform a three-dimensional display operation. The method of claim 1, wherein the step of generating the detection result according to the user information comprises: detecting a viewing distance between the user and the three-dimensional display device; detecting the user a distance between one eye and two eyes; and the detection result is generated according to the viewing distance and the distance between the two eyes. The method of claim 1, wherein the display device information comprises a resolution, a display range, a display disparity, a pixel unit disparity, and a relative display distance. The method of claim 1, wherein the comfort model is a Panum area model. The method of claim 1, wherein the step of extracting the density parallax image signal of the original display signal further comprises: using a Stereo matching technology to capture the original display signal Density parallax image signal. The method of claim 5, wherein the density parallax image signal comprises a plurality of density parallax signals, and the original display signal comprises a plurality of sub-original display signals corresponding to the plurality of pixel units of the three-dimensional display device. . The method of claim 6, further comprising: using the stereo matching technique to capture the plurality of density disparity signals corresponding to the plurality of sub-original display signals, wherein the plurality of density disparity signals include a maximum density disparity signal And a minimum density parallax signal. The method of claim 7, wherein the step of adjusting the disparity image signal is generated according to the disparity range signal and the density parallax image signal, comprising: obtaining an average density disparity signal according to the plurality of density disparity signals And generating the adjusted parallax image signal according to the average density parallax signal, the maximum density parallax signal, the minimum density parallax signal, and the parallax range signal. The method of claim 1, wherein the adjusted display signal is output according to the adjusted parallax image signal and the original display signal, so that the three-dimensional display device is The step of performing the three-dimensional stereoscopic display operation includes: converting the original display signal into the adjusted display signal by using a Depth image based rendering (DIBR) and the adjusted parallax image signal, so that the three-dimensional The display device displays the adjustment display signal and performs the three-dimensional display operation. A three-dimensional display device includes: a detection module for generating a detection result according to a user information; and a determination module for using the detection result, a display device information, and a comfort level The model generates a parallax range signal; a receiving module is configured to capture a density parallax image signal of an original display signal; and an adjustment module is configured to generate the signal according to the parallax range signal and the density parallax image signal An adjustment parallax image signal; and an output module configured to output an adjusted display signal according to the adjusted parallax image signal and the original display signal, so that the three-dimensional stereoscopic display device performs a three-dimensional stereoscopic display operation. The three-dimensional display device of claim 10, wherein the detection module further detects an apparent distance between the user and the three-dimensional display device and a distance between the two eyes of the user to generate the detection. result. The three-dimensional display device of claim 10, wherein the display device information includes a resolution, a display range, a display disparity, and a pixel unit parallax. And a relative display distance. The three-dimensional display device of claim 10, wherein the comfort model is a Panum area model. The three-dimensional display device of claim 10, wherein the receiving module further utilizes a Stereo matching technology to capture the density parallax image signal of the original display signal. The three-dimensional display device of claim 14, wherein the density parallax image signal comprises a plurality of density parallax signals, and the original display signal comprises a plurality of sub-original display signals corresponding to the plurality of three-dimensional display devices. Pixel units. The three-dimensional display device of claim 15, wherein the receiving module further uses the stereo matching technique to capture the plurality of density parallax signals corresponding to the plurality of sub-original display signals, and the plurality of density parallax signals It includes a maximum density parallax signal and a minimum density parallax signal. The three-dimensional display device of claim 16, wherein the adjustment module further obtains an average density parallax signal according to the plurality of density parallax signals, and according to the average density parallax signal, the maximum density parallax signal, the minimum density The parallax signal and the parallax range signal are generated to generate the adjusted parallax image signal. The three-dimensional display device of claim 10, wherein the output module further converts the original display signal into the adjusted display by using a Depth image based rendering (DIBR) and the adjusted parallax image signal. The signal causes the three-dimensional display device to display the adjusted display signal and perform the three-dimensional display operation.