CN111757088A - A naked-eye stereoscopic display system with lossless resolution - Google Patents

Abstract

The present invention relates to a multi-view naked-eye stereoscopic display, comprising a display screen with a display panel and a grating, a video signal interface for receiving 3D video signals, and one or more 3D video processing units, wherein the display panel includes multiple lines and multiple Columns of pixels and defining a plurality of pixel groups, each pixel group consisting of at least 3 pixels and corresponding to a multi-view setup, wherein the one or more 3D video processing units are configured to generate images based on the 3D video signals corresponding to A plurality of images of all viewpoints or predetermined viewpoints are rendered and corresponding pixels in each pixel group are rendered according to the generated plurality of images. In some embodiments, the mutual arrangement positions of the plurality of pixel groups are adjusted or determined based on the optical relationship data between pixels and gratings and/or the corresponding relationship data between pixels and viewpoints of the display panel. The present invention also provides a naked-eye stereoscopic display system, a display method for a naked-eye stereoscopic display, and a pixel group arrangement method for the naked-eye stereoscopic display.

Description

A naked-eye stereoscopic display system with lossless resolution

technical field

The present invention relates to the field of stereoscopic images, in particular to a naked-eye stereoscopic display technology. Specifically, the present invention relates to a naked eye stereoscopic (3D) display system.

Background technique

Stereoscopic imaging is one of the hottest technologies in the video industry, driving the technological change from flat display to stereoscopic display. Stereoscopic display technology is a key part of the stereoscopic image industry, and is mainly divided into two categories, namely, eye-based stereoscopic display and naked-eye stereoscopic display technology. The naked-eye stereoscopic display technology is a technology that enables viewers to view stereoscopic display images without wearing glasses. Compared with the eye-type stereoscopic display, the naked-eye stereoscopic display belongs to the autostereoscopic display technology, which reduces the constraints on the viewer.

Usually, the naked-eye stereoscopic display is based on viewpoints, and a sequence of parallax images (frames) is formed at different positions in space, so that the stereoscopic image pairs with parallax relationship can enter the left and right eyes of a person respectively, thereby bringing stereoscopic to the viewer. sense. For a conventional multi-view naked-eye stereoscopic (3D) display with eg N viewpoints, multiple independent pixels on the display panel are required to project multiple viewpoints in space. Since the total resolution of the display panel is a fixed value, the resolution will drop sharply, for example, the column resolution will be reduced to 1/N of the original resolution. This also results in different reductions in resolution horizontally and vertically due to the pixel arrangement of multi-view displays.

If high-definition display is to be maintained, in the case of providing high-definition, for example, an N-view 3D display device that is N times larger than a 2D display device, the transmission bandwidth from the terminal to the display that needs to be occupied is also multiplied by N, resulting in a signal transmission volume. too big. Moreover, the pixel-level rendering of such an N-fold high-resolution image will seriously occupy the computing resources of the terminal or the display itself, resulting in a significant drop in performance.

The background art is only for the convenience of understanding the relevant technology in the field, and is not regarded as an admission of the prior art.

SUMMARY OF THE INVENTION

Embodiments of the present invention are intended to provide a multi-view naked-eye stereoscopic display and a display method thereof, and are intended to overcome or alleviate the problem of resolution reduction of the naked-eye stereoscopic display without occupying excessive transmission bandwidth or rendering computing resources.

In addition, the inventors have also realized that, due to the installation, material or alignment of the grating, there may be situations in which the pixels of the display screen viewed by the viewpoint in space do not correspond to the "ideal" pixels (or vice versa). question. In some embodiments of the present invention, a completely new technical solution for the technical problem is also provided.

In one technical solution, a multi-view naked-eye stereoscopic display is provided, which is characterized by comprising a display screen with a display panel and a grating, a video signal interface for receiving 3D video signals, and one or more 3D video processing units, wherein The display panel includes a plurality of rows and columns of pixels and defines a plurality of pixel groups, each pixel group is composed of at least 3 pixels and corresponds to a multi-view setting, wherein the one or more 3D video processing units are configured to be based on the The image of the 3D video signal generates a plurality of images corresponding to all viewpoints or predetermined viewpoints and renders corresponding pixels in each pixel group according to the generated plurality of images.

In the technical solutions of the embodiments of the present invention, the generated images are generated from the images of the received 3D video signal corresponding to all viewpoints or predetermined viewpoints in a "resolution lossless" manner, that is, according to the required (all viewpoints) or predetermined) viewpoint to generate images and render pixels "point-to-point" from the images of the original 3D video signal. This advantageously overcomes the problem of reduced resolution in the prior art. In an embodiment of the present invention, the "resolution lossless" or "point-to-point" rendering explicitly includes that the image corresponding to a single viewpoint has the same resolution as the image (frame) of the received 3D video signal and that in each pixel group Pixels corresponding to each viewpoint (or pixels determined from the pixel-viewpoint correspondence) correspond substantially point by point to the generated image (and thus the received image). The "resolution lossless" or "point-to-point" rendering may also include the following embodiments, that is, interpolating or otherwise increasing the resolution of the received 3D video signal, and then corresponding to the "resolution lossless" way. The interpolated or increased resolution image generates images for each viewpoint and accordingly renders the pixels in each pixel group corresponding to each viewpoint (or pixels determined from pixel-viewpoint correspondence).

In one embodiment, the mutual arrangement positions of the plurality of pixel groups are adjusted or determined based on the optical relationship data between pixels and gratings and/or the corresponding relationship data between pixels and viewpoints of the display panel.

In one embodiment, the grating includes a cylindrical prism grating, and the optical relationship between the pixels and the grating includes an alignment relationship between the pixel and the cylindrical prism grating and/or a refraction state of the cylindrical prism grating relative to the corresponding pixel.

In one embodiment, the grating includes a front and/or rear parallax barrier grating, the parallax barrier grating includes a light-shielding part and a light-transmitting part, and the optical relationship between the pixel and the grating includes the difference between the pixel and the parallax barrier grating. The alignment relationship of the corresponding light-transmitting parts.

In one embodiment, the pixel to viewpoint correspondence is calculated or determined based on the optical relationship of the pixel to the grating.

In one embodiment, the correspondence of pixels to viewpoints is determined by measuring at each viewpoint location.

In one embodiment, the multi-view naked-eye stereoscopic display further comprises a memory storing the optical relationship data and/or the pixel-view correspondence data, the one or more 3D video processing units configured to read the memory data in .

In one embodiment, the received 3D video signal includes the received depth image and the rendered color image, and the generated image includes the generated depth image and the rendered color image.

In one embodiment, the received 3D video signal includes the received depth image and the rendered color image, and the generated image includes the generated first and second parallax images.

In one embodiment, the received 3D video signal includes the received first and second parallax images, and the generated images include the generated first and second parallax images.

In one embodiment, the received 3D video signal includes the received first parallax image and the second parallax image, and the generated images include a generated depth image and a rendered color image.

In one embodiment, multiple 3D video processing units are provided in the multi-view naked-eye stereoscopic display, and each 3D video processing unit is configured to allocate multiple rows or columns of pixels and render respective multiple rows or columns of pixels. . In one embodiment, the plurality of 3D video processing units may sequentially configure and render respective rows or columns of pixels. For example, if 4 3D video processing units are provided, and the display panel is provided with M columns of pixels in total, then each 3D video processing unit is sequentially arranged with respective M/4 columns of pixels, for example, from left to right or from right to left.

In some embodiments of the present invention, the pixel driving and rendering of the display panel is progressive scan.

In some preferred embodiments of the present invention, the above-mentioned 3D video processing units each allocating multiple columns of pixels are combined with the progressive scanning, which has a prominent effect and effectively reduces the computational bandwidth.

In one embodiment, the one or more 3D video processing units are FPGA or ASIC chips or chipsets.

In one embodiment, the 3D video signal is a single-channel signal, and the one or more 3D video processing units are configured to generate a plurality of images corresponding to all viewpoints based on the single-channel 3D video signal and render them into each pixel group all pixels.

In one embodiment, the 3D video signal is a multi-channel signal, wherein the number of multi-view points is N, the number of multi-channel signals is M, and N≧M, and the one or more 3D video processing units are configured to generate corresponding N images of the viewpoint and all pixels in each pixel group are rendered, and each generated image is generated based on one of the M signals.

In one embodiment, the multi-view naked-eye stereoscopic display further includes an eye-tracking device or an eye-tracking data interface for acquiring eye-tracking data.

In one embodiment, the one or more 3D video processing units are configured to generate a plurality of images corresponding to predetermined viewpoints based on the images of the 3D video signal, and to render corresponding images in each pixel group according to the generated plurality of images pixels, the predetermined viewpoint is determined by the viewer's real-time eye-tracking data.

In one embodiment, the one or more 3D video processing units are configured to, when each eyeball of the viewer is located at a single viewpoint, generate an image corresponding to the single viewpoint based on the image of the 3D video signal and render each pixel The pixel corresponding to this single viewpoint in the group.

In one embodiment, the one or more 3D video processing units are configured to further generate images corresponding to viewpoints adjacent to the single viewpoint and to also render pixels corresponding to the adjacent viewpoints in each pixel group.

In one embodiment, the one or more 3D video processing units are configured to, when each eyeball of the viewer is located between two viewpoints, generate an image corresponding to the two viewpoints based on the image of the 3D video signal image and render the pixels corresponding to the two viewpoints in each pixel group.

In one embodiment, wherein the 3D video signal is a single-channel signal, the one or more 3D video processing units are configured to, when there are multiple viewers, based on the single-channel signal, for each viewer For the viewpoints corresponding to the respective eyeballs, the plurality of images are generated and the corresponding pixels in each pixel group are rendered.

In one embodiment, wherein the 3D video signal is a multi-channel signal, the one or more 3D video processing units are configured to, when there are multiple viewers, for at least some of the viewers corresponding to their respective eyeballs Viewpoint, the plurality of images are generated based on different 3D video signals and corresponding pixels in each pixel group are rendered.

In one embodiment, the display panel is a self-emissive display panel, and the self-emissive display panel is configured such that unrendered pixels do not emit light. Preferably, the display panel is a MICRO-LED display panel.

In another technical solution, a multi-view naked-eye stereoscopic display is provided, including a display screen with a display panel and a grating, a video signal interface and one or more 3D video processing units, wherein the display panel includes multiple rows and multiple columns of pixels and defines a plurality of pixel groups, each pixel group consisting of at least 3 pixels and corresponding to a multi-view setting, wherein the plurality of pixel groups have irregular mutual arrangement positions and are based on the optical relationship of the pixel to the grating and/or Or the corresponding relationship data between pixels and viewpoints of the display panel is adjusted or determined, wherein the one or more 3D video processing units are configured to render corresponding pixels in each pixel group.

Compared with the conventional method of improving the accuracy to overcome the alignment error, installation error, and material error, in the embodiment of the present invention, by simply adjusting the arrangement of the pixel groups, it provides simple, high-reliability high-definition, such as Naked-eye stereoscopic display with lossless resolution.

In one embodiment, the grating includes a cylindrical prism grating, and the optical relationship between the pixels and the grating includes an alignment relationship between the pixel and the cylindrical prism grating and/or a refraction state of the cylindrical prism grating relative to the corresponding pixel.

In one embodiment, the grating includes a front and/or rear parallax barrier grating, the parallax barrier grating includes a light-shielding part and a light-transmitting part, and the optical relationship between the pixel and the grating includes the difference between the pixel and the parallax barrier grating. The alignment relationship of the corresponding light-transmitting parts.

In one embodiment, the pixel to viewpoint correspondence is calculated or determined based on the optical relationship of the pixel to the grating.

In one embodiment, the correspondence of pixels to viewpoints is determined by measuring at each viewpoint location.

In one embodiment, the multi-viewpoint glasses-free stereoscopic display further comprises a memory storing the optical relationship data and/or the corresponding relationship data between pixels and viewpoints, and the one or more 3D video processing units are configured to read data in the memory.

In yet another technical solution, a multi-view naked-eye stereoscopic display is provided, comprising a display screen having a display panel and a grating, and a memory, wherein the display panel includes multiple rows and multiple columns of pixels, wherein the memory stores the display panel The optical relationship data between each pixel and the grating and/or the corresponding relationship data between each pixel of the display panel and the viewpoint. With the help of the stored data, a naked-eye stereoscopic display according to the present invention, in particular a "resolution lossless" naked-eye stereoscopic display, can be used.

Compared with the conventional improved precision to overcome alignment errors, installation errors, and material errors, the embodiments of the present invention provide a simple, high-reliability, high-definition, naked-eye stereoscopic display with lossless resolution.

In one embodiment, the grating includes a cylindrical prism grating, and the optical relationship between the pixels and the grating includes an alignment relationship between the pixel and the cylindrical prism grating and/or a refraction state of the cylindrical prism grating relative to the corresponding pixel.

In one embodiment, the grating includes a front and/or rear parallax barrier grating, the parallax barrier grating includes a light-shielding part and a light-transmitting part, and the optical relationship between the pixel and the grating includes the difference between the pixel and the parallax barrier grating. The alignment relationship of the corresponding light-transmitting parts.

In one embodiment, the pixel to viewpoint correspondence is calculated or determined based on the optical relationship of the pixel to the grating.

In one embodiment, the correspondence of pixels to viewpoints is determined by measuring at each viewpoint location.

In one embodiment, the multi-view naked-eye stereoscopic display further includes a video signal interface for receiving 3D video signals and one or more 3D video processing units, wherein the one or more 3D video processing units are configured to be based on The received video signals generate images corresponding to a plurality of 3D videos of some or all of the viewpoints, and the one or more 3D video processing units are further configured to read the alignment relationship data between each pixel of the display panel and the grating and/or data on the correspondence between each pixel of the display panel and a viewpoint, and rendering the pixels corresponding to some or all of the viewpoints based on the data.

In another technical solution, a naked-eye stereoscopic display system is provided, including a processor unit and a multi-view naked-eye stereoscopic display according to an embodiment of the present invention, wherein the processor unit is communicatively connected to the multi-view naked-eye stereoscopic display.

In one embodiment, the naked-eye stereoscopic display system is configured as a smart TV having the processor unit.

In one embodiment, the naked-eye stereoscopic display system is a smart cellular phone, a tablet computer, a personal computer or a wearable device.

In one embodiment, the naked-eye stereoscopic display system includes a set-top box or a cell phone or tablet capable of projecting as the processor unit and a multi-viewpoint computer connected to the set-top box, cell phone or tablet by wire or wirelessly Digital TV with naked-eye stereoscopic display.

In one embodiment, the naked-eye stereoscopic display system is configured as a smart home system or a part thereof, wherein the processor unit includes a smart gateway or a central controller of the smart home system, and the smart home system further includes a An eye-tracking device that acquires eye-tracking data.

In one embodiment, the naked eye stereoscopic display system is configured as an entertainment interactive system or a part thereof. Preferably, the entertainment interactive system is configured to be suitable for use by multiple people and to generate multiple 3D video signals based on multiple users for transmission to the naked eye stereoscopic display system.

In yet another technical solution, a method for displaying a multi-view naked-eye stereoscopic display is provided. The display includes a display screen having a display panel and a grating, wherein the display panel includes rows and columns of pixels. The method includes the steps of: defining a plurality of pixel groups, each pixel group consisting of at least 3 pixels and corresponding to a multi-view setting; receiving a 3D video signal; multiple images of the viewpoint; rendering corresponding pixels in each pixel group according to the generated multiple images.

In one embodiment, the step of defining a plurality of pixel groups includes: adjusting or determining the mutual arrangement positions of the plurality of pixel groups based on the optical relationship data between the pixels and the grating and/or the corresponding relationship data between the pixels and the viewpoints of the display panel .

In one embodiment, the display method further includes the step of: receiving or reading the implemented eye tracking data of the viewer. The generating step includes determining the predetermined viewpoint based on real-time eye tracking data by a viewer. The rendering step includes rendering pixels in each pixel group corresponding to the predetermined viewpoint.

In yet another technical solution, a method for displaying a multi-view naked-eye stereoscopic display is provided. The display includes a display screen having a display panel and a grating, wherein the display panel includes rows and columns of pixels. The method includes the following steps: acquiring optical relationship data between each pixel of the display panel and the grating and/or data on the corresponding relationship between each pixel of the display panel and the viewpoint; receiving a 3D video signal; and generating a corresponding image based on the received 3D video signal. Multiple images in all viewpoints or predetermined viewpoints; corresponding pixels are rendered according to the generated multiple images. The corresponding pixels to be rendered therein are determined based on the acquired optical relationship data and/or the corresponding relationship data of each pixel and the viewpoint.

In one embodiment, the step of acquiring data includes measuring the alignment data of each pixel and the grating and/or the refraction state of the cylindrical prism grating relative to each pixel as the optical relationship data.

In one embodiment, the step of acquiring data includes calculating or determining a pixel-viewpoint correspondence based on an optical relationship between the pixel and the grating, or determining the pixel-viewpoint correspondence by measuring at each viewpoint position.

In yet another technical solution, a method for arranging pixel groups of a multi-view naked-eye stereoscopic display is provided, comprising the steps of: providing a display screen with a display panel and a grating, wherein the display panel includes multiple rows and multiple columns of pixels; The optical relationship data between each pixel of the panel and the grating and/or the corresponding relationship data between each pixel of the display panel and the viewpoint; multiple pixel groups are defined based on the acquired optical relationship data and/or the corresponding relationship data between each pixel and the viewpoint. The pixel group is composed of at least 3 pixels and corresponds to a multi-view setting. The defined plurality of pixel groups are used for multi-view naked-eye stereoscopic display of the display.

Preferred features of the invention are described in part hereinafter, and in part will be apparent from a reading of the text.

Description of drawings

Hereinafter, the embodiments of the present disclosure will be described in detail with reference to the accompanying drawings, wherein:

FIG. 1A shows a schematic structural diagram of a multi-view naked-eye stereoscopic display according to an embodiment of the present invention.

FIG. 1B shows a schematic structural diagram of a multi-view naked-eye stereoscopic display according to an embodiment of the present invention.

FIG. 1C shows a schematic structural diagram of a multi-view naked-eye stereoscopic display according to an embodiment of the present invention.

FIG. 2 shows a schematic structural diagram of pixels in the display panel corresponding to viewpoints in the embodiment shown in FIGS. 1A-C .

FIG. 3 schematically shows a schematic diagram of generating an image corresponding to each viewpoint from an image (frame) of a received 3D video signal in the embodiment shown in FIGS. 1A-C .

FIG. 4 shows a schematic structural diagram of a single 3D video processing unit of a multi-view naked-eye stereoscopic display according to an embodiment of the present invention.

FIG. 5 shows a schematic structural diagram of multiple 3D video processing units of a multi-view naked-eye stereoscopic display according to an embodiment of the present invention.

FIG. 6 schematically shows a schematic diagram of generating an image corresponding to each viewpoint from an image (frame) of a received 3D video signal in the embodiment shown in FIG. 1 .

FIG. 7A shows a schematic structural diagram of a multi-view naked-eye stereoscopic display according to an embodiment of the present invention, and schematically shows that the correspondence between pixels and viewpoints in some pixel groups deviates.

FIG. 7B shows a schematic structural diagram of the multi-view naked-eye stereoscopic display of the embodiment of FIG. 7A , and schematically presents the corresponding relationship between adjustment pixels and viewpoints.

FIG. 8 shows a schematic structural diagram of a multi-view naked-eye stereoscopic display according to an embodiment of the present invention, and schematically presents the corresponding relationship between each pixel of the display panel and the viewpoint.

FIG. 9 shows a partial structural schematic diagram of a multi-view naked-eye stereoscopic display according to an embodiment of the present invention, which adopts a columnar prism grating.

FIG. 10 is a schematic diagram of a partial structure of a multi-view naked-eye stereoscopic display according to an embodiment of the present invention, which adopts a columnar prism grating.

FIG. 11 shows a partial structural schematic diagram of a multi-view naked-eye stereoscopic display according to an embodiment of the present invention, which adopts a parallax barrier grating.

FIG. 12 shows a schematic structural diagram of a multi-view naked-eye stereoscopic display using real-time eye tracking data according to an embodiment of the present invention, wherein each eye corresponds to one viewpoint.

FIG. 13 shows a schematic structural diagram of a multi-view naked-eye stereoscopic display using real-time eye tracking data according to an embodiment of the present invention, wherein each eye corresponds to one viewpoint.

FIG. 14 shows a schematic structural diagram of a multi-view naked-eye stereoscopic display using real-time eye tracking data according to an embodiment of the present invention, wherein each eye is located between two viewpoints.

FIG. 15 shows a schematic structural diagram of a multi-view naked-eye stereoscopic display using real-time eye tracking data according to an embodiment of the present invention, in which eyeballs are moved.

FIG. 16 shows a schematic structural diagram of a multi-view naked-eye stereoscopic display using real-time eye tracking data according to an embodiment of the present invention, wherein there are multiple viewers.

FIG. 17 schematically shows a schematic diagram of generating an image corresponding to a predetermined viewpoint from images (frames) of two channels of 3D video signals received in the embodiment shown in FIG. 16 .

FIG. 18 schematically shows that a multi-view naked-eye stereoscopic display system according to an embodiment of the present invention is configured as a cellular phone or a part thereof.

FIG. 19 schematically shows a multi-view naked-eye stereoscopic display system according to an embodiment of the present invention configured as a digital TV connected to a set-top box.

FIG. 20 schematically shows that a multi-view naked-eye stereoscopic display system according to an embodiment of the present invention is configured as a smart home system or a part thereof.

FIG. 21 schematically shows that a multi-view naked-eye stereoscopic display system according to an embodiment of the present invention is configured as an entertainment interactive system or a part thereof.

Detailed ways

In order to make the objectives, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail below with reference to the specific embodiments and accompanying drawings. Here, the exemplary embodiments of the present invention and their descriptions are used to explain the present invention, but not to limit the present invention.

definition

In this article, "naked-eye stereoscopic (3D) display" refers to technologies in which a viewer can observe a stereoscopic display image on a flat panel display without wearing glasses for stereoscopic display, including but not limited to "parallax barrier", "lenticular lens" , "pointing backlight" technology.

As used herein, "grating" has the broadest meaning in the art, including but not limited to "parallax barrier" gratings and "lenticular" gratings.

As used herein, "multi-viewpoint" has the conventional meaning in the art, and means that a sequence (frame) of parallax images is formed at different positions (viewpoints) in space. In this paper, multi-view will mean at least 3 viewpoints.

Referring to FIG. 1A , an embodiment of the present invention provides a naked-eye stereoscopic display system, which may include a processor unit and a multi-view naked-eye stereoscopic display, where the processor unit is communicatively connected to the multi-view naked-eye stereoscopic display. In some embodiments herein, the processor unit includes a processing\sending\forwarding\controlling device for sending a 3D video signal to a naked-eye stereoscopic display, which may be a device having both functions of generating and sending a 3D video signal, or may be A device that processes or does not process the received 3D video signal and forwards it to the display. In some embodiments, the processor unit may be included in or referred to as a processing terminal or terminal.

The multi-view naked-eye stereoscopic display may include a display screen having a display panel and a grating (not identified), a video signal interface for receiving a 3D video signal, and a 3D video processing unit. Referring to Figure 2, in the embodiment shown, the display may have 12 viewpoints (V1-V12), although it is contemplated that it may have more or fewer viewpoints.

In an embodiment of the present invention, the display may optionally further include a timing controller and/or a display driver chip, which may be integrated with the 3D video processing unit or independently configured.

In some embodiments of the invention, the display may also optionally include a memory to store desired data. Some memory-incorporated display embodiments of the present invention are further described below.

With continued reference to FIG. 1A , the display panel may include multiple rows and columns of pixels and define multiple pixel groups. In the embodiment shown, for the sake of illustration, only two illustrative pixel groups PG _1,1 and PG _x,y are shown, each pixel group corresponding to a multi-view setup, each with its own 12 pixels (P1-P12). As an illustrative embodiment, the pixels in the pixel group are arranged in the form of a single row and multiple columns, but other arrangement forms are conceivable, such as a single column and multiple rows or multiple rows and multiple columns. For illustrative description only, the aforementioned PG _{x, y} may schematically represent the pixel group in the X-th row and the Y-th column.

The display of the display of this embodiment is described with reference to FIGS. 1A and 2 in conjunction. As mentioned above, the display can have 12 viewpoints V1-V12, and the viewer's eyes can see the display of the corresponding pixel points in each pixel group in the display panel at each viewpoint (spatial position), and then see different the rendered picture. The two different pictures seen by the viewer's two eyes from different viewpoints form parallax, and the three-dimensional picture is synthesized in the brain.

In an embodiment of the invention, one or more 3D video processing units are configured to generate images for display and render pixels such that a plurality of images corresponding to all viewpoints are generated based on the images of the 3D video signal and The corresponding pixels in each pixel group are rendered according to the generated plurality of images.

Correspondingly, an embodiment of the present invention can also provide a method for displaying a multi-view naked-eye stereoscopic display, the method comprising the steps of: defining a plurality of pixel groups, each pixel group being composed of at least 3 pixels and corresponding to the multi-view setting; Receive a 3D video signal; generate a plurality of images corresponding to all viewpoints or predetermined viewpoints based on an image of the received 3D video signal; and render corresponding pixels in each pixel group according to the generated plurality of images. In the illustrated embodiment, image generation and pixel rendering are performed corresponding to all viewpoints (12).

The processing of the 3D video processing unit in the illustrated embodiment is described in conjunction with reference to FIGS. 1A , 2 and 3 . The 3D video signal S1 received by the video signal interface is an image frame containing two contents of color image and depth of field. Thus, the 3D video processing unit takes the received image information and depth information of the 3D video signal S1 as input, and renders 12 pictures according to the viewing angles corresponding to the viewpoints V1-V12. Then, the content of each generated image is written into the pixels seen corresponding to each viewpoint.

Therefore, when the viewer's eyes are viewed at different viewpoints V1-V12, they can see the rendered images from different angles, resulting in parallax, so as to form a stereoscopic effect of 3D display.

In some embodiments, the above-mentioned 12 pictures generated are generated with "resolution lossless" with the corresponding image frames of the received 3D video signal, especially when the resolutions are equal. Moreover, in these embodiments , the corresponding written pixels also correspond substantially point by point to the resolution of the generated image (and thus the resolution of the image of the received 3D video signal).

In some embodiments, processing to increase (multiply) the resolution of the received 3D video signal, such as interpolation processing, or so-called preprocessing, may also be performed. As an illustrative example, for example, both the color image and the depth image may be interpolated at 2x the line resolution. The processing of "resolution lossless" and/or "point-to-point rendering" according to embodiments of the present invention can then be combined to obtain new embodiments. It will be appreciated that the processing of "resolution lossless" and/or "point-to-point rendering" combined with interpolation or other resolution-increasing processes, or itself, falls within the meaning of "resolution lossless" and/or "point-to-point rendering" in the present invention. " within the scope of processing. Herein, the generation of pictures of corresponding viewpoints combined with increased resolution may sometimes also be referred to as generation of increased resolution (multiplied).

In some embodiments of the invention, an additional (pre)processor may be provided to perform the resolution increase (multiplication) or interpolation, and the resolution may also be performed by the one or more 3D video processing units Adding (multiplying) or interpolating, this falls within the scope of the invention.

In some embodiments of the invention, the display system or display may include an eye-tracking device or may read eye-tracking data.

Referring to FIG. 1B , an embodiment of the present invention provides a naked-eye stereoscopic display system, which may include a processor unit and a multi-view naked-eye stereoscopic display, where the processor unit is communicatively connected to the multi-view naked-eye stereoscopic display. In the embodiment shown, the display may be integrated with an eye-tracking device that is directly communicatively connected to the 3D video processing unit. In some embodiments not shown, the display may be provided with a memory for storing the eye tracking data, and the 3D video processing unit is connected to the memory and reads the eye tracking data. Preferably, the eye tracking data is real-time data. In the embodiment shown, the eye tracking device may be in the form of a dual camera, for example. In other embodiments of the present invention, other forms of eye tracking devices may be used, such as a single camera, a combination of an eye tracking camera and a depth camera, and other sensing devices that can be used to determine the viewer's eye position, or combinations thereof. In some embodiments of the invention, the eye tracking device may have other functions or be shared with other functions or components. For example, in one embodiment, a display system configured as a cellular phone may employ a front-facing camera on the cellular phone as an eye-tracking device.

Alternatively, the display may further include an eye-tracking data interface, and the 3D processing unit can read real-time eye-tracking data by means of the eye-tracking data transmission interface.

Referring to an embodiment of FIG. 1C , a naked-eye stereoscopic display system is provided, which may include a processor unit and a multi-view naked-eye stereoscopic display, wherein the processor unit is connected in communication with the multi-view naked-eye stereoscopic display. In the illustrated embodiment, the naked-eye stereoscopic display system may further comprise an eye-tracking device, eg in the form of a dual camera, communicatively connected to the processor unit. Furthermore, the display may include an eye-tracking data interface, and the 3D processing unit may communicate with the processor unit via the eye-tracking data transmission interface to read real-time eye-tracking data.

In some not-shown embodiments, the processor unit may not be equipped with or connected to the eye-tracking device, but instead reads real-time eye-tracking data by itself. Alternatively, the 3D processing unit can obtain real-time eye-tracking data from other sources through the eye-tracking data interface. These all fall within the scope of the present invention.

The embodiment of the present invention for setting the eye tracking device can be combined with the above-mentioned embodiments to obtain further embodiments. For example, the "resolution lossless" embodiments of the present invention may be combined with conventional use of eye tracking devices or data to obtain new embodiments. Alternatively, further improvements may be made using eye tracking devices or data to obtain preferred embodiments, as described further below.

In one embodiment, the generated image content is written (rendered) to the pixels of the display panel by writing (rendering) line by line. This greatly reduces the stress of rendering calculations.

In one embodiment of the present invention, the line-by-line writing (rendering) process is performed in the following manner: the information of the corresponding points in each generated image is separately read and written line by line into the pixels of the display panel.

In another embodiment of the present invention, the method further includes synthesizing a plurality of generated images into a composite image, and reading the information of corresponding points in the composite image and writing it into the pixels of the display panel line by line.

With continued reference to Figure 4, another embodiment of a display according to the present invention is shown. In the illustrated embodiment, only a single 3D video processing unit is provided, which simultaneously handles image generation for multiple viewpoints and rendering of corresponding multiple pixels in a pixel group.

In some embodiments of the invention, multiple 3D video processing units may be provided that handle image generation and pixel rendering in parallel, serial or a combination of serial and parallel.

Referring to Figure 5, a preferred embodiment of a display comprising a plurality of 3D video processing units according to the present invention is shown. In this embodiment, a plurality of 3D video processing units, ie groups of 3D video processing units, are provided. More preferably, the plurality of parallel 3D video processing units are sequentially arranged in parallel corresponding to the respective columns of pixels. Thereby, each 3D video processing unit can process pixel rendering in parallel, among other things. That is, each 3D video processing unit can correspondingly process the rendering of its respective pixel (column). As exemplarily shown in FIG. 5 , when the display panel has a total of M columns of pixels, if 4 parallel 3D video processing units (groups) are provided, the first 3D video processing unit processes the first M/4 columns of pixels, the first The second 3D video processing unit processes the second M/4 columns of pixels, the third 3D video processing unit processes the third M/4 columns of pixels, and the fourth 3D video processing unit processes the fourth M/4 columns of pixels.

The arrangement of such a 3D video processing unit (group) simplifies the structure and greatly speeds up the processing process. In particular, this embodiment is suitable to be combined with the aforementioned embodiment of the process of separately reading each generated image for line-by-line writing (rendering) to obtain a further preferred embodiment. For example, taking the embodiment shown in FIG. 5 as an example, in the case of progressive scanning, the first to fourth columns can sequentially process and render the pixels of each M/4 column of the first row, and for example, when the first 3D video processing unit completes After processing, when processing by other video processing units in sequence, the first 3D video processing unit can obtain sufficient time to prepare for processing the corresponding M/4 columns of pixels in the next row (eg, the second row), such as the first row of pixels in the second row. One M/4 columns of pixels. This can greatly overcome the serious shortage of rendering computing power that may be caused by conventional structures.

Those skilled in the art will appreciate that the embodiments shown in the accompanying drawings are only schematic, and there may be more or less 3D video processing units, or 3D video processing units (groups) may be allocated in other ways and parallelized It is within the scope of the present invention to process the rows and columns of pixels.

Referring to FIGS. 1A-1C , 2 and 6 , a naked-eye stereoscopic display system according to another embodiment of the present invention is shown, which may include a processor unit and a multi-view naked-eye stereoscopic display, the processor unit and the multi-view naked eye stereoscopic display Naked eye stereo display communication connection. In the illustrated embodiment, the naked-eye stereoscopic display system may further comprise an eye-tracking device, eg in the form of a dual camera, communicatively connected to the processor unit.

The multi-view naked-eye stereoscopic display may include a display screen having a display panel and a grating (not identified), a video signal interface for receiving a 3D video signal, and a 3D video processing unit. Referring to Figure 2, in the embodiment shown, the display may have 12 viewpoints (V1-V12), although it is contemplated that it may have more or fewer viewpoints. In the embodiment shown, the display may also include an eye tracking data interface. The 3D processing unit can be communicatively connected with the processor unit via the eye tracking data transmission interface to read real-time eye tracking data. In an embodiment of the present invention, the display may optionally further include a timing controller and/or a display driver chip, which may be integrated with the 3D video processing unit or independently configured. In some embodiments of the present invention, the display may be integrated with the eye final device, which is directly communicatively connected to the 3D video processing unit.

The display panel may include multiple rows and multiple columns of pixels and define multiple pixel groups. In the embodiment shown, for the sake of illustration, only two illustrative pixel groups PG _1,1 and PG _x,y are shown, each pixel group corresponding to a multi-view setup, each with its own 12 pixels (P1-P12).

1 and 2, the display of the display of this embodiment is described. As mentioned above, the display can have 12 viewpoints V1-V12, and the viewer's eyes can see the display of the corresponding pixel points in each pixel group in the display panel at each viewpoint (spatial position), and then see different the rendered picture. The two different pictures seen by the viewer's two eyes from different viewpoints form parallax, and the stereoscopic picture is synthesized in the brain

The processing of the 3D video processing unit in the illustrated embodiment is described in conjunction with reference to Figures 1-2 and Figure 6 . The 3D video signal S1 received by the video signal interface is an image frame containing two contents of left and right parallax color images. Thus, the 3D video processing unit takes as input the left and right parallax color images of the received 3D video signal S1, and thereby generates intermediate image information I1. In a specific embodiment, in one aspect, the depth-of-field image is synthesized with left and right parallax color images. On the other hand, a color image of the center point is generated by means of one or both of the above-mentioned left and right parallax color images. Then, using the intermediate image information I1, that is, the depth of field image information and the color image information of the center point, as input, 12 pictures are rendered according to the viewing angles corresponding to the viewpoints V1-V12. Then, the content of each generated image is written into the corresponding pixels in each pixel group seen corresponding to each viewpoint.

Therefore, when the viewer's eyes are viewed at different viewpoints V1-V12, they can see the rendered images from different angles, resulting in parallax, so as to form a stereoscopic effect of 3D display.

In some embodiments, the above-mentioned 12 pictures generated are generated with "resolution lossless" with the corresponding image frames of the received 3D video signal, especially when the resolutions are equal. Moreover, in these embodiments , the corresponding written pixels also correspond substantially point by point to the resolution of the generated image (and thus the resolution of the image of the received 3D video signal).

In some embodiments, processing to increase (multiply) the resolution of the received 3D video signal, such as interpolation processing, or so-called preprocessing, may also be performed. As an illustrative example, for example, the left-eye and right-eye disparity images may be interpolated at 2 times the line resolution. The "resolution lossless" and/or "point-to-point rendering" processing according to the embodiments of the present invention can then be combined to obtain new embodiments, and the image conversion processing can be performed as previously described before processing, all of which falls within the scope of the invention. It will be appreciated that the processing of "resolution lossless" and/or "point-to-point rendering" combined with interpolation or other resolution-increasing processes, or itself, falls within the meaning of "resolution lossless" and/or "point-to-point rendering" in the present invention. " within the scope of processing. Herein, the generation of pictures of corresponding viewpoints combined with increased resolution may sometimes also be referred to as generation of increased resolution (multiplied).

In some embodiments of the invention, an additional (pre)processor may be provided to perform the resolution increase (multiplication) or interpolation, and the resolution may also be performed by the one or more 3D video processing units Adding (multiplying) or interpolating, this falls within the scope of the invention.

7A and 7B, a naked-eye stereoscopic display system and a display thereof according to another embodiment of the present invention are shown.

Although not shown, the display panel of the naked-eye stereoscopic display according to the embodiment of the present invention has multiple rows and multiple columns of pixels. For "multi-view" display, the multi-row multi-column pixels are divided into groups in a manner corresponding to multi-view. For example, in the illustrated embodiment, each pixel group includes a row of 12 pixels corresponding to 12 viewpoints. In a conventional configuration, the groups of pixels are arranged relative to each other in a regular manner. For example, in a pixel group composed of pixels in a single row and multiple columns _, the pixel groups are arranged in sequence in the same row. For example, the pixel groups PG _j,1 (j≥1) in the same column are vertically aligned. As an illustrative embodiment, the pixels in the pixel group are arranged in the form of a single row and multiple columns, but other arrangement forms are conceivable, such as a single column and multiple rows or multiple rows and multiple columns. In a conventional configuration, other forms of pixel groups PG are still regularly arranged with respect to each other.

Ideally, the corresponding pixels in the above regularly arranged pixel groups are displayed correctly in the corresponding viewpoints. However, the inventors realized that, due to the installation, material or alignment of the grating, there may be a problem that the pixels of the display screen viewed by the viewpoint in space do not correspond to the "ideal" pixels (or vice versa). .

For example, as exemplarily shown in FIG. 7A , the shown display panel has a plurality of pixel groups PG distributed regularly, including PG _1,1 and PG _x,y . In the illustrated embodiment, the corresponding pixels in the pixel groups PG ₁ , 1 are displayed correctly in the corresponding viewpoints V1-V12, respectively. However, the pixels of the pixel group PG _{x, y} that "theoretically" should be displayed in the corresponding viewpoints V1-V12 are actually displayed in the viewpoints V1'-V12', respectively. (In the embodiment shown, V1' corresponds to V3).

7B exemplarily shows that, in the exemplary embodiment shown, the multi-view naked-eye stereoscopic display is configured as pixel groups with irregular mutual arrangement positions, ie, with respect to the “regular” arrangement of pixel groups be adjusted. Such adjustment is adjusted or determined based on the correspondence between the pixels of the display panel and the viewpoint. In the specific embodiment shown, based on the correspondence between pixels and viewpoints, the pixel group PG'x _,y is adjusted or determined such that, compared to the "regularly" arranged pixel group PGx _,y, the direction of the drawing is Pan to the left by two pixels. Thereby, the pixels in the adjusted "irregularly" arranged pixel group PG'x _,y are displayed correctly at the corresponding viewpoints V1-V12.

Although in the illustrated embodiment, horizontal (row) adjustment of a pixel group consisting of a single row and multiple columns of pixels is provided, adjustments in other directions are conceivable, such as vertical (column) adjustment or combined horizontal and vertical adjustment. In addition, horizontal, vertical and/or combined adjustment of pixel groups formed by other pixel arrangement forms is also conceivable.

In the illustrated embodiment, the above-mentioned adjustment of the "irregular" pixel group is directly adjusted based on the correspondence between pixels and viewpoints. In some embodiments, the "irregular" correspondence of pixels to viewpoints shown is determined based on the optical relationship of the pixels to the grating, eg, alignment relationship, refraction relationship. Thus, in some embodiments, "irregular" groups of pixels may be adjusted or determined based on the optical relationship of the pixels to the grating. In other embodiments, the "irregular" or actual alignment relationship of pixels to viewpoint may be determined by direct measurement.

In some embodiments, the above-mentioned optical data and/or alignment relationship data may be stored in memory to be read during processing by the 3D video processing unit. In an alternative embodiment, a data interface in communication with the 3D video processing unit may be provided, so that the 3D video processing unit can read the optical data and/or the alignment relation data by means of the data interface. In alternative embodiments, the optical data and/or the alignment data may be written directly into the 3D video processing unit or as part of its algorithm. These all fall within the scope of the present invention.

The processing of the 3D video processing unit of the illustrated embodiment, and thus the display of the display, is described in conjunction with reference to FIGS. 1-3 , 6 and 7A-7B. The 3D video signal S1 received by the video signal interface is an image frame containing two contents of left and right parallax color images. Thus, the 3D video processing unit takes as input the left and right parallax color images of the received 3D video signal S1, and thereby generates intermediate image information I1. In a specific embodiment, in one aspect, the depth-of-field image is synthesized with left and right parallax color images. On the other hand, a color image of the center point is generated by means of one or both of the above-mentioned left and right parallax color images. Then, using the intermediate image information I1, that is, the depth of field image information and the color image information of the center point, as input, 12 pictures are rendered according to the viewing angles corresponding to the viewpoints V1-V12. Then, the content of each generated image is written into the corresponding pixels in each pixel group seen by each viewpoint, wherein each pixel group is adjusted or determined based on optical data or pixel-viewpoint alignment relationship, Preference is given to irregularly arranged pixel groups. For example, in the illustrated embodiment, the pixel group includes a "regular" arrangement of PG _1,1 and adjusted PG' _x,y .

Therefore, when the viewer's eyes are viewed at different viewpoints V1 . . . V12 , they can see rendered images from different angles, resulting in parallax, so as to form a stereoscopic effect of 3D display.

Adjustment of pixel groups based on optical data and/or pixel-viewpoint alignment relationships is described in the embodiments shown in FIGS. 7A-7B for the 3D video processing unit to correctly render corresponding pixels in the pixel groups. However, it is conceivable to use optical data and/or pixel-viewpoint alignment relationships, directly or indirectly, to determine a correctly displayed pixel at a corresponding viewpoint and a method of rendering that pixel, whether or not the pixel group and its adjustments are intentionally defined or not, fall within the scope of the present invention or belong to the equivalents of the present invention.

Referring to FIG. 8 , a naked-eye stereoscopic display system and a display thereof according to another embodiment of the present invention are shown. In the illustrated embodiment, the display panel of the naked-eye stereoscopic display of the embodiment has multiple rows and multiple columns of pixels. In the embodiment shown in FIG. 8 , the display stores or can read data of viewpoints corresponding to each pixel of the display panel. For example, FIG. 8 exemplarily shows that the pixel P _1,b1 corresponds to the viewpoint V8, the pixel P _am,bn corresponds to the viewpoint V6, and the pixel P _az,bz corresponds to the viewpoint V12.

In the embodiment shown in FIG. 8 , the data of the direct correspondence between each pixel and the viewpoint is shown. However, it is contemplated that in some embodiments, optical data that can be used to determine pixel-to-viewpoint correspondence, such as grating-to-pixel alignment data and/or grating refraction data, or other indirect data, may be employed. In some embodiments, the above-mentioned optical data and/or alignment relationship data may be stored in memory to be read during processing by the 3D video processing unit. In an alternative embodiment, a data interface in communication with the 3D video processing unit may be provided, so that the 3D video processing unit can read the optical data and/or the alignment relation data by means of the data interface. In alternative embodiments, the optical data and/or the alignment data may be written directly into the 3D video processing unit or as part of its algorithm. In a preferred embodiment, the pixel-viewpoint correspondence data may be in the form of a lookup table. These all fall within the scope of the present invention.

The processing of the 3D video processing unit of the illustrated embodiment, and thus the display of the display, will be described in conjunction with reference to FIGS. 1-3 , 6 and 8 . The 3D video signal S1 received by the video signal interface is an image frame containing two contents of left and right parallax color images. Thus, the 3D video processing unit takes as input the left and right parallax color images of the received 3D video signal S1, and thereby generates intermediate image information I1. In a specific embodiment, in one aspect, the depth-of-field image is synthesized with left and right parallax color images. On the other hand, a color image of the center point is generated by means of one or both of the above-mentioned left and right parallax color images. Then, using the intermediate image information I1, that is, the depth of field image information and the color image information of the center point, as input, 12 pictures are rendered according to the viewing angles corresponding to the viewpoints V1-V12. Then, the content of each generated image is written into each pixel corresponding to each viewpoint according to the pixel-viewpoint correspondence.

Therefore, when the viewer's eyes are viewed at different viewpoints V1-V12, they can see the rendered images from different angles, resulting in parallax, so as to form a stereoscopic effect of 3D display.

In some embodiments, the grating of the display is a cylindrical prism grating. Figure 9 shows one embodiment of a cylindrical prism grating.

In the embodiment of the cylindrical prism grating shown in FIG. 9 , features such as pixel group adjustment as shown in FIGS. 7A-7B or the pixel-viewpoint alignment relationship as shown in FIG. 8 may be used accordingly.

Referring specifically to FIG. 9 , in the illustrated embodiment, each row of obliquely arranged cylindrical prisms generally covers 12 pixels. As an example, the display of this embodiment also has 12 viewpoints, and the pixel group of the display panel has a single row and multiple columns of pixels corresponding to the 12 viewpoints. 9 and 7A-7B, in the display of the cylindrical prism grating of the illustrated embodiment, the pixels P _a1,b1 -P _a1,b4 in a "regular" arrangement of pixels located on top of the illustrated cylindrical prisms can have correct correspondence to viewpoints V1-V4. However, the four pixels in the "regularly" arranged pixel group at the bottom of the cylindrical prism are not aligned with the correct viewpoints V1-V4, but the corresponding viewpoints V1'-V4'. To do this, the pixel group can be adjusted to be shifted to the left by one pixel in the illustration so that it is displayed at the correct viewpoints V1-V4, and the remaining viewpoints in the pixel group can be similarly shifted to the left by one pixel, for example, as shown in Figure 9 " The pixel "corresponding to the viewpoint V4' theoretically corresponds to the viewpoint V5.

9 and 8, the embodiment shown in FIG. 9 is equally applicable to utilize optical (bias) data and/or pixel-viewpoint "irregular" alignment relationships directly for each pixel of the display panel. For example, the following pixel-viewpoint correspondence data can be stored, recorded or read, and the four pixels located at the bottom of the cylindrical prism correspond to viewpoints V2, V3, V4, and V5, respectively.

While not wishing to be bound by theory, the "misalignment" of the pixel groups or pixels may be caused by misalignment of the columnar prisms to the pixels and/or the refraction state of the columnar prisms. FIG. 9 exemplarily shows the theoretical alignment position and the actual alignment deviation of the left side of the prism in dashed and solid lines.

Referring to FIGS. 9 and 10 in conjunction, the cylindrical prisms in the illustrated embodiment are, for example, disposed obliquely to the pixels, for example, to eliminate moiré. Thus, there are "shared" pixels (eg, the pixels corresponding to viewpoint V1 described above) that lie between the boundaries of the column prisms. In some configurations, corresponding viewpoints are specified for these "shared" pixels. However, in some preferred embodiments of the present invention, pixel group fine-tuning based on these "shared" pixels or "dynamic" correspondence of pixel-viewpoint or pixels referred to as view-sharing may be provided.

Referring to FIG. 10, for the pixel row P _am,bn -P _am,bn+i (i≥1), for example, conventionally corresponding to the "shared" pixels of the viewpoint V12, for example, when the viewpoint V12 is not rendered, according to the image of the viewpoint V1 to render.

Those skilled in the art will appreciate that the fine-tuning or "dynamic" relationship of the embodiment shown in Figure 10 can be applied to other types of gratings, and further preferred embodiments can be obtained in combination with the embodiment of real-time eye tracking data acquisition.

Referring to FIG. 11 , a schematic diagram of a partial structure of a parallax barrier display is shown. The parallax barrier grating 100 includes a light-shielding portion 102 and a light-transmitting portion 104 . In the embodiment of the parallax barrier grating shown in FIG. 11 , features such as pixel group adjustment as shown in FIGS. 7A-7B or the pixel-viewpoint alignment relationship as shown in FIG. 8 may be used accordingly.

Although not wishing to be bound by theory, the "misalignment" of the pixel groups or pixels may be caused by misalignment of the light-transmitting portion 104 of the parallax barrier grating with the pixels.

In the illustrated embodiment, the parallax barrier grating 100 is a front grating, but it is conceivable to provide a rear grating and to provide both front and rear gratings.

1B-1C and FIG. 12 , in one embodiment of the present invention, a naked-eye stereoscopic display system is provided, which may include a processor unit and a multi-view naked-eye stereoscopic display, the processor unit and the multi-view naked-eye stereoscopic display Display communication connection. In the illustrated embodiment, the naked-eye stereoscopic display system may further comprise an eye-tracking device, eg in the form of a dual camera, communicatively connected to the processor unit. As an alternative embodiment, the eye-tracking device may be provided in the display or the system or display only has a transmission interface that can receive real-time eye-tracking data.

With continued reference to FIGS. 1B-1C, the multi-view naked-eye stereoscopic display may include a display screen having a display panel and a grating (not identified), a video signal interface for receiving 3D video signals, and a 3D video processing unit. Referring to Figure 2, in the embodiment shown, the display may have 12 viewpoints (V1-V12), although it is contemplated that it may have more or fewer viewpoints. In an embodiment of the present invention, the display may optionally further include a timing controller and/or a display driver chip, which may be integrated with the 3D video processing unit or independently configured. In some embodiments of the present invention, the display may be integrated with the eye final device, which is directly communicatively connected to the 3D video processing unit.

With continued reference to FIGS. 1B-1C, a display panel may include multiple rows and columns of pixels and define multiple pixel groups. In the embodiment shown, for the sake of illustration, only two illustrative pixel groups PG _1,1 and PG _x,y are shown, each pixel group corresponding to a multi-view setup, each with its own 12 pixels (P1-P12). As an illustrative embodiment, the pixels in the pixel group are arranged in the form of a single row and multiple columns, but other arrangement forms are conceivable, such as a single column and multiple rows or multiple rows and multiple columns. For illustrative description only, the aforementioned PG _{x, y} may schematically represent the pixel group in the X-th row and the Y-th column.

The display of the display of this embodiment is described in conjunction with reference to FIGS. 1B-1C and FIG. 12 . As mentioned above, the display can have 12 viewpoints V1-V12, and the viewer's eyes can see the display of the corresponding pixel points in each pixel group in the display panel at each viewpoint (spatial position), and then see different the rendered picture. The two different pictures seen by the viewer's two eyes from different viewpoints form parallax, and the stereoscopic picture is synthesized in the brain

In the embodiment shown in Figure 12, one or more 3D video processing units are configured to generate images for display and render pixels such that images based on the 3D video signal generate multiple images corresponding to predetermined viewpoints and rendering pixels corresponding to the predetermined viewpoints in each pixel group according to the plurality of generated images. In the illustrated embodiment, the predetermined viewpoint is determined based on real-time eye tracking data. More specifically, when it is detected that the eyeballs (left and right eyes) of the viewer are at predetermined viewpoints (spatial positions), an image for the corresponding viewpoint is generated, and the pixels in the pixel group corresponding to the corresponding viewpoint are rendered . Specifically, in the embodiment shown in FIG. 12 , it is detected that the first eyeball (eg, the right eye) is located at the viewpoint V4, and the second eyeball (eg, the left eye) is located at the viewpoint V8.

Correspondingly, an embodiment of the present invention can also provide a method for displaying a multi-view naked-eye stereoscopic display, the method comprising the steps of: defining a plurality of pixel groups, each pixel group being composed of at least 3 pixels and corresponding to the multi-view setting; Receive a 3D video signal; generate a plurality of images corresponding to predetermined viewpoints (eg, viewpoints V4 and V8 ) based on the images of the received 3D video signal; and render corresponding pixels in each pixel group according to the generated plurality of images. In the illustrated embodiment, image generation and pixel rendering are performed corresponding to predetermined viewpoints (V4 and V8).

1B-1C and FIG. 12, the processing of the 3D video processing unit in the illustrated embodiment is described. The 3D video signal S1 received by the video signal interface is an image frame containing two contents of color image and depth of field. Therefore, the 3D video processing unit takes the received image information and depth information of the 3D video signal S1 as input, and based on the real-time eyeball data, renders the viewpoints V4 and V8 where the eyeballs are located according to the corresponding viewing angles to render 2 pictures . Then, the content of the generated corresponding image is written into the pixels (such as the 4th and 8th pixels) seen by the corresponding viewpoints in each pixel group (such as PG _1,1 and PG _x,y ).

Therefore, the eyes of the viewers located at the viewpoints V4 and V8 can see the rendered images from different angles, resulting in parallax, so as to form a stereoscopic effect of 3D display.

In some embodiments of the present invention, the aforementioned "resolution lossless" embodiments may be combined with eye tracking to obtain new embodiments. For example, as described in conjunction with FIGS. 1B-1C and FIG. 12 , the above generated pictures corresponding to the viewpoints V4 and V8 are the corresponding image frames of the received 3D video signal with “lossless resolution”, especially when the resolutions are equal generated, and, in these embodiments, the corresponding written pixels also correspond substantially on a point-by-point basis to the resolution of the generated image (and thus the resolution of the image of the received 3D video signal).

In some embodiments, processing to increase (multiply) the resolution of the received 3D video signal, such as interpolation processing, or so-called preprocessing, may also be performed. As an illustrative example, for example, both the color image and the depth image may be interpolated at 2x the line resolution. The processing of "resolution lossless" and/or "point-to-point rendering" according to the embodiments of the present invention can then be combined to obtain new embodiments, such as obtaining corresponding viewpoints V4 and V4 of the image whose resolution corresponds to the 2x interpolation. The generated screen of V8. It will be appreciated that the processing of "resolution lossless" and/or "point-to-point rendering" combined with interpolation or other resolution-increasing processes, or itself, falls within the meaning of "resolution lossless" and/or "point-to-point rendering" in the present invention. " within the scope of processing. Herein, the generation of pictures of corresponding viewpoints combined with increased resolution may sometimes also be referred to as generation of increased resolution (multiplied).

In some embodiments of the invention, an additional (pre)processor may be provided to perform the resolution increase (multiplication) or interpolation, and the resolution may also be performed by the one or more 3D video processing units Adding (multiplying) or interpolating, this falls within the scope of the invention.

Furthermore, it will be appreciated that the described embodiments of rendering predetermined viewpoints (but not all viewpoints) using real-time eye tracking data may be combined with many of the previous embodiments, or replaced by some features to obtain new embodiments. In particular, this embodiment can be combined with features related to optical data/pixel-viewpoint alignment data to obtain new embodiments. Also, this embodiment can be modified without explicitly grouping pixels to obtain new embodiments.

Continuing reference is made to the embodiment shown in FIG. 13 , which is generally similar to the embodiment shown in FIG. 12 . The difference is that the predetermined viewpoint also includes viewpoints adjacent to the viewpoint where the eyeball is located. For example, in the embodiment shown in FIG. 13 , the predetermined viewpoints to generate an image may further include viewpoints V3 and V5, and viewpoints V7 and V9, and then render the pixels corresponding to these viewpoints in the pixel group. In some embodiments, only one-sided adjacent viewpoints may be used as predetermined viewpoints.

In some embodiments, only pixels as described in Figures 12 or 13 may be rendered, for example, and the remaining pixels are not rendered. Preferably, for liquid crystal displays, the pixels that are not rendered can be left as white light or with the color of the previous image frame. Thereby, this can reduce the computational load as much as possible.

Referring to FIG. 12 and FIG. 13 , according to a preferred embodiment of the present invention, the display includes a self-luminous display panel, preferably a MICRO-LED display panel. In some embodiments of the present invention, the self-illuminating display panel, such as a MICRO-LED display panel, is configured such that unrendered pixels do not emit light. This can greatly save the power consumed by the display, especially for ultra-high-definition displays with multiple viewpoints.

1B-1C and FIG. 14 , in one embodiment of the present invention, a naked-eye stereoscopic display system is provided, which may include a processor unit and a multi-view naked-eye stereoscopic display, the processor unit and the multi-view naked-eye stereoscopic display Display communication connection. In the illustrated embodiment, the naked-eye stereoscopic display system may further comprise an eye-tracking device, eg in the form of a dual camera, communicatively connected to the processor unit. As an alternative embodiment, the eye-tracking device may be provided in the display or the system or display only has a transmission interface that can receive real-time eye-tracking data.

With continued reference to FIG. 1 , the multi-view naked-eye stereoscopic display may include a display screen having a display panel and a grating (not identified), a video signal interface for receiving a 3D video signal, and a 3D video processing unit. Referring to Figure 2, in the embodiment shown, the display may have 12 viewpoints (V1-V12), although it is contemplated that it may have more or fewer viewpoints. In an embodiment of the present invention, the display may optionally further include a timing controller and/or a display driver chip, which may be integrated with the 3D video processing unit or independently configured. In some embodiments of the present invention, the display may be integrated with the eye final device, which is directly communicatively connected to the 3D video processing unit.

With continued reference to FIG. 1 , the display panel may include multiple rows and columns of pixels and define multiple pixel groups. In the embodiment shown, for the sake of illustration, only two illustrative pixel groups PG _1,1 and PG _x,y are shown, each pixel group corresponding to a multi-view setup, each with its own 12 pixels (P1-P12). As an illustrative embodiment, the pixels in the pixel group are arranged in the form of a single row and multiple columns, but other arrangement forms are conceivable, such as a single column and multiple rows or multiple rows and multiple columns. For illustrative description only, the aforementioned PG _{x, y} may schematically represent the pixel group in the X-th row and the Y-th column.

1 and 14, the display of the display of this embodiment will be described. As mentioned above, the display can have 12 viewpoints V1-V12, and the viewer's eyes can see the display of the corresponding pixel points in each pixel group in the display panel at each viewpoint (spatial position), and then see different the rendered picture. The two different pictures seen by the viewer's two eyes from different viewpoints form parallax, and the stereoscopic picture is synthesized in the brain

In the embodiment shown in Figure 14, one or more 3D video processing units are configured to generate images for display and render pixels such that images based on the 3D video signal generate multiple images corresponding to predetermined viewpoints and rendering pixels corresponding to the predetermined viewpoints in each pixel group according to the plurality of generated images. In the illustrated embodiment, the predetermined viewpoint is determined based on real-time eye tracking data. More specifically, when it is detected that the viewer's eyeballs (left and right eyes) are at adjacent viewpoints, images for the adjacent viewpoints are generated, and pixels in pixel groups corresponding to the corresponding viewpoints are rendered. Specifically, in the embodiment shown in FIG. 12 , it is detected that the first eyeball (eg, the right eye) is located between the viewpoints V4 and V5, and the second eyeball (eg, the left eye) is located between the viewpoints V8 and V9. Thereby, four images corresponding to the viewpoints V4, V5 and V8, V9 can be generated accordingly, and the pixels corresponding to the four viewpoints in the pixel group are rendered.

Correspondingly, an embodiment of the present invention can also provide a method for displaying a multi-view naked-eye stereoscopic display, the method comprising the steps of: defining a plurality of pixel groups, each pixel group being composed of at least 3 pixels and corresponding to the multi-view setting; Receive 3D video signals; generate multiple images corresponding to predetermined viewpoints (such as viewpoints V4, V5 and V8, V9) based on the images of the received 3D video signals; pixel.

1 and 14, the processing of the 3D video processing unit in the specific embodiment shown is described. The 3D video signal S1 received by the video signal interface is an image frame containing two contents of color image and depth of field. Thus, the 3D video processing unit takes the received image information and depth information of the 3D video signal S1 as input, and based on the real-time eyeball data, renders the viewpoints V4, V5, V8 and V9 where the eyeballs are located according to the corresponding viewing angles 4 pictures are displayed. Then, write the content of the generated corresponding image to the pixels (such as the 4th, 5th and 8th, 9th pixels) corresponding to the corresponding viewpoints in each pixel group (such as PG _1,1 and PG _x,y ) pixels).

Therefore, the eyes of the viewers located between the viewpoints V4 and V5 and between the viewpoints V8 and V9 can see the rendered images from different angles, resulting in parallax, so as to form a stereoscopic effect of 3D display.

It will be appreciated that the described embodiments of rendering predetermined viewpoints (but not all viewpoints) using real-time eye tracking data may be combined with many of the previous embodiments, or replaced by some features to obtain new embodiments. In particular, this embodiment can be combined with features related to optical data/pixel-viewpoint alignment data to obtain new embodiments. Also, this embodiment can be modified without explicitly grouping pixels to obtain new embodiments.

1B-C and FIG. 14 , in another embodiment of the present invention, a naked-eye stereoscopic display system is provided, which may include a processor unit and a multi-view naked-eye stereoscopic display. The difference in this embodiment is that the 3D video signal S1 received by the video signal interface is an image frame containing left and right parallax color image content. Thus, the 3D video processing unit takes as input the image frame containing the left and right parallax color image content of the received 3D video signal S1. Based on the real-time eyeball data, the left-eye or right-eye parallax color image is correspondingly generated according to the eyeballs detected by the real-time eyeball tracking data. For example, for the viewpoints V4 and V5 where the right eye is located, two pictures are rendered based on the content of the right parallax color image of the 3D video signal S1. For the viewpoints V8 and V9 where the left eye is located, two pictures are rendered based on the content of the left parallax color image of the 3D video signal S1. Then, write the content of the generated corresponding image to the pixels (such as the 4th, 5th and 8th, 9th pixels) corresponding to the corresponding viewpoints in each pixel group (such as PG _1,1 and PG _x,y ) pixels).

Therefore, the eyes of the viewers located between the viewpoints V4 and V5 and between the viewpoints V8 and V9 can see the rendered images from different angles, resulting in parallax, so as to form a stereoscopic effect of 3D display.

1 and 15 , in one embodiment of the present invention, a naked-eye stereoscopic display system is provided, which may include a processor unit and a multi-view naked-eye stereoscopic display, and the processor unit communicates with the multi-view naked-eye stereoscopic display connect. In the illustrated embodiment, the naked-eye stereoscopic display system may further comprise an eye-tracking device, eg in the form of a dual camera, communicatively connected to the processor unit. As an alternative embodiment, the eye-tracking device may be provided in the display or the system or display only has a transmission interface that can receive real-time eye-tracking data.

With continued reference to FIG. 1 , the multi-view naked-eye stereoscopic display may include a display screen having a display panel and a grating (not identified), a video signal interface for receiving a 3D video signal, and a 3D video processing unit. Referring to Figure 2, in the embodiment shown, the display may have 12 viewpoints (V1-V12), although it is contemplated that it may have more or fewer viewpoints. In an embodiment of the present invention, the display may optionally further include a timing controller and/or a display driver chip, which may be integrated with the 3D video processing unit or independently configured. In some embodiments of the present invention, the display may be integrated with the eye final device, which is directly communicatively connected to the 3D video processing unit.

With continued reference to FIG. 1 , the display panel may include multiple rows and columns of pixels and define multiple pixel groups. In the embodiment shown, for the sake of illustration, only two illustrative pixel groups PG _1,1 and PG _x,y are shown, each pixel group corresponding to a multi-view setup, each with its own 12 pixels (P1-P12). As an illustrative embodiment, the pixels in the pixel group are arranged in the form of a single row and multiple columns, but other arrangement forms are conceivable, such as a single column and multiple rows or multiple rows and multiple columns. For illustrative description only, the aforementioned PG _{x, y} may schematically represent the pixel group in the X-th row and the Y-th column.

1 and 15, the display of the display of this embodiment is described. As mentioned above, the display can have 12 viewpoints V1-V12, and the viewer's eyes can see the display of the corresponding pixel points in each pixel group in the display panel at each viewpoint (spatial position), and then see different the rendered picture. The two different pictures seen by the viewer's two eyes from different viewpoints form parallax, and the stereoscopic picture is synthesized in the brain

In the embodiment shown in Figure 15, one or more 3D video processing units are configured to generate images for display and render pixels such that images based on the 3D video signal generate multiple images corresponding to predetermined viewpoints and rendering pixels corresponding to the predetermined viewpoints in each pixel group according to the plurality of generated images. In the illustrated embodiment, the predetermined viewpoint is determined based on real-time eye tracking data. More specifically, when it is detected that the eyeballs (left and right eyes) of the viewer are at predetermined viewpoints (spatial positions), an image for the corresponding viewpoint is generated, and the pixels in the pixel group corresponding to the corresponding viewpoint are rendered . Specifically, in the embodiment shown in FIG. 15 , it is detected that the first eyeball (eg, the right eye Er) is located at the viewpoint V4, and the second eyeball (eg, the left eye El) is located at the viewpoint V8.

Continuing to refer to FIG. 15 , when the real-time eye tracking data indicates that the eyeball of the viewer moves, a plurality of images corresponding to the new predetermined viewpoint may be generated based on the next image (frame) of the 3D video signal and based on the generated Rendering the pixels corresponding to the predetermined viewpoints in each pixel group for the plurality of images. Specifically, in the embodiment shown in FIG. 15 , it is currently detected that the first eyeball (eg, the right eye Er) moves to the viewpoint V6, and the second eyeball (eg, the left eye El) is located at the viewpoint V10. In the illustrated embodiment, the predetermined viewpoint may also be changed based on real-time eye tracking data based on a timing controller provided by the display.

Correspondingly, an embodiment of the present invention can also provide a method for displaying a multi-view naked-eye stereoscopic display, the method comprising the steps of: defining a plurality of pixel groups, each pixel group being composed of at least 3 pixels and corresponding to the multi-view setting; Receive a 3D video signal; generate a plurality of images corresponding to a predetermined viewpoint based on an image of the received 3D video signal; and render corresponding pixels in each pixel group according to the generated plurality of images. It also includes the steps of: adjusting a predetermined viewpoint based on the real-time eye tracking data, and generating an image and rendering pixels based on the new predetermined viewpoint. In the illustrated embodiment, image generation and pixel rendering are performed corresponding to current predetermined viewpoints V4, V8 or V6, V10 based on real-time eye tracking data.

1 and 15, the processing of the 3D video processing unit in the illustrated embodiment is described. The 3D video signal S1 received by the video signal interface is an image frame containing left and right parallax color image content. Based on the real-time eyeball data, the left-eye or right-eye parallax color image is correspondingly generated according to the eyeballs detected by the real-time eyeball tracking data.

For example, at the first time, for the viewpoint V4 where the right eye is located, a picture is rendered based on the content of the right parallax color image of the 3D video signal S1. For the viewpoint V8 where the left eye is located, a picture is rendered based on the content of the left parallax color image of the 3D video signal S1. Then, the content of the generated corresponding image is written into the pixels (such as the 4th and 8th pixels) seen by the corresponding viewpoints in each pixel group (such as PG _1,1 and PG _x,y ).

At the second time, for the viewpoint V6 where the right eye is located, a picture is rendered based on the content of the right parallax color image of the 3D video signal S1. For the viewpoint V10 where the left eye is located, a picture is rendered based on the content of the left parallax color image of the 3D video signal S1. Then, the content of the generated corresponding image is written into the pixels (such as the 6th and 10th pixels) seen by the corresponding viewpoints in each pixel group (such as PG _1,1 and PG _x,y ).

Therefore, the eyes of the viewer in the moving state can still see the rendered images from different angles in real time, resulting in parallax, so as to form a three-dimensional effect of 3D display.

1 and 16 , in one embodiment of the present invention, a naked-eye stereoscopic display system is provided, which may include a processor unit and a multi-view naked-eye stereoscopic display, and the processor unit communicates with the multi-view naked-eye stereoscopic display connect. In the illustrated embodiment, the naked-eye stereoscopic display system may further comprise an eye-tracking device, eg in the form of a dual camera, communicatively connected to the processor unit. As an alternative embodiment, the eye-tracking device may be provided in the display or the system or display only has a transmission interface that can receive real-time eye-tracking data.

With continued reference to FIG. 1 , the multi-view naked-eye stereoscopic display may include a display screen having a display panel and a grating (not identified), a video signal interface for receiving a 3D video signal, and a 3D video processing unit. Referring to Figure 2, in the embodiment shown, the display may have 12 viewpoints (V1-V12), although it is contemplated that it may have more or fewer viewpoints. In an embodiment of the present invention, the display may optionally further include a timing controller and/or a display driver chip, which may be integrated with the 3D video processing unit or independently configured. In some embodiments of the present invention, the display may be integrated with the eye final device, which is directly communicatively connected to the 3D video processing unit.

With continued reference to FIG. 1 , the display panel may include multiple rows and columns of pixels and define multiple pixel groups. In the embodiment shown, for the sake of illustration, only two illustrative pixel groups PG _1,1 and PG _x,y are shown, each pixel group corresponding to a multi-view setup, each with its own 12 pixels (P1-P12). As an illustrative embodiment, the pixels in the pixel group are arranged in the form of a single row and multiple columns, but other arrangement forms are conceivable, such as a single column and multiple rows or multiple rows and multiple columns. For illustrative description only, the aforementioned PG _{x, y} may schematically represent the pixel group in the X-th row and the Y-th column.

1 and 16, the display of the display of this embodiment is described. As mentioned above, the display can have 12 viewpoints V1-V12, and the viewer's eyes can see the display of the corresponding pixel points in each pixel group in the display panel at each viewpoint (spatial position), and then see different the rendered picture. The two different pictures seen by the viewer's two eyes from different viewpoints form parallax, and the stereoscopic picture is synthesized in the brain

In the embodiment shown in FIG. 16, one or more 3D video processing units are configured to generate images for display and render pixels such that images based on the 3D video signal generate multiple images corresponding to predetermined viewpoints. and rendering pixels corresponding to the predetermined viewpoints in each pixel group according to the plurality of generated images. In the embodiment shown, there are multiple viewers, such as two. Based on where the eyeballs of different viewers are located, the image is rendered for the corresponding viewpoint and written to the corresponding pixels in the pixel group.

Correspondingly, an embodiment of the present invention can also provide a method for displaying a multi-view naked-eye stereoscopic display, the method comprising the steps of: defining a plurality of pixel groups, each pixel group being composed of at least 3 pixels and corresponding to the multi-view setting; Receive 3D video signals; generate multiple images corresponding to predetermined viewpoints (such as viewpoints V4 and V6 corresponding to the left and right eyes of the first user and viewpoints V8 and V10 corresponding to the left and right eyes of the second user) based on the images of the received 3D video signals ; Render corresponding pixels in each pixel group according to the generated multiple images.

1 and 16, the processing of the 3D video processing unit in the illustrated embodiment is described. The 3D video signal S1 received by the video signal interface is an image frame containing two contents of a color image and a depth image. Thus, the 3D video processing unit takes the received image information and depth information of the 3D video signal S1 as input, and based on the real-time eyeball data, converts the viewpoints V4 and V6 corresponding to the left and right eyes of the first user and the left and right eyes of the second user. The viewpoints V8 and V10 corresponding to the eyes render 4 pictures according to the corresponding viewing angles. Then, the content of the generated corresponding image is written into the pixels (such as the 4th, 6th and 8th, 10th pixels) corresponding to the corresponding viewpoints in each pixel group (such as PG _1,1 and PG _x,y ). pixels).

Therefore, each person can watch the rendered image corresponding to his own viewing angle, and generate parallax to form a stereoscopic effect of 3D display.

1 and 16 , in another embodiment of the present invention, a naked-eye stereoscopic display system is provided, which may include a processor unit and a multi-view naked-eye stereoscopic display. The difference in this embodiment is that the 3D video signal S1 received by the video signal interface is an image frame containing left and right parallax color image content. Thus, the 3D video processing unit takes as input the image frame containing the left and right parallax color image content of the received 3D video signal S1. Based on the real-time eyeball data, the left-eye or right-eye parallax color image is correspondingly generated according to the eyeballs detected by the real-time eyeball tracking data. For example, for the viewpoint V4 where the first user's right eye is located and the viewpoint V8 where the first user's right eye is located, two pictures are rendered based on the right parallax color image content of the 3D video signal S1. For the viewpoint V6 where the first user's left eye is located and the viewpoint V10 where the first user's left eye is located, two pictures are rendered based on the left parallax color image content of the 3D video signal S1. Then, the content of the generated corresponding image is written into the pixels (such as the 4th, 6th and 8th, 10th pixels) corresponding to the corresponding viewpoints in each pixel group (such as PG _1,1 and PG _x,y ). pixels).

Therefore, each person can watch the rendered image corresponding to his own viewing angle, and generate parallax to form a stereoscopic effect of 3D display.

16 and 17 , in another embodiment of the present invention, a naked-eye stereoscopic display system is provided, which may include a processor unit and a multi-view naked-eye stereoscopic display. The display is configured to receive multiple signal inputs, in the embodiment shown in FIG. 17 two S1 (left and right parallax images) and S2 (color images and depth images).

Continuing to refer to FIG. 16, for example, the first user (User2) wishes to see the left and right disparity signals S1, and the second user (User2) wishes to see the color and depth signals. Thereby, the 3D video processing unit is based on the positions (viewpoints V4 and V6) of the left and right eyeballs (Er and El) of the first user and the positions (viewpoints V8 and V10) of the left and right eyeballs (Er and El) of the first user. , respectively generate the rendered images corresponding to the viewpoints and write the content of the corresponding images into the pixels seen by the corresponding viewpoints in each pixel group (such as PG _1,1 and PG _x,y ) (such as the first 4, 6 and 8, 10 pixels).

Therefore, each person can watch the rendered image corresponding to his own viewing angle to generate parallax to form a stereoscopic effect of 3D display, and different users can watch different video contents.

In some embodiments of the present invention, the above-mentioned embodiments may have specific implementation schemes. For example, for a naked-eye 3D display with 12 viewpoints, the video signal interface receives MiPi signals with a resolution of 1920x1200, and the signals are converted into mini-LVDS signals after entering the timing controller. The traditional processing method is to respectively give a plurality of display driver chips for the signal output of the screen. In this regard, in an embodiment of the present invention, a 3D video processing unit (or unit group) in the form of FPGA or ASIC is provided before the display driving chip.

The resolution of the display screen is 1920x12x 1200, and the signal received by the interface is processed to complete the lossless expansion of the resolution of each viewpoint, that is, the expansion of 12 times the resolution of the received video.

In some embodiments of the present invention, the video signal interface may have multiple implementation forms, including but not limited to, a high-definition digital display interface (Display Port, DP1.2) of version 1.2, a high-definition multimedia interface of version 2.0 (High Definition Multimedia Interface, HDMI 2.0), high-definition digital display interface (V-by-One), etc. or wireless interface, such as WiFi, Bluetooth, cellular network, etc.

In some embodiments of the present invention, the display or display system and display method may be combined with other image processing techniques: such as color adjustment for video signals, including color space rotation (Color Tint) adjustment and color gain (Color Gain) adjustment; brightness Adjustments, including contrast (Contrast) adjustment, drive gain (Drive Gain) adjustment, and gamma GAMMA curve adjustment.

In some embodiments of the invention, implementations of display systems according to the invention are described. In one embodiment, as shown in FIG. 18, the display system 1800 is or is configured as part of a cellular telephone. In some embodiments, the processing unit of the display system may be provided by or integrated in a processor of a cellular phone, such as an application processor (AP). In some embodiments, the eye-tracking device may include or be configured as a camera of a cellular phone, particularly a front-facing camera. In some preferred embodiments, the eye tracking device according to the present invention may comprise or be configured as a front camera combined with a structured light camera.

In some embodiments, the display system may be configured as a tablet computer, personal computer, or wearable device with a processor unit.

In one embodiment of the present invention, the naked-eye stereoscopic display may be a digital TV (intelligent or non-intelligent). In some embodiments of the present invention, as shown in FIG. 19, the display system 1900 may be configured to connect to the naked eye stereoscopic display 1904 of a set-top box 1902 or a screen-casting cellular phone or tablet, in which the processor unit is contained Or cast to a cell phone or tablet.

In an alternative embodiment, the naked-eye stereoscopic display is a smart TV integrated with the processor unit.

In some embodiments of the present invention, the naked eye stereoscopic display system is configured as a smart home system or a part thereof. In the embodiment shown in FIG. 20, a smart home system 2000 (or a naked eye stereoscopic display system) may include an intelligent gateway 2002 or a central controller including or integrated with a processor unit, a naked eye stereoscopic display 2004, and eyeballs for acquiring eye tracking data Tracking devices such as Dual Camera 2006. As an example, the eye tracking device may be in other forms, such as including a single camera, a combination of a camera and a depth-of-field camera, and the like. In the embodiment shown, both the display and the eye tracking device are connected wirelessly, eg via WiFi, to the smart gateway or central controller. But other forms of connection are conceivable.

In some embodiments of the present invention, the naked-eye stereoscopic display system is configured as an entertainment interactive system or a part thereof.

FIG. 21 shows a naked-eye stereoscopic display system according to a preferred embodiment of the present invention, which is configured as an entertainment interactive system 2100 or a part thereof. The entertainment interactive system 2100 includes a naked-eye stereoscopic display 2104 and an eye-tracking device for acquiring eye-tracking data, such as dual cameras 2106. The processor unit is not shown. In the entertainment interactive system 2100, it is configured to be suitable for use by multiple people, and in the embodiment described, it is suitable for use by two users. In the illustrated embodiment, the naked eye stereoscopic display 2104 of the entertainment interaction system 2100 generates an image based on, for example, eye tracking data from an eye tracking device such as a dual camera 2106 and writes pixels corresponding to the viewpoint.

In a more preferred embodiment, the entertainment interactive system 2100 can also combine the embodiment of multi-channel signal input to obtain a new embodiment. For example, in one specific embodiment, based on user interaction (eg, based on data detected by eye-tracking devices or other sensors), the processing unit generates multiple, eg, two, personalized video signals accordingly, and can utilize this The display and the display method thereof according to the embodiment of the invention are displayed.

The entertainment interactive system according to the embodiment of the present invention can provide users with a very high degree of freedom and interaction.

The systems, devices, modules or units described in the above embodiments can be implemented by various possible entities. A typical implementing entity is a computer or its processor or other components. Specifically, the computer can be, for example, a personal computer, a laptop computer, an in-vehicle human-computer interaction device, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet Computers, wearable devices, smart TVs, IoT systems, smart homes, industrial computers, microcontroller systems, or a combination of these devices. In a typical configuration, a computer may include one or more processors (CPUs), input/output interfaces, network interfaces, and memory. Memory may include non-persistent memory in computer readable media, random access memory (RAM) and/or non-volatile memory in the form of, for example, read only memory (ROM) or flash memory (flash RAM).

The methods, programs, systems, apparatuses, etc. of the embodiments of the present invention may be executed or implemented in a single or multiple networked computers, and may also be practiced in a distributed computing environment. In these distributed computing environments, tasks are performed by remote processing devices that are linked through a communications network in embodiments of the present specification.

As will be appreciated by one skilled in the art, the embodiments of the present specification may be provided as a method, a system or a computer program product. Accordingly, embodiments of this specification may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects.

Those skilled in the art can think that the implementation of the functional modules/units or controllers and related method steps described in the above embodiments can be implemented by software, hardware and a combination of software/hardware. For example, it can be implemented in the form of pure computer readable program code, or it can be partially or completely by logically programming the method steps so that the controller can implement the same function in hardware, including but not limited to logic gates, switches, application-specific integrated circuits, programmable Logic controllers such as FPGAs and embedded microcontrollers.

In some embodiments of the invention, components of the apparatus are described in terms of functional modules/units. It is contemplated that multiple functional modules/units may be implemented in one or more "combined" functional modules/units and/or in one or more software and/or hardware. It is also conceivable that a single functional module/unit is implemented by multiple sub-functional modules or combinations of sub-units and/or multiple software and/or hardware. The division of functional modules/units may only be a logical function division. In a specific implementation manner, multiple modules/units may be combined or integrated into another system. In addition, the connection of the modules, units, devices, systems and their components described herein includes direct or indirect connections, including feasible electrical, mechanical, communication connections, especially including wired or wireless connections between various interfaces, Including but not limited to HDMI, Thunderbolt, USB, WiFi, Cellular.

In the embodiments of the present invention, the technical features, flowcharts and/or block diagrams of methods and programs can be applied to corresponding apparatuses, devices, systems, and modules, units, and components thereof. Conversely, the various embodiments and features of the apparatus, device, system, and modules, units, and components thereof can be applied to the methods and programs according to the embodiments of the present invention. For example, computer program instructions may be loaded into the processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing device to produce a machine having one of the flow charts implemented in the flowchart and/or the block diagram one The corresponding function or feature in a block or blocks.

The methods and programs according to the embodiments of the present invention may be stored in a computer-readable memory or medium capable of directing a computer or other programmable data processing device to work in a specific manner in the form of computer program instructions or programs. The embodiments of the present invention also relate to a readable memory or medium storing methods, programs, and instructions that can implement the embodiments of the present invention.

Storage media includes permanent and non-permanent, removable and non-removable items that can implement information storage by any method or technology. Information may be computer readable instructions, data structures, modules of programs, or other data. Examples of storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory (ROM) ), Electrically Erasable Programmable Read Only Memory (EEPROM), Flash Memory or other memory technology, Compact Disc Read Only Memory (CD-ROM), Digital Versatile Disc (DVD) or other optical storage, magnetic cartridges Magnetic tape, magnetic tape storage or other magnetic storage device or any other non-transmission medium that can be used to store information that can be accessed by a computing device.

Unless explicitly stated, the actions or steps of the methods, programs, and procedures described according to the embodiments of the present invention do not necessarily have to be performed in a specific order and still achieve desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

Herein, various embodiments of the present invention are described, but for the sake of brevity, the description of each embodiment is not exhaustive, and the same and similar features or parts among various embodiments may be omitted. As used herein, "one embodiment," "some embodiments," "an example," "a specific example," or "some examples" means applicable in at least one embodiment or example, but not all implementations in accordance with the present invention example. And the above terms are not necessarily meant to refer to the same embodiment or example. Furthermore, the specific features, structures, materials or characteristics of the various embodiments may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, those skilled in the art may combine and combine the different embodiments or examples described in this specification, as well as the features of the different embodiments or examples, without conflicting each other.

As used herein, the terms "comprising", "comprising" or variations thereof are intended to be inclusive, rather than exhaustive, so that a process, method, product, or device that includes a list of elements may include those elements, but not exclude that it may also include Other elements not explicitly listed. For the purpose of disclosure and unless otherwise stated, "a" means "one or more." As far as the terms "comprising" or "comprising" are used in this specification and claims, it will be non-exhaustive, somewhat analogous to "comprising" in that those terms are used as transitional conjunctions. time is explanatory. Also, where the term "or" is used (eg, A or B), it will mean "A or B or both." When the applicant intends to indicate "only A or B but not both", "only A or B but not both" will be used. Thus, use of the term "or" is inclusive and not exclusive. See Bryan. A. Garner, Dictionary of Modern Legal Terms, p. 624 (2d. Ed. 1995).

Exemplary systems and methods of the present invention have been specifically shown and described with reference to the foregoing embodiments, which are merely examples of the best modes for implementing the present systems and methods. It will be understood by those skilled in the art that various changes may be made to the embodiments of the systems and methods described herein in implementing the present systems and/or methods without departing from the spirit and scope of the invention as defined in the appended claims . The following claims are intended to define the scope of the present system and method, so that the systems and methods falling within these claims and their equivalents may be covered. The above description of the present systems and methods should be understood to include all combinations of new and non-obvious elements described herein, and claims may exist in this or subsequent applications referring to any combination of new and non-obvious elements . Furthermore, the above-described embodiments are exemplary and no single feature or element is essential to all possible combinations that may be claimed in this or subsequent applications.

Claims (46)

1. A multi-view autostereoscopic stereoscopic display comprising a display screen having a display panel and a raster, a video signal interface for receiving a 3D video signal and one or more 3D video processing units, wherein the display panel comprises a plurality of rows and a plurality of columns of pixels and defines a plurality of pixel groups, each pixel group being made up of at least 3 pixels and corresponding to a multi-view setting, wherein the one or more 3D video processing units are configured to generate a plurality of images corresponding to all views or a predetermined view based on an image of the 3D video signal and to render corresponding pixels in each pixel group from the generated plurality of images.

2. The multi-view autostereoscopic display according to claim 1, wherein the mutual arrangement positions of the plurality of pixel groups are adjusted or determined based on optical relationship data of pixels and gratings and/or correspondence data of pixels of the display panel and views.

3. The multi-view autostereoscopic display according to claim 2, wherein the grating comprises a cylindrical prism grating, the optical relationship of the pixels to the grating comprising an alignment relationship of the pixels to the cylindrical prism grating and/or a refraction state of the cylindrical prism grating relative to the corresponding pixels.

4. The multi-view autostereoscopic display according to claim 2, wherein the grating comprises a front and/or rear parallax barrier grating comprising a light blocking portion and a light transmitting portion, the pixel to grating optical relationship comprising a pixel to grating alignment relationship with the corresponding light transmitting portion of the parallax barrier grating.

5. The multi-view autostereoscopic stereoscopic display of claim 2, wherein the correspondence of pixels to views is calculated or determined based on an optical relationship of pixels to gratings.

6. The multi-view autostereoscopic stereoscopic display of claim 2, wherein the correspondence of pixels to views is determined by measurement at each view position.

7. The multi-view autostereoscopic stereoscopic display according to claim 2, further comprising a memory storing the optical relationship data and/or pixel-to-viewpoint correspondence data, the one or more 3D video processing units configured to read data in the memory.

8. The multi-view autostereoscopic display according to claim 1, wherein the received 3D video signal comprises a received depth image and a rendered color image, and the generated image comprises a generated depth image and a rendered color image.

9. The multi-view autostereoscopic stereoscopic display of claim 1, wherein the received 3D video signal comprises a received depth image and a rendered color image, and the generated image comprises the generated first parallax image and the second parallax image.

10. The multi-view autostereoscopic display according to claim 1, wherein the received 3D video signal comprises received first and second parallax images, and the generated image comprises the generated first and second parallax images.

11. The multi-view autostereoscopic display according to claim 1, wherein the received 3D video signal comprises a received first parallax image and a second parallax image, and the generated images comprise a generated depth image and a rendered color image.

12. The multi-view autostereoscopic stereoscopic display of claim 1, wherein a plurality of 3D video processing units are provided, each 3D video processing unit configured to be each assigned with a plurality of rows or columns of pixels and to render a respective plurality of rows or columns of pixels.

13. The multi-view autostereoscopic display according to claim 1, wherein the one or more 3D video processing units are FPGA or ASIC chips or chip sets.

14. The multi-view autostereoscopic display according to any one of claims 1 to 13, wherein the 3D video signal is a mono signal, the one or more 3D video processing units being configured to generate a plurality of images corresponding to all views based on the mono 3D video signal and to render all pixels in each pixel group.

15. The multi-view autostereoscopic display according to one of claims 1 to 13, wherein the 3D video signal is a multi-channel signal, wherein the number of multi-views is N, the number of multi-channel signals is M, N ≧ M, the one or more 3D video processing units are configured to generate N images corresponding to all views and render all pixels in each pixel group, each generated image being generated based on one of the M channels of signals, respectively.

16. Multi-view autostereoscopic display according to one of claims 1 to 13, characterized by further comprising an eye tracking device or an eye tracking data interface for acquiring eye tracking data.

17. The multi-view autostereoscopic stereoscopic display of claim 16, wherein the one or more 3D video processing units are configured to generate a plurality of images corresponding to predetermined viewpoints based on images of the 3D video signal and to render corresponding pixels in respective pixel groups from the generated plurality of images, the predetermined viewpoints being determined by real-time eye tracking data of a viewer.

18. The multi-view autostereoscopic stereoscopic display of claim 17, wherein the one or more 3D video processing units are configured to, when each eye of the viewer is located at a single view, generate an image corresponding to the single view based on an image of the 3D video signal and render a pixel corresponding to the single view in each pixel group.

19. The multi-view autostereoscopic stereoscopic display of claim 18, wherein the one or more 3D video processing units are configured to also generate images corresponding to views adjacent to the single view and also to render pixels in each pixel group corresponding to the adjacent views.

20. The multi-view autostereoscopic stereoscopic display of claim 17, wherein the one or more 3D video processing units are configured to generate images corresponding to the two views based on images of the 3D video signal and to render pixels corresponding to the two views in each pixel group when each eye of a viewer is positioned between the two views.

21. The multi-view autostereoscopic display according to claim 17, wherein the 3D video signal is a single-channel signal, and the one or more 3D video processing units are configured to, when there are a plurality of viewers, generate the plurality of images and render corresponding pixels in each pixel group for a view point corresponding to a respective eye position of each viewer based on the single-channel signal.

22. The multi-view autostereoscopic display according to claim 17, wherein the 3D video signals are multiplexed signals, and the one or more 3D video processing units are configured to, when the number of viewers is plural, generate the plurality of images based on different 3D video signals and render corresponding pixels in each pixel group for a view point corresponding to respective eyeballs of at least some of the viewers.

23. The multi-view autostereoscopic display according to any one of claims 17 to 22, wherein the display panel is a self-emissive display panel, and the self-emissive display panel is configured such that pixels not being rendered do not emit light.

24. The multi-view autostereoscopic display according to claim 23, wherein the display panel is a Micro-LED display panel.

25. A multi-view autostereoscopic display includes a display screen having a display panel and a raster, a video signal interface for receiving a 3D video signal, and one or more 3D video processing units, wherein the display panel includes a plurality of rows and a plurality of columns of pixels and defines a plurality of pixel groups, each pixel group is composed of at least 3 pixels and is arranged corresponding to a multi-view point, wherein the plurality of pixel groups have irregular mutual arrangement positions adjusted or determined based on an optical relationship between the pixels and the raster and/or corresponding relationship data between the pixels of the display panel and the view point, and wherein the one or more 3D video processing units are configured to render corresponding pixels in each pixel group.

26. The multi-view autostereoscopic display of claim 25, wherein the grating comprises a cylindrical prism grating, the optical relationship of the pixels to the grating comprising an alignment relationship of the pixels to the cylindrical prism grating and/or a refraction state of the cylindrical prism grating relative to the corresponding pixels.

27. The multi-view autostereoscopic display according to claim 25, wherein the grating comprises a front and/or rear parallax barrier grating comprising a light blocking portion and a light transmitting portion, the pixel to grating optical relationship comprising a pixel to grating alignment relationship with a corresponding light transmitting portion of the parallax barrier grating.

28. The multi-view autostereoscopic stereoscopic display of claim 25, wherein the correspondence of pixels to views is calculated or determined based on an optical relationship of pixels to gratings.

29. The multi-view autostereoscopic display of claim 25, wherein the correspondence of pixels to views is determined by measurement at each view position.

30. The multi-view autostereoscopic display according to any of claims 25 to 29, further comprising a memory storing the optical relationship data and/or pixel-to-viewpoint correspondence data, the one or more 3D video processing units configured to read data in the memory.

31. The multi-view naked eye stereoscopic display is characterized by comprising a display screen and a memory, wherein the display screen is provided with a display panel and a grating, the display panel comprises a plurality of rows and columns of pixels, and the memory stores optical relationship data of each pixel of the display panel and the grating and/or corresponding relationship data of each pixel of the display panel and a view point.

32. The multi-view autostereoscopic display of claim 31, wherein the grating comprises a cylindrical prism grating, the optical relationship of the pixels to the grating comprising an alignment relationship of the pixels to the cylindrical prism grating and/or a refraction state of the cylindrical prism grating relative to the corresponding pixels.

33. The multi-view autostereoscopic display according to claim 31, wherein the grating comprises a front and/or rear parallax barrier grating comprising a light blocking portion and a light transmitting portion, the pixel to grating optical relationship comprising a pixel to grating alignment relationship with a corresponding light transmitting portion of the parallax barrier grating.

34. The multi-view autostereoscopic stereoscopic display of claim 31, wherein the correspondence of pixels to views is calculated or determined based on an optical relationship of pixels to gratings.

35. The multi-view autostereoscopic display of claim 31, wherein the correspondence of pixels to views is determined by measurement at each view position.

36. The multi-view autostereoscopic display according to any one of claims 31 to 35, further comprising a video signal interface for receiving a 3D video signal and one or more 3D video processing units, wherein the one or more 3D video processing units are configured to generate images of a plurality of 3D videos corresponding to a part or all of the views based on the received video signal, and the one or more 3D video processing units are further configured to read the registration relationship data of each pixel of the display panel with the raster and/or the correspondence data of each pixel of the display panel with the views and render the pixels corresponding to the part or all of the views based on the data.

37. An autostereoscopic display system, comprising a processor unit and a multi-view autostereoscopic display according to any of claims 1 to 36, the processor unit being communicatively connected to the multi-view autostereoscopic display.

38. The autostereoscopic display system of claim 37, wherein the autostereoscopic display system is configured as a smart television having the processor unit; or the naked eye stereoscopic display system is an intelligent cellular phone, a tablet computer, a personal computer or wearable equipment; or the naked eye stereoscopic display system comprises a set top box or a screen-projectable cellular phone or a tablet personal computer serving as the processor unit and a digital television serving as a multi-view naked eye stereoscopic display, wherein the digital television is in wired or wireless connection with the set top box, the cellular phone or the tablet personal computer; or, the naked eye stereoscopic display system is constructed as an intelligent home system or a part thereof, wherein the processor unit comprises an intelligent gateway or a central controller of the intelligent home system, and the intelligent home system further comprises an eyeball tracking device for acquiring eyeball tracking data; alternatively, the autostereoscopic display system is configured as an entertainment interaction system or a part thereof.

39. The autostereoscopic display system of claim 37, wherein the entertainment interaction system is configured to be suitable for use by multiple people and to generate a multi-channel 3D video signal for transmission to the autostereoscopic display based on multiple users.

40. A display method of a multi-view naked eye stereoscopic display is characterized in that the display comprises a display screen with a display panel and a grating, wherein the display panel comprises a plurality of rows and a plurality of columns of pixels, and the method comprises the following steps:

defining a plurality of pixel groups, each pixel group being composed of at least 3 pixels and being disposed corresponding to a multi-viewpoint;

receiving a 3D video signal;

generating a plurality of images corresponding to all viewpoints or a predetermined viewpoint based on the images of the received 3D video signal;

and rendering corresponding pixels in each pixel group according to the generated plurality of images.

41. The display method according to claim 40, wherein the step of defining the plurality of pixel groups comprises: the mutual arrangement positions of the plurality of pixel groups are adjusted or determined based on the optical relationship data of the pixels and the gratings and/or the corresponding relationship data of the pixels and the viewpoints of the display panel.

42. The display method according to claim 40 or 41, further comprising the steps of: receiving or reading implemented eye tracking data of a viewer; wherein the generating step comprises determining the predetermined viewpoint based on real-time eye tracking data by a viewer; the rendering step includes rendering pixels corresponding to the predetermined viewpoint in each pixel group.

43. A display method of a multi-view naked eye stereoscopic display is characterized in that the display comprises a display screen with a display panel and a grating, wherein the display panel comprises a plurality of rows and a plurality of columns of pixels, and the method comprises the following steps:

acquiring optical relationship data of each pixel of the display panel and the grating and/or corresponding relationship data of each pixel of the display panel and a viewpoint;

receiving a 3D video signal;

generating a plurality of images corresponding to all viewpoints or a predetermined viewpoint based on the images of the received 3D video signal;

rendering corresponding pixels from the generated plurality of images,

wherein the corresponding pixels being rendered are determined based on the acquired optical relationship data and/or the correspondence data of each pixel to a viewpoint.

44. The display method according to claim 43, wherein the step of acquiring data comprises measuring alignment data of each pixel with a grating and/or a refraction state of a cylindrical prism grating relative to each pixel as the optical relationship data.

45. The display method according to claim 43, wherein the step of acquiring data comprises calculating or determining a correspondence of pixels to viewpoints based on optical relationships of pixels to gratings or determining a correspondence of pixels to viewpoints by measurement at each viewpoint position.

46. A pixel group arrangement method of a multi-view naked eye stereoscopic display is characterized by comprising the following steps:

providing a display screen having a display panel and a raster, wherein the display panel comprises a plurality of rows and a plurality of columns of pixels;

acquiring optical relationship data of each pixel of the display panel and the grating and/or corresponding relationship data of each pixel of the display panel and a viewpoint;

defining a plurality of pixel groups each of which is composed of at least 3 pixels and is set corresponding to multiple viewpoints, based on the acquired optical relationship data and/or the correspondence relationship data of each pixel with viewpoints;

wherein the defined plurality of pixel groups are for multi-view autostereoscopic display of the display.

Images