CN109425993B - Space-time hybrid multiplexing three-dimensional display system and method - Google Patents

Abstract

The invention discloses a three-dimensional display system of time-space mixed multiplexing. The three-dimensional display system of the time-space mixed multiplexing can improve the information presentation amount of the target three-dimensional image and improve the observation comfort through time-division mixed multiplexing. The guiding device proposed by the present invention can image a plurality of display units and guide their images to overlap or intersect in space; through the light-blocking plate array, the beams emitted from each display unit are constrained to exit through different apertures; at the same time, the beams exit through a set of clear apertures They correspond to multiple views respectively; at different times, the timing switches of multiple groups of clear apertures are used to project more and denser views, thereby increasing the number of views presented by the system, reducing the angular spacing between views, and improving three-dimensional information. rendering effect. At the same time, the present invention also provides a three-dimensional display method of space-time mixed multiplexing.

Description

A three-dimensional display system and method for hybrid space-time multiplexing

technical field

The invention relates to the technical field of three-dimensional image display, and in particular, to a three-dimensional display system and a method thereof with time-space hybrid multiplexing.

Background technique

People live in a three-dimensional world in daily life, and mainstream two-dimensional displays cannot express the depth information of the third dimension clearly and accurately. Therefore, people have been working on the research of three-dimensional image display technology that can realize the presentation of three-dimensional information. At present, the main three-dimensional technology mainly uses gratings to guide the pixels of the display screen to different viewpoints, thereby realizing the presentation of views corresponding to different positions in space. The observer can observe the corresponding view in the area corresponding to each viewpoint. But this technique only increases the number of views through spatial multiplexing of pixels, and the number and angular density of views that can be presented is highly limited by the pixel density of the display.

This patent uses space-time mixed multiplexing, on the basis of pixel space multiplexing, by adding time multiplexing to further improve the effective multiplexing degree of the display screen, which can effectively increase the number and angular density of the presented views, and improve the viewer's viewing experience. 3D look and feel.

SUMMARY OF THE INVENTION

Aiming at the problem that the number of presented views and angular density are very limited when the traditional three-dimensional display technology only displays multiple views through the spatial multiplexing of pixels, the present invention further improves the multiplexing degree from the time domain through the mixed multiplexing of space and time. , which can effectively increase the number and angular density of rendered views compared to traditional techniques.

For achieving the above object, the technical scheme adopted in the present invention is as follows:

A three-dimensional display system of space-time mixed multiplexing, comprising:

a display unit array, each display unit of the display unit array is composed of surface-arranged pixels for displaying optical information;

A guide device, which is placed at a position corresponding to the display unit array, used to image each display unit, and guides the images of each display unit to overlap or intersect in the projection area or projection space, and the overlapping or intersecting images are named as corresponding Display the main image of the unit;

A clear aperture array, which is placed in front of the guiding device along the transmission direction of the outgoing beam of the display unit array, and is composed of at least two groups of clear aperture sub-arrays that can be switched in sequence, and each clear aperture of the clear aperture array is respectively Corresponding to a spatial reference point, the clear aperture is used to gate or cut off the light equivalent to the main image of the display unit that passes through its corresponding spatial reference point. The light equivalent to the main image of the display unit corresponding to the reference point of each clear aperture of the same clear aperture sub-array comes from different pixels of the display unit array;

A control unit, the control unit is connected to the display unit array and the clear aperture array, and is used to control the timing switch of each group of clear aperture sub-arrays, and to control part or all of the clear apertures of a group of clear aperture sub-arrays When turned on, some or all of the pixels in the display unit array are controlled to load corresponding light information synchronously. Specifically, the control unit can control all or part of the clear apertures of each group of clear aperture sub-arrays to be opened or closed sequentially.

In the above scheme, by using the guiding device, multiple display units can be imaged, and the images can be guided to overlap or intersect in space; at the same time, multiple views corresponding to them are emitted through a set of clear apertures; at different times, use The timing switches of multiple groups of clear apertures project more and denser views, thereby increasing the number of views presented by the system, reducing the angular spacing between views, and improving the effect of 3D information presentation.

Preferably, it also includes a guiding device gating unit, the guiding device gating unit includes P groups of apertures that can be switched in sequence, each group of apertures arranged alternately can be opened in time sequence, and each aperture corresponds to a different display. It only allows the light information equivalently emitted by the main image of the corresponding display unit to pass through when it is opened; or the gating unit of the guiding device is composed of at least two sets of apertures with exclusive functions, each group of apertures are arranged alternately, each The apertures correspond to different above-mentioned display units respectively, and allow the light information equivalent to the main image of the corresponding display unit to pass through, but do not allow other groups of apertures to pass through the output light information corresponding to the display units, where P≧2. Specifically, the gating unit of the guiding device can be directly controlled by humans, or can be connected with the control unit and controlled by the control unit, so as to control all or part of the apertures of the guiding device gating unit to be opened or closed sequentially. closure.

Preferably, the three-dimensional display system of the space-time hybrid multiplexing further comprises a light blocking plate array, which is placed between the display unit array and the guiding device, and is used to constrain the outgoing light beams of each display unit to pass through the corresponding apertures respectively. out.

Preferably, the three-dimensional display system for mixed spatiotemporal multiplexing further includes a tracking unit, which is used for tracking and determining the binocular spatial position of the observer.

Preferably, the three-dimensional display system for mixed time-space multiplexing further includes an adjustment unit, which is used to adjust the relative positions between each display unit in the display unit array and the guide device, or to change the guide The optical property of the device causes the main image formed by each display unit of the display unit array through the guiding device to translate relative to the guiding device. In a more preferred embodiment, the adjustment unit may be configured to be able to adjust the spatial posture of the light blocking plate as required.

Preferably, the space-time hybrid multiplexed three-dimensional display system further includes a scattering sheet, which scatters the incident light in one-dimensional direction.

Preferably, the guiding device includes a small lens array and a large-sized concave lens, the guiding device includes a small lens array and a large-sized concave lens, wherein each small lens of the small lens array corresponds to each display unit of the display unit array one-to-one, Each display unit is located on the focal plane of the corresponding lenslet, wherein the large-sized concave lens aperture covers at least part of the lenslets in the lenslet array, and the guide device can be named as an I-type guide device.

Preferably, the guiding device comprises a small lens array and a large-sized convex lens, wherein each small lens of the small lens array is in one-to-one correspondence with each display unit of the display unit array, and each display unit is located on the focal plane of the corresponding small lens, wherein The large-sized convex lens aperture covers at least part of the lenslets in the lenslet array, and the guide device can be named as a type II guide device.

Preferably, the guiding device includes a small lens array, wherein each small lens of the small lens array corresponds to each display unit of the display unit array one-to-one, and each display unit forms a virtual image through the corresponding small lens, the guiding device can be named as III type guide.

Preferably, the guiding device includes a small lens array, wherein each small lens of the small lens array corresponds to each display unit of the display unit array one-to-one, and each display unit forms a real image through the corresponding small lens, the guiding device can be named as IV type guide.

Preferably, the guiding device further comprises a plurality of offset elements capable of inverting or translating the images formed by the lenslets, so that the images formed by the lenslets can overlap or intersect the projection areas or projection spaces.

Preferably, the small lens is replaced with an equivalent optical element or optical component, and/or the large-sized concave lens is replaced with an equivalent optical element or optical component; or the lenslet array is replaced with an equivalent optical element or An optical component is replaced, and/or the large-sized convex lens is replaced with an equivalent optical component or optical component.

Preferably, the lenslets are replaced with equivalent optical elements or optical assemblies, or the lenslet arrays are replaced with equivalent optical elements or optical assemblies. Wherein, the optical element may be a diffractive optical element with a phase modulation function, and the optical component may be a diffractive optical element with a phase modulation function.

Preferably, the three-dimensional display system of mixed spatiotemporal multiplexing further includes an auxiliary steering device, which is placed between the display unit array and the guiding device, so that each display unit is equivalently placed on the focal plane of the corresponding small lens , or parallel to the corresponding lenslet. More preferably, the auxiliary steering device may be an array of auxiliary steering units, the function of which is to allow non-parallel placement of each display unit and the corresponding lenslet in the array of display units, the array of auxiliary steering units being placed between the array of display units and the guiding device. , the auxiliary steering units correspond to the display units in the display unit array one-to-one, and the corresponding auxiliary steering units enable each display unit to be placed on the focal plane of the corresponding small lens equivalently or parallel to the corresponding small lens.

Preferably, it also includes an auxiliary synthesizing device, the auxiliary imaging device is placed between the display unit array and the guiding device, and when each display unit of the display unit array is composed of at least two discrete pixel screens, can The outgoing light beams of the at least two discrete pixel screens of the display unit are combined so that they all enter the guiding device. More preferably, the auxiliary synthesizing device may be an array of auxiliary synthesizing units, and each auxiliary synthesizing unit corresponds to the display units in the above-mentioned display unit array one-to-one. When the display units are composed of at least discrete pixel screens, the at least The outgoing light beams from the two separate pixel screens pass through the corresponding synthesizing units and enter the corresponding small lenses.

Another object of the present invention is to provide the following three-dimensional display method of mixed spatiotemporal multiplexing.

The first three-dimensional display method for space-time mixed multiplexing provided by the present invention, which uses the three-dimensional display system for space-time mixed multiplexing described in any one of the solutions, includes the following steps:

s1 divides the clear aperture array into N groups of clear aperture sub-arrays, and for each clear aperture, through ray tracing, it is determined that the corresponding spatial reference point and the equivalent rays originating from the main image of the display unit are in the display unit. The source pixels on the array and their images on the main image of the display unit, that is, the pixels corresponding to each spatial reference point and their images, where N≧1;

s2 At a time point, at least part of the clear apertures of one group of clear aperture sub-arrays are open, and the clear apertures of the other groups of clear aperture sub-arrays are closed;

s3 for each clear aperture opened in step s2 corresponding to the pixel corresponding to the spatial reference point, taking the corresponding spatial reference point as the viewpoint, and synchronously loading the projection information of the target object on its image;

s4 For at least part of the time points of the N adjacent time points, steps s2 to s3 are performed correspondingly at each time point of the at least part of the time points.

Preferably, the above-mentioned first three-dimensional display method for hybrid multiplexing of time and space further includes step s5: repeating step s4.

More preferably, in the above-mentioned first three-dimensional display method of hybrid multiplexing of time and space, the three-dimensional display system includes a tracking unit, and the tracking unit is used to track and determine the binocular spatial position of the observer; and

An adjustment unit, the adjustment unit is used to adjust the relative position between each display unit in the display unit array and the guide device, or to change the optical properties of the guide device, so that each display unit of the display unit array is The main image formed by the guiding device is translated relative to the guiding device;

The three-dimensional display method of spatiotemporal hybrid multiplexing further includes step s6: according to the binocular position of the observer, adjusting the relative position between each display unit in the display unit array and the above-mentioned guiding device through the adjusting unit, or changing the guiding device The optical properties of the device enable each display unit of the display unit array to translate relative to the guide device through the main image formed by the guide device, so as to ensure that the observer whose position has changed can receive the system outgoing light information, and For the new positional relationship between the display unit and the guide device, steps s1 to s5 are re-executed.

The present invention provides a second three-dimensional display method for hybrid multiplexing of time and space, which uses the three-dimensional display system for hybrid multiplexing of time and space described in any one of the above solutions, wherein the three-dimensional display system includes a steering device gating unit , the guide device gating unit includes P groups of apertures that can be switched in sequence, each group of apertures arranged alternately can be opened in sequence, and each aperture corresponds to a different display unit, and only allows the corresponding display unit to be opened when it is opened. The optical information passing through as the equivalent output; or the gating unit of the guiding device is composed of at least two groups of diaphragms with exclusive functions, each group of diaphragms are arranged alternately, and each diaphragm corresponds to a different above-mentioned display unit, allowing corresponding The light information equivalent to the main image of the display unit passes through, but other groups of diaphragms are not allowed to pass through the output light information corresponding to the display unit, where P≧2; including the following steps:

ss1 divides the clear aperture array into N groups of clear aperture sub-arrays, and for each clear aperture, through ray tracing, it is determined that the corresponding spatial reference point and the equivalent light originating from the main image of the display unit are in the display unit. The source pixels on the array and their images on the main image of the display unit, that is, the pixels corresponding to each spatial reference point and their images, where N≧1;

ss2 At a point in time, at least part of the apertures of one group of apertures of the P group apertures are opened, at least part of the apertures of one group of the N groups of aperture subarrays are opened, and the other apertures are opened. The clear apertures in the clear aperture sub-array are closed;

ss3 synchronously loads the projection information of the target object on the image of the pixel corresponding to the spatial reference point corresponding to each clear aperture opened in step ss2, taking the corresponding spatial reference point as the viewpoint, wherein at least the opened aperture is corresponding pixel loading light information of each display unit;

ss4 the P group of apertures respectively have only one group of P states when the apertures are gated, and the N groups of clear aperture sub-arrays respectively have only one set of N states when at least part of the clear apertures of the clear aperture sub-arrays are gated , combined to form PN states, respectively corresponding to PN adjacent time points, wherein, for at least part of the time points in the PN adjacent time points, at each time point of the at least part of the time points, correspondingly execute Steps ss2 to ss3.

Preferably, the above-mentioned second 3D display method for mixed time-space multiplexing further includes step ss5: repeating step ss4.

More preferably, in the above-mentioned second 3D display method of mixed space-time multiplexing, the 3D display system includes a tracking unit, and the tracking unit is used to track and determine the binocular spatial position of the observer; and

An adjustment unit, the adjustment unit is used to adjust the relative position between each display unit in the display unit array and the guide device, or to change the optical properties of the guide device, so that each display unit of the display unit array is The main image formed by the guiding device is translated relative to the guiding device;

The three-dimensional display method of spatio-temporal hybrid multiplexing further includes step ss6: adjusting the relative position between each display unit in the display unit array and the guiding device by adjusting the unit according to the binocular position of the observer, or changing the The optical properties of the guiding device enable each display unit of the display unit array to translate relative to the guiding device through the main image formed by the guiding device, so as to ensure that the eyes of the observer whose position has changed can receive the emitted light information from the system, And for the new positional relationship between the display unit and the guiding device, steps ss1 to ss5 are re-executed.

The third 3D display method of space-time mixed multiplexing provided by the present invention, the method uses a three-dimensional display system of space-time mixed multiplexing described in any one of the above schemes, and includes the following steps:

sss1 divides the clear aperture array into M groups of clear aperture sub-arrays along the one-dimensional row direction; where M≧1;

sss2 For each clear aperture, through ray tracing, the corresponding spatial reference point, the source pixel on the display unit array and the image on the display unit main image of each light equivalent to the main image of the display unit are determined. That is, the pixels and their images corresponding to each spatial reference point;

sss3 at a time point where at least part of the clear apertures of one group of clear aperture sub-arrays are open, and the clear apertures of other groups of clear aperture sub-arrays are closed;

sss4 takes a row of clear apertures as the reference clear aperture row, each clear aperture opened in the benchmark clear aperture row corresponds to the pixel corresponding to the spatial reference point, and takes the corresponding spatial reference point as the viewpoint, and loads the target object on its image synchronously At the same time, open the pixel corresponding to the spatial reference point corresponding to each clear aperture in other rows, and synchronously load the projection information loaded by the pixel corresponding to the spatial reference point corresponding to the clear aperture of the same column in the reference clear aperture row;

sss5 For at least part of the adjacent M time points, the steps sss3 to sss4 are correspondingly performed at each time point of the at least part of the time points.

Preferably, the above-mentioned third three-dimensional display method for mixed spatiotemporal multiplexing further includes step sss6: repeating step sss5.

Preferably, in the above-mentioned third three-dimensional display method of mixed space-time multiplexing, the three-dimensional display system includes a tracking unit, and the tracking unit is used to track and determine the binocular spatial position of the observer; and

An adjustment unit, the adjustment unit is used to adjust the relative position between each display unit in the display unit array and the guide device, or to change the optical properties of the guide device, so that each display unit of the display unit array is The main image formed by the guiding device is translated relative to the guiding device;

The three-dimensional display method of spatiotemporal hybrid multiplexing further includes step sss6: according to the binocular position of the observer, adjusting the relative position between each display unit in the display unit array and the guiding device through the adjusting unit, or changing the relative position of each display unit in the display unit array. The optical properties of the guiding device enable each display unit of the display unit array to translate relative to the guiding device through the main image formed by the guiding device, so as to ensure that the eyes of the observer whose position has changed can receive the light information emitted by the system. , and re-execute steps sss1 to sss5 for the new positional relationship between the display unit and the guiding device.

The present invention provides a fourth method for 3D display of space-time mixed multiplexing. The method uses a 3D display system of space-time mixed multiplexing described in any one of the above solutions, and the three-dimensional display system of space-time mixed multiplexing includes: The guiding device gating unit, the guiding device gating unit includes P groups of apertures that can be switched in sequence, each group of apertures arranged alternately can be opened in sequence, and each aperture corresponds to a different display unit, and only when the aperture is opened The light information equivalent to the main image of the corresponding display unit is allowed to pass through; or the gating unit of the guiding device is composed of at least two groups of diaphragms with exclusive functions, each group of diaphragms is arranged alternately, and each diaphragm corresponds to different above-mentioned diaphragms respectively. The display unit allows the light information corresponding to the main image of the display unit to pass through, but does not allow the output light information of other groups of apertures to pass through corresponding to the display unit, where P≧2, including the following steps:

ssss1 divides the clear aperture array into M groups of clear aperture sub-arrays along the one-dimensional row direction; where M≧1;

ssss2 For each clear aperture, through ray tracing, the corresponding spatial reference point, the source pixel on the display unit array and its image on the main image of the display unit, which are equivalent to the rays originating from the main image of the display unit, are determined. That is, the pixels and their images corresponding to each spatial reference point;

ssss3 selects one time point in the adjacent PN time points, at least part of the diaphragms of one group of diaphragms of the P group of diaphragms are opened, and the N groups of clear aperture subarrays of the group of clear aperture subarrays At least some of the clear apertures are open, and the clear apertures in other clear aperture sub-arrays are closed;

ssss4 takes a row of clear apertures as the reference clear aperture row, opens the pixels corresponding to the spatial reference points of each clear aperture in the benchmark clear aperture row, and takes the corresponding spatial reference point as the viewpoint, and loads the image of the target object synchronously. projection information; at the same time, for the pixels corresponding to the spatial reference points corresponding to the open clear apertures in other rows, synchronously load the projection information loaded by the pixels corresponding to the spatial reference points corresponding to the clear apertures of the same column in the reference clear aperture row, of which at least The pixels of the display units corresponding to the opened apertures are loaded with light information;

ssss5 The P group of apertures respectively have only one set of P states when gated, and the N groups of clear aperture sub-arrays respectively have only one set of N states when gated, which are combined to form PN states, corresponding to PN adjacent time points, wherein, for at least part of the time points in the PN adjacent time points, steps ssss3 to ssss4 are performed correspondingly at each time point of the at least part of the time points.

Preferably, the above-mentioned fourth 3D display method for mixed spatiotemporal multiplexing further includes step sssss6: repeating step ssss5.

More preferably, in the above-mentioned fourth three-dimensional display method of mixed space-time multiplexing, the three-dimensional display system includes a tracking unit, and the tracking unit is used to track and determine the binocular spatial position of the observer; and

An adjustment unit, the adjustment unit is used to adjust the relative position between each display unit in the display unit array and the guide device, or to change the optical properties of the guide device, so that each display unit of the display unit array is The main image formed by the guiding device is translated relative to the guiding device;

The three-dimensional display method of spatiotemporal hybrid multiplexing further includes step ssss7: adjusting the relative position between each display unit in the display unit array and the guiding device through the adjusting unit according to the binocular position of the observer, or changing all the relative positions of the guide device. The optical properties of the guiding device enable each display unit of the display unit array to translate relative to the guiding device through the main image formed by the guiding device, so as to ensure that the eyes of the observer whose position has changed can receive the light information emitted by the system. , and re-execute steps ssss1 to ssss6 for the new positional relationship between the display unit and the guiding device.

The fifth kind of three-dimensional display method of space-time mixed multiplexing provided by the present invention, the method uses a three-dimensional display system of space-time mixed multiplexing described in any one of the above schemes, and includes the following steps:

sssss1 divides the clear aperture array into M groups of clear aperture sub-arrays along the one-dimensional row direction, and the corresponding spatial reference points of all row clear apertures are arranged in a dislocation along the row direction; where M≧1;

sssss2 For each clear aperture, through ray tracing, the corresponding spatial reference point, the source pixel on the display unit array and its image on the main image of the display unit, which are equivalent to the rays originating from the main image of the display unit, are determined. That is, the pixels and their images corresponding to each spatial reference point;

sssss3 at a time point where at least part of the clear apertures of one group of clear aperture sub-arrays are open, and the clear apertures of other groups of clear aperture sub-arrays are closed;

sssss4 takes a row of clear apertures as the reference clear aperture row, and each open aperture corresponds to the pixel corresponding to the spatial reference point, and takes the corresponding spatial reference point as the viewpoint, and loads the projection information of the target object on its image synchronously; at the same time, The pixels corresponding to the spatial reference point corresponding to each clear aperture opened in other rows, on the premise of virtual translation of the corresponding spatial reference point along the column direction to the reference clear aperture row, take the shifted virtual spatial reference point as the viewpoint, and synchronize Load the projection information of the target object on its image;

At least part of the M time points adjacent to sssss5, at each time point of the at least part of the time points, steps sssss3 to sssss4 are performed correspondingly.

Preferably, the above-mentioned fifth 3D display method for mixed spatiotemporal multiplexing further includes step sssss6: repeating step sssss5.

More preferably, in the above-mentioned fifth 3D display method of mixed space-time multiplexing, the 3D display system includes a tracking unit, and the tracking unit is used to track and determine the binocular spatial position of the observer; and

An adjustment unit, the adjustment unit is used to adjust the relative position between each display unit in the display unit array and the guide device, or to change the optical properties of the guide device, so that each display unit of the display unit array is The main image formed by the guiding device is translated relative to the guiding device;

The three-dimensional display method of spatio-temporal hybrid multiplexing further includes step sssss7: adjusting the relative position between each display unit in the display unit array and the guiding device through the adjusting unit according to the binocular position of the observer, or changing all the relative positions. The optical properties of the guiding device enable each display unit of the display unit array to translate relative to the guiding device through the main image formed by the guiding device, so as to ensure that the eyes of the observer whose position has changed can receive the light information emitted by the system. , and re-execute steps sssss1 to sssss6 for the new positional relationship between the display unit and the guiding device.

The present invention provides a sixth 3D display method for space-time mixed multiplexing, which uses the three-dimensional display system for space-time mixed multiplexing described in any one of the above solutions, and the three-dimensional display system for space-time mixed multiplexing includes: The guiding device gating unit, the guiding device gating unit includes P groups of apertures that can be switched in sequence, each group of apertures arranged alternately can be opened in sequence, and each aperture corresponds to a different display unit, and only when the aperture is opened The light information equivalent to the main image of the corresponding display unit is allowed to pass through; or the gating unit of the guiding device is composed of at least two groups of diaphragms with exclusive functions, each group of diaphragms is arranged alternately, and each diaphragm corresponds to different above-mentioned diaphragms respectively. The display unit allows the light information corresponding to the main image of the display unit to pass through, but does not allow the output light information of other groups of apertures to pass through corresponding to the display unit, where P≧2, including the following steps:

ssssss1 divides the clear aperture array into M groups of clear aperture sub-arrays along the one-dimensional row direction, and the corresponding spatial reference points of all row clear apertures are arranged in dislocation along the row direction; where M≧1;

ssssss2 For each clear aperture, through ray tracing, the corresponding spatial reference point, the source pixel on the display unit array and its image on the display unit main image of each light equivalent to the main image of the display unit are determined. That is, the pixels and their images corresponding to each spatial reference point;

ssssss3 selects one time point in the adjacent PN time points, at least part of the apertures of one group of apertures in the P group apertures are opened, and the N groups of the clear aperture subarrays in the group of clear aperture subarrays At least part of the clear apertures are opened, and the clear apertures in other groups of clear aperture sub-arrays are closed;

ssssss4 takes a row of clear apertures as the reference clear aperture row, and opens the pixels corresponding to the spatial reference points of each clear aperture in the benchmark clear aperture row, and takes the corresponding spatial reference point as the viewpoint, and loads the image of the target object synchronously. Projection information; at the same time, for the pixels corresponding to the spatial reference points corresponding to the open clear apertures in other rows, on the premise of virtual translation of the corresponding spatial reference points along the column direction to the reference clear aperture row, the corresponding translated virtual space The reference point is a viewpoint, and the projection information of the target object on its image is loaded synchronously, wherein at least the pixels of each display unit corresponding to the opened group of apertures are loaded with light information;

ssssss 5 The P group of apertures respectively have only one set of P states when gated, and the N groups of clear aperture sub-arrays respectively have only one set of N states when gated, which are combined to form PN states, which correspond to PN adjacent time points, wherein, for at least part of the time points in the PN adjacent time points, steps ssssss3 to ssssss4 are performed correspondingly at each time point of the at least part of the time points.

Preferably, the above-mentioned sixth 3D display method for mixed spatiotemporal multiplexing further includes step sssssss6: repeating step ssssss5.

Preferably, in the above-mentioned sixth three-dimensional display method for mixed time-space multiplexing, the three-dimensional display system includes a tracking unit, and the tracking unit is used to track and determine the binocular spatial position of the observer; and

An adjustment unit, the adjustment unit is used to adjust the relative position between each display unit in the display unit array and the guide device, or to change the optical properties of the guide device, so that each display unit of the display unit array is The main image formed by the guiding device is translated relative to the guiding device;

The three-dimensional display method of spatio-temporal hybrid multiplexing further includes step ssssss7: according to the binocular position of the observer, adjust the relative position between each display unit in the display unit array and the guide device through the adjustment unit, or change all the relative positions of the guide device. The optical properties of the guiding device enable each display unit of the display unit array to translate relative to the guiding device through the main image formed by the guiding device, so as to ensure that the eyes of the observer whose position has changed can receive the light information emitted by the system. , and re-execute steps ssssss1 to ssssss6 for the new positional relationship between the display unit and the guiding device.

The beneficial effects of the present invention are that: the present invention uses space-time mixed multiplexing, and on the basis of pixel space multiplexing, since time multiplexing is added, the effective multiplexing degree of the display screen is further improved, and the number of presented views and the number of displayed views can be effectively improved. The angular density improves the three-dimensional perception effect of the observer.

Description of drawings

FIG. 1 is an optical path diagram of a three-dimensional display system using an I-type guide device for display according to the present invention.

FIG. 2 is a schematic diagram of the principle of setting a single selection area when an I-type guiding device is used for display according to the present invention.

FIG. 3 is a schematic diagram of the distribution of the viewing area when the I-type guiding device is used for display according to the present invention.

4 is a schematic diagram of the distribution of the resectable area when the observer's binocular spatial position is relatively fixed using the I-type guiding device according to the present invention.

FIG. 5 is a structural diagram of a unit of the auxiliary steering device according to the present invention.

FIG. 6 is a unit structure diagram of the auxiliary synthesis device according to the present invention.

FIG. 7 is a schematic diagram of the discrimination of pixel discrete screens based on orthogonal polarization states.

FIG. 8 is a schematic diagram of the discrimination of the pixel discrete screen based on the beam transmission direction.

FIG. 9 is an optical path diagram of a system incorporating a guiding device gating unit with timing characteristics and using an I-type guiding device for display.

FIG. 10 is a schematic diagram of the working principle when the gate unit of the timing characteristic guide device gates the apertures of different groups of lenslets of the I-type guide device.

Fig. 11 The shielding effect of the gating unit of the guiding device on the non-primary image near the display surface.

FIG. 12 is an optical path diagram of a three-dimensional display system using a type II guide device for display according to the present invention.

FIG. 13 is an optical path diagram of a three-dimensional display system using a type III guide device with a planar structure for display according to the present invention.

FIG. 14 is a schematic diagram of the formation of a single selection area when a type III guide device is used for display according to the present invention.

FIG. 15 is an optical path diagram of a three-dimensional display system using the IV-type guide device with a planar structure for display according to the present invention.

FIG. 16 is an optical path diagram of a three-dimensional display system using a type III guide device with a curved surface structure according to the present invention for display.

FIG. 17 is an optical path diagram of a three-dimensional display system using an IV-type guide device with a curved surface structure for display according to the present invention.

FIG. 18 is a schematic diagram of the structure of the small lens/prism group that realizes the effect of the curved surface structure by the plane arrangement structure according to the present invention.

10: Display cell array 11: Display cell

20: Guide 21: Lenslet

22: Large size concave lens 23: Large size convex lens

24: Small Prism 30: Light Barrier Array

31: Light Barrier 40: Clear Aperture Array

50: Control unit 60: Tracking unit

70: Adjustment unit 80: Auxiliary steering

90: Auxiliary synthesis device 100: Guide device gating unit

110: Diffuser

Detailed ways

In order to explain in more detail the three-dimensional display method of space-time hybrid multiplexing proposed in this patent, the present invention will be described in detail below with reference to the accompanying drawings. It should be understood that the embodiments described herein are only used to explain the design of the present invention, and are not intended to limit the present invention.

Example 1:

Using an I-type guide device 20 composed of a small lens array (21, 21', etc.) and a large-sized concave lens 22, as shown in FIG. Each small lens (21, 21', etc.) of 20 corresponds to each other one by one. The display unit is located on the focal plane (focal length f ₁ ) of the corresponding small lens, and the same relative spatial positional relationship is used between each display unit and each small lens. Each display unit can also be each different pixel part of an entire display screen. Each display unit is imaged by the corresponding small lens and the large-sized concave lens 22 and named as its main image, and the main image of each display unit coincides with the projection area on the focal plane (focal length f ₂ ) of the large-sized concave lens 22, that is, as shown in FIG. 1 . P _x1 P _x2 area on the image plane. If the aperture of the large-sized concave lens 22 cannot collect the light emitted by all the display chips through the corresponding small lens, that is, the aperture of the large-sized concave lens 22 cannot completely cover all the small lenses, the outgoing light beam on the display chip does not enter the pixels of the concave lens through the corresponding small lens, In the following process as invalid pixels. The light barrier array 30 is interposed between the display unit array 10 and the I-type guide device 20, as shown in FIG. 1 . Through the shielding of the light blocking plates ( 31 , 31 ′, etc.) of the light blocking plate array 30 , each display unit can only emit light information through the apertures of the respective small lenses. Along the transmission direction of the outgoing beam from the display unit array 10, the clear aperture array 40 is placed in front of the I-type guiding device, and consists of a plurality of clear apertures, each of which corresponds to a spatial reference point. The light equivalent to the main image of the display unit of the display unit array 10 is cut off by the corresponding spatial reference point. The clear aperture array 40 is further divided into two or more groups of clear aperture sub-arrays. Taking FIG. 1 as an example, the three groups of clear aperture sub-arrays correspond to the spatial reference points VP _x11 , VP _x12 , VP _x13 , VP _x14 , VP _x15 , VP _x16 , VP _x17 , VP _x18 , VP _x19 , spatial reference points VP _x21 , VP _x22 , VP _x23 , VP _x24 , VP _x25 , VP _x26 , VP _x27 , VP _x28 , and spatial reference points VP _x31 , VP _x32 , VP _x33 , VP _x34 , VP _x35 , VP _x36 , VP _x37 , VP _x38 . The characteristic of these spatial reference points is that the same group of clear aperture sub-arrays correspond to different spatial reference points, and the light equivalent to the main image of the display unit originates from different pixels on the display unit array 10 . In Figure 1, among the spatial reference points corresponding to the same group of clear aperture sub-arrays, the included angle between adjacent spatial reference points, such as VP _x11 and VP _x12 , relative to a point on the image plane, such as point P _x1 , is in the I-type guide device When the surface coverage size of the large-sized concave lens 22 of 20 is equal to or greater than the distance between adjacent small lenses, the light rays that pass through the set of spatial reference points and are equivalent to the main image of the display unit will originate from different pixels on the display unit array 10. .

In Figure 1, each spatial reference point is placed on a plane. In fact, under the premise that the same set of clear aperture sub-arrays correspond to different spatial reference points, and that the light equivalent to the main image of the display unit originates from different pixels on the display unit array 10, each spatial reference point can be a non-linear reference point. Coplanar, this also applies to the other embodiments described below. In FIG. 1, each spatial reference point is placed on the corresponding clear aperture surface, and in the following examples, for the sake of clear and simple illustration effect, the spatial reference points are all placed on the corresponding clear aperture surface. In fact, in this embodiment and the following embodiments, on the premise that the switch of one spatial aperture can turn on or off the light that passes through the corresponding spatial reference point and is equivalent to the light originating from the main image of the display unit, each spatial reference point also It may not be on the corresponding clear aperture surface, or even each clear aperture itself is non-planar, and each clear aperture can be of various shapes and structures, or even a combination of two or more holes of any shape, which also applies to the following Other embodiments.

区域。对应显示单元像的边点和

区域边点的连线交于两点，如图2中的点q₃和q₄。命名区域

为该显示单元对应的单选区(包含边线)。同理，各显示单元都分别对应一个单选区。只要同一通光孔径子阵列对应的各空间参考点分别位于不同单选区时，过该组通光孔径子阵列对应不同空间参考点、等效源自显示单元主像的光线，将分别来自显示单元阵列10的不同显示单元，也满足过同一组通光孔径子阵列对应不同空间参考点、等效源自显示单元主像的光线源自显示单元阵列10上的不同像素的要求。Relative to a point on the image plane, the corresponding spatial reference points of the same group of clear aperture sub-arrays shown in Figure 1 are arranged with approximately uniform angular spacing. This arrangement is conducive to obtaining a better three-dimensional display effect. However, the arrangement of the uniform or approximately uniform distribution is not mandatory. The light emitted from the same display unit and entering the large-sized concave lens 22 through the corresponding small lens, after passing through the large-sized concave lens 22, the reverse extension lines converge on the two sets of parallel rays of the display unit image on the image plane. The concave lens 22 collectively covers an area, as shown in FIG. 2

area. Corresponding to the edge points of the display unit image and

The line connecting the edge points of the region intersects at two points, such as points q ₃ and q ₄ in Figure 2 . named area

The single selection area (including the edge) corresponding to the display unit. Similarly, each display unit corresponds to a single selection area respectively. As long as the spatial reference points corresponding to the same clear aperture sub-array are located in different single-selection areas, the rays corresponding to different spatial reference points through the set of clear aperture sub-arrays, equivalent to originating from the main image of the display unit, will come from the display unit respectively. Different display units of the array 10 also meet the requirements that the same set of clear aperture sub-arrays correspond to different spatial reference points, and the light equivalent to the main image of the display unit originates from different pixels on the display unit array 10 .

The selection principles of the optical structures shown in Figures 1 and 2 and their related spatial reference points are explained and illustrated along the one-dimensional x-direction (row direction), and the same can be extended to the second-dimensional y-direction (column direction).

According to the selection principle of the above-mentioned spatial reference point and the design principle of the clear aperture, N(≧1) groups of clear aperture sub-arrays and their corresponding spatial reference points are determined. For each clear aperture, through the reverse tracing of rays, the corresponding spatial reference point, the source pixel on the display unit array 10 of each light equivalent to the main image of the display unit and the source pixel on the display unit array 10 and the source pixel through the I-type guiding device 20 are determined. The image formed on the projection area is the pixel corresponding to each spatial reference point and its image. At one point in time, a group of clear aperture sub-arrays are opened, and other clear apertures are closed at the same time; each open clear aperture corresponds to each pixel corresponding to a spatial reference point, and the control unit 50 loads the target synchronously with the spatial reference point as the viewpoint Projection information of an object on its image; at N adjacent time points, N groups of clear aperture sub-arrays are opened in sequence, and information is loaded synchronously to each pixel of the display unit array based on the previous method. Repeating the above process, passing each spatial reference point, a view corresponding to the spatial reference point is presented on the image plane. When the switching frequency of the clear aperture sub-array is high enough, the distribution of spatial reference points is dense enough, based on visual retention, along the beam transmission direction, in an area in front of the spatial reference point, that is, the viewing area shown in Figure 3, The three-dimensional information of the target object can be observed. The same goes for the column direction. In this process, at a point in time, part of the clear apertures of a group of clear aperture sub-arrays may also be opened. At this time, in the group of clear aperture sub-arrays, the corresponding pixels corresponding to the spatial reference points corresponding to the clear apertures are not opened. No information needs to be loaded at this point in time.

When the clear aperture array along the column direction is composed of only one set of clear aperture sub-arrays, that is, when one display unit along the column direction corresponds to only one clear aperture, or all clear aperture sub-arrays are divided along the row direction , at this time there is another information loading method: take a row of clear apertures as the reference clear aperture row, when each clear aperture is opened, the corresponding pixel corresponding to the spatial reference point, with the spatial reference point as the viewpoint, is controlled by The unit 50 synchronously loads the projection information of the target object on its image; but when each clear aperture belonging to other non-reference clear aperture rows is opened, the pixel corresponding to the corresponding spatial reference point is loaded synchronously in the same column in the reference clear aperture row. When the clear aperture is opened, the spatial reference point corresponds to the light information loaded by the pixel. In this information loading mode, three-dimensional parallax information is no longer displayed in the column direction, and three-dimensional information is only displayed in the row direction. During this process, at a point in time, part of the clear apertures of a group of clear aperture sub-arrays may also be opened. At this time, in the group of clear aperture sub-arrays, the corresponding pixels corresponding to the spatial reference points corresponding to the clear apertures are not opened. No information needs to be loaded at this point in time.

With the tracking unit 60 enabled, the binocular position of the observer can be determined. According to the binocular position of the observer, the system can be controlled to display only the information needed in a small space at the binocular, reducing the amount of information calculation. When the spatial position of the observer's binocular to the system is relatively fixed, the related devices that do not contribute to the incident observer's binocular light, or the contribution is not necessary, will have an unnecessary effect on the three-dimensional display effect and can be removed, as shown in the figure. 4 shows the display unit, small lens, and even part of the large-sized concave lens 22 in the resectable area.

When the observer binocular moves out of the viewing area shown in FIG. 3, the specific position of the observer's binocular obtained by the tracking unit is adjusted by the adjusting unit 70 shown in FIG. 4 to adjust each display unit in the display unit array 10 and the above I The relative position between the type guide devices 20 makes the image formed by each display unit of the display unit array 10 through the I-type guide device 20 translate relative to the above-mentioned I-type guide device 20, and also causes the viewing area to move relative to the guide device 20. In order to keep both eyes in the viewing area of the display system. The position adjustment of the display unit relative to the I-type guide device 20 can be realized by moving the display unit array 10 or by moving the I-type guide device 20. When each display unit is a pixel of a different part of a whole display screen, even This can be achieved by re-dividing the pixels of the display unit corresponding to each small lens. During this process, the spatial attitude of the light blocking plate array 30 also changes accordingly. The movement of the viewing area can also be achieved by changing the optical properties of the above-mentioned I-type guiding device 20. For example, when the small lens in the I-type guiding device 20 is a variable optical center lens, each small lens is changed according to the eyes of the observer. The optical center can also make the image and viewing area of each display unit translate relative to the I-type guiding device 20 . The tracking unit 60 and the adjusting unit 70 are also applicable to other embodiments of the present invention.

In the above-mentioned optical structures corresponding to FIGS. 1-4 , each display unit and the corresponding small lens are placed in parallel to ensure that the display unit is in the focal plane of the corresponding small lens. In the relevant figures in the following embodiments, the display unit shown is also placed in parallel with the I-type guide device 20 or the corresponding small lens included in it, so as to ensure that the display unit is in the focal plane of the corresponding small lens or through the corresponding small lens. The lens is ideal for imaging. The auxiliary steering device 8 is adopted, and the auxiliary steering device 8 includes one or more steering units. In the system of the present invention, each steering unit can make the display unit placed in non-parallel relative to the small lens or the I-shaped guide device 20 equivalent to placed in parallel, as shown in Figure 5. The auxiliary steering device 80 in the special case here is an array of right-angle reflectors, which is only one unit shown in FIG. Can be used as auxiliary steering device 80 or its unit. The auxiliary steering device 80 is also applicable to other embodiments of the patent of the present invention.

In the above-mentioned optical structures shown in FIGS. 1-4, when each display unit is composed of two or more discrete pixel screens, the auxiliary synthesis device 90 can make the light beams emitted from the two or more discrete pixel screens pass through the corresponding synthesis unit. , the incident corresponds to the small lens or the I-type guiding device 20 . Taking one display unit corresponding to two pixel discrete screens as an example, as shown in FIG. 6 , the auxiliary synthesizing device in this special case is a spectroscopic reflection prism array, and FIG. Further explain the working principle of the auxiliary synthesis device. The different discrete screens corresponding to the display unit can be equivalently incident on the I-type guiding device 20 in a manner parallel to the small lens through the corresponding light splitting reflective prisms, and then image. Different display units have two imaging situations: imaging at different depths and imaging at the same depth. In the first case, the system will form multiple image planes on two or more different depth planes, and each image plane is responsible for displaying the three-dimensional information of the area near the image plane, thereby increasing the display depth of the system. In the second case, through the aperture of each small lens, the image of the small lens corresponding to each discrete pixel screen of the display unit can be equivalently regarded as different display surfaces overlapping with different light information at the same depth. When different pixel discrete screens corresponding to each display unit are overlapped on the same image plane through the I-type guiding device 20, different pixel discrete screens of the same display unit should display different information to different clear apertures at the same time. That is to say, the q pixel discrete screens of the same display unit should exclusively emit light information through q apertures at the same time point. In this case, each clear aperture sub-array is further divided into q groups of sub-sub-arrays, the clear apertures belonging to each sub-sub-array have the same characteristics, and the clear apertures of different sub-sub-arrays of the same clear aperture sub-array have the same characteristics. , to have the ability to distinguish different pixel beam splitting screens, here is a special unit of the auxiliary synthesis device shown in FIG. 7 as an example to illustrate, one display unit corresponds to q=2 pixel discrete screens, and the output light information of the two pixel discrete screens is processed by The corresponding units in the auxiliary synthesis device respectively have two orthogonal polarization states in the horizontal "-" and vertical "﹒" directions. Clear apertures A ₁ and A ₃ are open to allow only horizontally polarized light to pass through, and A ₂ and A ₄ are open to allow only vertically polarized light to pass through. Two of the four clear apertures with different characteristics belong to the same group of clear aperture sub-arrays, for example, A ₁ and A ₂ belong to a group of clear aperture sub-arrays together, but at the same time A ₁ and A ₂ with different characteristics belong to the same group of clear aperture sub-arrays. Two different sub-sub-arrays of this sub-array; likewise, A ₃ and A ₄ belong together to another set of clear aperture sub-arrays, but at the same time A ₃ and A ₄ of different characteristics belong to two different sub-sub-arrays of this sub-array array. At one point in time, A ₁ and A ₂ belonging to the same clear aperture sub-array are turned on, and each spatial reference point corresponding to the sub-sub-array where A ₁ is located corresponds to the pixel on the discrete screen 1, and the spatial reference point is taken as the viewpoint, by The control unit 50 synchronously loads the projection information of the target object on its image; the pixels corresponding to each spatial reference point corresponding to the sub-array where A ₂ is located on the discrete screen 2 are synchronously loaded by the control unit 50 with the spatial reference point as the viewpoint Projection information of the target object on its image; at the next adjacent time point, A ₃ and A ₄ belonging to another clear aperture sub-array are turned on, and each spatial reference point corresponding to the sub-sub-array where A ₃ is located corresponds to the discrete screen 1 The pixel of , taking this spatial reference point as the viewpoint, the projection information of the target object on its image is loaded synchronously by the control unit 50; the corresponding pixel of each spatial reference point corresponding to the sub-subarray where A ₄ is located on the discrete screen 2, with this The spatial reference point is the viewpoint, and the control unit 50 loads the projection information of the target object on its image synchronously; this is repeated. Other display units also perform the above process synchronously. In the example shown in FIG. 7 , the pixel discrete screen 1 and the pixel discrete screen 2 may have orthogonal polarization states for the emitted light itself, or may have orthogonal polarization states after passing through the corresponding units in the auxiliary synthesis device, such as auxiliary synthesis The unit of the device is a polarizing beam splitter. Figure 7 uses the polarization state as the characteristic to distinguish different pixel discrete screens. This characteristic can also be other orthogonal characteristics, such as spin state, complementary color, etc., as long as the clear apertures of different sub-arrays in each clear aperture sub-array It is possible to exclusively pass light information from discrete screens of different pixels when turned on. FIG. 8 shows a principle of discriminating different pixel discrete screens of the display unit by the light transmission direction. Here, a special unit of the auxiliary synthesis device is taken as an example for description, and the unit is an array composed of prisms P ₁ , P ₂ , P ₃ , and P ₄ . Here simply let the deflection angles of _prisms P2 and P4 be ₀ °. Due to the refraction of the prism, the refraction image of the pixel separation screen ₁ through the prisms P2 and P4 coincides with the refracted image _of the pixel separation screen ₂ through the prisms P1 and _P3 , and can then be imaged in the projection area of the image plane through the guiding device 10 . At the same time, the refraction image of the pixel discrete screen ₂ through the prisms P2 and P4, and the refraction image of the pixel discrete screen ₁ through the prisms P1 and _P3 , after passing through the guiding device ₁₀ , will be outside the projection area on the image plane, and will not affect 3D display content. In this case, in each clear aperture sub-array, each clear aperture belonging to the same sub-sub-array is placed on the aperture of the same type of prism, and each of the clear apertures belonging to different sub-sub-arrays is placed on the aperture of different types of prisms respectively On the above, different pixel discrete screens corresponding to the same display unit can be discriminated by the light transmission direction. The auxiliary synthesis device 90 is also applicable to other embodiments of the present patent.

In the related examples of FIGS. 1 , 4 and 8 , along the display unit/lenslet array arrangement direction, the display unit size is not greater than the lenslet pitch as an example for description. When the guiding device gate unit 100 with timing characteristics is introduced, as shown in FIG. 9 , the size of each display unit may be larger than the size of the corresponding lenslet. The guide device gating unit 100 is composed of two or more sets of apertures, which are used to gate a group of sub-arrays of the small lens array of the guide device 20 at each time point, and at the same time block the clear apertures of other small lenses. The lenslets of the lens sub-array are spaced in sequence. Taking the example that the lenslet array is divided into P=2 groups, as shown in FIG. 9 , the lenslets of the two groups of lenslet sub-arrays are arranged alternately. At a group of N adjacent time points, the guiding device gating unit 100 allows the apertures of each lenslet in the lenslet sub-array formed by the lenslets 21, 21″, etc. to pass light, while blocking the clear apertures of other lenslets; At one of the time points, a group of clear aperture sub-arrays are opened, and other clear apertures are closed at the same time; each pixel corresponding to the spatial reference point corresponding to each open clear aperture is synchronously loaded by the control unit 50 with the spatial reference point as the viewpoint The projection information of the target object on its image; at the adjacent N time points, N groups of clear aperture sub-arrays are turned on in turn, and the information is synchronously loaded into each pixel of the display unit array based on the previous method. At the next group of adjacent N At a time point, the guiding device gating unit 100 allows the apertures of each lenslet in the lenslet sub-array formed by the lenslets 21', 21"', etc. to pass light, while blocking the clear apertures of other lenslets, as shown in Figure 10; in which At a time point, a group of clear aperture sub-arrays are opened, and other clear apertures are closed at the same time; each open clear aperture corresponds to each pixel corresponding to the spatial reference point, and the control unit 50 loads the target synchronously with the spatial reference point as the viewpoint Projection information of the object on its image; at the adjacent N time points, N groups of clear aperture sub-arrays are turned on in sequence, and the information is loaded synchronously to each pixel of the display unit array based on the previous method. When the display units corresponding to adjacent small lenses overlap in space, each display unit is a different part of the pixels of a whole display screen, and the display units corresponding to adjacent small lenses are the partially overlapped pixels selected from the whole display screen at different times. Different area pixels. In the above process, the time point of PN=2N corresponds to 2N states, and the time sequence of the 2N states can be adjusted arbitrarily. If the lenslet array is divided into more groups of sub-arrays, the same is handled. In the above process, when P is switched between different values, the adjustment unit 10 needs to adjust the spatial posture of each light blocking plate of the light blocking plate array 30 as required, as shown in the changes in FIG. 9 to FIG. 10 .

In the related examples of FIGS. 1 to 8 , the light blocking plate array 30 is used to make the light emitted from each display unit exit only through the corresponding small lens apertures in the guide device 20 . When the light baffle array 30 is removed, the light emitted from each display unit will pass through the non-corresponding small lens and will be imaged outside the area where the main image is located. Although it will not be superimposed on the projection area as noise, it may also enter the observer's eyes and affect the display. . In this case, the guiding device gating unit 100 with timing characteristics is turned off by the timing of different groups of small lens sub-arrays arranged at intervals, which can remove useless non-main images near the projection area where the main image is located, and improve the display effect. Taking the case where the lenslet array is divided into P=2 groups as an example, the lenslets of the two groups of lenslet sub-arrays are arranged alternately, as shown in FIG. 11 . The guide device gating unit 100 gates a group of sub-arrays of the small lens array of the guide device 20 while blocking the clear apertures of other small lenses. At a group of N adjacent time points, the guiding device gating unit 100 allows the apertures of each lenslet in the lenslet sub-array formed by the lenslets 21, 21″, etc. to pass light, and blocks the clear apertures of other lenslets at the same time. The display unit corresponding to the blocked lenslet does not display optical information at the N time points; at one of the time points, a group of clear aperture sub-arrays are opened, and other clear apertures are closed at the same time; each open clear aperture corresponds to a spatial reference Point on each pixel corresponding to the display unit corresponding to each small lens of the gating, take the spatial reference point as the viewpoint, and load the projection information of the target object on its image synchronously by the control unit 50. At the next group of adjacent N time points , the guiding device gating unit 100 allows the apertures of each small lens of the small lens sub-array formed by the small lenses 21', 21"', etc. to pass light, and at the same time blocks the clear apertures of other small lenses, and at the same time blocks the corresponding display unit of the small lens No optical information is displayed at the N time points; N groups of clear aperture sub-arrays are turned on in sequence, and information is synchronously loaded to each pixel of the display unit array corresponding to each small lens by the gating method based on the previous method. In this process, if the outgoing beam of each gating lenslet corresponding to the pixel of the display unit cannot be incident due to the limited divergence angle and simultaneously gating the adjacent lenslets in the gating lenslet, in the absence of the light-blocking plate array 30 , the main Like a three-dimensional representation of the presence of interference. If a certain gating lenslet corresponding to the pixel of the display unit can enter the adjacent lenslets in the gating lenslet at the same time, the interfering non-main image formed is also far away from the projection area, and the impact on the three-dimensional display is limited. The above PN=2N time points correspond to 2N states, and the time sequence of the 2N states can be adjusted arbitrarily. If the lenslet array is divided into more groups of sub-arrays, the same is handled. If an exclusive guiding device gating unit 100 is used, such as in FIG. 11 , the adjacent apertures of the guiding device gating unit 100 are two polarizers with orthogonal light passing directions, and the adjacent display units emit light. They also have corresponding polarization states, and the light emitted from each display unit can pass through the aperture corresponding to the corresponding small lens, but cannot pass through the aperture corresponding to the adjacent small lens of the corresponding small lens. Since the light emitted from each display unit cannot pass through the adjacent non-corresponding small lenses, a three-dimensional display with no non-main image interference or non-main image interference far from the projection area can be achieved in the same way. In this process, at a point in time, part of the apertures in a set of apertures and part of the clear apertures of a set of clear aperture sub-arrays can also be opened. At this time, by opening the clear aperture corresponding to the spatial reference point corresponding to the pixel , when the equivalent light emitted on the corresponding main image is blocked by the diaphragm, the pixel does not need to load information.

In the above structure of this embodiment, a large-sized convex lens can be used to replace the large-sized concave lens in the I-type guiding device, that is, the II-type guiding device is used, as shown in FIG. 12 . Based on the above-mentioned similar methods and processes in this embodiment, the system using the type II guide device can also implement three-dimensional display.

When the type II guide device is used, the main image of each display unit is a real image, and a one-dimensional scattering sheet 110 can be placed in the display area where the main images of the display units overlap, such as the scattering sheet 110 of vertically scattered incident light in FIG. 12 . Along the horizontal x-axis, a row of display unit/lenslet pairs are arranged as shown in Figure 12; along the vertical y-direction, multiple rows of display units/lenslet pairs of the same structure are arranged in sequence, but the spatial reference points corresponding to different rows of display units/lenslet pairs , which are sequentially dislocated along the horizontal direction. At one point in time, the clear apertures of a group of clear aperture sub-arrays are opened, and the other clear apertures are closed; the clear aperture along the x-axis is taken as the reference clear aperture row, and each open clear aperture corresponds to the spatial reference point. For the corresponding pixel, take the spatial reference point as the viewpoint, and load the projection information of the target object on its image synchronously; at the same time, the pixels corresponding to the spatial reference point corresponding to the clear apertures opened in other rows are virtually translated along the column direction. On the premise of the spatial reference point to the reference clear aperture line, take the translated virtual spatial reference point as the viewpoint, and load the projection information of the target object on its image synchronously. At multiple adjacent time points, multiple groups of clear aperture sub-arrays are turned on in sequence, and information is loaded synchronously as above. This process is repeated, and through scattering along the y-direction by the scattering sheet 110 , a three-dimensional presentation with only x-direction parallax is finally realized. Similar to the related application in FIG. 10 , the guide device gating unit 100 can also be introduced in the structure shown in FIG. 12 , and information is loaded synchronously on the corresponding pixels through the common gating of the guide device gating unit 100 and the clear aperture array 40 . And similarly, at a point in time, a set of apertures of a clear aperture sub-array and a guide device gating unit 100 may be partially opened.

Example 2:

The type III guide device 20 shown in FIG. 13 is composed of small lens arrays (21, 21', etc.) arranged in a plane. Each display unit (11, 11', etc.) of the display unit array 10 and each small lens (21', etc.) , 21′, etc.) one-to-one correspondence. Each display unit is placed at an object distance u relative to the corresponding small lens, and each display unit/small lens pair is placed at a specific eccentric distance, such as δ ₁ , δ ₂ , δ ₃ in Fig. The main image of the lens coincides with the projection area P _x1 P _x2 area of the image plane. In the special case shown in FIG. 13 , the eccentric distance between the center of the display unit and the optical axis of the lenslet in the display unit/lenslet pair in the middle position is set to δ ₅ =0. In fact, the values of the eccentric distances can be set to other values, as long as the settings of the eccentric distances can ensure that the images of the display units overlap in a common area of the image plane. Each aperture of the guiding device gating unit 100 is located on each small lens aperture of the guiding device 20 . If the guiding device gating unit 100 with timing characteristics is used, each group of small lenses of each group of apertures of the guiding device gating unit 100 corresponds to The array will be gated in sequence. If the guide device gate unit 100 with exclusive characteristics is used, the emitted light of each display unit needs to have the aperture corresponding to its corresponding small lens, and the same group of light that can also pass through the aperture. stop, but cannot pass the characteristic of a stop of a different group than this stop. Along the transmission direction of the outgoing light beam from the display unit array 10, the clear aperture array 40 is placed in front of the guiding device, and consists of a plurality of clear apertures, each of which corresponds to a spatial reference point, and its switch can be switched on or off. Corresponding to the spatial reference point, it is equivalent to the light rays originating from the display unit array 10 to display the main image of the array. The clear aperture array 40 is further divided into two or more groups of clear aperture sub-arrays. Taking FIG. 13 as an example, the three groups of clear aperture sub-arrays correspond to spatial reference points VP _x11 , VP _x12 , VP _x13 , VP _x14 , VP _x15 , VP _x16 , VP _x17 , VP _x18 , VP _x19 , spatial reference points VP _x21 , VP _x22 , VP _x23 , VP _x24 , VP _x25 , VP _x26 , VP _x27 , VP _x28 , and spatial reference points VP _x31 , VP _x32 , VP _x33 , VP _x34 , VP _x35 , VP _x36 , VP _x37 , VP _x38 . The characteristic of these spatial reference points is that the light rays equivalent to originating from the main image of the display unit that pass through the same group of clear aperture sub-arrays corresponding to different spatial reference points originate from different pixels on the display unit array 10 . Taking Fig. 13 as an example, among the spatial reference points corresponding to the same group of clear aperture sub-arrays, the angle between adjacent spatial reference points, such as VP _x11 and VP _x12 , relative to a point on the image plane, such as point P _x1 , is When the surface coverage size of the small lens of the guiding device 20 is equal to or greater than the distance between adjacent small lenses, the light rays passing through the set of spatial reference points will originate from different pixels on the display unit array 10 .

In Figure 13, each spatial reference point is placed on a plane. In fact, under the premise that the light rays passing through the same set of clear aperture sub-arrays corresponding to each spatial reference point originate from different pixels on the display unit array 10, each spatial reference point may be non-coplanar, which is also applicable to the following Other embodiments are described. In FIG. 13 , each spatial reference point is placed on the corresponding clear aperture surface, and in the following examples, for the sake of clear and simple illustration effect, the spatial reference points are all placed on the corresponding clear aperture surface. In fact, in this embodiment and the following embodiments, on the premise that the switch of one spatial aperture can turn on or off the light from the display unit array 10 that passes through the corresponding spatial reference point, each spatial reference point may not be Corresponding to the surface of the clear aperture, even each clear aperture itself is non-planar, which also applies to the other embodiments described below.

为该显示单元对应的单选区(含边界)。同样道理各显示单元都分别对应一个单选区。只要同一通光孔径子阵列对应的各空间参考点分别位于不同单选区时，无论其是否采用等角间距排列的方式，过该组通光孔径子阵列对应不同空间参考点的、等效源自显示单元主像的光线，将源自显示单元阵列10上的不同像素。在相邻小透镜毗邻放置时，相临小透镜的边点是重合的，此时，相邻单选区会出现一个重合点，如图14中的点q₁和q₂。在这种情况下，处于不同单选区的各空间参考点的选取，要以不重合为前提进行选取。该空间参考点的选取原则，也适用于以下的各实例。图13中各小透镜为凸透镜，在经对应小透镜，各显示单元成重合虚像的前提下，图13中各小透镜也可以是凹透镜。Relative to the points on the image plane, the corresponding spatial reference points of the same group of clear aperture sub-arrays shown in Figure 13 are arranged in a manner of approximately uniform angular spacing, which is conducive to obtaining a better three-dimensional display effect. However, the arrangement of uniform or approximately uniform angular spacing is not mandatory. Let the edge points of the small lens 21' be q ₁ and q ₂ , as shown in FIG. 14 , connect the two points with the two sides of the image of the display unit corresponding to the small lens, namely the points P _x1 and P _x1 in FIG. 11 , Intersection at points q ₃ and q ₄ . named area

It is the single selection area (including border) corresponding to the display unit. In the same way, each display unit corresponds to a single selection area respectively. As long as the spatial reference points corresponding to the same clear aperture sub-array are located in different single-selection areas, regardless of whether they are arranged in equiangular spacing, the equivalent value derived from the set of clear aperture sub-arrays corresponding to different spatial reference points is derived from The light of the main image of the display unit will originate from different pixels on the display unit array 10 . When adjacent lenslets are placed adjacent to each other, the edge points of the adjacent lenslets are coincident, and at this time, a coincident point will appear in the adjacent radio selection areas, such as points q ₁ and q ₂ in Figure 14 . In this case, the selection of spatial reference points in different single selection areas should be based on the premise that they do not overlap. The selection principle of the spatial reference point is also applicable to the following examples. Each small lens in FIG. 13 is a convex lens, and each small lens in FIG. 13 may also be a concave lens on the premise that each display unit forms a superimposed virtual image through the corresponding small lens.

The optical structures shown in FIGS. 13 and 14 and the selection of related spatial reference points are explained and illustrated along the one-dimensional x-direction (row direction), and the same can be extended to the second-dimensional y-direction (column direction).

According to the above selection principles of spatial reference points and the design principles of clear apertures, N(≧1) groups of clear aperture sub-arrays and corresponding spatial reference points are determined. For each clear aperture, through the ray reverse tracing, the corresponding spatial reference point, the source pixel on the display unit array 10 of each light equivalent to the light originating from the main image of the display unit, and the main image of the display unit through the guiding device 20 are determined. image above. At one point in time, a group of clear aperture sub-arrays are opened, and other clear apertures are closed at the same time. Each open clear aperture corresponds to each pixel corresponding to the spatial reference point. Taking the spatial reference point as the viewpoint, the control unit 50 loads the target synchronously. Projection information of the object on its image; when the exclusive characteristic is used to guide the device gating unit 100, at N adjacent time points, N groups of clear aperture sub-arrays are turned on in turn, and the information is loaded into each display unit array in the same way. pixel. Repeating the above process, passing each spatial reference point, a view corresponding to the spatial reference point is presented on the projection area. When the switching frequency of the clear aperture sub-array is high enough, the distribution of spatial reference points is dense enough, based on visual retention, along the beam transmission direction, in an area in front of the spatial reference point, that is, similar to the viewing area shown in Figure 3 Inside, the three-dimensional information of the target object can be observed. The same is true along the y direction. During this process, at a point in time, part of the clear apertures of a group of clear aperture sub-arrays may also be opened. At this time, in the group of clear aperture sub-arrays, the corresponding pixels corresponding to the spatial reference points corresponding to the clear apertures are not opened. No information needs to be loaded at this point in time.

When using the timing characteristic to guide the device gating unit 100, taking it as an example of including P=2 groups of diaphragms, the lenslet array is also divided into P=2 groups of sub-arrays, and the lenslets of the two groups of lenslet sub-arrays are arranged alternately, such as Figure 13. The guide device gating unit 100 gates a group of sub-arrays of the small lens array of the guide device 20 while blocking the clear apertures of other small lenses. At a group of N adjacent time points, the guiding device gating unit 100 allows the apertures of each lenslet in the lenslet sub-array formed by the lenslets 21, 21″, etc. to pass light, and blocks the clear apertures of other lenslets at the same time. The display unit corresponding to the blocked lenslet does not display optical information at the N time points; at one of the time points, a group of clear aperture sub-arrays are opened, and other clear apertures are closed at the same time; each open clear aperture corresponds to a spatial reference Point on each pixel corresponding to the display unit corresponding to each small lens of the gating, take the spatial reference point as the viewpoint, and load the projection information of the target object on its image synchronously by the control unit 50. At the next group of adjacent N time points , the guiding device gating unit 100 allows the apertures of each small lens of the small lens sub-array formed by the small lenses 21', 21"', etc. to pass light, and at the same time blocks the clear apertures of other small lenses, and at the same time blocks the corresponding display unit of the small lens No optical information is displayed at the N time points; N groups of clear aperture sub-arrays are turned on in sequence, and information is synchronously loaded to each pixel of the display unit array corresponding to each small lens by the gating method based on the previous method. Repeat the above process to achieve three-dimensional display in the same way. In the above process, the display units corresponding to adjacent small lenses are also allowed to overlap each other in space, which is similar to the situation shown in FIG. 9 and FIG. 10 . When the guiding device gating unit 100 is removed, the above process no longer considers the switching of each small lens of the guiding device 20, but only considers the timing switch of the N groups of clear aperture sub-arrays. At N adjacent time points, N groups of clear aperture sub-arrays are turned on in sequence, and the same principle as above is used to load information into each pixel of the display unit array. Repeating the above process, passing each spatial reference point, a view corresponding to the spatial reference point is presented on the projection area. When the switching frequency of the clear aperture sub-array is high enough, the distribution of spatial reference points is dense enough, based on visual retention, along the beam transmission direction, in an area in front of the spatial reference point, that is, similar to the viewing area shown in Figure 3 Inside, the three-dimensional information of the target object can be observed. At this time, the non-main image formed by each display unit through the adjacent lenses of the corresponding small lens is presented as useless information at a position closer to the projection area where the main image is located. A light blocking plate array 30 is further placed in the system, similar to that shown in FIG. 1 , each light blocking plate of the light blocking plate array 30 will block the non-main image of each display unit. Based on the principles shown in FIGS. 9 and 10 , in the system shown in FIG. 13 , the gating unit 100 of the guiding device with timing characteristics can also be introduced, so that each small lens has a larger size corresponding to the display unit.

When the clear aperture array along the y direction is composed of only one set of clear aperture sub-arrays, that is, when one display unit along the y direction only corresponds to one clear aperture, there is also another information loading method: take a row of clear apertures. As the reference clear aperture row, when each clear aperture is opened, each pixel corresponding to the corresponding spatial reference point is taken as the viewpoint, and the projection information of the target object on its image is loaded synchronously by the control unit 50; but When each clear aperture belonging to other non-reference clear aperture row is opened, the pixel corresponding to its corresponding spatial reference point is loaded synchronously with the pixel loaded by the corresponding spatial reference point corresponding to the clear aperture of the same column in the reference clear aperture row when it is opened. light information. In this information loading mode, the 3D parallax information is no longer displayed in the y direction, and only the 3D information is presented along the x direction.

If the tracking unit 60 is enabled, the binocular position of the observer can be determined. According to the binocular position of the observer, the system can be controlled to display only the information needed in a small space at the binocular, reducing the amount of information calculation. When the spatial position of the observer's binocular pair system is relatively fixed, in the structure of Figure 13, part of the display unit/small lens pair can be removed, and only all or part of the display units that contribute to the optical information entering the observer's binocular are retained. / lenslet pair.

The auxiliary steering device 80 and the auxiliary combining device 90 described in FIGS. 5 to 8 in Embodiment 1 can be used in the system shown in FIG. 13 in the same way.

When each display unit in the plane arrangement in Figure 13 forms a real image through the corresponding small lens, that is, when an IV-type guide device with a plane structure is used, as shown in Figure 15, three-dimensional display can be achieved similarly through the above-mentioned process.

When the IV-type guide device is used, the main image of each display unit is a real image, and a one-dimensional scattering sheet 110 can be placed in the display area where the main images of the display units overlap, such as the scattering sheet 110 of vertically scattered incident light in FIG. 15 . Along the horizontal x-axis, a row of display unit/lenslet pairs are arranged as shown in Figure 15; along the vertical y-direction, multiple rows of display units/lenslet pairs of the same structure are arranged in sequence, but the spatial reference points corresponding to different rows of display units/lenslet pairs , which are sequentially dislocated along the horizontal direction. At one point in time, the clear apertures of a group of clear aperture sub-arrays are opened, and the other clear apertures are closed; the clear aperture along the x-axis is taken as the reference clear aperture row, and each open clear aperture corresponds to the spatial reference point. For the corresponding pixel, take the spatial reference point as the viewpoint, and load the projection information of the target object on its image synchronously; at the same time, the pixels corresponding to the spatial reference point corresponding to the clear apertures opened in other rows are virtually translated along the column direction. On the premise of the spatial reference point to the reference clear aperture line, take the translated virtual spatial reference point as the viewpoint, and load the projection information of the target object on its image synchronously. At multiple adjacent time points, multiple groups of clear aperture sub-arrays are turned on in sequence, and information is loaded synchronously as above. This process is repeated, and through scattering along the y-direction by the scattering sheet 110 , a three-dimensional presentation with only x-direction parallax is finally realized.

Example 3:

The type III guide device 20 can use a curved surface to arrange the lenslet arrays (21, 21', etc.), as shown in FIG. 21', etc.) one-to-one correspondence. The main images formed by each display unit through the corresponding small lens intersect at point O. For the clear visualization of images, FIG. 16 only takes two groups of display unit/lens pairs as an example for description. Each aperture of the guiding device gating unit 100 is located on each small lens aperture of the guiding device 20. If the guiding device gating unit 100 with timing characteristics is used, the small lens sub-arrays of different groups will be sequentially gated. For the guiding device gating unit 100 with characteristic characteristics, the light emitted from each display unit needs to have the characteristic that it can only pass through the group of apertures where the aperture corresponding to its corresponding small lens is located, but cannot pass through other groups of apertures. Along the transmission direction of the outgoing light beam from the display unit array 10, the clear aperture array 40 is placed in front of the guiding device, and consists of a plurality of clear apertures, each of which corresponds to a spatial reference point, and its switch can be switched on or off. The light equivalent to the main image of the display unit of the display unit array 10 corresponds to the light corresponding to the spatial reference point. The clear aperture array 40 is further divided into two or more sets of clear aperture sub-arrays. Taking FIG. 16 as an example, the three sets of clear aperture sub-arrays correspond to the spatial reference points VP _h11 and VP _h12 respectively, and the spatial reference points VP _h21 and VP h21 , respectively. VP _h22 , and spatial reference points VP _h31 , VP _h32 . The characteristic of these spatial reference points is that the light rays that pass through different spatial reference points corresponding to the same set of clear aperture sub-arrays, which are equivalent to the main image of the display unit of the display unit array 10 , originate from different pixels on the display unit array 10 . . Taking Figure 16 as an example, in the corresponding spatial reference points of the same group of clear aperture sub-arrays, the adjacent spatial reference points, such as VP _h11 and VP _h12 , relative to point O, the included angle is equal to or greater than that of the adjacent display unit/small lens. For the included angle relative to point O, the light rays passing through the set of spatial reference points and equivalently originating from the main image of the display unit of the display unit array 10 will originate from different pixels on the display unit array 10 .

In FIG. 16 , each spatial reference point is placed on the corresponding clear aperture surface, and in the following examples, for the sake of clear and simple illustration effect, the spatial reference points are all placed on the corresponding clear aperture surface. In fact, in this embodiment, on the premise that the switch of a spatial aperture can turn on or off the corresponding spatial reference point and is equivalent to the main image of the display unit from the display unit array 10, each spatial reference point may not be Corresponding to the surface of the clear aperture, even each clear aperture itself is non-planar.

为显示单元11所对应的单选区(含边线)。同理，各显示单元都分别对应一个单选区。只要同一通光孔径子阵列对应的各空间参考点分别位于不同单选区时，无论其是否采用均匀角间距的排列方式，过该组通光孔径子阵列对应不同空间参考点、等效来源于显示单元阵列10显示单元主像的光线，将分别来自显示单元阵列10的不同显示单元，满足过同一组通光孔径子阵列对应不同空间参考点、等效来源于显示单元阵列10显示单元主像的光线源自显示单元阵列10上的不同像素的要求。Relative to point O, the corresponding spatial reference points of the same group of clear aperture sub-arrays shown in FIG. 16 are arranged with uniform angular spacing, and this arrangement is conducive to obtaining a better three-dimensional display effect. However, the arrangement of the approximately uniform angular spacing is not mandatory. Let the edge points of the small lens 21 be q ₁ and q ₂ , as shown in FIG. 16 , connecting the two points and the two sides of the image of the display unit corresponding to the small lens, namely the points E and F in FIG. 16 , intersect at the point q ₃ and q ₄ . named area

It is the single selection area (including the border) corresponding to the display unit 11 . Similarly, each display unit corresponds to a single selection area respectively. As long as the spatial reference points corresponding to the same clear aperture sub-array are located in different single-selection areas, regardless of whether they are arranged with uniform angular spacing, the set of clear aperture sub-arrays corresponding to different spatial reference points, equivalently derived from the display The light rays of the main image of the display unit of the unit array 10 will come from different display units of the display unit array 10 respectively, and meet the requirements that the same group of clear aperture sub-arrays correspond to different spatial reference points, and are equivalent to the light from the main image of the display unit of the display unit array 10. Light originates from the requirements of the different pixels on the display cell array 10 .

The principle of selecting the optical structure and its related spatial reference points shown in FIG. 16 is explained and explained in the one-dimensional direction (row direction), and the same can be extended to the column direction of another dimension. Along the column direction, the lenslet arrays can be arranged along a straight line or along a curve; when arranged along a straight line, the center of each display unit has a specific spatial offset along the column direction relative to the optical axis of the corresponding lenslet to ensure that the The images of the display units are coincident; when they are arranged along the column-direction curve, it is similar to the row-direction curved surface arrangement shown in FIG. 13 .

According to the above selection principles of spatial reference points and the design principles of clear apertures, N(≧1) groups of clear aperture sub-arrays and corresponding spatial reference points are determined. For each clear aperture, through the reverse tracing of rays, the corresponding spatial reference point, the source pixel on the display unit array 10 of each light equivalent to the main image of the display unit of the display unit array 10 and the guide device 20 are determined. Imaged on the main image of the display unit.

At one point in time, a group of clear aperture sub-arrays are opened, and other clear apertures are closed at the same time. Each open clear aperture corresponds to each pixel corresponding to the spatial reference point. Taking the spatial reference point as the viewpoint, the control unit 50 loads the target synchronously. Projection information of the object on its image; when the exclusive characteristic is used to guide the device gating unit 100, at N adjacent time points, N groups of clear aperture sub-arrays are turned on in turn, and the information is loaded into each display unit array in the same way. pixel. Repeating the above process, passing each spatial reference point, a view corresponding to the spatial reference point is presented on the image plane. When the switching frequency of the clear aperture sub-array is high enough and the spatial reference point distribution is dense enough, based on visual retention, along the beam transmission direction, in an area in front of the spatial reference point, that is, the viewing area shown in Figure 3, The three-dimensional information of the target object can be observed. The same is true for the column direction in another dimension.

When using the timing characteristic to guide the device gating unit 100 , it is described by taking the case of including P=2 groups of diaphragms as an example, and the lenslet array is also divided into P=2 groups of sub-arrays. As shown in Figure 16, the two lenslets belong to different sub-arrays. The guide device gating unit 100 gates a group of sub-arrays of the small lens array of the guide device 20 while blocking the clear apertures of other small lenses. At a set of N adjacent time points, the guide device gating unit 100 allows the apertures of each small lens of the small lens sub-array where the small lens 21 is located to pass light, while blocking the clear apertures of other small lenses, and at the same time the blocked small lenses correspond to The display unit does not display optical information at the N time points; at one of the time points, a group of clear aperture sub-arrays are opened, and other clear apertures are closed at the same time. The small lens corresponds to each pixel on the display unit, and the control unit 50 loads the projection information of the target object on the image synchronously with the spatial reference point as the viewpoint. At the next set of N time points adjacent to each other, the guiding device gating unit 100 allows the apertures of each lenslet in the lenslet sub-array where the lenslet 21' is located to pass light, while blocking the clear apertures of other lenslets, and at the same time being blocked by the lenslets The corresponding display unit does not display optical information at the N time points; the N groups of clear aperture sub-arrays are turned on in sequence, and the information is loaded synchronously to each pixel of the display unit array corresponding to each small lens by the gating method based on the previous method. Repeat the above process to achieve three-dimensional display in the same way. When the guiding device gating unit 100 is removed, the switching of each small lens of the guiding device 20 is no longer considered in the above process, but only the timing switches of the N groups of clear aperture sub-arrays are considered. At N adjacent time points, N groups of clear aperture sub-arrays are turned on in sequence, and the same principle as above is used to load information into each pixel of the display unit array. Repeating the above process, passing each spatial reference point, a view corresponding to the spatial reference point is presented on the image plane. When the switching frequency of the clear aperture sub-array is high enough and the distribution of spatial reference points is dense enough, the three-dimensional information of the target object can be observed in a viewing area in front of the spatial reference point along the beam transmission direction based on visual retention. . At this time, the non-main image formed by each display unit through the adjacent lenses of the corresponding small lens is presented as useless information at a position closer to the projection area where the main image is located. A light blocking plate array 30 is further placed in the system, similar to that shown in FIG. 1 , each light blocking plate of the light blocking plate array 30 will block the non-main image of each display unit.

When the clear aperture array along the column direction is composed of only one set of clear aperture sub-arrays, that is, when one display unit along the column direction corresponds to only one clear aperture, there is also another information loading method: along the row direction, take A row of clear apertures is used as a reference clear aperture row. When each clear aperture is opened, each pixel corresponding to the spatial reference point corresponds to the spatial reference point, and the control unit 50 loads the image of the target object synchronously. projection information; however, when each clear aperture belonging to other non-reference clear aperture rows is opened, the pixel corresponding to its corresponding spatial reference point is loaded synchronously when the clear apertures in the same column along the column direction in the reference clear aperture row are opened, The corresponding spatial reference point corresponds to the light information loaded by the pixel. In this information loading mode, the 3D parallax information is no longer displayed in the column direction, and only the 3D information is presented in the row direction.

If the tracking unit 60 is enabled, the binocular position of the observer can be determined. According to the binocular position of the observer, the system can be controlled to display only the information needed in a small space at the binocular, reducing the amount of information calculation. When the spatial position of the observer's binocular pair system is relatively fixed, in the structure of Figure 13, part of the display unit/small lens pair can be removed, and only all or part of the optical components that contribute to the optical information entering the observer's binocular can be retained. .

The auxiliary steering device 80 and the auxiliary combining device 90 described in FIGS. 5 to 8 in Embodiment 1 can be used in the system shown in FIG. 16 in the same way.

When each display unit in FIG. 16 forms a real image through the corresponding small lens, that is, when an IV-type guiding device is used, as shown in FIG. 17 , three-dimensional display can also be realized by the method and process similar to the above.

In the systems shown in Figures 16 and 17, the lenslets are curved. With a small lens and an offset element, such as a prism, which folds or translates the image formed by the small lens, instead of the small lens in the III-type guide device or the IV-guide device, the display unit array 10 arranged in a plane can be used to complete the figure. 16 or the display effect realized by the display unit array 10 arranged on the curved surface as shown in FIG. 17 . FIG. 18 shows the optical structure when the lenslet/prismlet pair arranged in a plane replaces the lenslet arranged in a curved surface as shown in FIG. 14 .

To sum up, the present invention is characterized in that the guiding device 20 images each display unit of the display unit array 10 to the overlapping or intersecting area, and through a set of clear aperture sub-arrays, different pixels on the display unit array 10 present the three-dimensional target object. A group of views; using different groups of clear aperture sub-arrays that can be switched in time sequence, at different time points, through the timing switches of different groups of clear aperture sub-arrays, a large number of views are presented, and three-dimensional effect presentation is realized based on visual retention. Due to the introduction of the clear aperture array 40 of the timing switch, compared with the traditional three-dimensional display method, the technology proposed in this patent further improves the presentation amount of three-dimensional information and effectively improves the three-dimensional display effect through time multiplexing.

Claims (18)

1. A spatio-temporal hybrid multiplexed three-dimensional display system, comprising:

a display unit array, each display unit of the display unit array being composed of surface-arranged pixels for displaying optical information;

the guiding device is arranged at a position corresponding to the display unit array and is used for imaging each display unit and guiding the images of each display unit to be overlapped or intersected in a projection area or a projection space, and the overlapped or intersected images are named as main images of the corresponding display units;

the light-transmitting aperture array is arranged in front of the guide device along the transmission direction of the emergent light beams of the display unit array and consists of at least two groups of light-transmitting aperture sub-arrays which can be switched in a time sequence, each light-transmitting aperture of the light-transmitting aperture array corresponds to a space reference point respectively, the light-transmitting aperture is used for gating or cutting off the light which passes through the corresponding space reference point and is equivalent to the light from the main image of the display unit, and the corresponding reference point of each light-transmitting aperture is selected to ensure that the light which passes through the corresponding reference point of each light-transmitting aperture of the same light-transmitting aperture sub-array and is equivalent to the light from the main image of the display unit comes from different pixels of the display unit array;

the control unit is connected with the display unit array and the clear aperture array, and is used for controlling the time sequence switch of each group of clear aperture sub-arrays and controlling part or all pixels of the display unit array to synchronously load corresponding optical information when part or all of the clear apertures of one group of clear aperture sub-arrays are opened;

the directing device comprises a small lens array and a large-size concave lens, or the directing device comprises a small lens array and a large-size convex lens, wherein each small lens of the small lens array corresponds to each display unit of the display unit array in a one-to-one mode, each display unit is located on a focal plane of the corresponding small lens, and at least part of the small lenses in the small lens array are covered by the large-size concave lens aperture or the large-size convex lens aperture.

2. The space-time hybrid multiplexing three-dimensional display system according to claim 1, further comprising a guiding device gating unit, wherein the guiding device gating unit comprises P groups of light stops capable of being switched in a time sequence, each group of light stops arranged at intervals can be switched in a time sequence, each light stop corresponds to a different display unit, and only when the light stops are switched on, the light information equivalently emergent from the corresponding display unit main image is allowed to pass; or the guiding device gating unit consists of P groups of diaphragms with exclusive functions, the diaphragms of each group are arranged at intervals and correspond to different display units respectively, so that the light information of the main image equivalent emergent of the corresponding display unit can pass through, but the emergent light information of the display units corresponding to other groups of diaphragms cannot pass through, wherein P is larger than or equal to 2.

3. The spatio-temporal hybrid multiplexing three-dimensional display system according to claim 1, further comprising an array of light barriers disposed between the array of display units and the director for constraining the emergent light beams of each display unit to respectively emerge through the corresponding apertures; and/or

A tracking unit for tracking and determining the spatial positions of the two eyes of the observer; and/or

The adjusting unit is used for adjusting the relative position between each display unit in the display unit array and the guide device or changing the optical property of the guide device so that each display unit of the display unit array can translate relative to the guide device through a main image formed by the guide device; and/or

And a diffusion sheet which diffuses incident light in a one-dimensional direction.

4. The spatiotemporal hybrid multiplexed three dimensional display system of claim 1, wherein the lenslets are replaced with equivalent optical elements or optical components, and/or the large-sized concave lenses are replaced with equivalent optical elements or optical components; or said lenslet array is replaced by an equivalent optical element or optical component, and/or said large-size convex lens is replaced by an equivalent optical element or optical component.

5. The spatiotemporal hybrid multiplexing three-dimensional display system according to any one of claims 1 to 4, further comprising an auxiliary steering device interposed between the array of display units and the directing means for placing each display unit equivalently on the focal plane of or parallel to the corresponding lenslet.

6. The spatio-temporal hybrid multiplexing three-dimensional display system according to any one of claims 1 to 4, further comprising an auxiliary synthesizing device disposed between the display unit array and the directing device and capable of synthesizing the outgoing beams of the at least two separate pixel panels of each display unit so as to be incident on the directing device when each display unit of the display unit array is composed of at least two separate pixel panels.

7. A spatio-temporal hybrid multiplexing three-dimensional display method using a spatio-temporal hybrid multiplexing three-dimensional display system according to any one of claims 1 to 6, comprising the steps of:

s1, dividing the clear aperture array into N groups of clear aperture sub-arrays, and for each clear aperture, determining a spatial reference point corresponding to the clear aperture sub-array, a source pixel of each light ray on the display unit array and an image of each light ray on the display unit main image, which are equivalent to the light ray from the display unit main image, on the display unit main image, namely a pixel and an image corresponding to each spatial reference point, wherein N is not less than 1;

s2 at a point in time, in which at least part of the clear apertures of one group of sub-arrays of clear apertures are open and the clear apertures of the other groups of sub-arrays of clear apertures are closed;

s3 synchronously loading the projection information of the target object on the image of the target object by taking the corresponding space reference point as a viewpoint for the pixel corresponding to the space reference point corresponding to each light-transmitting aperture opened in the step s 2;

s4 is executed for each of at least partial time points of N adjacent time points, respectively executing steps s 2-s 3.

8. The spatio-temporal hybrid multiplexing three-dimensional display method according to claim 7, further comprising the step of s5 repeating the step of s 4.

9. The spatio-temporal hybrid multiplexing three-dimensional display method according to claim 8, the three-dimensional display system comprising a tracking unit for tracking and determining binocular spatial positions of an observer; and

the adjusting unit is used for adjusting the relative position between each display unit in the display unit array and the guide device or changing the optical property of the guide device so that each display unit of the display unit array can translate relative to the guide device through a main image formed by the guide device;

characterized in that, it also includes step s 6: according to the positions of the two eyes of the observer, the relative positions of the display units in the display unit array and the guide device are adjusted through the adjusting unit, or the optical properties of the guide device are changed, so that the display units of the display unit array can translate relative to the guide device through the main image formed by the guide device, the two eyes of the observer with changed positions can receive the emergent light information of the system, and the steps s 1-s 5 are executed again according to the new position relationship between the display units and the guide device.

10. A spatio-temporal hybrid multiplexing three-dimensional display method using a spatio-temporal hybrid multiplexing three-dimensional display system according to any one of claims 1 to 6,

the space-time hybrid multiplexing three-dimensional display system also comprises a guiding device gating unit, wherein the guiding device gating unit comprises P groups of diaphragms capable of being switched in a time sequence manner, all the groups of diaphragms arranged at intervals can be switched in a time sequence manner, all the diaphragms respectively correspond to different display units, and only when the diaphragms are switched on, the light information equivalently emergent from the main image of the corresponding display unit is allowed to pass; or the guiding device gating unit consists of P groups of diaphragms with exclusive functions, the diaphragms of each group are arranged alternately and correspond to different display units respectively, so that the light information of the main image equivalent emergent of the corresponding display unit can pass through the diaphragms, but the emergent light information of the display units corresponding to other groups of diaphragms can not pass through the diaphragms, wherein P is not less than 2;

the three-dimensional display method of the space-time hybrid multiplexing comprises the following steps:

ss1 divides the clear aperture array into N groups of clear aperture sub-arrays, and for each clear aperture, the source pixel of each light ray on the display unit array and the image of each light ray on the display unit main image, which are equivalent to the corresponding spatial reference point, from the display unit main image, are determined through ray tracing, that is, the pixel and the image corresponding to each spatial reference point are determined, wherein N is not less than 1;

ss2 at a point in time, at least part of the diaphragms of one of the P groups of diaphragms are opened, at least part of the clear apertures of one of the N groups of clear aperture sub-arrays are opened, and the clear apertures of the other groups of clear aperture sub-arrays are closed;

ss3 synchronously loads the projection information of the target object on the image of the target object for the pixels corresponding to the space reference points corresponding to the light-transmitting apertures opened in step ss2 by taking the corresponding space reference points as viewpoints, wherein at least the pixels of the display units corresponding to the opened diaphragms are loaded with light information;

ss4, P states of the P groups of light stops with only one group of gating respectively and N states of the N groups of light aperture sub-arrays with only at least partial light aperture sub-arrays with only one group of light aperture sub-arrays respectively are combined to form PN states respectively corresponding to PN adjacent time points, wherein, for at least partial time points in the PN adjacent time points, steps from ss2 to ss3 are correspondingly executed respectively at each time point of the at least partial time points.

11. The spatio-temporal hybrid multiplexing three-dimensional display method according to claim 10, further comprising the step ss 5: step ss4 is repeated.

12. The spatio-temporal hybrid multiplexing three-dimensional display method according to claim 11, the three-dimensional display system comprising a tracking unit for tracking and determining binocular spatial positions of an observer; and

the adjusting unit is used for adjusting the relative position between each display unit in the display unit array and the guide device or changing the optical property of the guide device so that each display unit of the display unit array can translate relative to the guide device through a main image formed by the guide device;

it is characterized in that the method also comprises the step ss 6: according to the positions of the two eyes of the observer, the relative positions of the display units in the display unit array and the guide device are adjusted through the adjusting unit, or the optical properties of the guide device are changed, so that the display units in the display unit array can translate relative to the guide device through the main image formed by the guide device, the condition that the two eyes of the observer with changed positions can receive the emergent light information of the system is ensured, and steps ss 1-ss 5 are executed again according to the new position relationship between the display units and the guide device.

13. A spatio-temporal hybrid multiplexing three-dimensional display method using a spatio-temporal hybrid multiplexing three-dimensional display system according to any one of claims 1 to 6, comprising the steps of:

the sssss1 divides the clear aperture array into N groups of clear aperture sub-arrays along a one-dimensional row direction, and all row clear apertures are arranged along the row direction in a staggered manner corresponding to the space reference points; wherein N is ≧ 1;

sssss2 determines, for each clear aperture, the spatial reference point corresponding thereto, the source pixel of each light ray on the display cell array equivalent to the main image of the display cell and the image thereof on the main image of the display cell, that is, the pixel and the image thereof corresponding to each spatial reference point, by ray tracing;

sssss3 at a point in time, where at least part of the clear apertures of one set of clear aperture sub-arrays are open and the clear apertures of the other sets of clear aperture sub-arrays are closed;

the sssss4 takes a row of clear apertures as a reference clear aperture row, opens the pixels corresponding to the spatial reference points corresponding to the clear apertures, and synchronously loads the projection information of the target object on the image by taking the corresponding spatial reference points as viewpoints; meanwhile, on the premise that the pixels corresponding to the space reference points corresponding to the light-transmitting apertures opened in other rows are virtually translated to the reference light-transmitting aperture rows along the column direction, the translated virtual space reference points are used as viewpoints, and projection information of the target object on the image is synchronously loaded;

at least some of the N adjacent time points of the sssss5 respectively perform the sssss 3-sssss 4 steps at each of the at least some of the time points.

14. The spatio-temporal hybrid multiplexing three-dimensional display method according to claim 13, further comprising the step sssss 6: step sssss5 is repeated.

15. The spatio-temporal hybrid multiplexing three-dimensional display method according to claim 14, the three-dimensional display system comprising a tracking unit for tracking and determining binocular spatial positions of an observer; and

the adjusting unit is used for adjusting the relative position between each display unit in the display unit array and the guide device or changing the optical property of the guide device so that each display unit of the display unit array can translate relative to the guide device through a main image formed by the guide device;

the method is characterized by further comprising the step sssss 7: according to the positions of the two eyes of the observer, the relative positions of the display units in the display unit array and the guide device are adjusted through an adjusting unit, or the optical properties of the guide device are changed, so that the main images of the display units in the display unit array formed by the guide device are translated relative to the guide device, the two eyes of the observer with changed positions can receive the emergent light information of the system, and the steps sssss 1-sssss 6 are executed again according to the new position relationship between the display units and the guide device.

16. A three-dimensional display method of space-time hybrid multiplexing, which uses a three-dimensional display system of space-time hybrid multiplexing as claimed in any one of claims 1 to 6, wherein the three-dimensional display system of space-time hybrid multiplexing further comprises a guiding device gating unit, the guiding device gating unit comprises P groups of light diaphragms which can be switched on and off in a time sequence, each group of light diaphragms arranged alternately can be opened in a time sequence, each light diaphragm corresponds to a different display unit, and only when the light diaphragms are opened, the light information equivalently emergent from the main image of the corresponding display unit is allowed to pass; or the guiding device gating unit consists of P groups of diaphragms with exclusive functions, the diaphragms of each group are arranged alternately and correspond to different display units respectively, so that the light information of the main image equivalent emergent of the corresponding display unit can pass through the diaphragms, but the emergent light information of the display units corresponding to other groups of diaphragms can not pass through the diaphragms, wherein P is not less than 2;

the space-time hybrid multiplexing three-dimensional display method comprises the following steps:

the ssssss1 divides the clear aperture array into N groups of clear aperture sub-arrays along a one-dimensional row direction, and all row clear apertures are arranged along the row direction in a staggered manner corresponding to the space reference points; wherein N is ≧ 1;

ssssss2 determines, for each clear aperture, the spatial reference point corresponding thereto, the source pixel of each light ray on the display cell array and the image thereof on the display cell main image, which are equivalent to the light ray from the display cell main image, through ray tracing, that is, the pixel and the image thereof corresponding to each spatial reference point;

ssssss3 selects one time point of the adjacent PN time points, at least part of the diaphragms of one of the P groups of diaphragms are opened, at least part of the clear apertures of one of the N groups of clear aperture sub-arrays are opened, and the clear apertures of the other groups of clear aperture sub-arrays are closed;

ssssss4 takes a row of clear apertures as a reference clear aperture row, opens the pixels corresponding to the spatial reference points corresponding to each clear aperture in the reference clear aperture row, and synchronously loads the projection information of the target object on the image by taking the corresponding spatial reference points as viewpoints; simultaneously, on the premise of virtually translating the corresponding space reference point to the reference clear aperture row along the column direction, synchronously loading projection information of a target object on the image of the target object by taking the correspondingly translated virtual space reference point as a viewpoint for pixels corresponding to the space reference point corresponding to each opened clear aperture in other rows, wherein at least the pixels of each display unit corresponding to the opened diaphragm are loaded with optical information;

ssssss5, wherein the P states of the P groups of light stops when only one group of gating is present respectively and the N states of the N groups of clear aperture sub-arrays when only one group of gating is present respectively are combined to form PN states corresponding to PN adjacent time points respectively, and wherein, for at least some of the PN adjacent time points, the steps ssssss 3-ssssss 4 are correspondingly performed at each of the at least some time points respectively.

17. The spatio-temporal hybrid multiplexing three-dimensional display method according to claim 16, further comprising the step ssssss 6: step ssssss5 is repeated.

18. The spatio-temporal hybrid multiplexing three-dimensional display method according to claim 17, the three-dimensional display system comprising a tracking unit for tracking and determining binocular spatial positions of an observer; and

the adjusting unit is used for adjusting the relative position between each display unit in the display unit array and the guide device or changing the optical property of the guide device so that each display unit of the display unit array can translate relative to the guide device through a main image formed by the guide device;

characterized in that, it also includes the step sssss 7: according to the positions of the two eyes of the observer, the relative positions of the display units in the display unit array and the guide device are adjusted through an adjusting unit, or the optical properties of the guide device are changed, so that the main images of the display units in the display unit array formed by the guide device are translated relative to the guide device, the two eyes of the observer with changed positions can receive the emergent light information of the system, and the steps sssss 1-sssss 6 are executed again according to the new position relationship between the display units and the guide device.

Images