WO2022264029A1

WO2022264029A1 - 3d image capturing and displaying system using a moving array of holes

Info

Publication number: WO2022264029A1
Application number: PCT/IB2022/055497
Authority: WO
Inventors: Jan Karch
Original assignee: SPYRA, Czesław; KARCH, Jarosław; KARCH, Krzysztof
Priority date: 2021-06-15
Filing date: 2022-06-14
Publication date: 2022-12-22
Also published as: PL438164A1

Abstract

The subject of the invention is a method for recording images and their reading in 3D technology on the displays of TV sets, computers, smartphones and other devices additionally equipped with LCD, LED, OLED, QLED panels with programmable transparency. The method of recording images and their reading in 3D technology consists in developing images and scenes from real and animated objects and events, so that images and scenes are recorded from various perspectives, both vertically and horizontally, with high accuracy. Selective recording of images and scenes from different perspectives is possible by separate recording of partial images through an orifice or groups of orifices in a diaphragm (A) on a light sensitive carrier (B) at different locations in this carrier so that partial images recorded at the same time never overlap each other. Each partial image is recorded during the time interval from 't' to 't+nx' at a single location or at a group of locations. During this time interval, the object (O) or event is recorded from many different sides vertically and horizontally as partial images.

Description

3D IMAGE CAPTURING AND DISPLAYING SYSTEM USING A MOVING ARRAY OF HOLES

The present invention relates to a method for recording of images and reading of recorded images in the 3D technology on displays of TV sets, computers, smartphones and other devices equipped additionally with LCD, LED, OLED or QLED display panels.

Various techniques for recording of images have been used so far with the aim to enable further reproduction of images as stereographic ones so that to achieve an illusion of 3D perception where a separate image is seen by each of human eyes. These techniques are based on combination of two images, a red one and a blue or green one, on a single paper sheet, snapshot or movie. Such images are watched by means of dedicated filtering goggles or visors so that only one of overlapped images is received by each eye. Such a technique leads to the illusion of stereoscopic vision.

Another method that also enables stereographic vision consists in alternated sequencing of video frames, i.e. the doubles number of frames is shown to spectators, which is 48 frames instead of 24 for movies or 120 frames instead of 60 for TV images. These frames are alternately watched by the left and right eye. Spectators must wear special goggles that instantly shut off and reopen light beams and eventually appropriate images from interleaved frames are delivered to the left and right eyeballs to produce the effect of the stereoscopic vision. Yet another technology is known as well, where polarization of light waves is used in such a way that images from two projectors pass through polarizing devices rotated mutually by 90°. Special goggles that are used for that technology act as an analysing device that allow only the image dedicated to the appropriate eye to pass through at a moment.

There is a technology used in radiology, actually in systems for recording of movements and intensity of gamma radiation emitted by various objects then, after the signal strength is measured, the radiation field is mapped into a 3D image. Such a solution is known from US 7,166,846 B2.

The international patent application W02007/105205A2 discloses a device for 3D mapping of objects that includes an illuminating unit comprising an emitter of collimated light and a diffuser (diffractive element) that are arranged accordingly to project the main pattern of dots onto an object; a single unit for acquisition of images that is designed to acquire images of the primary pattern dots projected onto the object and then received at a single, fixed location and at a fixed angles with respect to the light emitter. Subsequently, a controller is used to process images of the primary pattern of dots acquired at a single and fixed angle so that to produce a 3D map of the object.

The purpose of this invention is to disclose a method for recording images and then display 3D images and scenes so that they can be viewed from any watching direction and such images can be viewed without any goggles. Another purpose of this invention is to disclose a method for recoding images and scenes with the use of both real objects and events and animated ones so that these images and scenes are recorded with high resolution from various perspectives both in the horizontal and vertical planes. The selective recording images and scenes from various perspectives is possible owing to separate recording of partial images on a light sensitive carrier through at least one moving orifice of a diaphragm (A) on a light sensitive carrier (B) at various locations on that carrier arranged in such a way that at a specific moment these partial images do not overlap. The term ‘at least one orifice’ is understood as a single orifice or a group of orifices. Each partial image is recorded during the time interval from ‘t’ to ‘t+nx’ at a single location or at a group of locations. It is the time interval when the image of the object Ό’ or an event are recorded as partial images viewed from various sides located in both horizontal and vertical planes.

An object or an event are recorded in the way as disclosed in the invention, where the recording principle is very close to actual viewing of objects or images by human eves who stays behind an opaque plate with a single orifice in it. For each specific location a non-moving human sees the space behind the plate in different ways, depending whether the space is watched with the left or the right eye. When the plate with an orifice is moving in its plane, the human at each moment of time can see a different part of real space behind the plate. The same situation is when the plate is immobile and the human is moving with respect to the plate - the human through the orifice can see a different part of the real space with the left eye and a different one with the right eye. Therefore recording of partial images or scenes, covered by the spherical angle ‘a’ with the vertex in the orifices (1; 2; 3; ...n) moving down the diaphragm (A), on a light sensitive carrier (B) actually corresponds to recording of images or scenes that are viewed by a human positioned behind the plate. Partial images of objects or scenes are then converted by means of the axial transformation and transferred to the display (D) or stored in a memory. The partial images of objects or scenes are recorded along with information about the position of the orifice (1; 2; 3; ...n) or position of orifice groups were used to make recordings so that to enable reverse transformation and images or scenes would be presented on screen of TV sets or other displays. To enable such reproduction of already recorded and then transmitted and replayed scenes or images on a display panel (D), these images are watched through a diaphragm (R) with moving orifices (G; 2’; 3’;...n’) or orifice groups, where locations of such orifices or orifice groups are synchronized with images or scenes to be shown on displays. Should recording and further reproduction of images are carried out at sufficiently high rates, a spectator, owing to some inertia of human eyes can see images or scenes in different way from different locations, which makes an impression of 3D imaging since the images or scenes can be viewed from the right/left hand side or top/bottom perspectives.

The method for recording of images and reading of recorded images in the 3D technology according to the present invention is characterized in that a light sensitive carrier (B), preferably a matrix of a photo camera or a photographic plate, is positioned behind a diaphragm (A) preferably designed in the form of a LED, QLED or OLED screen with programmable transparency or mechanical diaphragm with movable orifices. Images of objects (O) or scenes extended in front of the diaphragm (A) and comprising imaged points, for instance (la, 2a, 3a, 4a, 5a, 6a,

7a, .13a), are recorded on the light sensitive carrier, whereas the distance (L) between the diaphragm (A) and the light sensitive carrier (B) is adjustable and adapted to the area of the scene or to the viewing angle (a). The diaphragm (A) comprises at least one orifice positioned at locations (1; 2; 3; 4 ... n) or pluralities of orifices arranged in vertical, oblique or alternated groups, whereas images recorded on the light sensitive carrier (B) never overlap during recording through orifice groups. Light beams penetrate the diaphragm at exactly predefined locations, i.e. orifices that are preferably arranged in mechanical or electronic way. These light beams arrive to the diaphragm (A) at various angles and then pass through orifice (1; 2; 3; ...n) or orifice groups. Consequently, reproduction of scenes or objects (O) are projected by the diaphragm onto the light sensitive element (B) in the horizontal and vertical perspectives. Simultaneously, after transformation by the central symmetry, the image is recorded at the moment of / in a permanent manner (in the memory of a photo camera or on a photographic plate), whereas the retrieving time T is delayed with respect to the recording time t (T>t). The images can be transmitted as well (also after transformation by the central symmetry) to a display (D), if the images are reproduced in the real time mode (T = t). Displaying of partial images, transformed by the central symmetry, is always synchronised with the time offset of ‘x’ necessary for displacement of orifices (G; 2’; 3’; ... n’) or grouped orifices or transparent dots in the diaphragm (D), whereas images of the object (O) defined by points: (la, 2a, 3a, 4a, 5a, 6a, 7a, 8a, 9a, 10a, 1 la, 12a, 13a) make partial records on the light sensitive carrier (B) and such partial records depend on locations of specific orifices. For instances, when the orifice is in the position ‘G, the recording is defined by points (201, 101), for the orifice position of ‘2’ the recording comprises points (402; 302; 202; 102); for the orifice position of ‘3’ the recording is defined by points (303; 403; 503; 603; 704; 803), for the orifice position of ‘4’ the points (604; 704; 804; 904; 1104; 1204) are recorded, for the orifice position of ‘5’ the recording comprises points (905; 1005; 1105; 1205; 1305) and for the orifice position of ‘6’ the recorded image includes points (1106; 1206 ;1306). For the orifice position of ‘n’ the recording corresponds to the space outside the object (O). In all cases the recordings on a light sensitive carrier (B) are transformed by the central symmetry (1/1; 2/2; 3/3; 4/4; 5/5; 6/6; up to n/n) for each partial recording, separately for each position of the orifice (1, 2, 3, ... n) or separately for groups of orifices. The transformation is carried out by optical or electronic means is such a way that the image (201, 101) for the orifice position of ‘ is transformed to the image (101, 201), the image (402, 302, 202, 102) for the orifice position of ‘2’ is transformed into the image (102, 202, 302, 402), the image (803, 703, 603, 503, 403, 303) for the orifice position of ‘3’ is transformed into the image (303, 403, 503, 603, 703, 803), the image (1204, 1104, 904, 804, 704, 604) for the orifice position of ‘4’ is transformed into the image (604, 704, 804, 904, 1104, 1204), the image (1305, 1205, 1105, 1005, 905) for the orifice position of ‘5’ is transformed into the image (905, 1005, 1105, 1205, 1305), whilst the image (1306, 1206, 1106) for the orifice position of ‘6’ is transformed into the image (1106, 1206, 1306). In turn, the image for the orifice position of ‘n’ (a partial image for the vicinity of the object (O)) is also transformed by the central symmetry. The synchronization is carried out in such a way that each position of the orifice (1; 2; 3; ... n) or the orifice groups in the diaphragm (A) is mapped onto a single position of the orifice ( ; 2’; 3’; ... n’) or the orifice groups in the diaphragm (R), whilst displaying of partial images on the display (D) is synchronized with subsequent positions of orifices, which leads to formation of a virtual image (lb; 2b; 3b; 4b; 5b; 6b; 7b; 8b; 9b; 10b; lib; 12b; 13b) to be watched by a spectator (01), (02), whereas the light sensitive carrier (B) is interfaced to the display (D) that receives partial images after transformation by the central symmetry and that is beneficially arranged as a TV screen or a projection screen with a diaphragm arranged as an intermediate screen with local transparent areas, which enables presentation of 3D images on cinema screens with the diaphragms (R). Such an intermediate screen is beneficially arranged as a QLED or OLED display with programmable transparency or can also be a diaphragm provided with moving orifices (G; 2’; 3’; ... n’) and the spectator (01) or (02) shall be positioned behind the diaphragm. The orifice (1; 2; 3; ... n) or groups of orifices move down the entire surface of the diaphragm (A) synchronously to the images recorded on a light sensitive carrier (B) as partial images, depending on positions of the orifice (1; 2; 3; ... n) or groups of orifices and on the viewing angle ‘a’ adjusted by mean of the controllable distance ‘L\ The diameters of single orifice (1; 2; 3; ... n) or orifices in groups range from 0.1 to 0.5 mm so that recordings on a light sensitive carrier (B) offer the best quality

(resolution) and can be moved to subsequent position with any increment (step) greater than 0 within the time ‘x ’ greater than 0 while subsequent partial images are recorded on a light sensitive carrier (B). The recorded images are presented on the display (D) in the same sequence as they have been recorded on the light sensitive carrier (B), synchronously to the sequence of orifice positions (1; 2; 3; ... n) in the diaphragm (A) and positions of orifice ( ; 2’; 3’; ... ’) in the diaphragm (R).

The method for recording of images and reading of recorded images in the 3D technology on displays of TV sets, computers, smartphones and other appliances additionally provided with LCD, LED, OLED or QLED display panels as well as other transparent displays adopted in sizes is shown with more details in the attached drawings, where Fig. l is a schematic illustration of the entire process that comprises recording of images, its storage, transformation and presentation on screens or displays that can be watched by spectators; Fig. 2 is a schematic illustration of images recording during the phase of their storage; Fig. 3 is a schematic illustration of the images recording during the phase of their transformation, whilst Fig. 4 is a schematic illustration of images recording during the phase of their screening (presentation on displays).

Embodiment 1. The method for recording of images and reading of them in the 3D technology consists in the solution that a diaphragm (A) implemented in the form of a transparent OLED display with the adjustable reduction of its transparency is positioned in between of an object (O) or a scene and a light sensitive carrier (B), which can be a matrix of a photographic camera, where images of an object (O) or a scene positioned in front of the diaphragm (A) are recorded, whereas the distance (L) between the diaphragm (A) and the light sensitive carrier (B) is adjustable and may correspond to the size of a scene. The diaphragm (A) comprises a single orifice (1), which is actually a transparent spot on the diaphragm. The orifice is displaced down the entire diaphragm by a specific increment starting from the position (1) to subsequent positions (2; 3; ... n) whereas only a single partial image, associated with a specific position of the orifice, is recorded on a light sensitive carrier (B) at a specific moment of time. After the orifice is displaced to another position the light sensitive carrier is substituted with a next ‘frame’ or a record. A single orifice can be substitutes by a group of orifices. Penetration of light beams, i.e. movements of the diaphragm (A) is preferably controlled in a mechanical way so that light beams arrive at various angles to locations on the diaphragm (A) after passing through the orifice that is displaced to subsequent positions (1; 2; 3; ... n) simultaneously in the horizontal and vertical perspective. Subsequently, light beams arrive to the light sensitive carrier (B) and project light from the scene (O) to the light sensitive carrier (B) simultaneously in the horizontal and vertical perspectives. These light beams map a record on the light sensitive carrier (B), where the record depends on the orifice positions (1; 2; 3; n) against the diaphragm (A) and the record on the light sensitive material (B) is transformed by the central symmetry (1/1; 2/2; 3/3; 4/4; 5/5; 6/6; ... up to n/n), separately for each position (1; 2; 3; n) of the orifice by optical means. The recording of images on the light sensitive carrier is synchronized with displacement of the orifice (1) in the time increment ‘x’ is such a way that each position of the orifice corresponds to only one image on the display, whereas an interface to a display (D) is provided behind the light sensitive carrier (B) and the display (D) can be implemented as a TV screen or a projection screen. The diaphragm (R) arranged as a screen with programmable local transparencies (G; 2’; 3’; 4’;....n’ ) is positioned behind the light sensitive carrier (B), while a spectator (01, 02) is positioned behind the diaphragm (R). Since partial images (scenes) are presented on the display (D) at high rates and human eyes work with some inertia, the spectator (01) and the spectator (02) can see the entire object or a scene at different angles, from different perspectives at the horizontal and vertical planes, i.e. human eyes in an inherent way can see an object or a scene as a 3D image. Embodiment 2. The method for recording of images and reading of them in the 3D technology consists in the solution that a diaphragm (A) implemented in the form of a transparent QLED display with the adjustable blinding of its transparency, is positioned in between of an object (O) at one side and a light sensitive carrier (B) at the other side, whereas the light sensitive carrier (B) can be implemented as photographic plate designed to record images of an object (O) or a scene positioned in front of the diaphragm (A). The distance (L) between the diaphragm (A) and the light sensitive carrier (B) is adjustable and may correspond to the desired viewing angle (a). The diaphragm (A) comprises at least a single orifice (a programmable transparent spot), which is displaced to subsequent positions (1; 2; 3; ...n), or may comprise a group of orifices, whereas images projected onto the light sensitive carrier (B) never overlap when a single partial image or a group of images is recorded. Propagation of light beams is controlled in an optical and electronic manner so that these beams arrive at various angles to locations on the diaphragm (A) and the diaphragm (A), in turn, projects light received from a scene or an object (O) onto the light sensitive carrier (B) through an orifice at the positions (1; 2; 3; ...n) or through transparent spots in OLED or QLED screens, or through groups of orifices. The images of objects (O) map records on the light sensitive carrier (B), where the record depends on the orifice positions (1; 2; 3; n) against the diaphragm (A) and the record on the light sensitive material (B) is transformed by the central symmetry (1/1; 2/2; 3/3; 4/4; 5/5; 6/6; ... up to n/n), separately for each position of the orifice or the group of orifices, by electronic means. The record is transmitted to the display (D) at the moments when the time of recording t coincides with the time of readout (T = t ) and presentation of partial images on the display (D) is synchronized with displacement of orifices, groups of orifices or group of transparent spots (they can be arranged in vertical, horizontal or oblique series of orifices or transparent spots) by the time increment ‘x’ on both the diaphragm (A) and the diaphragm (R), so that at each moment of time any position (1 ; 2; 3 ; ... n) of the orifice or a group of orifices on the diaphragm, (A) corresponds to displaying a single partial image or a group of partial images on the display (D) and these moments are synchronized with the positions (G; 2’; 3; ...n’) of an orifice or a group of orifices on the diaphragm (R). The display (D) is implemented as a TV screen or a projection screen, whilst the diaphragm (R) is a screen with programmable local transparencies to enable presentation of images on cinema screens. The diaphragm can be also arranged as a transparent QLED display with programmable transparent spots, where a spectator (01) or (02) is positioned in front of it. A spectator watches the screen implemented as a diaphragm (R) and can see partial scenes presented on the display (D) in such a way that he/she can see subsequent pre-recorded images associated with position of a certain orifice or a certain transparent spot as he/she would watch a real object from different perspectives through ‘orifices’ in a plate moving in front of a scene or an object. When the partial records change with sufficiently high rates, a spectator can see the entire scene but in a different way from different perspectives.

According to the explanation of the related drawing, the invention consists in recording of images and real scenes by means of at least one lenses that comprises a diaphragm (A) with a moving orifice (1 ; 2; 3 ; ... n) or orifices arranged into groups and is coupled with a recording light sensitive carrier (B) so that the mutual distance of them can be adjusted. The moving orifice (1) (1; 2; 3; ...n) or moving groups of orifices in the diaphragm (A) are synchronized with recording on the light sensitive carrier (B) so than every new position (1; 2; 3; ... n) of the orifice (1) or orifices arranged in groups in the diaphragm (A) correspond to exactly one record of a partial image or exactly one group of partial images mapped onto the light sensitive carrier. Therefore, within the presumed range, a real image or a scene is recorded from multiple directions and locations arranged in both horizontal and vertical planes, whilst the distance between the lenses, arranged as the diaphragm (A), and the light sensitive carrier (B) is properly selected so that to achieve the assumed range of the scene. Images on the light sensitive carrier (B) can be recorded at any time provided that components in the group of images recorded simultaneously do not overlap. The already recorded images are then processed in such a way that they can be presented on a display with the image orientation corresponding to the real view. Such a recording, depending on actual needs and the desired resolution (accuracy) may store images of an object /scene (O) viewed from any number of observation points and with such a range that is determined by the size and accuracy (resolution) of the light sensitive carrier (B).

Images on the display (D) can be presented in the real time mode or can be retrieved from memory devices that are commonly used. Presentation of images on the display (D) assumes that a diaphragm (R) is arranged in front of the display (D) and the diaphragm (R) comprises moving orifice (G) ( ; 2’; 3’; ... n’) or groups of orifices that are associated with the image presented on the display (D) in such a way that each position of the orifice (G) ( ; 2’; 3’; ... n’) or groups of orifices on the diaphragm (R) corresponds to a single image /group of images recorded on the light sensitive carrier (B). Due to the fact that only one partial scene or a partial image can be seen through one orifice (G) and image presentation and displacement of the orifice (G) are carried out at high rates, human eyes perceive an apparent (virtual) image and apparent (virtual) scenes as would be seen on the display (D) at various angles (b) and from various locations and no dedicated goggles are needed. Spectator /viewers 01 and/or 02 can see an object or a scene from various sides, in a different way for the right and the left eye and in a different way for one spectator 01 and the second spectator 02, which enables to achieve the impression of a 3D image. Watching object/scenes in the foregoing way makes it possible to see spatial details both in the horizontal and vertical planes. The images /scenes presented on the display (D) can be watched by viewers/spectators 01 and/02 independently from various locations and the impression remains that a 3D image is watched.

Claims

Patent claims

1. A method for recording of images and reading of recorded images in the 3D technology, characterized in that images and scenes with involvement of both real objects and events as well as cartooned ones are recorded selectively from various perspectives both in the vertical and horizontal planes by separate recording of partial images through an orifice or groups of orifices in a diaphragm (A) arranged preferably as a transparent LCD, LED, OLED or QLED screen, where images are recorded on a light sensitive carrier (B), preferably a matrix of a photographic camera or a photographic plate, in various locations of that carrier so that partial images recorded at the same time never overlap each other whereas the distance (L) between the diaphragm (A) and the light sensitive carrier (B) is adjustable and can match the area of a scene or the viewing angle (a); and further the diaphragm (A) comprises at least one orifice (1) at the positions (1; 2; 3; 4; ... n) or orifices arranged into groups and directions of light beams propagation are preferably controlled in a mechanical or electronic way, these light beams arrive at various angles to locations in the diaphragm (A) and then pass the diaphragm through the orifice (1) at the positions (1; 2; 3; 4; ... n) or orifices arranged into groups and subsequently light beams received from the scene or the object (O) are projected onto the light sensitive carrier (B) simultaneously in the horizontal and vertical perspectives; the light beams arrive then to the light sensitive carrier (B), whereas partial images of scenes or objects (O) are recorded on the light sensitive carrier (B), where the records depend on the positions (1; 2; 3; 4; ... n) of the orifice (1) or groups of orifices against the diaphragm (A), whilst the records on the light sensitive carrier (B) are transformed by central symmetry (1/1; 2/2; 3/3; 4/4; 5/5; 6/6; up to n/n ) separately for each position (1; 2; 3; 4; ... n) of the orifice (1) or groups of orifices and the transformation is carried out in the optical or electronic way; the records can be durably stored on the light sensitive carrier, so that the time of image presentation T s delayed with respect to the time of recording (!) ( T> /), or the records are transmitted to a display to be presented in the real time mode ( = /), whereas presentation of partial images is synchronized with time increments ‘x’ assigned for movements of the orifice (1), groups of orifices or a transparent spot to the position (1; 2; 3; 4; ... n) on the diaphragm (A), therefore each position of the orifice is associated with only a single presentation on the display, or each position of a group of orifices in the diaphragm (A) is associated with a single group of partial images recorded on the light sensitive carrier (B), which is synchronized with the process of image recording and the sequence of recording corresponding to the order of recorded images is preserved; whereas the light sensitive carrier (B) is electronically interfaces to the display (D), arranged preferably as a TV screen or a projection screen, together with a diaphragm (R) arranged as a screen with local transparent spots, which is suitable for presentation of images on a cinema screen, or arranged as a LCD, LED, OLED or QLED panel with programmable locations of transparent spots, which enables generation of orifices or groups of orifices or transparent spots at locations (L; 2’; 3’; 4’;....n’), whereas a spectator (01) or (02) is positioned behind the screen.

2. The method according to Claim 1, characterized in that the orifice (1) or groups of orifices in the diaphragm (A) are moved to positions (1; 2; 3; 4; ... n) or groups of positions on the entire surface of the diaphragm (A) in such a way that movements are synchronized with recording on the light sensitive carrier (B) so that each position (1; 2; 3; 4; ... n) of the orifice (1) or orifices within groups is associated with only one partial record or a single group of partial records for the corresponding image of an actual scene or an object (O) on the light sensitive carrier (B), where these images are recorded in parts and partial images depend on position of the orifice (1) or orifices within a group and controlled by means of the distance ‘L’ and the viewing angle ‘a’.

3. The method according to Claim 1, characterized in that each orifice (1) or orifices within groups have the diameters ranging from 0.1 mm to 0.5 mm and are displaced to subsequent position with any spacing /step greater than 0 and during the time increment ‘x’ greater than 0 so that subsequent images are recorded on the light sensitive carrier B.

4. The method according to Claim 1, characterized in that orifices in groups are arranged in vertical, horizontal or oblique planes or in a whichever another order so that images recorded on the light sensitive carrier never overlap each other.

5. The method according to Claim 1, characterized in that the footage for a scene or an object is recorded preferably by means of a single camera.