[go: up one dir, main page]

WO2019225775A1 - Multi-view integral imaging system using dual-prism array - Google Patents

Multi-view integral imaging system using dual-prism array Download PDF

Info

Publication number
WO2019225775A1
WO2019225775A1 PCT/KR2018/005849 KR2018005849W WO2019225775A1 WO 2019225775 A1 WO2019225775 A1 WO 2019225775A1 KR 2018005849 W KR2018005849 W KR 2018005849W WO 2019225775 A1 WO2019225775 A1 WO 2019225775A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
sub
dual
array
prism
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2018/005849
Other languages
French (fr)
Korean (ko)
Inventor
김은수
최희민
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Research Institute for Industry Cooperation of Kwangwoon University
Original Assignee
Research Institute for Industry Cooperation of Kwangwoon University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Research Institute for Industry Cooperation of Kwangwoon University filed Critical Research Institute for Industry Cooperation of Kwangwoon University
Priority to PCT/KR2018/005849 priority Critical patent/WO2019225775A1/en
Publication of WO2019225775A1 publication Critical patent/WO2019225775A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
    • H04N13/322—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using varifocal lenses or mirrors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/349—Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking
    • H04N13/351—Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking for displaying simultaneously

Definitions

  • the present invention relates to a multi-view integrated imaging system using a dual prism array. More particularly, the present invention provides a multi-view three-dimensional restored image using a pickup system composed of a dual prism array and a lens array.
  • the present invention relates to a multi-view integrated video system using a dual prism array that can provide more viewpoints than a three-dimensional display and uses an existing display system, and thus has high utilization of the system and can feel a greater depth due to the multi-view. .
  • Korean Patent Publication No. 10-1445489 discloses a three-dimensional integrated image display system, comprising: a pickup unit for acquiring respective element images of three-dimensional objects; For each element image acquired by the pickup unit A focus image generator for newly generating a focused element image by using a convolution operation of a periodic delta function array represented by; An observer recognition unit for recognizing the observer's instruction and finding the position of the focused element image; An optical display unit for optically displaying a focused element image through a lens array;
  • the 3D image generated in space is recognized as a depth camera or stereo camera by the observer's directed depth region, which is a 3D image portion indicated by the observer's hand movement, and spatially coordinated.
  • a three-dimensional integrated image display system having a focus control function which is characterized by providing a three-dimensional image by blurring images of other regions, has been disclosed.
  • Korean Patent Publication No. 10-1600681 discloses a three-dimensional image display depth conversion method of an integrated imaging system.
  • the conventional integrated imaging system has a limited view point, and the number of viewpoints is limited by the lens array when picking up, and therefore, there is a disadvantage in that the various view points of the object are limited when the 3D object is restored.
  • the present invention has been made to solve the above problems, the present invention can provide more viewpoints than the existing three-dimensional display, and because the use of the existing display system, the utilization of the system is high, multi-view It is to provide a multi-view integrated image system using a dual prism array that can feel a greater depth.
  • the present invention relates to a multi-view integrated imaging system using a dual prism array, and to provide a multi-view three-dimensional restored image using a pickup system consisting of a dual prism array and a lens array,
  • the three-dimensional object 400 is located on the left side of the lens array 200, the dual prism array 300 is positioned between the lens array 200 and the three-dimensional object 400, the dual prism array 300 ) Is attached to the same two prism arrays, in which one prism is rotated 180 degrees and then attached to another prism array, so that the ray of light emitted from the object is generated by the dual prism 300, where the two prisms Because of this attachment, the light rays from one point of the object make two points, one object is shown as two virtual images with two different faces and the refracted rays pass through the lens array 300. Since the set of the element images formed and joined to the camera 100 is an element image of two virtual images, the generated element image is a dual prism element image 500.
  • the present invention can provide more viewpoints than the existing three-dimensional display, and because the use of the existing display system, the utilization of the system is high, there is a remarkable effect that can feel a greater depth due to the multi-view.
  • the present invention relates to a multi-view integrated imaging system using a dual prism array, characterized in that to provide a multi-view three-dimensional restored image using a pickup system consisting of a dual prism array and a lens array.
  • the three-dimensional object 400 is located on the left side of the lens array 200
  • the dual prism array 300 is positioned between the lens array 200 and the three-dimensional object 400
  • the dual prism array ( 300 is the same two prism array is attached, where one prism is rotated 180 degrees and then attached to another prism array, so that the ray of light emitted from the object is generated by the dual prism 300, where two Since the prism is attached, the light rays from one point of the object make two points, and one object is shown as two virtual images with two different planes.
  • the set of element images passed through and bound to the camera 100 is an element image for two virtual images
  • the generated element image is characterized by being a dual prism element image 500.
  • the converted sub-image set is to have an image for an object having a different viewpoint, the left side of one sub-image
  • the face subimage is located on the right side and the right side subimage is reconstructed on the x-axis.
  • Left-right-left Extract only the left side sub-images from the image combination consisting of the right and gather them in succession, extract only the right side sub-images and gather them in succession, and then paste two consecutive sub-images into one, in this case, one sub
  • any subimage has only the left side subimage with two consecutive viewpoints
  • any subimage is the right with two consecutive viewpoints.
  • the pickup system of the present invention is composed of a camera 100, a lens array 200, and a dual prism array (300).
  • the lens array 200 is a collection of lenses having the same size and focal length.
  • the dual prism array 300 attaches two identical prism arrays. At this time, one prism is rotated 180 degrees and attached to another prism array.
  • the element image set 500 is generated by using the proposed pickup system.
  • the three-dimensional object 400 is located on the left side of the lens array 200.
  • the dual prism array 300 is positioned between the lens array 200 and the object 400. The ray of light emitted from the object is generated by the dual prism 300.
  • the ray from one point of the object creates two points. That is, one object is shown as two virtual images having two different surfaces.
  • the refracted light rays pass through the lens array 300 to form the camera 100.
  • the elementary image set combined is an elemental image of two virtual images, unlike the elemental image of a single object. Therefore, the generated element image is referred to as a dual prism-based element image 500.
  • the digital processing (600) process is as follows.
  • a dual prism element image 500 is generated.
  • the generated dual prism element image 500 is converted into a sub image set.
  • the transformed subimage sets have images for objects with different viewpoints. This is called the left subimage and the right subimage. That is, the left subimage is located on the left side of one subimage, and the right subimage is located on the right side of the subimage. Reconstruct this on the x axis.
  • the reconstruction method is left-right-left... -From the image combination consisting of the right side, only the left side sub-image is extracted and collected continuously. Then, only the right side sub-images are extracted and collected in succession, and then two successive sub-images are pasted into one.
  • any subimage has only the left subimage having two consecutive viewpoints.
  • any subimage has only the right side subimage with two consecutive viewpoints.
  • the sequential right side subimages on the right side of the generated subimage set are downsampled 1/2 times.
  • Downsampling means lowering consecutive periods.
  • the downsampled subimage sets are reconverted into element images using an inverse sub-image conversion technique. As a result, the synthesized element image 700 is generated.
  • the converted element image 700 is transmitted to the system consisting of the lens array 200 and the flat panel display 800, to restore the three-dimensional image (900).
  • the present invention can provide more viewpoints than the existing three-dimensional display, and because the use of the existing display system, the utilization of the system is high, there is a remarkable effect that can feel a greater depth due to the multi-view.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

The present invention relates to a multi-view integral imaging system using a dual-prism array, and provides a multi-view three-dimensional reconstruction image by using a pickup system composed of a dual-prism array and a lens array, the multi-view integral imaging system comprising a three-dimensional object (400) positioned to the left of a lens array (200) and a dual-prism array (300) positioned between the lens array (200) and the three-dimensional object (400) and having two same prism arrays attached to each other, wherein one prism array is attached to the other prism array after being rotated 180 degrees, such that a light beam outputted from the object is refracted by the dual-prism array (300), and two prisms are attached to each other such that the light beam outputted from one point of the object makes two points, and thus one object is viewed as two visual images having two different sides and the refracted light beams pass through the lens array (300) and are picked up by a camera (100), and the formed element image set is an element image for the two visual images such that the generated element image becomes a dual-prism element image (500). Therefore, the present invention can provide more viewpoints than a conventional three-dimensional display, has high system usability since a conventional display system is used, and has a remarkable effect of enabling a greater sense of depth to be felt by means of multiple viewpoints.

Description

듀얼프리즘어레이를 이용한 다중시점집적영상시스템Multi-view Integrated Image System Using Dual Prism Array

본발명은 듀얼프리즘어레이를 이용한 다중시점집적영상시스템에 관한 것으로, 보다 상세하게는 듀얼프리즘어레이와 렌즈어레이로 구성된 픽업시스템을 이용하여 다시점 3차원복원영상을 제공하는 것으로, 본발명은 기존의 3차원디스플레이보다 더많은 시점을 제공할 수 있으며,기존의 디스플레이시스템을 이용하기 때문에, 시스템의 활용도가 높으며, 다시점으로 인한 더큰 깊이감을 느낄 수 있는 듀얼프리즘어레이를 이용한 다중시점집적영상시스템에 관한 것이다.The present invention relates to a multi-view integrated imaging system using a dual prism array. More particularly, the present invention provides a multi-view three-dimensional restored image using a pickup system composed of a dual prism array and a lens array. The present invention relates to a multi-view integrated video system using a dual prism array that can provide more viewpoints than a three-dimensional display and uses an existing display system, and thus has high utilization of the system and can feel a greater depth due to the multi-view. .

일반적으로 집적영상시스템에 대해, 종래기술인 등록특허공보 10-1445489호에는 3차원 집적 영상 디스플레이 시스템에 있어서, 3차원 물체들에 대한 각각의 요소영상을 획득하는 픽업부와; 상기 픽업부에서 획득된 각각의 요소영상에 대해서

Figure PCTKR2018005849-appb-I000001
로 표현되는 주기적인 델타 함수 배열의 콘볼루션 연산을 사용하여 초점조절된 요소영상을 새로이 생성하는 초점영상생성부와; 관측자의 지시를 인식하여 초점조절된 요소영상의 위치를 알아내는 관 측자인식부와; 초점조절된 요소영상을 광학적으로 렌즈 배열을 통해 표시하는 광학표시부; 로 구성하여, 공간상에 생성된 3D영상에 대하여 관측자의 손동작에 의해 지시되는 3D영상 부분인 관측자의 지시 깊이 영역을 깊이카메라 또는 스테레오 카메라로 인식하여 공간 좌표화하고, 선택된 좌표점에 대하여 초점영상생성부에서 델타 함수 배열의 콘볼루션 연산을 사용하여 요소영상을 새로이 생성함으로써 공간 상에는 관측자의 손동작에 의해 지시되는 부분인 관측자의 지시 깊이 영역의 영상은 선택적으로 선명하게 표시되고, 관측자의 지시 깊이 영역 이외 영역의 영상들은 흐리게 만듦으로써 3차원 영상을 제공하는 것이 특징인 초점 조절 기능을 가지는 3차원 집적 영상 디스플레이 시스템이 공개되어 있다.In general, for an integrated imaging system, Korean Patent Publication No. 10-1445489 discloses a three-dimensional integrated image display system, comprising: a pickup unit for acquiring respective element images of three-dimensional objects; For each element image acquired by the pickup unit
Figure PCTKR2018005849-appb-I000001
A focus image generator for newly generating a focused element image by using a convolution operation of a periodic delta function array represented by; An observer recognition unit for recognizing the observer's instruction and finding the position of the focused element image; An optical display unit for optically displaying a focused element image through a lens array; The 3D image generated in space is recognized as a depth camera or stereo camera by the observer's directed depth region, which is a 3D image portion indicated by the observer's hand movement, and spatially coordinated. By generating a new element image using a convolution operation of the delta function array in the generator, an image of the observer's indicated depth region, which is a portion indicated by the observer's hand movement, is selectively displayed clearly in the space, and the observer's indicated depth region Background Art A three-dimensional integrated image display system having a focus control function, which is characterized by providing a three-dimensional image by blurring images of other regions, has been disclosed.

또한, 등록특허공보 등록번호 10-1600681호에는 집적 영상시스템의 3차원 영상 표시깊이변환방법이 공개되어 있다.In addition, Korean Patent Publication No. 10-1600681 discloses a three-dimensional image display depth conversion method of an integrated imaging system.

그러나 상기 기존의 집적영상시스템은 시점이 제한되어있으며, 픽업시 렌즈어레이에 의해 시점의 개수가 제한되며, 따라서, 3차원물체복원시 물체의 다양한 시점을 제한적으로 보여준다는 단점이 있었다.However, the conventional integrated imaging system has a limited view point, and the number of viewpoints is limited by the lens array when picking up, and therefore, there is a disadvantage in that the various view points of the object are limited when the 3D object is restored.

따라서 본 발명은 상기와 같은 문제점을 해결하고자 안출된 것으로, 본발명은 기존의 3차원디스플레이보다 더많은 시점을 제공할 수 있으며, 기존의 디스플레이시스템을 이용하기 때문에, 시스템의 활용도가 높으며, 다시점으로 인한 더큰 깊이감을 느낄 수 있는 듀얼프리즘어레이를 이용한 다중시점집적영상시스템을 제공하고자 하는 것이다.Accordingly, the present invention has been made to solve the above problems, the present invention can provide more viewpoints than the existing three-dimensional display, and because the use of the existing display system, the utilization of the system is high, multi-view It is to provide a multi-view integrated image system using a dual prism array that can feel a greater depth.

본발명은 듀얼프리즘어레이를 이용한 다중시점집적영상시스템에 관한 것으로, 듀얼프리즘어레이와 렌즈어레이로 구성된 픽업시스템을 이용하여 다시점 3차원복원영상을 제공하는 것으로,The present invention relates to a multi-view integrated imaging system using a dual prism array, and to provide a multi-view three-dimensional restored image using a pickup system consisting of a dual prism array and a lens array,

상기 3차원물체(400)는 렌즈어레이(200)의 왼쪽에 위치하되, 상기 렌즈어레이(200)와 3차원물체(400)사이에 듀얼프리즘어레이(300)를 위치시키며, 상기 듀얼프리즘어레이(300)는 동일한 2개의프리즘어레이를 붙인 것이고, 이때 1개의 프리즘은 180도 회전시킨후 다른 프리즘어레이에 붙이므로, 물체에서 나온 광선은 듀얼프리즘(300)에 의해 광선굴절이 발생하고, 이때 2개의프리즘이 붙어있기 때문에, 물체의 한 점에서 나온 광선은 2개의 점을 만들게 되는 것으로 하나의 물체는 2가지 서로 다른면을 갖는 2개의 버츄얼영상으로 보여지며 상기 굴절된 광선들은 렌즈어레이(300)를 통과하여 카메라(100)에 맺히고 맺혀진 요소영상집합은 2개의 버츄얼영상에 대한 요소영상이므로 생성된 요소영상은 듀얼프리즘 요소영상(500)이 되는 것을 특징으로 한다.The three-dimensional object 400 is located on the left side of the lens array 200, the dual prism array 300 is positioned between the lens array 200 and the three-dimensional object 400, the dual prism array 300 ) Is attached to the same two prism arrays, in which one prism is rotated 180 degrees and then attached to another prism array, so that the ray of light emitted from the object is generated by the dual prism 300, where the two prisms Because of this attachment, the light rays from one point of the object make two points, one object is shown as two virtual images with two different faces and the refracted rays pass through the lens array 300. Since the set of the element images formed and joined to the camera 100 is an element image of two virtual images, the generated element image is a dual prism element image 500.

따라서 본발명은 기존의 3차원디스플레이보다 더많은 시점을 제공할 수 있으며, 기존의 디스플레이시스템을 이용하기 때문에, 시스템의 활용도가 높으며, 다시점으로 인한 더큰 깊이감을 느낄 수 있는 현저한 효과가 있다.Therefore, the present invention can provide more viewpoints than the existing three-dimensional display, and because the use of the existing display system, the utilization of the system is high, there is a remarkable effect that can feel a greater depth due to the multi-view.

도 1은 본발명의 디지털프로세싱 과정도1 is a digital processing process diagram of the present invention

<도면의 주요 부분에 대한 부호의 설명><Explanation of symbols for main parts of the drawings>

100 : 카메라 200 : 렌즈어레이100: camera 200: lens array

300 : 듀얼프리즘어레이 400 : 3차원물체300: dual prism array 400: three-dimensional object

본발명은 듀얼프리즘어레이를 이용한 다중시점집적영상시스템에 관한 것으로, 듀얼프리즘어레이와 렌즈어레이로 구성된 픽업시스템을 이용하여 다시점 3차원복원영상을 제공하는 것을 특징으로 한다. The present invention relates to a multi-view integrated imaging system using a dual prism array, characterized in that to provide a multi-view three-dimensional restored image using a pickup system consisting of a dual prism array and a lens array.

또한, 3차원물체(400)는 렌즈어레이(200)의 왼쪽에 위치하되, 상기 렌즈어레이(200)와 3차원물체(400)사이에 듀얼프리즘어레이(300)를 위치시키며, 상기 듀얼프리즘어레이(300)는 동일한 2개의프리즘어레이를 붙인 것이고, 이때 1개의 프리즘은 180도 회전시킨후 다른 프리즘어레이에 붙이므로, 물체에서 나온 광선은 듀얼프리즘(300)에 의해 광선굴절이 발생하고, 이때 2개의프리즘이 붙어있기 때문에, 물체의 한 점에서 나온 광선은 2개의 점을 만들게 되는 것으로 하나의 물체는 2가지 서로 다른면을 갖는 2개의 버츄얼영상으로 보여지며 상기 굴절된 광선들은 렌즈어레이(300)를 통과하여 카메라(100)에 맺히고 맺혀진 요소영상집합은 2개의 버츄얼영상에 대한 요소영상이므로 생성된 요소영상은 듀얼프리즘 요소영상(500)이 되는 것을 특징으로 한다. In addition, the three-dimensional object 400 is located on the left side of the lens array 200, the dual prism array 300 is positioned between the lens array 200 and the three-dimensional object 400, the dual prism array ( 300 is the same two prism array is attached, where one prism is rotated 180 degrees and then attached to another prism array, so that the ray of light emitted from the object is generated by the dual prism 300, where two Since the prism is attached, the light rays from one point of the object make two points, and one object is shown as two virtual images with two different planes. Since the set of element images passed through and bound to the camera 100 is an element image for two virtual images, the generated element image is characterized by being a dual prism element image 500.

또한, 상기 생성된 듀얼프리즘 요소영상(500)을 서브이미지집합으로 변환하는 것으로, 상기 변환된 서브이미지집합은 서로 다른 시점을 갖는 물체에 대한 이미지를 갖게 되는 것으로, 하나의 서브이미지의 왼쪽에는 왼쪽면 서브이미지, 오른쪽에는 오른쪽면 서브이미지가 위치하며 이를 x축으로 재구성하는 것으로, 왼쪽-오른쪽-왼쪽…-오른쪽으로 구성되어 있는 이미지조합에서 왼쪽면 서브이미지만 추출하여 연속적으로 모은후, 오른쪽면 서브이미지만 추출하여 연속적으로 모은후, 2개의 연속된 서브이미지들을 하나로 붙이되, 이럴경우, 하나의 서브이미지집합의 왼쪽부분에서, 임의의 서브이미지는 2개의 연속된 시점을 갖는 왼쪽면 서브이미지만을 갖게 되고, 하나의 서브이미지집합의 오른쪽부분에서는, 임의의 서브이미지는 2개의 연속된 시점을 갖는 오른쪽면 서브이미지만을 갖게 되며, 상기 생성된 서브이미지집합에서 연속된 왼쪽면 서브이미지들을 연속되는 주기를 낮추는 다운샘플링을 1/2로 하고, 아울러 생성된 서브이미지집합의 오른쪽에 있는 연속된 오른쪽면 서브이미지들을 1/2배 다운샘플링하며, 상기 다운샘플링이 끝난 서브이미지집합은 역서브이미지변환기법을 이용하여 요소영상으로 재변환하는 것으로, 그결과, 합성된요소영상(700)이 생성되는 것을 특징으로 한다.In addition, by converting the generated dual prism element image 500 to a sub-image set, the converted sub-image set is to have an image for an object having a different viewpoint, the left side of one sub-image The face subimage is located on the right side and the right side subimage is reconstructed on the x-axis. Left-right-left… Extract only the left side sub-images from the image combination consisting of the right and gather them in succession, extract only the right side sub-images and gather them in succession, and then paste two consecutive sub-images into one, in this case, one sub In the left part of the imageset, any subimage has only the left side subimage with two consecutive viewpoints, and in the right part of one subimageset, any subimage is the right with two consecutive viewpoints. It has only a plane sub-image, and the downsampling lowering a continuous period of consecutive left sub-images in the generated sub-image set is 1/2, and the successive right-side sub on the right side of the generated sub-image set. Images are halved downsampled, and the downsampled subimage set is inverse sub-image conversion technique. By re-converted to the image element by using, as a result, it characterized in that the elements generating the synthesized image 700.

본발명을 첨부도면에 의해 상세히 설명하면 다음과 같다. 도 1은 본발명의 디지털프로세싱 과정도이다.The present invention is described in detail by the accompanying drawings as follows. 1 is a digital processing process diagram of the present invention.

1. 기존의 카메라와 렌즈어레이로 구성된 픽업시스템과 달리, 본발명의 픽업시스템은 카메라(100), 렌즈어레이(200), 그리고 듀얼프리즘어레이(300)로 구성된다. 렌즈어레이(200)는 동일한 크기와 초점거리를 갖는 렌즈들의 집합이다. 듀얼프리즘어레이(300)는 동일한 2개의 프리즘어레이를 붙인 것이다. 이때 1개의 프리즘은 180도 회전시킨후 다른 프리즘어레이에 붙인다. 제안된 픽업시스템을 이용하여 요소영상집합(500)을 생성한다. 3차원물체(400)는 렌즈어레이(200)의 왼쪽에 위치한다. 그리고 렌즈어레이(200)와 물체(400)사이에 듀얼프리즘어레이(300)를 위치시킨다. 물체에서 나온 광선은 듀얼프리즘(300)에 의해 광선굴절이 발생한다. 이때 2개의 프리즘이 붙어있기 때문에, 물체의 한점에서 나온 광선은 2개의 점을 만들게 된다. 즉, 하나의 물체는 2가지 서로 다른면을 갖는 2개의 버츄얼영상으로 보여진다. 굴절된 광선들은 렌즈어레이(300)를 통과하여 카메라(100)에 맺힌다. 맺혀진 요소영상집합은 기존의 1개의 물체에 대한 요소영상과 달리 2개의 버츄얼영상에 대한 요소영상이다. 따라서 생성된 요소영상은 듀얼프리즘기반요소영상(500)이라 부른다. 1. Unlike a conventional pickup system consisting of a camera and a lens array, the pickup system of the present invention is composed of a camera 100, a lens array 200, and a dual prism array (300). The lens array 200 is a collection of lenses having the same size and focal length. The dual prism array 300 attaches two identical prism arrays. At this time, one prism is rotated 180 degrees and attached to another prism array. The element image set 500 is generated by using the proposed pickup system. The three-dimensional object 400 is located on the left side of the lens array 200. The dual prism array 300 is positioned between the lens array 200 and the object 400. The ray of light emitted from the object is generated by the dual prism 300. Since two prisms are attached, the ray from one point of the object creates two points. That is, one object is shown as two virtual images having two different surfaces. The refracted light rays pass through the lens array 300 to form the camera 100. The elementary image set combined is an elemental image of two virtual images, unlike the elemental image of a single object. Therefore, the generated element image is referred to as a dual prism-based element image 500.

2. 듀얼프리즘기반요소영상(500)을 재생할 경우, 2개의 물체가 보여진다. 따라서, 디스플레이시한개의 3차원영상을 복원하기 위해, 디지털프로세싱과정이 요구된다.2. When playing the dual prism-based element image 500, two objects are shown. Therefore, in order to reconstruct one 3D image during display, a digital processing process is required.

3. 디지털프로세싱(600)과정은다음 과정과 같다.3. The digital processing (600) process is as follows.

먼저, 듀얼프리즘요소영상(500)을 생성한다. 생성된 듀얼프리즘 요소영상(500)을 서브이미지집합으로 변환한다. 변환된 서브이미지집합은 서로 다른 시점을 갖는 물체에 대한 이미지를 갖는다. 이를 왼쪽면 서브이미지, 오른쪽면 서브이미지라고 부른다. 즉 하나의 서브이미지의 왼쪽에는 왼쪽면 서브이미지, 오른쪽에는 오른쪽면 서브이미지가 위치한다. 이를 x축으로 재구성한다. 재구성하는 방법은 왼쪽-오른쪽-왼쪽…-오른쪽으로 구성되어 있는 이미지조합에서 왼쪽면 서브이미지만 추출하여 연속적으로 모은다. 그후, 오른쪽면 서브이미지만 추출하여 연속적으로 모은후, 2개의 연속된 서브이미지들을 하나로 붙인다. 이럴경우, 하나의 서브이미지집합의 왼쪽부분에서, 임의의 서브이미지는 2개의 연속된시점을 갖는 왼쪽면 서브이미지만을 갖는다. 하나의 서브이미지집합의 오른쪽부분에서는, 임의의 서브이미지는 2개의 연속된 시점을 갖는 오른쪽면 서브이미지만을 갖는다. 생성된 서브이미지집합에서 연속된 왼쪽면 서브이미지들을 1/2배 다운샘플링을 한다. 아울러 생성된 서브이미지집합의오른쪽에 있는 연속된 오른쪽면 서브이미지들을 1/2배 다운샘플링한다. 다운샘플링의 의미는 연속되는 주기를 낮추는것이다. 다운샘플링이 끝난 서브이미지집합은 역서브이미지변환기법을 이용하여 요소영상으로 재변환한다. 그결과, 합성된요소영상(700)이 생성된다.First, a dual prism element image 500 is generated. The generated dual prism element image 500 is converted into a sub image set. The transformed subimage sets have images for objects with different viewpoints. This is called the left subimage and the right subimage. That is, the left subimage is located on the left side of one subimage, and the right subimage is located on the right side of the subimage. Reconstruct this on the x axis. The reconstruction method is left-right-left… -From the image combination consisting of the right side, only the left side sub-image is extracted and collected continuously. Then, only the right side sub-images are extracted and collected in succession, and then two successive sub-images are pasted into one. In this case, in the left part of one subimage set, any subimage has only the left subimage having two consecutive viewpoints. In the right part of one subimage set, any subimage has only the right side subimage with two consecutive viewpoints. Half-sequence downsampling of the left sub images in succession from the generated sub-image set. In addition, the sequential right side subimages on the right side of the generated subimage set are downsampled 1/2 times. Downsampling means lowering consecutive periods. The downsampled subimage sets are reconverted into element images using an inverse sub-image conversion technique. As a result, the synthesized element image 700 is generated.

3. 변환된요소영상(700)은 렌즈어레이(200)와 평면패널디스플레이(800)로 구성된시스템이 전송되어, 3차원영상(900)을 복원하게 된다.3. The converted element image 700 is transmitted to the system consisting of the lens array 200 and the flat panel display 800, to restore the three-dimensional image (900).

따라서 본발명은 기존의 3차원디스플레이보다 더많은 시점을 제공할 수 있으며, 기존의 디스플레이시스템을 이용하기 때문에, 시스템의 활용도가 높으며, 다시점으로 인한 더큰 깊이감을 느낄 수 있는 현저한 효과가 있다.Therefore, the present invention can provide more viewpoints than the existing three-dimensional display, and because the use of the existing display system, the utilization of the system is high, there is a remarkable effect that can feel a greater depth due to the multi-view.

Claims (3)

듀얼프리즘어레이(300)와 렌즈어레이(200)로 구성된 픽업시스템을 이용하여 다시점 3차원복원영상을 제공하는 것을 특징으로 하는 듀얼프리즘어레이를 이용한 다중시점집적영상시스템Multi-view integrated imaging system using dual prism array, characterized in that to provide a multi-view three-dimensional restored image using a pickup system consisting of a dual prism array 300 and a lens array 200 제1항에 있어서, 상기 렌즈어레이(200)의 왼쪽에 3차원물체(400)가 위치하되, 상기 렌즈어레이(200)와 3차원물체(400)사이에 듀얼프리즘어레이(300)를 위치시키며, 상기 듀얼프리즘어레이(300)는 동일한 2개의프리즘어레이를 붙인 것이고, 이때 1개의 프리즘은 180도 회전시킨후 다른 프리즘어레이에 붙이므로, 물체에서 나온 광선은 듀얼프리즘(300)에 의해 광선굴절이 발생하고, 이때 2개의프리즘이 붙어있기 때문에, 물체의 한 점에서 나온 광선은 2개의 점을 만들게 되는 것으로 하나의 물체는 2가지 서로 다른면을 갖는 2개의 버츄얼영상으로 보여지며 상기 굴절된 광선들은 렌즈어레이(300)를 통과하여 카메라(100)에 맺히고 맺혀진 요소영상집합은 2개의 버츄얼영상에 대한 요소영상이므로 생성된 요소영상은 듀얼프리즘 요소영상(500)이 되는 것을 특징으로 하는 듀얼프리즘어레이를 이용한 다중시점집적영상시스템According to claim 1, wherein the three-dimensional object 400 is located on the left side of the lens array 200, the dual prism array 300 is positioned between the lens array 200 and the three-dimensional object 400, The dual prism array 300 is attached to the same two prism array, in which one prism is rotated 180 degrees and then attached to the other prism array, so that the ray of light from the object is generated by the dual prism 300 In this case, since two prisms are attached, the light rays from one point of the object make two points, and one object is shown as two virtual images having two different planes. Since the set of the element images formed and joined to the camera 100 through the array 300 is an element image for two virtual images, the generated element image is a dual prism element image 500. Multiple time integral imaging system using a dual-prism array 제2항에 있어서, 상기 생성된 듀얼프리즘 요소영상(500)을 서브이미지집합으로 변환하는 것으로, 상기 변환된 서브이미지집합은 서로 다른 시점을 갖는 물체에 대한 이미지를 갖게 되는 것으로, 하나의 서브이미지의 왼쪽에는 왼쪽면 서브이미지, 오른쪽에는 오른쪽면 서브이미지가 위치하며 이를 x축으로 재구성하는 것으로, 왼쪽-오른쪽-왼쪽…-오른쪽으로 구성되어 있는 이미지조합에서 왼쪽면 서브이미지만 추출하여 연속적으로 모은후, 오른쪽면 서브이미지만 추출하여 연속적으로 모은후, 2개의 연속된 서브이미지들을 하나로 붙이되, 이럴경우, 하나의 서브이미지집합의 왼쪽부분에서, 임의의 서브이미지는 2개의 연속된 시점을 갖는 왼쪽면 서브이미지만을 갖게 되고, 하나의 서브이미지집합의 오른쪽부분에서는, 임의의 서브이미지는 2개의 연속된 시점을 갖는 오른쪽면 서브이미지만을 갖게 되며, 상기 생성된 서브이미지집합에서 연속된 왼쪽면 서브이미지들을 연속되는 주기를 낮추는 다운샘플링을 1/2로 하고, 아울러 생성된 서브이미지집합의 오른쪽에 있는 연속된 오른쪽면 서브이미지들을 1/2배 다운샘플링하며, 상기다운샘플링이 끝난 서브이미지집합은 역서브이미지변환기법을 이용하여 요소영상으로 재변환하는 것으로, 그결과, 합성된요소영상(700)이 생성되는 것을 특징으로 하는 듀얼프리즘어레이를 이용한 다중시점집적영상시스템The method of claim 2, wherein the generated dual prism element image 500 is converted into a sub-image set, wherein the converted sub-image set has an image of an object having different viewpoints, and one sub-image. The left side subimage is located on the left side, and the right side subimage is located on the right side. Extract only the left side sub-images from the image combination consisting of the right and gather them in succession, extract only the right side sub-images and gather them in succession, and then paste two consecutive sub-images into one, in this case, one sub In the left part of the imageset, any subimage has only the left side subimage with two consecutive viewpoints; in the right part of one subimageset, any subimage is the right with two consecutive viewpoints. It has only a plane sub-image, and the downsampling lowering a continuous period of consecutive left sub-images in the generated sub-image set is 1/2, and the successive right-side sub on the right side of the generated sub-image set. Images are half-sampled downsampled, and the downsampled subimage set uses an inverse sub-image conversion technique. The multi-view integrated image system using the dual prism array, which is characterized by reconversion to the element image using the result, and as a result, the synthesized element image 700 is generated.
PCT/KR2018/005849 2018-05-23 2018-05-23 Multi-view integral imaging system using dual-prism array Ceased WO2019225775A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/KR2018/005849 WO2019225775A1 (en) 2018-05-23 2018-05-23 Multi-view integral imaging system using dual-prism array

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/KR2018/005849 WO2019225775A1 (en) 2018-05-23 2018-05-23 Multi-view integral imaging system using dual-prism array

Publications (1)

Publication Number Publication Date
WO2019225775A1 true WO2019225775A1 (en) 2019-11-28

Family

ID=68615762

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2018/005849 Ceased WO2019225775A1 (en) 2018-05-23 2018-05-23 Multi-view integral imaging system using dual-prism array

Country Status (1)

Country Link
WO (1) WO2019225775A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110050858A1 (en) * 2009-09-01 2011-03-03 Chien-Yue Chen 3d image capture device and symmetric prism array for the same
KR20130106725A (en) * 2012-03-20 2013-09-30 엘지디스플레이 주식회사 Integral image system and driving method of the same
KR20150084784A (en) * 2012-09-04 2015-07-22 솔리디디디 코포레이션 Switchable lenticular array for autostereoscopic video displays
KR20150120029A (en) * 2014-04-16 2015-10-27 광운대학교 산학협력단 Depth convertion method of 3D images interal imaging system
JP2016018108A (en) * 2014-07-09 2016-02-01 国立大学法人 筑波大学 Naked-eye stereoscopic picture display device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110050858A1 (en) * 2009-09-01 2011-03-03 Chien-Yue Chen 3d image capture device and symmetric prism array for the same
KR20130106725A (en) * 2012-03-20 2013-09-30 엘지디스플레이 주식회사 Integral image system and driving method of the same
KR20150084784A (en) * 2012-09-04 2015-07-22 솔리디디디 코포레이션 Switchable lenticular array for autostereoscopic video displays
KR20150120029A (en) * 2014-04-16 2015-10-27 광운대학교 산학협력단 Depth convertion method of 3D images interal imaging system
JP2016018108A (en) * 2014-07-09 2016-02-01 国立大学法人 筑波大学 Naked-eye stereoscopic picture display device

Similar Documents

Publication Publication Date Title
Horisaki et al. Three-dimensional information acquisition using a compound imaging system
US5973726A (en) Panoramic image processing apparatus
KR101294261B1 (en) Three dimensional interal imagine display-using mask and time-multiplexing
JP2012138068A (en) Image generation apparatus
JP2009031797A (en) 2D-3D combined display method and apparatus with integrated video background
JPWO2011114572A1 (en) Imaging apparatus, method and program
JP2004312745A (en) Composite camera and method for implementing autofocus, depth of field and high resolution functions
WO2004038486A1 (en) Image display and method for displaying image
CN112700502A (en) Binocular camera system and binocular camera space calibration method
JP2013196532A (en) Three-dimensional model/integral image conversion device and program thereof
JP2009290268A (en) Imaging apparatus
JPH07129792A (en) Image processing method and image processing apparatus
CN105139336A (en) Method for converting multichannel panorama images into dome-screen fish-eye movie
JP2006101224A (en) Image generation apparatus, image generation method, and image generation program
JP3328478B2 (en) Camera system
CN110087059B (en) Interactive auto-stereoscopic display method for real three-dimensional scene
JP4729011B2 (en) Element image group conversion device, stereoscopic image display device, and element image group conversion program
WO2019225775A1 (en) Multi-view integral imaging system using dual-prism array
WO2024051214A1 (en) Three-dimensional image collection apparatus and method, and related device
CN208724107U (en) A stereoscopic scene shooting device
KR100927234B1 (en) Method, apparatus for creating depth information and computer readable record-medium on which program for executing method thereof
CN111583117A (en) Rapid panoramic stitching method and device suitable for space complex environment
JPH11155153A (en) Stereoscopic video display device
JPH10336703A (en) Image synthesizing apparatus, method and storage medium
JP2021002783A (en) Depth map generation device and program thereof, and stereoscopic image generation device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18919683

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18919683

Country of ref document: EP

Kind code of ref document: A1