JP4966941B2 - 3D video data generation method, 3D video data generation system, and 3D video data generation program - Google Patents

Description

  The present invention relates to a 3D video data generation method, a 3D video data generation system, a 3D video data generation method and a 3D video data generation system, a recording medium on which 3D video data is recorded, and 3D video data generation. Regarding the program.

2. Description of the Related Art Conventionally, a technique for realizing stereoscopic vision by separately providing a left-eye image and a right-eye image, which are two-dimensional images with parallax in the left and right eyes of an observer, is known. For example, there are the following (1) to (4) as methods for providing the left-eye video only to the left eye and providing the right-eye video only to the right eye. These methods are disclosed in Patent Document 1, for example.
(1) Anaglyph method (2) Method of alternately displaying left-eye video and right-eye video, and opening and closing the left and right shutters of the glasses worn by the observer in synchronization with this alternate display (3) Left-eye video and right-eye (4) HMD (Head Mounted Display) is used to change the polarization direction of the video for the viewer so that the left and right polarizing filters of the glasses worn by the viewer transmit only one image. Using an apparatus with an optical system that provides an image independent of the eye

  Further, as a method of generating 3D video data (stereoscopic data) for realizing such a stereoscopic view, a cross method and a parallel method are known. Both the cross method and the parallel method can be applied to a case where 3D video data is obtained by actual shooting in a real 3D space, or a case where 3D video data is obtained by CG (Computer Graphics) in a virtual 3D space. It is.

JP 2004-104742 A

  However, with the cross method, there is a problem that although the stereoscopic effect is obtained, the observation range is limited from the viewpoint of the observer's eye fatigue. With the parallel method, although the observer's eye fatigue can be reduced, the stereoscopic effect is reduced. There was a problem of being scarce.

  The present invention has been made in view of the above-described problems, and generates three-dimensional image data rich in stereoscopic effect while maintaining the advantage of less observer eye fatigue in the parallel method. It is an object of the present invention to provide a 3D video data generation method, a 3D video data generation system, and a recording medium on which the 3D video data generated thereby is recorded. In addition, the present invention provides a 3D video data generation method and a 3D video data generation system that can generate 3D video data that includes a plurality of gazing points and has a low burden on the observer. Another object of the present invention is to provide a recording medium on which 3D video data is recorded and a 3D video data generation program.

  In order to solve the above-described problems and achieve the object, the present invention generates two-dimensional video data including a left-eye video and a right-eye video, which are two-dimensional videos having parallax obtained by a parallel method. The distant view is positioned to the left of the original position on the left-eye image, and the distant view is positioned to the right of the original position on the right-eye image. Thereby, the three-dimensional effect can be emphasized while suppressing the eyestrain of the observer.

Here, the original position is a result of observing an object (for example, a distant view) from a predetermined viewpoint with a predetermined line of sight in a real or virtual three-dimensional space, and the object is in an observation field of view (observation video). It is the position where it appears. In other words, when an object such as a near view and a distant view is observed from the left eye viewpoint and the right eye viewpoint in a real or virtual three-dimensional space to obtain left and right two-dimensional images, the above-described two-dimensional images are displayed on the respective two-dimensional images. The position of the object image, that is, the position where the object is observed on the two-dimensional video.
For example, when an object is photographed with a camera in an actual three-dimensional space, the position of the object in the photographed two-dimensional image is the original position. When a virtual three-dimensional space is handled by CG or the like, an operation for projecting an object in the virtual three-dimensional space onto a two-dimensional plane by applying a predetermined optical parameter to a viewpoint set in the virtual three-dimensional space. Is the position on the two-dimensional plane where the object is projected.

  The video may be a still image or a moving image. In addition, the lines of sight in the parallel method do not need to be strictly parallel, and at least do not intersect in the distance range from the observer to the distant view.

  The three-dimensional space to which the parallel method is applied may be real or virtual. In this three-dimensional space, it is assumed that there are at least an object in the foreground and an object in the distance.

In one aspect, the 3D image data generation method of the present invention is a method for generating 3D image data for stereoscopic vision including a left-eye image and a right-eye image, which are two-dimensional images having a parallax obtained by a parallel method. In a two-dimensional image obtained by observing a real or virtual three-dimensional space from a left eye viewpoint corresponding to the left eye of an observer, only a distant view of a distant view and a distant view is provided. In a left-eye image generation step for generating a left-eye image by arranging the image at a position to the left of the original position, and a two-dimensional image obtained by observing the three-dimensional space from the right eye viewpoint corresponding to the right eye of the observer, of near view, and disposed only distant position to the right than the original position to generate the right-eye video, possess a right eye image generating step, the amount of deviation to the left and right from the original position, the left eye For video A distant view to kick, the distant view in the right-eye images, is characterized in that the maximum amount together overlapping.

In another aspect, the 3D image data generation method of the present invention is a left-eye image that is a two-dimensional image observed with the left eye of the observer and a right-eye image that is a 2D image observed with the right eye of the observer. In a real or virtual three-dimensional space having a distant view and a near view on the near side of the distant view, from a left eye viewpoint corresponding to the left eye of the observer, A left eye temporary image acquisition step for acquiring a left eye temporary image that is a two-dimensional image obtained by observing a distant view and a near view, and a line of sight parallel to the line of sight of the left eye viewpoint from the right eye viewpoint corresponding to the observer's right eye in a three-dimensional space Then, a right-eye temporary image acquisition step for acquiring a right-eye temporary image, which is a two-dimensional image obtained by observing a distant view and a near-view, and image processing of the acquired left-eye temporary image, Out of the foreground Only the distant view is placed at a position to the left of the original position to generate the left-eye image, and the left-eye image generation step and the acquired right-eye provisional image are image-processed. of near view, and disposed only distant position to the right than the original position to generate the right-eye video, possess a right eye image generating step, the amount of deviation to the left and right from the original position, the left eye It is characterized in that the amount of overlap between the distant view in the video for use and the distant view in the image for the right eye is maximized .

In still another aspect, the 3D image data generation method of the present invention is for the left eye, which is a 2D image observed with the left eye of the observer, and for the right eye, which is a 2D image observed with the right eye of the observer. And a first view corresponding to the left eye of an observer in a real or virtual three-dimensional space having a distant view and a near view on the near side of the distant view. From the left eye viewpoint, a first image acquisition step of acquiring a first image that is a two-dimensional image observing a near view without including a distant view, and from a first right eye viewpoint corresponding to the right eye of the observer in a three-dimensional space. A second image acquisition step of acquiring a second image which is a two-dimensional image obtained by observing a close-up view without including a distant view with a line of sight parallel to the line of sight of the left eye viewpoint, and corresponds to the left eye of the observer in a three-dimensional space From the second left eye viewpoint, foreground A third image acquisition step of acquiring a third image that is a two-dimensional image of a distant view that is not included, and a second right-eye viewpoint corresponding to the observer's right eye in a three-dimensional space, parallel to the line of sight of the left-eye viewpoint. A fourth image acquisition step for acquiring a fourth image, which is a two-dimensional image obtained by observing a distant view without including a close view with a simple line of sight, and generating a left eye image from the first image and the fourth image. a step, and the right-eye video generating step of generating a right-eye video from the second image and the third image, have a, a distant view in the acquired left-eye video are arranged so distant overlap in the acquired right-eye video It is characterized by that.

  In the 3D video data generation method of the present invention, it is preferable to use a real or virtual 3D object as a distant view in a 3D space.

  In the 3D video data generation method of the present invention, it is preferable to use a real or virtual 2D diagram as a distant view in a 3D space.

The 3D video data generation system of the present invention is a system that generates 3D video data for stereoscopic viewing including a left-eye video and a right-eye video, which are two-dimensional video images having a parallax obtained by a parallel method. In a two-dimensional image obtained by observing a real or virtual three-dimensional space having a foreground and a foreground in front of the distant view from the left eye viewpoint corresponding to the left eye of the observer, only the distant view of the distant view and the foreground from the original position Left-eye image generation means for generating a left-eye image arranged at the left position and a two-dimensional image obtained by observing the three-dimensional space from the right eye viewpoint corresponding to the right eye of the observer. generating a right-eye video placed in the right position than the original position, possess the right-eye video generating means, the amount of deviation to the left and right from the original position, the distant view in the left-eye video, right eye A distant view in the images, is characterized in that the maximum amount together overlapping.

In another aspect, the three-dimensional video data generation system of the present invention is a left-eye video that is a two-dimensional video observed with the left eye of the observer and a right-eye video that is a two-dimensional video observed with the right eye of the observer. In a real or virtual three-dimensional space having a distant view and a near view on the near side of the distant view, from a left eye viewpoint corresponding to the left eye of the observer, A left eye temporary image acquisition means for acquiring a left eye temporary image that is a two-dimensional image obtained by observing a distant view and a near view, and a line of sight parallel to the line of sight of the left eye viewpoint from the right eye viewpoint corresponding to the observer's right eye in a three-dimensional space. Then, a right-eye temporary image acquisition means for acquiring a right-eye temporary image that is a two-dimensional image obtained by observing a distant view and a close-up view, and processing the acquired left-eye temporary image, the distant view and Out of the foreground A left-eye image generating means for generating a left-eye image by disposing only a distant view at a position to the left of the original position, and processing the acquired right-eye provisional image on the right-eye temporary image, of near view, and disposed only distant position to the right than the original position to generate the right-eye video, possess a right-eye video generating means, the amount of deviation to the left and right from the original position, the left eye It is characterized in that the amount of overlap between the distant view in the video for use and the distant view in the image for the right eye is maximized .

In another aspect, the 3D image data generation system of the present invention is for a left eye which is a 2D image observed with the left eye of the observer and a right eye which is a 2D image observed with the right eye of the observer. And a first view corresponding to the left eye of an observer in a real or virtual three-dimensional space having a distant view and a near view in front of the distant view. From a left-eye viewpoint, a first image acquisition unit that acquires a first image that is a two-dimensional image of a close-up view without including a distant view, and a first right-eye viewpoint corresponding to the right eye of the observer in a three-dimensional space A second image acquisition means for acquiring a second image that is a two-dimensional image obtained by observing a close-up view without including a distant view with a line of sight parallel to the line of sight of the left eye viewpoint; and in the three-dimensional space, the left eye of the observer From the corresponding second left eye viewpoint The third image acquisition means for acquiring a third image that is a two-dimensional image obtained by observing a distant view without including a near view, and the left eye view from the second right eye view corresponding to the right eye of the observer in a three-dimensional space. A fourth image acquisition means for acquiring a fourth image, which is a two-dimensional image observing a distant view without including a near view, with a line of sight parallel to the line of sight, and generating a left-eye image from the first image and the fourth image , a left-eye video generating means generates the right-eye video from the second image and the third image, possess the right-eye video generating unit, and a distant view in the acquired left-eye video, distant in acquired right-eye video is characterized in Rukoto disposed so as to overlap.

  In the 3D video data generation system of the present invention, it is preferable to use a real or virtual 3D object as a distant view in a 3D space.

  In the 3D image data generation system of the present invention, it is preferable to use a real or virtual 2D diagram as a distant view in a 3D space.

The 3D image data generation program of the present invention is a 3D image data for generating stereoscopic 3D images including a left eye image and a right eye image, which are 2D images having parallax obtained by a parallel method. A two-dimensional image data generation program, which is a two-dimensional image obtained by observing a real or virtual three-dimensional space having a distant view and a near view on the near side of the distant view from a left eye viewpoint corresponding to the left eye of the observer. A left-eye image generation function that generates a left-eye image by placing only a distant view at a position to the left of the original position, and a two-dimensional image obtained by observing a three-dimensional space from the right-eye viewpoint corresponding to the observer's right eye of the distant view and near view, and disposed only distant position to the right than the original position to generate the right-eye video, a function and right-eye video generating, a shift in the right and left from the original position Includes a distant view in the left-eye video, the distant view in the right-eye images, is characterized in that is implemented using a computer to maximize the amount that both overlap.

  The present invention can generate three-dimensional video data in which stereoscopic effect is enhanced while suppressing fatigue of the eyes of an observer.

  Embodiments of a 3D video data generation method, a 3D video data generation system, a 3D video data recording medium, and a 3D video data generation program according to the present invention will be described below in detail with reference to the drawings. . In addition, this invention is not limited by the following embodiment.

Prior to the description of the embodiment, the principle of the cross method and the parallel method will be described.
First, the cross method will be described with reference to FIGS. FIG. 1 is a conceptual diagram illustrating an example of a configuration in the case of creating three-dimensional image data by the cross method. Such a configuration may be realized in an actual three-dimensional space, or may be a virtual three-dimensional space realized inside a computer.

  In a real or virtual three-dimensional space, a mountain is disposed as a distant view 101 and a ball is disposed as a foreground 102 on the near side of the distant view 101, and a left eye viewpoint 103 and a right eye as viewpoints corresponding to the left eye of an observer observing them. A right eye viewpoint 104 is arranged as a corresponding viewpoint. In an actual three-dimensional space, for example, cameras are placed corresponding to these viewpoint positions. That is, a left-eye camera is arranged at the left-eye viewpoint 103 and a right-eye camera is arranged at the right-eye viewpoint 104, respectively. The ball moves between positions P1, P2, and P3 arranged in order from the side far from the observer to the observer side.

  The left visual line 103E of the left eye viewpoint 103 and the right visual line 104E of the right eye viewpoint 104 intersect on the way, and thereby an intersection (cross point) 107 is defined. Thus, in the cross method, the left visual line 103E of the left eye viewpoint 103 and the right visual line 104E of the right eye viewpoint 104 intersect.

  Here, it is assumed that the ball as the foreground 102 moves between a position P1 separated from the observer and a position P3 approaching the observer. A position P2 is arranged between the position P1 and the position P3 so as to substantially coincide with the intersection 107.

  FIG. 2 shows images at the respective viewpoints of the left eye and the right eye at each position when the ball approaches the observer and moves from position P1 to position P3 via position P2 in the configuration shown in FIG. FIG. (A)-(c) has shown the left eye viewpoint image, (a) when the ball is in position P1, (b) is in position P2, and (c) is in position P3, respectively. Show. (D) to (f) show right-eye viewpoint images, (d) shows when the ball is at position P1, (e) when at position P2, and (f) when at position P3, respectively. Show. In FIG. 2, in order to distinguish the left-eye viewpoint video from the right-eye viewpoint video, the mountain that is the distant view 101L of the left-eye viewpoint image is drawn with a solid line, and the mountain that is the distant view 101R of the right-eye viewpoint image is drawn with a broken line. Further, the ball that is the foreground 102L of the left-eye viewpoint video is drawn with a white circle ○, and the foreground 102R of the right-eye viewpoint video is drawn with a black circle ●.

  In the left-eye viewpoint image, when the ball is at the position P1 (FIG. 2A), the ball is on the left side of the left visual line 103E, and is therefore displayed small on the left side of the image. When the ball moves to the position P2 (FIG. 2 (b)), the ball is positioned on the left visual line 103E, so that it is displayed in the middle of the image at a medium size larger than that at the position P1. When the ball moves to the position P3 (FIG. 2C), the ball is positioned on the right side of the left visual line 103E, so that it is displayed larger on the right side of the image than when it is at the position P2. Further, since the mountain as the distant view 101L is stationary at the left side of the left visual line 103E, it is displayed at a fixed position on the left side of the video.

  On the other hand, in the right-eye viewpoint image, when the ball is at the position P1 (FIG. 2 (d)), the ball is on the right side of the right visual line 104E, and is thus displayed small on the right side of the image. When the ball moves to the position P2 (FIG. 2 (e)), the ball is positioned on the right visual line 104E, so that it is displayed in the middle of the image at a medium size larger than that at the position P1. When the ball moves to the position P3 (FIG. 2 (f)), since the ball is located on the left side of the right visual line 104E, it is displayed larger on the left side of the image than when it is at the position P2. Since the mountain as the distant view 101R is stationary on the right side of the right visual line 104E, it is displayed at a fixed position on the right side of the video.

  As described above, when the ball as the foreground 102 moves from the position P1 far from the intersection 107 to the position P3 near the intersection via the position P2 on the intersection 107 when viewed from the observer, the ball is displayed on the left eye viewpoint image. Moves from the left side of the screen through the center to the right side. On the other hand, on the right eye viewpoint image, the ball moves greatly from the right side of the screen to the left side through the center. Further, the mountain which is the distant view 101 is displayed at a fixed position on the left side of the screen on the left-eye viewpoint video and on the right side of the screen on the right-eye viewpoint video.

  FIG. 3 is a diagram illustrating an image obtained by combining the left-eye viewpoint image and the right-eye viewpoint image in the cross method. 3A is an image obtained by combining FIGS. 2A and 2D, FIG. 3B is an image obtained by combining FIGS. 2B and 2E, and FIG. 2 is an image obtained by combining (c) and (f). Accordingly, FIG. 3 (a) shows the ball at position P1, (b) at position P2, and (c) at position P3.

  As shown in FIG. 3, in the cross method, when the distance between the foregrounds 102L and 102R and the observer changes, the distant views 101L and 101R are kept at a fixed position and size, and the images of the foregrounds 102L and 102R are displayed. Since the position changes greatly in the horizontal direction, a rich expression can be achieved.

  However, the cross method has a drawback that the observer's eyes become tired when the screen size of the image increases. This will be described with reference to FIGS.

  FIG. 4 is a diagram illustrating a state in which the viewer observes the image of the ball almost at the position of the intersection 107 with the left eye 108 and the right eye 109 corresponding to FIG. The line of sight 108E of the observer's left eye 108 and the line of sight 109E of the right eye 109 extend substantially in parallel, and a distant view 101L and a distant view 101R are respectively disposed at the ends. FIG. 5 is an image having a size larger than that of FIG. 4, and an observer observes an image corresponding to FIG. 3B in which the ball is substantially at the position of the intersection 107 with the left eye 108 and the right eye 109. It is a figure which shows a mode. The line of sight 108E of the observer's left eye 108 and the line of sight 109E of the right eye 109 extend away from each other toward the video image, and a distant view 101L and a distant view 101R are arranged at the ends.

  In the state of FIG. 4, when the observer pays attention to the distant views 101L and 101R, the observer's left eye 108 observes the mountain (solid line) that is the distant view 101L on the left-eye viewpoint image, and the observer's right eye 109 A mountain (broken line) that is a distant view 101R on the right-eye viewpoint image is observed. If the image size is about the size of FIG. 4 with respect to the positions of both eyes of the observer, the eyes of the left eye 108 and the eyes of the right eye 109 of the observer are almost parallel, so the eye fatigue is not so great.

  On the other hand, in the state shown in FIG. 5, since the video size is large, the line of sight 108E of the left eye 108 and the line of sight 109E of the right eye 109 of the observer are directed in the direction of spreading outward. It is not natural that the left and right lines of sight 108E and 109E for viewing the distant views 101L and 101R spread in this manner, and the human eye structure is unreasonable and eye fatigue is great. Furthermore, since the foregrounds 102L and 102R are too close to each other, the left and right lines of sight intersect too close to the observer, which increases eye fatigue. For this reason, the distance from the observer is limited to a predetermined range so that the eye can be observed with little eye fatigue in the cross method. This predetermined range usually includes the position of the intersection 107.

FIG. 6 is a conceptual diagram showing an example of a range that can be observed with little eye fatigue in the cross method. In FIG. 6, the inside of the closed curve is an observable region 110 (predetermined range) with less eye fatigue. Thus, of the observable range, there is an observable region with less eye fatigue only in the observable region 110 within a predetermined distance range from the intersection 107, which is indicated by a closed curve. The outside of the observable region 110 can be observed, but eye fatigue increases, making practical use difficult. Note that there is no left-right parallax on the display surface 111 disposed on the intersection 107.
As described above, the cross method is a display method rich in stereoscopic effect, but has a drawback that eye fatigue is large.

  On the other hand, when 3D image data is generated by the parallel method, eye fatigue can be suppressed even when the distance between the foreground 202 and the observer changes compared to the cross method. Hereinafter, the parallel method will be described with reference to FIGS.

  FIG. 7 is a conceptual diagram illustrating an example of a configuration in the case where three-dimensional image data is created by the parallel method. Such a configuration may be realized in an actual three-dimensional space, or may be a virtual three-dimensional space realized inside a computer.

  In FIG. 7, a mountain as a distant view 201 and a ball as a foreground 202 on the near side of the distant view 201 are arranged in a real or virtual three-dimensional space, and the left eye as a viewpoint corresponding to the left eye of the observer who observes these. A viewpoint 203 and a right eye viewpoint 204 as a viewpoint corresponding to the right eye are arranged. In an actual three-dimensional space, for example, cameras are placed corresponding to these viewpoint positions. That is, a left-eye camera is arranged at the left-eye viewpoint 203 and a right-eye camera is arranged at the right-eye viewpoint 204, respectively. The ball moves between positions P1, P2, and P3 arranged in order from the side far from the observer to the observer side.

  The example shown in FIG. 7 differs from the cross method of FIG. 1 in that the left visual line 203E of the left eye viewpoint 203 and the right visual line 204E of the right eye viewpoint 204 are parallel. Thus, the parallel method does not intersect the observer's line of sight, and thus has the advantage of less observer eye fatigue. In this case, the parallel does not need to be strictly parallel, and it is sufficient that the line of sight does not intersect at least from the observer to the distant view.

  FIG. 8 is a diagram showing images of the left eye and the right eye at each position when the ball approaches the observer and moves from position P1 to position P3 via position P2 in the configuration shown in FIG. It is. As in FIG. 2, (a) to (c) show the left eye viewpoint video, (a) when the ball is at position P1, (b) when at position P2, and (c) at position P3. When there is, each is shown. (D) to (f) show right-eye viewpoint images, (d) shows when the ball is at position P1, (e) when at position P2, and (f) when at position P3, respectively. Show. Similarly to FIG. 2, the mountain that is the distant view 201L of the left-eye viewpoint video is drawn with a solid line, and the mountain that is the distant view 201R of the right-eye viewpoint image is drawn with a broken line. Further, the ball that is the foreground 202L of the left-eye viewpoint image is drawn with a white circle ○, and the ball that is the foreground 202R of the right-eye viewpoint image is drawn with a black circle ●.

  In the left eye viewpoint image, the ball moves in any case where the ball moves from the position P1 (FIG. 8A) to the position P3 (FIG. 8C) via the position P2 (FIG. 8B). Is to the right of the left line of sight 203E. Specifically, as the ball moves from the position P1 to the position P3 (approaching the observer), the ball as the foreground 202L gradually increases on the right side of the image, but toward the right side (toward the outside). Moving. On the other hand, since the mountain as the distant view 201L is stationary on the right side of the left visual line 203E, it is displayed at a fixed position on the right side of the video.

  On the other hand, in the right-eye viewpoint image, when the ball moves from the position P1 (FIG. 8D) to the position P3 (FIG. 8F) via the position P2 (FIG. 8E), the ball is always It is on the left side of the right visual line 204E. Specifically, as the ball moves from the position P1 to the position P3 (closer to the observer), the ball as the foreground 202R gradually increases on the left side of the video, and further toward the left side (toward the outside). Moving. Since the mountain as the distant view 201R is stationary on the left side of the right visual line 204E, it is displayed at a fixed position on the left side of the video.

  As described above, when the balls in the foreground 102L and 202R approach the observer, the ball moves to the right side on the right side of the screen on the left-eye viewpoint image, but the degree of movement is smaller than that in the cross method. Also, on the right eye viewpoint image, the ball moves to the left side on the left side of the screen, but the degree of this movement is also smaller than in the case of the cross method. The mountains that are the distant views 201L and 201R are displayed on the right side of the screen on the left-eye viewpoint video and on the left side of the screen on the right-eye viewpoint video.

  FIG. 9 is a diagram illustrating an image obtained by synthesizing the left-eye viewpoint image and the right-eye viewpoint image in the parallel method. 9A is an image obtained by synthesizing (a) and (d) in FIG. 8, (b) is an image obtained by synthesizing (b) and (e) in FIG. 8, and (c) is illustrated in FIG. 8 (c) and 8 (f). Accordingly, FIG. 9A shows a case where the ball is at the position P1, FIG. 9B shows a case where the ball is at the position P2, and FIG. 9C shows a case where the ball is at the position P3.

  As shown in FIG. 9, in the parallel method, even when the distance between the foregrounds 202L and 202R and the observer changes, the change in the lateral position on the image of the foregrounds 202L and 202R is small compared to the cross method. You don't get too close to each other like the cross method. Furthermore, since the distant views 201L and 201R are always arranged near the center of the image, even if the image size increases, there is no unnatural line of sight for viewing the distant views 201L and 201R. Therefore, the video can be viewed in a wide range without being limited to the range as in the cross method.

  However, in the parallel method, even if the position of the ball changes, there is little change in the arrangement of the near views 202L and 202R with respect to the distant views 201L and 201R.

  Hereinafter, a 3D video data generation method, a 3D video data generation system, a recording medium on which 3D video data is recorded, and a 3D video data generation program according to an embodiment of the present invention will be described with reference to the drawings.

  The present invention generates three-dimensional video data including a left-eye video and a right-eye video, which are two-dimensional video images having a parallax obtained by the parallel method. The distant view is positioned to the right of the original position on the right eye image. Thereby, the three-dimensional effect can be emphasized while suppressing the eyestrain of the observer.

  Here, the original position is a result of observing an object (for example, a distant view) from a predetermined viewpoint with a predetermined line of sight in a real or virtual three-dimensional space, and the object is in an observation field of view (observation video). It is the position where it appears. In other words, when an object such as a near view and a distant view is observed from the left eye viewpoint and the right eye viewpoint in a real or virtual three-dimensional space to obtain left and right two-dimensional images, the above-described two-dimensional images are displayed on the respective two-dimensional images. This is the position of the object image, that is, the position where the object is observed.

  In the present invention, as will be described later, by processing a two-dimensional image obtained by observing a distant view and a near view, or by observing a close view from the right eye viewpoint or the left eye viewpoint, By using for generation, the distant view is positioned to the left of the original position on the left-eye image, and the distant view is positioned to the right of the original position on the right-eye image.

Further, the amount of deviation from the original position to the left and right is preferably in a range in which the distant view in the left-eye image and the distant view in the right-eye image correspond to any of the following relationships in the composite image.
(1) The distant view in the left-eye image and the distant view in the right-eye image are both the distant view in the left-eye image and the distant view in the right-eye image. It is arranged between.
(2) More preferably, when the distant view in the left-eye image and the distant view in the right-eye image are both closest to each other, the distant view in the left-eye image and the distant view in the right-eye image are both closest. It is arranged between the close view in the image.
(3) More preferably, the distant view in the left-eye image and the distant view in the right-eye image overlap.

  The video may be a still image or a moving image. In addition, the lines of sight in the parallel method do not need to be strictly parallel, and at least do not intersect in the distance range from the observer to the distant view.

  The three-dimensional space to which the parallel method is applied may be real or virtual. In this three-dimensional space, it is assumed that there are at least an object in the foreground and an object in the distance. In addition, the positional relationship between a distant view, a close view, a left eye viewpoint, and a right eye viewpoint in a real or virtual three-dimensional space is the same as the parallel method disclosed in FIG.

  Next, with reference to FIGS. 10 to 17, a 3D video data generation method, a 3D video data generation system, a recording medium on which 3D video data is recorded, and a 3D video data generation program according to the present embodiment. explain.

  First, the 3D video data generation system according to the present embodiment will be described with reference to FIGS. 10 and 11. FIG. 10 is a diagram showing a schematic configuration of the 3D video data generation system according to the present embodiment. FIG. 11 is a block diagram showing an internal configuration of a part of the 3D video data generation system according to the present embodiment.

  As shown in FIG. 10, the 3D video data generation system 10 according to the present embodiment includes a computer 21 and two cameras 31 and 32. The cameras 31 and 32 are preferably cameras having the same performance as each other, and known digital cameras can be used.

  A display 24, an input console 23, and an external storage device 22 are connected to the computer 21. Further, the computer 21 is connected to two cameras 31 and 32 for the left eye and the right eye via a communication line (network) 25 and can acquire these photographing data. Any computer 21, external storage device 22, input console 23, display 24, and communication line 25 can be used. Any camera can be used as long as it can send shooting data to the computer 21, and three or more cameras may be used. In addition, it is possible to perform imaging for the left eye and the right eye with one unit. Furthermore, depending on the environment, the cameras 31 and 32 may be directly connected to the computer 21 without using the communication line 25.

  The cameras 31 and 32 are located, for example, in a studio (not shown). In the studio, an object as a distant view is disposed at a position away from the camera, and an object as a close view is disposed at a position near the camera. .

  As shown in FIG. 11, the computer 21 includes a CPU (Central Processing Unit) 26, an internal HDD (Hard Disc Drive) 27, and an internal semiconductor memory 28. The computer 21 is connected to the external storage device 22 via the external storage device I / F 22a, connected to the input console 23 via the input console I / F 23a, and displayed on the display 24 via the display I / F 24a. And is further connected to the communication line 25 via the network I / F 25a.

  The camera 31 observes the distant view and the near view in front of the distant view from the left eye viewpoint. That is, the camera 31 as the left-eye provisional image acquisition means generates a left-eye provisional image that is a two-dimensional image obtained by observing a distant view and a near view from the left eye viewpoint corresponding to the left eye of the observer in a real or virtual three-dimensional space. To win.

  The camera 32 observes the distant view and the near view in front of the distant view from the right eye viewpoint. When functioning as a provisional image acquisition means for the right eye, the right eye is a two-dimensional image obtained by observing a distant view and a foreground with a line of sight parallel to the line of sight of the left eye viewpoint from the right eye viewpoint corresponding to the observer's right eye in a three-dimensional space. Acquire a provisional video.

  The CPU 26 uses the shooting data from the camera 31 and the camera 32 to generate a left-eye video and a right-eye video by a data 3D video data generation program, and as a means for generating a left-eye temporary video and a right-eye temporary video. Also works.

  FIG. 12 is a perspective view illustrating a configuration example when acquiring a distant view 251 and a close view 252 in an actual three-dimensional space observed from the left eye viewpoint and the right eye viewpoint in the present embodiment. FIG. 13 is a perspective view illustrating a configuration example when acquiring a distant view 261 and a close view 252 in an actual three-dimensional space observed from the left eye viewpoint and the right eye viewpoint in the present embodiment. In both cases, the line of sight from the left eye viewpoint and the line of sight from the right eye viewpoint are parallel.

  As shown in FIG. 12, if the distant view 251 is a three-dimensional three-dimensional figure, a realistic expression can be achieved. On the other hand, as shown in FIG. 13, the distant view 261 may be expressed in a two-dimensional view for the purpose of simplifying the set creation in studio shooting or saving the CPU power in the CG.

  When the computer 21 virtually creates 3D video data with CG, or when using a separately created virtual 3D space video, the cameras 31 and 32 and the communication line 25 can be omitted. . Data captured by the cameras 31 and 32 may be input to the computer 21 not via the communication line 25 but via a storage medium.

A 3D video generation operation will be described with reference to FIGS.
FIG. 14 shows images at the left eye viewpoint at each position when the ball approaches the observer and moves from position P1 to position P3 via position P2 in the configuration shown in FIGS. FIG. (A)-(c) has shown the two-dimensional image | video of the original position which observed the three-dimensional space. Here, (a) shows when the ball is at position P1, (b) when at position P2, and (c) when at position P3. The arrows are provided for explanation and do not appear on the actual video.
(D) to (f) correspond to (a) to (c), respectively, and in the two-dimensional images shown in (a) to (c), only the distant view is positioned to the left of the original position. The left-eye video is shown. That is, the distant view 301L in (a) to (c) is arranged at the position of the distant view 301L shown in (d) to (f) by moving in the left direction indicated by the arrow. On the other hand, the position of the foreground 302L in (a) to (c) and the position of the foreground 302L shown in (d) to (f) are arranged at the same position regardless of the movement of the distant view.

FIG. 15 shows images at the right-eye viewpoint at each position when the ball approaches the observer and moves from position P1 to position P3 via position P2 in the configuration shown in FIGS. FIG. (A)-(c) has shown the two-dimensional image | video of the original position which observed the three-dimensional space. Here, (a) shows when the ball is at position P1, (b) when at position P2, and (c) when at position P3. The arrows are provided for explanation and do not appear on the actual video.
(D) to (f) correspond to (a) to (c), respectively, and only the distant view of the two-dimensional images shown in (a) to (c) is positioned to the right of the original position. The right eye image is shown. That is, the distant view 301R in (a) to (c) is arranged in the position of the distant view 301R shown in (d) to (f) by moving in the right direction indicated by the arrow. On the other hand, the position of the foreground 302R in (a) to (c) and the position of the foreground 302R shown in (d) to (f) are arranged at the same position regardless of the movement of the distant view.

  For convenience of explanation, the distant view 301L shown in FIG. 14 is indicated by a solid line, and the distant view 301R shown in FIG. 15 is indicated by a broken line. Similarly, the foreground 302L shown in FIG. 14 is indicated by a white circle ◯, and the foreground 302R shown in FIG. 15 is indicated by a black circle ●.

16 is a diagram showing a three-dimensional image obtained by superimposing and synthesizing (d) to (f) in FIG. 14 and (d) to (f) in FIG.
FIG. 17 is a flowchart showing a flow of 3D video data generation by the 3D video data generation system 10 according to the present embodiment.

  A 3D video generation program is recorded in the internal HDD 27 or the internal semiconductor memory 28 in the computer 21. This 3D image generation program includes at least (1) a 2D image obtained by observing a real or virtual 3D space from a left eye viewpoint corresponding to the left eye of an observer, having a distant view and a near view on the near side of the distant view. A program part with a left-eye image generation function that generates a left-eye image by placing the image at a position to the left of the original position, and (2) observing the three-dimensional space from the right-eye viewpoint corresponding to the right eye of the observer In the two-dimensional video, a program portion including right eye video generation for generating a right eye video by disposing a distant view at a position to the right of the original position is included.

By starting this program, the 3D video data generation system 10 exhibits its function. Hereinafter, a description will be given with reference to FIG.
First, using a camera 31 and a camera 32 arranged in parallel with each other in the shooting direction, a two-dimensional image (FIGS. 14A to 14C) observed from the left viewpoint by the parallel method and observed from the right viewpoint. Two-dimensional images (FIGS. 15A to 15C) are respectively acquired (step S101). Since the shooting directions of the camera 31 and the camera 32 are arranged in parallel to each other, parallax occurs in the obtained two-dimensional image. These two-dimensional images include distant views 301L and 301R, and foreground views 302L and 302R in front of the distant view. The acquired two-dimensional video is converted into an electrical signal by the cameras 31 and 32 and transmitted to the computer 21 via the communication line 25, and the computer 21 stores it in a predetermined area in the external storage device 22.

  Subsequently, in accordance with the instruction signal from the input console 23, the computer 21 positions the distant view to the left of the original position with respect to the two-dimensional image observed from the left viewpoint. Left-eye video (FIGS. 14D to 14F) are generated (step S102). The generated left-eye video data is stored in a predetermined area in the external storage device 22.

  Further, in accordance with the instruction signal from the input console 23, the computer 21 positions the distant view to the right of the original position with respect to the two-dimensional image observed from the right viewpoint, of the three-dimensional image data for stereoscopic viewing. The right-eye video (FIGS. 15D to 15F) is generated (step S103). The generated right-eye video data is stored in a predetermined area in the external storage device 22.

  Here, the movement amount from the “original position” is set in advance by the user operating the input console 23, or set after confirming the photographing results by the cameras 31 and 32 on the display 24, Store in the external storage device 22. The amount of movement is preferably the same for the video observed from the left viewpoint and the video observed from the right viewpoint, but may be different from the viewpoint of stereoscopic effect and other viewpoints.

  The computer 21 generates stereoscopic 3D video data using the left-eye video and the right-eye video according to the instruction signal transmitted by the user of the 3D video data generation system 10 by operating the input console 23. (Step S104). The 3D video data is recorded in a predetermined format in association with the left-eye video and the right-eye video so that the left-eye video and the right-eye video can be presented in synchronization with each other. The generated 3D video data is stored in a predetermined area in the external storage device 22 (recording medium).

Note that the order of step S102 and step S103 may be reversed, or may be performed simultaneously. Further, the recording medium for recording the 3D video data is not limited to the external storage device 22, and for example, an optical disk, a magneto-optical disk, or a memory can be used.
Of course, when it is implemented in the virtual three-dimensional space by CG or the like, an image in which the distant view is shifted from the original position may be directly created.

  The three-dimensional video generated as described above is further distanced in the horizontal direction between the foreground and the background, and the sense of distance is emphasized. This enhances the stereoscopic effect. In the present embodiment, the distant view 301L at the left eye viewpoint is a distant view 301L moved to the left from the original position, and the distant view 301R at the right eye viewpoint is moved to the right from the original position. While 301L and 301R are arranged so as to overlap in the approximate center of the 3D video, the foregrounds 302L and 302R are arranged at substantially the left and right ends of the 3D video. For this reason, it is possible to relieve eye fatigue caused by the separation of the distant view from the left and right viewpoints, and to enhance the stereoscopic effect by separating the distant view and the distant view.

  Next, a more specific technical application example for generating a left-eye video and a right-eye video for stereoscopic viewing from a two-dimensional video observed in a real or virtual three-dimensional space will be described based on an embodiment.

(First embodiment)
The 3D video data generation method according to the first embodiment will be described with reference to FIGS. Here, FIG. 18 is a flowchart showing a flow of generating 3D video data by the 3D video data generating method according to the first embodiment. FIG. 19 is a diagram showing the video obtained in each step shown in FIG.

The 3D video data generation method according to the first embodiment includes the following steps (1) to (4).
(1) In a real or virtual three-dimensional space having a distant view and a near view in front of the distant view, a left-eye temporary image that is a two-dimensional image obtained by observing the distant view and the close view from the left eye viewpoint corresponding to the left eye of the observer Step of acquiring provisional image for left eye (2) For right eye that is a two-dimensional image in which a distant view and a near view are observed from a right eye viewpoint corresponding to an observer's right eye in a three-dimensional space with a line of sight parallel to the line of sight of the left eye viewpoint Step for acquiring provisional image, right-eye provisional image acquisition step (3) Processing the obtained left-eye provisional image, and disposing the distant view on the left-eye position from the original position on the left-eye provisional image. The left eye image generation step (4), which generates the image, processes the acquired right eye temporary image, and places the distant view on the right side of the original position on the right eye temporary image to generate the right eye image. Video for right eye to be generated Forming step

  That is, by processing the left-eye and right-eye temporary images and disposing the distant view to the left or right of the original position, the left-eye image that is a two-dimensional image observed with the left eye of the observer, and the observation 3D image data for stereoscopic viewing including a right-eye image that is a two-dimensional image observed with the right eye of a person is generated.

  As shown in FIG. 18, first, a temporary image for the left eye which is a two-dimensional image observed from the left viewpoint by a parallel method using a camera 31 and a camera 32 in which shooting directions are arranged in parallel to each other (FIG. 19A )) Is acquired (step S201). Next, a right-eye temporary image (FIG. 19B), which is a two-dimensional image observed from the right viewpoint, is acquired (step S202). Since the left-eye temporary image and the right-eye temporary image have the shooting directions of the camera 31 and the camera 32 arranged in parallel to each other, parallax occurs in the obtained two-dimensional image. These two-dimensional images include distant views 401L and 401R, and foreground views 402L and 402R in front of the distant view. The acquired two-dimensional video is converted into an electrical signal by the cameras 31 and 32 and transmitted to the computer 21 via the communication line 25, and the computer 21 stores it in a predetermined area in the external storage device 22. Note that the order of step S201 and step S202 may be reversed or simultaneous.

  Next, in accordance with the instruction signal from the input console 23, the computer 21 positions the distant view to the left of the original position by image processing for the temporary video for the left eye, and includes the 3D video data for stereoscopic viewing. Left-eye video (FIG. 19C) is generated (step S203). The generated left-eye video data is stored in a predetermined area in the external storage device 22.

  Further, the computer 21 positions the distant view to the right of the original position by image processing for the temporary image for the right eye according to the instruction signal from the input console 23, and includes the 3D image data for stereoscopic viewing. A right-eye video (FIG. 19D) is generated (step S204). The generated right-eye video data is stored in a predetermined area in the external storage device 22. Note that the order of step S201 and step S202 may be reversed.

  The computer 21 associates the left-eye video and the right-eye video with each other according to the instruction signal transmitted by the user of the 3D video data generation system 10 by operating the input console 23 (FIG. 19 (e)). )) Is generated (step S205). In this generation, the left-eye video and the right-eye video having frames of the same size are connected without changing the size and arrangement.

(Second Embodiment)
Next, a second embodiment of the present invention will be described with reference to FIGS. Here, FIG. 20 is a flowchart showing a flow of generating 3D video data by the 3D video data generating method according to the second embodiment. FIG. 21 is a diagram showing the video obtained in each step shown in FIG.

The 3D video data generation method according to the second embodiment includes the following steps (1) to (6).
(1) In a real or virtual three-dimensional space having a distant view and a near view on the near side of the distant view, a two-dimensional image obtained by observing the distant view without including the distant view from the first left eye viewpoint corresponding to the left eye of the observer A first image acquisition step (2) for acquiring a first image is a two-dimensional image obtained by observing a near view without including a distant view from a first right eye viewpoint corresponding to the right eye of the observer in a three-dimensional space. Second image acquisition step of acquiring two images (3) In a three-dimensional space, from a second left eye viewpoint corresponding to the left eye of the observer, a third image that is a two-dimensional image obtained by observing a distant view without including a near view Third video acquisition step (4) to acquire a fourth video that is a two-dimensional video obtained by observing a distant view without including a foreground from a second right eye viewpoint corresponding to the right eye of the observer in a three-dimensional space. 4th video acquisition step (5) No. Image and right-eye video generating step of generating a right-eye video from the second image and third image left eye image generating step (6) for generating a left-eye video from the fourth video

  That is, a distant view image captured from the right eye viewpoint is used as a distant view of the left eye image, and a distant view image captured from the left eye viewpoint is used as a distant view of the right eye image. Accordingly, it is possible to obtain an effect that the distant view included in the left-eye image is positioned to the left of the original position, and the distant view included in the right-eye image is positioned to the right of the original position.

  As shown in FIG. 20, first, a near view 502L that does not include a distant view 501L in a two-dimensional image observed from the left viewpoint by the parallel method using a camera 31 and a camera 32 in which shooting directions are arranged in parallel to each other. A first image (FIG. 21A) in which only the image is observed is acquired (step S301). Next, using the camera 31 and the camera 32, a second image (FIG. 21B) in which the near view 502R is observed without including the distant view 501R is acquired from the two-dimensional images observed from the right viewpoint (step S302). ). The acquired two-dimensional video is converted into an electrical signal by the cameras 31 and 32 and transmitted to the computer 21 via the communication line 25, and the computer 21 stores it in a predetermined area in the external storage device 22.

  Subsequently, among the two-dimensional images observed from the left viewpoint, a third image (FIG. 21C) in which only the distant view 501L is observed without including the close view 502L is acquired (step S303). Next, a fourth image (FIG. 21D) in which only the distant view 501R is observed without including the foreground 502R is acquired from the two-dimensional image observed from the right viewpoint (step S304). The acquired two-dimensional video is converted into an electrical signal by the cameras 31 and 32 and transmitted to the computer 21 via the communication line 25, and the computer 21 stores it in a predetermined area in the external storage device 22.

  Note that steps S301 to S304 can be executed in any other order.

  Next, the computer 21 synthesizes the first video and the fourth video as 3D video data according to an instruction signal transmitted by the user of the 3D video data generation system 10 operating the input console 23. The left-eye video (FIG. 21E) is generated (step S305). The computer 21 stores the generated data in a predetermined area in the external storage device 22. In this synthesis, the first video and the fourth video having frames of the same size are synthesized without changing the size and arrangement.

  Further, the computer 21 synthesizes the second video and the third video as 3D video data according to an instruction signal transmitted by the user of the 3D video data generation system 10 operating the input console 23. The right-eye video (FIG. 21 (f)) is generated (step S306). The computer 21 stores the generated data in a predetermined area in the external storage device 22. In this synthesis, the second video and the third video having frames of the same size are synthesized without changing the size and arrangement.

  Note that steps S305 to S306 can be executed in the reverse order or simultaneously.

  Further, the computer 21 associates the left-eye video generated in step S305 with the right-eye video generated in step S306, and generates three-dimensional video data (FIG. 21 (g)) (step S307). The computer 21 stores the generated data in a predetermined area in the external storage device 22. This composition associates the left-eye video and the right-eye video having the same frame size without changing the size and arrangement.

  Note that the second left viewpoint may be provided at the same position as the first left viewpoint, or the positions may be different. The same applies to the second right viewpoint and the first right viewpoint. For example, in viewing a distant view, the stereoscopic effect can be enhanced by increasing the distance between the left and right viewpoints.

  As described above, the 3D video data generation method and 3D video data generation system according to the present invention are useful for generating a 3D video having a plurality of gazing points.

It is a conceptual diagram explaining an example of a structure in the case of creating three-dimensional image data by the cross method. FIG. 3 is a diagram showing images at the respective viewpoints of the left eye and the right eye at each position when the ball approaches the observer and moves from position P1 to position P3 via position P2 in the configuration shown in FIG. . It is a figure which shows the image | video which synthesize | combined the left eye viewpoint image | video and the right eye viewpoint image | video in the cross method. FIG. 3B shows a state in which a distant view is disposed at the tip of the left eye line of sight and the right eye line of the observer, extending substantially parallel to the image where the ball is substantially at the position of the intersection, corresponding to FIG. FIG. In the image corresponding to FIG. 3 (b) where the ball is substantially at the position of the intersection, distant views are arranged in front of the observer's left eye line and right eye line extending toward the image. It is a figure which shows the state currently performed. In the cross method, it is a conceptual diagram which shows the example of the range which has little eye fatigue and can be observed. It is a conceptual diagram explaining an example of a structure in the case of producing 3D image data by a parallel method. FIG. 8 is a diagram illustrating an image of the left eye and the right eye at each position when the ball approaches the observer and moves from position P1 to position P3 via position P2 in the configuration illustrated in FIG. 7. It is a figure which shows the image | video which synthesize | combined the left eye viewpoint image | video and the right eye viewpoint image | video in the parallel method. 1 is a diagram illustrating a schematic configuration of a 3D video data generation system according to an embodiment of the present invention. It is a block diagram which shows the internal structure of a part of 3D video data generation system which concerns on embodiment of this invention. In the embodiment of the present invention, it is a perspective view showing a configuration example when acquiring a distant view and a close view of an actual three-dimensional space observed from the left eye viewpoint and the right eye viewpoint. In this embodiment, it is a perspective view which shows the structural example when acquiring the distant view and the near view of the real three-dimensional space observed from the left eye viewpoint and the right eye viewpoint. FIG. 12 is a diagram illustrating an image at the left eye viewpoint at each position when the ball approaches the observer and moves from position P1 to position P3 via position P2 in the configuration illustrated in FIGS. 10 and 11. FIG. 12 is a diagram showing an image at the right eye viewpoint at each position when the ball approaches the observer and moves from the position P1 to the position P3 via the position P2 in the configuration shown in FIGS. It is the figure which displayed the three-dimensional image | video obtained by superimposing each combining (d)-(f) of FIG. 14, and (d)-(f) of FIG. It is a flowchart which shows the flow of the production | generation of 3D video data by the 3D video data system which concerns on embodiment of this invention. It is a flowchart which shows the flow of the production | generation of 3D video data by the 3D video data generation method which concerns on 1st Embodiment. It is a figure which shows the image | video obtained in each step shown in FIG. It is a flowchart which shows the flow of the production | generation of 3D video data by the 3D video data generation method which concerns on 2nd Embodiment. It is a figure which shows the image | video obtained in each step shown in FIG.

Explanation of symbols

10 3D image data generation system 21 Computer 22 External storage device 23 Input console 24 Display 25 Communication line (network)
26 CPU
27 Internal HDD
28 Internal semiconductor memory 31, 32 Cameras 101, 101L, 101R Distant view 102, 102L, 102R Near view 103 Left eye viewpoint 103E Left eye line 104 Right eye viewpoint 104E Right eye line 107 Intersection 108 Left eye 108E Line of sight 109 Right eye 109E Line of sight 110 Observable area 111 Display surface 201 201L, 201R Distant view 202, 202L, 202R Foreground 203 Left eye viewpoint 203E Left viewing line 204 Right eye viewpoint 204E Right viewing line 251 Distant view 252 Distant view 261 Distant view 301L, 301R Distant view 302L, 302R Foreground 401L, 401R Distant view 402L, 402R Distant view 501L, 501R Distant view 501L , 502R Foreground P1, P2, P3 position

Claims (11)

A method of generating stereoscopic 3D image data including a left-eye image and a right-eye image, which are two-dimensional images having parallax obtained by a parallel method;
In a two-dimensional image obtained by observing a real or virtual three-dimensional space from the left eye viewpoint corresponding to the left eye of the observer, the distant view and only the distant view of the distant view and the foreground are located at their original positions. A left-eye image generation step for generating a left-eye image by arranging the left-eye position,
In a two-dimensional image obtained by observing the three-dimensional space from the right eye viewpoint corresponding to the right eye of the observer, a right-eye image is generated by disposing only the distant view of the distant view and the close view at a position to the right of the original position. A right eye video generation step;
I have a,
The three-dimensional video data generation method characterized in that the amount of deviation from the original position to the left and right is maximized by the amount of overlap between the distant view in the left-eye image and the distant view in the right-eye image . A method of generating stereoscopic 3D image data including a left-eye image that is a two-dimensional image observed with the left eye of the observer and a right-eye image that is a two-dimensional image observed with the right eye of the observer And
In a real or virtual three-dimensional space having a distant view and a near view on the near side of the distant view, a temporary image for the left eye that is a two-dimensional image obtained by observing the distant view and the close view from the left eye viewpoint corresponding to the left eye of the observer Acquiring a temporary video acquisition step for the left eye;
In the three-dimensional space, from the right eye viewpoint corresponding to the right eye of the observer, a right eye temporary image that is a two-dimensional image obtained by observing the distant view and the near view with a line of sight parallel to the line of sight of the left eye viewpoint is obtained. Video acquisition step,
The acquired left-eye temporary image is image-processed, and on the left-eye temporary image, among the far view and the near view, only the distant view is arranged at a position to the left of the original position to generate a left-eye image. A left eye image generation step;
The acquired right-eye temporary image is image-processed, and on the right-eye temporary image, of the far view and the near view, only the distant view is arranged at a position on the right side of the original position to generate a right eye image. A video generation step for the right eye;
I have a,
The three-dimensional video data generation method characterized in that the amount of deviation from the original position to the left and right is maximized by the amount of overlap between the distant view in the left-eye image and the distant view in the right-eye image . A method of generating stereoscopic 3D image data including a left-eye image that is a two-dimensional image observed with the left eye of the observer and a right-eye image that is a two-dimensional image observed with the right eye of the observer And
In a real or virtual three-dimensional space having a distant view and a near view in front of the distant view, a two-dimensional image obtained by observing the distant view without including the distant view from the first left eye viewpoint corresponding to the left eye of the observer A first video acquisition step of acquiring a first video;
In the three-dimensional space, a second two-dimensional image is obtained by observing the foreground without including the distant view from a first right eye viewpoint corresponding to the right eye of the observer with a line of sight parallel to the line of sight of the left eye viewpoint. A second video acquisition step of acquiring a video;
A third image acquisition step of acquiring a third image that is a two-dimensional image obtained by observing the distant view without including the near view from the second left eye viewpoint corresponding to the left eye of the observer in the three-dimensional space;
In the three-dimensional space, from a second right eye viewpoint corresponding to the right eye of the observer, a fourth image that is a two-dimensional image obtained by observing a distant view without including the near view with a line of sight parallel to the line of sight of the left eye viewpoint. Acquiring a fourth video acquisition step;
A left-eye image generating step for generating the left-eye image from the first image and the fourth image;
A right-eye video generation step of generating the right-eye video from the second video and the third video;
I have a,
3-dimensional image data generating method, characterized the distant view in the left-eye video described above was acquired, the Rukoto arranged so distant overlap in the right-eye images as described above acquired.   4. The 3D video data generation method according to claim 3, wherein a real or virtual 3D object is used as the distant view in the 3D space.   4. The 3D video data generation method according to claim 3, wherein a real or virtual 2D diagram is used as the distant view in the 3D space. A system for generating stereoscopic 3D image data including a left-eye image and a right-eye image, which are two-dimensional images having parallax obtained by a parallel method,
In a two-dimensional image obtained by observing a real or virtual three-dimensional space having a distant view and a near view in front of the distant view from the left eye viewpoint corresponding to the left eye of the observer, only the distant view of the distant view and the close view is from the original position. A left-eye image generating means for generating a left-eye image by arranging the left-eye position;
In a two-dimensional image obtained by observing the three-dimensional space from the right eye viewpoint corresponding to the right eye of the observer, a right-eye image is generated by disposing only the distant view of the distant view and the close view at a position to the right of the original position. Right eye image generation means;
I have a,
The three-dimensional video data generation system characterized in that the amount of deviation from the original position to the left and right is maximized by the amount of overlap between the distant view in the left-eye image and the distant view in the right-eye image . A system for generating stereoscopic 3D image data including a left-eye image that is a two-dimensional image observed with the left eye of the observer and a right-eye image that is a two-dimensional image observed with the right eye of the observer And
In a real or virtual three-dimensional space having a distant view and a near view on the near side of the distant view, a temporary image for the left eye that is a two-dimensional image obtained by observing the distant view and the close view from the left eye viewpoint corresponding to the left eye of the observer A left-eye provisional video acquisition means,
In the three-dimensional space, from the right eye viewpoint corresponding to the right eye of the observer, a right eye temporary image that is a two-dimensional image obtained by observing the distant view and the near view with a line of sight parallel to the line of sight of the left eye viewpoint is obtained. Video acquisition means;
The acquired left-eye temporary image is image-processed, and on the left-eye temporary image, among the far view and the near view, only the distant view is arranged at a position to the left of the original position to generate a left-eye image. Left-eye image generation means;
The acquired right-eye temporary image is image-processed, and on the right-eye temporary image, of the far view and the near view, only the distant view is arranged at a position on the right side of the original position to generate a right eye image. Right eye image generation means;
I have a,
The three-dimensional video data generation system characterized in that the amount of deviation from the original position to the left and right is maximized by the amount of overlap between the distant view in the left-eye image and the distant view in the right-eye image . A system for generating stereoscopic 3D image data including a left-eye image that is a two-dimensional image observed with the left eye of the observer and a right-eye image that is a two-dimensional image observed with the right eye of the observer And
In a real or virtual three-dimensional space having a distant view and a near view in front of the distant view, a two-dimensional image obtained by observing the distant view without including the distant view from the first left eye viewpoint corresponding to the left eye of the observer A first video acquisition means for acquiring a first video;
In the three-dimensional space, a second image that is a two-dimensional image obtained by observing the near view without including the distant view from the first right eye viewpoint corresponding to the right eye of the observer with a line of sight parallel to the line of sight of the left eye viewpoint. A second image acquisition means for acquiring
A third image acquisition means for acquiring a third image that is a two-dimensional image obtained by observing a distant view without including the close-up view from the second left-eye viewpoint corresponding to the left eye of the observer in the three-dimensional space;
In the three-dimensional space, from a second right eye viewpoint corresponding to the right eye of the observer, a fourth image that is a two-dimensional image obtained by observing a distant view without including the near view with a line of sight parallel to the line of sight of the left eye viewpoint. 4th image acquisition means to acquire,
Left eye image generating means for generating the left eye image from the first image and the fourth image;
A right-eye image generating means for generating the right-eye image from the second image and the third image;
I have a,
3-dimensional image data generation system, wherein the distant view in the left-eye video described above was acquired, the Rukoto arranged so distant overlap in the right-eye images as described above acquired.   9. The 3D video data generation system according to claim 8, wherein a real or virtual 3D object is used as the distant view in the 3D space.   9. The 3D video data generation system according to claim 8, wherein a real or virtual 2D diagram is used as the distant view in the 3D space. A 3D video data generation program for generating 3D video data for stereoscopic viewing including a left-eye video and a right-eye video, which are two-dimensional video images having parallax obtained by a parallel method,
In a two-dimensional image obtained by observing a real or virtual three-dimensional space from the left eye viewpoint corresponding to the left eye of the observer, the distant view and only the distant view of the distant view and the foreground are located at their original positions. A left-eye video generation function that generates a left-eye video by placing it at a position to the left of
In a two-dimensional image obtained by observing the three-dimensional space from the right eye viewpoint corresponding to the right eye of the observer, a right-eye image is generated by disposing only the distant view of the distant view and the close view at a position to the right of the original position. And a right-eye video generation function ,
The amount of deviation from the original position to the right and left is realized by using a computer to maximize the amount of overlap between the distant view in the left-eye image and the distant view in the right-eye image. Dimensional video data generation program.

Images