KR102370326B1 - Image processing method and image processing apparatus for generating 3d content using 2d images - Google Patents

Abstract

Herein, in an image processing method performed by an image processing apparatus, a first image representing a 2D image of 3D content observed at a first position in a 3D coordinate system and the 3D content observed at a second position in the 3D coordinate system obtaining a second image representing a 2D image of detecting a first boundary line indicating one boundary of the 3D content in the first image; detecting a second boundary line indicating the one boundary in the second image; and determining a third boundary line expressing the one boundary in 3D in the 3D coordinate system by using the first boundary line and the second boundary line.

Description

Image processing method and image processing apparatus for generating 3D content using 2D images

The present invention relates to an image processing method and an image processing apparatus for generating 3D content.

3D modeling refers to modeling or virtualizing the real or non-real world in a three-dimensional form. Such three-dimensional (3D) modeling can be represented by expressing a three-dimensional target object as geometric data.

In the past, the method of constructing a 3D depiction based on the survey performance of the real world was considered inefficient, so instead of using the survey performance, approximate 3D modeling was made based on observations through photos or field visits, or modeling of the unreal world was mainly performed was done However, in recent years, 3D modeling work on the real world is gradually progressing due to the development of surveying technology, the development of photogrammetry tools, and the development of computer graphics technology.

As an example, the 3D modeling may be generated by 3D scanning the target object. A picture created by scanning describes the distance from each point to a surface. Accordingly, the three-dimensional position of each point in the picture can be identified. In such a technique, a scan operation from multiple directions is typically required to obtain information from all directions of the target object, and this operation takes a considerable amount of time.

In order to promote 3D modeling efficiency, Korean Patent Application No. 10-2018-0047235 sets a virtual camera and texture in 3D space using data obtained from a commercialized photogrammetry tool, Disclosed is a method for rapidly producing a more realistic 3D model by setting coordinates for

However, as the demand for 3D modeling has rapidly increased in recent years, there is still a need to use a more efficient 3D modeling method.

The present specification provides an image processing method and an image processing apparatus for efficiently generating realistic 3D content.

An image processing method performed by an image processing apparatus according to an embodiment of the present invention for solving the above problems includes a first image representing a 2D image of 3D content observed at a first position in a 3D coordinate system, and a second image in the 3D coordinate system. obtaining a second image representing a 2D image of the 3D content observed at the location; detecting a first boundary line indicating one boundary of the 3D content in the first image; detecting a second boundary line indicating the one boundary in the second image; and determining a third boundary line expressing the one boundary in 3D in the 3D coordinate system by using the first boundary line and the second boundary line.

The determining of the third boundary line may include: generating a first projection surface by projecting the first boundary line in a direction in which the 3D content is observed from the first position; generating a second projection surface by projecting the second boundary line in a direction in which the 3D content is observed from the second position; and determining the third boundary line based on the intersection of the first projection surface and the second projection surface.

The generating of the first projection surface may be performed by projecting the first boundary line based on angle of view information and resolution information of the first image.

The detecting of the first boundary line may include: displaying the first image on a user terminal; representing the first boundary line on a first image based on a user input; and detecting the first boundary line according to the expression of the first boundary line.

In addition, the image processing method according to an embodiment for solving the above problem corrects the first boundary line by changing the position of at least one point constituting the first boundary line according to the movement of the position of the indicator displayed on the terminal. It may further include the step of The indicator may change a position displayed on the terminal according to a user input.

In addition, the image processing method according to an embodiment for solving the above problem may further include generating a boundary surface expressed in 3D in the 3D coordinate system by using the third boundary line. Here, the boundary surface may be generated by extending the third boundary line in a predetermined direction.

In addition, an image processing method according to an embodiment for solving the above problem includes: identifying a target object in 3D content; obtaining a first image and a second image in which the target object is expressed in 2D; detecting a boundary line of the target object in the first image and the second image; and determining a boundary line expressed in 3D in the 3D coordinate system by using the detected boundary line.

The determining of the boundary line expressed in 3D may include determining a boundary line indicating the same boundary of the target object expressed in both the first image and the second image.

In addition, the image processing method according to an embodiment for solving the above problem may further include generating a boundary surface expressed in 3D in the 3D coordinate system by using the boundary line expressed in 3D.

In addition, the image processing method according to an embodiment for solving the above problem may further include adding the generated boundary surface to the 3D content. In this case, after predetermined data corresponding to the generated boundary surface is removed from the 3D content, data for the generated boundary surface may be added to the 3D content.

In addition, an image processing apparatus according to an embodiment for solving the above problem includes a processor and a memory, wherein the processor acquires a first image representing a 2D image of 3D content observed at a first position in a 3D coordinate system, , obtains a second image indicating a 2D image of the 3D content observed at a second position in the 3D coordinate system, and detects a first boundary line indicating one boundary of the 3D content from the first image, and the second image , detects a second boundary line indicating the work boundary, and determines a third boundary line expressing the work boundary in 3D in the 3D coordinate system using the first boundary line and the second boundary line.

In addition, an image processing apparatus according to an embodiment of the present invention for solving the above problem includes a processor and a memory, wherein the processor identifies a target object from 3D content, and the target object includes a first image and a second image expressed in 2D. A second image may be obtained, a boundary line of the target object may be detected from the first image and the second image, and a boundary line expressed in 3D in the 3D coordinate system may be determined using the detected boundary line.

In addition, the computer-readable recording medium according to an embodiment for solving the above problems may be a computer-readable recording medium in which a computer program for performing the image processing method according to the above-described embodiment is recorded. there is.

According to the technical details described in this specification, an image processing method and an image processing apparatus according to an embodiment utilize a boundary line of a target object selected from a plurality of 2D images of the target object to display 3D content representing the target object in 3D. can be created efficiently.

1 is a block diagram illustrating an image processing apparatus according to an exemplary embodiment.
2 is a flowchart illustrating an image processing method performed by an image processing apparatus according to an exemplary embodiment.
3 is a conceptual diagram illustrating a positional relationship between a target object and a plurality of cameras surrounding the target object, according to an exemplary embodiment.
4 and 5 are diagrams illustrating first and second images and a user interface for receiving a user input therefor, according to an exemplary embodiment.
6 is a diagram illustrating a method of generating, by an image processing apparatus, a virtual projection surface in a 3D space, according to an exemplary embodiment.
7 is a conceptual diagram illustrating a method of generating, by an image processing apparatus, a boundary line by using an intersection of a first projection surface and a second projection surface according to an exemplary embodiment.
8 is a flowchart illustrating a method of updating 3D content by an image processing apparatus according to an exemplary embodiment.
9 shows an embodiment of 3D content.
10 is a diagram illustrating an embodiment of generating a virtual 3D surface in a 3D space.
11 is a diagram illustrating an example in which a part of 3D content is updated.

The following is merely illustrative of the principles of the invention. Therefore, those skilled in the art can devise various devices that, although not explicitly described or shown herein, embody the principles of the invention and are included in the spirit and scope of the invention. In addition, it should be understood that all conditional terms and examples listed herein are, in principle, expressly intended only for the purpose of understanding the inventive concept, and are not limited to the specifically enumerated embodiments and states as such. .

The above objects, features and advantages will become more apparent through the following detailed description in relation to the accompanying drawings, and accordingly, those of ordinary skill in the art to which the invention pertains will be able to easily practice the technical idea of the invention. .

In the specification and claims, terms such as "first," "second," "third," and "fourth," are used, if any, to distinguish between like elements and, if not necessarily, in a specific sequence. or to describe the order of occurrence. It will be understood that the terms so used are interchangeable under appropriate circumstances to enable the embodiments of the invention described herein to operate, for example, in sequences other than those shown or described herein. Likewise, where methods are described herein as including a series of steps, the order of those steps presented herein is not necessarily the order in which those steps may be performed, and any described steps may be omitted and/or Any other steps not described may be added to the method.

Also, terms such as "left", "right", "front", "behind", "top", "bottom", "above", "below" in the specification and claims are used for descriptive purposes, It is not necessarily intended to describe an invariant relative position. It will be understood that the terms so used are interchangeable under appropriate circumstances to enable the embodiments of the invention described herein to operate otherwise than, for example, as shown or described herein. As used herein, the term “connected” is defined as being directly or indirectly connected in an electrical or non-electrical manner. Objects described herein as being "adjacent" to one another may be in physical contact with one another, in proximity to one another, or in the same general scope or area as appropriate for the context in which the phrase is used. The presence of the phrase “in one embodiment” herein refers to the same, but not necessarily, embodiment.

In addition, in the specification and claims, references to 'connected', 'connecting', 'fastened', 'fastening', 'coupled', 'coupled', etc., and various variations of these expressions, refer to other elements directly It is used in the sense of being connected or indirectly connected through other elements.

In addition, the suffixes "module" and "part" for components used in this specification are given or used in consideration of ease of writing the specification, and do not have a meaning or role distinct from each other by themselves.

In addition, the terms used herein are for the purpose of describing the embodiments and are not intended to limit the present invention. In this specification, the singular also includes the plural unless specifically stated otherwise in the phrase. As used herein, 'comprise' and/or 'comprising' means that a referenced component, step, operation and/or element is the presence of one or more other components, steps, operations and/or elements. or addition is not excluded.

In addition, in the description of the invention, if it is determined that a detailed description of a known technology related to the invention may unnecessarily obscure the gist of the invention, the detailed description thereof will be omitted. Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram illustrating an image processing apparatus according to an embodiment for generating 3D content. The image processing apparatus 100 according to an embodiment may include a processor 110 , a memory 120 , a communication unit 130 , an input unit 140 , and an output unit 150 . The above configuration is exemplary, and some of the listed configurations may be omitted, and non-listed configurations may be further included.

The processor 110 controls the operation of the image processing apparatus 100 to perform an image processing method described below, at least one of the memory 120 , the communication unit 130 , the input unit 140 , and the output unit 150 . Each configuration of the image processing apparatus 100 including one may be controlled.

In an embodiment, the processor 110 is configured to include a first image representing an image of 3D content viewed at a first position on the 3D coordinate system, and a second image representing an image of 3D content viewed from a second position on the 3D coordinate system. can be obtained. The processor 110 detects a first boundary line indicating one boundary of the 3D content from a first image, detects a second boundary line indicating one boundary from a second image, and 3D using the first boundary line and the second boundary line A third boundary line representing one boundary in the coordinate system may be determined. Here, the third boundary line may be a virtual line expressed in a 3D coordinate system.

In another embodiment, the processor 110 may identify a target object included in the 3D content, and obtain a first image and a second image in which the target object is expressed. The processor 110 may detect a boundary line of the target object in the first image and the second image, and determine a virtual boundary line in the 3D coordinate system by using the detected boundary line.

The memory 120 may store program data and temporary data for operation of the image processing apparatus. Furthermore, the memory 120 may include 3D content data for performing an image processing method, 2D image data of 3D content generated at a location, and the like. Here, the 2D image data is additional information, and location information in the 3D coordinate system in which the 2D image is generated (eg, location information expressed by coordinates of the x-axis, y-axis, and z-axis), and camera information for generating a 2D image (eg angle of view, resolution) , color format, direction information of the camera angle of view, etc.).

The communication unit 130 may receive 3D content data, 2D image data, image generation information, control information, etc. from an external device by using an existing wireless/wired communication method under the control of the processor 110 , and send it to the external device. 3D content data, 2D image data, image generation information, control information, and the like may be transmitted.

The input unit 140 may include a keyboard, a mouse, a touch panel, and a user interface using the same for receiving a user input in order to perform an image processing method according to an embodiment.

The output unit 150 may include a display unit including a display panel, etc. to output information for querying a processing result or user input to a user to perform an image processing method according to an embodiment.

2 is a flowchart illustrating an image processing method performed by an image processing apparatus according to an exemplary embodiment. 3 is a conceptual diagram illustrating a positional relationship between a target object 310 and a plurality of cameras 320 surrounding the target object.

Hereinafter, a method for generating 3D content of a target object by an image processing apparatus performing an image processing method according to an embodiment will be described with reference to FIGS. 2 and 3 .

First, the image processing apparatus may acquire a first image and a second image of the target object 310 (S210). The first image may be an image of the target object 310 viewed from the first position 321 on the 3D coordinate system. For example, when the 3D coordinate system is a real space, the first image may be a 2D image generated by photographing the target object 310 with the first camera 321 located at any one position in the 3D coordinate system. For example, when the 3D coordinate system is a virtual 3D space, the first image may be a 2D image generated by photographing the target object 310 with a virtual first camera 321 located at any one position in the 3D coordinate system. there is. Similarly, the second image may be an image of the target object 310 viewed at the second position 322 on the 3D coordinate system. For example, the second image may be a 2D image generated by photographing the target object 310 with the second camera 322 located at any one position in the 3D coordinate system.

In an embodiment, the first position and the second position are different positions, and accordingly, the images of the object represented in the first image and the second image may be different from each other. For example, the first image may be illustrated as in FIG. 4A . The second image may be illustrated as in FIG. 5A .

Next, the image processing apparatus may detect the boundary of the target object 310 in the first and second images ( S220 ). The image processing apparatus according to an embodiment may recognize an object in an image using an object recognition algorithm. Furthermore, the boundary line of the target object appearing in the image may be detected by using the boundary identification algorithm to identify the boundary of the recognized object.

Meanwhile, the image processing apparatus according to an embodiment may detect the boundary line of the target object from the image based on the user input. To this end, the image processing apparatus according to an embodiment may display the first image on the display unit of the user terminal. Accordingly, the user may check the first image displayed on the display unit. In an embodiment, the user may input a user input for generating the first boundary line on the first image to the image processing apparatus. Accordingly, the image processing apparatus may acquire data representing the first boundary line generated on the first image. For example, the image processing apparatus may acquire data indicating the first boundary line according to a user input that causes the display unit to represent line segments.

When the processing of the first image is finished, the image processing apparatus according to an embodiment may display the second image on the display unit of the user terminal and acquire data indicating the second boundary line based on the user input thereto.

For this purpose, an embodiment of displaying the first and second images and receiving a user input therefor is shown in FIGS. 4 and 5 . FIG. 4(a) shows a first image and a user interface displayed on the first image, and FIG. 4(b) shows the concept of a user interface. FIG. 5A shows a second image and a user interface displayed on the second image, and FIG. 5B shows the concept of a user interface.

Hereinafter, an example of using the user interface for detecting the boundary line of the target object in the first image will be described with reference to FIG. 4 . In an embodiment, the image processing apparatus may express the first boundary line 430 on the first image displayed on the display unit based on a user input input through the user interface.

The user interface according to an embodiment may include a first controller 410 and a second controller 420 . The image processing apparatus according to an embodiment places the first controller 410 at a corresponding position when a user input for the empty space of the first image is obtained, and the user input for the empty space of the first image is re-acquired. In this case, the second controller 420 may be disposed at the corresponding position. Accordingly, the image processing apparatus may generate a first boundary line 430 passing through the first controller 410 and the second controller 420 as shown in FIG. 4B . In addition, the image processing apparatus may change the shape of the first boundary line 430 by changing the location of the controller according to a user input for changing the location of the controller.

In an embodiment, a starting point and an ending point of the boundary line may be set based on the location of the controller. The starting point and the ending point may be generated at a predetermined distance apart from the location of the controller, or may be generated at a location indicated by the controller. For example, as shown in FIG. 4B , the starting point 412 of the first boundary line 430 may be generated to be spaced apart from the location of the first controller 410 by a predetermined distance. The image processing apparatus according to an embodiment may indicate to the user the starting point 412 generated by the first controller 410 by displaying the first guide line 411 perpendicular to the first boundary line 430 through the display unit. there is. Here, the first guide line 411 may be a virtual line generated through the starting point 412 at the position 401 of the first camera.

Also, as shown in FIG. 4B , the end point 422 of the first boundary line 430 may be generated at the location of the second controller 420 . The image processing apparatus according to an embodiment may display the end point 422 generated by the second controller 420 to the user by displaying the second guide line 421 perpendicular to the first boundary line 430 through the display unit. there is. Here, the second guide line 421 may be a virtual line generated from the position 401 of the first camera through the end point 422 .

Meanwhile, as shown in FIG. 5B , the starting point 512 of the second boundary line 530 may be generated at the location of the first controller 510 . The image processing apparatus according to an embodiment may indicate to the user the starting point 512 generated by the first controller 510 by displaying the first guide line 511 perpendicular to the second boundary line 530 through the display unit. there is. Here, the first guide line 511 may be a virtual line generated through the starting point 512 at the location 501 of the second camera.

Also, the end point 522 of the second boundary line 530 may be generated to be spaced apart from the location of the second controller 520 by a predetermined distance. The image processing apparatus according to an embodiment may display the end point 522 generated by the second controller 520 to the user by displaying the second guide line 521 perpendicular to the second boundary line 530 through the display unit. there is. Here, the second guide line 521 may be a virtual line generated through the end point 522 at the location 501 of the second camera.

Next, the image processing apparatus may generate a projection surface in 3D space by using the boundary line of the target object detected in the first image and the second image (S230). 6 is a diagram for describing a method of generating, by an image processing apparatus, a virtual projection surface in a 3D space, according to an exemplary embodiment. As shown in FIG. 6 , the image processing apparatus according to an embodiment may generate a first projection surface in the 3D space by projecting the first boundary line into the 3D space.

For example, the image processing apparatus according to an embodiment may generate the first projection surface by projecting the first boundary line in the direction toward the target object from the first position, which is the position in the 3D where the first image is generated.

In more detail, in an embodiment in which the position 401 of the first camera photographing the first image is specified based on a three-dimensional coordinate system, and the position 310 of the target object is specified based on the three-dimensional coordinate system, the second The first projection surface may be generated by projecting the first boundary line generated according to the resolution of the first image at the position of the first camera toward the target object.

In this case, the first boundary line may be projected according to the shooting condition of the first image. For example, the first boundary line may be projected according to the angle of view information of the first image. In an embodiment, the first boundary line may be enlarged at a magnification ratio according to the angle of view information of the camera stored together with the first image and projected into the 3D space.

In the same way, the image processing apparatus according to an embodiment may generate the second projection surface in the 3D space by projecting the second boundary line into the 3D space.

Meanwhile, step S230 may be performed by determining a surface determined by the first guide line and the second guide line set for each image as the projection surface. The projection surface determined according to this may be defined as an expression method of the first and second guide lines. For example, the projection surface may be represented by a vector representation of the first and second guide lines.

In more detail, the image processing apparatus according to an embodiment may determine a surface defined by the first guide line 411 and the second guide line 421 for the first image as the first projection surface for the first image. In the same way, the image processing apparatus according to an embodiment may determine a surface defined by the first guide line 511 and the second guide line 521 for the second image as the second projection surface for the second image. .

Next, the image processing apparatus may determine a boundary line in the 3D space by using the intersection of the projection surfaces ( S240 ). 7 is a conceptual diagram illustrating a method of generating a boundary line using the intersection of the first projection surface 710 and the second projection surface 720 . As shown in FIG. 7 , the image processing apparatus determines the boundary line 730 generated by the intersection of the first projection surface 710 and the second projection surface 720 in the 3D space in the 2D image in step S220 in advance. It can be determined as a 3D boundary line in the 3D coordinate system for the boundary line.

As described above, the image processing apparatus may generate 3D content representing the target object in the 3D coordinate system by performing the method described above with respect to each boundary line representing the target object.

8 is a flowchart illustrating a method for updating 3D content by applying the above-described image processing method to 3D content generated in a virtual 3D space using an image processing apparatus according to an exemplary embodiment.

First, the image processing apparatus according to an embodiment may select a target object included in 3D content (S810). 9 illustrates 3D content according to an embodiment. 3D content according to an embodiment may be content generated using a 3D scanner as shown in FIG. 9 . The image processing apparatus according to an embodiment may determine the target object 910 based on a user input for selecting the target object 910 in 3D content. Alternatively, the image processing apparatus according to an embodiment may determine the target object 910 in the 3D content by using an object identification algorithm that identifies the target object 910 in the 3D content.

Next, the image processing apparatus according to an embodiment may acquire a plurality of 2D images of the selected object ( S820 ). As described above with reference to FIG. 3 , the image processing apparatus according to an embodiment may determine a plurality of 2D image generation positions in a virtual 3D space. This may be described as generating a plurality of virtual cameras in a virtual 3D space as described above. In this regard, hereinafter, the generation of the 2D image at the 2D image generation position will be described instead of the generation of the 2D image at the plurality of virtual camera positions.

The image processing apparatus according to an embodiment may generate a plurality of virtual cameras in a virtual 3D space based on a preset camera arrangement. In another embodiment, the image processing apparatus may generate a plurality of cameras in a virtual 3D space based on a user input.

The image processing apparatus according to an embodiment may generate a 2D image of a target object at a virtual camera position. The image processing apparatus according to an embodiment may generate an image according to a predetermined option. Here, the predetermined option may be a set of camera setting attributes for generating an image. For example, the predetermined option may include an angle of view, a resolution, and the like. Accordingly, the image processing apparatus according to an embodiment may match and store the image-generated additional information (eg, camera position, angle of view, resolution information, etc.) together with the 2D image to the 2D image as described above.

Next, as described above, the image processing apparatus according to an embodiment may detect the boundary of the object from the plurality of 2D images (S830). Next, the image processing apparatus according to an embodiment may select a boundary line indicating the same boundary line of the 3D content from among the detected boundary lines ( S840 ). The image processing apparatus according to an embodiment may select a boundary line indicating the same boundary line of 3D content by classifying the boundary lines detected from the plurality of 2D images based on whether the boundary lines of the corresponding 3D content are the same. The image processing apparatus according to another embodiment may determine whether or not the same boundary line of 3D content is displayed based on a user input.

Next, the image processing apparatus according to an embodiment may generate a boundary line of 3D content in a 3D space by generating a plurality of projection surfaces using a plurality of boundary lines selected as described above ( S850 ).

Next, the image processing apparatus according to an embodiment may generate a 3D object by generating a surface in the 3D space using the determined boundary line in the 3D space ( S860 ). It will be described in more detail with reference to FIG. 10 . In the image processing apparatus according to an embodiment, when the first boundary line 1010 and the second boundary line 1020 are identified in the three-dimensional space, one boundary line is extended toward the other boundary line (1011). (1030) can be created.

Next, the image processing apparatus according to an embodiment may modify 3D content by using the generated 3D object ( S870 ). The image processing apparatus according to an embodiment may modify 3D content by adding the 3D object 1110 generated as shown in FIG. 11 to the existing 3D content. The image processing apparatus according to an embodiment may modify the 3D content by removing the target object from the 3D content and adding the generated 3D object.

The image processing apparatus and the image processing method according to the embodiment described above may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the medium may be specially designed and configured according to the embodiment, or may be known and available to those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic such as floppy disks. - includes magneto-optical media, and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like.

Each of the drawings referenced in the description of the previous embodiment is merely an embodiment shown for convenience of description, and items, contents, and images of information displayed on each screen may be modified and displayed in various forms.

Although the present invention has been described with reference to an embodiment shown in the drawings, this is merely exemplary, and those of ordinary skill in the art will understand that various modifications and equivalent other embodiments are possible therefrom. Accordingly, the true technical protection scope of the present invention should be determined by the technical spirit of the appended claims.

Claims (15)

In the image processing method performed by the image processing apparatus,
obtaining a first image representing a 2D image of the 3D content observed at a first position in a 3D coordinate system and a second image representing a 2D image of the 3D content observed at a second position in the 3D coordinate system;
detecting a first boundary line indicating one boundary of the 3D content in the first image;
detecting a second boundary line indicating the one boundary in the second image; and
determining a third boundary line expressing the one boundary in 3D in the 3D coordinate system by using the first boundary line and the second boundary line,
a direction in which the 3D content is observed at the first position, a first 3D-boundary line in the first position of the 3D coordinate system corresponding to the first boundary line, a direction in which the 3D content is observed in the second position, and the An image processing method in which the third boundary line is determined based on a second 3D-boundary line at the second position of the 3D coordinate system corresponding to the second boundary line. The method of claim 1,
The step of determining the third boundary line,
generating a first projection surface by projecting the first 3D-boundary line in a direction in which the 3D content is observed at the first position;
generating a second projection surface by projecting the second 3D-boundary line in a direction in which the 3D content is observed at the second location; and
and determining the third boundary line based on the intersection of the first projection surface and the second projection surface.
3. The method of claim 2,
The step of generating the first projection surface,
An image processing method performed by projecting the first 3D-boundary line based on the angle of view information and resolution information of the first image.
The method of claim 1,
The step of detecting the first boundary line,
displaying the first image on a user terminal;
representing the first boundary line on a first image based on a user input; and
and detecting the first boundary line according to the expression of the first boundary line.
5. The method of claim 4,
Further comprising the step of modifying the first boundary line by changing the position of at least one point constituting the first boundary line according to the movement of the position of the indicator displayed in the terminal,
The indicator is an image processing method in which a position displayed on the terminal is changed according to a user input.
The method of claim 1,
and generating a boundary surface expressed in 3D in the 3D coordinate system by using the third boundary line.
7. The method of claim 6,
The boundary surface is an image processing method in which the third boundary line is generated by extending in a predetermined direction.
In the image processing method performed by the image processing apparatus,
identifying a target object in 3D content expressed in a 3D coordinate system;
obtaining a first image and a second image in which the target object is expressed in 2D;
detecting a boundary line of the target object in the first image and the second image; and
determining a boundary line of the target object expressed in 3D in the 3D coordinate system by using the detected boundary line,
The first image is a 2D image in which the target object is observed at a first position,
The second image is a 2D image in which the target object is observed at a second position,
A direction in which the 3D content is observed from the first position, a direction in which the 3D content is observed from the second position, and the 3D- An image processing method in which a boundary line of the target object expressed in 3D in the 3D coordinate system is determined based on the boundary line.
9. The method of claim 8,
The step of determining the boundary of the target object expressed in 3D comprises:
and determining a boundary line indicating the same boundary of the target object expressed in both the first image and the second image.
9. The method of claim 8,
and generating a boundary surface of the target object expressed in 3D in the 3D coordinate system by using the boundary line of the target object expressed in 3D.
11. The method of claim 10,
The image processing method further comprising the step of adding the generated boundary surface of the target object to the 3D content.
12. The method of claim 11,
An image processing method in which predetermined data corresponding to the generated boundary surface of the target object is removed from the 3D content, and then data on the generated boundary surface of the target object is added to the 3D content. In the image processing apparatus,
processor and memory;
The processor is
Obtaining a first image representing a 2D image of 3D content observed at a first position in a 3D coordinate system,
acquiring a second image representing a 2D image of the 3D content observed at a second position in the 3D coordinate system;
detecting a first boundary line indicating one boundary of the 3D content in the first image,
Detecting a second boundary line indicating the one boundary in the second image,
Determining a third boundary line expressing the one boundary in 3D in the 3D coordinate system using the first boundary line and the second boundary line,
a direction in which the 3D content is observed at the first position, a first 3D-boundary line in the first position of the 3D coordinate system corresponding to the first boundary line, a direction in which the 3D content is observed in the second position, and the and the third boundary line is determined based on a second 3D-boundary line at the second position of the 3D coordinate system corresponding to the second boundary line.
In the image processing apparatus,
processor and memory;
The processor is
Identify the target object in the 3D content,
Obtaining a first image and a second image in which the target object is expressed in 2D,
detecting a boundary line of the target object in the first image and the second image,
Determining a boundary line of the target object expressed in 3D in a 3D coordinate system using the detected boundary line,
The first image is a 2D image in which the target object is observed at a first position,
The second image is a 2D image in which the target object is observed at a second position,
A direction in which the 3D content is observed from the first position, a direction in which the 3D content is observed from the second position, and the 3D- An image processing apparatus for determining a boundary line of the target object expressed in 3D in the 3D coordinate system based on the boundary line.
A computer-readable recording medium in which a computer program for performing the method of claim 1 or 8 is recorded.

Images