KR20130095488A - Apparatus and method for providing three-dimensional model in the smart device - Google Patents

Abstract

The present invention relates to an apparatus and a method for providing a 3D model in a smart device that provides a virtual 3D model corresponding to a real object in the real world through augmented reality in the smart device to enable editing of the 3D model. will be.
The apparatus for providing a 3D model using augmented reality in a smart device according to the present invention includes: a marker including a preset rule; A database (DB) for storing a plurality of virtual three-dimensional models corresponding to the set rule of the marker; A camera mounted on a smart device and shooting a real environment and the marker; In the augmented reality mode in the smart device, when the camera photographs an object of the real environment including the marker, a plurality of three-dimensional models corresponding to the set rule of the marker are generated using the object image and the augmented reality of the real environment. A model providing unit for searching in the database and providing it to the display of the smart device; An input / selector for selecting one of a plurality of virtual three-dimensional models provided on the display of the smart device; And an editing unit for editing the shape and color of the 3D model.

Description

Apparatus and method for providing 3D models using augmented reality in smart devices {APPARATUS AND METHOD FOR PROVIDING THREE-DIMENSIONAL MODEL IN THE SMART DEVICE}

The present invention relates to an apparatus and method for providing a 3D model using augmented reality in a smart device, and in particular, to a virtual 3D model corresponding to a real object in the real world through augmented reality in a smart device, The present invention relates to an apparatus and a method for providing a 3D model in a smart device to enable editing.

Recently, technology development for smart devices that are not limited in function and that can change or expand a large part of functions through application programs are rapidly developing. Representative smart devices include smart phones and smart pads. With the development of such smart devices, Augmented Reality (AR), in which cameras and displays are mixed, is becoming more popular. Augmented reality is a technology that shows a 3D virtual image superimposed on the image of reality as a single image.

In the early stages of research, the methods of constructing augmented reality environment and registration problems for matching real objects with virtual objects were mainly focused on the transfer of knowledge about information that users could not actually feel. Beyond function, research is being conducted on various applications such as education, design, tourism, and industrial fields.

However, in the case of the prior art in the field of design, since there are still attempts to design a new three-dimensional model while acquiring a real image using a camera and directly checking the obtained real image, the same three-dimensional model as the actual product or structure. There is a limit to implementing the model. In this case, when a new three-dimensional model is applied based on the appearance of a specific product and designed, it is difficult to design a new three-dimensional model because the appearance of the specific product cannot be presented.

The present invention has been proposed in accordance with the requirements of the prior art, a smart device that can provide a virtual three-dimensional model corresponding to a real object through augmented reality in the smart device and can provide an editing function for the three-dimensional model In order to provide a 3D model providing apparatus and a providing method in the purpose.

Apparatus for providing a three-dimensional model using augmented reality in a smart device according to the present invention for achieving the above object,

A marker including a preset rule; A database (DB) for storing a plurality of virtual three-dimensional models corresponding to the set rule of the marker; A camera mounted on a smart device and shooting a real environment and the marker; In the augmented reality mode in the smart device, when the camera photographs an object of the real environment including the marker, a plurality of three-dimensional models corresponding to the set rule of the marker are generated using the object image and the augmented reality of the real environment. A model providing unit for searching in the database and providing it to the display of the smart device; An input / selector for selecting one of a plurality of virtual three-dimensional models provided on the display of the smart device; And an editing unit for editing the shape and color of the 3D model.

In the present invention, the virtual three-dimensional model is provided in a hexahedral, cylindrical, sphere-shaped frame.

In the present invention, the editing unit edits at least one of a radius, a high, a chamfer, and a color of the virtual three-dimensional model provided on the display.

In addition, the three-dimensional model providing method using augmented reality in a smart device according to the present invention for achieving the above object,

Photographing a marker including an object of a real environment and a preset rule using a camera mounted on the smart device; Searching for a 3D model corresponding to the rule of the marker together with an image of the object on a display of the smart device from a database storing a plurality of 3D models and displaying the same using an augmented reality application; Displaying an editing function for the three-dimensional model on the display; And editing at least one of a radius, a high, a chamfer, and a color of the displayed 3D model using the displayed editing function.

In the present invention, the three-dimensional model is represented by a hexahedron, cylinder, sphere-shaped frame.

According to the present invention, by providing an image of a real object through augmented reality in the smart device and by providing a virtual three-dimensional model corresponding to the shape (shape) of the real object to be able to design more easily for the real object.

In addition, according to the present invention can be provided by setting a plurality of virtual three-dimensional model according to the shape of the real object obtained through augmented reality in a smart device can be modified in various forms when implementing the design.

Furthermore, when the actual product is designed, the present invention can provide a more realistic and realistic feeling by providing a virtual three-dimensional model corresponding to the product.

1 is a block diagram of a three-dimensional model providing apparatus using augmented reality in a smart device according to an embodiment of the present invention.
Figure 2 is an illustration of a marker for implementing augmented reality in a smart device according to the present invention.
Figure 3 is an illustration of a three-dimensional model in a smart device according to the present invention.
4 is an exemplary view for providing a three-dimensional model in a smart device according to an embodiment of the present invention.
5 is a flow chart of a three-dimensional model providing method using augmented reality in a smart device according to an embodiment of the present invention.

As the inventive concept allows for various changes and numerous embodiments, particular embodiments will be illustrated in the drawings and described in detail in the written description. However, this is not intended to limit the present invention to the specific embodiments, it should be understood to include all changes, equivalents, and substitutes included in the spirit and scope of the present invention.

1 is a block diagram of a 3D model providing apparatus using augmented reality in a smart device according to an embodiment of the present invention.

Referring to FIG. 1, a 3D model providing apparatus 100 according to an exemplary embodiment of the present invention may include a marker 110, an input / selection unit 120, a camera 130, a model providing unit 140, The editor 150 includes a database (DB) 160 and a controller 170.

The marker 110 is a kind of artificially generated marker for realizing augmented reality, and the marker includes a preset rule. The marker 110 is intended to provide a virtual model according to augmented reality corresponding to a preset rule by reading with the camera 130. At this time, in the present embodiment, the marker 110 may be implemented as a character, a symbol, a figure, or a combination thereof, and the shape, size, arrangement, and color of the character, symbol, figure, or a combination thereof are formed according to a preset rule. Can be.

Here, the present invention is not limited to the artificial marker on the marker 110, but may be implemented as various objects. For example, it may be implemented as a natural object such as a book cover or a photograph. In another embodiment of the present invention, augmented reality may be implemented by reading the natural object with the camera 130 and correspondingly thereto. Furthermore, in another embodiment of the present invention, the marker 110 may also be implemented as an atypical object such as a finger.

The input / selection unit 120 is provided to receive various commands and information from a user in a smart device and select desired information and data. Thus, the user may input user information, application execution, various commands, and select a plurality of functions from the smart device using the input / selection unit 120. The input / selection unit 120 may be implemented with, for example, a keyboard, a touch pad, voice recognition, a mouse, a touch screen, and the like.

The database 160 stores a plurality of virtual three-dimensional models corresponding to the set rules of the marker 110. Such virtual three-dimensional models include various forms. For example, in the present embodiment, it may be provided in a hexahedron, cylinder, sphere-shaped frame.

The camera 130 is mounted on a smart device and shoots images and images of the surrounding environment. In particular, in the present embodiment, the object and the marker 110 of the real environment are simultaneously or selectively photographed.

When the model providing unit 140 captures an object of the real environment including the marker 110 by the camera 130 to implement augmented reality in the smart device, the marker 110 is set through the object image and the augmented reality of the real environment. The virtual 3D model corresponding to the rule is retrieved from the database 160 and provided to the display of the smart device. In other words, not only the objects existing in the real environment but also the 3D virtual model corresponding to the rule of the marker 110 are displayed on the display through augmented reality. Augmented reality is preferably implemented as an application (application) program in a smart device, in this embodiment it is preferable that the camera 130 is set to operate only in the technology for implementing augmented reality on the display. In this case, in order to implement an augmented reality application, a marker 110 capable of recognizing a specific code through the camera 130 is required.

The editing unit 150 is for editing the shape and color of the virtual three-dimensional model provided on the display of the smart device. The editor 150 may edit a radius, a high, a chamfer, a color, etc. of the 3D model provided on the display. This is to design a virtual three-dimensional model in a desired shape.

The controller 170 controls the overall operation of the smart device, and in particular, controls the operation of each functional unit for providing an augmented reality and virtual three-dimensional model according to the present embodiment.

Figure 2 is an illustration of a marker for implementing augmented reality in a smart device according to the present invention.

Referring to the example of FIG. 2, the marker 110 according to an embodiment of the present invention is implemented in a predetermined shape according to a preset rule. When the augmented reality application is executed in a smart device such that the marker 110 is photographed through the camera 130 to provide a virtual three-dimensional model corresponding to the marker 110 to the display of the smart device through augmented reality do. In FIG. 2, the marker 110 is illustrated as a plurality of black and white figures as an example, but in another embodiment, the marker 110 may be implemented as a letter or a symbol, and these may be implemented according to a preset rule of shape, size, arrangement, color, and the like. Is preferred.

Meanwhile, as described above, in another example of the present invention, the marker 110 may be implemented as a natural object such as a book cover, a photo, a picture, or the like in addition to a letter, a symbol, a figure, or a combination thereof, and an unstructured object such as a finger. Note that you can of course also implement.

3 is an exemplary diagram of a three-dimensional model in a smart device according to the present invention.

Figure 3 (a) is an illustration of a three-dimensional model, (b) is an illustration of a virtual three-dimensional model displayed on a smartphone, (c) is a virtual three displayed through augmented reality on the smart pad An illustration of the dimensional model.

First, in Figure 3 (a) is a three-dimensional model for displaying through augmented reality in a smart device, the shape of the three-dimensional model is a basic frame of the object image of the real environment to be designed. These three-dimensional models are provided in, for example, hexahedral, cylindrical, sphere-shaped frames, each classified by product, environment, and control category. For example, since the three-dimensional model indicated by 31 has a basic shape corresponding to the mobile phone, it can be used to design a mobile phone. Also, the three-dimensional model indicated by 32 denotes a basic shape corresponding to the washing machine. Can be used. As described above, each of the three-dimensional models corresponding to the existing objects can be variously edited such as rotation, processing, modification, deletion, and addition for designing in a smart device.

3 (b) shows a selected one of a plurality of three-dimensional models displayed on the right side as a virtual three-dimensional model displayed on an actual smartphone. Such three-dimensional models can be applied, for example, when designing waste bins, bollards, street lamps, telescopes and the like.

3C illustrates an example of photographing the marker 110 on an actual smart pad and executing an augmented reality application to display a virtual 3D model corresponding to the set rule of the marker 110. Referring to (c) of FIG. 3, three mobile phones 31a, 32a, 33a and markers 110 are placed in a real environment, and are photographed using a camera (not shown) of the smart device 34. . In this case, three images of the mobile phones 31a, 32a, and 33a are displayed on the display of the smart device 34, and the three-dimensional model 310 of the marker 110 through augmented reality. It can be seen that the ().

Meanwhile, in the present embodiment, it is preferable that a plurality of three-dimensional models are classified by categories of products, environments, and controls, respectively. Such products, environments and controls are preferably based on shapes used in everyday life. For example, the category of the product includes TV, computer, kitchen appliances, household appliances, digital device-shaped frame, the environmental category includes amenities, supply facilities, information carrier-shaped frame, the category of control is dial, It includes a button and a slide-shaped frame. Of course, the present invention is not limited thereto and may further include a frame having various shapes.

4 is an exemplary diagram of a three-dimensional model edited in a smart device according to an embodiment of the present invention.

Referring to FIG. 4, a basic three-dimensional model is displayed on the left side, and the result of editing on the right side is shown. You can see that the A part on the left is modified to A 'on the right. Such editing can be implemented through the application. In this embodiment, at least one or more of a radius, a high, a chamfer, and a color may be edited. In FIG. 4, as an example, A is edited using an editing function of a chamfer. An example of performing an edit such as' is shown.

5 is a flowchart illustrating a 3D model providing method using augmented reality in a smart device according to an embodiment of the present invention.

Referring to FIG. 5, in the method for providing a 3D model using augmented reality in a smart device according to the present invention, the augmented reality application is executed in a smart device (S101), and a camera 130 mounted on the smart device is actually used. In operation S103, a marker 110 including an object of an environment and a preset rule is photographed.

The image of the object and the marker 110 photographed as described above is differently displayed on the display of the smart device. The image of the object is displayed as it is for the object of the real environment, but the marker 110 corresponds to the preset rule 3. The dimensional model is displayed (S105). This is preferably implemented by the execution of the augmented reality application pre-installed on the smart device. Since the augmented reality application and implementation technology is a known technology, a detailed description thereof will be omitted. Here, the display process of the three-dimensional model using augmented reality to retrieve and display the three-dimensional model corresponding to the rule from the database (DB) 160, which stores a plurality of three-dimensional models in advance. In this embodiment, the three-dimensional model is preferably represented by a hexahedron, cylinder, sphere-shaped frame.

Subsequently, the display of the smart device displays at least one or more editing functions for the displayed three-dimensional model (S107). In the present embodiment, for example, at least one or more editing functions of a radius, a height, a chamfer, and a color of the 3D model are provided. Subsequently, the 3D model is edited using the displayed editing function (S109).

While the invention has been shown and described with reference to certain preferred embodiments thereof, it is to be understood that the invention is not limited to the disclosed embodiments. Those skilled in the art will appreciate that various modifications, additions and substitutions are possible, without departing from the scope of the appended claims, The genius will be so self-evident. Accordingly, the true scope of the present invention should be determined by the technical idea of the appended claims.

Recently, research on augmented reality technology has been conducted in various applications such as education, design, tourism, and industrial fields. Especially in the design field, when designing a new product or application while checking the objects in the real environment, the product is designed more accurately, easily and conveniently by designing while checking the objects in the real environment and the virtual three-dimensional model provided through augmented reality. I can design it.

In view of this aspect, the present invention makes it easy to design by providing a virtual three-dimensional model corresponding to the shape (shape) of the object and the object image of the real environment through augmented reality in a smart device. Therefore, the present invention can be very usefully applied in the field of industrial design.

110: marker 120: input / selection
130: camera 140: model providing unit
150: editing unit 160: database (DB)
170:

Claims (5)

A marker including a preset rule;
A database (DB) for storing a plurality of virtual three-dimensional models corresponding to the set rule of the marker;
A camera mounted on a smart device and shooting a real environment and the marker;
In the augmented reality mode in the smart device, when the camera photographs an object of the real environment including the marker, a plurality of three-dimensional models corresponding to the set rule of the marker are generated using the object image and the augmented reality of the real environment. A model providing unit for searching in the database and providing it to the display of the smart device;
An input / selector for selecting one of a plurality of virtual three-dimensional models provided on the display of the smart device; And
An editing unit for editing the shape and color of the 3D model; 3D model providing apparatus using augmented reality in a smart device comprising a. The method of claim 1,
The virtual three-dimensional model is a three-dimensional model providing apparatus using augmented reality in a smart device, characterized in that provided in the frame of the cube, cylinder, sphere. The method of claim 1, wherein the editing unit,
Using augmented reality in a smart device characterized in that for editing at least one or more of the radius (radius), high (high), chamfer (color) of the virtual three-dimensional model provided on the display 3D model providing device. Photographing a marker including an object of a real environment and a preset rule using a camera mounted on the smart device;
Searching for a 3D model corresponding to the rule of the marker together with an image of the object on a display of the smart device from a database storing a plurality of 3D models and displaying the same using an augmented reality application;
Displaying an editing function for the three-dimensional model on the display; And
Editing at least one of a radius, a high, a chamfer, and a color of the displayed 3D model using the displayed editing function; 3D model providing method using augmented reality in a smart device comprising a. 5. The method of claim 4,
The three-dimensional model is a cube, cylinder, sphere (sphere) frame characterized in that the three-dimensional model providing method using augmented reality in a smart device characterized in that the frame.

Images