KR102238193B1 - Method and server for managing construction information and maintenance information based on augmented reality - Google Patents

Abstract

A method for managing at least some of construction information and maintenance information based on augmented reality, the method comprising: (a) (i) an individual space within the building specified by at least one of a building's building, arc, floor, and room Space information, which is information about the space, (ii) public type information for each part in the individual spaces, and (iii) activity information corresponding to the public type information are obtained from the user terminal to the user terminal. When a request for augmented reality information for a specific area in specific spatial information on the live-action image captured by is obtained, the construction information management server checks a specific individual space in which the user terminal is located by referring to the location information in which the user terminal is located. The step of doing; And (b) the construction information management server, among the construction type information and the activity information corresponding to the specific individual space, writes specific construction type information and specific activity information for the specific part corresponding to the live-action image. Classified according to a set category, and transmits selection menus for the specific public type information and the specific activity information classified according to the preset category to the user terminal, thereby causing the user terminal to render the selection menus, and the A method including, and a construction information management server using the same, supporting selection menus to display an augmented reality screen by overlapping the live image.

Description

A method of managing construction information and maintenance information based on augmented reality, and a server using it {METHOD AND SERVER FOR MANAGING CONSTRUCTION INFORMATION AND MAINTENANCE INFORMATION BASED ON AUGMENTED REALITY}

The present invention relates to a method for managing construction information and maintenance information based on augmented reality, and a construction information management server using the same.

Buildings are divided into unique sub-spaces such as buildings, houses, floors, and rooms, and numerous construction methods must be applied sequentially in each sub-space according to the design documents and specifications in order to properly perform the construction work.

In this construction process, not only construction photos and construction videos, but also various inspection documents and quality control documents should be prepared for each construction stage. Such documents may include checklists, quality control registers, test reports, material approval certificates, design change registers, construction diaries, supervision diaries, building codes, various certification standards related to construction, and building maintenance checklists.

However, when a large number of documents are written in a large amount by each construction type according to the Building Law and Construction Technology Promotion Law as described above, there is a problem that it is difficult to carry the documents in an actual construction site.

Accordingly, when the inspection is performed on a specific construction site, it is very difficult to search design drawings or other documents immediately in order to grasp the progress of the past construction type.

In order to improve this problem, a method of converting paper documents into electronic documents and searching them through a portable terminal has been used. For example, a method of integrated management of a construction site using a construction site management application is disclosed in Korean Patent Registration No. 10-1829169.

However, in the above scheme, there is a problem in that it is difficult to easily search for appropriate data due to the complex structure of the construction site.

For example, in the case of an apartment construction site in a large complex, there are numerous construction-related electronic documents corresponding to thousands of detailed spaces, but there is still a problem in that it is difficult to easily search and modify a specific electronic document among a large number of electronic documents.

Therefore, there is a need for an improvement method to solve the above problems.

KR 10-1829169 B1

An object of the present invention is to solve all of the above-described problems.

In addition, another object of the present invention is to display spatial information, construction type information, and activity information about individual spaces in a complex construction site in augmented reality by referring to location information of a user terminal, and the like.

In addition, another object of the present invention is to display in augmented reality so that existing design information for a building and actual construction information can be compared with each other.

In addition, another object of the present invention is to detect a specific area where construction has been made and to display the detection result in augmented reality.

In addition, another object of the present invention is to allow process instruction information to be shared through augmented reality regardless of the distance from the construction site or the building to be maintained.

In addition, another object of the present invention is to facilitate the maintenance of the building even after the building is completed by allowing the information on the existing process to be easily searched.

In order to achieve the object of the present invention as described above and to realize the characteristic effects of the present invention to be described later, the characteristic configuration of the present invention is as follows.

According to an aspect of the present invention, in a method for managing at least some of construction information and maintenance information based on augmented reality, (a) (i) at least one of a building, a building, a floor, a floor, and a room In a state in which spatial information, which is information about individual spaces in the building specified by, (ii) work type information for each part in the individual spaces, and (iii) activity information corresponding to the work type information, are acquired. , When a request for augmented reality information for a specific area in specific spatial information on the live-action image captured by the user terminal is obtained from the user terminal, the construction information management server refers to the location information where the user terminal is located, and the user terminal Identifying a specific individual space in which it is located; And (b) the construction information management server, among the construction type information and the activity information corresponding to the specific individual space, writes specific construction type information and specific activity information for the specific part corresponding to the live-action image. Classified according to a set category, and transmits selection menus for the specific public type information and the specific activity information classified according to the preset category to the user terminal, thereby causing the user terminal to render the selection menus, and the Disclosed is a method comprising: supporting selection menus to display an augmented reality screen by overlapping the live image.

As an example, (c) when a selection signal for a specific selection menu corresponding to any one of the specific construction information and the specific activity information among the selection menus is obtained from the user terminal, the construction information management server, Specific design information and specific construction information corresponding to any one of specific construction type information and specific activity information corresponding to the specific selection menu are transmitted to the user terminal, and the user terminal causes the specific design information and the specific construction information. The method further comprises a step of rendering the specific design information and the specific construction information to be superimposed on the live-action image to display an augmented reality screen.

As an example, when a detection menu for detecting the specific part is selected among the selection menus, the construction information management server (i) analyzes the live-action image corresponding to the specific part obtained from the user terminal, and the Generates new detection information for a specific region, checks a reference value corresponding to the specific region by referring to the specific design information, and transmits the new detection information and the reference value to the user terminal to cause the user terminal to And rendering the new detection information so that the reference value and the new detection information are superimposed on the real image to display an augmented reality screen.

As an example, in the step (a), characterized in that the construction information management server obtains the location information where the user terminal is located by referring to at least one of GPS information and an augmented reality marker for the user terminal. The method is disclosed.

As an example, a method is disclosed, wherein the category includes at least document information, drawing information, image information, and detection information.

As an example, (d) the construction information management server, (i) when a process monitoring request is obtained from the user terminal, transmits the live-action image captured by the user terminal obtained from the user terminal to a monitoring terminal, or Allows the user terminal to transmit the live-action image to the monitoring terminal, and (ii) transmits process instruction information for a specific region among the arbitrary regions of the live-action image obtained from the monitoring terminal to the user terminal, or Allows a monitoring terminal to transmit the process instruction information to the user terminal, causes the user terminal to render a markup corresponding to the process instruction information, and displays an augmented reality screen by superimposing the markup on the live image The method further comprising: assisting to do so is disclosed.

As an example, when process instruction voice information corresponding to the process instruction for the specific area of the live-action image is additionally obtained from the monitoring terminal, the construction information management server causes the user terminal to perform the markup. Disclosed is a method characterized in that the process instruction audio information is output while displaying an augmented reality screen superimposed on an image.

As an example, the construction information management server, a construction information structure including at least one unit cube cell consisting of a unit space, a unit construction type, and a unit time by referring to each of the spatial information and the construction type information of each of the activity information A spatial axis in which the spatial information is arranged on a first axis of the 3D axis, a co-type axis in which the spatial information is arranged on a second axis of the 3D axis, and a time in which the time information is arranged on a third axis of the 3D axis By arranging the construction information structures in a specific area of the three-dimensional construction information posting space consisting of axes and generating a three-dimensional construction information cube in the three-dimensional construction information posting space, the user terminal causes the three-dimensional construction information Disclosed is a method comprising displaying the spatial information, the public type information, and the activity information through a cube.

According to another aspect of the present invention, there is provided a construction information management server for managing at least some of construction information and maintenance information based on augmented reality, comprising: at least one memory for storing instructions; And at least one processor configured to execute the instructions, wherein the processor includes: (1) (i) in individual spaces within the building specified by at least one of a building, a floor, a floor, and a room. Space information, which is information related to, (ii) public type information for each part in the individual spaces, and (iii) activity information corresponding to the public type information is acquired from the user terminal by the user terminal. A process of checking a specific individual space in which the user terminal is located by referring to the location information in which the user terminal is located when a request for augmented reality information is obtained for a specific area in the specific spatial information on the live-action image; And (2) among the public type information and the activity information corresponding to the specific individual space, specific public type information and specific activity information for the specific part corresponding to the live image are classified according to a preset category, By transmitting the selection menus for the specific contribution information and the specific activity information classified according to the preset category to the user terminal, the user terminal renders the selection menus, and the selection menus are displayed on the live image. A construction information management server is disclosed that executes the instructions for performing a process of supporting overlapping and displaying an augmented reality screen.

As an example, (3) when the processor obtains a selection signal for a specific selection menu corresponding to any one of the specific contribution information and the specific activity information among the selection menus from the user terminal, the specific selection By transmitting specific design information and specific construction information corresponding to any one of specific construction type information and specific activity information corresponding to a menu to the user terminal, the user terminal renders the specific design information and the specific construction information. A process for supporting the display of an augmented reality screen by superimposing the specific design information and the specific construction information on the live image is disclosed.

As an example, the processor, when a detection menu for detecting the specific region among the selection menus is selected, (i) analyzes the live-action image corresponding to the specific region acquired from the user terminal, and It generates new detection information for, and checks a reference value corresponding to the specific part by referring to the specific design information, and transmits the new detection information and the reference value to the user terminal to cause the user terminal to generate the reference value and the new Disclosed is a construction information management server, which supports to display an augmented reality screen by superimposing the reference value and the new detection information on the live image by rendering detection information.

As an example, the processor, in the process (1), by referring to at least one of GPS information and an augmented reality marker for the user terminal to obtain the location information where the user terminal is located, characterized in that the construction information management The server is started.

As an example, a construction information management server is disclosed, wherein the category includes at least document information, drawing information, image information, and detection information.

As an example, (4) the processor, (i) when a process monitoring request is obtained from the user terminal, transmits the live image captured by the user terminal obtained from the user terminal to the monitoring terminal, or the user terminal Allows the user to transmit the live image to the monitoring terminal, and (ii) transmit process instruction information for a specific region among the arbitrary regions of the live image obtained from the monitoring terminal to the user terminal, or the monitoring terminal Transmitting the process instruction information to the user terminal, causing the user terminal to render a markup corresponding to the process instruction information, and supporting the display of an augmented reality screen by superimposing the markup on the live image A construction information management server further comprising a process is disclosed.

As an example, when the process instruction voice information corresponding to the process instruction for the specific region of the live image is additionally obtained from the monitoring terminal, the processor causes the user terminal to superimpose the markup on the live image. Thus, a construction information management server is disclosed, characterized in that it outputs the process instruction voice information while displaying an augmented reality screen.

As an example, the processor generates construction information structures including at least one unit cube cell consisting of a unit space, a unit type of work, and a unit time by referring to the spatial information and the work type information of each of the activity information, and , A spatial axis in which the spatial information is arranged on a first axis of the 3D axis, a co-type axis in which the public type information is arranged on a second axis of the 3D axis, and a time axis in which the time information is arranged on a third axis of the 3D axis. By arranging the construction information structures in a specific area of the 3D construction information posting space to generate a 3D construction information cube in the 3D construction information posting space, the user terminal can use the 3D construction information cube. A construction information management server is disclosed that displays the spatial information, the construction type information, and the activity information.

In addition to this, a computer-readable recording medium for recording a computer program for executing the method of the present invention is further provided.

The present invention has the effect of displaying spatial information, construction type information, and activity information about individual spaces in a complex construction site in augmented reality by referring to location information of a user terminal, and the like.

In addition, the present invention has the effect of displaying in augmented reality so that existing design information for a building and actual construction information can be compared with each other.

In addition, the present invention has the effect of detecting a specific area where construction has been made and displaying the detection result in augmented reality.

In addition, the present invention has the effect of allowing process instruction information to be shared through augmented reality regardless of the distance from the construction site or the building to be maintained.

In addition, the present invention has the effect of facilitating maintenance of the building even after the building is completed by allowing the information on the existing process to be easily searched.

The accompanying drawings, which are attached to be used in the description of the embodiments of the present invention, are only some of the embodiments of the present invention, and those of ordinary skill in the art to which the present invention pertains (hereinafter, "ordinary technician") Other drawings can be obtained based on these drawings without any further work being done.
1 schematically illustrates a construction information management server, a user terminal, and a monitoring terminal for managing at least some of construction information and maintenance information based on augmented reality according to an embodiment of the present invention,
2 schematically shows at least one construction information structure including at least one cube cell according to an embodiment of the present invention,
3 is a spatial axis in which spatial information is arranged on a first axis of a three-dimensional axis, a co-kind axis in which co-ordinate information is arranged on a second axis of a three-dimensional axis, and time information on a third axis of the three-dimensional axis according to an embodiment of the present invention It schematically shows the arrangement of construction information structures in a specific area of the 3D construction information posting space consisting of the listed time axes,
4A to 4C schematically illustrate a state in which specific service information and specific activity information are superimposed and displayed on a live image according to an embodiment of the present invention.
5 schematically shows a state in which an augmented reality screen is displayed by superimposing new detection information and a reference value on a live image according to an embodiment of the present invention.
6 schematically illustrates an augmented reality screen displayed by superimposing a markup corresponding to process instruction information on a live image according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE INVENTION The detailed description of the present invention to be described below refers to the accompanying drawings, which illustrate specific embodiments in which the present invention may be practiced in order to clarify the objects, technical solutions, and advantages of the present invention. These embodiments are described in detail sufficient to enable a person skilled in the art to practice the present invention.

Further, throughout the detailed description and claims of the present invention, the word "comprises" and variations thereof are not intended to exclude other technical features, additions, components or steps. Other objects, advantages, and features of the present invention to those skilled in the art will appear, in part, from this description, and in part from the practice of the present invention. The examples and drawings below are provided by way of example and are not intended to limit the invention.

Moreover, the present invention covers all possible combinations of the embodiments indicated herein. It should be understood that the various embodiments of the present invention are different from each other, but need not be mutually exclusive. For example, specific shapes, structures, and characteristics described herein may be implemented in other embodiments without departing from the spirit and scope of the present invention in relation to one embodiment. In addition, it should be understood that the location or arrangement of individual components within each disclosed embodiment may be changed without departing from the spirit and scope of the present invention. Accordingly, the detailed description to be described below is not intended to be taken in a limiting sense, and the scope of the present invention, if appropriately described, is limited only by the appended claims, along with all ranges equivalent to those claimed by the claims. Like reference numerals in the drawings refer to the same or similar functions over several aspects.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings in order to enable those of ordinary skill in the art to easily implement the present invention.

1 schematically illustrates a construction information management server 110, a user terminal 120, and a monitoring terminal 130 for managing at least some of construction information and maintenance information based on augmented reality according to an embodiment of the present invention. 1, the construction information management server 110 is a memory 111 and a memory 111 for storing instructions for managing at least some of construction information and maintenance information based on augmented reality. It may include a processor 112 that performs an operation of managing at least some of the construction information and maintenance information based on augmented reality in response to the instructions stored in the.

Specifically, the construction information management server 110 is typically a computing device (e.g., a computer processor, memory, storage, input device and output device, a device that may include components of other existing computing devices; routers, switches, etc.) Using a combination of the same electronic communication device; electronic information storage systems such as network attached storage (NAS) and storage area networks (SAN)) and computer software (i.e., instructions that cause the computing device to function in a specific way). It may be to achieve the desired system performance.

In addition, the processor of the computing device may include a hardware configuration such as a micro processing unit (MPU) or a central processing unit (CPU), a cache memory, and a data bus. In addition, the computing device may further include an operating system and a software configuration of an application that performs a specific purpose.

However, it is not excluded that the computing device includes an integrated processor in which a medium, a processor, and a memory are integrated for implementing the present invention.

On the other hand, the user terminal 120 is based on augmented reality in response to the instructions stored in the memory 121 and the memory 121 storing instructions for managing at least some of the construction information and maintenance information based on augmented reality. Thus, it may include a processor 122 that performs an operation to manage at least some of the construction information and maintenance information.

Specifically, user terminal 120 is typically a computing device (e.g., a computer processor, memory, storage, input device and output device, a device that may include components of other existing computing devices; electronic devices such as routers, switches, etc.) Communication device; desired system using a combination of electronic information storage systems such as network attached storage (NAS) and storage area networks (SAN)) and computer software (i.e., instructions that cause the computing device to function in a specific way) It may be to achieve performance.

In addition, the processor of the computing device may include a hardware configuration such as a micro processing unit (MPU) or a central processing unit (CPU), a cache memory, and a data bus. In addition, the computing device may further include an operating system and a software configuration of an application that performs a specific purpose.

However, it is not excluded that the computing device includes an integrated processor in which a medium, a processor, and a memory are integrated for implementing the present invention.

On the other hand, the monitoring terminal 130 is based on augmented reality construction information and maintenance information based on augmented reality in response to the memory 131 for storing instructions for managing construction information and the instructions stored in the memory 131. It may include a processor 132 that performs an operation of managing at least some of them.

Specifically, the monitoring terminal 130 is typically a computing device (e.g., a device that may include components of a computer processor, memory, storage, input and output devices, and other existing computing devices; electronic devices such as routers, switches, etc. Communication device; desired system using a combination of electronic information storage systems such as network attached storage (NAS) and storage area networks (SAN)) and computer software (i.e., instructions that cause the computing device to function in a specific way) It may be to achieve performance.

In addition, the processor of the computing device may include a hardware configuration such as a micro processing unit (MPU) or a central processing unit (CPU), a cache memory, and a data bus. In addition, the computing device may further include an operating system and a software configuration of an application that performs a specific purpose.

However, it is not excluded that the computing device includes an integrated processor in which a medium, a processor, and a memory are integrated for implementing the present invention.

A method of managing at least some of construction information and maintenance information using the construction information management server 110, the user terminal 120, and the monitoring terminal 130 according to an embodiment of the present invention configured as described above will be described. As follows.

For reference, in the drawings, for convenience of explanation, an augmented reality screen is displayed through a head mounted display or a handheld display, but the present invention is not limited to the corresponding devices, and any device capable of displaying an augmented reality screen is used in the present invention. The following treatment can be performed.

First, spatial information, which is information on individual spaces within the building specified by at least one of the building's building, arc, floor, and room, construction information for each part in the individual spaces, and construction information corresponding to the construction type information. Activity information can be obtained.

At this time, the information on the type of work for each part in individual spaces may include information on foundation work, temporary construction work, frame work, masonry work, masonry work, tile work, plaster work, and the like. However, the construction type information is not limited to the above examples, and any number of construction types that can be applied to buildings at the construction site may be included.

In addition, activity information corresponding to the construction type information may include information on a specific construction status for each construction type.

For example, the activity information regarding tile construction in a specific space may include information on the work status of tile construction performed on a specific space from January 5, 2020 to January 19, 2020.

As another example, the activity information regarding tile construction in a specific space may also include information on the inspection performed on January 20, 2020 by a specific supervisor for a specific space where the tile construction work has been completed.

That is, the activity information may include not only construction information before completion of the building, but also maintenance information after completion, and may include any number of information on specific actions performed by time/type of construction for a specific space. For example, it may include at least one of technical information, inspection information, defect information, photo information, video information, cost information, safety information, design information, and maintenance information. In addition, various contracts and contract details may be included in the activity information.

And, as shown in Figure 2, the construction information management server 110, a unit consisting of a unit space, a unit type of work, and a unit time by referring to each of the spatial information, construction type information, and time information of each of the activity information Construction information structures 201, 202, 203, and 204 including at least one cube cell may be generated. Here, the cube cell may mean a minimum unit for generating a construction information structure.

As can be seen through FIG. 2, the construction information structure may have various shapes according to spatial information, construction type information, and activity information.

As an example, when the construction information structure for the reinforcement work made for a specific period for 5 stories above the ground has a shape of a square bar, the construction information structure for the reinforcement work made for the 6th and 7th floor above the ground for a specific period is 5 above the ground. It may have a shape of a square bar having twice the width of the construction information structure for the floor.

And, the construction information management server 110, the spatial axis in which the spatial information is arranged on the first axis of the three-dimensional axis, the construction type axis in which the construction type information is arranged on the second axis of the three-dimensional axis, and the time information on the third axis of the three-dimensional axis. By creating a 3D construction information cube 200 in a construction information database by arranging construction information structures in a specific area of the 3D construction information posting space consisting of the listed time axis, the user terminal 120 can perform 3D construction. Spatial information, public type information, and activity information may be displayed through the information cube 200.

At this time, the construction information structures may have different areas to be arranged according to spatial information, construction type information, and activity information. In FIG. 3, a plurality of construction information structures are arranged to generate one 3D construction information cube 200. It shows the appearance.

For example, for specific construction information made for each part of Building 105 Room 401 from January 5, 2020 to January 12, 2020, the color of the specific cube and the location of the specific cube on the 3D construction information cube 200 Using, it is possible to display information on a specific construction performed in a specific period for a specific space.

On the other hand, in the state in which spatial information, public type information, and activity information are obtained as above, a request for augmented reality information for a specific area within specific spatial information on the live-action image captured by the user terminal 120 is sent to the user terminal 120. When obtained from, the construction information management server 110 may check a specific individual space in which the user terminal 120 is located by referring to the location information in which the user terminal 120 is located.

Here, the construction information management server 110 may obtain location information where the user terminal 120 is located by referring to at least one of GPS information and an augmented reality marker for the user terminal 120.

In this case, when the location information of the user terminal 120 is acquired through GPS information, there is a convenience in that there is no need to go through a process of generating a separate marker for acquiring the location information of the user terminal 120. In addition, there is an advantage in that the marker can be recognized quickly and accurately even with a simple algorithm. Therefore, it is not limited to using only one of the GPS information and the augmented reality marker, but it may be advantageous to use them properly.

For example, when construction is performed in a place where GPS information is not received smoothly, such as a basement, the augmented reality marker may be used alone, or the accurate location information of the user terminal 120 may be obtained by using the GPS information and the augmented reality marker together. I can.

Additionally, information on the direction in which the camera lens of the user terminal is directed may be obtained by a direction sensor, a gravity sensor, a geomagnetic sensor, or the like of the user terminal 120.

In addition, when a specific individual space in which the user terminal 120 is located is identified, the construction information management server 110, among the work type information and activity information corresponding to the specific individual space, for a specific part corresponding to the live image. The user terminal 120 classifies specific construction type information and specific activity information according to a preset category, and transmits selection menus for specific construction type information and specific activity information classified according to the preset category to the user terminal 120. ) To render the selection menus and to display the augmented reality screen by superimposing the selection menus on the live image.

At this time, the category may include at least document information, drawing information, image information, and detection information.

As an example, FIG. 4A shows specific work type information and specific activities for a specific part on the live image in a state in which a live image of the user's surrounding environment, for example, a rebar reinforcement work site, is output through a head mounted display mounted by the user. The information is classified into categories such as drawings, galleries, and documents, and is displayed overlaid on a live image.

Specifically, documents such as a supervision journal for each work type may be classified into a document category, supervision photos for a specific region may be classified as a gallery category, and drawings for a specific region may be classified as a drawing category.

On the other hand, while construction type information and activity information corresponding to a specific individual space can be checked through augmented reality during construction as shown in FIG. 4A, construction type information corresponding to a specific individual space for reasons such as maintenance even after construction is completed. Field and activity information can be checked through augmented reality.

As an example, FIG. 4B shows specific construction type information and specific activity information for a specific part appearing in the live image in a state in which a live image of a user's surrounding environment, such as a completed apartment living room, is output through the user's tablet PC. It is classified into categories of and the selection menus for it are superimposed on the live-action image and displayed in augmented reality.

Specifically, in FIG. 4B, 32 construction information classified as a drawing corresponding to an apartment living room, 115 construction information classified as a document corresponding to an apartment living room, and construction information classified as a picture corresponding to an apartment living room You can see the display as there are 20.

In addition, in a situation in which selection menus such as drawings, galleries, documents, inspections, safety, etc. are displayed as shown in FIG. 4B, when a user selects a specific selection menu, sub-information corresponding to the selection menu may be displayed as shown in FIG. 4C.

Specifically, when a user selects a document menu from a selection menu such as a drawing or a gallery document through an augmented reality environment, detailed documents corresponding to the living room of the apartment in which the user is located, such as a photo mount, a checklist, and a supervision journal Etc. are displayed as sub-information corresponding to the document menu, which is superimposed on the live image.

In addition, it is not limited to querying the previously acquired construction information corresponding to the specific individual space, but it is also possible to update new construction information corresponding to the specific individual space by selecting a document creation menu or the like.

For example, when a defect occurs due to water leakage in a specific part of an apartment living room, a range in which leakage may occur may be specified by querying the previously stored construction information. Accordingly, when the defect repair is actually completed, new information indicating that the defect repair has been performed for a specific part may be updated.

Accordingly, before completion, it is possible to check from time to time whether the progress of the construction is accurately performed according to the design document, and after completion, accurate defect repair work can be performed based on the accumulated design information and inspection information for each specific individual space. do.

On the other hand, when a selection signal for a specific selection menu corresponding to any one of specific construction type information and specific activity information among selection menus is obtained from the user terminal 120, the construction information management server 110 Specific design information and specific construction information corresponding to any one of specific construction type information and specific activity information corresponding to are transmitted to the user terminal 120 to cause the user terminal 120 to render specific design information and specific construction information. Thus, it is possible to support the display of an augmented reality screen by superimposing specific design information and specific construction information on a live image.

For example, while it was initially designed to construct 10 5m long boiler hot water pipes for a specific individual space, in reality, 8 5m long boiler hot water pipes and 3 3m long boiler hot water pipes according to the site situation. The construction situation can be assumed.

In such a case, the construction information management server 110 allows the user terminal 120 to (i) provide information indicating a plan to construct 10 boiler hot water pipes with a length of 5 m as specific design information, and (ii) 5 m as specific construction information. It is possible to support the display of an augmented reality screen by superimposing each of the information indicating that 8 boiler hot water pipes of length and 3 boiler hot water pipes of 3 m length were actually constructed on a live-action image for a specific individual space.

Accordingly, the user can easily compare and analyze information inconsistency between the design information and the actual construction result at the construction site through the augmented reality screen.

In addition, when a detection or inspection menu for detecting a specific part of the selection menu is selected, the construction information management server 110 (i) analyzes the live-action image corresponding to the specific part obtained from the user terminal 120 It creates new detection information for a specific area, checks a reference value corresponding to a specific area by referring to specific design information, and transmits the new detection information and reference value to the user terminal 120 to cause the user terminal 120 to determine the reference value and the reference value. By rendering the new detection information, the reference value and the new detection information may be superimposed on the live image to support the display of an augmented reality screen.

As an example, as shown in Figure 5, when the user selects the detection menu to detect the reinforcement spacing of the reinforcement, the construction information management server 110, corresponding to a specific portion obtained from the user terminal 120 It is possible to generate new detection information for a specific area by analyzing the live reinforcement reinforcement image. In this case, the new detection information may include actual measurement information on the reinforcement reinforcement spacing corresponding to the acquired actual image.

In addition, the construction information management server 110 may check a reference value corresponding to a specific site by referring to specific design information for a specific site. At this time, the reference value may include design information about the reinforcement interval.

In addition, the construction information management server 110 transmits the actual measurement information and design information about the reinforcement spacing to the user terminal 120 to allow the user terminal 120 to share the actual measurement information and the design information together with the actual image. It can be superimposed to display an augmented reality screen. Through this, the user can immediately and easily compare and analyze the design information and the actual measurement information in the field.

On the other hand, when a process monitoring request is obtained from the user terminal 120, the construction information management server 110 transfers the live image captured by the user terminal 120 obtained from the user terminal 120 to the monitoring terminal 130. Alternatively, the user terminal 120 may directly transmit a live image to the monitoring terminal 130.

In addition, the construction information management server 110 transmits process instruction information for a specific area among arbitrary areas of the live-action image acquired from the monitoring terminal 130 to the user terminal 120, or the monitoring terminal 130 performs the process. The instruction information is directly transmitted to the user terminal 120, the user terminal 120 renders the markup 600 corresponding to the process instruction information, and the markup 600 is superimposed on the live image to provide augmented reality. It can support to display the screen.

As an example, as shown in FIG. 6, when a user, for example, a field worker, wants to receive specific instructions from a field engineer, technician, or supervisor about the rebar reinforcement process, the user by photographing a live image showing the reinforcement reinforcement It may be transmitted directly from the terminal 120 to the monitoring terminal 130, or from the user terminal 120 to the monitoring terminal 130 through the construction information management server 110.

In addition, an indicator using the monitoring terminal 130, for example, a field engineer, etc., may transmit process instruction information to the user terminal 120 for a specific area on the live-action image obtained from the user terminal 120 of the worker.

At this time, the process instruction information may include an instruction to perform a supplementary work for an inappropriate construction condition, an instruction on a work order, a response instruction to a civil complaint in a specific area of a construction site, and the like.

In addition, the process management server causes the user terminal 120 to render a markup 600 corresponding to the process instruction information, for example, a pin-shaped mark, and superimposes the markup 600 on the live reinforcement image. Thus, by supporting the display of an augmented reality screen, it is possible to transmit and receive accurate work orders in real time even if the operator and the indicator are not together in the same space.

Meanwhile, for convenience of explanation, the pin-shaped markup 600 is shown to be rendered in FIG. 6, but the shape of the markup is not limited thereto, and may be rendered in various shapes such as arrows, circles, and check marks. In addition, the markup 600 may include character information corresponding to the process instruction.

In addition, when process instruction voice information corresponding to the process instruction for a specific area of the live-action image is additionally acquired from the monitoring terminal 130, the construction information management server 110 causes the user terminal 120 to make the markup 600 ) May be superimposed on the live-action image to display the augmented reality screen and output process instruction voice information.

Accordingly, the process operator can proceed with the process according to the process instruction explained by the manager, and the manager can manage and supervise the process conducted by the worker in real time, thereby preventing process defects, etc. In addition, it can enable process workers to proceed with the process according to the designed construction standard.

In addition, the embodiments according to the present invention described above may be implemented in the form of program instructions that can be executed through various computer components and recorded in a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, and the like alone or in combination. The program instructions recorded in the computer-readable recording medium may be specially designed and configured for the present invention, or may be known and usable to those skilled in the computer software field. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magnetic-optical media such as floptical disks. media), and a hardware device specially configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules to perform the processing according to the present invention, and vice versa.

In the above, the present invention has been described by specific matters such as specific elements and limited embodiments and drawings, but this is provided only to help a more general understanding of the present invention, and the present invention is not limited to the above embodiments. , Anyone having ordinary knowledge in the technical field to which the present invention pertains can make various modifications and variations from these descriptions.

Therefore, the spirit of the present invention is limited to the above-described embodiments and should not be defined, and all modifications that are equally or equivalent to the claims as well as the claims to be described later fall within the scope of the spirit of the present invention. I would say.

Claims (16)

In a method for managing at least some of construction information and maintenance information based on augmented reality,
(a) (i) Spatial information, which is information on individual spaces within the building specified by at least one of the building's wing, arc, floor, and room, (ii) Construction information for each part in the individual spaces And (iii) when activity information corresponding to the public type information is obtained, when a request for augmented reality information for a specific region in specific spatial information on the live-action image photographed by the user terminal is obtained from a user terminal, Checking, by a construction information management server, a specific individual space in which the user terminal is located by referring to location information in which the user terminal is located;
(b) The construction information management server presets specific construction type information and specific activity information for the specific part corresponding to the live-action image among the construction type information and the activity information corresponding to the specific individual space. Classified according to a category, and transmits selection menus for the specific public type information and the specific activity information classified according to the preset category to the user terminal, thereby causing the user terminal to render the selection menus, and the selection Supporting menus to display an augmented reality screen by overlapping the live image;
(c) When a selection signal for a specific selection menu corresponding to any one of the specific construction type information and the specific activity information among the selection menus is obtained from the user terminal, the construction information management server, the specific selection By transmitting specific design information and specific construction information corresponding to any one of specific construction type information and specific activity information corresponding to a menu to the user terminal, the user terminal renders the specific design information and the specific construction information. Supporting to display an augmented reality screen by superimposing the specific design information and the specific construction information on the live-action image; And
(d) the construction information management server, (i) when a process monitoring request is obtained from the user terminal, transmits the live-action image captured by the user terminal obtained from the user terminal to the monitoring terminal, or the user terminal Allows the user to transmit the live image to the monitoring terminal, and (ii) transmit process instruction information for a specific region among the arbitrary regions of the live image obtained from the monitoring terminal to the user terminal, or the monitoring terminal Transmitting the process instruction information to the user terminal, causing the user terminal to render a markup corresponding to the process instruction information, and supporting the display of an augmented reality screen by superimposing the markup on the live image step;
Including,
When a detection menu for detecting the specific region among the selection menus is selected, the construction information management server (i) analyzes the live-action image corresponding to the specific region acquired from the user terminal, Generates new detection information including actual measurement information for, and checks a reference value indicating construction plan information corresponding to the specific part by referring to the specific design information,
The new detection information including the actual measurement information for the specific region and the reference value indicating the construction plan information corresponding to the specific region are transmitted to the user terminal to allow the user terminal to transmit the reference value and the new detection information. The method characterized in that to support the display of an augmented reality screen by superimposing the reference value and the new detection information on the real image by rendering. delete delete The method of claim 1,
In step (a),
The method, characterized in that the construction information management server obtains the location information where the user terminal is located by referring to at least one of GPS information and an augmented reality marker for the user terminal. The method of claim 1,
The method, characterized in that the category includes at least document information, drawing information, image information, and detection information. delete The method of claim 1,
When process instruction voice information corresponding to the process instruction for the specific area of the live-action image is additionally obtained from the monitoring terminal, the construction information management server causes the user terminal to superimpose the markup on the live-action image. And outputting the process instruction voice information while displaying an augmented reality screen. The method of claim 1,
The construction information management server includes at least one unit cube cell consisting of a unit space, a unit type of construction, and a unit time by referring to each of the spatial information, the construction type information, and time information of each of the activity information. A spatial axis in which structures are created, and the spatial information is arranged on a first axis of the 3D axis, a co-type axis in which the co-type information is arranged on a second axis of the 3D axis, and the time information is arranged on a third axis of the 3D axis. By arranging the construction information structures in a specific area of the three-dimensional construction information posting space consisting of a time axis and generating a three-dimensional construction information cube in a construction information database, the user terminal allows the user terminal to use the three-dimensional construction information cube. And displaying the spatial information, the public type information, and the activity information. In a construction information management server for managing at least some of construction information and maintenance information based on augmented reality,
At least one memory for storing instructions; And
At least one processor configured to execute the instructions,
The processor may include (1) (i) spatial information, which is information on individual spaces within the building specified by at least one of a building, a building, a floor, a floor, and a room, (ii) in the individual spaces. Request for augmented reality information for a specific area in specific spatial information on the live image captured by the user terminal from the user terminal while the public type information for each area and (iii) activity information corresponding to the public type information are acquired When the user terminal is obtained, a process of checking a specific individual space in which the user terminal is located by referring to location information in which the user terminal is located; (2) Among the public type information and the activity information corresponding to the specific individual space, specific public type information and specific activity information for the specific part corresponding to the live image are classified according to a preset category, and the By transmitting the selection menus for the specific public type information and the specific activity information classified according to a preset category to the user terminal, the user terminal renders the selection menus, and the selection menus are superimposed on the live image. A process of supporting to display an augmented reality screen; (3) When the processor obtains a selection signal for a specific selection menu corresponding to any one of the specific service information and the specific activity information among the selection menus from the user terminal, the processor responds to the specific selection menu The specific design information and specific construction information corresponding to any one of the specific construction type information and specific activity information are transmitted to the user terminal, and the user terminal renders the specific design information and the specific construction information to render the specific design information. A process of supporting the display of an augmented reality screen by superimposing information and the specific construction information on the live-action image; And (4) the processor, (i) when a process monitoring request is obtained from the user terminal, transmits the live-action image captured by the user terminal obtained from the user terminal to the monitoring terminal, or causes the user terminal to The live-action image is transmitted to the monitoring terminal, and (ii) process instruction information for a specific region among the arbitrary regions of the live-action image obtained from the monitoring terminal is transmitted to the user terminal, or the monitoring terminal performs the process. Transmitting instruction information to the user terminal, causing the user terminal to render a markup corresponding to the process instruction information, and supporting the display of an augmented reality screen by superimposing the markup on the live image;
Execute the instructions to perform,
The processor,
In the above (3) process,
When a detection menu for detecting the specific region among the selection menus is selected, (i) a new image including actual measurement information on the specific region by analyzing the live image corresponding to the specific region obtained from the user terminal Generates detection information, and checks a reference value indicating construction plan information corresponding to the specific part by referring to the specific design information,
The new detection information including the actual measurement information for the specific region and the reference value indicating the construction plan information corresponding to the specific region are transmitted to the user terminal to allow the user terminal to transmit the reference value and the new detection information. A construction information management server, characterized in that to support the display of an augmented reality screen by superimposing the reference value and the new detection information on the real image by rendering. delete delete The method of claim 9,
The processor,
In the above (1) process,
A construction information management server, characterized in that acquiring the location information where the user terminal is located by referring to at least one of GPS information and an augmented reality marker for the user terminal. The method of claim 9,
Construction information management server, characterized in that the category includes at least document information, drawing information, image information, and detection information. delete The method of claim 9,
The processor,
When process instruction voice information corresponding to the process instruction for the specific region of the live image is additionally obtained from the monitoring terminal, the user terminal superimposes the markup on the live image to display an augmented reality screen. Construction information management server, characterized in that to output the process instruction voice information. The method of claim 9,
The processor,
A construction information structure including at least one unit cube cell consisting of a unit space, a unit construction type, and a unit time is generated by referring to the spatial information and the construction type information of each of the activity information, and the spatial information is 3D A three-dimensional construction information posting space consisting of a spatial axis arranged on the first axis of the axis, a construction type axis arranged on the second axis of the three-dimensional axis, and a time axis arranged on the third axis of the three-dimensional axis. By arranging the construction information structures in a specific area to create a three-dimensional construction information cube in the three-dimensional construction information posting space, the user terminal allows the spatial information and the construction type through the three-dimensional construction information cube. Construction information management server, characterized in that to display information and the activity information.

Images