JP7336253B2 - Installation method - Google Patents

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method of constructing a fixture for installing a fixture.

Conventionally, there is known a construction management device that displays construction status management information using a transparent wearable terminal worn by a worker (see, for example, Patent Literature 1). The construction management device captures an image of the construction surface using an imaging device such as a video camera, and acquires current shape data. Further, the construction management device creates construction status management information including a degree of coincidence based on a comparison between the design shape data of the construction surface and the current shape data.

JP 2018-104933 A

In Patent Literature 1, a transmissive wearable terminal is used to visually confirm the actual construction surface. Moreover, the construction state management information is projected from the projector onto the lens surface of the transmissive wearable terminal. Since it is necessary to acquire the current shape data using an imaging device, it is difficult to operate the construction state management information only with the transmission type wearable terminal when constructing the construction surface. Moreover, in Patent Literature 1, the generated construction status management information is only projected on the transmissive wearable terminal, and is not effectively used after construction.

Accordingly, the present invention provides a method for constructing an installation that can appropriately install the installation with a simple device configuration and that can effectively utilize the measurement results of three-dimensional measurement of the installation after installation. An object of the present invention is to provide a display device and an installation position inspection method.

The installation method of the present invention uses a video display device that virtually extends a real space and a three-dimensional measurement device that three-dimensionally measures an object to be measured in the real space. In the construction method of 1, the video display device includes an imaging unit that captures an image of the physical space, a display unit that displays the captured image of the physical space, a design model of the fixture, and an installation position of the fixture. and a storage unit that stores position information related to the installation, and superimposes the image of the real space captured by the imaging unit and the design model of the installation based on the position information stored in the storage unit. a first step of displaying the display image thus obtained on the display unit of the video display device, installing the installation object at the installation position based on the display image; a second step of three-dimensionally measuring an object by the three-dimensional measuring device; A third method for generating a measurement model of an object, deriving correction data for correcting the design model based on a comparison result of comparing the design model and the measurement model, and documenting the derived correction data and a step.

According to this configuration, in the first step, by visually recognizing the display image displayed on the video display device, it is possible to appropriately install the fixture at the installation position with a simple device configuration using the video display device. can. In the second step, the installed object can be measured using a three-dimensional measuring device after installation, and in the third step, correction data can be derived and the correction data can be documented. . Therefore, it is possible to output the measurement result of the installed object after installation as a form, so that the measurement result of the three-dimensional measurement can be effectively used.

Moreover, it is preferable to further include a fourth step of feeding back the derived correction data to the design model of the fixture to correct the design model.

According to this configuration, the installation position of the installation after installation can be reflected in the design model. Therefore, even if the installation is hidden after installation, it is possible to easily grasp the installation position of the installation on the design model.

In addition, the position information includes tolerance information, which is information relating to a range in which the installation position of the installation is permitted. is preferably displayed in the displayed image, including a tolerance based on

According to this configuration, it is possible to install the fixture such that the fixture is within the allowable range.

Moreover, in the first step, it is preferable that the design model of the installation is displayed in the display image in a frame form that serves as a skeleton of the installation.

According to this configuration, even if the installation in the real space and the design model are superimposed, the installation can be captured on the display image without hiding the installation in the design model. That is, even if the fixture is in the form of a solid block, for example, the design model is displayed in frame form.

Also, in the first step, it is preferable that the design model of the installation is displayed in the display image in different colors according to the type of the installation.

According to this configuration, on the display image, the design model can be displayed in different colors according to the type of installation, so that it is possible to call attention to the operator so as not to mistakenly install the installation. can.

A video display device according to the present invention is a video display device that virtually extends a physical space. A storage unit for storing a model and positional information regarding the installation position of the installation object, and a control unit for controlling each unit, wherein the positional information includes information related to the allowable range of the installation position of the installation object. A certain allowable range information is included, and the control unit superimposes the image of the real space captured by the imaging unit and the design model of the fixture based on the position information stored in the storage unit. A display image is displayed on the display unit, and the design model of the fixture is displayed on the display image including the allowable range based on the allowable range information.

According to this configuration, by displaying the design model including the allowable range on the display image, it is possible to prompt the worker to install the fixture so that the fixture is within the allowable range.

Moreover, it is preferable that the control section displays the design model of the installation on the display image in a frame form serving as a skeleton of the installation.

According to this configuration, even if the installation in the real space and the design model are superimposed, the installation can be captured on the display image without being hidden by the design model, and the visibility can be improved. can. That is, even if the fixture is in the form of a solid block, for example, the design model is displayed in frame form.

Moreover, it is preferable that the control unit displays the design model of the installation in the display image in different colors depending on the type of the installation.

According to this configuration, on the display image, the design model can be displayed in different colors according to the type of installation, so that it is possible to call attention to the operator so as not to mistakenly install the installation. can.

An installation position inspection method of the present invention is an installation position inspection method for inspecting an installation position of an installation object using a video display device that virtually extends a real space, wherein the video display device an imaging unit that captures an image of an installation in space, a display unit that displays the captured image of the real space, and a storage unit that stores a design model of the installation and position information regarding the installation position of the installation. The position information includes allowable range information that is information relating to the allowable range of the installation position of the installation object, and the image of the physical space captured by the imaging unit and stored in the storage unit. a display image superimposed on the design model of the installation object based on the position information is displayed on the display unit of the video display device, and the design model of the installation object is displayed on the basis of the allowable range information. A fifth step of displaying the display image including the allowable range, and a sixth step of inspecting whether or not the installed object imaged by the imaging unit is within the allowable range of the design model. And prepare.

According to this configuration, it is possible to easily check whether or not the installation object has been installed at an appropriate installation position by visually recognizing the display image of the video display device.

Also, in the fifth step, it is preferable that the video display device outputs the display image to a remote terminal.

According to this configuration, since the display image can be displayed on the remote terminal, it is possible to remotely inspect the installation position.

FIG. 1 is a schematic configuration diagram of a construction management system used in a method of constructing an installation according to this embodiment. FIG. 2 is a flow chart relating to the installation method according to the present embodiment. FIG. 3 is an explanatory diagram relating to a display image. FIG. 4 is a flowchart relating to an installation position inspection method according to the present embodiment.

EMBODIMENT OF THE INVENTION Below, embodiment which concerns on this invention is described in detail based on drawing. In addition, this invention is not limited by this embodiment. In addition, components in the following embodiments include components that can be easily replaced by those skilled in the art, or components that are substantially the same. Furthermore, the components described below can be combined as appropriate, and when there are multiple embodiments, each embodiment can be combined.

[This embodiment]
FIG. 1 is a schematic configuration diagram of a construction management system used in a method of constructing an installation according to this embodiment. The installation method according to the present embodiment includes an AR (Augmented Reality) device (video display device) that virtually extends the real space, and a three-dimensional It is a method of installing a fixture using a measuring device. It should be noted that the installation may be of any type, and the method of installing the installation may be applied, for example, to the construction of various plants such as nuclear power plants or buildings. The installation method is performed using the construction management system 1 shown in FIG.

As shown in FIG. 1, the construction management system 1 includes an AR device 11, a three-dimensional measuring device 12, and a construction management device 13, which are connected to a remote terminal 15 so as to be communicable.

The AR device 11 includes a display section 21 , an imaging section 22 , a control section 23 and a storage section 24 . The display unit 21 is a display device such as a liquid crystal panel, and displays various images. The display unit 21 is connected to the control unit 23 and the display operation is controlled by the control unit 23 . The image capturing unit 22 is, for example, a camera, and captures an image of the physical space to generate an image. The imaging unit 22 is connected to the control unit 23 and the imaging operation is controlled by the control unit 23 .

The control unit 23 includes, for example, an integrated circuit such as a CPU (Central Processing Unit). The storage unit 24 includes a semiconductor storage device or a magnetic storage device as a memory and a recording medium as a work area.

The storage unit 24 stores the design model M of the installation and the position information P regarding the installation position of the installation in association with each other. The design model M is a three-dimensional design model created using CAD (Computer-Aided Design) or the like. The position information P is, for example, coordinates in a three-dimensional space (orthogonal coordinate system). The design model M and the position information P are stored in advance in the storage unit 24 before the fixture is installed.

The control unit 23 uses the design model M and the position information P stored in the storage unit 24 to generate an image to be displayed on the display unit 21 when the installation method for the fixture is executed.

When the installation object is installed, the AR device 11 displays a display image in which the design model M of the installation object stored in the storage unit 24 and the installation object in the real space captured by the imaging unit 22 are superimposed. and displays the generated display image on the display unit 21 .

The AR device 11 is communicably connected to the construction management device 13 and the remote terminal 15, and can output information such as images generated by the control unit 23 to the construction management device 13 and the remote terminal 15. It's becoming

The three-dimensional measuring device 12 includes an imaging device 31 and a target 32 . The image capturing device 31 is, for example, a camera, and captures an image of an installation installed at a predetermined installation position. The target 32 serves as an index for converting the image of the installation object captured by the imaging device 31 into coordinates in the three-dimensional space of the installation object. A plurality of targets are arranged in the vicinity of an installation installed at a predetermined installation position.

The three-dimensional measuring device 12 captures an image of the installed object together with the target 32 using the imaging device 31 . The image captured by the imaging device 31 is output toward the construction management device 13 communicably connected to the three-dimensional measuring device 12 .

The construction management device 13 acquires an image including the target 32 and the fixture output from the three-dimensional measurement device 12, and based on the acquired image, converts the shape and position information of the fixture into a three-dimensional space on the CAD. Convert to coordinates. In other words, the construction management device 13 generates the measurement model of the installation object, and also generates the position information related to the installation position of the measurement model in association with each other. The construction management device 13 also compares the design model M and the measurement model acquired in advance, and derives correction data for correcting the design model M based on the comparison result. For example, the construction management device 13 derives the difference in the shape of the measurement model with respect to the shape of the design model M as correction data. The construction management device 13 generates form data by converting the derived correction data into a form, outputs the generated form data to a communicably connected printer, and outputs the form as a paper surface from the printer. The construction management device 13 may output the derived correction data to a CAD device that generates the design model M, and the CAD device may feedback-correct the design model M based on the correction data.

Next, with reference to FIG. 2, a method for constructing the fixture will be described. FIG. 2 is a flow chart relating to the installation method according to the present embodiment. The installation method of the present embodiment is performed by a conductor who directs the installation work using the AR device 11 and an operator who installs the installation at the installation position. Note that the number of workers may be one or may be plural.

In the installation method, first, the AR device 11 acquires the design model M of the installation and the position information P associated with the design model M, and stores the acquired design model M and the position information P in the storage unit 24. (step S1). Subsequently, the conductor using the AR device 11 matches the reference point of the coordinates on the design model M with the reference center provided in the actual work space where the fixture is installed (step S2). As a result, the virtual design model M can be aligned with the real work space.

Subsequently, the conductor visually recognizes the display image displayed on the display unit 21 of the AR device 11, and instructs the worker to install the installation object at the installation position ( step S3: first step). In step S3, on the display unit 21 of the AR device 11, a display image obtained by superimposing the image of the installation object in the work space captured by the imaging unit 22 and the design model M of the installation object based on the position information P is displayed on the display unit. 21. While visually recognizing the displayed image, the conductor instructs the worker to set the installation position of the installation so that the installation is at the installation position of the design model M, that is, so that the installation and the design model M overlap. to direct.

FIG. 3 is an explanatory diagram relating to a display image. The display image 35 displayed on the display unit 21 of the AR device 11 is, for example, the display image 35 shown in FIG. Here, the position information P stored in the storage unit 24 includes allowable range information, which is information regarding the allowable range of the installation position of the fixture. Then, in step S3, the display image 35 is displayed so that the design model M of the fixture includes the allowable range E based on the allowable range information. FIG. 3 shows, for example, a display image 35 in which a plate-shaped iron plate 36 is applied as an installation object and the iron plate 36 is installed on a reinforcing bar 37 . In the display image 35 of FIG. 3, the design model M of the iron plate 36 is illustrated with a thick solid line, and the allowable range E of the design model M is illustrated with a thick dotted line. The allowable range E is one size larger than the design model M.

Further, in step S3, the design model M of the iron plate 36 is displayed in the display image 35 in the form of a frame that serves as the skeleton of the iron plate 36. As shown in FIG. Here, since the iron plate 36 is a solid (massive) plate material, the design model M is generated as a solid model. If the solid design model M is displayed on the display image 35 as it is, the iron plate 36 is hidden by the design model M when the iron plate 36 is superimposed. For this reason, the design model M of the fixture is displayed in a frame form so that the iron plate 36 superimposed on the design model M can be visually recognized even if the fixture is a massive fixture.

In step S3, if there are multiple types of design models M of the installation to be displayed, the design models M may be displayed in the display image 35 in different colors depending on the type of installation.

When the installed object is installed at the installation position in step S3, three-dimensional measurement is performed by the three-dimensional measurement device 12 using the installed installed object as a measurement target (step S4: second step). In step S<b>4 , the target 32 is arranged near the installation, and the image of the installation together with the target 32 is captured by the imaging device 31 . Then, in step S4, an image of the installed object together with the target 32 is output to the construction management apparatus 13 as a measurement result.

The construction management device 13 generates a measurement model of the installation in the coordinate system of the three-dimensional space in the design model M based on the measurement result, and based on the comparison result of comparing the design model M and the measurement model, performs the design Correction data for correcting the model M is derived, and the derived correction data is documented (step S5: third step).

Thereafter, the construction management device 13 determines whether or not the derived correction data is to be fed back to the design model M of the installation based on the input instruction (step S6). In step S6, if an instruction to correct the design model M is input (Yes), the correction data is output to the CAD device, and the CAD device corrects the design model M based on the correction data (step S7: fourth step), the operation related to the construction method is completed. On the other hand, in step S6, when an instruction not to correct the design model M is input (No), the operation related to the construction method ends without executing step S7.

In the installation method of the fixture described above, the AR device 11 is used at the time of installation, and the three-dimensional measuring device 12 is used at the time of measurement. Therefore, the AR device 11 and the three-dimensional measuring device 12 can be configured independently.

Further, in this embodiment, the AR device 11 of the construction management system 1 can be used to inspect the installation position of the installation object. An inspection method using the AR device 11 will be described with reference to FIG. FIG. 4 is a flowchart relating to an installation position inspection method according to the present embodiment. The installation position inspection method of the present embodiment is performed by an inspector who uses the AR device 11 to inspect. As will be described later, when the remote terminal 15 is used, an operator who handles the AR device 11 and an inspector who performs the inspection using the remote terminal 15 may perform the inspection.

In the installation position inspection method, first, the AR device 11 acquires the design model M of the installation and the position information P associated with the design model M, and stores the acquired design model M and the position information P in the storage unit 24 . (step S11). Subsequently, the inspector using the AR device 11 aligns the reference point of the coordinates on the design model M with the reference center provided in the actual work space where the fixture is to be installed (step S12). As a result, the virtual design model M can be aligned with the real work space.

Subsequently, the inspector takes an image of the installed object with the imaging unit 22 of the AR device 11 (step S13: fifth step). In step S13, on the display unit 21 of the AR device 11, a display image obtained by superimposing the image of the installation object in the work space captured by the imaging unit 22 and the design model M of the installation object based on the position information P is displayed on the display unit. 21. At this time, the design model M including the allowable range E is displayed in the display image. By visually recognizing the displayed image, the inspector determines whether or not the fixture is within the allowable range E of the design model M (step S14: sixth step). In step S14, if the installed object is within the allowable range E of the design model M (Yes), the installation position of the installed object is determined to be appropriate and the inspection is passed (step S15). On the other hand, in step S14, if the installation does not fall within the allowable range E of the design model M (No), the installation position of the installation is inappropriate and the inspection is rejected (step S16). An installation that fails the inspection is again installed in an appropriate installation position by executing the installation installation method shown in FIG.

In the installation position inspection method shown in FIG. 4, the inspector uses the AR device 11 for inspection, but the remote terminal 15 may also be used for inspection. When the remote terminal 15 is used, the installation position inspection method is performed by an operator using the AR device 11 and an inspector using the remote terminal 15 . That is, in step S13, the worker images the installed object using the imaging unit 22 of the AR device 11. FIG. Then, in the AR device 11, a display image in which the installed object and the design model M are superimposed is directly output to the remote terminal 15, or indirectly output to the remote terminal 15 via the construction management device 13. is displayed on the display unit of the remote terminal 15 . Then, in step S14, the inspector visually checks the display image of the remote terminal 15 to determine whether or not the installation is within the allowable range E of the design model M.

As described above, according to the present embodiment, in step S3, by visually recognizing the display image 35 displayed on the AR device 11, it is possible to move the fixture to the installation position with a simple device configuration using the AR device 11. can be installed properly. Further, in step S4, the installed object can be measured using the three-dimensional measuring device 12 after installation, and in step S5, correction data can be derived and the correction data can be documented. Therefore, it is possible to output the measurement result of the installed object after installation as a form, so that the measurement result of the three-dimensional measurement can be effectively used.

Further, according to the present embodiment, by feeding back the correction data to the design model M, it is possible to reflect the installation position of the fixture after installation in the design model M. FIG. Therefore, even if the installation is hidden after installation, it is possible to easily grasp the installation position of the installation on the design model M. FIG.

Further, according to the present embodiment, the design model M including the allowable range E can be displayed in the display image 35, so that the installed object can be installed so that the installed object falls within the allowable range E. Become.

Further, according to the present embodiment, by displaying the design model M in the form of a frame on the display image 35, even if the installation and the design model M are superimposed, the installation can be displayed without being hidden by the design model M. The fixture can be captured on the image 35 .

In addition, according to the present embodiment, the design model M can be displayed in different colors on the display image 35 according to the type of installation. can call attention.

In addition, according to the present embodiment, by inspecting the installation position using the AR device 11, by visually recognizing the display image displayed on the display unit 21 of the AR device 11, it is possible to determine the appropriate installation position of the installation object. It can be easily inspected whether or not it has been installed in the vehicle.

Further, according to this embodiment, by displaying the display image 35 on the remote terminal 15, it is possible to remotely inspect the installation position.

1 construction management system 11 AR device 12 three-dimensional measuring device 13 construction management device 15 remote terminal 21 display unit 22 imaging unit 23 control unit 24 storage unit 31 imaging device 32 target 35 display image 36 iron plate 37 reinforcing bar M design model P location information E Tolerance

Claims (5)

A method for installing a fixture by using a video display device that virtually extends a real space and a three-dimensional measurement device that three-dimensionally measures a measurement object in the real space, the method comprising:
The image display device stores an image capturing unit that captures the physical space, a display unit that displays the captured image of the physical space, a design model of the fixture, and position information regarding the installation position of the fixture. a storage unit;
A display image obtained by superimposing the image of the physical space captured by the imaging unit and the design model of the installation based on the position information stored in the storage unit is displayed on the display unit of the video display device. a first step of displaying and installing the fixture at the installation position based on the displayed image;
a second step of three-dimensionally measuring the installed object as the object to be measured by the three-dimensional measuring device;
The measurement results of the three-dimensional measurement of the installation by the three-dimensional measuring device are converted into the coordinate system of the design model to generate a measurement model of the installation, and the design model and the measurement model are compared. and a third step of deriving correction data for correcting the design model based on the comparison result, and documenting the derived correction data. The installation method according to claim 1, further comprising a fourth step of feeding back the derived correction data to the design model of the installation to correct the design model. The position information includes tolerance information, which is information on a tolerance range for the installation position of the fixture,
3. The installation method according to claim 1, wherein in the first step, the design model of the installation is displayed on the display image including the allowable range based on the allowable range information. 4. The installation according to any one of claims 1 to 3, wherein in the first step, the design model of the installation is displayed in the display image in the form of a frame serving as a framework of the installation. Construction method. 5. The installation according to any one of claims 1 to 4, wherein in the first step, the design model of the installation is displayed in the display image in different colors depending on the type of the installation. construction method .

Images