JP2026021622A - Construction site construction management system, construction site construction management method and program - Google Patents

Abstract

[Problem] To provide a construction site construction management system, a construction site construction management method, and a program that can improve the efficiency of construction site construction management by utilizing data photographed at the construction site.
[Solution] A construction site construction management system 1 that manages construction at a construction site using a computer (2, 3, 4) and images of the construction site taken by a camera 2 is provided with a judgment unit 54 that judges the construction status of the construction site based on the images, and an image generation unit 53 that generates a walk-through image W that can be viewed and operated from any angle based on the images, and a route display (13) that identifies the route photographed by the camera on a design floor plan of the construction site, and the judgment result by the judgment unit is displayed on the route display, and when the user operates the route display, the walk-through image photographed along the route is displayed.
[Selected Figure] Figure 1

Description

The present invention relates to a construction site construction management system, construction site construction management method, and program for managing construction work at construction sites.

Management systems for construction sites such as buildings and apartment buildings have been proposed in the past. For example, Patent Document 1 describes using a patrol robot to photograph objects within the facility at predetermined locations, and then using those images to manage progress.

Japanese Patent Application Laid-Open No. 2022-30717

As work progresses daily at construction sites, the situation changes daily, but the latest information is always required to make appropriate decisions and carry out appropriate work. In recent years, technological advances have improved the performance of cameras, making it possible to link captured video and still images with floor plans of the construction site. While this technology makes it possible to visually record the construction status, it presents the following challenges:

All still images and videos taken at construction sites quickly become outdated because the site changes daily. As a result, much of the data is not used for daily management and is simply stored as an archive, posing a challenge for how to utilize the latest data for on-site construction management. Furthermore, construction work involves a lot of administrative work, such as creating reports for stakeholders such as the contractor and government, as well as various construction personnel, and issuing work instructions when construction defects occur. This administrative work places a heavy burden on the construction industry, and the reality is that the captured data is not being used effectively.

The present invention was proposed in light of these circumstances, and its purpose is to provide a construction site construction management system, construction site construction management method, and program that utilizes data captured at construction sites to improve the efficiency of construction site construction management.

To achieve the above objectives, the construction site construction management system uses a computer and images of the construction site taken by a camera to manage construction at the construction site. The system includes a judgment unit that judges the construction status of the construction site based on the images, and an image generation unit that generates walk-through images that can be viewed and manipulated from any angle based on the images, and a route display that identifies the route taken by the camera on a design floor plan of the construction site. The judgment results by the judgment unit are displayed on the route display, and when the user operates the route display, the walk-through image taken along the route is displayed.

The construction site construction management system may automatically generate work instructions by automatically inserting at least the walk-through image, the judgment result, and the corresponding portion of the design floor plan associated with the judgment result. The construction site construction management system may further include a judgment unit that judges the progress rate for each type of work at the construction site based on the captured images, automatically generate a progress chart for each type of work based on the captured images and a schedule, and reflect the progress rate judged by the judgment unit in the progress chart. The construction site construction management system may also display a measuring indicator that allows actual dimensions to be recognized on the walk-through image and can be moved in all directions, including up and down, left and right, and diagonally, by the user's operation. The construction site construction management system may also be configured to use learning results from machine learning to make judgments in the judgment unit. The construction site construction management system may also compare previously captured images with images of the same location and display areas or the positions of specified building components that differ from the previous images in the walk-through image.

The construction site construction management system may also display, along with the walk-through images captured along the route, a judgment button that allows the user to select and set a work type from multiple work types for judging the construction status of the construction site. In this case, the work types may include an undercut judgment that determines whether or not there is an excessively large gap between a door and a floor installed at the construction site, and the judgment result of the undercut by the judgment unit may be displayed on the door or the floor on the walk-through image. In this case, the work types may also include a floor clearance judgment that determines whether or not there is an excessively large gap between a floor and a wall installed at the construction site, and the judgment result of the floor clearance by the judgment unit may be displayed between the floor and the wall on the walk-through image. Furthermore, in this case, the work types may also include a board screw pitch judgment that determines whether the spacing between multiple screws securing the base boards installed at the construction site is appropriate, and the judgment result of the board screw pitch by the judgment unit may be displayed on the walk-through image, along with the positions of the multiple screws and the lines connecting the screws.

Furthermore, to achieve the above-mentioned objectives, a construction site construction management method is a construction site construction management method in which construction at the construction site is managed by a computer based on images of the construction site taken by a camera, and is characterized in that a route display that identifies the route taken by the camera is displayed on a design plan of the construction site, and the route display displays a judgment result of the construction status of the construction site based on the captured images, and when a user operates the route display, a walk-through image that can be viewed and manipulated from any angle is displayed based on the images taken along the route.Furthermore, a program for achieving the above-mentioned objectives causes the computer to execute the above-mentioned construction site construction management method.

The construction site construction management system, construction site construction management method, and program of the present invention are configured as described above, and therefore can utilize data photographed at construction sites to improve the efficiency of construction site construction management.

1 is a system diagram of a construction site execution management system according to an embodiment of the present invention. 1A is an example of a block diagram of a camera in the construction site execution management system, and FIG. 1B is an example of a block diagram of a user terminal in the construction site execution management system. 1 is an example of a block diagram of a server in the construction site execution management system. 1A is a flowchart showing an outline of the basic operation of the construction site execution management system, and FIG. 1B is a diagram for explaining an example of the display of a judgment button. 10 is a diagram showing a schematic example of a display of a design plan of a construction site displayed on the display unit of a user terminal in the construction site execution management system. FIG. (a) A diagram showing a schematic diagram of an example of a walk-through image displayed on the display unit of a user terminal in the construction site construction management system, and (b) is a diagram for explaining an example of the display of the judgment button shown in Figure 6(a). 10A and 10B are diagrams illustrating an example of a walk-through image displayed on the display unit of a user terminal in the construction site execution management system. 10A and 10B are diagrams illustrating an example of a walk-through image displayed on the display unit of a user terminal in the construction site execution management system. 10A and 10B are diagrams showing an example of a walk-through image displayed on the display unit of a user terminal in the construction site execution management system. FIG. 7 is a diagram showing an example of a work instruction sheet automatically created based on a walk-through image using the instruction sheet function shown in FIG. 6( a ). 10A and 10B are diagrams showing examples of a production progress chart automatically created based on photographed images. FIG. 10 is a diagram illustrating an example of material management based on a walk-through image.

Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings.
The construction site construction management system 1 according to this embodiment (hereinafter referred to as the construction management system) manages construction at a construction site using a computer (2, 3, 4) and photographed images of the construction site, and is equipped with a determination unit 54 that determines the construction status at the construction site based on the photographed images, and a setting unit 56 that allows the user to freely select and set the type of work for which the construction status is to be determined from a plurality of work types. These will be described in detail below.

In this embodiment, unless otherwise specified, the term "user" refers to a system user who has the authority to access the construction management system 1 in this embodiment. Possible users include not only construction companies and owners, but also clients, various construction-related personnel, and government agencies. Furthermore, there is no particular limitation on who takes images at the construction site using the camera 2, and this includes not only people but also robots. Furthermore, construction sites are not limited to large-scale construction sites such as buildings, apartment buildings, commercial facilities, and hospitals, but also include small-scale construction sites for private homes and small stores, and even civil engineering construction sites such as tunnels and bridges. Therefore, the content of the judgment by the judgment unit 54 is not limited to the content described below, and may be content that judges the construction condition of the construction site, such as poor construction work.

<System>
1 shows an example of a construction management system 1 according to this embodiment. The construction management system 1 includes a camera 2 capable of capturing images of a construction site, a user terminal 3 such as a smartphone or personal computer, and a server 4 connected to these via a communication network 7, and is configured as a system capable of freely communicating with each other in a secure environment. Examples of the communication network 7 include telephone networks such as public switched telephone networks, mobile phone communication networks, next-generation telephone networks, and dedicated line telephone networks, as well as packet-based networks such as the Internet. The communication standard is not particularly limited, and includes any network that provides data communication via wireless signals. An example of the arbitrary network is a wireless local area network (WLAN) that uses Wi-Fi/WiMax communication.

<Camera>
As described above, camera 2 may be any camera capable of capturing images of the construction site. For example, a dedicated wide-angle camera, such as a so-called 360-degree camera, may be used, or the camera may be captured by a smartphone capable of capturing wide-angle images. Camera 2 is preferably capable of capturing an image of a range of 180 degrees or more. It may be a camera mounted on a person's head (helmet), a handheld camera that can capture images while walking around the construction site, a tripod, or a fixed installation on a wall or floor. When capturing images handheld, a fixture for holding camera 2 may be used. For example, if the construction site to be managed is a detached house, a single camera 2 equipped with a wide-angle lens may be installed in a position that allows it to capture the entire site. For large-scale construction sites such as large apartment buildings, images may be captured while walking, or remotely controlled by a robot that can travel around the construction site. Furthermore, the installation location and capture method of camera 2 may be changed based on the construction schedule. The photographed image referred to here refers to an image taken arbitrarily within the construction site, and as long as the photographed image generated by the image generation unit 53 can be converted and viewed at any angle by the user's operation, there are no limitations on the image format, photographing method, number of cameras used for photographing, number of pixels of the photographed image, etc. Of course, in order to make the determination result by the determination unit 54 more accurate, it is desirable to use a camera 2 that can obtain photographed images with high photo resolution and video resolution.

Figure 2(a) shows an example of a block diagram when a 360-degree camera dedicated to wide-angle image capture is used as camera 2. Camera 2 includes a control unit 20, a transmission/reception unit 21, a memory unit 22, a display unit 23, an operation unit 24, and a lens 25. Control unit 20 is, for example, a microcomputer, and includes a CPU (Central Processing Unit) 20a that performs calculations and processing on acquired data in accordance with a computer program stored in memory 22, thereby executing various processes. Transmitting/receiving unit 21 includes a communication module such as BLE (Bluetooth Low Energy) or a mobile phone communication network that performs short-range wireless communication with user terminal 3 and server 4, and transmits and receives data such as captured images. The storage unit 22 is composed of memories such as RAM (Random Access Memory) and ROM (Read Only Memory), and stores various computer programs executed by the control unit 20, data on captured images, etc. Images captured by the camera 2 may be stored in the server 4 sequentially via the communication network 7 and configured to be viewable in real time from the user terminal 3 (a so-called cloud camera), or the captured images may be imported (uploaded) to the server 4 via an external interface. Furthermore, the images captured by the camera 2 may be imported into the user terminal 3 once, and then the images to be judged by the judgment unit 54 may be selected and imported into the server 4.

The display unit 23 is composed of a liquid crystal display, organic EL (Electro Luminescence) display, or the like, and displays various information under the control of the control unit 20. The operation unit 24 is a user interface that accepts operations such as starting shooting by the user, and includes touch operation of the display unit 23, button operation, and voice operation. The lens 25 may be a full hemispherical or hemispherical type, and may be a single lens, dual lens, or multi-lens with three or more lenses. In addition to the above, the camera 2 may also have image stabilization and waterproofing functions, and may have an image generation unit with the ability to adjust the brightness of the captured image.

<User terminal>
FIG. 2(b) shows an example of a block diagram in which a user terminal 3 is a smartphone, laptop, or other device used by the user. The user terminal 3 refers to a computer used by the user, and may be a smartphone, laptop, tablet, or desktop PC. Essentially, the user terminal 3 has a display unit 23 capable of displaying a screen for selecting the type of work for which the construction status is to be determined and a walk-through image W via a communication network 7, and an operation unit 24 capable of operating a design floor plan 8 and viewing the walk-through image W from any angle. Therefore, for example, the user terminal 3 may be configured to require a dedicated application to access the construction management system 1, or may be configured to be accessible from a browser. From a security perspective, the user terminal 3 may be configured to grant access to the construction management system 1 by logging in via an account, or may be configured to be accessible from a unique URL.

The user terminal 3 comprises a control unit 30, a transmission/reception unit 31, a memory unit 32, a display unit 33, an operation unit 34, and a camera 35. The control unit 30 is, for example, a microcomputer, and has a CPU 30a that performs calculations and processing on acquired data in accordance with computer programs stored in the memory unit 32, thereby executing various processes. The transmission/reception unit 31 is equipped with a communication module that transmits and receives data to and from the server 4, etc. The memory unit 32 is composed of memories such as RAM and ROM, and an HDD, and stores various computer programs executed by the control unit 30. The display unit 33 is composed of an LCD display, an organic EL display, etc., and displays various information and the construction status assessment results (described below) within the walk-through image W based on control by the control unit 30. The operation unit 34 is a user interface that accepts user operations, and includes, for example, a touch switch provided on the thin display that constitutes the display unit 33, which outputs signals in response to operations and is operated by voice.

<Server>
FIG. 3 shows an example block diagram of the server 4, which performs image processing, assessment processing, production progress chart generation, work type selection, instruction sheet generation, etc. The server 4 is configured with an information processing device such as a computer, and may be a single device or may be configured with multiple devices, such as a server for image generation and a database server for data storage. The server 4 may be a dedicated server computer or a cloud server. Security measures such as a firewall are provided between the server 4 and the communication network 7. The server 4 includes an image processing server 5 and may also include a learning device 6 to improve the assessment accuracy of the assessment unit 54. The image processing server 5 includes a control unit 50, a transmission/reception unit 51, a memory unit 52, an image generation unit 53, a assessment unit 54, a production progress chart generation unit 55, and a setting unit 56.

The control unit 50 is equipped with a CPU 50a, which executes various programs stored in the memory unit 52 to perform various processes. The transmission/reception unit 41 transmits and receives data, files, and operation signals from the operation units 24 and 34 to and from the camera 2 and user terminal 3. For example, the transmission/reception unit 41 receives images captured by the camera 2 and transmits information to be displayed on the display unit 33. The memory unit 52 stores image processing programs required for the operation of the image processing server 5, as well as various programs and data for determining the construction status.

Based on the images captured by camera 2, the image generation unit 53 generates a walk-through image W that can be viewed from any angle by the user, based on a screen for selecting the type of work for which the construction status is to be assessed from multiple work types, as shown in FIG. 4(b), and the captured images. The walk-through image W may be partially CG images, as long as it can be viewed from any angle by the user. It may also be generated by combining not only the captured image but also 2D design drawings, 3D data, and CG. For example, the captured image may be incorporated into a 3D model created using software that realizes BIM (Building Information Modeling), to generate the walk-through image W, and the system according to this embodiment may be applied. The image generation unit 53 also generates images (e.g., FIGS. 5 and 6(a)) that display the judgment result display 9 on the design floor plan 8 or the walk-through image W, and images (e.g., FIG. 5) that display the judgment result display 9 in color, graphics, and text on the design floor plan 8 of the construction site. The image generation unit 53 compares previously captured images with images of the same location, and generates an image that displays areas that differ from the previous images and/or the positions of specified building components on the walk-through image W. The image generation unit 53 also generates an image that displays a measuring indicator M1 (see Figures 8(a) and 9(a)) that allows actual dimensions to be recognized on the walk-through image W, and a level M2 (see Figure 8(b)) that can measure horizontal and vertical positions.

The determination unit 54 determines the status of construction work at the construction site using a determination algorithm appropriate for the selected work type, based on the images of the construction site captured by the camera 2 or the walk-through images W generated from the captured images. Specific examples of determinations will be described later with reference to the figures. The determination unit 54 also determines the progress rate for each work type at the construction site based on the captured images. Specifically, the determination unit 54 determines the progress rate for each work type based on the captured images, such as the percentage of walls and ceilings with a light steel base that have been completed, or the percentage of wallpapering that has been completed, based on the captured images. When determining the progress rate here, for example, if a result of the determination indicates "requires confirmation," the program may not recognize the work as completed, even though the construction itself has been completed. This enables progress management that is more suited to the actual situation at the site. Progress management will be described further below with reference to the figures. Although not shown, the results of the determination by the determination unit 54 may be displayed by the image generation unit 53 in bar graphs or line graphs for each work type and each shooting date.

The progress report generator 55 generates a progress report for each type of work at the construction site based on the captured images. The specific generation of the progress report 80 will be described later with reference to Figure 11. The setting unit 56 allows the user to freely select and set from multiple types of work the type of work that will be used to register various settings and determine the construction status in the construction management system 1. Work type selection will be described with reference to Figure 4, etc.

When the server 4 is equipped with a learning device 6, the learning device 6 comprises a control unit 60 having a CPU, GPU, GPGPU, etc. capable of machine learning, and a memory unit 61 for storing a learning dataset. The learning device 6 works in conjunction with a judgment unit 54 that judges the construction status of a construction site, and performs AI learning to improve the judgment of the judgment unit 54. The memory unit 61 is composed of memory such as RAM and ROM, and an HDD. The control unit 60 reads and executes a program corresponding to machine learning from the memory unit 61, thereby performing machine learning using the learning dataset and generating a trained model. For example, a learning dataset is generated that includes multiple pairs of judgment results for image data of poorly constructed wall surfaces with uneven paint and image data of wall surfaces without uneven paint. Image data to be judged as poorly constructed is input to the neural network as input data, and the neural network is trained to output a judgment result of poor construction for the input image data from the output side.

<Basic operation>
4 to 6, we will now explain the basic operation of the construction management system 1 and examples of display (image generation examples) of the design floor plan 8 and the walk-through image W. Here, as an example of judging the construction status, we will explain an example of judging undercuts by comparing predetermined reference data with a captured image to determine whether construction has been carried out without creating any unnecessary gaps between the wall and floor surfaces at a construction site, specifically, between fittings and doors and the floor, which are inspected at the construction site as part of a voluntary inspection.

First, an image of the construction site is captured by camera 2 (S100 in Figure 4). Then, the user terminal 3 selects the type of work (S101 in Figure 4). Figure 4(b) shows an example of the display of the judgment button 11a, which allows for the selection of the type of work. There are various types of work for which the construction status needs to be assessed at a construction site. In this example, the judgment button 11a allows the user to select the type of work for which the construction status needs to be assessed from among multiple types of work. As shown in Figure 4(b), when the menu button 11aa next to the undercut key 11ad is operated, the board screw pitch key 11ae and floor clearance key 11af are displayed, allowing the user to select the type of work for which the construction status needs to be assessed. Therefore, if the user wants to assess the construction status of an undercut, the user simply selects the undercut key 11ad. The scope of the assessment can be the entire construction site being managed, or it can be performed for each walk-through image W, as shown in Figure 6(a). Selection can also be made from the design floor plan shown in Figure 5. When the type of work is selected and "undercut" is selected from multiple types of work in the setting unit 56, the judgment unit 54 judges the construction status based on the captured image (Fig. 2, S102). The judgment result is then displayed on the design floor plan 8 shown in Fig. 5 and the walk-through image W shown in Fig. 6(a).

Figure 5 shows an example of the display of a design plan 8. The design plan 8 is the actual design drawing of the construction site that has been imported into the construction management system 1 and displayed. In this embodiment, it is used in conjunction with the walk-through image W, and is configured so that the design plan 8 alone can be displayed enlarged based on user operation. For example, in the state of Figure 6(a) where the walk-through image W is displayed, moving the cursor over the design plan 8 displayed on the right and clicking it may switch to the screen of Figure 5. At this time, the design plan 8 of the construction site may display the judgment result using color, icons, or text.

In Figure 5, the judgment result display 9 by the judgment unit 54 is displayed in a bubble-like figure, with the words "OK" and "Confirmation Required" (Figure 4, S103, S104). Here, the judgment result for the undercut construction status is displayed, along with a progress status display 14 saying "100% complete." Furthermore, dotted lines 13 are also displayed in the design floor plan 8 to show the path and trajectory captured by camera 2. This makes it possible to see at a glance where the site is being photographed and where it is not. Additionally, clicking on each point on the dotted line 13 may switch the screen to display a walk-through image W as shown in Figure 6(a).

By clicking on the dotted line of the room marked "Confirmation Required" in the display of FIG. 5, the walk-through image W shown in FIG. 6(a) can be viewed. The walk-through image W is generated by the image generation unit 53 of the image processing server 5. The format of the walk-through image W is not particularly limited, as long as it allows the captured image to be freely viewed and manipulated from any angle by operating the operation unit 34 of the user terminal 3. FIG. 6(a) shows an example of the walk-through image W displayed on the display unit 33 of the user terminal 3. At first glance, it is unclear whether the image of the room displayed in FIG. 6(a) is an image that can be viewed from different perspectives. However, by placing the cursor on the "circle W2" displayed in the walk-through image W and moving the operation unit 34, such as the mouse of the user terminal 3, up, down, left, right, or any other angle as desired, the captured image of the site can be viewed from any angle as if walking around the site. In this embodiment, the image described above is referred to as a walk-through image.

Operation bars 11, 12 are provided at the top and bottom ends of the walk-through image W. The lower operation bar 11 includes a judgment button 11a that displays the judgment result by the judgment unit 54 and stores buttons for executing the judgment, an operation cursor 11b that allows viewing and operating captured images and videos, and a date and time display unit 11c that displays the capture date and time of the image displayed on the display unit 33. The upper operation bar 12 includes operation buttons that allow downloading the captured image to the user terminal 3 and uploading another captured image, as well as operation buttons that allow enlarging and reducing the walk-through image W.

Window W1 is provided at the top right of the walk-through image W, allowing easy identification of the image on the design floor plan 8 (see Figure 5). The design floor plan 8 displayed in window W1 is linked to the walk-through image W displayed on the display unit 33 of the user terminal 3. Below that, a display 9 of the judgment result by the judgment unit 54 is displayed. Here, the judgment result display 9 is displayed as the text "Confirmation Required." However, this is not limited to this; it could be the English letter "NG," an icon that intuitively indicates that confirmation is required, or a symbol or graphic such as a penalty mark. It could also be displayed in color. In the walk-through image W shown in Figure 6(a), dotted lines indicate areas where judgment was made by the judgment unit 54, and double circles and arrows indicate areas requiring confirmation so that the judgment result can be recognized. This allows users to see at a glance what the judgment unit 54 judged, and whether there are any problems with construction or not. The instruction function 10 provided below the judgment result display 9 will be described later.

The construction status judgment operation can be performed not only on the separate screen shown in Figure 4(b), but also by operating the judgment button 11a on the operation bar 11 below the walk-through image W. Figure 6(b) shows an example of how the judgment button 11a is displayed. The judgment button 11a has a pull-down menu button 11aa and a judgment key 11ab. When the menu button 11aa is operated, the judgment edit key 11ac is displayed (see the right side of Figure 6(b)). When the judgment key 11ab is operated, an automatic judgment is made by the judgment unit 54 (Figure 4, S102), and a judgment is made by the judgment unit 54. In this case, the construction status of the currently displayed walk-through image W is judged to be good or bad.

The method by which the judgment unit 54 determines whether the construction condition is good or bad is not particularly limited, but it may, for example, compare predetermined reference data with the data of the captured image to judge the construction condition. For example, an image data processing program (e.g., an image difference detection program) compares the generated ideal image data with the actually captured image data to detect the difference. The image processing program then determines whether the condition is "OK" or "check required" based on the size of the difference. Note that the judgment program in the judgment unit 54 is not limited to the above, and the predetermined data may be threshold data. When the predetermined data is threshold data, the gap between the door and the floor is calculated from the image data, and if it exceeds the threshold, it is displayed on the walk-through image W as "check required," or if it is below the threshold, it is displayed as "OK" (Figure 4, S105).

Figure 6(b) shows an example of the display of the judgment button 11a. The judgment button 11a displayed on the walk-through image W includes a judgment edit key 11ac. Operating the menu button 11aa next to the judgment button 11a displays the judgment edit key 11ac, and operating the judgment edit key 11ac enables text editing of the judgment result display 9. In other words, the user can input text regarding the judgment result from the user terminal 3. Therefore, judgment editing can be performed after directly inspecting a construction site that has been judged as "requiring inspection" by the judgment unit 54, or the user can visually judge the undercut construction status by viewing the walk-through image W. Note that judgment editing can be performed by generating a separate judgment edit screen (not shown) on the walk-through image W that allows the judgment result to be entered, or by selecting specified words (e.g., "OK," "Request construction from a contractor," etc.) from a pull-down menu. In this way, while relying on automatic judgment by the judgment unit 54 as the basis, by having the user (human) visually check only those areas that are marked "requiring confirmation" in the judgment result of the judgment unit 54, the efficiency of construction management can be significantly improved. Furthermore, by utilizing user judgment to assist the judgment by the judgment unit 54, the reliability of the construction management system 1 can be further improved.

<Examples of display content on user terminal and construction status assessment content>
In the construction management system 1, it is extremely important for construction management to clearly display the construction status of the construction site on the user terminal 3. Examples of the display content and construction status judgment content on the user terminal will be further explained below with reference to the drawings.

7(a) and 7(b) show other examples of construction status assessments. Figure 7(a) shows an example of an assessment performed at a construction site as a self-inspection to determine whether construction has been completed without creating unnecessary gaps between the floor and the wall, and displays the assessment results on the walk-through image W. In this case, too, the assessment can be performed by operating the floor clearance key 11af (see Figure 4(b)) during work type selection (Figure 4, S101), or by displaying the walk-through image W of the area to be assessed and operating the assessment button 11a. When the assessment unit 54 performs a assessment based on user operation, areas on the walk-through image W that are determined to have unnecessary gaps are displayed in a different color than other areas, and an arrow and text are displayed for those areas. The assessment result display 9 also displays the text "Confirmation Required." At this time, if the user determines that there are no problems, for example by enlarging the area indicated as requiring confirmation, the user can operate the assessment edit key 11ac (see Figure 6(b)) to enter "OK."

Next, Figure 7(b) shows an example of a self-inspection performed at a construction site to determine whether the installation of base boards has been carried out without any problems, and displays the result of the assessment on the walk-through image W. In this example, too, the assessment can be performed by operating the board screw pitch key 11ae (see Figure 4(b)) during work type selection (S101, Figure 4), or by displaying the walk-through image W of the area for which the assessment is desired and operating the assessment button 11a. When the assessment unit 54 performs a assessment through user operation, the positions of the screws securing the base board are circled on the walk-through image W, with lines displayed between the screws. This allows the user to determine whether there are any problems with the screw pitch, and arrows and text are displayed for areas where distortion is detected. Again, if the assessment is deemed "requiring confirmation," this is displayed in text on the assessment result display 9. If the user determines that there are no problems, for example by enlarging the area marked "requiring confirmation," the user can operate the assessment edit key 11ac (see Figure 6(b)) to enter "OK."

As can be seen from Figure 6(a) and other figures, the walk-through image W is clear, so by enlarging the walk-through image W or freely changing the viewing angle to check the construction site, it is possible to check the construction work according to various sites, such as the level of floor clearance, whether there are any cracks, unevenness, or distortions in the base boards, and whether the base boards are attached in a hook-shaped manner around openings.

<Other function examples>
Other examples of the functions of the construction management system 1 according to this embodiment will be further described. The examples shown in Figures 8(a) to 9(b) show hidden areas that will later be covered by wall or ceiling materials. Plywood G is applied to areas where air conditioners, handrails, kitchen cabinets, etc. will be installed later, but the size of the plywood G is unclear from the captured image alone. It is also difficult to determine whether the plywood G is installed horizontally. Therefore, Figures 8(a) to 9(a) show an example equipped with a measurement function 15. Operating the measurement function 15 on the walk-through image W displays a pull-down menu (not shown) with "Measurement Function,""LevelFunction," and "Cross Rod Function," allowing users to select and use the function. Figure 8(a) shows an example in which a measuring indicator M1 is displayed on the walk-through image W, enabling the user to measure the height of the area where the plywood G is applied. The measuring indicator M1 is displayed so that it can be moved in all directions, including up and down, left and right, and diagonally, by user operation. FIG. 8(b) shows an example in which a level M2 is displayed, allowing for horizontal and vertical measurements, to confirm whether the plywood G is installed horizontally. FIG. 9(a) shows an example in which a cross rod M3 is used instead of the measuring indicator M1 to recognize the dimensions of the plywood. While FIGS. 8(a) and 9(b) show an example of plywood G, the use of the measurement function is not limited to the illustrated example. For example, the measuring indicator M1 and cross rod M3 can be used as a measurement guide for any location, and the level M2 can be used to check whether pipes, towel racks, counters, and other items that must be installed horizontally are properly installed.

In these examples, the judgment unit 54 may also be used to make a judgment. In this case, the walk-through image W of the area where the judgment is desired, such as the vertical and horizontal dimensions and levelness of the plywood G, is displayed, and the judgment button 11a is operated, and the judgment unit 54 makes a judgment. If the judgment unit 54 determines that the desired dimensions and levelness are met, the judgment result display 9 will display "OK" or similar if the desired dimensions and levelness are not met. In this way, the quality of the construction can be judged without visiting the construction site, and it is also possible to confirm whether the dimensions and levelness are as desired. Furthermore, in the case of the construction photographs shown in Figures 8(a) to 9(a), the dimensions and levelness can be kept as records of the base photographs of areas hidden by wall materials, etc.

Figure 9(b) shows the same location as Figure 9(a) after interior construction work has been completed, with plywood G installed beneath the wall material and concealed, indicated by a dotted line. The image generation unit 53 compares a previously captured image (e.g., Figure 9(a)) with an image of the same location (e.g., Figure 9(b)), and generates an image in the walk-through image W that displays differences from the previous image and/or the location of specified building components. As described above, the location of specified building components, in the example of Figure 9(b), is displayed, allowing for smooth installation of, for example, a kitchen wall cabinet. Furthermore, if the location of plywood for the air conditioner base and handrail base is displayed, construction of the air conditioner, handrail, etc. can be carried out smoothly and without construction errors in accordance with the Quality Assurance Act. Furthermore, by saving the captured images in this way, they can be used as evidence that the construction was carried out according to the blueprints.

Figure 10 shows an example of a work instruction sheet 70 automatically created based on a walk-through image W. If the construction status is assessed based on the walk-through image W and a site inspection is required by the contractor or user, the work instruction sheet 70 can be automatically created by clicking on the instruction sheet function 10 displayed on the photographed image or walk-through image W. The extent to which the work instruction sheet 70 shown in Figure 10 is automatically filled out can be configured as desired, but for ease of use, it is recommended that the "photograph date," "walk-through image" of the site, and "design floor plan" are automatically added, while the user can input information in the description, comments, and responsible person fields. Conventionally, creating instructions to point out defects and provide work instructions to contractors often required analog work, such as uploading photographs, scanning the relevant design floor plans, and highlighting the relevant areas. However, the construction management system 1 of this embodiment significantly reduces the workload. Another significant benefit is that the clear walk-through image W can be attached to the work instruction sheet 70, eliminating the need for explanations to contractors.

The example shown in Figure 10 is intended as a work instruction 70 for a contractor, but it can also be used as a progress report. If there is anything of concern each time the work is checked using the walk-through image W, the instruction function 10 can be used to record the on-site situation with comments. It can also be used as a document for on-the-job training (OJT) at sites where difficult construction work or construction examples are rare. Reports are not limited to progress reports, and can also be used as documentation when problems arise. For example, the walk-through image W can be used to check and report on the usage status of equipment that requires safety management, such as high-speed cutters, at the site. Even in this case, the ability to attach the walk-through image W allows for effective attention to be drawn without intimidating the site, contributing to the creation of a site where flat human relationships can be built.

Figure 11 shows an example of a progress progress chart 80. This progress progress chart 80 reflects progress on a schedule based on images of the construction site. Figure 11 shows an example of progress progress chart data automatically generated by the progress progress chart generator 55 based on the schedule data uploaded to the image processing server 4 for the private areas of a certain condominium. For example, 39F, which has 11 units, is managed as sections 1 and 2, with the schedules for sections 2 and 1 listed in the upper row. This allows the bold line L to show at a glance whether construction is progressing or behind schedule compared to the schedule schedule on the confirmation date of January 29, 2024. For example, as of January 29, it can be seen that the advanced board construction on section 2 of 39F has not yet been completed, despite being scheduled to be completed by January 26. It can also be seen that wood subfloor construction on section 1 of 39F is two days ahead of schedule. In Section 2 of 38F, LGS ceiling construction is one day behind schedule, while Section 1 of 38F is on schedule; in Section 2 of 37F, wood subfloor construction is two days ahead, while Section 1 of 37F is on schedule.

As a result of the above, the progress of construction work can be managed in real time based on the captured images. The table generated by the completed progress table generator 55 can also reflect the results of the assessment made by the assessor 54. This allows progress management to be more in line with the actual conditions at the construction site.

Figure 12 is a diagram illustrating an example of material management using a two-dimensional code 90 attached to a material in a walk-through image W. Various materials, kitchen, toilet, and bathroom equipment, electrical wiring, and other items are delivered to a construction site daily depending on the progress of the work. Therefore, managing the delivery and removal of these materials is extremely important for smooth site maintenance and accident prevention. Therefore, a unique two-dimensional code 90 is attached to packaging materials for materials requiring removal management. The URL linked to this two-dimensional code 90 contains information such as the material's intended use and storage period. It is a site rule that items with two-dimensional codes 90 attached must be placed so that they are visible. When an item with a two-dimensional code 90 is found on the walk-through image W, the user enlarges the image as shown in Figure 12 and photographs the two-dimensional code 90 on the display 33 of the user terminal 3 using a smartphone or other device. This takes the user to the URL linked to the two-dimensional code 90, where the user can obtain information such as the material's storage period. At this time, by operating the judgment edit key 11ac of the judgment button 11a, entering "Deadline has passed" or similar in the judgment result display 9, and clicking the instruction function 10, a work instruction 70 can be created urging the materials to be removed promptly.

As described above, the construction management system 1 according to this embodiment allows users to check not only the construction status of a construction site but also the results of construction status assessments on the design floor plan 8 and walk-through image W without having to go to the site, thereby improving the efficiency of on-site construction management.

The configuration and aspects of the construction management system 1 according to this embodiment are not limited to the above embodiment, nor are the judgment contents and the types of work selected and judged by the judgment unit 54 limited to those described above. Furthermore, the display examples of the various functions of the walk-through image W are not limited to those shown in the figures, and the display contents of the judgment result display 9 are not limited to those shown in the figures. For example, when a location where a construction status judgment has not been performed or does not need to be performed is displayed, the display may read "Unjudged," or the judgment result and progress status may be displayed together, such as "OK, construction progress 60%." The configuration of the camera 2 is also not limited to the above; it may not include the transceiver 21, and the captured data may be downloaded to a recording medium such as an SD card. Furthermore, when the judgment unit 54 performs judgment while checking the walk-through image W, it is also possible to, for example, drag an area on the design floor plan 8 in Figure 5 to judge the specified area as a whole, or to specify the entire 39th floor or a specific room on the 39th floor, and then display only the locations requiring inspection in the walk-through image W.

REFERENCE SIGNS LIST 1 Construction management system 2 Camera 3 User terminal 33 Display unit 4 Server 5 Image processing server 53 Image generation unit 54 Determination unit 55 Work progress chart generation unit 56 Setting unit 6 Machine device 8 Design floor plan 9 Determination result display 10 Instruction function 14 Progress status display 15 Measurement function W Walk-through image 70 Work instruction 80 Work progress chart

Claims (12)

In a construction site construction management system that uses a computer and images of the construction site taken by a camera,
a determination unit that determines the construction status of the construction site based on the photographed images; and an image generation unit that generates, based on the photographed images, a walk-through image that can be freely viewed and operated from any angle and a route display that identifies the route photographed by the camera on a design plan of the construction site;
A construction site execution management system characterized in that the judgment result by the judgment unit is displayed on the route display, and when the user operates the route display, the walk-through image taken along the route is displayed. In claim 1,
A construction site execution management system characterized by automatically generating work instructions by automatically inserting at least the walk-through image, the judgment result, and the relevant portion of the design floor plan associated with the judgment result. In the system according to claim 1 or claim 2,
The determination unit further determines the rate of progress for each type of work at the construction site based on the captured images,
A construction site management system characterized by automatically generating a progress chart for each type of work based on the captured images and the schedule, and reflecting the progress rate determined by the determination unit in the progress chart. In claim 1 or claim 2,
This construction site management system is characterized by displaying measuring indicators that allow the user to recognize actual dimensions on the walk-through image and that can be moved in all directions, including up and down, left and right, and diagonally, by the user's operation. In claim 1 or claim 2,
A construction site execution management system characterized in that the judgment unit makes judgments using learning results obtained through machine learning. In claim 1 or claim 2,
A construction site management system that compares previously taken images with images taken of the same location, and displays in the walk-through image areas that differ from the previous images or the locations of specified building components. In claim 1 or claim 2,
A construction site construction management system characterized by displaying, along with the walk-through images taken along the route, a judgment button that allows the user to freely select and set the type of work to be used to judge the construction status of the construction site from among multiple types of work. In claim 7,
The type of work includes an undercut determination for determining whether or not there is an excessive gap between a door and a floor installed at the construction site,
A construction site management system characterized in that the undercut judgment result by the judgment unit is displayed on the door or floor on the walk-through image. In claim 7,
The type of work includes determining a floor clearance to determine whether or not there is a gap larger than necessary between the floor and the wall constructed at the construction site,
A construction site management system characterized in that the judgment result of the placement clearance by the judgment unit is displayed between the placement floor and the wall on the walk-through image. In claim 7,
The type of work includes a board screw pitch determination that determines whether the spacing between multiple screws that fix the base board installed at the construction site is appropriate,
A construction site management system characterized in that the judgment results of the board screw pitch by the judgment unit are displayed on the walk-through image, and the positions of the multiple screws and the lines connecting the screws are also displayed. A construction site construction management method in which construction management of a construction site is performed by a computer based on images of the construction site taken by a camera,
a route display for identifying the route photographed by the camera on a design plan of the construction site, and a determination result of the construction status of the construction site based on the photographed images is displayed on the route display;
A construction site management method characterized in that when a user operates the route display, a walk-through image is displayed that can be viewed and manipulated from any angle based on the images taken along the route. A program for causing the computer to execute the construction site execution management method according to claim 11.