JP7559417B2 - Display device, display system, display control method and program - Google Patents

Description

This disclosure relates to a display device, a display system, a display control method, and a program.

Tunnels and other structures are lined with concrete, which over time can cause cracks and other deformations. If left unchecked, pieces of concrete could fall off and cause damage to passing vehicles and people. For this reason, inspection companies carry out regular inspections and report the results of the inspection to national or prefectural authorities (hereafter referred to as "national government, etc."). To make these reports, inspection companies must submit documents specified by the national or local government.

The inspection company prepares documents to be submitted to the government, etc., based on a field notebook of comments etc. written during the tunnel inspection, images such as photos of abnormalities obtained by photographing the abnormal parts inside the tunnel, and a tunnel ledger showing the length of the tunnel, etc. Furthermore, when the inspection company views the entire structure such as a tunnel, a display device such as a PC displays an image that is a composite of multiple photographed images. For example, the inspection company draws cracks and other abnormal parts while looking at the image displayed on the PC etc. (see Patent Document 1).

However, with conventional methods, when a user views an image of a structure, there is a problem in that it is difficult for the user to easily understand which area of the structure is depicted in the displayed image.

In order to solve the above-mentioned problems, the invention according to claim 1 is a display device that displays a photographed image of a structure including a plurality of areas, and includes a receiving means that receives image data in which the plurality of photographed images are combined from a data management device that stores the photographed images, and a display control means that displays on a display screen a photographed image corresponding to at least a portion of the received image data in association with area information indicating the area corresponding to the photographed image.

The present invention has the effect of enabling a user to grasp the area of a structure shown in a displayed captured image.

FIG. 1 illustrates an example of an overall configuration of an evaluation system. FIG. 1 is a diagram illustrating an example of a schematic configuration of an imaging system. 1A and 1B are diagrams for explaining an example of how a tunnel wall is photographed from a photographing vehicle, in which (A) is a diagram of the photographing vehicle viewed from the direction of travel, and (B) is a diagram showing the vehicle traveling inside the tunnel. FIG. 2 is a diagram illustrating an example of a hardware configuration of a display device, a data management device, and a communication terminal. FIG. 2 illustrates an example of a functional configuration of an evaluation system. FIG. 11 is a conceptual diagram showing an example of a relationship between tunnel development image data and coordinate data. 1A is a conceptual diagram showing an example of a shooting information management table, and FIG. 1B is a conceptual diagram showing an example of a span information management table. FIG. 4 is a conceptual diagram illustrating an example of an image information management table. FIG. 2 is a diagram illustrating an example of a schematic of tile image data. FIG. 11 is a sequence diagram showing an example of a data upload process in the evaluation system. FIG. 11 is a sequence diagram showing an example of a display process of a captured image in the evaluation system. FIG. 11 is a diagram showing an example of a selection screen displayed on a display device. FIG. 4 is a diagram showing an example of an image viewing screen displayed on a display device. 11 is a sequence diagram showing an example of a process for creating a document to be submitted in the evaluation system; FIG. FIG. 10 is a diagram for explaining an example of an outline of a process for creating a document to be submitted; FIG. 11 is a sequence diagram showing an example of a display process of a captured image corresponding to a specified span number. 13 is an example of a screen showing a state in which a span specified jump function is selected on the image viewing screen. 13 is an example of a screen showing a state in which a span number is selected on the image viewing screen. 13 is a screen example showing a state in which a photographed image corresponding to a specified span number is displayed on the image viewing screen. 13 is an example of a screen showing a state in which a span number is selected on the image viewing screen. 13 is a screen example showing a state in which a photographed image corresponding to a specified span number is displayed on the image viewing screen. 10 is a flowchart showing an example of a brightness change process for a displayed captured image. 13 is an example of a screen showing a state in which a brightness change request has been accepted on the image viewing screen. 11 is an example of a screen showing a state in which a captured image with brightness changed is displayed on an image viewing screen. 11 is a sequence diagram showing an example of a display process of a captured image corresponding to a screen size of an image viewing screen. FIG. 13 is an example of a screen showing a state in which a fit to height function is selected on the image viewing screen. 11 is a screen example showing a state in which a captured image corresponding to an image size is displayed on an image viewing screen. 13 is an example of a screen showing a state in which a photographing position of a structure shown in a photographed image is selected in the vertical width fitting function. 11 is an example of a screen showing a state in which a photographed image corresponding to a selected photographing position is displayed on the image viewing screen. FIG. 11 is a sequence diagram showing an example of a display process of an image with the original resolution corresponding to a displayed captured image. 13 is an example of a screen showing a state in which a pixel-to-pixel magnification function is selected on the image viewing screen. 11 is a screen example showing a state in which a captured image in the original resolution is displayed on an image viewing screen. FIG. 11 is a diagram showing another example of an image viewing screen displayed on the display device. FIG. 11 is a diagram showing another example of an image viewing screen displayed on the display device. FIG. 11 is a diagram showing another example of an image viewing screen displayed on the display device. FIG. 11 is a diagram showing another example of an image viewing screen displayed on the display device. FIG. 11 is a diagram showing another example of an image viewing screen displayed on the display device.

Below, we will explain the mode for implementing the invention with reference to the drawings. Note that in the explanation of the drawings, the same elements are given the same reference numerals, and duplicate explanations will be omitted.

●Embodiment●
● Overview of the System First, an overview of the evaluation system according to this embodiment will be described with reference to Figures 1 to 3. Figure 1 is a diagram showing an example of the overall configuration of the evaluation system. The evaluation system 1 shown in Figure 1 is a system that uses photographed images of a structure such as a tunnel 6 to evaluate the condition of the structure. The evaluation system 1 also serves as a display system that displays photographed images of the structure such as the tunnel 6 on a display device 30 used by an inspection company or the like.

The evaluation system 1 is constructed by a display device 30 and a data management device 50. The display device 30 and the data management device 50 constituting the evaluation system 1 can communicate via a communication network 100. The communication network 100 is constructed by the Internet, a mobile communication network, a LAN (Local Area Network), or the like. The communication network 100 may include not only wired communication but also wireless communication networks such as 3G (3rd Generation), 4G (4th Generation), 5G (5th Generation), Wi-Fi (Wireless Fidelity) (registered trademark), WiMAX (Worldwide Interoperability for Microwave Access), or LTE (Long Term Evolution). The display device 30 and the data management device 50 may also have a communication function using a short-range communication technology such as NFC (Near Field Communication) (registered trademark).

In FIG. 1, the inspection worker who is riding on the inspection vehicle 7 and carrying out the inspection overwrites the cracks and other abnormalities with special chalk to make them more noticeable, and notes how many centimeters wide the cracks are. At that time, the inspection worker writes down comments indicating the state of the abnormalities and the evaluation results in a field notebook or the like. Meanwhile, an assistant standing under the inspection vehicle 7 writes down the comments made by the inspection worker in a field notebook or the like, and in some cases takes a photograph of the entire area. The helmet worn by the inspection worker may be equipped with a small microphone and a small camera, and the comments made by the inspection worker may be recorded by the small microphone and the areas commented on may be photographed by the camera. In this case, the recorded voice information may be recognized and digitized by a voice recognition device, and automatically recorded in a field notebook (in this case, a tablet terminal, etc.) along with the image taken by the small camera.

After that, a photographing vehicle 9 equipped with a camera travels through the tunnel 6 from its entrance to its exit while photographing the walls of the tunnel 6, thereby obtaining the data for the tunnel unfolded image shown in FIG. 5 described below. The tunnel unfolded image shows the areas marked by the inspection worker with special chalk, so that the inspection company can easily determine the position or shape of the abnormal area by looking at the tunnel unfolded image at a later date.

The data management device 50 is a computer that manages various data acquired by the photographing vehicle 9. The data management device 50 receives various data from the communication terminal 80 equipped in the photographing vehicle 9, and transfers the received various data to the display device 30 that performs data analysis. The method of transferring the various acquired data from the data management device 50 to the display device 30 may be manual movement using a USB (Universal Serial Bus) memory or the like. The data management device 50 manages comments, tunnel unfolded images and detection data of various sensors described below, and data such as a tunnel ledger. The data management device 50 also manages data that quantifies deformed parts such as cracks drawn on the display device 30, and coordinate data in the tunnel unfolded images. The data management device 50 may be configured to realize each function by distributing it among multiple computers. Furthermore, the data management device 50 may be a server computer that exists in a cloud environment, or a server computer that exists in an on-premise environment.

The display device 30 is a computer such as a notebook PC (Personal Computer) for viewing the captured images and inputting various data for the captured images based on various data transferred from the data management device 50. The display device 30 is equipped with a browser and can display the tunnel unfolded image sent from the data management device 50. The display device 30 also has a dedicated application program installed for viewing or drawing. The user of the display device 30 (hereinafter referred to as the inspection company) inputs into the display device 30 comments such as field notes written by assistants, data of the tunnel unfolded image captured from the entrance to the exit of the tunnel 6 as an example of a structure, and detection data of each sensor. The inspection company also inputs into the display device 30 data from the tunnel ledger obtained from the government, etc. The tunnel ledger contains information such as the length and height of the tunnel.

The inspection company quantifies the image of the deformed part, such as a crack, using position coordinates by drawing lines or the like over the deformed part shown on the tunnel unfolded image. The display device 30 downloads the data of the documents to be submitted, including the deformed development diagram generated by drawing the deformed part, from the data management device 50. The inspection company then submits the printed documents or unprinted electronic data to the government, etc. Note that the display device 30 is not limited to a notebook PC, and may be a smartphone, tablet terminal, etc.

That is, the data management device 50 transmits the data of the documents to be submitted, including a development diagram of the deformation generated by drawing the deformed portion, to the display device 30 via the communication network 100. As a result, the display device 30 receives the data of the documents to be submitted. The display device 30 also transmits the data of the documents to the government, etc. via the communication network 100. Alternatively, the display device 30 transmits the data of the documents to be submitted to a printing device to print, and the inspection company, etc. submits the printed paper as the documents to be submitted to the government, etc. Alternatively, the display device 30 records the data of the documents to be submitted on a recording medium such as a DVD-R, and the inspection company, etc. submits the recording medium to the government, etc. It is preferable that documents (including electronic data) to be submitted to the government, etc. are subjected to anti-tampering processing to ensure their authenticity.

The configuration of the photography system 8 equipped in the photography vehicle 9 will now be described with reference to Figures 2 and 3. Figure 2 is a diagram showing an example of a schematic configuration of the photography system. As shown in Figure 2, the photography system 8 is equipped with a photography unit 900 for photographing the tunnel 6 and a communication terminal 80. The photography unit 900 includes a camera unit 901, a lighting unit 902, a TOF (Time Of Flight) sensor 903, an IMU (Inertial Measurement Unit) 904, a speedometer/travel distance meter 905, and a sensor control board 90.

The camera unit 901 is a line camera that includes multiple cameras and is equipped with a line sensor in which photoelectric conversion elements are arranged in one or multiple rows. The camera units 901 are installed so that the angle of view of each camera overlaps with that of the adjacent cameras, and the entire camera unit is installed so that half of the circumference of the tunnel is included in the angle of view. The camera unit 901 may be configured as a camera equipped with an area sensor in which photoelectric conversion elements are arranged in a plane, a stereo camera, or the like.

The lighting unit 902 includes multiple light sources, and like the camera unit 901, is installed so that the illumination angle of each light source partially overlaps with that of the adjacent light sources. The lighting unit 902 is installed so that the illumination angle covers the entire angle of view of the camera unit 901.

The TOF sensor 903 is a first distance measurement sensor that measures the distance between the photographing vehicle 9 and the wall of the tunnel 6. The TOF sensor 903 performs measurement simultaneously with photographing using the camera unit 901, etc., detects the distance from the wall of the tunnel 6 to the TOF sensor 903, and detects the distance from the wall of the tunnel 6 to the photographing vehicle 9. More specifically, the TOF sensor 903 detects the distance to the wall of the tunnel 6 based on the time it takes to irradiate the wall of the tunnel 6 with light and receive the reflected light. When the TOF sensor 903 uses an area sensor as the light receiving element, it can obtain a two-dimensional contour image in which the display color differs depending on the distance. The first distance measurement sensor may be not only a TOF sensor, but also a LIDAR (Light Detection and Ranging) sensor, a radar sensor, etc.

The IMU 904 is a gyro sensor that detects the angle (attitude) and angular velocity (or angular acceleration) of the image capture vehicle 9. The IMU 904 measures the angles, angular velocities, and accelerations of the three axes that govern the motion of the image capture vehicle 9. The IMU 904 is used to calculate the movement trajectory of the image capture vehicle 9.

The speedometer/distance meter 905 is a second distance measuring sensor that measures the speed and distance traveled in the traveling direction of the photographing vehicle 9. The speedometer/distance meter 905 is used to calculate the movement trajectory of the photographing vehicle 9, similar to the IMU 904. The speedometer/distance meter 905 also serves as a shutter when photographing with the camera unit 901, generating pulses for every evenly spaced movement amount.

Here, the data measured by the TOF sensor 903, IMU 904, or speedometer/travel distance meter 905 is used for geometric correction of the image. For example, the data management device 50 calculates the movement trajectory of the image-taking vehicle 9 from the data measured by the IMU 904 and speedometer/travel distance meter 905, thereby determining the posture of each camera when taking the image, and performs correction for each pixel so that the image is taken from the center of the tunnel 6. In addition, the data measured by the TOF sensor 903 is used to automatically determine the position of the camera unit 901 and lighting unit 902 when taking images using the image-taking vehicle 9.

The sensor control board 90 is a control device that controls the camera unit 901, the lighting unit 902, the TOF sensor 903, the IMU 904, and the speedometer/travel distance meter 905. The sensor control board 90 includes a CPU (Central Processing Unit) 911, a ROM (Read Only Memory) 912, a RAM (Random Access Memory) 913, a HDD (Hard Disk Drive) 914, an external I/F (Interface) 915, and a bus line 916.

Of these, the CPU 911 controls the operation of the entire imaging unit 900. The CPU 911 reads programs, data, and setting information from the ROM 912, etc. onto the RAM 913 and executes processing. Note that some or all of the control, image data processing, and various functions realized by the CPU 911 may be realized by a field-programmable gate array (FPGA) or an application specific integrated circuit (ASIC).

The ROM 912 stores various programs and data, as well as various setting information. The RAM 913 is used as a work area for the CPU 911. The HDD 914 stores image data input from the camera unit 901, or sensor data input from the TOF sensor 903, the IMU 904, and the speedometer/travel distance meter 905.

The external I/F 915 is an interface for connecting various external devices. The external I/F 915 is connected wirelessly or via a wire to the communication terminal 80 that allows the user to operate the photographing unit 900, and exchanges data or signals. The bus line 916 is an address bus or a data bus, etc., for electrically connecting each component such as the CPU 911 shown in FIG. 2.

The communication terminal 80 is a computer such as a notebook PC for operating the photographing unit 900. For example, an inspection worker sitting in the passenger seat of the photographing vehicle 9 uses the communication terminal 80 to operate a recording start button or a stop button to control the photographing unit 900 and store the photographed image data and various sensor data in the HDD 914. In addition, when performing photographing processing using the photographing unit 900, the inspection worker operating the communication terminal 80 inputs a predetermined comment into the communication terminal 80. The communication terminal 80 transmits the photographed image data, the detection data of each sensor, and the comment to the data management device 50. Note that the communication terminal 80 is not limited to a notebook PC and may be a smartphone, tablet terminal, or the like.

Next, the manner in which the wall of the tunnel 6 is photographed from the photographing vehicle 9 will be described with reference to FIG. 3. FIG. 3 is a diagram for explaining an example of the manner in which the tunnel wall is photographed from the photographing vehicle. FIG. 3(A) is a diagram of the photographing vehicle as seen from the traveling direction, and FIG. 3(B) is a diagram showing the vehicle traveling inside the tunnel.

As shown in FIG. 3(A), the photographing unit 900 is fixed onto the roof of the photographing vehicle 9. The camera unit 901 and the lighting unit 902 slide in a direction intersecting the traveling direction of the photographing vehicle 9 by a slide unit 920, and are fixed at two positions determined based on the length of a specified road structure.

The length of the specified road structure is the width of the sidewalk in the direction intersecting with the traveling direction of the photographing vehicle 9. Here, the sidewalk is a road for pedestrians to walk on, and refers to a part of the road that is attached to the roadway or the like and structurally partitioned for pedestrian passage. The width of the sidewalk varies depending on the amount of pedestrian traffic, but is generally about 1.5 to 3 m. If the width of the sidewalk is 1.5 m, the distance between two positions determined based on the sidewalk width may be set to 1.5 m. Alternatively, if the width of the sidewalk is 3 m or the like and exceeds the width of the vehicle, the distance between two positions determined based on the sidewalk width may be set as the maximum width of the photographing vehicle 9. Also, if there is an inspection road or a shoulder strip in addition to the sidewalk, the distance between two positions determined based on the sidewalk width may be set as the difference between the width of the sidewalk and the width of the inspection road or the shoulder strip.

When acquiring images at two positions, first, in a direction intersecting the traveling direction of the photographing vehicle 9, the camera unit 901 and the lighting unit 902 are fixed to one of two positions determined based on the width of the sidewalk, and an area image of the wall surface of the tunnel 6 in the desired area is acquired. Next, the camera unit 901 and the lighting unit 902 are fixed to the other of the two positions, and an area image of the wall surface of the tunnel 6 in the desired area is acquired.

In FIG. 3(A), the camera unit 901 and the lighting unit 902 are slid toward the driving direction and fixed to the left end of the slide unit 920. On the other hand, in FIG. 3(B), the lane 710 is on the left side of the center of the road 700, and the lane 720 is on the right side. The photographing vehicle 9 is traveling in the lane 710, toward the front of the page. Also, in FIG. 3(B), the sidewalk 730 is on the side of the lane 710 (the lane in which the photographing vehicle 9 is traveling).

F1 in Figure 3 (B) represents the range of photography by the photography system 8. In other words, the photography system 8 photographs an area 60 (indicated by a thick line) of the tunnel 6 wall within the photography range indicated by the dashed line F1. As indicated by the thick line, the photography system 8 photographs up to the boundary between the tunnel 6 wall (lining) and the ground. In this way, the photography system 8 photographs while driving the photography vehicle 9, so that the left half of the wall in Figure 3 (B) is photographed from the entrance to the exit of the tunnel 6 relative to the paper.

On the other hand, by driving the photographing vehicle 9 in the direction toward the paper in the lane 720, it is possible to capture an image of the wall surface in the right half of FIG. 3(B) in relation to the paper. In this case, the camera unit 901 and the lighting unit 902 are slid to the right side of the slide unit 920 in the direction of travel and fixed in place.

In this way, the evaluation system 1 can acquire an image of the entire wall surface (whole circumference) from the entrance to the exit of the tunnel 6 by stitching together an image of the left half of the wall surface and an image of the right half of the wall surface. Here, it is desirable that the image areas of the images captured by the imaging system 8 overlap. In addition, in order to stitch together the images to create a single tunnel unfolded image, it is desirable to capture the image of the side without a sidewalk and the image of the side with a sidewalk shown in FIG. 3(B) so that the ceiling parts overlap. In other words, when the imaging system 8 captures the wall surface of the tunnel 6 on the way there and back, it is desirable to capture the imaging area on the way there and the imaging area on the way back so that they overlap in a direction that intersects with the traveling direction of the imaging vehicle 9 so that no area of the wall surface of the tunnel 6 is not captured.

Here, we will provide some additional information regarding the "direction facing the wall of tunnel 6." Tunnel 6 has a semicircular cross section perpendicular to the traveling direction of the imaging vehicle 9. Therefore, the walls of tunnel 6 face horizontally near the ground, and face vertically downward near the ceiling. The "direction facing the wall of tunnel 6" refers to the direction facing the wall, which has different orientations depending on the location. The "direction facing the wall of tunnel 6" near the ground is approximately horizontal, etc. On the other hand, the "direction facing the wall of tunnel 6" near the ceiling is approximately vertically upward.

Hardware Configuration Next, the hardware configuration of each device constituting the evaluation system 1 will be described with reference to Fig. 4. Note that components may be added or deleted from the hardware configuration shown in Fig. 4 as necessary.

○Display device hardware configuration○
Fig. 4 is a diagram showing an example of the hardware configuration of a display device. Each hardware component of the display device 30 is indicated by a reference number in the 300 range. The display device 30 is constructed by a computer, and includes a CPU 301, a ROM 302, a RAM 303, a HD (Hard Disk) 304, a HDD controller 305, a display 306, an external device connection I/F 308, a network I/F 309, a bus line 310, a keyboard 311, a pointing device 312, a DVD-RW (Digital Versatile Disk Rewritable) drive 314, and a media I/F 316, as shown in Fig. 4.

Of these, the CPU 301 controls the operation of the entire display device 30. The ROM 302 stores programs used to drive the CPU 301, such as IPL. The RAM 303 is used as a work area for the CPU 301. The HD 304 stores various data such as programs. The HDD controller 305 controls the reading or writing of various data from the HD 304 according to the control of the CPU 301. The display 306 displays various information such as a cursor, a menu, a window, characters, or an image. The display 306 is an example of a display unit. The display 306 may be a touch panel display equipped with an input means. The external device connection I/F 308 is an interface for connecting various external devices. In this case, the external device is, for example, a USB memory or a printer. The network I/F 309 is an interface for data communication using the communication network 100. Bus line 310 is an address bus or a data bus for electrically connecting each component such as CPU 301 shown in FIG. 4.

The keyboard 311 is a type of input means having multiple keys for inputting characters, numbers, various instructions, etc. The pointing device 312 is a type of input means for selecting or executing various instructions, selecting a processing target, moving a cursor, etc. The input means may be not only the keyboard 311 and the pointing device 312, but also a touch panel or a voice input device, etc. The DVD-RW drive 314 controls the reading or writing of various data from the DVD-RW 313, which is an example of a removable recording medium. The removable recording medium is not limited to a DVD-RW, but may be a DVD-R or a Blu-ray (registered trademark) Disc, etc. The media I/F 316 controls the reading or writing (storing) of data from the recording medium 315, such as a flash memory.

○Hardware configuration of data management device○
Fig. 4 is a diagram showing an example of the hardware configuration of the data management device. Each piece of hardware configuration of the data management device 50 is indicated by a reference number in parentheses in the 500 range. The data management device 50 is constructed by a computer, and as shown in Fig. 4, has a similar configuration to the display device 30, so a description of each piece of hardware configuration will be omitted.

○Hardware configuration of communication terminal○
Fig. 4 is a diagram showing an example of the hardware configuration of a communication terminal. Each piece of hardware configuration of the communication terminal 80 is indicated by a reference number in parentheses in the 800 range. The communication terminal 80 is constructed by a computer, and as shown in Fig. 4, has a similar configuration to the display device 30, so a description of each piece of hardware configuration will be omitted.

The above programs may be distributed by recording them on a computer-readable recording medium in the form of an installable or executable file. Examples of recording media include CD-Rs (Compact Disc Recordable), DVDs (Digital Versatile Disks), Blu-ray Discs, SD cards, and USB memories. The recording media may be provided domestically or internationally as a program product. For example, the display device 30 realizes the display control method according to the present invention by executing the program according to the present invention.

Functional Configuration Next, the functional configuration of the evaluation system according to the embodiment will be described with reference to Figures 5 to 8. Figure 5 is a diagram showing an example of the functional configuration of the evaluation system. Note that Figure 5 shows devices or terminals shown in Figures 1 and 2 that are related to the processing or operation described below.

○Functional configuration of the display device○
First, the functional configuration of the display device 30 will be described with reference to Fig. 5. The display device 30 has a communication unit 31, a reception unit 32, a display control unit 33, a determination unit 34, an image processing unit 35, and a storage/readout unit 39. Each of these units is a function or means realized when any of the components shown in Fig. 4 operates in response to an instruction from the CPU 301 in accordance with a program for the display device that has been loaded from the HD 304 onto the RAM 303. The display device 30 also has a storage unit 3000 constructed by the ROM 302 and HD 304 shown in Fig. 4.

The communication unit 31 is mainly realized by the processing of the CPU 301 on the network I/F 309, and communicates various data or information with other devices via the communication network 100. The communication unit 31 receives, for example, data of the tunnel expansion image 951 stored in the data management device 50. The communication unit 31 also receives, for example, tile image data stored in the data management device 50.

The reception unit 32 is mainly realized by the processing of the CPU 301 on the keyboard 311 or the pointing device 312, and receives various selections or inputs from the user. The reception unit 32 receives, for example, various selections or inputs on the selection screen 200 or the image viewing screen 400 described below. The display control unit 33 is mainly realized by the processing of the CPU 301, and causes the display 306 to display various images. The display control unit 33 causes, for example, the selection screen 200 or the image viewing screen 400 described below to be displayed on the display 306.

The judgment unit 34 is realized by the processing of the CPU 301, and performs various judgments. The image processing unit 35 is mainly realized by the processing of the CPU 301, and performs various processes on the image data received by the communication unit 31. For example, the image processing unit 35 changes the brightness of the captured image displayed on the image viewing screen 400 (described later) in response to a request from the inspection company.

The storage/reading unit 39 is mainly realized by the processing of the CPU 301, and stores various data (or information) in the storage unit 3000 and reads various data (or information) from the storage unit 3000.

○Functional configuration of data management device○
Next, the functional configuration of the data management device 50 will be described with reference to Fig. 5. The data management device 50 has a communication unit 51, a judgment unit 52, a data creation unit 53, an image data generation unit 54, a document submission creation unit 55, and a storage/readout unit 59. Each of these units is a function or means realized by any of the components shown in Fig. 4 being loaded from the HD 504 onto the RAM 503 and operating according to an instruction from the CPU 501 in accordance with a program for the data management device. The data management device 50 also has a storage unit 5000 constructed by the ROM 502 and the HD 504 shown in Fig. 4.

The communication unit 51 is mainly realized by the processing of the CPU 501 on the network I/F 509, and communicates various data or information with other devices via the communication network 100. The communication unit 51 receives, for example, captured image data and various detection data transmitted from the communication terminal 80. In addition, the communication unit 51 transmits data of the tunnel expansion image 951 or tile image data to the display device 30 in response to a request from the display device 30. The judgment unit 52 is realized by the processing of the CPU 501, and makes various judgments.

The data creation unit 53 is mainly realized by the processing of the CPU 501, and creates data to be managed by the data management device 50. For example, the data creation unit 53 creates shooting information for associating and managing various data acquired by the shooting processing by the shooting vehicle 9. The data creation unit 53 also creates coordinate data 953 as shown in FIG. 6 based on the tunnel unfolded image 951 data and each detection data received by the communication unit 51.

The image data generating unit 54 is mainly realized by the processing of the CPU 501, and generates various image data. For example, the image data generating unit 54 generates data of a tunnel unfolded image 951 obtained by combining multiple captured images based on the captured image data and various detection data received by the communication unit 51. The image data generating unit 54 also generates tile image data using the data of the tunnel unfolded image 951, for example.

The document submission creation unit 55 is mainly realized by the processing of the CPU 501, and creates data for documents to be submitted to the government etc. (deformation development diagrams, photo registers, and tunnel inspection result summary sheets).

The storage/reading unit 59 is mainly realized by the processing of the CPU 501, and stores various data (or information) in the storage unit 5000 and reads various data (or information) from the storage unit 5000.

Tunnel unfolded image data and coordinate data Fig. 6 is a conceptual diagram showing an example of the relationship between the data of the tunnel unfolded image and the coordinate data in the evaluation system. The storage unit 5000 stores data of the tunnel unfolded image 951, detection data of each sensor such as distance measurement, comments, and data of the tunnel ledger. The coordinate data 953 is data created by the data creation unit 53 after acquiring the tunnel unfolded image and each detection data transmitted from the communication terminal 80.

In this embodiment, the data of the tunnel unfolded image 951 is image data obtained by combining multiple captured images acquired from the communication terminal 80. The data of the tunnel unfolded image 951 is simply image data when it is output from the camera of the photographing vehicle 9. Therefore, the positional relationship between the tunnel unfolded image 951 and the actual tunnel 6 is not clear. Therefore, the image data generating unit 54 uses the captured image data and detection data transmitted from the communication terminal 80 to generate data of the tunnel unfolded image 951 that combines multiple captured images so that the entrance to the exit of the tunnel 6 is shown in a single image. Then, the data creating unit 53 creates coordinate data 953 corresponding to the tunnel unfolded image 951 to clarify the positional relationship between the tunnel unfolded image 951 and the actual tunnel 6.

In addition, in FIG. 6, each span is shown in order from the entrance to the exit of the actual tunnel 6, starting from the first span. In this embodiment, a span is a concrete block made from formwork, and is an area separated every 10 m from the entrance of the actual tunnel. A span is also called a center, for example. FIG. 6 shows a tunnel expansion image 951 composed of images of multiple spans. Span numbers are written in a tunnel register provided by the government, etc. The span number is an example of area information that indicates the area of a structure that includes multiple areas. Note that the span interval differs depending on the type of tunnel 6, etc.

Furthermore, in the coordinate data 953, span numbers for the coordinate data are assigned from left to right, with the first span indicated by 0000, the second span indicated by 0001, and so on. Position coordinates (x, y) are used to indicate a specific position within each span. For example, even if any two points in the coordinate data are indicated by the same coordinates, different spans indicate different positions within the tunnel. Note that, in order to accommodate tunnels without spans, it is also possible to indicate specific positions within the tunnel unfolded image only by position coordinates, without using span numbers such as 0000.

○Photography information management table FIG. 7(A) is a conceptual diagram showing an example of a photography information management table. The acquired data management table is a table for managing photography information including various data acquired by the photography process by the photography unit 900. In the storage unit 5000, a photography information management DB 5001 configured by the photography information management table shown in FIG. 7(A) is constructed. This photography information management table manages photography information associated with an ID and name that identify the photography content by the photography vehicle 9, the photography time, and a URL (Uniform Resource Locator) that indicates the storage destination of various data transmitted from the communication terminal 80. Data acquired in one photography process is stored as photography information in the same URL (folder). Here, the URL is an example of storage destination information. The storage destination information is not limited to a URL, and may be a URI (Uniform Resource Identifier) or the like.

Span Information Management Table Fig. 7B is a conceptual diagram showing an example of a span information management table. The span information management table is a table for managing span information of the tunnel 6 shown in the tunnel expansion image 951. A span information management DB 5002 configured by the span information management table shown in Fig. 7B is constructed in the storage unit 5000. This span information management table manages span information in which a span number for identifying a span and coordinate data (x) corresponding to the span are associated. In addition, the span information management table manages span information for each folder (URL) in which the tunnel expansion image 951 is stored.

Image Information Management Table FIG. 8 is a conceptual diagram showing an example of the image information management table. The image information management table is a table for managing image information of tile image data of different resolutions generated by the image data generating unit 54. The storage unit 5000 has an image information management DB 5003 configured by the image information management table shown in FIG. 8. This image information management table manages image information associated with tile coordinates (x, y) indicating the position of the generated tile, coordinate data (x) indicating the position of the tile image in the tunnel development image 951, and span boundary coordinates (x) corresponding to the boundary position of the span of the tunnel development image 951, for each layer corresponding to the resolution of the generated tile image. Similarly to the span information management table, the image information management table manages image information for each folder (URL) in which the tunnel development image 951 is stored.

Now, the tile image data generated by the image data generating unit 54 will be described with reference to FIG. 9. FIG. 9 is a diagram for explaining an example of a schematic tile image. In this embodiment, a tile image is an image obtained by dividing the tunnel unfolded image 951 into tiles. The tile image expresses the tunnel unfolded image 951 using one or more tiles depending on the resolution. The size of one tile is 256 pixels by 256 pixels. Each tile has tile coordinates (x, y) for identifying its position in the tile image. Furthermore, the tile image indicates its resolution by the zoom level (z). That is, each tile included in the generated tile image is identified by the tile coordinates (x, y) and the zoom level (z).

In the example of FIG. 9, the tile image of layer 1 is an image with a maximum resolution at a zoom level (z) of "100". The tile image of layer 2 is an image with a zoom level (z) of "50" and a lower resolution than layer 1. The tile image of layer 3 is an image with a zoom level (z) of "25" and a lower resolution than layer 2. The tile image of layer 1 with the maximum resolution shown in FIG. 9 is an image with the resolution at the time of shooting (original resolution). The image data generation unit 54 hierarchically generates images with a lower resolution than the tile image of layer 1, and manages each of them using layers for each resolution (zoom level). Note that the number of layers and corresponding zoom levels managed by the data management device 50 are not limited to the example shown in FIG. 9.

Here, the inspection accuracy of the tunnel 6 is preferably such that cracks of approximately 0.3 mm or more in the wall surface of the tunnel 6 can be identified using the captured images. It is also required to distinguish between crack growth and seasonal changes from the captured images. Therefore, the imaging system 8 acquires captured images with a resolution and resolution that can meet such requirements during imaging.

○Functional configuration of communication terminal○
Next, the functional configuration of the communication terminal 80 will be described with reference to Fig. 5. The communication terminal 80 has a communication unit 81, a reception unit 82, a display control unit 83, a judgment unit 84, a photography control unit 85, a data acquisition unit 86, and a storage/readout unit 89. Each of these units is a function or means realized by any of the components shown in Fig. 4 being loaded from the HD 804 onto the RAM 803 and operating according to an instruction from the CPU 801 in accordance with a program for the communication terminal. The communication terminal 80 also has a storage unit 8000 constructed by the ROM 802 and the HD 804 shown in Fig. 4.

The communication unit 81 is mainly realized by the processing of the CPU 801 on the network I/F 809, and communicates various data or information with other devices via the communication network 100. The communication unit 81 transmits, for example, captured image data and detection data acquired by the photographing unit 900 to the data management device 50.

The reception unit 82 is mainly realized by the processing of the CPU 801 on the keyboard 811 or the pointing device 812, and receives various selections or inputs from the user. The display control unit 83 is mainly realized by the processing of the CPU 801, and causes various images to be displayed on the display 806. The judgment unit 84 is mainly realized by the processing of the CPU 801, and makes various judgments.

The photographing control unit 85 is mainly realized by the processing of the CPU 801 on the external device connection I/F 808, and controls the processing of the photographing unit 900 in response to a request from an inspection worker using the communication terminal 80. The data acquisition unit 86 is mainly realized by the processing of the CPU 801 on the external device connection I/F 808, and acquires photographed image data and various detection data obtained by the processing of the photographing unit 900.

The storage/reading unit 89 is mainly realized by the processing of the CPU 801, and stores various data (or information) in the storage unit 8000 and reads various data (or information) from the storage unit 8000.

Processing or operation of the embodiment Data upload processing
Next, the process or operation of the evaluation system according to the embodiment will be described with reference to Fig. 10 to Fig. 37. First, the process of uploading data acquired by the photography system 8 to the data management device 50 will be described with reference to Fig. 10. An inspection worker gets on the photography vehicle 9, photographs the wall surface of the tunnel 6, and uploads the acquired data to the data management device 50 using the communication terminal 80. A detailed description will be given below.

Figure 10 is a sequence diagram showing an example of data upload processing in the evaluation system. First, the inspection worker performs a predetermined input operation using an input means such as the keyboard 811, and the reception unit 82 of the communication terminal 80 receives a data acquisition start request (step S11). Then, the communication terminal 80 executes a data acquisition process using the photographing unit 900 while driving the photographing vehicle 9 (step S12). Specifically, the photographing control unit 85 outputs a photographing request to the photographing unit 900 to start photographing processing of the wall surface of the tunnel 6. The photographing unit 900 starts photographing processing using the camera unit 901 and detection processing by various sensors such as the TOF sensor 903 in synchronization with the photographing processing. Then, the data acquisition unit 86 acquires the photographed image data and various detection data obtained by the processing of the photographing unit 900.

Next, the inspection worker performs a predetermined input operation using an input means such as the pointing device 812, and the reception unit 82 receives a request to upload the various data acquired from the photographing unit 900 (step S13). The communication unit 81 then uploads (transmits) to the data management device 50 the photographed image data and various detection data acquired in step S12, the photographed date and time, and data such as comments entered by the inspection worker (step S14). As a result, the communication unit 51 of the data management device 50 receives the various data transmitted from the communication terminal 80.

The storage and readout unit 59 of the data management device 50 stores the various data received in step S14 in the photography information management DB 5001 (see FIG. 7(A)) (step S15). The storage and readout unit 59 stores the photographed image data and detection data in one folder in association with the photography date and time included in the received data. Specifically, the data creation unit 53 creates an ID and name that identify the contents of photography by the photography vehicle 9, and a URL that indicates the storage destination of the various data received in step S14. The storage and readout unit 59 also stores the received photographed image data and detection data in the created URL. The storage and readout unit 59 then stores the photography information associated with the created ID, name, and URL in the photography information management DB 5001.

Next, the image data generating unit 54 generates data for a tunnel unfolded image 951 as shown in FIG. 6 using the captured image data and detection data received in step S14 (step S16). The image data generating unit 54 generates data for the tunnel unfolded image 951 by combining multiple captured images so that the tunnel 6 entrance to exit is shown in a single image. The storage and reading unit 59 then stores the generated data for the tunnel unfolded image 951 in a storage location corresponding to the URL created in step S15.

The data creation unit 53 also creates span information and coordinate data corresponding to the data of the tunnel unfolded image 951 generated in step S16 (step S17). Specifically, the data creation unit 53 uses the various detection data received in step 14 to create coordinate data 953 corresponding to the data of the tunnel unfolded image 951 generated in step S16. The data creation unit 53 also creates span information that associates the span number and coordinate data corresponding to the span of the tunnel 6 shown in the tunnel unfolded image 951. The storage and reading unit 59 then stores the created coordinate data 953 in a storage location corresponding to the URL created in step S15.

Here, when the photographing vehicle 9 photographs the wall surface of the tunnel 6 while traveling in the tunnel, it is practically difficult for the photographing vehicle 9 to always travel at a constant speed and always maintain a constant distance from the wall surface of the tunnel 6. Moreover, the photographing vehicle 9 often tilts due to the unevenness of the road surface of the tunnel 6. Therefore, the data creation unit 53 creates the coordinate data 953 for the data of the tunnel unfolded image 951 while correcting it using the detection data of each sensor. For example, in FIG. 6, the starting point is determined by matching the position of the upper left corner of 0000 of the coordinate data 953 with the upper left corner of the first span of the tunnel unfolded image 951, so the data creation unit 53 can create the coordinate data 953 for the tunnel unfolded image 951 based on the determined starting point. Note that the data creation unit 53 may use the starting point set by the administrator of the data management device 50, or may use the starting point set automatically. When automatically setting the starting point, the data creation unit 53 can easily identify the entrance of the tunnel 6 from the captured image because the brightness value of the captured image changes suddenly at the entrance (the boundary between the inside and outside of the tunnel) of the tunnel.

Next, the storage/reading unit 59 stores the span information created in step S17 in the span information management DB 5002 (see FIG. 7B) (step S18). The storage/reading unit 59 associates each span number and coordinate data of the tunnel expansion image 951, and stores them in the span information management DB 5002 corresponding to the URL created in step S15.

Next, the image data generating unit 54 generates tile image data using the data of the tunnel expansion image 951 generated in step S16 (step S19). As shown in FIG. 9, the image data generating unit 54 generates tile image data of different resolutions using the tunnel expansion image 951. Then, the storing and reading unit 59 stores image information corresponding to the tile image data generated in step S19 in the image information management DB 5003 (see FIG. 8) (step S20). The storing and reading unit 59 associates, for each layer corresponding to the resolution of the generated tile image, tile coordinates indicating the coordinates of the generated tile image, coordinate data indicating the position of the tile image in the tunnel expansion image 951, and span boundary coordinates corresponding to the boundary position of the span of the tunnel expansion image 951, and stores them in the image information management DB 5003 corresponding to the URL created in step S15. The storing and reading unit 59 also stores the tile image data generated in step S19 in a storage location corresponding to the URL created in step S15.

In this way, the evaluation system 1 uploads to the data management device 50 the photographed image data of the tunnel 6 wall surface while the photographing vehicle 9 is traveling, and various detection data acquired in response to the photographing process.

○Evaluation of captured images○
Display Processing of Photographed Images Next, a process for evaluating the state of the tunnel 6 using the display device 30 will be described with reference to Fig. 11 to Fig. 37. First, a process for displaying photographed images of the wall surface of the tunnel 6 uploaded to the data management device 50 on the display device 30 will be described with reference to Fig. 11 to Fig. 13. Fig. 11 is a sequence diagram showing an example of display processing of photographed images in the evaluation system.

First, in response to a predetermined input operation on an input means such as the pointing device 312 of the inspection company, the communication unit 31 of the display device 30 transmits a data acquisition request to the data management device 50 (step S31). As a result, the communication unit 51 of the data management device 50 receives the data acquisition request transmitted from the display device 30.

Next, the storage/reading unit 59 of the data management device 50 reads out the shooting information stored in the shooting information management DB 5001 (see FIG. 7(A)) (step S32). Then, the communication unit 51 transmits the shooting information read out in step S32 to the display device 30 (step S33). As a result, the communication unit 31 of the display device 30 receives the shooting information transmitted from the data management device 50.

Next, the display control unit 33 of the display device 30 causes the display 306 to display a selection screen 200 for selecting data to be processed (step S34). FIG. 12 is a diagram showing an example of a selection screen displayed on the display device. The selection screen 200 shown in FIG. 12 is a display screen for selecting data to be processed that shows tunnel shooting results. The selection screen 200 includes display areas 210a, 210b (hereinafter referred to as display area 210 when there is no need to distinguish between them) showing each piece of shooting information received in step S33, a filter designation button 230 for filtering the shooting information to be displayed on the selection screen 200, a display number designation button 250 for designating the number of pieces of shooting information to be displayed on the selection screen 200, and a page switching button 235 for switching the pages displayed on the selection screen 200.

Of these, the display area 210 includes an ID and a name for identifying each piece of shooting information, as well as a summary image display button 211 (211a, 211b) that is pressed to display a summary image. The summary image is, for example, an overhead image showing the entire tunnel unfolded image 951 corresponding to the shooting information.

Next, the inspection company operates the pointer p1 using an input means such as the pointing device 312 to select the ID or name shown in the display area 210, and the reception unit 32 receives the selection of the processing target (step S35). In the example of FIG. 12, the reception unit 32 receives the selection of the data of the ID "A_001" and the name "○×1 Line" displayed in the display area 210a from the shooting information displayed in the display area 210. Then, the communication unit 31 transmits the URL of the shooting information to be processed received in step S35 and screen size information indicating the screen size of the image viewing screen 400 described later to the data management device 50 (step S36). This screen size information is information indicating the screen size of the image viewing screen 400. The screen size information indicates, for example, the number of pixels (number of horizontal pixels × number of vertical pixels), which is the amount of information that can be displayed on the image viewing screen 400. The screen size information may indicate the number of pixels that can be displayed in the image display area 410 of the image viewing screen 400 described below, or may indicate the number of pixels that can be displayed on the display 306 of the display device 30. In this way, the data management device 50 receives the URL to be processed and the screen size information transmitted from the display device 30.

The storage/reading unit 59 of the data management device 50 reads out image information stored in the image information management DB 5003 (see FIG. 8) that corresponds to the URL to be processed received in step S36 (step S37). In this case, the storage/reading unit 59 reads out image information stored in the image information management DB 5003 that is stored in a layer that corresponds to the resolution indicated in the screen size information received in step S36. The storage/reading unit 59 also reads out tile image data that corresponds to the image information read out from the image information management DB 5003 from a storage location that corresponds to the URL to be processed.

The storage/reading unit 59 also reads out the span information stored in the span information management DB 5002 (see FIG. 7(B)) corresponding to the URL to be processed received in step S36 (step S38). The communication unit 51 then transmits the tile image data and image information read out in step S37, as well as the span information read out in step S38, to the display device 30 (step S39). As a result, the communication unit 31 of the display device 30 receives the tile image data, image information, and span information transmitted from the data management device 50.

Then, the display control unit 33 of the display device 30 causes the display 306 to display an image viewing screen 400 for allowing the inspection company to view the captured image (step S40). FIG. 13 is a diagram showing an example of an image viewing screen displayed on the display device. The image viewing screen 400 shown in FIG. 13 includes an image display area 410 for displaying the captured image, a display state switching icon 430 that is pressed to switch the display state of the captured image, a slider 451 for changing the brightness of the captured image, a line of sight direction selection means 453 for switching the line of sight direction of the tunnel unfolded image 951, and a span display selection means 455 for switching whether or not to display span information.

Of these, the image display area 410 displays an image corresponding to the tile image data received in step S39. That is, the image display area 410 displays an image of at least a partial area of the tunnel expansion image 951. The image display area 410 also displays a span number 550 indicating the span corresponding to the displayed image. In the example of FIG. 13, the image display area 410 displays an image of the area of span numbers "0000" to "0004" in the initial state.

The viewing direction selection means 453 is a selection means for selecting whether the captured image to be displayed in the image display area 410 is to be displayed in a downward or upward viewing state, which have different viewing directions. Here, the downward viewing is a display of an image as viewed from outside the tunnel 6 (from above). On the other hand, the upward viewing is a display of an image obtained by photographing the image while looking up at the ceiling from inside the tunnel 6. In other words, the downward viewing and upward viewing are images that are upside down.

When the inspection company operates the line of sight direction selection means 453 using the pointer p1, the display control unit 33 changes (converts) the display of the captured image displayed in the image display area 410 between a downward view and an upward view. When displaying the captured image upside down, the display control unit 33 displays "y" in the coordinate data (x, y) as "-y". The image viewing screen 400 shown in FIG. 16 shows the state in which the downward view is selected. The deformation development diagram that must be submitted to the government office is an image viewed from the outside of the tunnel 6 (from above), and the inspection company can view the captured image in the state that it will be displayed in the actual deformation development diagram by selecting the downward view using the line of sight direction selection means 453, for example.

The span display selection means 455 is a selection means for selecting whether to display or not display span information corresponding to the captured image displayed in the image display area 410. The image viewing screen 400 shown in FIG. 16 shows a state in which display of span information has been selected. When display of span information is selected by the span display selection means 455, the display control unit 33 displays an image indicating the span number 550 corresponding to the captured image and an image of the boundary line of each span superimposed on the captured image displayed in the image display area 410. On the other hand, when non-display of span information is selected by the span display selection means 455, the display control unit 33 hides the span number 550 and the boundary line of each span.

The image viewing screen 400 also includes a magnification change means 470 for enlarging or reducing the displayed captured image, and a data display area 490 for displaying information about the displayed captured image.

Of these, the magnification change means 470 includes a magnification icon 471 that is pressed to enlarge the displayed captured image, a reduction icon 473 that is pressed to reduce the displayed captured image, and a slider 475 for adjusting the magnification (zoom). The inspection company operates each icon or slider 475 included in the magnification change means 470 with a pointer p1 using the input means to enlarge or reduce the captured image displayed in the image display area 410. Note that the inspection company may be configured to enlarge or reduce the displayed captured image by input operations such as clicking, double-clicking, dragging, swiping, pinching in or out on the image display area 410 using the input means.

The data display area 490 includes a magnification display area 491 that indicates the magnification (resolution) of the displayed captured image, a coordinate display area 493 that indicates the coordinate data of the captured image corresponding to the position of the pointer p1, and a span number display area 495 that indicates the span number of the captured image corresponding to the position of the pointer p1.

In this way, the display device 30 displays in the image display area 410 at least a portion of the tunnel unfolded image 951 stored in the data management device 50, and also displays the span number 550 in association with the displayed image. This allows the inspection company to easily understand which part of the tunnel 6 was captured in the captured image displayed on the image viewing screen 400.

Preparation and output process of documents to be submitted Next, a process of preparing documents to be submitted by an inspection agent to a government or the like will be described with reference to Figs. 14 and 15. Fig. 14 is a sequence diagram showing an example of the preparation process of documents to be submitted. Fig. 15 is a diagram for explaining an outline of an example of the preparation process of documents to be submitted.

As shown in FIG. 15, the reception unit 32 of the display device 30 receives input of drawings and diagnostic information for the captured image displayed on the image viewing screen 400 through the operation of the inspection company (step S40). Specifically, the inspection company draws crack lines and the like for the captured image displayed on the image viewing screen 400 and inputs the width of the crack lines. The inspection company also inputs diagnostic information including the evaluation results by referring to comments in the field notebook, etc. The inspection company may also use drawing software such as CAD (Computer-Aided Design) to draw or input information while looking at the captured image displayed on the image viewing screen 400.

Then, the communication unit 31 transmits to the data management device 50 a request to create documents to be submitted to the government, etc., together with the drawing data and input data accepted in step S40 (step S41). As a result, the communication unit 51 of the data management device 50 receives the request to create documents to be submitted together with the drawing data and input data.

Next, the storage/read unit 59 of the data management device 50 reads data such as the tunnel register from the storage unit 5000 in order to create the documents to be submitted (step S42). The document to be submitted creation unit 55 then uses the drawing data and input data received in step S41 and the tunnel register data read in step S42 to create the data for the documents to be submitted (deformation development diagram, photo register, and tunnel inspection result summary table) as shown in FIG. 15 (step S43).

Here, the deformation development diagram is a drawing that visually shows cracks and the like in the deformed portion. When creating a deformation development diagram, the inspection company draws crack lines and inputs the width of the crack lines while checking the field notebook, deformation photos, and tunnel ledger. The photo ledger is a ledger in which the evaluation results of deformations such as cracks are recorded, with the deformation photos attached. The inspection company attaches the deformation photos to the photo ledger and inputs diagnostic information including the evaluation results by referring to the comments in the field notebook. Furthermore, the tunnel inspection result summary table is a table in which information such as the tunnel length and the evaluation results are recorded. The inspection company refers to the tunnel ledger and records the tunnel length and the like in the tunnel inspection result summary table, and refers to the field notebook and inputs diagnostic information including the results of the deformation judgment.

Then, the communication unit 51 transmits the created data of the submitted document to the display device 30 (step S44). As a result, the communication unit 31 of the display device 30 receives the data of the submitted document transmitted from the data management device 50.

Next, as shown in FIG. 15, the display device 30 prints out the data of the documents to be submitted to the government or the like (step S45). This allows the inspection company to submit the data of the documents to the government office. Note that, depending on the rules of the government or other institutions, the inspection company may submit the data of the documents to the government office as is, without printing them.

Switching the display of a captured image (XX span number designation) Next, a process of switching the display of a captured image to be displayed on the image viewing screen 400 shown in Fig. 13 will be described with reference to Figs. 16 to 32. First, a process of displaying a captured image at a position corresponding to a span number designated by an inspection company will be described with reference to Figs. 16 to 21. Fig. 16 is a sequence diagram showing an example of a display process of a captured image corresponding to a designated span number.

First, as shown in FIG. 17, the inspection company operates the image viewing screen 400, and the reception unit 32 of the display device 30 receives the selection of the "span designation jump function" (step S101). Specifically, when the inspection company selects the display state switching icon 430 using the pointer p1, the display control unit 33 displays the selection image 610 shown in FIG. 17 on the image viewing screen 400. The selection image 610 is a selection area for selecting the operation content. The selection image 610 includes a selection icon 611 that is pressed to specify the span of the image to be displayed, a selection icon 613 that is pressed to display the captured image that matches the vertical width of the image display area 410, and a selection icon 615 that is pressed to display the displayed captured image at the original resolution. Then, as shown in FIG. 17, the inspection company selects the selection icon 611 using the pointer p1, and the reception unit 32 receives the selection of the "span designation jump function".

Next, the display control unit 33 displays the span selection image 630 shown in FIG. 18 on the image viewing screen 400 (step S102). The span selection image 630 shown in FIG. 18 is a selection image that accepts the designation of the span of the captured image to be displayed in the image display area 410. The span selection image 630 includes a slider 631 indicating the number of spans included in the tunnel unfolded image 951, a designation point 635 indicating the designated location of the span number in all spans, a "jump" button 637 pressed to switch the display to the designated span number, and a "cancel" button 639 pressed to cancel the execution of the span designation jump function. The inspection company can visually grasp which part of the tunnel 6 between the entrance and the exit is designated by the positions of the slider 631 and the designation point 635. Note that the span selection image 630 may be configured to include an input area that allows the inspection company to directly input the number of the designated span number instead of the slider format shown in FIG. 18.

Next, the inspection company moves the specified point 635 by operating the pointer p1 using an input means such as the pointing device 312, and presses the "jump" button 637, causing the reception unit 32 to receive a display image change request indicating a request to change the display to the captured image corresponding to the specified span number (step S103). In the example of FIG. 18, the reception unit 32 receives a request to change the display image to the captured image corresponding to span number "0071".

Next, the communication unit 31 transmits a display request for the captured image corresponding to the received change request to the data management device 50 (step S104). This display request includes the span number received in step S103 and screen size information indicating the screen size of the image viewing screen 400. Among these, the screen size information is information indicating the screen size of the image viewing screen 400. The screen size information indicates, for example, the number of pixels (number of horizontal pixels x number of vertical pixels), which is the amount of information that can be displayed on the image viewing screen 400. Note that the screen size information may indicate the number of pixels that can be displayed in the image display area 410, or may indicate the number of pixels that can be displayed on the display 306 of the display device 30. In this way, the communication unit 51 of the data management device 50 receives the display request transmitted from the display device 30.

The storage and reading unit 59 of the data management device 50 uses the span number received in step S104 as a search key to search the span information management DB 5002 (see FIG. 7B) corresponding to the URL to be processed received in step S36, and reads out span information associated with the same span number as the received span number (step S105). In this case, the storage and reading unit 59 reads out span information before and after the received span number, in addition to the span information corresponding to the received span number. The storage and reading unit 59 reads out a number of span information corresponding to the received screen size information, based on the number of horizontal pixels (number of horizontal pixels) indicated in the screen size information received in step S104 and the coordinate data indicated in the span information.

Next, the storage/reading unit 59 reads out image information of the layer corresponding to the received screen size information from the image information management DB 5003 (see FIG. 9) corresponding to the URL to be processed received in step S36, based on the number of vertical pixels (number of vertical pixels) and the resolution (number of pixels) of each layer indicated in the screen size information received in step S104 (step S106). In this case, the storage/reading unit 59 searches the corresponding layer in the image information management DB 5003 using the coordinate data indicated in the span information read in step S105 as a search key, thereby reading out image information associated with the coordinate data corresponding to the read coordinate data. The storage/reading unit 59 also reads out tile image data corresponding to the read image information from the storage location corresponding to the URL to be processed received in step S36.

The communication unit 51 transmits to the display device 30 the tile image data and image information read in step S106, and the span information read in step S105 (step S107). As a result, the communication unit 31 of the display device 30 receives the tile image data, image information, and span information transmitted from the data management device 50.

Then, the display control unit 33 of the display device 30 changes the display image displayed in the image display area 410 of the image viewing screen 400 (step S108). The display control unit 33 causes the captured image corresponding to the tile image data received in step S107 to be displayed in the image display area 410. The display control unit 33 also causes the span number 550 indicating the span of the captured image displayed in the image display area 410 to be displayed based on the image information and span information received in step S107.

Figure 19 shows an example of the image viewing screen 400 displayed in step S108. The image viewing screen 400 shown in Figure 19 displays the captured image with the span number "0071" specified in step S103 at its center in the image display area 410.

In this way, the display device 30 displays the captured image corresponding to the span number specified by the inspection company in the image display area 410. The display device 30 also automatically adjusts the display position and magnification of the captured image so that the captured image corresponding to the span fits within the image display area 410. This allows the inspection company to view the captured image of the specified span number with a simple operation when comparing submitted documents such as deformation development diagrams organized by span with the tunnel development image 951, for example, thereby reducing the burden required for creating submitted documents. Furthermore, by displaying the entire captured image of the specified span, the display device 30 makes it easier for the inspection company to find the area they want to view, improving the convenience of the inspection company.

20 and 21, another example of the span-specified jump function will be described. In step S103, the display control unit 33 may display the span selection image 630a shown in FIG. 20 on the image viewing screen 400 instead of the span selection image 630 shown in FIG. 18. In addition to the configuration of the span selection image 630, the span selection image 630a shown in FIG. 20 includes a shooting position selection means 640 for selecting the shooting position of the tunnel 6 in the captured image to be displayed in the image display area 410. The shooting position selection means 640 also includes a "left (L)" icon 641 that is pressed when displaying a captured image of the wall of the tunnel 6 on the left side of the traveling direction of the shooting vehicle 9, and a "right (R)" icon 643 that is pressed when displaying a captured image of the wall of the tunnel 6 on the right side of the traveling direction of the shooting vehicle 9.

For example, as shown in FIG. 2, the tunnel unfolded image 951 is an image that combines an image taken while the photographing vehicle 9 is traveling in one lane with an image taken while traveling in the other lane. Therefore, when the inspection company wants to focus on viewing one of the images taken while traveling in different lanes, the inspection company specifies the span number and selects the photographing position using the photographing position selection means 640.

In the example of FIG. 20, the inspection company specifies the span number "0071" and selects the "left (L)" icon 641, so that in step S103 the reception unit 32 receives a request to change the display image to the image captured on the left side of the travel direction of the span number "0071". Then, in step S104, the communication unit 31 transmits a display request including the span number, screen size information, and shooting position information indicating the selected shooting position to the data management device 50. In this case, the data management device 50 reads out image information of a tile image at a position corresponding to the shooting position (e.g., left (L)) indicated in the shooting position information from the image information management DB 5003 (see FIG. 9) corresponding to the URL to be processed received in step S36, based on the number of vertical pixels (number of vertical pixels) and shooting position information indicated in the received screen size information, and the layer resolution (number of pixels). The data management device 50 prestores coordinate data (y) that indicates approximately half of the vertical width of the tunnel expanded image 951, i.e., the position of the ceiling of the tunnel 6.

Then, in step S108, the display control unit 33 displays the captured image shown in FIG. 21 in the image display area 410 of the image viewing screen 400. The image viewing screen 400 shown in FIG. 21 displays in the image display area 410 the image on the left (L) side specified using FIG. 20, among the captured images centered on the specified span number "0071". Note that the image viewing screen 400 may be marked with L corresponding to the downward direction and R corresponding to the upward direction when the lane in which the photographing vehicle 9 is traveling has an upward direction and a downward direction. The image viewing screen 400 may also be marked with L corresponding to the upper side and R corresponding to the lower side in the downward viewing direction of the captured image.

In this way, the display device 30 can display the captured image corresponding to the shooting position specified by the inspection company in the image display area 410, allowing the inspection company to easily view the specified location.

XX Brightness Change Processing Next, a process for changing the brightness of a captured image displayed on the image viewing screen 400 shown in Fig. 13 will be described with reference to Fig. 22 to Fig. 24. Fig. 22 is a flowchart showing an example of the brightness change processing of a displayed captured image.

23, the inspection company operates the image viewing screen 400, and the reception unit 32 of the display device 30 receives a brightness change request (step S201). Specifically, the inspection company operates the slider 451 using the pointer p1, and the reception unit 32 receives a request to change the brightness to the position specified by the slider 451. The reception unit 32 receives, for example, a gamma value according to the movement amount (slide amount) of the slider 451 as a change request. Here, the slider 451 displays the current brightness of the captured image and is an operation area for specifying the brightness value to be changed. The inspection company can visually grasp the current brightness of the displayed captured image and the brightness after the change according to the position of the slider 451. Note that the image viewing screen 400 may be configured to include a display input area that displays the brightness value of the captured image instead of the slider 451 and allows the inspection company to directly input the brightness value after the change.

Next, the image processing unit 35 changes the brightness of the captured image displayed in the image display area 410 to the brightness specified in step S201 (step S202). Specifically, the image processing unit 35 uses the gamma value accepted in step S201 to calculate the luminance value of the captured image after the brightness change according to the following (Equation 1). Here, X is the luminance value before the brightness change, Y is the luminance value after the brightness change, and γ is the gamma value accepted in step S201. For example, in the default position of the slider 451, γ=1, and the luminance before the brightness change=the luminance after the brightness change.

The image processing unit 35 uses the calculated brightness value to perform image correction on the captured image displayed in the image display area 410. Note that the image processing unit 35 performs the same correction process on the multiple tile images displayed in the image display area 410. In other words, the image processing unit 35 performs image correction on all tile images received in step S39 using the calculated brightness value.

Then, the display control unit 33 changes the display image displayed in the image display area 410 of the image viewing screen 400 (step S203). The display control unit 33 displays the captured image whose brightness has been changed in step S202 in the image display area 410. FIG. 24 shows an example of the image viewing screen 400 displayed in step S203. The image viewing screen 400 shown in FIG. 24 displays in the image display area 410 a captured image whose brightness has been changed with respect to the captured image shown in the image display area 410 of FIG. 23.

In this way, the display device 30 can adjust the brightness of the captured image to make it easier to distinguish the contents of the captured image when the captured image is too bright or too dark due to the condition of the tunnel 6 wall surface or the influence of external light, etc. For example, when the captured image is too dark and cracks are difficult to see, the display device 30 can make the cracks easier to distinguish by brightening the entire image. Also, when chalk written on the wall surface shown in the captured image is difficult to see, the display device 30 can make the entire image darker to create contrast with the chalking and make it easier to distinguish.

XX Vertical Fit Function Next, a process of displaying a captured image corresponding to the screen size of the image viewing screen 400 on the image viewing screen 400 shown in FIG. 13 will be described with reference to FIG. 25 to FIG. 29. FIG. 25 is a sequence diagram showing an example of a display process of a captured image corresponding to the screen size of the image viewing screen. When viewing the tunnel unfolded image 951, the inspection company uses the magnification change means 470 or the like to enlarge or reduce the captured image displayed in the image display area 410 in order to check the details of the captured content. For example, while viewing an image, the inspection company uses the "vertical fit function" to display a captured image corresponding to the vertical size of the screen in the image display area 410 as in the initial state shown in FIG. 15. This will be described in detail below.

26, the inspection company operates the image viewing screen 400, and the reception unit 32 of the display device 30 receives the selection of the "fit to vertical width function" (step S301). Specifically, when the inspection company selects the display state switching icon 430 using the pointer p1, the display control unit 33 displays the selection image 610 shown in FIG. 26 on the image viewing screen 400. Then, as shown in FIG. 26, the inspection company selects the selection icon 613 using the pointer p1, and the reception unit 32 receives the selection of the "fit to vertical width function."

Next, the communication unit 31 transmits a display request for the captured image corresponding to the screen size of the image viewing screen 400 to the data management device 50 (step S302). This display request includes coordinate data of the captured image displayed in the image display area 410 and screen size information indicating the screen size of the image viewing screen 400. Among these, the coordinate data is, for example, data of the coordinates of the center position of the captured image displayed in the image display area 410. In addition, the screen size information indicates, for example, the number of pixels (number of horizontal pixels x number of vertical pixels), which is the amount of information that can be displayed on the image viewing screen 400. Note that the screen size information may indicate the number of pixels that can be displayed in the image display area 410, or may indicate the number of pixels that can be displayed on the display 306 of the display device 30. As a result, the communication unit 51 of the data management device 50 receives the display request transmitted from the display device 30.

The storage/reading unit 59 of the data management device 50 searches the span information management DB 5002 (see FIG. 7B) corresponding to the URL to be processed received in step S36 using the coordinate data received in step S302 as a search key, thereby reading out span information associated with the coordinate data corresponding to the received coordinate data (step S303). In this case, the storage/reading unit 59 reads out span information before and after the span number corresponding to the received coordinate data, along with the span information corresponding to the received coordinate data. The storage/reading unit 59 reads out a number of span information corresponding to the received screen size information, based on the number of horizontal pixels (number of horizontal pixels) indicated in the screen size information received in step S302 and the coordinate data indicated in the span information.

Next, the storage/reading unit 59 reads out image information of the layer corresponding to the received screen size information from the image information management DB 5003 (see FIG. 9) corresponding to the URL to be processed received in step S36, based on the number of vertical pixels (number of vertical pixels) and the resolution (number of pixels) of each layer indicated in the screen size information received in step S302 (step S304). In this case, the storage/reading unit 59 searches the corresponding layer in the image information management DB 5003 using the coordinate data indicated in the span information read in step S303 as a search key, thereby reading out image information associated with the coordinate data corresponding to the read coordinate data. The storage/reading unit 59 also reads out tile image data corresponding to the read image information from the storage location corresponding to the URL to be processed received in step S36.

The communication unit 51 transmits to the display device 30 the tile image data and image information read in step S304, and the span information read in step S303 (step S305). As a result, the communication unit 31 of the display device 30 receives the tile image data, image information, and span information transmitted from the data management device 50.

Then, the display control unit 33 of the display device 30 changes the display image displayed in the image display area 410 of the image viewing screen 400 (step S306). The display control unit 33 displays the captured image corresponding to the tile image data received in step S305 in the image display area 410. The display control unit 33 also displays a span number 550 indicating the span of the captured image displayed in the image display area 410 based on the image information and span information received in step S305. FIG. 27 shows an example of the image viewing screen 400 displayed in step S306. The image viewing screen 400 shown in FIG. 27 displays the captured image centered on the span number "0071" shown in the image display area 410 of FIG. 26, at a size corresponding to the vertical width of the image display area 410.

In this way, the display device 30 can display the captured image with its vertical width adjusted to fit the screen size of the image viewing screen 400, making it easy to check the entire circumference of the tunnel 6 at a specified point. The display device 30 also maintains the horizontal (sideways) display position of the captured image being displayed, and automatically adjusts the vertical (lengthways) display position and magnification. This allows the display device 30, for example, when checking for multiple abnormalities within a specified span, to first look down on the entire circumference of the span to find the abnormalities and then enlarge the display, improving convenience for the inspection company.

28 and 29, another example of the vertical width fit function will be described. In step S301, when the inspection company selects the selection icon 613 using the pointer p1, the display control unit 33 may display the display range selection image 620 shown in FIG. 28 on the image viewing screen 400. The display range selection image 620 shown in FIG. 28 includes a selection icon 621 that is pressed when the entire vertical width of the tunnel unfolded image 951 is to be displayed, a selection icon 623 that is pressed when the image of the tunnel unfolded image 951 photographed from the left (L) side is to be displayed, and a selection icon 625 that is pressed when the image of the tunnel unfolded image 951 photographed from the right (R) side is to be displayed.

In the example of FIG. 28, the inspection company selects the selection icon 623, and then selects the "left (L)" icon 641, and in step S301, the reception unit 32 receives the selection of the "vertical width fit function" for the left (L) side. Then, in step S302, the communication unit 31 transmits the shooting position information indicating the selected shooting position together with the coordinate data and screen size information to the data management device 50. In this case, the data management device 50 reads out the image information of the tile image at the position corresponding to the shooting position (for example, left (L)) indicated in the shooting position information from the image information management DB 5003 (see FIG. 9) corresponding to the URL to be processed received in step S36, based on the number of pixels in the vertical width (number of vertical pixels) and the shooting position information indicated in the received screen size information, and the resolution (number of pixels) of the layer. The data management device 50 prestores coordinate data (y) that indicates approximately half of the vertical width of the tunnel expanded image 951, i.e., the position of the ceiling of the tunnel 6.

Then, in step S306, the display control unit 33 displays the captured image shown in FIG. 29 in the image display area 410 of the image viewing screen 400. The image viewing screen 400 shown in FIG. 29 displays the image on the left (L) side specified using FIG. 28, among the captured images centered around the specified span number "0071", at a size corresponding to the vertical width of the image display area 410.

In this way, the display device 30 displays the captured image in such a way that the vertical width corresponding to the shooting position specified by the inspection company fits the screen size of the image viewing screen 400, thereby allowing the inspection company to display the specified location in a format that is easy for the inspection company to view.

XX pixel same size display function Next, a process of displaying a captured image with the original resolution on the image viewing screen 400 shown in FIG. 13 will be described with reference to FIG. 30 to FIG. 32. Here, the original resolution is the highest resolution of the captured images of the wall surface of the tunnel 6 as a system. That is, the image with the original resolution is the tile image with the highest resolution among the tile images with different resolutions stored in the data management device 50. The tile image with the highest resolution is, for example, an image with a resolution of 0.2 mm/pix. This corresponds to the resolution of the tunnel expanded image 951 generated by the image data generating unit 54 in step S16. FIG. 30 is a sequence diagram showing an example of a display process of an image with the original resolution corresponding to the displayed captured image.

First, as shown in FIG. 31, the inspection company operates the image viewing screen 400, and the reception unit 32 of the display device 30 receives the selection of the "actual pixel size function" (step S401). Specifically, when the inspection company selects the display state switching icon 430 using pointer p1, the display control unit 33 displays the selection image 610 shown in FIG. 31 on the image viewing screen 400. Then, as shown in FIG. 31, the inspection company selects the selection icon 615 using pointer p1, and the reception unit 32 receives the selection of the "actual pixel size function."

Next, the communication unit 31 transmits a display request for the captured image at the resolution at the time of shooting to the data management device 50 (step S402). This display request includes coordinate data of the captured image displayed in the image display area 410. This coordinate data is, for example, data of the coordinates of the center position of the captured image displayed in the image display area 410. As a result, the communication unit 51 of the data management device 50 receives the display request transmitted from the display device 30.

The storage/reading unit 59 of the data management device 50 searches the span information management DB 5002 (see FIG. 7(B)) corresponding to the URL to be processed received in step S36 using the coordinate data received in step S402 as a search key, thereby reading out span information associated with the coordinate data corresponding to the received coordinate data (step S403).

Next, the storage/reading unit 59 reads out image information of the layer of the image with the original resolution, which is the highest resolution image, from the image information management DB 5003 (see FIG. 9) corresponding to the URL to be processed received in step S36 (step S404). In this case, the storage/reading unit 59 searches the corresponding layer in the image information management DB 5003 using the coordinate data indicated in the span information read in step S403 as a search key, thereby reading out image information associated with the coordinate data corresponding to the read out coordinate data. The storage/reading unit 59 also reads out tile image data corresponding to the read out image information from the storage location corresponding to the URL to be processed received in step S36.

The communication unit 51 transmits to the display device 30 the tile image data and image information read in step S404, and the span information read in step S403 (step S405). As a result, the communication unit 31 of the display device 30 receives the tile image data, image information, and span information transmitted from the data management device 50.

Then, the display control unit 33 of the display device 30 changes the display image displayed in the image display area 410 of the image viewing screen 400 (step S406). The display control unit 33 displays the captured image corresponding to the tile image data received in step S405 in the image display area 410. The display control unit 33 also displays a span number 550 indicating the span of the captured image displayed in the image display area 410 based on the image information and span information received in step S405. FIG. 31 shows an example of the image viewing screen 400 displayed in step S406. The image viewing screen 400 shown in FIG. 31 displays the captured image centered on the span number "0071" shown in the image display area 410 of FIG. 30 in the original resolution in the image display area 410.

In this way, the display device 30 allows the inspection company to select the selection icon 615 to display an image with the resolution (maximum resolution) of the displayed captured image at the time of capture. For example, when enlarging and viewing the details of an abnormality, the image can be enlarged to the maximum resolution with minimal operations, thereby improving convenience for the inspection company.

Modifications of Image Viewing Screen Next, modifications of the image viewing screen 400 shown in Fig. 13 will be described with reference to Figs. 33 to 37. The image viewing screens 400a and 400b shown in Figs. 33 and 34 are display screens in the initial state displayed on the display device 30 in step S14, similar to the image viewing screen 400 shown in Fig. 13. First, the image viewing screen 400a shown in Fig. 33 displays an image around the span number "0050", which is the horizontal center of the tunnel unfolded image 951, in the image display area 410. The image viewing screen 400b shown in Fig. 34 displays an overhead image showing the entire tunnel unfolded image 951 in the image display area 410.

Next, the image viewing screens 400c1, 400c2, and 400c3 shown in Fig. 35 to Fig. 37 display information on the shooting position of the captured image displayed on the image viewing screen 400. First, the image viewing screen 400c1 shown in Fig. 35 displays the span number indicating the span of the captured image and the image 550a indicating the shooting position of the captured image superimposed on the image display area 410. The image 550a indicates the shooting position L or R after the span number. L indicates that the shooting position of the tunnel unfolded image 951 is the image on the left (L) side. On the other hand, R indicates that the shooting position of the tunnel unfolded image 951 is the image on the right (R) side. Note that the image viewing screen 400c1 may be marked with L corresponding to the down direction and R corresponding to the up direction when the lane on which the image capturing vehicle 9 is traveling has an uphill direction and a downhill direction. Furthermore, the image viewing screen 400c1 may be marked so that the upper side of the captured image in the downward viewing direction corresponds to L and the lower side corresponds to R. Furthermore, the image viewing screen 400c1 includes a span number display area 495a that indicates the span number and the shooting position of the captured image, instead of the span number display area 495 of the image viewing screen 400 shown in FIG. 13. The span number display area 495a indicates the shooting position, L or R, after the span number, just like the image 550a described above.

In addition, the image viewing screen 400c2 shown in FIG. 36 includes a shooting position display area 497 that indicates the shooting position of the captured image displayed in the image display area 410, instead of the coordinate display area 493 of the image viewing screen 400 shown in FIG. 13, etc. The shooting position display area 497 indicates the above-mentioned shooting position information and the above-mentioned L or R marking.

Furthermore, in addition to the configuration of the image viewing screen 400c1 shown in FIG. 35, the image viewing screen 400c3 shown in FIG. 37 displays a boundary line 660 indicating the ceiling position of the tunnel 6 superimposed on the image display area 410. Note that the display device 30 may be configured to display the boundary line 660 not only on the image viewing screen 400c3 but also on the image viewing screens 400, 400a, 400b, and 400c2.

In this way, the display device 30 can easily allow the inspection company to understand which part of the tunnel 6 the captured image is being displayed by displaying the captured position of the captured image or the position of the ceiling of the tunnel 6 in a distinguishable manner. The display device 30 may use any of the image viewing screens 400a, 400b, 400c1, 400c2, and 400c3 shown in FIGS. 33 to 37 to perform the process of switching the display of the captured image described with reference to FIGS. 16 to 32.

Effect of the embodiment As described above, when the evaluation system 1 displays the tunnel unfolded image 951, which is a composite of multiple photographed images of the tunnel 6, on the display device 30, the evaluation system 1 displays the span number corresponding to the displayed photographed image in association with the image. This allows the inspection company of the tunnel 6 to easily know which span of the tunnel 6 is being viewed when viewing the photographed images.

The evaluation system 1 also performs processing such as displaying the captured image of the specified span number or changing the brightness of the captured image being displayed, by simple operations on the image viewing screen 400 displayed on the display device 30. This allows the evaluation system 1 to immediately display on the display device 30 the image that the inspection company wants to view, thereby improving the convenience of the inspection company.

In the above embodiment, an example of inspecting and evaluating a tunnel 6 on a road has been described as an example of a structure, but the evaluation system 1 may be used for inspecting and evaluating various structures on a road, such as a road surface, a bridge, or a slope. The evaluation system 1 may also be used for inspecting and evaluating other structures, such as a building wall, an elevator wall, or a subway tunnel. In addition, the process of displaying a photographed image taken using a photographing vehicle 9 has been described as an example of a moving body, but the evaluation system 1 may be configured to display photographed images taken by other moving bodies such as a drone or by moving people. Furthermore, an example of viewing a photographed image using an image viewing screen 400 displayed on the display device 30 has been described, but the evaluation system 1 may be configured to display the image viewing screen 400 on a communication terminal 80 mounted on the photographing vehicle 9 to view the photographed image.

●Summary●
As described above, the display device according to one embodiment of the present invention is the display device 30 that displays a captured image of a tunnel 6 (an example of a structure) including a plurality of spans (an example of an area). The display device 30 receives data (an example of image data) of a tunnel unfolded image 951 in which a plurality of captured images are combined from a data management device 50 that stores the captured images, and displays a tile image (an example of a captured image) corresponding to at least a portion of the data of the received tunnel unfolded image 951 in association with a span number (an example of area information) indicating the span corresponding to the tile image on the image viewing screen 400 (an example of a display screen). This allows the display device 30 to allow a user to grasp the span of the tunnel 6 shown in the displayed captured image.

In addition, the display device according to one embodiment of the present invention accepts the designation of a span (an example of an area) to be displayed on the image viewing screen 400 (an example of a display screen) from the received data (an example of image data) of the tunnel unfolded image 951, and transmits a display request for the photographed image corresponding to the accepted span to the data management device 50. Then, in response to the transmitted display request, the display device 30 receives a tile image (an example of a photographed image) corresponding to the span from the data management device 50, and associates the tile image corresponding to the received span with the span number (an example of area information) and displays it on the image viewing screen 400. In addition, the display device 30 receives a tile image corresponding to the screen size of the image viewing screen 400 from the data management device 50, and displays the tile image corresponding to the received screen size on the image viewing screen 400. As a result, when an inspection company compares submitted documents such as a deformation development diagram with the tunnel unfolded image 951, for example, the display device 30 can display the photographed image of the span number specified by a simple operation, thereby reducing the load required for the inspection company to prepare submitted documents. In addition, the display device 30 can display the entire captured image for a specified span, making it easier for the inspection company to find the part they want to view, improving convenience for the inspection company.

Furthermore, the display system according to one embodiment of the present invention includes a display device 30 and a data management device 50. The data management device 50 generates a plurality of tile image data with different resolutions of the tunnel unfolded image 951 (an example of image data). The display device 30 receives the generated tile image data and coordinate data 953 indicating the position of the tile image data on the tunnel unfolded image 951 from the data management device 50, and displays the captured image corresponding to the received tile image data on the image viewing screen 400. The data management device 50 also receives screen size information indicating the screen size of the image viewing screen 400 and a span number indicating the span from the display device 30, and transmits the tile image data corresponding to the received screen size and span to the display device 30. As a result, the display system according to one embodiment of the present invention displays tile images with a resolution corresponding to the screen size of the image viewing screen 400 displayed on the display device 30, so that the captured image can be displayed in a format that is easier for the inspection company to view.

●Additional Information●
Each function of the above-described embodiment can be realized by one or more processing circuits. Here, the "processing circuit" in the present embodiment includes a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, as well as devices such as ASIC, DSP (digital signal processor), FPGA, SOC (System on a chip), GPU (Graphics Processing Unit), and conventional circuit modules designed to execute each function described above.

The various tables in the above-described embodiments may be generated by the learning effect of machine learning, and by classifying the data of each associated item by machine learning, tables may not be used. Here, machine learning is a technology for making a computer acquire human-like learning capabilities, and refers to a technology in which a computer autonomously generates an algorithm required for judgment such as data identification from learning data that is previously loaded, and applies this to new data to make predictions. The learning method for machine learning may be any of supervised learning, unsupervised learning, semi-supervised learning, reinforcement learning, and deep learning, or may be a combination of these learning methods, and any learning method for machine learning may be used.

So far, we have described a display device, display system, display control method, and program according to one embodiment of the present invention, but the present invention is not limited to the above-mentioned embodiment, and can be modified within the scope of what a person skilled in the art can imagine, such as adding, changing, or deleting other embodiments, and any aspect is within the scope of the present invention as long as it achieves the functions and effects of the present invention.

1. Evaluation system (an example of a display system)
6. Tunnels (an example of a structure)
8. Photography system 9. Photography vehicle (an example of a moving body)
30 Display device 31 Communication unit (an example of a receiving means, an example of a transmitting means)
32 Reception unit (an example of a reception means)
33 Display control unit (an example of a display control means)
35 Image processing unit 50 Data management device 51 Communication unit (an example of a communication means)
54 Image data generating unit (an example of an image data generating means)
80 Communication terminal 200 Selection screen 400 Image viewing screen (an example of a display screen)
550 Span number (an example of area information)
550a Image (an example of area information)
900: Photographing unit 951: Tunnel development image (an example of image data)
953 Coordinate data 5001 Shooting information management DB
5002 Span information management DB
5003 Image information management DB

JP 2002-288180 A

Claims (18)

A display device for displaying an image,
a receiving means for receiving a designation of an area to be displayed on a display screen of a tunnel unfolded image obtained by combining a plurality of photographed images of a tunnel wall surface by designating a span indicating the area of the tunnel wall surface ;
a display control means for displaying on the display screen a tunnel wall image corresponding to the span received by the reception means and a span number corresponding to the span received by the reception means in association with each other;
A display device comprising: A display device for displaying an image,
a display control means for displaying on a display screen at least a part of a tunnel development image obtained by combining a plurality of photographed images of the tunnel wall surface ;
A reception means for receiving a designation of an area to be displayed on the display screen of the tunnel unfolded image by designating a span indicating an area of the tunnel wall surface ;
a transmission means for transmitting a request for a tunnel wall image corresponding to the span received by the reception means to a data management device;
a receiving means for receiving from the data management device image data of the tunnel wall surface image corresponding to the span accepted by the accepting means as a response to the transmitted request;
Equipped with
The display control means is a display device that displays on the display screen a tunnel wall image corresponding to the span accepted by the acceptance means and received by the receiving means , in association with the span number corresponding to the span accepted by the acceptance means . The display device described in claim 1 or 2, wherein the display control means displays on the display screen a tunnel wall image corresponding to the span accepted by the acceptance means and a tunnel wall image corresponding to a span adjacent to the span accepted by the acceptance means, and displays the span boundary line between each of the tunnel wall images. The display device according to claim 1 , wherein the tunnel unfolded image is composed of images of a plurality of the spans. The display device according to claim 1 , wherein the reception unit receives the designation of the span indicating the area of the tunnel wall by designating a span number. The receiving means receives a request to change the brightness of the tunnel wall image displayed on the display screen ,
The display device according to claim 1 , wherein the display control means causes the tunnel wall image, the brightness of which has been changed in response to the received change request, to be displayed on the display screen. The receiving means receives a display request at a predetermined resolution,
The display device according to claim 1 , wherein the display control means switches the display of the tunnel wall image displayed on the display screen to the predetermined resolution in response to a received display request. A display system including a display device that displays an image and a data management device,
The display device includes:
a display control means for displaying on a display screen at least a part of a tunnel development image obtained by combining a plurality of photographed images of the tunnel wall surface ;
a receiving means for receiving a designation of a tunnel wall surface to be displayed on the display screen from the tunnel unfolded image by designating a span indicating an area of the tunnel wall surface;
a display device side transmitting means for transmitting a request for a tunnel wall image corresponding to the span received by the receiving means to the data management device;
a display device side receiving means for receiving from the data management device image data of the tunnel wall surface image corresponding to the span accepted by the accepting means as a response to the transmitted request;
Equipped with
The data management device includes:
a data management device side receiving means for receiving the request transmitted by the display device side transmitting means;
a data management device side transmitting means for transmitting image data of a tunnel wall surface image corresponding to the request to the display device;
Equipped with
The display control means is a display system that associates a tunnel wall image corresponding to the span accepted by the reception means, received by the display device side receiving means, with a span number corresponding to the span accepted by the reception means, and displays them on the display screen. The data management device includes:
The display system according to claim 8, further comprising a data creation means for creating span information that associates a span number corresponding to the span in the tunnel unfolded image with coordinate data based on detection data when the tunnel wall surface is photographed. The data management device includes:
10. The display system according to claim 8, further comprising an image data generating means for generating the tunnel unfolded image by synthesizing a plurality of images of the tunnel wall surface. A data management device that stores image data of a tunnel wall,
a data creation means for creating span information that associates span numbers corresponding to spans in a tunnel development image obtained by combining a plurality of photographed images of the tunnel wall surface with coordinate data, based on detection data obtained when the tunnel wall surface is photographed;
A transmission means for transmitting image data of the tunnel wall image obtained by photographing the tunnel wall to a display device;
a receiving means for receiving a request for a tunnel wall image corresponding to the span transmitted by the display device and accepted by the accepting means of the display device;
Equipped with
The transmitting means is a data management device that transmits image data of a tunnel wall image corresponding to the request to the display device. The data management device according to claim 11, further comprising an image data generating means for generating the tunnel unfolded image by synthesizing a plurality of photographed images of the tunnel wall surface. A display control method executed by a display device that displays an image, comprising:
a receiving step of receiving a designation of an area to be displayed on a display screen of a tunnel development image obtained by combining a plurality of photographed images of a tunnel wall surface by designating a span indicating the area of the tunnel wall surface ;
a display control step of displaying on the display screen a tunnel wall image corresponding to the span accepted in the accepting step and a span number corresponding to the span accepted in the accepting step in association with each other;
A display control method that performs the following: A display control method executed by a display device that displays an image, comprising:
a display control step of displaying on a display screen at least a part of a tunnel development image obtained by combining a plurality of photographed images of the tunnel wall surface;
a receiving step of receiving a designation of an area to be displayed on the display screen of the tunnel unfolded image by designating a span indicating an area of the tunnel wall;
a sending step of sending a request for a tunnel wall image corresponding to the span received in the receiving step to a data management device;
a receiving step of receiving, from the data management device, image data of the tunnel wall image corresponding to the span accepted in the accepting step as a response to the transmitted request;
Run
The display control step is a display control method for displaying on the display screen a tunnel wall image corresponding to the span accepted in the acceptance step and received in the receiving step, in association with a span number corresponding to the span accepted in the acceptance step. An information processing method executed by a data management device that stores image data of a tunnel wall, comprising:
a data creation step of creating span information corresponding to a tunnel development image obtained by combining a plurality of images of the tunnel wall surface based on detection data obtained when the tunnel wall surface is photographed;
A transmission step of transmitting image data of a tunnel wall image obtained by photographing the tunnel wall to a display device;
a receiving step of receiving a request for a tunnel wall image corresponding to the span transmitted by the display device and accepted by the accepting means of the display device;
Run
The information processing method includes transmitting image data of a tunnel wall image corresponding to the request to the display device in the transmitting step. A display device for displaying an image,
a receiving step of receiving a designation of an area to be displayed on a display screen of a tunnel development image obtained by combining a plurality of photographed images of a tunnel wall surface by designating a span indicating the area of the tunnel wall surface ;
a display control step of displaying on the display screen a tunnel wall image corresponding to the span accepted in the accepting step and a span number corresponding to the span accepted in the accepting step in association with each other;
A program that executes the following. A display device for displaying an image,
a display control step of displaying on a display screen at least a part of a tunnel development image obtained by combining a plurality of photographed images of the tunnel wall surface;
a receiving step of receiving a designation of an area to be displayed on the display screen of the tunnel unfolded image by designating a span indicating an area of the tunnel wall;
a sending step of sending a request for a tunnel wall image corresponding to the span received in the receiving step to a data management device;
a receiving step of receiving, from the data management device, image data of the tunnel wall surface image corresponding to the span accepted in the accepting step as a response to the transmitted request;
Run the command,
The display control step is a program for displaying on the display screen a tunnel wall image corresponding to the span accepted in the acceptance step received in the receiving step and a span number corresponding to the span accepted in the acceptance step in association with each other. A data management device stores image data of a tunnel wall.
a data creation step of creating span information corresponding to a tunnel development image obtained by combining a plurality of images of the tunnel wall surface based on detection data obtained when the tunnel wall surface is photographed;
A transmission step of transmitting image data of a tunnel wall image obtained by photographing the tunnel wall to a display device;
a receiving step of receiving a request for a tunnel wall image corresponding to the span transmitted by the display device and accepted by the accepting means of the display device;
Run the command,
The transmitting step is a program for transmitting image data of a tunnel wall image corresponding to the request to the display device.