JP7613887B2 - Information processing system and information processing program - Google Patents

Description

The present invention relates to an information processing system and an information processing program.

Three-dimensional graphic generation systems related to three-dimensional CAD and the like have been known in the past (see, for example, Patent Document 1).

JP 2016-15083 A

However, in general, when it comes to 3D CAD and the like, the operations required to handle 3D structural drawing information are complicated, and only a limited number of users are able to use them.

The present invention has been made in consideration of the above-mentioned facts, and aims to provide an information processing system and an information processing program that can improve the convenience of drawing information related to three-dimensional structures.

In order to solve the above-mentioned problems and achieve the objective, the information processing system described in claim 1 is an information processing system that performs information processing on two-dimensional drawing information indicating a two-dimensional building image, which is an image of a two-dimensional drawing displaying at least a building, and is equipped with a storage means in which association information for interrelating the two-dimensional building image indicated by the two-dimensional drawing information and the three-dimensional structure of the building, and a processing means that performs information processing on the two-dimensional drawing information based on the association information stored in the storage means, and the association information is information that interrelates information indicating a position on the two-dimensional building image and three-dimensional coordinate information based on the three-dimensional structure.

The information processing system of claim 2 is the information processing system of claim 1, in which the two-dimensional drawing information includes first drawing information and second drawing information that display at least a portion of a common area that is common to both, and when the processing means edits the portion of the first drawing information that displays the common area based on an instruction from a user, it also edits the portion of the second drawing information that displays the common area.

The information processing system described in claim 3 is the information processing system described in claim 2, in which the first drawing information and the second drawing information display two-dimensional drawings of different types.

The information processing system described in claim 4 is the information processing system described in any one of claims 1 to 3, in which the storage means stores, as the associated information, information that associates multiple positions in the two-dimensional drawing information with three-dimensional coordinate information based on the three-dimensional structure of the building.

The information processing system according to claim 5 is the information processing system according to claim 4, further comprising a storage control means for storing, in the storage means as the associated information, information in which the positions indicated by the first input information and the three-dimensional coordinate information indicated by the second input information are mutually associated when first input information indicating the multiple positions and second input information indicating the three-dimensional coordinate information are input to the information processing system.

The information processing program described in claim 6 is an information processing program that processes information about two-dimensional drawing information indicating a two-dimensional building image, which is an image of a two-dimensional drawing displaying at least a building, and causes a computer to function as a processing means that performs information processing on the two-dimensional drawing information based on association information stored in a storage means in which association information for interrelating the two-dimensional building image indicated by the two-dimensional drawing information and the three-dimensional structure of the building is stored, and the association information is information that interrelates information indicating a position on the two-dimensional building image and three-dimensional coordinate information based on the three-dimensional structure.

According to the information processing system described in claim 1 and the information processing program described in claim 6, by performing information processing on two-dimensional drawing information based on association information, it is possible to perform information processing on two-dimensional drawing information in association with the three-dimensional structure of a building without using an application such as a so-called three-dimensional CAD, thereby improving convenience.

According to the information processing system described in claim 2, when the portion displaying the common area in the first drawing information is edited based on an instruction from a user, the portion displaying the common area in the second drawing information is also edited, so that, for example, editing can be performed synchronously with respect to the common area, thereby improving convenience.

According to the information processing system described in claim 3, since the first drawing information and the second drawing information display two-dimensional drawings of different types, for example, the two-dimensional drawings that are different from each other can be edited synchronously, thereby improving convenience.

According to the information processing system described in claim 4, information in which multiple positions in the two-dimensional drawing information are mutually associated with three-dimensional coordinate information based on the three-dimensional structure of the building is stored as associated information. Therefore, for example, when information input by a user (e.g., a captured image or text information) is associated with the three-dimensional coordinate information, even if the two-dimensional drawing information is replaced, it is possible to display the information input by the user at an appropriate position in the replaced two-dimensional drawing information.

According to the information processing system described in claim 5, by storing information in which multiple positions indicated by the first input information are mutually associated with three-dimensional coordinate information indicated by the second input information as associated information, it becomes possible to appropriately associate, for example, two-dimensional drawing information with a three-dimensional structure.

1 is a block diagram showing a functional concept of an information processing system according to an embodiment of the present invention; 1 is a perspective view showing a building to which the present embodiment is applied. FIG. 1 is a diagram showing the first floor of a building. FIG. 1 is a diagram showing the second floor of a building. FIG. 1 is a diagram illustrating a building model. 11 is a diagram illustrating an example of building plan specific information. FIG. 13 is a diagram illustrating an example of a building plan image. FIG. 13 is a diagram illustrating an example of a building plan image. FIG. 11 is a diagram illustrating an example of target object identification information. 11 is a diagram illustrating an example of input information specifying information. FIG. 2 is a diagram illustrating a captured image. 13 is a display example of a building plan image. 13 is a display example of a building plan image. 13 is a display example of a building plan image. FIG. 1 is a diagram illustrating a building model. FIG. 13 is a diagram illustrating an example of a building plan image. FIG. 13 is a diagram illustrating an example of a building plan image. 13 is a display example of a building plan image. 13 is a flowchart of an information display process. 13 is a display example of a building plan image. 13 is a display example of a building plan image. 13 is a display example of a building plan image. FIG. 1 is a diagram illustrating a building model.

The following describes in detail an embodiment of an information processing system and an information processing program according to the present invention with reference to the attached drawings.

[I] Basic Concept of the Embodiment First, the basic concept of the embodiment will be described. The embodiment relates to an information processing system and an information processing program. The information processing system according to the present invention is a system for performing information processing on two-dimensional drawing information, and includes, for example, a storage unit and a processing unit, and optionally includes a storage control unit.

"Two-dimensional drawing information" is information that indicates a two-dimensional drawing that displays at least a building, and is a concept that includes any type of data, such as image data (for example, data in JPEG format, PNG format, TIF format, etc.), vector data, and PDF data.

A "two-dimensional drawing" is a drawing that shows at least a portion of a building in two dimensions, and optionally also shows the surroundings of the building in two dimensions. Examples of the drawing include plans, elevations, cross sections, and perspective views.

"Storage means" is a concept that includes means for storing associated information. "Associated information" is a concept that includes information for associating two-dimensional drawing information with the three-dimensional structure of a building, for example, information that associates multiple positions in two-dimensional drawing information with three-dimensional coordinate information based on the three-dimensional structure of a building.

The term "processing means" refers to a concept that includes means for performing information processing on two-dimensional drawing information based on the associated information stored in the storage means. "Information processing on two-dimensional drawing information" refers to a concept that includes, for example, a display process, a process for associating various pieces of information, or an editing process. And, the term "processing means" refers to a concept that includes, for example, a means for editing the part displaying the common area in the second drawing information when the part displaying the common area in the first drawing information is edited based on an instruction from a user.

The term "storage control means" refers to a concept including means for storing, in a storage means, information in which the multiple positions indicated by the first input information and the three-dimensional coordinate information indicated by the second input information are mutually associated with each other, as associated information, when first input information indicating multiple positions and second input information indicating three-dimensional coordinate information are input to an information processing system.

In the embodiment described below, for example, we will explain the application of the information processing system and information processing program to information about a building under construction.

[II] Specific Contents of the Embodiment Next, specific contents of the embodiment will be described.

(composition)
First, Fig. 1 is a block diagram showing the functional concept of an information processing system according to this embodiment, Fig. 2 is a perspective view showing a building to which this embodiment is applied, Fig. 3 is a view showing the first floor of the building, and Fig. 4 is a view showing the second floor of the building. In the following description, the X-Y-Z directions shown in Fig. 2 are directions perpendicular to each other, specifically, the Z direction is the vertical direction, and the X and Y directions are horizontal directions perpendicular to the vertical direction, and are described as corresponding to the directions exemplified in Fig. 2, for example.

(Composition - Building)
2 is a building to be displayed in a two-dimensional drawing, for example, a building that is the subject of construction. This building 900 is, for example, a five-story building, and has a first floor portion including rooms 101 and 102 shown in FIG. 3, a second floor portion including the rooms shown in FIG. 4, and the like.

(Configuration - Information Processing System)
1 includes, for example, a terminal device 1 and a server device 2, and these devices are capable of communicating with each other. Note that the information processing system 100 includes a plurality of terminal devices carried by various users (workers, inspectors, managers, etc.), but in this embodiment, the system will be described by illustrating only one terminal device 1 in FIG. 1 as a representative example.

(Configuration - Information Processing System - Terminal Device)
The terminal device 1 in FIG. 1 is a device carried by a user, for example a tablet terminal, and includes, as one example, a communication unit 11, a touchpad 12, a display 13, a camera 14, a recording unit 15, and a control unit 16.

The communication unit 11 is a communication means for communicating with an external device (e.g., the server device 2). The touchpad 12 is an operation means for accepting various operational inputs from a user. The display 13 is an image display means for displaying various images, and for example, the touchpad 12 and the display 13 are integrally formed as a touch panel. The camera 14 is an imaging means for capturing images to obtain them. The recording unit 15 is a recording means for recording programs and various data. The control unit 16 is a control means for controlling the terminal device 1, and is configured using, for example, a CPU, a RAM, and internal memories such as a ROM.

(Configuration - Information Processing System - Server Device)
The server device 2 in FIG. 1 includes, for example, a communication unit 21, a recording unit 22, and a control unit 23.

(Configuration - Information Processing System - Server Device - Communication Unit)
The communication unit 21 in FIG. 1 is a communication unit that communicates with an external device (for example, the terminal device 1).

(Configuration - Information Processing System - Server Device - Recording Unit)
1 is a recording means for recording programs and various data necessary for the operation of the server device 2. The recording unit 22 includes, for example, a building three-dimensional model specific information database 221 (hereinafter, the database is referred to as "DB"), a building plan specific information DB 222, an object specific information DB 223, and an input information specific information DB 224.

(Configuration - Information processing system - Server device - Recording unit - Building three-dimensional model specific information DB)
1 is a storage unit that stores building three-dimensional model specific information. The "building three-dimensional model specific information" is information that specifies a three-dimensional model that indicates the three-dimensional structure (including the external structure and the internal structure) of a building, and is a concept that includes, for example, information to which so-called BIM (Building Information Modeling) technology is applied.

Figure 5 is a diagram illustrating a building model. The building model M900 in Figure 5 is a three-dimensional model that shows the three-dimensional structure (including the external structure and the internal structure) of the building 900 in Figure 2, and is a three-dimensional model in which three-dimensional coordinate information is set based on an orthogonal coordinate system consisting of XYZ axes with an arbitrary position (in the case of Figure 5, the position shown as "(0,0,0)") as the origin.

Regarding this coordinate system, we will explain a case where it is set so that, for example, "1" in the coordinates corresponds to 1 mm so as to correspond to the dimensions of the building 900 in Figure 2 shown by the building model M900. That is, for example, "(0,0,0)" in Figure 5 is three-dimensional coordinate information indicating a position corresponding to point 31 on the building 900 in Figure 2, and "(30000,0,0)" in Figure 5 is three-dimensional coordinate information indicating a position corresponding to point 32 on the building 900 in Figure 2. Therefore, by referring to each piece of three-dimensional coordinate information, it is possible to determine that point P32 in Figure 2 is 30000 mm to the east of point P31.

In the building 3D model identification information DB221 in FIG. 1, for example, information identifying the building model M900 in FIG. 5 is stored as building 3D model identification information. Note that this building 3D model identification information is stored, for example, by inputting various information into the server device 2.

(Configuration - Information processing system - Server device - Recording unit - Building drawing specific information DB)
The building plan identification information DB 222 in FIG. 1 is a storage unit for storing the building plan identification information. FIG. 6 is a diagram illustrating an example of the building plan identification information. The "building plan identification information" is information related to the plan of the building 900, and for example, the information of each item shown in FIG. 6 is mutually associated. The information in the item "building plan ID" is a building plan ID for uniquely identifying the plan of the building 900. The information in the item "building plan image information" is the above-mentioned two-dimensional plan information, and is building plan image information for displaying a two-dimensional building image (building plan image) which is an image of the two-dimensional plan of the building 900. FIGS. 7 and 8 are diagrams illustrating examples of building plan images. As this building plan image information, for example, "B001.jpg" (information for displaying a floor plan of the first floor) and "B003.jpg" (information for displaying an elevation view of the east side) in FIGS. 7 and 8 are stored. The information in the item "building plan type information" is building plan type information indicating the type of the building plan image. The information in the item "Building Plan Position Reference Information" is the aforementioned association information, which is information that mutually associates a position on the building plan image (e.g., a pixel) with three-dimensional coordinate information based on the three-dimensional structure of the building 900 (three-dimensional coordinate information on the building model M900 in FIG. 5). In FIG. 6, pixels are illustrated as "P11" and the like for convenience. A specific method for storing this building plan specific information will be described later.

(Configuration - Information processing system - Server device - Recording unit - Object identification information DB)
The object identification information DB 223 in FIG. 1 is an object identification information storage means for storing object identification information. FIG. 9 is a diagram illustrating an example of object identification information. "Object identification information" is information for identifying an object (such as a temporary scaffold) to be placed in the building 900, and for example, information of each item shown in FIG. 9 is mutually associated. Information in the item "Object ID" is an object ID for uniquely identifying an object. Information in the item "Object type, etc. information" is object type, etc. information indicating the type and three-dimensional dimensions (dimensions in the XYZ axis directions) of an object. Note that this object identification information is stored, for example, by inputting each piece of information into the server device 2.

(Configuration - Information processing system - Server device - Recording unit - Input information specific information DB)
The input information identification information DB 224 in FIG. 1 is an input information identification information storage means for storing the input information identification information. FIG. 10 is a diagram illustrating an example of the input information identification information. The "input information identification information" is information related to information input by a user, and for example, the information of each item shown in FIG. 10 is associated with each other. FIG. 11 is a diagram illustrating an example of a captured image. The information of the item "input information" is input information input by a user. This input information is arbitrary, but for example, "R601.jpg" indicating the captured image of FIG. 11 captured by the user (a captured image showing a stain image G300 indicating a stain on a wall) and "R602.txt" indicating text information "Painting work confirmation" input by the user are stored. The information corresponding to the item "Position information" is position information (three-dimensional coordinate information) indicating the position to which the input information is associated. A specific method of storing the input information identification information will be described later.

(Configuration - Information Processing System - Server Device - Control Unit)
1 is a control means for controlling the server device 2, and functionally includes, for example, a processing unit 231 and a storage control unit 232. The processing unit 231 is the processing means described above. The storage control unit 232 is the storage control means described above. The processes performed by each unit of the control unit 23 will be described later.

(process)
Next, a description will be given of processes executed by the information processing system 100 according to the present embodiment. For example, a building plan specific information storage process, a building plan image information editing process, an input information specific information storage process, and an information display process will be described.

(Processing - Building drawing specific information storage processing)
The building plan specific information storage process will be described. The building plan specific information storage process is a process for storing the building plan specific information in FIG. 6. Here, the case of storing the information in the top row of FIG. 6 will be described. In this process, first, for example, when the building plan image in FIG. 7 is scanned with a scanner or obtained from a so-called CAD system and input to the server device 2, the storage control unit 232 of the server device 2 stores the "Building Plan ID" = "ID001" (unique automatically generated information) and "Building Plan Image Information" = "B001.jpg" (information indicating the input building plan image) in FIG. 6.

Figure 12 is an example of a display of a building plan image. Next, when the user performs a predetermined operation on the terminal device 1, the control unit 16 of the terminal device 1 accesses the server device 2 to obtain the "building plan image information" = "B001.jpg" in Figure 6, and displays the building plan image of Figure 12 on the display 13.

Next, when the user taps on point 81 in the building plan image of FIG. 12 to input "(0,0,0)" as the three-dimensional coordinate information corresponding to the tapped point 81, taps on point 82 to input "(30000,20000,0)", and inputs "floor plan" as the type of the plan being displayed, the terminal device 1 transmits information based on the above inputs or taps to the server device 2.

Here, for example, the terminal device 1 transmits "P11-(0,0,0)", "P12-(30000,20000,0)", and the "floor plan" to the server device 2, and the storage control unit 232 of the server device 2 stores the "floor plan" and "P11-(0,0,0), P12-(30000,20000,0)" illustrated in FIG. 6 based on this transmitted information.

Note that "P11" and "P12" sent to the server device 2 indicate the pixels of points 81 and 82 tapped by the user in the building plan image of FIG. 12. These may also be interpreted as corresponding to the "first input information." Furthermore, "(30000, 20000, 0)" and "(30000, 20000, 0)" sent to the server device 2 are three-dimensional coordinate information. These may also be interpreted as corresponding to the "second input information." This concludes the explanation of the building plan specific information storage process.

(Processing - Building drawing image information editing processing)
The building plan image information editing process will be described. The building plan image information editing process is a process for editing and updating the building plan image information in Fig. 6. Fig. 13 and Fig. 14 are display examples of building plan images, Fig. 15 is a diagram illustrating a building model, and Fig. 16 and Fig. 17 are diagrams illustrating a building plan image.

In this process, first, when the user performs a predetermined operation (operation to display the desired building image) on the terminal device 1, the control unit 16 of the terminal device 1 accesses the server device 2 to obtain the "Building Plan Image Information" = "B001.jpg" in Figure 6 (i.e., the building plan image showing the building image desired by the user), and displays the building plan image in Figure 13 on the display 13.

Next, the user edits the building plan image information showing the displayed building plan image by inputting information indicating the object to be placed into the terminal device 1. Note that the information to be input here is arbitrary, but for example, information indicating the object identified by the object identification information in FIG. 9 is input. As an example, information indicating a temporary scaffolding with dimensions of "1800 x 1200 x 1600", the position where the temporary scaffolding is to be placed, the number of spans (number in the horizontal direction), and the number of steps (number in the vertical direction) is input. Here, for example, information indicating a temporary scaffolding with dimensions of "1800 x 1200 x 1600", the position shown by the dashed line in FIG. 14, "number of spans" = "4", and "number of steps" = "2" is input.

In addition, the information indicating the position where the temporary scaffolding is to be placed may be configured to be input by, for example, tracing the dashed line portion of FIG. 14 with a finger, or may be configured to be input by tapping the position corresponding to the start point or end point.

Next, the control unit 16 of the terminal device 1 transmits each of the input information to the server device 2, and the processing unit 231 of the server device 2 receives the transmitted information and edits the building plan image information based on the received information. Here, for example, the processing unit 231 of the server device 2 receives information transmitted from the terminal device 1 regarding a temporary scaffolding with dimensions of "1800 x 1200 x 1600", the position illustrated by the dashed line in FIG. 14, "number of spans" = "4", and "number of steps" = "2", and based on the received information, edits the building plan image of FIG. 14 by adding an object plan image G1 (an image showing a temporary scaffolding with dimensions of "1800 x 1200 x 1600" for four spans) (FIG. 16) corresponding to the information indicating the object input by the user, and stores and updates the information indicating the edited building plan image.

In addition to the above-mentioned editing, the processing unit 231 of the server device 2 also performs editing corresponding to the building plan image into which information was directly input (here, editing to add object drawing image G2 of FIG. 17, which is an image showing two layers of temporary scaffolding stacked from ground level and measuring 1800 x 1200 x 1600) on the building plan image (the image of FIG. 8 shown by "B003.jpg") that includes an area in which information showing the input object is located among building plan images other than the building plan image into which information was directly input by the user (the image of FIG. 14 shown by "B001.jpg"), and stores and updates information showing the edited building plan image.

Note that, for example, in the building plan position reference information of FIG. 6, two pixels located at specific positions in the building plan image are associated with three-dimensional coordinate information, so by referencing this information, it is possible to grasp the three-dimensional coordinate information of any position in the building plan image, and it is also possible to grasp that the area shown by the dashed dotted line in FIG. 14 is common to the area shown in the object plan image G2 in FIG. 17. The above-mentioned processing may be performed based on this. Alternatively, in this case, the above-mentioned processing may be performed by virtually arranging an object model M901 corresponding to the information indicating the input object, as shown in FIG. 15.

That is, for example, when a user edits the building plan image of FIG. 14 to place an object, the processing unit 231 of the server device 2 will edit and update "B001.jpg" in FIG. 6, which shows the image of FIG. 7, to information showing the image of FIG. 16, and will also edit and update "B003.jpg" in FIG. 6, which shows the image of FIG. 8, to information showing the image of FIG. 17.

The building plan image information displaying the building plan images in Figures 16 and 17 may be interpreted as corresponding to the "first plan information" or the "second plan information", and the area corresponding to the area in which the object plan images G1 and G2 are shown in Figures 16 and 17 may be interpreted as corresponding to the "common area". This concludes the explanation of the building plan image information editing process.

(Processing - Input information specific information storage processing)
The input information specifying information storage process will be described below. The input information specifying information storage process is a process for storing the input information specifying information in Fig. 10. Fig. 18 is a display example of a building plan image.

In this process, first, when the user performs a predetermined operation on the terminal device 1 (an operation for displaying a desired building image), the control unit 16 of the terminal device 1 performs the above-mentioned process to display the building plan image of FIG. 18.

Next, when the user captures the image of FIG. 11 with the camera 14 in room 101 (FIG. 3) of the building 900 and taps on point 901 in FIG. 18 as the position on the image to which the captured image is to be associated (the position corresponding to the captured position), the control unit 16 of the terminal device 1 transmits the captured image and pixel information indicating the pixel corresponding to point 901 to the server device 2.

Next, the processing unit 231 of the server device 2 receives the pixel information and captured image from the terminal device 1, and by referring to the building plan identification information of FIG. 6, acquires building plan position reference information associated with the building plan image information indicating the image displayed on the terminal device 1, and identifies three-dimensional coordinate information corresponding to the pixel indicated by the received pixel information based on the acquired building plan position reference information, and stores the information indicating the received captured image as input information in the input information identification information of FIG. 10, and also stores the identified three-dimensional coordinate information as position information.

Here, for example, the processing unit 231 of the server device 2 receives the pixel information corresponding to point 901 in FIG. 18 and the captured image (R601.jpg) in FIG. 11, and refers to the building plan identification information in FIG. 6 to acquire "P11-(0,0,0), P12-(30000,20000,0)" associated with "B001.jpg" indicating the image displayed on the terminal device 1. Based on the acquired information, it becomes possible to identify the three-dimensional coordinate information of every position (i.e., every pixel) of the image indicated by "B001.jpg". Therefore, it identifies "(0,Y3,0)" as the three-dimensional coordinate information corresponding to the pixel of point 901 in FIG. 18, and stores the information in the top row of FIG. 10.

For example, if the user taps on point 902 in FIG. 18 on the terminal device 1 and then inputs the text information "Painting work confirmation," the information in the second row in FIG. 10 is stored by performing the same process as described above. Here, the explanation of the input information specific information storage process will be omitted.

(Processing - Information Display Processing)
The information display process will be described. FIG. 19 is a flowchart of the information display process (in the following description of each process, steps are abbreviated as "S"). The information display process is a process for displaying various information on the terminal device 1 carried by a user who is a worker. When a user inputs information showing a desired building plan image via the touch pad 12, the terminal device 1 transmits the input information, and the information is started when the server device 2 receives the information. The process will be described from the point where the process is started.

Here, we will explain an example in which "B001.jpg" in Figure 6 has been edited as described above, the user inputs this "B001.jpg", and the server device 2 receives the information.

In SA1 of FIG. 19, the processing unit 231 of the server device 2 displays the building plan image desired by the user. For example, by referring to the building plan identification information of FIG. 6, it identifies the building plan image information and building plan position reference information corresponding to the information received when the information display process was started, and by referring to the input information identification information of FIG. 10, it identifies the input information whose position on the image indicated by the identified building plan image information is the position information based on the building plan position reference information, generates image information for displaying an image indicating the position of the identified input information in the building plan image indicated by the identified building plan image information, and transmits the generated image information to the terminal device 1, thereby displaying an image corresponding to the image information on the display 13.

Figure 20 is an example of a display of a building plan image. Here, for example, by referring to the building plan identification information of Figure 6, "B001.jpg" and "P11-(0,0,0), P12-(30000,20000,0)" corresponding to the information of "B001.jpg" received when the information display process was started are identified. In this case, it is possible to identify the three-dimensional coordinate information of every position (i.e., every pixel) of the image indicated by "B001.jpg" based on "P11-(0,0,0), P12-(30000,20000,0). Next, by referring to the input information identification information of Figure 10, "R601.jpg" and "R602.txt" are identified as input information whose position on the building plan image of Figure 16 indicated by the above-mentioned identified "B001.jpg" is the position information. Next, image information is generated for displaying images (information notification images G901 and G902 in FIG. 20) indicating the positions of "R601.jpg" and "R602.txt" (i.e., "(0, Y3, 0)" and "(X4, Y4, 0)") in the building plan image in FIG. 16 indicated by the identified "B001.jpg," and the building plan image in FIG. 20 corresponding to the image information is displayed on the display 13 by transmitting the generated image information to the terminal device 1.

In SA2 of FIG. 19, the processing unit 231 of the server device 2 displays the input information. For example, when the user taps on the information notification image G901 or G902 of FIG. 20, the terminal device 1 transmits information indicating the tapped information notification image, and when the server device 2 receives the information, it refers to the input information identification information of FIG. 10 to obtain input information corresponding to the received information, and transmits the obtained input information to the terminal device 1, thereby displaying it on the display 13.

Figures 21 and 22 are examples of displaying building plan images. Here, for example, if the user taps on information notification image G901, the captured image indicated by "R601.jpg" (Figure 10) is displayed on the display 13, as shown in Figure 21. Also, for example, if the user taps on information notification image G902, the text information indicated by "R602.txt" (Figure 10) is displayed on the display 13, as shown in Figure 22. This concludes the explanation of the information display process.

(Effects of this embodiment)
According to this embodiment, by performing information processing on two-dimensional drawing information (building drawing image information) based on association information (building drawing position reference information), it is possible to perform information processing on the two-dimensional drawing information in association with the three-dimensional structure of the building 900 without using an application such as a so-called three-dimensional CAD, thereby improving convenience.

In addition, when the portion of the first drawing information that displays the common area is edited based on an instruction from the user, the portion of the second drawing information that displays the common area can also be edited, for example, to perform synchronous editing of the common area, thereby improving convenience.

In addition, since the first drawing information and the second drawing information display two-dimensional drawings of different types (plan and elevation views), for example, the different two-dimensional drawings can be edited synchronously, thereby improving convenience.

In addition, information that associates multiple positions (pixels) in the two-dimensional drawing information with the three-dimensional coordinate information of the building model M900 based on the three-dimensional structure of the building 900 is stored as associated information. For example, when information input by the user (e.g., a captured image or text information) is associated with the three-dimensional coordinate information, even if the two-dimensional drawing information is replaced, it is possible to display the information input by the user at an appropriate position in the replaced two-dimensional drawing information.

In addition, by storing information that correlates multiple positions (pixels) indicated by the first input information with the three-dimensional coordinate information indicated by the second input information as association information, it becomes possible to appropriately associate, for example, two-dimensional drawing information with a three-dimensional structure.

[III] Modifications to the embodiments The above describes the embodiments of the present invention, but the specific configurations and means of the present invention can be modified and improved as desired within the scope of the technical ideas of each invention described in the claims.

(Definition of space)
The three-dimensional coordinate information and the name of the space in the above embodiment may be associated with each other. FIG. 23 is a diagram illustrating a building model. For example, the space illustrated by the dotted line in FIG. 23 corresponding to room 101 in FIG. 3 may be defined as "room 101", and the three-dimensional coordinates in the space illustrated by the dotted line may be associated with "room 101". In this case, for example, the captured image in FIG. 11 (that is, the captured image indicated by "R601.jpg" in FIG. 10) can be associated with "room 101", so that when the captured image is displayed in the building plan image in FIG. 21, text information such as "room 101" may be further displayed at the edge of the captured image.

In addition, in the object identification information of FIG. 9, other information about the object (for example, information indicating weight, etc.) may also be associated and stored. In addition, in the building plan image of FIG. 20, when a user traces and selects all or a part of the object plan image G1, the processing unit 231 of the server device 2 may be configured to output the number and weight, etc. of temporary scaffolding, which is the object indicated by the selected object plan image G1.

In addition, the building 3D model specific information stored in the building 3D model specific information DB221 in FIG. 1 may use information other than information to which BIM technology is applied, for example, information showing the general structure of a building (information that is coarser than BIM).

Reference Signs List 1 Terminal device 2 Server device 11 Communication unit 12 Touch pad 13 Display 14 Camera 15 Recording unit 16 Control unit 21 Communication unit 22 Recording unit 23 Control unit 31 Point 32 Point 81 Point 82 Point 100 Information processing system 221 Building three-dimensional model specific information DB
222 Building drawing specific information DB
223 Object identification information DB
224 Target image etc. specific information DB
231 Processing unit 232 Storage control unit 900 Building 901 Point 902 Point G1 Object drawing image G2 Object drawing image G300 Stains image G901 Information notification image G902 Information notification image M900 Building model M901 Object model

Claims (6)

An information processing system for processing information on two-dimensional drawing information showing a two-dimensional building image, which is an image of a two-dimensional drawing showing at least a building,
a storage means for storing association information for associating the two-dimensional building image indicated by the two-dimensional drawing information with a three-dimensional structure of the building;
a processing means for performing information processing on the two-dimensional drawing information based on the association information stored in the storage means ,
The association information is information that associates information indicating a position on the two-dimensional building image with three-dimensional coordinate information based on the three-dimensional structure.
Information processing system. The two-dimensional drawing information includes first drawing information and second drawing information at least partially displaying a common area that is common to each other,
when the processing means edits a portion of the first drawing information that displays the common area based on an instruction from a user, the processing means also edits a portion of the second drawing information that displays the common area.
The information processing system according to claim 1 . The first drawing information and the second drawing information represent different types of the two-dimensional drawings.
The information processing system according to claim 2 . The storage means includes:
The information in which a plurality of positions in the two-dimensional drawing information and three-dimensional coordinate information based on the three-dimensional structure of the building are mutually associated is stored as the association information.
The information processing system according to any one of claims 1 to 3. a storage control means for storing, when first input information indicating the plurality of positions and second input information indicating the three-dimensional coordinate information are input to the information processing system, information in which the plurality of positions indicated by the first input information and the three-dimensional coordinate information indicated by the second input information are mutually associated in the storage means as the associated information,
5. The information processing system according to claim 4. An information processing program for processing information on two-dimensional drawing information showing a two-dimensional building image, which is an image of a two-dimensional drawing showing at least a building,
Computer,
a processing means for performing information processing on the two-dimensional drawing information based on association information stored in a storage means in which association information for associating the two-dimensional building image indicated by the two-dimensional drawing information with the three-dimensional structure of the building is stored;
The association information is information that associates information indicating a position on the two-dimensional building image with three-dimensional coordinate information based on the three-dimensional structure.
Information processing program.

Images