JP2025089677A - Information processing device and information processing method - Google Patents

Abstract

To improve efficiency of discussion about a site among participants into a virtual space.SOLUTION: An information processing device: holds knowledge information indicating data about a site including a 3D model of the site, and a position corresponding to the data; displays a first virtual space constructed by the 3D model of a project management room on a display device; displays a miniature 3D model obtained by reducing the 3D model of the site, and display contents which are the data selected from the knowledge information, on the first virtual space; identifies coordinates in the miniature 3D model, and corresponding to the position of the data corresponding to the display contents, on the basis of the 3D model of the site and the position of the selected data; and highlights the identified coordinates in the miniature 3D model.SELECTED DRAWING: Figure 1

Description

The present invention relates to an information processing device and an information processing method.

Background of the present invention is JP2022-505469A (Patent Document 1). This publication states that "multiple visualization objects may be provided to represent one or more data sets in a virtual 3D space. The visualization objects may include funnels, containers, name cards, etc. The visualization objects may be arranged in a circular carousel that can rotate around a virtual camera or a user's position in the VR/AR environment. Individual data points within the visualization objects may be rotated, sized, positioned, colored, or otherwise characterized based on attributes of the corresponding data points. Individual data points may also be animated as transitions between visualization objects in a unified view. Voice commands may be interpreted as part of an interactive environment that can provide views of visualization objects to multiple devices simultaneously" (see abstract).

Special Publication No. 2022-505469

The technology described in Patent Document 1 places individual data points in a visualization object in a virtual 3D space according to the attributes of the data points, but does not link the data placed in the virtual 3D space with the location in the site where the data was obtained. Therefore, one aspect of the present invention displays the correspondence between the data placed in the virtual space and the location in the site in a manner that is easy for participants in the virtual space to recognize, thereby making discussions about the site among participants more efficient.

In order to solve the above problem, one aspect of the present invention employs the following configuration. An information processing device includes a processor and a memory, and is connected to a display device. The memory holds knowledge information indicating data related to the site, including a 3D model of the site, and a position corresponding to the data, and virtual space management information indicating a first virtual space constructed by a 3D model of a project management room. The processor displays the first virtual space on the display device, displays a miniature 3D model that is a reduced version of the 3D model of the site in the first virtual space, accepts selection of data included in the knowledge information, displays the selected data in the first virtual space as display content, and identifies coordinates in the miniature 3D model that correspond to the position of the data corresponding to the display content based on the 3D model of the site and the position indicated by the knowledge information of the selected data, and highlights the identified coordinates in the miniature 3D model.

According to one aspect of the present invention, the correspondence between data placed in a virtual space and the location at the site is displayed in a manner that is easy for participants in the virtual space to recognize, thereby making discussions about the site among participants more efficient.

Problems, configurations, and advantages other than those described above will become clear from the description of the embodiments below.

1 is a block diagram showing an example of the configuration of a discussion space providing system in a first embodiment. 2 is a diagram illustrating an example of a data configuration of a knowledge DB (DataBase) in the first embodiment. FIG. 4 is a diagram illustrating an example of a data configuration of virtual space management information according to the first embodiment. FIG. FIG. 4 is a diagram showing an example of a data configuration of miniature 3D model management information in the first embodiment. 5 is a diagram illustrating an example of a data configuration of display content management information according to the first embodiment. FIG. 5 is a diagram showing an example of a data configuration of corresponding coordinate management information in the first embodiment. FIG. 5 is a diagram illustrating an example of a data configuration of user management information according to the first embodiment. FIG. 5 is a flowchart illustrating an example of an initial setting process according to the first embodiment. 4 is a flowchart illustrating an example of a steady-state process in the first embodiment. 11 is a flowchart illustrating an example of a participant instruction response process in the first embodiment. 11 is a flowchart illustrating an example of a room layout update process in the first embodiment. FIG. 2 is a plan view showing an example of a project management room in the first embodiment. FIG. 13 is a diagram showing an example of a screen configuration of a query input screen in the first embodiment. FIG. 13 is a diagram showing an example of a screen configuration of a search result display screen in the first embodiment.

The following describes in detail an embodiment of the present invention with reference to the drawings. In this embodiment, the same components are generally designated by the same reference numerals, and repeated explanations are omitted. It should be noted that this embodiment is merely one example for realizing the present invention, and does not limit the technical scope of the present invention.

Figure 1 is a block diagram showing an example of the configuration of a discussion space providing system. The discussion space providing system includes a discussion space providing device 100, a participant terminal 200 used by participants, and a worker terminal 300 used by on-site workers, and each participant terminal 200 and each worker terminal 300 is connected to the discussion space providing device 100 via a network 400 such as the Internet.

The discussion space providing device 100 provides an on-site 3D space and a project management room as a 3D (Three-Dimensional) virtual space (hereinafter simply referred to as virtual space or space). Places where work is carried out, such as large factories or plants, and some areas within large factories or plants (for example, rooms within large factories or plants), are all examples of on-sites. The on-site 3D space is a 3D space constructed as a copy of the on-site space.

The project management room is a virtual space that is different from the site 3D space. In the project management room, for example, 3D models (3D models include three-dimensional shape information) that construct the site 3D space, miniature 3D models of equipment placed at the site, and data related to the site are displayed. Hereinafter, these miniature 3D models (i.e., reduced 3D models) are also referred to as miniature 3D models, and the data related to the site displayed in the project management room is also referred to as display content.

The participant terminal 200 may be, for example, a PC (Personal Computer), smartphone, or tablet terminal on which an application is installed that enables the participant to enter a virtual space, such as the metaverse, and interact with other participants, the administrator of the discussion space providing system, and on-site workers, or may be a headset including a goggle-type display device, headphones, a microphone, and a gyro sensor (for example, a VR (Virtual Reality) headset).

The worker terminal 300 is, for example, a PC, smartphone, or tablet terminal that is carried by a worker on-site and has an application installed that enables the worker on-site to communicate with participants who use the participant terminal 200.

The worker terminal 300 periodically measures the position of the worker on-site using, for example, a GPS (Global Positioning System) function or PDR (Pedestrian Dead Reckoning) using angular velocity obtained by a gyro sensor or the like, and transmits the position information of the worker to the discussion space providing device 100, whereby the position information of the worker is accumulated in the knowledge DB 121 described below. Note that the position of the worker may be captured, for example, by a surveillance camera installed on-site, and periodically transmitted to the discussion space providing device 100, whereby the position information of the worker is accumulated in the knowledge DB 121.

A participant using the participant terminal 200, for example, causes an icon representing the participant to enter the virtual space via an input device (e.g., a mouse, keyboard, touch panel, or microphone) provided on the participant terminal 200. An image according to the position, orientation, and viewing angle of the icon is displayed on the output device of the participant terminal 200. For example, via the input device provided on the participant terminal 200, the participant can move the icon in the virtual space within the virtual space or to a different virtual space, or change the field of view displayed on the display device provided on the participant terminal 200 (for example, change the viewing angle or line of sight, zoom in or out, etc.).

After an avatar representing the participant enters the virtual space, the participant can input voice or text via an input device provided in the participant terminal 200, and the input voice or text can be output from the corresponding icon on an output device provided in the participant terminal 200 of the participant who has entered the virtual space. This allows the participant using the participant terminal 200 to hold a discussion with other participants in the virtual space.

In addition, after an avatar representing the participant enters the virtual space, the participant can input voice or text via an input device provided in the participant terminal 200, and the input voice or text can be output from an output device provided in the worker terminal 300. This allows the participant using the participant terminal 200 to hold a discussion with the worker on-site.

In this way, participants are people who can enter the virtual space, and workers are people who do not enter the virtual space but can interact with participants. Hereinafter, administrators, participants, and workers will be collectively referred to as users.

The discussion space providing device 100 is configured, for example, by a computer having a CPU (Central Processing Unit) 101, a memory 102, an auxiliary storage device 103, a communication device 104, an input device 105, and an output device 106.

The CPU 101 includes a processor and executes programs stored in the memory 102. The memory 102 includes a ROM (Read Only Memory), which is a non-volatile storage element, and a RAM (Random Access Memory), which is a volatile storage element. The ROM stores immutable programs (e.g., a BIOS (Basic Input/Output System)). The RAM is a high-speed, volatile storage element such as a DRAM (Dynamic Random Access Memory), and temporarily stores programs executed by the CPU 101 and data used when the programs are executed.

The auxiliary storage device 103 is, for example, a large-capacity, non-volatile storage device such as a magnetic storage device (HDD (Hard Disk Drive)) or a flash memory (SSD (Solid State Drive)), and stores the programs executed by the CPU 101 and data used when the programs are executed. In other words, the programs are read from the auxiliary storage device 103, loaded into the memory 102, and executed by the CPU 101.

The input device 105 is a device that receives input from an operator, such as a keyboard, mouse, or microphone. The output device 106 is a device that outputs the results of program execution in a format that can be recognized by the operator, such as a display device, printer, or speaker.

The communication device 104 is a network interface device that controls communication with other devices according to a specific protocol. The communication device 104 also includes a serial interface such as a Universal Serial Bus (USB).

A part or all of the program executed by the CPU 101 may be provided to the discussion space providing device 100 via a network from a removable medium (CD-ROM, flash memory, etc.) which is a non-transitory storage medium or an external computer equipped with a non-transitory storage device, and stored in a non-volatile auxiliary storage device 103 which is a non-transitory storage medium. For this reason, the discussion space providing device 100 may have an interface for reading data from removable media. The same applies to the participant terminal 200 and the worker terminal 300.

The discussion space providing device 100 is a computer system configured on one physical computer, or on multiple logically or physically configured computers, and may operate in separate threads on the same computer, or may operate on a virtual computer constructed on multiple physical computer resources. The same applies to the participant terminal 200 and the worker terminal 300.

The CPU 101 includes, for example, a knowledge setting unit 111, a virtual space management unit 112, a room management unit 113, a user management unit 114, a miniature 3D model management unit 115, and a display content management unit 116.

The knowledge setting unit 111 sets the knowledge DB 121, which will be described later. The virtual space management unit 112 manages the virtual space. The room management unit 113 manages the project management room, which is an example of a virtual space. The user management unit 114 manages users of the discussion space providing system. The miniature 3D model management unit 115 manages miniature 3D models placed in the project management room. The display content management unit 116 manages the display content placed in the project management room.

For example, the CPU 101 functions as a knowledge setting unit 111 by operating according to a knowledge setting program loaded into the memory 102, and functions as a virtual space management unit 112 by operating according to a virtual space management program loaded into the memory 102. The relationships between programs and functional units are similar for the other functional units included in the CPU 101.

In addition, some or all of the functions of the functional units included in CPU 101 may be realized by hardware such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field-Programmable Gate Array).

The auxiliary storage device 103 holds, for example, a knowledge DB (Data Base) 121, virtual space management information 122, miniature 3D model management information 123, display content management information 124, corresponding coordinate management information 125, and user management information 126.

Knowledge DB121 includes data related to the site (e.g., data indicating the environment, equipment status, worker status or behavior, etc., at the site or a portion of the site). Virtual space management information 122 includes information for managing multiple virtual spaces including the site 3D space and the project management room.

Miniature 3D model management information 123 includes information for managing miniature 3D models placed in the project management room. Display content management information 124 includes information for managing display content placed in the project management room. Corresponding coordinate management information 125 includes information indicating which coordinates in the miniature 3D model placed in the project management room correspond to the (real) position of the display content placed in the project management room. User management information 126 includes information for managing users including managers, participants, and workers.

In addition, some or all of the information stored in the auxiliary storage device 103 may be stored in the memory 102, or in an external database connected to the discussion space providing device 100.

In this embodiment, the information used by the discussion space providing system does not depend on the data structure and may be expressed in any data structure. In this embodiment, the information is expressed in table format, but the information can be stored in an appropriately selected data structure from, for example, a list, a database, or a queue.

Figure 2 is a diagram showing an example of the data configuration of knowledge DB 121. Knowledge DB 121 includes, for example, a data ID column 1211, a data type column 1212, a data column 1213, a tag column 1214, a feature column 1215, a location column 1216, a related object column 1217, and a time column 1218. Data ID column 1211 holds a data ID that identifies data stored in knowledge DB 121 (identifies a record in knowledge DB 121).

The data type column 1212 holds information indicating the data type. Data types include, for example, images, video, voice, audio, motion, acceleration, gyro, geomagnetism, heart rate, pulse rate, electrical resistance of the skin, sweat rate, body temperature, brain waves, point of gaze, air temperature, humidity, pressure (voltage, oil pressure, air pressure, etc.), and current.

The data type may also include, for example, document data such as work procedures, equipment manuals, work reports, and memos for the site or equipment installed at the site, and audio data for meetings related to the site or equipment at the site. The data type may also include a 3D model showing the three-dimensional shape of the site, a portion of the site, or equipment installed at the site.

The data column 1213 holds data corresponding to the data ID and the data type. The tag column 1214 holds tags attached to the data, and the tags are used, for example, for data searches using search queries. Note that the tags do not need to be highly readable, and may be, for example, features of a high-dimensional vector obtained by feature extraction processing.

The feature column 1215 holds features related to the data. The location column 1216 holds information indicating the (real) location where the data was obtained, or the (real) location of an object related to the data, which will be described later. The related object column 1217 holds information indicating an object related to the data. An object related to the data includes an object or event related to the data, and an object or event that is the subject of measurement of the data, as well as an object or event described in the data, are both examples of an object related to the data. The time column 1218 holds information indicating a time corresponding to the data in the data column 1213 (for example, the time when the data was obtained).

2 is 3D model data showing the shape of plant A at the relevant time, and the position ( _x1 , y1, _z1 ) indicates the position of the center of gravity of plant A. Furthermore, for example, data with a data ID of D002 is audio data of a meeting at the relevant time regarding factory B, and the position ( _x2 , _y2 , _z2 ) indicates the position of the center of gravity of factory B. Furthermore, for example, data with a data ID _of D003 is temperature data at the relevant time at the position ( _x3 , _y3 , _z3 ), and a tag is attached indicating that no abnormality has occurred at that position. indicates the position of the center of gravity of factory B.

Furthermore, for example, data with a data ID of D004 is image data of cooling device A at a given time, a tag is added to the image data indicating that an accident has occurred on cooling device A at that time, and the position ( _x4 , _y4 , _z4 ) indicates the position of the center of gravity of cooling device A. Furthermore, for example, data with a data ID of D005 is audio data of cooling device A at a given time, a tag is added to the audio data indicating that an accident has occurred on cooling device A at that time, and the position ( _x4 , _y4 , _z4 ) indicates the position of the center of gravity of cooling device A.

Furthermore, for example, data with a data ID of D006 is document data (e.g., a manual) related to transformer A at the relevant time, a tag is added indicating that the document describes work A, and the position ( _x5 , _y5 , _z5 ) indicates the center of gravity of transformer A. Furthermore, for example, data with a data ID of D007 is position data of a worker with a user ID of U003, and indicates that the position at the relevant time is ( _x7 , _y7 , _z7 ).

Figure 3 is a diagram showing an example of the data configuration of virtual space management information 122. The virtual space management information 122 includes, for example, a space ID column 1221, a space type column 1222, a data ID column 1223, a room ID column 1224, a data column 1225, a display size column 1226, a description column 1227, and a connected space ID column 1228.

The space ID column 1221 holds a space ID that identifies a virtual space. A different space ID is defined for each different virtual space. The space type column 1222 holds a space type that indicates the type of the virtual space. The space type includes, for example, "site", which indicates that the virtual space is a site 3D space, and "room", which indicates that the virtual space is a project management room.

The data ID column 1223 holds the data ID of the 3D model data that constructs the on-site 3D space. In a record whose space type is "on-site", a data ID is stored in the data ID column 1223, but in a record whose space type is "room", no data ID is stored in the data ID column 1223 (it may be a null value).

The room ID column 1224 holds a room ID that identifies the 3D model data that constructs the project management room. In a record whose space type is "room", a room ID is stored in the room ID column 1224, but in a record whose space type is "site", no room ID is stored in the room ID column 1224 (it may be a null value).

The data column 1225 holds 3D model data that constructs a virtual space of the space type. The display size column 1226 holds information indicating the display size of the 3D model indicated by the data column 1225 (e.g., a ratio to the size of the original 3D model).

The explanation column 1227 holds an explanation of the 3D model indicated by the data column 1225. In the example of FIG. 3, it is shown that the shape of room1.glb is a rectangular parallelepiped with a side ratio of x:y:z. The connected space ID column 1228 holds information indicating the virtual spaces to which participants (icons) in the virtual space can move. In the example of FIG. 3, it is shown that a participant in the virtual space with a space ID of S001 can move to a virtual space with a space ID of S002 and a virtual space with a space ID of S003, and a participant in the virtual space with a space ID of S002 can move to a virtual space with a space ID of S001.

Figure 4 is a diagram showing an example of the data configuration of the miniature 3D model management information 123. The miniature 3D model management information 123 includes, for example, a miniature ID column 1231, a data ID column 1232, a data column 1233, a room ID column 1234, a display size column 1235, a display position column 1236, and a display angle column 1237.

The miniature ID column 1231 holds a miniature ID that identifies a miniature 3D model. The data ID column 1232 holds a data ID of 3D model data that is miniaturized to construct a miniature 3D model. The data column 1233 holds 3D model data that is miniaturized to construct a miniature 3D model.

The room ID column 1234 holds the room ID of the project management room in which the miniature 3D model is located. The display size column 1235 indicates the display size of the miniature 3D model (e.g., a ratio to the size of the original 3D model). The display position column 1236 indicates the display position (e.g., center of gravity position) of the miniature 3D model in the project management room indicated by the room ID column 1234. The display angle column 1237 indicates the display angle of the miniature 3D model in the project management room indicated by the room ID column 1234.

Figure 5 is a diagram showing an example of the data configuration of the display content management information 124. The display content management information 124 includes, for example, a content ID column 1241, a data ID column 1242, a data type column 1243, a data column 1244, a room ID column 1245, a display size column 1246, a display position column 1247, and a display angle column 1248.

The content ID column 1241 holds a content ID that identifies the display content. The data ID column 1242 holds a data ID of the display content. The data type column 1243 holds a data type of the display content. The data column 1244 holds information indicating the data that constructs the display content.

The room ID column 1245 holds the room ID of the project management room in which the display content is located. The display size column 1246 indicates the display size of the display content (e.g., the size ratio relative to a display frame having a specified shape and size). The display position column 1247 indicates the display position (e.g., the center of gravity position) of the display content in the project management room indicated by the room ID column 1245. The display angle column 1237 indicates the display angle of the display content in the project management room indicated by the room ID column 1245.

In the example of FIG. 4, the display content with a content ID of C001 indicates an administration screen. The administration screen indicates an operation screen by the administrator (for example, a screen displayed on the display of the discussion space providing device 100 or another terminal used by the administrator). Therefore, no data ID is stored in the data ID column 1242 in the display content with a content ID of C001, and a URL (Uniform Resource Locator) for viewing the administration screen is stored in the data column 1244.

The management screen can also display a query input screen and a search display screen, which will be described later. Participants whose icons are placed in the project management room can view the management screen, making it easier for participants to communicate with the administrator, and therefore easier for the administrator to obtain consent from participants when adding display content or miniature 3D models to the project management room using the query input screen and search display screen, which will be described later. Also, by displaying a web browser or the like on the management screen, participants can link with external applications through communication with the administrator while remaining in the project management room.

For example, when audio data is displayed as display content, a player for playing the audio may be displayed as display content, or text transcribed from the audio may be displayed as display content.

Figure 6 is a diagram showing an example of the data configuration of the corresponding coordinate management information 125. The corresponding coordinate management information 125 includes, for example, a content ID column 1251, a miniature ID column 1252, a coordinates within a miniature column 1253, and an emphasis flag column 1254. The content ID column 1251 holds a content ID. The miniature ID column 1252 holds.

The miniature coordinates column 1253 indicates the coordinates in the miniature 3D model indicated by the miniature ID column 1252 that correspond to the (real) position of the displayed content of the content ID indicated by the content ID column 1251. The highlight flag column 1254 holds a highlight flag that indicates whether the miniature coordinates corresponding to the displayed content are highlighted in the miniature 3D model (for example, if the highlight flag is "1", it is highlighted, and if it is "0", it is not highlighted).

Figure 7 is a diagram showing an example of the data configuration of user management information 126. User management information 126 includes, for example, a user ID column 1261, icon data 1262, space ID column 1263, coordinate column 1264, orientation column 1265, participant flag column 1266, administrator flag column 1267, and worker flag column 1268.

The user ID column 1261 holds a user ID that identifies a user. The icon data 1262 holds data of the user's icon that is displayed in the virtual space. The space ID column 1263 holds the space ID of the virtual space in which the user (icon) is currently present. The coordinate column 1264 holds coordinates that indicate the current location of the user (icon) in the virtual space.

The orientation column 1265 holds information indicating the current orientation of the user (or his/her icon) in the virtual space (if the user is a participant or administrator, the viewing angle displayed on the terminal used by the user).

The participant flag column 1266 holds a participant flag which is a flag indicating whether the user is a participant (for example, if the participant flag is "1", the user is a participant, and if it is "0", the user is not a participant). The administrator flag column 1267 holds an administrator flag which is a flag indicating whether the user is an administrator (for example, if the administrator flag is "1", the user is an administrator, and if it is "0", the user is not an administrator). The worker flag column 1268 holds a worker flag which is a flag indicating whether the user is a worker (for example, if the worker flag is "1", the user is a worker, and if it is "0", the user is not a worker).

Figure 8 is a flowchart showing an example of an initial setting process by the discussion space providing device 100. The knowledge setting unit 111 registers information in the knowledge DB 121 (S801). Specifically, for example, the knowledge setting unit 111 may register information in the knowledge DB 121 according to input from an administrator to the input device 105, or may register information received from an external system in the knowledge DB 121.

The virtual space management unit 112 registers information on the site 3D space and the project management room in the virtual space management information 122 (S802). Specifically, for example, the virtual space management unit 112 selects data to be registered as the site 3D space from data whose data type is a 3D model stored in the knowledge DB 121 according to the administrator's input to the input device 105. Furthermore, the virtual space management unit 112 acquires the display size, destination space ID, and description of the selected data according to the administrator's input to the input device 105. The virtual space management unit 112 issues a space ID for the selected data, and registers the issued space ID, the space type "site", the data ID of the selected data, the selected data, and the acquired display size, destination space ID, and description in the virtual space management information 122. This registers the information on the site 3D space.

For example, the virtual space management unit 112 acquires data (3D model data) as a project management room, as well as the display size, destination space ID, and description of the data, in accordance with input from the administrator to the input device 105. The virtual space management unit 112 issues a space ID and a room ID for the acquired data, and registers the issued space ID and room ID, the space type "room," the acquired data, and the acquired display size, destination space ID, and description in the virtual space management information 122. This registers the information on the project management room.

The virtual space management unit 112 may register multiple on-site 3D spaces in the virtual space management information 122, and may register multiple project management rooms in the virtual space management information 122. The virtual space management unit 112 may not obtain descriptions of the on-site 3D spaces and project management rooms (may not register them in the virtual space management information 122).

The miniature 3D model management unit 115 places the miniature 3D model in the project management room (S803). Specifically, for example, the miniature 3D model management unit 115 displays data of the data type of 3D model stored in the knowledge DB 121 on the output device 106 (it may display a list of the data, or may display 3D model data corresponding to a search query generated by an input from the administrator to the input device 105), and selects data to be placed in the project management room as a miniature 3D model from the data of the data type of 3D model stored in the knowledge DB 121 according to the input from the administrator to the input device 105.

Furthermore, for example, the miniature 3D model management unit 115 determines, in accordance with an input from the administrator to the input device 105, the room ID of the project management room in which the miniature 3D model is to be placed, as well as the display size, display position, and display angle of the miniature model in the project management room. The miniature 3D model management unit 115 issues a miniature ID, and registers the issued miniature ID, the data ID of the selected data, the selected data, the determined room ID, display size, display position, and display angle in the miniature 3D model management information 123. As a result, the miniature 3D model is placed in the project management room.

Note that a predetermined restriction may be imposed on the display size, display position, and/or display angle of the miniature 3D model. For example, the display size of the miniature 3D model may be determined so that the volume of the miniature 3D model is equal to or less than a predetermined multiple (e.g., 1/10 or less) of the volume of the project management room and the entire area of the miniature 3D model is contained within the project management room. Also, for example, the display position of the miniature 3D model may be limited to the center of the floor of the project management room (e.g., a position within a predetermined distance from the center of gravity of the floor).

Note that one miniature 3D model may be placed in one project management room, multiple miniature 3D models may be placed there, or no miniature 3D model may be placed there at all.

The display content management unit 116 places the display content in the project management room (S804). Specifically, for example, the display content management unit 116 displays the data stored in the knowledge DB 121 on the output device 106 (it may display a list of the data, or it may display data corresponding to a search query generated by an input from the administrator to the input device 105), and selects data to be placed in the project management room as display content from the data stored in the knowledge DB 121 according to the input from the administrator to the input device 105. However, since the management screen is not stored in the knowledge DB 121, the display content management unit 116 accepts input of, for example, the URL of the management screen.

Furthermore, for example, the display content management unit 116 determines the room ID of the project management room in which the display content is to be placed, and the display size, display position, and display angle of the display content within the project management room, in accordance with input from the administrator to the input device 105. The display content management unit 116 issues a content ID, and registers the issued content ID, the data ID of the selected data, the selected data, the determined room ID, display size, display position, and display angle in the display content management information 124. As a result, the display content is placed in the project management room.

Note that a certain restriction may be imposed on the display size, display position, and/or display angle of the display content. For example, the display size of the display content may be determined so that the entire area of the display content fits within the project management room. Also, for example, the display position of a management screen, which is an example of the display content, may be restricted to a first wall surface of the project management room, and the display positions of display content other than the management screen may be restricted to a wall surface different from the first wall surface of the project management room.

Note that one display content may be placed in one project management room, multiple display contents may be placed in one project management room, or no display content may be placed in one project management room.

The display content management unit 116 associates the placed miniature 3D model with the display content for each project management room (S805). Specifically, for example, the display content management unit 116 identifies, for each project management room, coordinates (intra-miniature coordinates) corresponding to the position of the display content in the miniature 3D model based on the position indicated by the knowledge DB 121 of the display content placed in the project management room in step S804, the position indicated by the knowledge DB 121 of the miniature 3D model placed in the project management room in step S803, and the 3D model data of the miniature 3D model.

Furthermore, the display content management unit 116 acquires, for example, information indicating whether to highlight the specified coordinates within the miniature in the miniature 3D model (i.e., a highlight flag) according to an input from the administrator to the input device 105. The display content management unit 116 registers the content ID of the display content for which the coordinate correspondence has been specified, the miniature ID of the miniature 3D model, the specified coordinates, and the highlight flag in the corresponding coordinate management information 125.

In the project management room, for example, coordinates within a miniature whose highlight flag is set to "1" may be highlighted by lighting or blinking, or by placing a pin on the coordinates within the miniature, or a ray of light may be connected between the coordinates within the miniature whose highlight flag is set to "1" and the display content corresponding to the coordinates within the miniature.

The display content management unit 116 may also highlight coordinates in the on-site 3D space that correspond to coordinates in the miniature whose highlight flag is set to "1" (for example, the coordinates are identified from the coordinates in the miniature and the position indicated by the knowledge DB 121 of the on-site 3D model that corresponds to the miniature 3D model). This makes it easier for participants viewing the on-site 3D space to check in more detail the location in the on-site 3D space that corresponds to the highlighted display content.

The user management unit 114 executes the initial registration of the user (S806) and ends the initial setting process. Specifically, for example, the user management unit 114 acquires icon data, a participant flag, an administrator flag, and a worker flag in accordance with input from the administrator to the input device 105. Furthermore, the user management unit 114 issues a user ID and registers the issued user ID and the acquired icon data, participant flag, administrator flag, and worker flag in the user management information 126.

Figure 9 is a flowchart showing an example of routine processing executed by the discussion space providing device 100 after the initial setting process. In the normal state, the discussion space providing device 100 repeatedly executes routine processing in parallel, including, for example, update processing of the knowledge DB 121 (S901), entry and exit management processing of participants and administrators to the virtual space (S902), management processing of user coordinates and orientation (S903), processing responding to instructions by participants (S904), and layout update processing of the project management room (S905).

In step S901, the knowledge setting unit 111 updates the knowledge DB 121 in accordance with a knowledge DB update instruction input to the input device 105 by an administrator or received from an external device or system. The knowledge DB update instruction includes, for example, information on a record to be newly added to the knowledge DB 121, update information on the contents of a record registered in the knowledge DB 121, or information on a registered record to be deleted.

In step S902, the user management unit 114 receives an entry instruction from, for example, the participant terminal 200 of a participant who has not entered the virtual space. The entry instruction includes, for example, the user ID of the participant, the space ID of the virtual space into which the participant wishes to enter, and the coordinates and orientation within the virtual space.

The user management unit 114 stores the space ID, coordinates, and orientation indicated by the entry instruction in a record of the user management information 126 that corresponds to the user ID indicated by the entry instruction. The user management unit 114 also places icon data corresponding to the user ID indicated by the entry instruction at the coordinates indicated by the entry instruction in the virtual space of the space ID indicated by the entry instruction, in the orientation indicated by the entry instruction.

In addition, if there is a miniature 3D model that has the same data ID as the virtual space (on-site 3D space) in which the icon is placed, the user management unit 114 may also place the icon in the same orientation at the corresponding coordinates in the miniature 3D model. In this way, participants can enter the virtual space. Entry of the administrator into the virtual space can also be achieved in a similar manner.

The entry instruction does not have to include the space ID, coordinates, and/or orientation, in which case the space ID, coordinates, and/or predetermined initial values are set to the space ID, coordinates, and/or predetermined initial values at the time of the participant's entry.

In addition, in step S902, the user management unit 114 receives, for example, an exit instruction from the participant terminal 200 of a participant currently in the virtual space. The exit instruction includes, for example, the user ID of the participant.

The user management unit 114 changes the space ID, coordinates, and orientation of the record in the user management information 126 that corresponds to the user ID indicated by the exit instruction to null values. The user management unit 114 also deletes the icon data that corresponds to the user ID indicated by the exit instruction from the virtual space. In this way, the participant can exit the virtual space. The administrator can also exit from the virtual space in a similar manner.

A participant who is currently in the virtual space inputs an instruction to move an icon and change its orientation to an input device (e.g., a gyro sensor, keyboard, and/or mouse) of the participant terminal 200, and in step S903, the user management unit 114 receives the movement instruction and orientation change instruction, including the participant's user ID, from the participant terminal 200, and reflects the post-movement coordinates and post-change orientation indicated by the instruction for the user ID in the user management information 126.

Furthermore, the user management unit 114 changes the coordinates and orientation of the icon of the user ID in the virtual space to the coordinates after the movement and the changed orientation. If there is a miniature 3D model having the same data ID as the virtual space (on-site 3D space) in which the icon is placed, the user management unit 114 may also place the icon in the changed orientation at the corresponding coordinates in the miniature 3D model. Note that management of the administrator's icon coordinates and orientation is also achieved in a similar manner.

As mentioned above, the worker has not entered the virtual space. Therefore, in step S903, the user management unit 114 periodically acquires the latest location of a user (i.e., a worker) whose worker flag is set to 1 in the user management information 126 from the knowledge DB 121 (e.g., data whose data ID is 007 in FIG. 1), updates the coordinate values of the icon corresponding to the worker in the user management information 126 according to the acquired location, and places the icon of the worker at the corresponding location in the site 3D space.

In addition, if there is a miniature 3D model with the same data ID as the virtual space (site 3D space) in which the icon is placed, the user management unit 114 may also place the icon at the corresponding coordinates in the miniature 3D model. This allows even a participant whose icon is placed in the project management room to easily understand which site 3D space the other participants are looking at or which site the workers are at, and thus allows the participant to easily move to the site 3D space that the other participants are looking at or the site 3D space that corresponds to the site where the workers are, by the spatial movement process in step S1005 described later.

Details of the participant instruction response process in step S904 will be described later with reference to FIG. 10. Details of the room layout update process in step S905 will be described later with reference to FIG. 11.

Figure 10 is a flowchart showing an example of participant instruction response processing in step S904. The room management unit 113 receives various instructions input by the participant to the input device of the participant terminal 200 from the participant terminal 200 (S1001). The room management unit 113 determines the type of instruction received in step S1001 (S1002). The types of instructions received from the participant terminal 200 in step S1001 include, for example, an instruction to select display content in the project management room, an instruction to select another user's icon, a spatial movement instruction, and an instruction to change the visibility state of a miniature 3D model.

When the room management unit 113 determines that the type of instruction is an instruction to select display content in the project management room (S1002: display content selection instruction), it refers to the corresponding coordinate management information 125 and changes the display of the intra-miniature coordinates corresponding to the selected display content in the miniature 3D model arranged in the project management room (S1003). Specifically, for example, the room management unit 113 changes the emphasis flag corresponding to the intra-miniature coordinates (from "1" to "0" and from "0" to "1").

The processing of step S1003 allows participants to recognize coordinates within the miniature that correspond to the displayed content on the miniature 3D model, thereby deepening their understanding of the displayed content and making it easier to deepen discussion among participants. Furthermore, if the coordinates within the on-site 3D space that correspond to coordinates within the miniature whose highlight flag is set to "1" are also highlighted, participants viewing the on-site 3D space can also recognize the coordinates that correspond to the displayed content, thereby deepening their understanding of the displayed content and making it easier to deepen discussion among participants.

In addition, in step S1003, the room management unit 113 may search the knowledge DB 121 for 3D model data showing the same related matter as the display content selected in step S1002, and place the found 3D model data in the project management room as a miniature 3D model.

When the room management unit 113 determines that the type of instruction is an instruction to select the icon of another user in the project management room or in the miniature 3D model (S1002: Select other user), it mediates an interaction between the selected other user and the participant terminal 200 that sent the instruction in step S1001 (S1004).

Specifically, for example, if the icon of the other user selected in step S1002 is the icon of a participant or administrator different from the participant of the participant terminal 200 that sent the instruction in step S1001, the room management unit 113, for example, causes chat or audio/video calls to be performed using icons in a virtual space between the participant terminal 200 of the participant and the participant terminal 200 of the different participant or the terminal of the administrator (for example, the discussion space providing device 100). Also, for example, if the icon of the other user selected in step S1002 is the icon of a worker, the room management unit 113 causes audio/video calls to be performed between the participant terminal 200 of the participant and the worker terminal 300 of the worker.

Also, for example, if the icon of the other user selected in step S1002 is the icon of a participant or administrator other than the participant of the participant terminal 200 that sent the instruction in step S1001, the room management unit 113 may display the field of view corresponding to the icon of the other user on the output device of the participant terminal 200 that sent the instruction in step S1001, or may display the field of view corresponding to the icon of the participant of the participant terminal 200 that sent the instruction in step S1001 on the output device of the participant terminal 200 of the participant corresponding to the icon of the other user.

Also, for example, if the icon of the other user selected in step S1002 is an icon of a participant or manager other than the participant of the participant terminal 200 that sent the instruction in step S1001 and is an icon located in the on-site 3D space, the room management unit 113 may display data in the project management room on the output device of the terminal of the other user.

The processing of step S1003 allows participants to easily interact with other participants, managers, or on-site workers. In particular, participants who recognize that icons are placed in the same on-site 3D space can easily interact with each other, making it easier for participants who share the same issues or goals to deepen their discussions.

When the room management unit 113 determines that the type of instruction is a spatial movement instruction indicating the user ID of the participant, the space ID of the destination virtual space, and the coordinates and orientation in the destination virtual space (S1002: spatial movement instruction), it moves the icon of the participant to the coordinates in the destination virtual space in the orientation (S1005). Also, in step S1005, the room management unit 113 changes the space ID, coordinates, and orientation of the user ID in the user management information 126 to values indicated by the spatial movement instruction.

The spatial movement instruction does not have to include coordinates and/or direction, in which case it is set to the coordinates and/or a predetermined initial value immediately after the movement of the participant in the destination virtual space.

For example, when a participant's icon is placed in a project management room, if a miniature 3D model placed in the project management room is selected via an input device of the participant's participant terminal 200, a spatial movement instruction to move the icon to the virtual space (on-site 3D space) corresponding to the miniature 3D model is transmitted to the discussion space providing device 100.

Also, for example, when a participant's icon is placed in the on-site 3D space, input of a room ID is accepted via an input device of the participant's participant terminal 200, and a spatial movement instruction to move the icon to the project management room of the room ID is transmitted to the discussion space providing device 100.

The processing of step S1005 allows the participant of the participant terminal 200 to easily move to a different virtual space. In particular, when the site 3D space is a large space such as a plant, a participant who wants to check a first location and a second location that are far from each other in the site 3D space may, for example, move to the first location in the site 3D space by selecting a first location in a miniature 3D model corresponding to the site 3D space from the project management room, check the first location, return to the project management room, and move to the second location in the site 3D space by selecting a second location in a miniature 3D model corresponding to the site 3D space from the project management room. This allows the participant to move between the first location and the second location in a short time without directly moving an icon from the first location to the second location that are far from each other in the site 3D space.

When the room management unit 113 determines that the type of instruction is an instruction to change the viewing state of a miniature 3D model (S1002: instruction to change the viewing state of a miniature 3D model), it changes the viewing state of the miniature 3D model indicated by the instruction and displayed on the output device 106 of the participant terminal 200 that sent the instruction to the viewing state indicated by the instruction (S1006).

For example, when the participant terminal 200 of a participant whose icon is placed in a project management room receives a selection of a partial area of a miniature 3D model placed in the project management room via, for example, an input to an input device, the participant terminal 200 executes a predetermined motion such as zooming in or out on the area, and transmits a miniature 3D model visibility state change instruction to the discussion space providing device 100 to change the visibility state of the miniature 3D model.

The processing of step S1006 makes it easier for participants to visually identify areas of concern in the miniature 3D model, which in turn makes it easier for participants to recognize and solve problems they have.

In the above example, the processes of steps S1003 to S1006 are executed according to various instructions from the participant terminal 200, but the processes of steps S1003 to S1006 may also be executed according to instructions from an administrator (for example, according to input to the input device 105 of the discussion space providing device 100 or the terminal owned by the administrator). Also, some of the processes of steps S1003 to S1006 may be executed only by instructions from some users, such as the administrator or participants who have been given authority in advance. In particular, if the process of step S1003 could be executed by instructions from all participants, many parts of the miniature 3D model would be highlighted, making it difficult to recognize important parts, so it is desirable that it be executed only by instructions from some users, such as the administrator.

FIG. 11 is a flowchart showing an example of a room layout update process. The room management unit 113 determines whether a query for adding display content has been input (S1201). In step S1201, the room management unit 113 determines whether it has acquired, for example, a query input to the input device of the participant terminal 200 by a participant whose icon has been placed in the project management room, or a query input to the input device 105 of the discussion space providing device 100 (or a terminal owned by the administrator) by an administrator whose icon has been placed in the project management room. Specific examples of queries will be described later with reference to FIG. 13. Note that the query in step S1201 may be input only by the administrator.

When the room management unit 113 determines that a query has been input (S1201: YES), it searches the knowledge DB 121 for data corresponding to the query, and displays the hit data in the project management room where the icon of the participant or manager who input the query is located, either as a miniature 3D model if the data type of the hit data is a 3D model, or as display content if the data type of the hit data is other than a 3D model (S1202).

The display size, display position, and display angle of the hit data may be specified by input by the participant or administrator who entered the query, or the hit data may be automatically displayed at a specified display size and display angle in an available area of the project management room (so as not to overlap with the display area of the miniature 3D model or other display content that has already been displayed). Also, in step S1202, a specified restriction may be imposed on the above-mentioned display size, display position, and/or display angle of the miniature 3D model and display content.

In addition, in step S1202, the room management unit 113 updates the miniature 3D model management information 123 or the display content management information 124 according to the newly displayed 3D model or display content.

If the room management unit 113 determines that a query has not been input (S1201: NO), the process proceeds to step S1203. The room management unit 113 determines whether a predetermined trigger has been fired, for example, by constantly monitoring the knowledge DB 121 (S1203).

When the room management unit 113 determines that the trigger has been fired (S1203: YES), it displays data that satisfies the specified condition corresponding to the trigger in the project management room that is pre-associated with the trigger (S1204). Note that in step S1204, if the data type of the data that satisfies the specified condition corresponding to the trigger is a 3D model, it displays the data as a miniature 3D model, and if the data type of the data that satisfies the specified condition corresponding to the trigger is other than a 3D model, it displays the data as display content (S1204). When the room management unit 113 determines that the trigger has not been fired (S1203: NO), it transitions to step S1205.

For example, assume that the trigger is previously set as "the value of data at position ( _x3 , _y3 , _z3 ) whose data type is temperature is 20° C. or more," data that satisfies a predetermined condition corresponding to the trigger is "data at position ( _x3 , _y3 , _z3 ) whose data type is temperature," and a project management room with a room ID of R001 is previously associated with the trigger. In this case, when a record with a data ID of D003 in the example of FIG. 1 (i.e., data whose temperature at the position is 20° C. or more) is added to knowledge DB 121, room management unit 113 displays the data corresponding to the record as display content in the project management room with room ID R001.

For example, assume that "an accident occurs in cooling device A" is predefined as the trigger, that data that satisfies a predetermined condition corresponding to the trigger is "data in which the related matter is cooling device A", and that the trigger is predefined as corresponding to a project management room with a room ID of R001. In this case, when a record with a data ID of D004 or D005 in the example of FIG. 1 (i.e., data for which it is determined from the related matter and tag that an accident has occurred in cooling device A) is added to knowledge DB 121, room management unit 113 displays the data corresponding to the record as display content in the project management room with a room ID of R001.

The display size, display position, and display angle of the data corresponding to the trigger may be specified by input by the participant or administrator who entered the query, or the data corresponding to the trigger may be automatically displayed at a predetermined display size and a predetermined display angle in an available area of the project management room (so as not to overlap with the display area of the miniature 3D model or other display content that has already been displayed). Also, in step S1205, a predetermined restriction may be imposed on the above-mentioned display size, display position, and/or display angle of the miniature 3D model and display content.

In addition, in step S1204, the room management unit 113 updates the miniature 3D model management information 123 or the display content management information 124 according to the newly displayed 3D model or display content.

The room management unit 113 determines whether it has received an instruction to change the display position, shape, or size of a miniature 3D model or display content already placed in the project management room, or an instruction to delete the miniature 3D model or display content (S1205). In step S1203, the room management unit 113 determines whether it has acquired, for example, a query input to the input device of the participant terminal 200 by a participant whose icon has been placed in the project management room, or a query input to the input device 105 of the discussion space providing device 100 (or a terminal owned by the administrator) by an administrator whose icon has been placed in the project management room. Note that the instruction in step S1205 may be executable only by the administrator.

If the room management unit 113 determines that it has received the instruction in step S1205 (S1205: YES), it changes the display position, shape, or display size of the existing miniature 3D model or display content, or deletes it in response to the instruction (S1206). If the room management unit 113 determines that it has not received the instruction in step S1205 (S1205: NO), it ends the room layout update process.

In addition, in step S1206, the room management unit 113 updates the miniature 3D model management information 123 or the display content management information 124 in response to the change in display position, shape, or display size, or the deletion, performed in step S1205.

Figure 12 is a plan view showing an example of a project management room. In the example of Figure 12, the project management room 1270 is a rectangular parallelepiped, and has a first wall 1280, a second wall 1290, a third wall 1292, and a fourth wall 1294. A management screen 1281 is displayed on the first wall 1280 as display content. In addition, display content 1291, display content 1293, and display content 1295 are displayed on the second wall 1290, the third wall 1292, and the fourth wall 1294, which are walls different from the first wall 1280, respectively.

A miniature 3D model 1271 is placed in the center of the floor of the project management room 1270 (which may be a position a specified height above the center of the floor). A ray 1273 connects the intra-miniature coordinates 1272 of the miniature 3D model 1271 to the display content 1291, thereby highlighting the intra-miniature coordinates 1272 and indicating that the (real) position of the display content 1291 corresponds to the intra-miniature coordinates 1272.

In addition, an icon 1274 of a participant whose participant ID is U010 and an icon 1275 of a participant whose participant ID is U015 are placed in the project management room 1270.

In this way, since the project management room 1270 can arrange multiple display contents for the site, participants can view the objects of the site all at once, even in a large site such as a plant. In particular, if the participant terminal 200 is an immersive device such as a VR headset, it is difficult to view these display contents all at once if the participant moves only within the 3D space of the site, so the above-mentioned effect of providing the project management room 1270 is particularly pronounced. Furthermore, in the project management room 1270, participants can easily recognize which position the display content corresponds to in the miniature 3D model (i.e., the site).

In addition, by displaying the management screen 1281 on the first wall 1280, which is a wall on which no other display content is displayed, participants can easily distinguish between the management screen 1281 and other display content.

Figure 13 is a diagram showing an example of the screen configuration of a query input screen for inputting a query in step S1201. The query input screen 1300 is displayed, for example, on the output device 106 of the discussion space providing device 100, the output device of the terminal owned by the administrator, or the output device of the participant terminal 200.

The query input screen 1300 includes, for example, a search keyword input area 1310 and a search condition setting area 1320. The room management unit 113 searches the knowledge DB 121 according to the search keyword and/or the search condition.

The search condition setting area 1320 includes, for example, a search type setting area 1321, a time setting area 1322, a data type setting area 1323, a location setting area 1324, a related object setting area 1325, and a free input area 1326.

The search type setting area 1321 is an area for setting the search range, for example, by a search keyword. When "content" is selected in the search type setting area 1321, for example, data containing the search keyword in the content (e.g., sentences in a document file, the file name of each file, etc.) is searched for in the knowledge DB 121.

When "tag" is selected in the search type setting area 1321, for example, data containing the search keyword in the tag is searched from the knowledge DB 121. When "full text" is selected in the search type setting area 1321, for example, data containing the search keyword in the content and/or tag is searched from the knowledge DB 121.

The time setting area 1322 is an area for setting search conditions related to the time of data. The data type setting area 1323 is an area for setting search conditions related to data type.

The position setting area 1324 is an area for setting search conditions related to the position of data. In the example of FIG. 13, the center and radius can be set in the position setting area 1324, and data indicating a position within the sphere defined by the set center and radius can be searched from the knowledge DB 121. Note that the position may be set in an area of a shape other than a sphere in the position setting area 1324, and the names of rooms or sections within the site may also be set.

The related thing setting area 1325 is an area for setting search conditions related to related things of data. In the example of FIG. 13, the related thing setting area 1325 displays a box in which related things included in the knowledge DB 121 can be selected. The free input area 1326 is an area for the user to freely input text indicating search conditions.

Examples of queries that can be specified using the query input screen 1300 are described below. For example, displaying data within a 1 m radius of a certain location whose data type is a document, displaying image data matching the search keyword "danger" and dated this week, constantly displaying data whose data type is temperature (thermometer measurements) located at a certain location in real time, displaying all data whose time is the current day, etc. are all examples of queries.

Figure 14 is a diagram showing an example of the screen configuration of a search result display screen. Search result display screen 1400 is a screen that displays data hit by a search using a query entered on query input screen 1300, and is displayed, for example, on the output device that was displaying query input screen 1300.

The search result display screen 1400 includes, for example, a 3D model display area 1410, a search result display area 1420, a button 1430, and a button 1440. The 3D model display area 1410 displays a 3D model (extracted from the 3D model data in the knowledge DB 121) of an area including positions and related matters corresponding to the data included in the search results. The positions and related matters corresponding to the data included in the search results are also shown on the 3D model displayed in the 3D model display area 1410 (the positions and related matters are indicated by the numbers "1" and "2" in the 3D model display area 1410 in FIG. 14).

The search result display area 1420 displays the search results based on the search keywords and search conditions specified on the query input screen 1300. In the example of FIG. 14, the search result displayed in the search result display area 1420 includes data, data type, time, tag, location, and related items, but any item included in the knowledge DB 121 may be displayed.

In addition, items extracted from knowledge DB121, such as data, data type, time, tag, location, and related things, may also be displayed superimposed on the 3D model in the 3D model display area 1410.

In addition, in the search result display area 1420, for example, the data may be arranged in chronological order, or the data may be sorted by data type and then arranged in chronological order. In addition, in the search result display area 1420, for example, the data may be sorted by related things and then arranged in chronological order.

When data displayed in the search result display area 1420 is selected and then button 1430 is selected, the selected data is displayed in step S1202. When button 1440 is selected, the screen returns to the query input screen 1300, or simply the search result display screen 1400 is closed.

The present invention is not limited to the above-described embodiments, but includes various modified examples. For example, the above-described embodiments have been described in detail to clearly explain the present invention, and are not necessarily limited to those having all of the configurations described. It is also possible to replace part of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment to the configuration of one embodiment. It is also possible to add, delete, or replace part of the configuration of each embodiment with other configurations.

The above configurations, functions, processing units, processing means, etc. may be realized in part or in whole in hardware, for example by designing them as integrated circuits. The above configurations, functions, etc. may be realized in software by a processor interpreting and executing a program that realizes each function. Information on the programs, tables, files, etc. that realize each function can be stored in a memory, a recording device such as a hard disk or SSD (Solid State Drive), or a recording medium such as an IC card, SD card, or DVD.

In addition, the control lines and information lines shown are those considered necessary for the explanation, and not all control lines and information lines on the product are necessarily shown. In reality, it can be assumed that almost all components are interconnected.

100 Discussion space providing device, 101 CPU, 102 Memory, 103 Auxiliary storage device, 104 Communication device, 105 Input device, 106 Output device, 112 Virtual space management unit, 113 Room management unit, 114 User management unit, 115 Miniature 3D model management unit, 116 Display content management unit, 121 Knowledge DB, 122 Virtual space management information, 123 Miniature 3D model management information, 124 Display content management information, 125 Corresponding coordinate management information, 126 User management information, 1270 Project management room, 1271 Miniature 3D model, 1272 Miniature internal coordinates, 1273 Light ray, 1281 Management screen, 1291 Display content

Claims (13)

An information processing device,
A processor and a memory,
connected to a display device,
The memory includes:
knowledge information indicative of data relating to the site, including a 3D model of the site, and a location corresponding to the data;
virtual space management information indicating a first virtual space constructed by a 3D model of a project management room;
The processor,
Displaying the first virtual space on the display device;
A miniature 3D model of the site is displayed in the first virtual space;
Accepting a selection of data included in the knowledge information;
displaying the selected data as display content in the first virtual space;
Identifying coordinates in the miniature 3D model based on the 3D model of the site and the positions indicated by the knowledge information of the selected data, the coordinates corresponding to the position of the data corresponding to the display content;
An information processing device that highlights the identified coordinates within the miniature 3D model. 2. The information processing device according to claim 1,
The processor,
accepting an input of a query for searching the knowledge information after accepting an entry of a participant into the first virtual space;
Searching for data corresponding to the query from the knowledge information;
The information processing device displays the searched data as the display content in the first virtual space. 2. The information processing device according to claim 1,
The knowledge information indicates a type of data related to the site,
The processor,
receiving an instruction to update the knowledge information;
updating the knowledge information based on the update instruction;
When it is determined that a predetermined trigger is fired when the knowledge information is updated, data satisfying a predetermined condition corresponding to the predetermined trigger is acquired from the knowledge information;
An information processing device that displays the acquired data as the display content in the first virtual space. 2. The information processing device according to claim 1,
The information processing device wherein the processor displays, in the first virtual space, a management screen, which is a screen of a terminal used by an administrator who manages the first virtual space, as the display content. 5. The information processing device according to claim 4,
The project management room includes a floor and a plurality of walls;
The processor,
placing the miniature 3D model on the floor surface;
The management screen is disposed on a wall surface included in the plurality of walls;
an information processing device that places the display content different from the management screen on a wall surface included in the plurality of walls and different from the wall surface on which the management screen is placed. 2. The information processing device according to claim 1,
The processor,
accepting an instruction to change a visibility state of the miniature 3D model by a predetermined motion;
An information processing device that changes a visibility state of the miniature 3D model being displayed in accordance with the instruction. 2. The information processing device according to claim 1,
The processor,
An information processing device, wherein the virtual space management information indicates a second virtual space different from the first virtual space, constructed using a 3D model of the site. The information processing device according to claim 7,
The processor,
Accepting entry of a participant into the first virtual space or the second virtual space;
placing a participant icon representing the participant in the virtual space in which the participant is present;
displaying a field of view based on the arrangement of the participant icons on the display device;
An information processing device that moves the participant icon located in one of the first virtual space or the second virtual space to the other. 9. The information processing device according to claim 8,
The knowledge information indicates the location of workers at the site;
The processor,
Identifying coordinates corresponding to a position of the worker within the miniature 3D model based on the 3D model of the site and the position indicated by the knowledge information of the worker;
placing a worker icon representing the worker at the identified coordinates of the miniature 3D model;
identifying a position in the 3D model of the site that corresponds to the position of the worker based on the 3D model of the site and the position indicated by the knowledge information of the worker;
The information processing device places the worker icon at the specified position in the second virtual space. The information processing device according to claim 9,
The processor,
Accepting a selection of an icon representing the participant or the worker;
An information processing device that executes a predetermined interaction process with the participant or the worker corresponding to the selected icon. The information processing device according to claim 10,
The information processing device, wherein the processor displays, as the predetermined interaction processing, the field of view of the participant or the worker corresponding to the selected icon on the display device. The information processing device according to claim 7,
The processor,
Calculating coordinates in the 3D model of the site that correspond to the specified coordinates based on a position indicated by the knowledge information of the 3D model of the site and the specified coordinates;
The information processing device highlights the calculated coordinates in the second virtual space. An information processing method by an information processing device,
The information processing device includes:
A processor and a memory,
connected to a display device,
The memory includes:
knowledge information indicative of data relating to the site, including a 3D model of the site, and a location corresponding to the data;
virtual space management information indicating a first virtual space constructed by a 3D model of a project management room;
The information processing method includes:
The processor displays the first virtual space on the display device;
The processor displays a miniature 3D model of the site in the first virtual space;
the processor accepts a selection of data included in the knowledge information;
The processor displays the selected data as display content in the first virtual space;
the processor identifies coordinates within the miniature 3D model based on the 3D model of the venue and the location of the selected data indicated by the knowledge information, the coordinates corresponding to a location of the data corresponding to the display content;
The information processing method, wherein the processor highlights the identified coordinates within the miniature 3D model.

Images