JP2018181222A - Stay status display system and stay status display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To confirm seating status of a plurality of persons collectively, and present information with high visibility for identifying a person simply, to a user.SOLUTION: A stay status display system detects a person staying in detection areas where a person is assumed to stay, in a target area, acquires stay information on stay status of a person in each of the detection areas, generates a person icon 53 having different display modes (colors) in accordance with a stay status of the person, on the basis of the stay information, and superimposes the person icon on an area map 44 representing the target area. Specifically, the person icon is formed by embedding a face image registered in advance.SELECTED DRAWING: Figure 10

Description

  The present invention relates to a stay status display system and a stay status display method for generating display information regarding a stay status of a person in a target area based on a video captured by a camera installed in a facility.

  In a facility such as an office building, a camera for shooting the inside of the facility is installed, and a monitoring system for monitoring the situation in the facility by the image of the camera is widely spread. If information about the person's stay in the facility is acquired using such camera images and the information is presented to the user, it is easy to see if the person you want to meet at your desk is at your desk or not The user's convenience is improved.

  As a technique for presenting such a person's stay status to the user, information on the person's presence status, specifically, presence / absence, during a meeting, during a call, during a call, is denied based on the image of a camera. There is known a technology for acquiring information on etc., presenting the information to the user, and presenting to the user statistical information on occupancy rates such as occupancy rates and vacancy rates, congestion levels, crowded places, etc. Patent Document 1).

JP 2002-260110 A

  By the way, there is a demand to want to confirm the presence status of a plurality of persons collectively. For example, a user who wants to check the presence status of a particular person has, in addition to the presence status of that person, another person whose seat is in the vicinity, for example, the presence of another person who belongs to the same team as the particular person. You may also want to check your seating situation.

  However, in the related art, there is a problem in that only the stay information on whether the person is in a specific place is presented to the user, and it is not possible to collectively check the stay status of a plurality of persons. In addition, when presenting the staying status of a plurality of persons to the user, it is desirable to be able to easily identify each person.

  Therefore, according to the present invention, it is possible to collectively check the presence status of a plurality of persons, and further, to provide a stay status display capable of presenting information excellent in visibility for easily identifying each person to the user. The main purpose is to provide a system and a method of displaying the status of stay.

  A stay status display system according to the present invention executes a process of acquiring display images taken by a camera installed in a facility in real time, and generating display information regarding the current stay status of a person in a target area by a processor The display system, wherein the processor detects a stay of a person in a detection area where a person is expected to stay in the target area based on the video, and the stay regarding a stay status of the person for each detection area Information is acquired, and based on the stay information, a person image having a different display form is generated according to the stay condition of the person, and the display information is generated by superimposing the person image on an area image representing the target area Configure

  In the stay status display method of the present invention, a process of acquiring in real time an image captured by a camera installed in a facility and generating display information regarding a current stay status of a person in a target area in the facility A stay status display method executed by a processor, wherein the processor detects a stay of a person in a detection area where a person is expected to stay in the target area based on the video, and detects the stay of each person in the detection area. Based on the stay information, a person image having a different display form is generated based on the stay information, and a person image is superimposed on an area image representing the target area. The display information is generated.

  According to the present invention, the user can grasp the stay status of each person from the person image superimposed on the area image. Thus, the presence statuses of a plurality of persons can be collectively confirmed, and furthermore, display information excellent in visibility for easily identifying each person can be presented to the user.

The whole block diagram of the stay status display system concerning a 1st embodiment Explanatory drawing which shows the layout of each room in the plant | facility based on 1st Embodiment, and the installation condition of the camera 1 Explanatory drawing which shows the setting condition of the detection area with respect to the imaging | video of the camera 1 which concerns on 1st Embodiment. Block diagram showing a schematic configuration of the facility management device 3 and the user terminal 4 according to the first embodiment Explanatory drawing which shows the content of the camera setting information which concerns on 1st Embodiment. Explanatory drawing which shows the presence map screen which concerns on 1st Embodiment. An explanatory view showing an area list screen concerning a 1st embodiment Block diagram showing a schematic configuration of the facility management device 3 and the user terminal 4 according to the second embodiment An explanatory view showing an area list screen concerning a 2nd embodiment An explanatory view showing a presence map screen concerning a 2nd embodiment Explanatory drawing which shows the change condition of the person icon which concerns on 2nd Embodiment Explanatory drawing which shows the principal part of the presence map screen which concerns on 2nd Embodiment. Block diagram showing a schematic configuration of the facility management device 3 and the user terminal 4 according to the third embodiment An explanatory view showing an area list screen concerning a 3rd embodiment Explanatory drawing which shows the principal part of the area list screen which concerns on 3rd Embodiment. Explanatory drawing which shows the modification of the area list screen which concerns on 3rd Embodiment. Flow chart showing processing procedure of facility management device 3 according to the third embodiment The flowchart showing the modification of the processing procedure of facility management device 3 concerning a 3rd embodiment Block diagram showing a schematic configuration of the facility management device 3 and the user terminal 4 according to the fourth embodiment Explanatory drawing which shows the setting condition of the detection area which concerns on 4th Embodiment. Flow chart showing processing procedure of facility management device 3 according to the fourth embodiment The flowchart showing the modification of the processing procedure of facility management device 3 concerning a 4th embodiment Explanatory drawing which shows the detection area edit screen which concerns on 4th Embodiment. Block diagram showing a schematic configuration of the facility management device 3 and the user terminal 4 according to the fifth embodiment An explanatory view showing a presence map edit screen concerning a 5th embodiment Explanatory drawing which shows the principal part of the seating map edit screen which concerns on 5th Embodiment. Explanatory drawing which shows the area map edit screen which concerns on 5th Embodiment.

  According to a first aspect of the present invention, which has been made to solve the above-mentioned problems, there is provided a processing for acquiring in real time an image captured by a camera installed in a facility and generating display information regarding the current state of stay of a person in a target area. A stay status display system executed by a processor, wherein the processor detects a stay of a person in a detection area where a person is expected to stay in the target area based on the video, and detects the stay of each person in the detection area. Based on the stay information, a person image having a different display form is generated based on the stay information, and a person image is superimposed on an area image representing the target area. The display information is generated.

  According to this, the user can grasp the staying condition of each person from the person image superimposed on the area image. Thus, the presence statuses of a plurality of persons can be collectively confirmed, and furthermore, display information excellent in visibility for easily identifying each person can be presented to the user.

  In the second invention, the processor generates display information for displaying a list of a plurality of target areas, and generates the display information on the selected target area according to an operation in which the user selects the target area. Configuration.

  According to this, when the number of persons targeted is large in a large-scale facility, the user can easily grasp the person's stay status by setting multiple target areas and displaying information for each target area. be able to.

  In the third invention, the human image includes a face image registered in advance.

  According to this, the user can easily identify the person.

  Further, according to a fourth invention, the processor changes the display color of the person image in accordance with the presence or absence of the person's present stay.

  According to this, the user can easily grasp the current stay status of the person.

  In the fifth invention, the processor changes the display color of the person image in accordance with the length of absence time of the person.

  According to this, the user can easily grasp the absence time of the person.

  Further, according to a sixth aspect of the present invention, the processor is configured to display the past and future stay statuses of the person according to the selection according to the user's operation of selecting the person image.

  According to this, the user can confirm the past and future presence status of the person who is not present at present.

  Further, according to a seventh aspect of the present invention, the processor is configured to display a schedule of a person involved in the selection in response to a user's operation of selecting the person image.

  According to this, the user can easily confirm the schedule of the person who is currently absent.

  In the eighth invention, the processor is configured to display a screen for creating an e-mail addressed to a person related to the selection according to an operation of the user selecting the person image.

  According to this, the user can easily create an e-mail addressed to a person who is not present at present.

  In addition, the ninth invention executes, by means of a processor, processing for acquiring, in real time, an image taken by a camera installed in a facility in real time, and generating display information regarding the current state of stay of a person in a target area in the facility. The processor is configured to detect a stay of a person in a detection area where a person is expected to stay in the target area based on the video, and the stay of the person for each detection area is detected. The display information obtained by acquiring stay information about a situation, generating a person image having a different display form according to the stay situation of the person based on the stay information, and superimposing the person image on an area image representing the target area Is configured to generate

  According to this, as in the first aspect of the invention, the presence status of a plurality of persons can be checked at once, and furthermore, information excellent in visibility for easily identifying each person is presented to the user. be able to.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

First Embodiment
FIG. 1 is an entire configuration diagram of a stay status display system according to a first embodiment.

  This stay status display system presents to the user information on the stay status of the person in each room (target area) in the facility, and the camera 1, the recorder 2, the facility management apparatus 3, and the user terminal 4 And. The camera 1, the recorder 2, the facility management apparatus 3, and the user terminal 4 are connected via a network.

  The camera 1 is installed in each room (target area) in the facility, and photographs a person staying in each room.

  The recorder 2 accumulates the video transmitted from the camera 1.

  The facility management device 3 receives the video transmitted from the camera 1 and the recorder 2 and analyzes the video to generate display information on the person's stay in each room (target area) in the facility.

  The user terminal 4 is a PC or a tablet terminal operated by the user. The user terminal 4 displays a screen regarding the stay status of a person in each room (target area) in the facility based on the display information transmitted from the facility management device 3, and the user browses this screen. The user can confirm the person's stay in each room in the facility.

  Next, the layout of each room in the facility according to the first embodiment and the installation situation of the camera 1 will be described. FIG. 2 is an explanatory view showing a layout of each room in the facility and an installation state of the camera 1.

  In this embodiment, the facility is provided with an office (office) shown in FIG. 2 (A), a meeting room shown in FIG. 2 (B), and a common room shown in FIG. 2 (C).

  In the office shown in FIG. 2A, desks and chairs are arranged side by side, and a seat consisting of a pair of desks and chairs is assigned to each person, and each person is seated in his or her seat. Do business. In the conference room shown in FIG. 2 (B), a plurality of chairs are arranged around one table, and one group rents the entire room for use. In the common room shown in FIG. 2 (C), a plurality of tables are arranged, and a plurality of chairs are arranged around each table, and one section by one table and a plurality of chairs around it (Division area) is formed, and one group rents and uses this one section.

  A camera 1 is installed on the ceiling of each of the office, the conference room and the common room, and photographs a person staying in each room. In this case, it is preferable to adopt an omnidirectional camera that captures a 360-degree range using a fisheye lens as the camera 1, but a box camera that captures a range of a predetermined angle of view is also possible.

  Next, the setting situation of the detection area with respect to the image of the camera 1 according to the first embodiment will be described. FIG. 3 is an explanatory view showing a setting situation of a detection area for an image of the camera 1.

  In the present embodiment, as shown in FIGS. 3A, 3B, and 3C, detection areas (dotted line rectangular areas) are set in advance on the image of the camera 1. This detection area is set at a position where it is assumed that the body of the person seated in the seat is present, and one detection area corresponds to one person based on the size of the person's body. It is set.

  Further, in the present embodiment, the presence detection process is performed based on the detection area set on the video of the camera 1. In the presence detection process, the stay of the person in the detection area on the video is detected, and stay information regarding the stay status of the person in each detection area is acquired.

  Here, in the present embodiment, room attributes (area attributes) set in advance for each room (target area), specifically, display items corresponding to each of the office (office), the meeting room, and the common room Therefore, display information reflecting the stay information is generated.

  As shown in FIG. 3 (A), in the case of the office (first area attribute), the stay status of the person in each of the detection areas, ie, the presence status for each seat is a display item, and the stay information is Based on the presence status regarding whether or not a person is present at each seat is displayed.

  As shown in FIG. 3B, in the case of a conference room (second area attribute), display information is generated with the use status of the aggregation area in which a plurality of detection areas are aggregated as a display item. In particular, here, the usage status of one entire room (target area) is a display item, and the usage status regarding whether each room is in use is displayed. At this time, with the entire room (target area) as one judgment area, it is judged based on the stay information whether or not each room is in use. In addition, if stay of one or more persons is detected in one room, it may be determined that the room is in use.

  As shown in FIG. 3C, in the case of the common room (third area attribute), as in the case of the conference room, display information is generated using the use status of the aggregation area in which a plurality of detection areas are aggregated as a display item Do. In particular, here, the use status of each section (division area) set in plural in one room (target area) is a display item, and the use status regarding whether each section is in use is displayed. At this time, with one section including a plurality of detection areas as one determination area, it is determined based on the stay information whether or not each section is in use. If the stay of one or more persons is detected in one section, it may be determined that the section is in use.

  The detection area may be set by the user specifying an area of the detection area on the screen on which the image of the camera 1 is displayed, as in the fourth embodiment described later. An object (chair and desk) may be detected from the image of the camera 1 and a detection area may be set based on the detection result.

  Next, schematic configurations of the facility management device 3 and the user terminal 4 according to the first embodiment will be described. FIG. 4 is a block diagram showing a schematic configuration of the facility management device 3 and the user terminal 4.

  The facility management device 3 includes a communication unit 21, a processor 22, a storage unit 23, a monitor 24 (display device), and an input device 25.

  The communication unit 21 communicates with the camera 1 and the recorder 2 and receives an image transmitted from the camera 1 and the recorder 2.

  The storage unit 23 stores an image received by the communication unit 21, various setting information such as setting information on a detection area, setting information on a camera (see FIG. 5), a program executed by the processor 22, and the like.

  The monitor 24 displays a screen (not shown) for inputting a detection area. In the input device 25, the operator performs an operation of inputting the detection area.

  The processor 22 executes various programs by executing the program stored in the storage unit 23. In the present embodiment, each process of presence detection, area determination, and screen control is performed.

  In the presence detection process, based on the video of the camera 1, the stay of the person in the detection area where the stay of the person set in advance on the video is assumed is detected at regular time intervals, and the constant time in each sensing area Get stay information about the stay status of each person.

  In the present embodiment, since a change occurs in the image when the person stays, it is detected whether or not the person is present in the seat based on the change state of the image in the detection area. Specifically, first, the video of the detection area of each time is cut out from the video of each time having a predetermined sampling cycle (for example, one minute). Then, the video change rate is acquired for the video of the detection area at each time. At this time, the video change rate with respect to the video of the time immediately before is compared with the video of the time immediately before setting the sampling period. Next, based on the video change rate at each time, the presence or absence of a person staying in the detection area is determined. Then, based on the determination result, stay information indicating the presence or absence of the person staying at each time having a sampling cycle is generated. In the presence detection process, it is possible to use a classifier in which two classes of presence and absence states are learned in advance by deep learning. In the presence detection process, the discriminator compares the two likelihoods by obtaining the likelihood (certainty) as the presence state and the likelihood as the absence state with respect to the image of the detection area. It can be determined whether the user is present or absent.

  In the area determination process, based on the stay information, the utilization status of the aggregation area in which a plurality of detection areas are aggregated is determined according to the room attribute (area attribute). That is, in a room where one group exclusively uses the entire room, such as a meeting room, the usage status regarding whether the room is in use is determined. In addition, in a room where a plurality of sections are set in the target area, such as a common room, the use status regarding whether or not each section is in use is determined.

  In the screen control process, a screen to be displayed on the user terminal 4 is controlled. In the present embodiment, display information regarding the stay status presentation screen (see FIGS. 6 and 7) is generated. The stay status presentation screen is updated at regular time intervals according to the detection result of the presence detection (stay information) and the determination result of the area determination.

  The facility management apparatus 3 can present the current stay status to the user in real time by performing processing using the current image acquired from the camera 1. Further, by performing processing using the past video acquired from the recorder 2, it is possible to present the past stay status to the user. As a result, the manager can grasp the use situation of each room in the past, and can examine the layout of the room, etc. Further, the manager can confirm the improvement situation when the layout of the room is changed .

  The user terminal 4 includes a communication unit 31, a processor 32, a storage unit 33, a monitor 34, and an input device 35.

  The communication unit 31 communicates with the facility management device 3. The storage unit 33 stores a program or the like to be executed by the processor 22. The processor 32 controls the operation of each unit of the user terminal 4 and, in response to the operation of the input device 35 by the user, the facility management apparatus 3 requests the display of the stay status presentation screen (see FIGS. 6 and 7) from the communication unit 31. Send to Then, when display information regarding the stay status presentation screen transmitted from the facility management device 3 is received by the communication unit 31, the stay status presentation screen is displayed on the monitor 34 based on the display information.

  In addition, when the user terminal 4 is a tablet terminal etc., the input device 35 becomes a touch panel, and it combines with the display panel used as the monitor 34, and comprises a touch panel display.

  Next, camera setting information stored in the storage unit 23 of the facility management device 3 according to the first embodiment will be described. FIG. 5 is an explanatory view showing the contents of camera setting information.

  A camera ID, a camera name, a room number, and a room attribute (area attribute) are registered in the camera setting information. Based on the camera setting information, the processor 22 acquires the room attribute of each room, and generates display information according to the display item corresponding to the room attribute.

  In the present embodiment, one room is set as one target area, and room attributes (area attributes) are set for each room, but one room is divided into a plurality of divided areas, and the divided areas are divided. Area attributes may be set for each area.

  Next, a stay status presentation screen displayed on the user terminal 4 according to the first embodiment will be described. FIG. 6 is an explanatory view showing a presence map screen as a stay status presentation screen. FIG. 7 is an explanatory view showing an area list screen as a stay status presentation screen.

  In the present embodiment, a stay status presentation screen showing the stay status of a person in each room in the facility is displayed on the user terminal 4.

  The presence map screen shown in FIG. 6 and the area list screen shown in FIG. 7 are provided with tabs 41 of each floor (1F, 2F, 3F). When this tab 41 is selected, the screen of the selected floor is displayed. In the case of the office (3F), by selecting a room on the same screen as the area list screen (see FIG. 9) shown in the second embodiment, the transition to the presence map screen shown in FIG. 6 is made.

  In the office (office), the presence status of the person in each of the detection areas set for each seat is a display item, and as shown in FIG. 6, the presence map screen as the stay status presentation screen in the office , A presence map 42 (stay map) indicating the presence status (stay status) of each person is displayed. In the presence map 42, a seat icon 43 (fixed image) indicating the presence status of each seat is superimposed on an area map 44 (map image) indicating the layout of the office (target area). In the area map 44, an image 45 of a desk is drawn.

  In the seat icon 43, characters of "present" or "not" are displayed according to the presence status (present and absent). The seat icon 43 changes in color according to the presence status, is displayed in red when in the presence, and is displayed in green in the absence. The display mode of the seat icon 43 in the office is not limited to this, as long as the presence status (present and absent) can be identified, and a person icon described later can be used.

  In the conference room, the usage status of the entire conference room (target area) is a display item, and as shown in FIG. 7A, the area list screen displays an area icon 46 indicating the usage status of each conference room. . In this area icon 46, the characters "in use" or "available" are displayed according to the use situation. The area icon 46 changes in color according to the usage condition, is displayed in red when in use, and is displayed in green when available in an idle state.

  In the common room, the usage status of each section (divided area) set in the common room (target area) becomes a display item, and as shown in FIG. 7 (B), the area list screen is used for each section A section icon 47 representing the situation is displayed. In the section icon 47, characters of "in use" or "available" are displayed according to the use situation. In addition, the division icon 47 changes in color according to the use status, is displayed in red when in use, and is displayed in green when it is available in an idle state.

  In the present embodiment, the seat icon 43 is superimposed on the area map 44 representing the layout of the office on the office stay status presentation screen (presence map screen) shown in FIG. The seat icon 43 may be superimposed on the In this case, it is preferable to perform processing to correct distortion of the image.

Second Embodiment
Next, a second embodiment will be described. The points not particularly mentioned here are the same as the above embodiment. FIG. 8 is a block diagram showing a schematic configuration of the facility management device 3 and the user terminal 4 according to the second embodiment.

  Although the presence map (see FIG. 6) is displayed in the first embodiment, the presence map of the person in the office can be confirmed in this presence map, but each person can be easily identified. Can not. Therefore, in the present embodiment, a person icon including a face image of a person is displayed on the presence map to simultaneously check the presence situation of a plurality of persons so that each person can be easily identified.

  The facility management apparatus 3 includes a communication unit 21, a processor 22, a storage unit 23, a monitor 24, and an input device 25 as in the first embodiment.

  The communication unit 21, the storage unit 23, the monitor 24, and the input device 25 are the same as those in the first embodiment, but the storage unit 23 stores schedule information of each person.

  The processor 22 performs each process of presence detection and screen control as in the first embodiment, but also performs each process of schedule cooperation and mail cooperation. The presence detection process is the same as that of the first embodiment.

  In the screen control process, display information on the area list screen (see FIG. 9) and the presence map screen (see FIG. 10) is generated.

  In the process of schedule coordination, in accordance with the user's operation on the presence map screen (see FIG. 10), schedule information of a person is acquired from the storage unit, and the schedule information is displayed on the screen.

  In the process of mail cooperation, the mail application program installed on the user terminal 4 is activated according to the user operation on the presence map screen (see FIG. 10), and the electronic mail creation screen is displayed on the user terminal 4 .

  In the present embodiment, the facility management device 3 stores the schedule information of each person, but the schedule information may be acquired from a device dedicated to schedule management. In addition, the facility management apparatus 3 itself may perform schedule management.

  The user terminal 4 includes a communication unit 31, a processor 32, a storage unit 33, a monitor 34, and an input device 35, as in the first embodiment.

  The communication unit 31 communicates with the facility management device 3. The storage unit 33 stores a program or the like to be executed by the processor 22. The processor 32 controls the operation of each part of the user terminal 4 and, in response to the operation of the input device 35 by the user, the display part of the area list screen (see FIG. 9) or the presence map screen (see FIG. 10) 31 to the facility management apparatus 3. Then, when the communication unit 31 receives display information regarding the area list screen and the stay status presentation screen transmitted from the facility management device 3, the area list screen and the stay status presentation screen are displayed on the monitor 34 based on the display information.

  Further, the processor 32 executes the mail application program stored in the storage unit 33 in response to the user's operation on the presence map screen (see FIG. 10), and causes the monitor 34 to display an e-mail creation screen.

  Next, the area list screen displayed on the user terminal 4 according to the second embodiment will be described. FIG. 9 is an explanatory view showing an area list screen.

  The area list screen is provided with a tab 41 of each floor (1F, 2F, 3F). When this tab 41 is selected, an area list screen of the selected floor is displayed. Here, when the tab 41 of the floor (3F) on which the office (office) is located is selected, a plurality of area icons 51 representing each office (target area) are displayed side by side.

  When the user selects an area icon 51 of a room with a seat of a person whose presence is to be checked on this area list screen and performs an operation to shift the screen, the transition to the presence map screen (see FIG. 10) The presence status of each person in the selected room is displayed on the presence map screen.

  Here, as an operation for transitioning the screen, for example, when the input device 35 is a mouse, a scroll operation, that is, when the pointer is superimposed on the area icon 51 and the mouse scroll button is operated, the area icon 51 Is enlarged and it changes to a presence map screen. When the input device 35 is a touch panel, it is preferable to perform pinch out and swipe operations.

  Next, the presence map screen displayed on the user terminal 4 according to the second embodiment will be described. FIG. 10 is an explanatory view showing the presence map screen. FIG. 11 is an explanatory view showing a change state of the person icon 53. As shown in FIG. FIG. 12 is an explanatory view showing the main part of the presence map screen.

  As shown in FIG. 10, on the presence map screen, a presence map 52 (stay map) indicating the presence status (stay status) of each person is displayed. In the presence map 52, a person icon 53 (person image) for each person who has a seat in the target room is superimposed on the area map 44 (map image) representing the layout of the office (target area) . In the area map 44, an image 45 of a desk is drawn.

  The person icon 53 is displayed at a position corresponding to the seat of each person, specifically at a position of a chair on which each person sits. In the person icon 53, a face image of a person (a photographed image of a face) is embedded. Thereby, the person can be easily identified.

  In the present embodiment, transition to the presence map screen is made by selecting a room (target area) on the area list screen (see FIG. 9), but a department list representing the organization configuration is displayed, and By selecting one of the departments from the department list, an occupancy map screen of a room having the selected department may be displayed.

  Further, in the present embodiment, the person icon 53 in which the face image is embedded is disposed on the area map 44 as a person image for identifying each person, but this person image has a feature of the appearance of the person. It may be an image (like a caricature or avatar) drawn schematically, or a character identifying an individual, that is, a character representing a person's name or a person's attribute (affiliation or title) is drawn. It may be.

  As shown in FIG. 11, the display form of the person icon 53 changes in accordance with the presence status of the person. In the example shown in FIG. 11A, the color of the face image of the person icon 53 changes in accordance with the presence or absence of the seat. Specifically, when the user is present, the face image is displayed in color, and when not present, the face image is displayed in gray. This allows the user to immediately confirm whether a person is present or not.

  Further, when the person icon 53 is absent at present, the display form changes according to the absence time. In the example illustrated in FIG. 11B, the color of the portion other than the face image of the person icon 53 changes in accordance with the presence or absence of the seat. For example, the absence time is displayed in blue when the absence time is short, in red when the absence time is long, and changes from blue to red according to the absence time being long.

  Here, in the absence time, the past absence time, that is, the time from when the person leaves the seat to the present time, and the future absence time (the expected absence time), that is, from the current time to the time when the person is going to return to the seat The user can specify at which absentee time the person icon 53 is to be displayed. In addition, the past absent time can be calculated based on the stay information acquired by the presence detection. Further, the future absence time can be calculated from schedule information.

  In addition, on the presence map screen shown in FIG. 10, a legend 54 indicating the length of absence time represented by the color of the person icon 53 is displayed.

  In addition, in the presence map screen, when a predetermined operation is performed on the person icon 53, a transition to a schedule screen (not shown) can be made, and the person's schedule can be confirmed. In the example shown in FIG. 12A, when “schedule” is selected in the pop-up menu 55 displayed by performing the left click operation on the person icon 53, the screen changes to the schedule screen of the person. This allows the user to confirm the person's schedule.

  When a predetermined operation is performed on the person icon 53, the screen changes to a mail creation screen (not shown), and an email addressed to the person can be created. In the example shown in FIG. 12A, when “e-mail” is selected in the pop-up menu 55, a transition is made to a mail creation screen. In the mail creation screen, since the address of the destination is set in advance, it is possible to save the trouble of inputting the address.

  Note that "schedule" or "e-mail" may be selected in a list box (not shown) displayed by right-clicking on the area icon. When the input device 35 is a touch panel, such as when the user terminal 4 is a tablet terminal, the screen changes to the schedule screen or the mail creation screen by an operation such as tap, double tap, long tap (long press), etc. You should do it.

  Further, when a predetermined operation is performed on the person icon 53, the past and future presence statuses of the person are displayed. In the example illustrated in FIG. 12B, the balloon 57 is displayed by the mouse-over operation of placing the pointer over the person icon 53. In this balloon 57, the past presence status, that is, information indicating when it is absent (from 15:00 absent), and the future presence status, that is, when from where it is present (when it is absent) And information (representing no schedule from 17:00) are described. This allows the user to confirm the past and future presence of the person.

  Here, the past presence status of the person may be obtained from the stay information indicating the presence or absence of the person's stay at each time acquired in the presence detection process. Further, the future presence status of the person may be acquired from the schedule information.

  In the present embodiment, the pop-up menu 55 is displayed by the left-click operation, the list box (not shown) is displayed by the right-click operation, and the balloon 57 is displayed by the mouse-over operation. It is not limited to such operation.

Third Embodiment
Next, a third embodiment will be described. The points not particularly mentioned here are the same as the above embodiment. FIG. 13 is a block diagram showing a schematic configuration of the facility management device 3 and the user terminal 4 according to the third embodiment.

  In the first embodiment (see FIG. 7A), the usage status of the conference room (target area) is presented to the user, but when the conference room can be used for reservation, the conference room is currently used. The conference room can not be used if it is reserved even if not. Therefore, in the present embodiment, the reservation status is presented to the user along with the usage status of the conference room.

  The facility management apparatus 3 includes a communication unit 21, a processor 22, a storage unit 23, a monitor 24, and an input device 25 as in the first embodiment.

  The communication unit 21, the storage unit 23, the monitor 24, and the input device 25 are the same as in the first embodiment, but the storage unit 23 stores schedule information on reservation of use of a conference room.

  The processor 22 performs each process of presence detection, area determination, screen control, reservation management, schedule linkage, and mail linkage.

  In the presence detection process, based on the image of the camera 1, the stay of a person in the detection area is detected at regular time intervals, and stay information on the stay status of the person at regular time intervals in the conference room is acquired.

  In the area determination process, based on the stay information, the status of stay of the person in the meeting room, that is, the state of use regarding whether or not the meeting room is currently used is determined at regular intervals.

  In the screen control process, display information is generated on an area list screen (see FIG. 14) that displays the usage status and reservation status of the meeting room (target area).

  In the reservation management process, a schedule for reservation of use of a conference room is managed. Specifically, a reservation screen (not shown) is displayed on the user terminal 4 to allow the user to perform an operation to reserve a use of the conference room, and to execute a process to receive a reservation to use the conference room according to the operation. . In addition, a cancellation screen (not shown) is displayed on the user terminal 4 to allow the user to perform an operation for canceling the usage reservation, and cancel the usage reservation according to the operation and perform processing to update the reservation information. .

  Further, in the process of reservation management, a cancellation prohibition flag is set, which makes it impossible to cancel the use reservation, as the user designates at the time of reservation.

  Further, in the processing of reservation management, when the conference room is left unused even though the conference room is reserved, the process of canceling the reservation for using the conference room is periodically performed.

  In the process of schedule cooperation, in accordance with the user's operation on the area list screen (see FIG. 14), reservation schedule information of the conference room is acquired from the storage unit 23, and the reservation schedule information is displayed on the screen.

  In the process of mail cooperation, the mail application program installed in the user terminal 4 is activated according to the user operation on the area list screen (see FIG. 14), and the electronic mail creation screen is displayed on the user terminal 4.

  In the present embodiment, the facility management device 3 manages the schedule for use reservation of the conference room, but a dedicated device for reservation management may be provided separately. In this case, schedule information is acquired from the dedicated reservation management device, and if it is necessary to release the usage reservation, a notification instructing cancellation of the usage reservation is sent from the facility management device 3 to the dedicated reservation management device. do it.

  The user terminal 4 includes a communication unit 31, a processor 32, a storage unit 33, a monitor 34, and an input device 35, as in the first embodiment.

  The communication unit 31 communicates with the facility management device 3. The storage unit 33 stores a program or the like to be executed by the processor 22. The processor 32 controls the operation of each unit of the user terminal 4 and transmits a display request for displaying the area list screen (see FIG. 14) from the communication unit 31 to the facility management apparatus 3 according to the operation of the input device 35 by the user. Then, when the communication unit 31 receives the display information on the area list screen transmitted from the facility management device 3, the area list screen is displayed on the monitor 34 based on the display information.

  Further, the processor 32 executes the mail application program stored in the storage unit 33 in response to the user's operation on the area list screen (see FIG. 14), and causes the monitor 34 to display an e-mail creation screen.

  Next, an area list screen according to the third embodiment will be described. FIG. 14 is an explanatory view showing an area list screen. FIG. 15 is an explanatory view showing the main part of the area list screen.

  As shown in FIG. 14, the tab 41 of each floor (1F, 2F, 3F) is provided in the area list screen (usage status presentation screen), and when this tab 41 is selected, the area of the selected floor is displayed. A list screen is displayed. Here, when the tab 41 of the floor (1F) on which the meeting room is located is selected, a plurality of area icons 61 (fixed images) representing the meeting rooms (target areas) are displayed side by side.

  The display form of the area icon 61 changes in accordance with the current usage state of the conference room. For example, it is displayed in red if it is in use, and it is displayed in green if it is not in use.

  In addition, on this area list screen, when a predetermined operation is performed on the area icon 61, a transition to a schedule screen (not shown) can be made, and the reservation schedule of the conference room can be confirmed. In the example shown in FIG. 15A, when “schedule” is selected in the pop-up menu 65 displayed by performing the left-click operation on the area icon 61, transition to the reservation schedule screen of the conference room is made.

  Also, when a predetermined operation is performed on the area icon 61, a transition to a mail creation screen (not shown) is made, and an email addressed to the current reservation person of the selected meeting room (target area) is created. Can. In the example shown in FIG. 15A, when “e-mail” is selected in the pop-up menu 65, a transition is made to a mail creation screen. In the mail creation screen, since the address of the destination is set in advance, it is possible to save the trouble of inputting the address.

  Note that “schedule” or “e-mail” may be selected in a list box (not shown) displayed by performing a right-click operation on the area icon 61. When the input device 35 is a touch panel, such as when the user terminal 4 is a tablet terminal, transition to a reservation schedule screen or a mail creation screen is performed by an operation such as tap, double tap, or long tap (long press). Just do it.

  In addition, when a predetermined operation is performed on the area icon 61, the current reservation status of the conference room (target area) is displayed. In the example shown in FIG. 15B, the balloon 67 is displayed by the mouse-over operation of placing the pointer on the area icon 61. In the balloon 67, the current reservation status of the conference room (without a reservation) and the current usage status of the conference room (from 15:00 no usage) are described.

  Thus, the user can easily check whether a conference room not currently used is reserved. Furthermore, the user can easily confirm whether a conference room not being used is originally reserved or if the conference is completed earlier than scheduled and the conference room is vacant.

  In the present embodiment, the pop-up menu 65 is displayed by the left-click operation, the list box (not shown) is displayed by the right-click operation, and the balloon 67 is displayed by the mouse-over operation. It is not limited to such operation.

  Next, a modification of the area list screen according to the third embodiment will be described. FIG. 16 is an explanatory view showing a modification of the area list screen.

  In the example shown in FIG. 14, the display form (color) of the area icon 61 representing each meeting room (target area) is changed according to the current usage condition of the meeting room, but in this modification, the reservation is made In a conference room in which a cancel impossible flag is set to disable the cancellation of the reservation, the area icon 61 is displayed as grayed out as the inoperable state.

  In addition, when the cancellation impossible flag is set, the area icon 61 may be in the non-display state.

  Next, the processing procedure of the facility management device 3 according to the third embodiment will be described. FIG. 17 is a flowchart showing the processing procedure of the facility management device 3.

  In the present embodiment, a process of canceling a reservation for using a conference room that has been left unused is periodically performed. The processing described below is sequentially performed on each conference room.

  Specifically, first, in the processor 22, it is determined whether or not the target conference room is currently reserved (ST101). Here, if the target meeting room is not currently reserved (No in ST101), the process ends.

  On the other hand, when the target conference room is currently reserved (Yes in ST101), it is next determined whether a cancellation impossible flag is set for the reservation (ST102). Here, when the cancellation impossible flag is set (Yes in ST102), the process is ended.

  On the other hand, when the cancellation impossible flag is not set (No in ST102), it is next determined whether the conference room is currently in use (ST103). Here, if the conference room is currently in use (Yes in ST103), the process ends.

  On the other hand, if the conference room is not currently in use (No in ST103), it is next determined whether a predetermined time (for example, 15 minutes) has elapsed without being used (ST104). Here, when the predetermined time has not passed without being used (Yes in ST104), the process is ended.

  On the other hand, when the predetermined time has elapsed without being used (No in ST104), a notification (cancel notification) to the effect that the reservation is canceled is transmitted to the user terminal 4 of the reserver by e-mail or the like (ST105). Then, a process of canceling the usage reservation and updating the reservation information is performed (ST106).

  If the conference room is reserved but not used, the conference will not be used at all from the beginning of the reservation time, or the conference will end earlier than scheduled and the conference room will be vacant There is. For this reason, when it is not used at all from the beginning of the reservation time, it may be determined by the elapsed time (left time) from the start time of the reserved use time in the elapsed time determination (ST104) of the predetermined time. Further, when the reserved use time is in the middle of the vacant state, it may be determined by the elapsed time after the vacant state.

  Thus, when the reservation is canceled and the reservation information is updated, the updated reservation information is reflected on the area list screen (refer to FIG. 14) displaying the use situation of the conference room, and displayed by the operation of the mouse over A balloon 67 (see FIG. 15B) indicates that the reservation has been canceled.

  Next, a modification of the processing procedure of the facility management device 3 according to the third embodiment will be described. FIG. 18 is a flowchart showing a modified example of the processing procedure of the facility management device 3.

  In the example shown in FIG. 17, the process of canceling the reservation for using the conference room left unused is periodically performed. However, in this modification, an area list screen for displaying the use situation of the conference room The process of canceling the reservation for using the conference room is started, triggered by the operation of the user selecting the conference room in (see FIG. 14).

  Specifically, first, in the processor 22, an operation of selecting a meeting room (target area) on the area list screen (see FIG. 14), specifically, an operation of clicking or mouse-over on the area icon 61 was performed. If it is detected (YES in ST111), it is determined whether a reservation has been made in the target meeting room (ST101). Here, if the target meeting room is not currently reserved (No in ST101), the process ends.

  On the other hand, when the target conference room is currently reserved (Yes in ST101), it is next determined whether a cancellation impossible flag is set for the reservation (ST102). Here, when the cancellation impossible flag is set (Yes in ST102), the process is ended.

  On the other hand, when the cancellation impossible flag is not set (No in ST102), it is next determined whether the conference room is currently in use (ST103). Here, if the conference room is currently in use (Yes in ST103), the process ends.

  On the other hand, when the conference room is not currently in use (No in ST103), a notification (cancel notification) indicating cancellation of the reservation is transmitted to the user terminal 4 of the reserver by e-mail or the like (ST105). Then, it is determined whether or not there is a reply to the effect that the cancellation of the reservation is accepted (ST112). Here, when there is a reply to the effect that the cancellation of the reservation is accepted (Yes in ST112), processing for canceling the usage reservation and updating the reservation information is performed (ST106).

  On the other hand, when there is no reply to the effect that the cancellation of the usage reservation is accepted (No in ST112), it is next determined whether the usage status has changed during usage (ST113). Here, if the use status changes during use (Yes in ST113), the process ends.

  On the other hand, if the use status has not changed during use (No in ST113), it is next determined whether or not a predetermined time has elapsed since the cancellation notice was transmitted (ST114). Here, if the predetermined time has not passed since the cancellation notice was transmitted (No in ST114), the process returns to the determination (ST112) whether or not there is a reply to the effect that the cancellation of the reservation is accepted.

  On the other hand, if a predetermined time has elapsed since the transmission of the cancellation notification (Yes in ST114), the reservation is canceled and the reservation information is updated (ST1016).

  Thus, in this modification, the user who wants to use the meeting room browses the area list screen (see FIG. 14, usage state presentation screen), confirms the use state of the meeting room, and further, wants to use the meeting room. At the timing when the reservation status is confirmed, processing for canceling the reservation for using the conference room is started. As a result, the user is waiting for cancellation, reservation for use of a conference room left unused is quickly canceled, and the conference room can be used early. A plurality of users may check the use status of the conference room, and cancellation waiting may conflict. In this case, a message (not shown) indicating that only the first accessed user is accepted as a cancellation waiting user, and the second and subsequent users are made unavailable (cancel waiting registration registered) is displayed as a balloon 67 It is good to make it display.

  In particular, in the present modification, when there is a response indicating that cancellation of the usage reservation is accepted in response to the notification (cancel notification) indicating cancellation of the usage reservation, the usage reservation is canceled and the reservation information is updated. . In addition, after sending the notification that the usage reservation is canceled, there is no reply to the acceptance of the cancellation of the usage reservation, and a predetermined time has passed without changing the usage status of the conference room during usage. , Forcibly cancel the usage reservation and update the reservation information. As a result, it is possible to quickly cancel the reservation for using a conference room that is not used or a conference room that is unlikely to be used, and to effectively use the conference room.

  It should be noted that, when the reservation for using the conference room is canceled, the area list screen (see FIG. 14, usage status presentation screen) is displayed, and the user terminal 4 on which the user has performed the screen operation has been canceled. The notification may be sent by e-mail or the like. As a result, the user can quickly grasp that the reservation for using the meeting room has been canceled, and therefore, the meeting room can be used early.

  Moreover, although the example which made the meeting room the object area was demonstrated in this embodiment, the object area is not limited to this, and the room used for applications other than a meeting may be sufficient. Further, the same applies to the case where a reservation is required for each of a plurality of sections set in one room serving as the target area, as in the case of a common room.

Fourth Embodiment
Next, a fourth embodiment will be described. The points not particularly mentioned here are the same as the above embodiment. FIG. 19 is a block diagram showing a schematic configuration of the facility management device 3 and the user terminal 4 according to the fourth embodiment.

  In shops such as restaurants, there are cases where the layout is free, that is, a customer or a salesclerk can freely move a chair and a table during business hours. In this case, since the detection area set on the video to detect the presence of a person is shifted from the actual position of the seat, the accuracy of the detection of presence decreases.

  Therefore, in the present embodiment, the positions of fixed objects, specifically tables and chairs, which are installed in a store and define the staying position of a person, are detected, and detection areas are set based on the detection results. By regularly performing this process, even when the detection area is updated as needed and the customer or the store clerk moves the chair and the table, it is possible to avoid a decrease in the accuracy of the presence detection.

  The facility management device 3 includes a communication unit 21, a processor 22, a storage unit 23, a monitor 24 (display device), and an input device 25 as in the first embodiment.

  The communication unit 21, the storage unit 23, the monitor 24, and the input device 25 are the same as those in the first embodiment.

  The processor 22 performs each process of person detection, object detection, detection area setting, and detection area correction. In addition, the processor performs each process of presence detection and screen control as in the first embodiment.

  In the process of person detection, a person is detected from the image acquired from the camera 1. If a person is present in the image, the detection accuracy of the chair and the table in the object detection process is reduced. Therefore, when a person is detected from the image, the subsequent object detection and detection area setting process is not performed.

  In the process of object detection, a chair and a table are detected from an image acquired from the camera 1 to acquire positional information of the chair and the table. It should be noted that prior to the object detection process, it is preferable that the chair and the table (a fixed object) installed in the store be learned in advance by the classifier to perform the object detection. The learning accuracy of the fixed object is the detection accuracy of the object detection Can be improved.

  In the detection area setting process, based on the position information of the chair and the table acquired in the object detection process, a detection area to be subjected to the presence detection of whether or not a person is present is set. At this time, since the chair and the table at a position away from the camera 1 appear small in the image, the size of the detection area is corrected according to the distance from the camera 1.

  In the detection area correction process, if there is an error in the detection area set in the detection area setting process, the detection area editing screen (see FIG. 23) is displayed on the monitor 24, and the detection area editing screen is displayed. The position and size of the detection area are corrected according to the operation of the operator.

  In the present embodiment, as in the first embodiment, stay information regarding a person's stay status is acquired by presence detection, and display information is generated based on the stay information. As in the one embodiment, a stay map (presence map) may be generated. This makes it possible to grasp the customer's stay status at a glance at a large-scale store.

  In addition, based on the stay information, statistical information on the store's operation status, such as a customer's seat occupancy time, occupancy rate, and average stay time may be generated, and display information on the statistical information may be generated. .

  Next, the setting condition of the detection area according to the fourth embodiment will be described. FIG. 20 is an explanatory view showing a setting state of a detection area.

  The image of the camera 1 shows a table and a chair installed in the store, and the table and the chair are detected by the object detection with respect to the image, and the detection area is set on the image based on the detection result .

  Next, the processing procedure of the facility management device 3 according to the fourth embodiment will be described. FIG. 21 is a flowchart showing the processing procedure of the facility management device 3.

  In this embodiment, the positions of fixed objects, specifically tables and chairs, which are installed in a store and define the staying position of a person, are detected, and a detection area is set based on the detection result. The detection area is updated as needed by periodically performing this process every predetermined time (for example, 15 minutes or 30 minutes).

  Specifically, first, the processor 22 acquires an image of the camera 1 and performs processing for detecting a person from the image (ST201). Then, it is determined whether or not a person is detected in the person detection process (ST202).

  Here, when a person is not detected (No in ST202), next, processing for detecting an object (chair and table) from the image of the camera 1 is performed (ST203). Then, the detected position of the object is compared with the position of the object registered in the area setting information of the storage unit 23 to determine whether the position of the object is changed (ST 204).

  Here, when there is a change in the position of the object (Yes in ST204), the detection area is set based on the position information of the detected object to update the area setting information (ST205). That is, position information of the detection area newly set based on the position of the detected object is registered in the area setting information.

  On the other hand, when a person is detected (Yes in ST202) or when there is no change in the position of an object (No in ST204), processing of object detection and area setting is not performed.

  In the present embodiment, human detection is performed prior to object detection, but human detection may not be performed. In addition, the user may select whether or not to perform person detection in user settings.

  Next, a modification of the processing procedure of the facility management device 3 according to the fourth embodiment will be described. FIG. 22 is a flowchart showing a modified example of the processing procedure of the facility management device 3.

  In the example shown in FIG. 21, processing of object detection and area setting is performed at the timing when a person is not detected. However, in this modification, object detection and area setting are performed for a place where a person is not detected. Make it work. That is, the target area is divided into a plurality of divided areas, and object detection and area setting processing are performed on the divided areas in which no person is detected. The division area may be, for example, a cell obtained by dividing the target area with a uniform size.

  Specifically, first, in the processor 22, processing for detecting a person from the video of the camera 1 is performed on the first divided area (ST211). Then, it is determined whether or not a person is detected in the process of person detection (ST 212).

  Here, when a person is not detected (No in ST21), next, processing is performed to detect an object from a video by targeting a divided area (ST213). Then, the detected position of the object is compared with the position of the object registered in the area setting information of the storage unit 23 to determine whether the position of the object is changed (ST 214).

  Here, when there is a change in the position of the object (Yes in ST214), the detection area is set based on the position information of the detected object to update the area setting information (ST215). That is, position information of the detection area newly set based on the position of the detected object is registered in the area setting information.

  Next, it is determined whether all divided areas have ended (ST216). Here, if all the divided areas are not finished (No in ST216), the process proceeds to the processing of the next divided area.

  On the other hand, when a person is detected in the process of person detection (Yes in ST212), or when there is no change in the position of an object (No in ST214), the process of object detection or area setting for divided areas is Without performing, the process proceeds to the end determination of the division area (ST216).

  Next, a detection area editing screen according to the fourth embodiment will be described. FIG. 23 is an explanatory view showing a detection area editing screen.

  In the present embodiment, the position information of the chair and the table is acquired by object detection with respect to the image, and the detection area is set based on the position information. In this case, the position and size of the detection area may be inappropriate. Therefore, in the present embodiment, the position and size of the detection area can be corrected on the detection area editing screen shown in FIG.

  In the detection area editing screen, a frame line 71 (detection area image) representing the range of the detection area is displayed on the image 72 of the camera 1 based on the position information of the detection area acquired in the process of area setting. It can be checked whether the location and size of the area is different from the actual one. Here, if the position or size of the detection area is different from the actual one, correct the position or size of the detection area by selecting the frame line 71 of the detection area and performing the operation of moving or changing the size. Can.

  For example, a correction operation becomes possible by selecting the frame line 71 of the detection area by left-clicking, and the frame line 71 of the detection area can be moved to the correct position by the drag and drop operation. In addition, when the pointer is placed on the frame line 71 of the detection area in the selection state of the frame line 71 of the detection area, the pointer changes to arrows in both directions, and the size of the frame line 71 of the detection area can be corrected. it can.

  Further, the detection area correction screen is provided with an "add" button 75 and a "delete" button 76. When the “Add” button 75 is operated, the frame line 71 of the new detection area appears on the image 72, and the movement of the frame line 71 of the detection area and the size change operation are performed. Can be set to an appropriate position and size. Further, when the “delete” button 76 is operated, the frame line 71 of the detection area in the selected state can be deleted.

  In the present embodiment, the frame line 71 of the detection area is displayed on the image 72 of the camera 1. At this time, it is preferable to perform image processing for correcting distortion appearing in the image of the omnidirectional camera. .

Fifth Embodiment
Next, a fifth embodiment will be described. The points not particularly mentioned here are the same as the above embodiment. FIG. 24 is a block diagram showing a schematic configuration of the facility management device 3 and the user terminal 4 according to the fifth embodiment.

  In the second embodiment, the presence map 52 (see FIG. 10) representing the presence status for each person is displayed on the user terminal 4, but in the present embodiment, the editing operation of the operator in the facility management device 3 is performed. The presence map 52 is created.

  In the present embodiment, the facility management apparatus 3 creates the presence map 52, but an application program for editing the presence map is installed on the user terminal 4 operated by the administrator, and the user The presence map 52 may be created at the terminal 4.

  The facility management device 3 includes a communication unit 21, a processor 22, a storage unit 23, a monitor 24 (display device), and an input device 25 as in the first embodiment.

  The communication unit 21, the storage unit 23, the monitor 24, and the input device 25 are the same as those in the first embodiment, but the storage unit 23 stores affiliation information and face images of each person.

  The processor 22 performs processing of person list generation, person icon generation, object detection, area map generation, area map correction, and presence map generation. In addition to this, the processor 22 performs each processing of presence detection and screen control as in the first embodiment.

  In the person list generation process, based on the affiliation information of each person acquired from the storage unit 23, a person list 81 (see FIG. 25) to be displayed on the presence map editing screen is generated.

  In the process of generating a person icon, a person icon 53 (see FIG. 25) in which the face image of each person acquired from the storage unit 23 is embedded is generated.

  In the object detection process, an object is detected from the image of the camera 1 and position information of the object in the office (target area) is acquired. In the present embodiment, the chair and the desk are detected from the image to acquire the position information of the chair and the desk.

  In the area map generation process, an area map 44 (see FIG. 25) representing the layout of the office (target area) is generated based on the position information of the chair and the desk.

  In the presence map generation process, the presence map editing screen (see FIG. 25) is displayed on the monitor 24, and the seat of each person on the area map 44 is displayed according to the operator's operation on the presence map editing screen. The presence map 52 in which the person icon 53 is arranged at the position is generated.

  In the area map correction process, if there is an error in the area map 44 generated in the area map generation process, the area map editing screen (see FIG. 27) is displayed on the monitor 24 and the operator responds to the area map editing screen. And correct the area map 44.

  In the present embodiment, the facility management device 3 stores the affiliation information and the face image of each person, but the affiliation information and the face image may be acquired from a device dedicated to tissue management. Further, the facility management apparatus 3 itself may perform organization management.

  Next, the presence map editing screen displayed on the monitor 24 according to the fifth embodiment will be described. FIG. 25 is an explanatory view showing the presence map editing screen. FIG. 26 is an explanatory view showing the main part of the presence map editing screen.

  In the facility management device 3, the presence map editing screen shown in FIG. 25 is displayed on the monitor 24, and the operator performs the editing operation to create the presence map 52. Editing of the presence map is performed at the time of system introduction. It is also implemented when the layout of the office (target area) is changed, or when there is a change in a person.

  The presence map editing screen is provided with tabs 41 of each floor (1F, 2F, 3F). When this tab 41 is selected, the screen of the selected floor is displayed. At this time, a screen similar to the area list screen (see FIG. 9) shown in the second embodiment is displayed, and by selecting a room to be edited, the screen changes to a presence map editing screen shown in FIG.

  In addition, a person list 81 is displayed on the presence map editing screen. In the person list 81, the names of the persons and the person icons 53 (person images) are displayed in a list in a state of being classified based on the configuration of the organization to which the persons belong. Specifically, the names of the groups, the names of the teams forming each group, the names of the people belonging to each team, and the person icons 53 are displayed side by side. In the person icon 53, a face image of the person is embedded.

  Further, an area map 44 (area image) representing a target room is displayed on the presence map editing screen. In the area map 44, a seat frame 83 (object image) in which the person icon 53 is arranged is drawn at the position of the seat (chair) (the fixed position of each person), and the desk image 45 (object image) ) Is drawn.

  The person icon 53 displayed in the person list 81 can be moved onto the area map 44 and pasted on the seat frame 83 of the area map 44 by a predetermined operation such as drag and drop operation by the operator. By sequentially performing an operation of attaching the person icon 53 to the area map 44 for each person, a presence map in which the person icon 53 of each person is disposed at the seat position of each person is completed.

  At this time, if control is performed so that the person icon 53 is pasted only on the seat frame 83 of the area map 44, the editing operation of the operator who pastes the person icon 53 on the area map 44 becomes easy.

  In the present embodiment, the person icon 53 is arranged on the area map 44 on which the seat frame 83 and the desk image 45 are drawn as an area image representing the target area. 53 may be arranged. In this case, image processing may be performed to correct distortion of the image.

  Further, as shown in FIG. 26, when a predetermined operation, for example, a mouse-over operation is performed on the person icon 53 attached to the seat frame 83 of the area map 44, the name of the person corresponding to the person icon 53 and A balloon 85 in which the affiliation (group, team) is described is displayed. As a result, the operator can confirm whether the person icon 53 arranged in the area map 44 has an error.

  In the present embodiment, the balloon 85 is displayed by the mouse-over operation. However, the present invention is not limited to such an operation.

  Next, an area map editing screen according to the fifth embodiment will be described. FIG. 27 is an explanatory view showing an area map editing screen.

  In this embodiment, position information of a chair and a desk is acquired by object detection with respect to a video, and an area map 44 in which an image 45 of the seat frame 83 or desk is drawn is generated based on the position information. If a false detection occurs, the position and size of the seat frame 83 and the desk image 45 on the area map 44 will be different from the actual one. Therefore, in the present embodiment, the position and size of the seat frame 83 and the desk image 45 on the area map can be corrected on the area map editing screen shown in FIG.

  In this area map editing screen, the area map 44 generated in the area map generation process is displayed on the image 86 of the camera 1, and it is confirmed whether the position and size of the seat frame 83 or the desk image 45 are different from actual. Can. Here, when the position and size of the seat frame 83 and the desk image 45 are different from the actual size, the seat frame 83 and the desk image 45 are selected, and the seat frame is operated by moving and resizing. The position or size of the image 83 of the desk 83 or the desk 45 can be corrected.

  For example, by making the seat frame 83 selected by left click, a correction operation becomes possible, and the seat frame 83 can be moved to the correct position by a drag and drop operation. In addition, when the pointer is placed on the frame of the seat frame 83 in the selected state of the seat frame 83, the pointer changes to arrows in both directions, and the size of the seat frame 83 can be corrected. The position and size of the desk image 45 can also be corrected in the same manner as the seat frame 83.

  Further, the area map editing screen is provided with an "add" button 87 and a "delete" button 88. When the "Add" button 87 is operated, a new seat frame 83 or desk image 45 appears on the area map 44, and the seat frame 83 or desk image 45 is moved or resized to operate the seat frame. The image 83 or the desk image 45 can be set to an appropriate position and size. Further, when the "delete" button 88 is operated, the seat frame 83 in the selected state and the image 45 of the desk can be deleted.

  Although the area map 44 is displayed on the image 86 of the camera 1 in this embodiment, at this time, it is preferable to perform image processing for correcting distortion appearing in the image of the omnidirectional camera.

  As described above, the embodiment has been described as an example of the technology disclosed in the present application. However, the technology in the present disclosure is not limited to this, and can be applied to embodiments in which changes, replacements, additions, omissions, and the like have been made. Moreover, it is also possible to combine each component demonstrated by said embodiment, and to set it as a new embodiment.

  In the stay status display system and the stay status display method according to the present invention, the presence status of a plurality of persons can be confirmed at once, and information excellent in visibility for easily identifying each person can be used as a user As a stay status display system and a stay status display method, etc., which have an effect that can be presented on the basis of an image captured by a camera installed in a facility, and generate display information regarding the stay status of a person in a target area It is useful.

1 camera 2 recorder 3 facility management device 4 user terminal 22 processor 51 area icon 52 presence map 53 person icon 55 pop-up menu 57 balloon

A stay status display system according to the present invention executes a process of acquiring display images taken by a camera installed in a facility in real time, and generating display information regarding the current stay status of a person in a target area by a processor In the display system, the processor cuts out a video of each time having a predetermined sampling cycle in a detection area where stay of a person set in advance is assumed on the video, and the cut-out video of each time is The presence or absence of a person staying in the detection area is determined using a classifier that has learned in advance two classes of stay state and absence state, and stay information regarding the person's stay status for each detection area is obtained, based on the stay information, a person icon human image is embedded representing the two elements of the degree of presence and absence times of presence Form, a configuration for generating the display information by superimposing the person icon on the area image representing the target area.

In the stay status display method of the present invention, a process of acquiring in real time an image captured by a camera installed in a facility and generating display information regarding a current stay status of a person in a target area in the facility It is a stay condition display method executed by a processor, and the processor cuts out an image of each time having a predetermined sampling cycle in a detection area where it is assumed on the image that a person set in advance is expected to stay. Regarding the cutout image of time, the presence / absence of the person staying in the detection area is determined using the classifier which has learned in advance two classes of the stay state and the absent state, and the stay regarding the person's stay status for each detection area to obtain information, based on the stay information, person image representing the two elements of the degree of presence and absence times of presence is embedded People It generates icon, a configuration for generating the display information by superimposing the person icon on the area image representing the target area.

According to the present invention, the user can grasp the presence or absence of each person and the degree of absence time by the person icons superimposed on the area image. Thus, the presence statuses of a plurality of persons can be collectively confirmed, and furthermore, display information excellent in visibility can be presented to the user for easily identifying the stay status of each person .

According to a first aspect of the present invention, which has been made to solve the above-mentioned problems, there is provided a processing for acquiring in real time an image captured by a camera installed in a facility and generating display information regarding a current person's stay in a target area. A stay status display system executed by a processor, wherein the processor cuts out a video of each time having a predetermined sampling cycle in a detection area where a stay of a person set in advance is assumed on the video, Regarding the cutout image of time, the presence / absence of the person staying in the detection area is determined using the classifier which has learned in advance two classes of the stay state and the absent state, and the stay regarding the person's stay status for each detection area to obtain information, based on the stay information, person image representing the two elements of the degree of presence and absence times of presence is embedded Generating an object icon, a configuration for generating the display information by superimposing the person icon on the area image representing the target area.

According to this, the user can grasp the presence or absence of each person and the degree of absence time by the person icon superimposed on the area image. Thus, the presence statuses of a plurality of persons can be collectively confirmed, and furthermore, display information excellent in visibility can be presented to the user for easily identifying the stay status of each person .

Further, according to a fifth invention, the processor changes the display color of at least a part of the person icon according to the length of absence time of the person .

Further, according to a sixth aspect of the present invention, the processor is configured to display the past and future stay statuses of the person according to the selection according to the user's operation of selecting the person icon .

Further, according to a seventh aspect of the present invention, the processor is configured to display a schedule of a person involved in the selection according to an operation of a user who selects the person icon .

In the eighth invention, the processor is configured to display a screen for creating an e-mail addressed to a person related to the selection according to the operation of the user selecting the person icon .

In addition, the ninth invention executes, by means of a processor, processing for acquiring, in real time, an image taken by a camera installed in a facility in real time, and generating display information regarding the current state of stay of a person in a target area in the facility. In the method of displaying a stay status, the processor cuts out a video of each time having a predetermined sampling cycle in a detection area in which a stay of a person set in advance is assumed on the video, and cuts out each time About the image, the presence or absence of the person in the detection area is determined using a classifier that has learned in advance two classes of stay state and absence state, and stay information regarding the person's stay status for each detection area is acquired and, based on the stay information, generates a person icon human image is embedded representing the two elements of the degree of presence and absence times of presence It is configured to generate the display information by superimposing the person icon on the area image representing the target area.

Claims (9)

A stay status display system, which causes a processor to execute processing for acquiring in real time an image captured by a camera installed in a facility and generating display information regarding the current status of a person's stay in a target area,
The processor is
Based on the video, a stay of a person in a detection area where a stay of a person is assumed in the target area is detected, and stay information regarding a stay status of the person in each detection area is acquired.
Based on the stay information, a person image having a display form different according to the stay condition of the person is generated,
A stay status display system characterized in that the display information is generated by superimposing the person image on an area image representing the target area. The processor is
Generate display information that lists multiple target areas,
The stay status display system according to claim 1, wherein the display information related to the selected target area is generated in response to an operation of the user selecting the target area.   The stay status display system according to claim 1 or 2, wherein the person image includes a face image registered in advance. The processor is
The stay status display system according to any one of claims 1 to 3, wherein the display color of the person image is changed according to the presence or absence of the current stay of the person. The processor is
The stay status display system according to any one of claims 1 to 4, wherein the display color of the person image is changed according to the length of absence time of the person. The processor is
The stay status display system according to any one of claims 1 to 5, wherein a past and future stay status of a person according to the selection is displayed according to an operation of a user who selects the person image. . The processor is
The stay status display system according to any one of claims 1 to 6, wherein a schedule of a person involved in the selection is displayed according to an operation of a user who selects the person image. The processor is
8. A stay according to any one of claims 1 to 7, characterized in that a screen for creating an e-mail addressed to the person concerned with the selection is displayed according to the operation of the user who selects the person image. Status display system. A stay status display method, which causes a processor to execute processing for acquiring in real time an image captured by a camera installed in a facility and generating display information regarding a current stay status of a person in a target area in the facility. ,
The processor is
Based on the video, a stay of a person in a detection area where a stay of a person is assumed in the target area is detected, and stay information regarding a stay status of the person in each detection area is acquired.
Based on the stay information, a person image having a display form different according to the stay condition of the person is generated,
A stay status display method comprising: generating the display information in which the person image is superimposed on an area image representing the target area.

Images