JP2024086388A - Management device, management system and management method - Google Patents

Abstract

[Problem] To provide a management device that allows each person to check their own authentication result in a short time, prevents congestion in the passage, and performs smooth authentication even when multiple people pass through a specified point at the same time. [Solution] A management device that manages people passing through a first point includes a processor that acquires a first image of multiple people moving through the specified passage by an imaging device arranged at a second point and capable of capturing an image of a person proceeding through a specified passage toward the first point, acquires authentication status information indicating the status of authentication performed for each of the multiple people based on the first image and a face image registered in advance, detects the facial area of each of the multiple people included in the first image, processes the detected facial area into multiple display images, and instructs one or more display devices arranged at the second point to display multiple pieces of authentication information including the display images and authentication status information of each of the multiple people at once. [Selected Figure] Figure 7

Description

This disclosure relates to a management device, a management system, and a management method.

Conventionally, there is known a security system that is applied to a facility (such as a data center) where the authority to enter and exit rooms in a building is specified for each visitor. This security system makes various announcements based on an image captured by a camera, such as whether a human area has been detected, whether a face area has been extracted, whether the face is facing forward, or whether personal authentication has been successful. For example, at a door that allows entry only to people who have successfully passed face authentication, this security system is known to make announcements to guide a person who wishes to enter to take a specific action in order to capture an image suitable for authentication, and to announce the results of the authentication performed on that person (see Patent Document 1).

JP 2017-224186 A

The security system in Patent Document 1 is not intended to authenticate multiple people at the door at the same time and allow them to pass through. Therefore, if multiple people come to an authentication device that authenticates people at the same time and are requested to perform authentication processing or display authentication processing results at approximately the same time, the number of people who can perform authentication processing or display authentication processing results at one time is limited, and people waiting to be authenticated may accumulate.

The security system in Patent Document 1 is also expected to display detailed data of visitors on the display unit of the reception terminal or entrance terminal. However, when many people pass by at the same time, the amount of information displayed increases, making it difficult for the person to be authenticated to understand the announcement that is being made to him or her. Therefore, when the above-mentioned display unit makes announcements to many people at the same time, it is desirable to simplify the display content while making it easier for the person to be authenticated to understand the content of the announcement that is being made to him or her.

The present disclosure provides a management device, management system, and management method that allows each person to check their own authentication information in a short time, avoid congestion in the passageway, and perform smooth authentication, even when multiple people pass through a given point at the same time.

One aspect of the present disclosure is a management device that manages people passing through a first point, the management device including a processor, the processor acquiring a first image of a plurality of people moving through a predetermined passage by an imaging device arranged at a second point and capable of imaging a person proceeding through a predetermined passage toward the first point, acquiring authentication status information indicating the status of authentication performed for each of the plurality of people based on the first image and a face image registered in advance, detecting a facial region of each of the plurality of people included in the first image, processing the detected facial regions into a plurality of display images, and instructing one or more display devices arranged at the second point to simultaneously display a plurality of pieces of authentication information including the display image and the authentication status information for each of the plurality of people.

One aspect of the present disclosure is a management system including a management device that manages people passing through a first point, an imaging device that is arranged at a second point and capable of imaging people proceeding along a predetermined passage toward the first point, and a display device that is arranged at the second point, in which the imaging device images a plurality of people moving along the predetermined passage to generate a first image and transmits the first image to the management device, the management device receives the first image, acquires authentication status information indicating the status of authentication performed for each of the plurality of people based on the first image and a face image registered in advance, detects a face area of each of the plurality of people included in the first image, processes the detected face area into a plurality of display images, and transmits authentication information including the display image and the authentication status information of each of the plurality of people to a display device, and the display device receives the authentication information of each of the plurality of people and displays the authentication information of each of the plurality of people multiple times at once.

One aspect of the present disclosure is a management method for managing people passing through a first point, the management method including the steps of: acquiring a first image of a plurality of people moving through a predetermined passage by an imaging device arranged at the second point and capable of imaging a person proceeding through a predetermined passage toward the first point; acquiring authentication status information indicating the status of authentication performed for each of the plurality of people based on the first image and a face image registered in advance; detecting a face region of each of the plurality of people included in the first image, and processing the detected face region into a plurality of display images; and instructing one or more display devices arranged at the second point to display multiple pieces of authentication information including the display image and the authentication status information for each of the plurality of people at once.

According to the present disclosure, even when multiple people pass through a given point at the same time, each person can check their own authentication result in a short time, preventing congestion in the passageway and enabling smooth authentication.

FIG. 1 is a block diagram illustrating a configuration example of a management system according to an embodiment of the present disclosure. A diagram showing an example of the installation of cameras and displays at the gates. FIG. 1 is a block diagram showing an example of the configuration of a management device; FIG. 13 is a diagram showing an example of person registration information. FIG. 13 is a diagram showing an example of gate passage information. Flowchart showing a first operation example of the management system A diagram showing an example of display according to the passage position at the gate FIG. 13 is a diagram showing an example of dynamic display change in response to a change in passage position at a gate. FIG. 13 is a diagram showing an example of a plurality of regions formed in a passage in a second operation example; Flowchart showing a second operation example of the management system FIG. 1 is a diagram showing an example of a plurality of regions formed in a passage and the positions of people passing through the passage; FIG. 11 is a diagram showing an example of displaying authentication information on each display according to the person position shown in FIG. 10 . FIG. 13 is a diagram showing an example of a plurality of regions formed in a passage in a third operation example; Flowchart showing a third operation example of the management system FIG. 13 is a diagram showing a display example in which authentication information is displayed in a Y2 direction. A flowchart showing a fourth operation example of the management system. FIG. 13 is a diagram showing a first display example of authentication information of each person in the fourth operation example; FIG. 13 is a diagram showing a second display example of authentication information of each person in the fourth operation example. Flowchart showing a fifth operation example by the management system FIG. 13 is a diagram showing a first display example of authentication information of each person in the fifth operation example; FIG. 13 is a diagram showing a second display example of authentication information of each person in the fifth operation example. Flowchart showing a sixth operation example by the management system FIG. 23 is a diagram showing a first display example of authentication information of each person in the sixth operation example; FIG. 23 is a diagram showing a second display example of authentication information of each person in the sixth operation example. FIG. 13 is a diagram showing an example of a plurality of regions formed in a passage in a sixth operation example; Flowchart showing a seventh operation example by the management system FIG. 11 is a diagram showing a first display example in which edge passing warning information is displayed using an authentication information frame. FIG. 11 is a diagram showing a second display example in which edge passing warning information is displayed using an authentication information frame. FIG. 13 is a diagram showing a third display example in which edge passing warning information is displayed using an authentication information frame. FIG. 11 shows a first display example in which end-traffic warning information or normal traffic information is displayed using aisle end lines. FIG. 11 shows a second display example in which end-traffic warning information or normal traffic information is displayed using aisle end lines. FIG. 13 shows a third display example in which end-traffic warning information or normal traffic information is displayed using aisle end lines. FIG. 13 is a diagram showing a first presentation example of authentication information using a character. FIG. 11 is a diagram showing a second example of presentation of authentication information using a character. FIG. 11 is a diagram showing a third example of presentation of authentication information using a character. FIG. 4 is a diagram showing a fourth example of presentation of authentication information using a character. FIG. 5 is a diagram showing a fifth example of presentation of authentication information using a character. FIG. 6 is a diagram showing a sixth presentation example of authentication information using a character.

Below, the embodiments will be described in detail with reference to the drawings as appropriate. However, more detailed explanations than necessary may be omitted. For example, detailed explanations of already well-known matters or duplicate explanations of substantially identical configurations may be omitted. This is to avoid the following explanation becoming unnecessarily redundant and to facilitate understanding by those skilled in the art. Note that the attached drawings and the following explanation are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

For example, the term "part" or "device" in the embodiments is not limited to a physical configuration that is mechanically realized by hardware, but also includes configurations whose functions are realized by software such as a program. Furthermore, the functions of one configuration may be realized by two or more physical configurations, or the functions of two or more configurations may be realized by, for example, one physical configuration.

FIG. 1 is a block diagram showing an example configuration of a management system 5 according to an embodiment of the present disclosure. The management system 5 includes a camera 10, a display 20, and a control PC (Personal Computer) 30. The camera 10, the display 20, and the control PC 30 are installed, for example, for each gate 50. The number of gates 50 may be one or more. The management system 5 also includes a management device 100 and an authentication server 200.

The camera 10 and display 20 of each gate 50 are connected to the control PC 30 so as to be able to communicate with each other wired or wirelessly. The control PC 30 of each gate 50 is connected to the management device 100 so as to be able to communicate with each other wired or wirelessly. The authentication server 200 is connected to the management device 100 so as to be able to communicate with each other wired or wirelessly. The camera 10, display 20, control PC 30, management device 100, and authentication server 200 may be connected to each other so as to be able to communicate with each other by forming a wired or wireless network. Furthermore, the number of cameras 10 and displays 20 installed at each gate 50 is arbitrary.

A camera 10 is installed at each gate 50. The camera 10 captures images of various subjects, for example, a person passing through the corresponding gate 50. The camera 10 captures, for example, the face of a person proceeding in a predetermined direction (travel direction).

A display 20 is installed for each gate 50. The display 20 displays various data and information. For example, the display 20 displays various data and information to a person passing through the corresponding gate 50 or a person located in the vicinity of the gate 50.

A control PC 30 is installed at each gate 50. The control PC 30 controls the operation of the camera 10 and display 20 of the corresponding gate 50. For example, the control PC 30 instructs the camera 10 on various settings and acquires images captured by the camera 10. For example, the control PC 30 instructs the display 20 on various settings and transmits information to be displayed by the display 20 (e.g., warning information, images, and guidance information) to the display 20.

The management device 100 manages each device in the management system 5 and cooperates with each device to manage people passing through each gate 50, that is, people present in the passage AL leading to the gate 50. The management device 100 may manage people passing through the gate 50 individually, or may manage multiple people passing through the gate 50 as a group. The management device 100 may be installed in any location, for example, in a management center that manages the gates 50 and the management system 5.

The authentication server 200 acquires images captured by each camera 10 installed at each gate 50 via the control PC 30 and the management device 100. The authentication server 200 authenticates the person captured in the acquired image based on the image, and notifies the management device 100 of authentication status information indicating the authentication status. The authentication status information may include authentication results and information indicating that authentication is in progress. The authentication results include, for example, authentication success (OK) or failure (NG). The authentication server 200 may be installed in any location, and may be installed in, for example, a management center that manages the gate 50 and the management system 5. Also, "authentication" may be interpreted as "matching". The authentication server 200 has a configuration including, for example, a processor, a memory, and a communication device.

Figure 2 is a diagram showing an example of the installation of cameras 10 and displays 20 for each gate 50. In Figure 2, the display 20 is installed in the center of the frame of the gate 50, and cameras 10 are installed on both sides of the display 20 in the horizontal direction. The gates 50 are installed in specified areas, and are installed at the entrances and exits of the area or within the area. Although not shown in Figure 2, the control PC 30 may be placed at any position relative to the position of the gate 50 for each gate 50.

The shape of the gate 50 is not limited to the shape shown in the first installation example, and may be other shapes. For example, the shape of the gate 50 may be a deep tunnel shape, or a ceiling-hanging shape in which the camera 10 and the display 20 are suspended from a support member installed above the ceiling or the passage through which people move. In addition, the gate 50 is not limited to the type as long as it is possible to obtain biometric characteristic data of a person at a specified point or data that is the source of the biometric characteristic data. For example, the camera 10 and the display 20 may be a shape in which the display 20 that can be moved on casters or the like is provided with a camera 10 that captures a person passing through a specified point. This display 20 that can be moved on casters or the like can be placed at any point (an example of a second point), but the placement position and placement orientation (placement state) of the camera 10 and the display 20 are adjusted so that the person passing through the gate 50 can be captured. Similarly, even when the camera 10 and the display 20 are installed at the gate 50, the installation position and installation orientation (installation state) of the camera 10 and the display 20 are adjusted at the time of installation so that they can capture images of people passing through the gate 50. Note that installation is one example of the arrangement.

Gate 50 is a gate through which multiple people (e.g., a large number of people) can pass at the same time. Gate 50 allows various people HM (e.g., people HA, HB, ...) to pass through. For example, adults, children (e.g., infants), people wearing masks, and people not wearing masks can pass through gate 50. People passing through gate 50 are authenticated individually or as a group by management device 100 and authentication server 200. Groups are, for example, family, friends, or other units, and may include adults and children.

Figure 3 is a block diagram showing an example configuration of the management device 100.

The management device 100 includes a processor 110, a memory 120, and a communication device 130. The management device 100 may operate as a server that performs a predetermined process, or may be equipped with an operation device and a display device like a PC, and may receive operations from an administrator and display them to the administrator when performing the predetermined process.

The processor 110 may include an MPU (Micro Processing Unit), a CPU (Central Processing Unit), a DSP (Digital Signal Processor), or a GPU (Graphical Processing Unit). The processor 110 may be configured with various integrated circuits (e.g., an LSI (Large Scale Integration), an FPGA (Field Programmable Gate Array)). The processor 110 realizes various functions by executing programs stored in the memory 120. The processor 110 comprehensively controls each part of the management device 100 and performs various processes.

The memory 120 includes a primary storage device (e.g., a random access memory (RAM) or a read only memory (ROM)). The memory 120 may include a secondary storage device (e.g., a hard disk drive (HDD) or a solid state drive (SSD)) or a tertiary storage device (e.g., an optical disk or an SD card). The memory 120 may be an external storage medium and may be removable from the management device 100. The memory 120 stores various data, information, programs, and the like. The memory 120 holds, for example, person registration information I1 and gate passage information I2, which will be described later. The person registration information I1 may also be held in memory in the authentication server 200.

Returning to FIG. 3, the communication device 130 communicates various data or information, etc., according to a wired or wireless communication method. The communication method of the communication device 130 may be a wide area network (WAN), a local area network (LAN), cellular communication for mobile phones (e.g., LTE, 5G), or power line communication, etc.

The communication device 130 can communicate with the camera 10, the display 20, the control PC 30, and other communication devices. For example, the communication device 130 may receive from the camera 10 an image captured by the camera 10. The communication device 130 may transmit to the display 20 display information and display instructions to be displayed by the display 20.

Figure 4 is a diagram showing an example of person registration information I1. Person registration information I1 includes various information related to a person who has been registered in advance. Person registration information I1 includes, for example, identification information of the person (e.g., name and ID) and a facial image of the person. Person registration information I1 may also include identification information of a registered group to which the person belongs (e.g., group ID). The facial image of the person is an example of biometric characteristic data of the person, and is used to authenticate the person. Furthermore, person registration information I1 may include images other than the facial image of the person.

5 is a diagram showing an example of the gate passage information I2. The processor 110 generates the gate passage information I2 for each gate 50, regarding the passage of each person through the gate 50. The gate passage information I2 includes, for example, the passage time when each person passed through the gate 50, the authentication result (individual authentication result), the group ID, and the group authentication result. The passage time is the time when each person passed through the gate 50, and may be, for example, the image capture time when an image of each person was captured when passing through the gate 50. The authentication result is the authentication result (success (OK) or failure (NG)) obtained from the authentication server 200. The group ID is an ID that identifies a registered group. The group authentication result is determined based on the individual authentication results of multiple people belonging to the same registered group. For example, when an authentication result of successful authentication is obtained for all people belonging to the registered group, the group authentication result is successful. Also, when an authentication result of successful authentication is not obtained for at least one person belonging to the set group, the group authentication result is failed.

The processor 110 of the management device 100 may perform group authentication based on the acquired individual authentication results of multiple persons belonging to the same registered group, derive the group authentication result, and write the group authentication result in the gate passage information I2. The processor of the authentication server 200 may perform group authentication based on the acquired individual authentication results of multiple persons belonging to the same registered group, derive the group authentication result, and transmit the group authentication result to the management device 100 via the communication device of the authentication server 200. The processor 110 of the management device 100 may obtain the group authentication result from the authentication server 200, and write the group authentication result in the gate passage information I2.

Next, we will explain an example of how the management system 5 displays each person's authentication information.

First, the zone in which a person can be detected by the management system 5 will be described. Each person enters or exits a specified area, for example, by passing through the passage AL and the gate 50. To pass through the gate 50, a person must be successfully authenticated by the authentication server 200 and must be highly reliable. Therefore, the entire passage AL is included in the zone in which a person can be detected. Therefore, the entire passage AL is included in the imaging range of at least one camera 10. In this embodiment, as an example, the zone will be described as coinciding with the range within the passage AL.

In FIG. 2, the coordinate system of the passage AL is shown. The X1 direction is parallel to the horizontal plane and perpendicular to the direction of travel of the person heading towards gate 50. The Y1 direction is parallel to the horizontal plane and parallel to the direction of travel of the person heading towards gate 50, i.e., perpendicular to the X1 direction.

Figure 2 also shows the coordinate system of the display 20. The X2 direction is the left-right direction in the display, and is, for example, parallel to the horizontal plane, parallel to the display surface (screen), and the same direction as the X1 direction. The Y2 direction is the up-down direction in the display, parallel to the display surface (screen), and perpendicular to the X2 direction. Note that the Y2 direction may be perpendicular to the horizontal plane or tilted from the direction perpendicular to the horizontal plane, depending on the installation state (installation angle) of the display 20 relative to the horizontal plane.

Note that in each of the X1, Y1, X2, and Y2 directions, the coordinate values in each direction are larger on the tip side (positive side) of the arrow, and smaller on the base side (negative side) of the arrow.

[First operation example]
Fig. 6 is a flowchart showing a first operation example of the management system 5. The process in Fig. 6 is performed, for example, for each image captured by the camera 10 of each gate 50. Fig. 6 shows that face recognition is performed as an example of authentication, but other authentication may be used.

First, the camera 10 of the gate 50 captures an image including the face of at least one person HM passing through the passage AL. The passage AL is located upstream in the direction of travel of the people, near the gate 50. The control PC 30 obtains from the camera 10 an image captured by the camera 10 (captured image), and transmits the captured image to the management device 100.

In the management device 100, the processor 110 acquires (receives) an image captured from the camera 10 via the communication device 130 (S11). The processor 110 transmits the acquired image to the authentication server 200 via the communication device 130 and instructs the authentication server 200 to perform face authentication. The authentication server 200 receives the image captured and an instruction to perform face authentication from the management device 100, performs face authentication on the image captured in accordance with the instruction, and transmits authentication status information to the management device 100. In the management device 100, the processor 110 acquires (receives) authentication status information from the authentication server 200 via the communication device 130.

Processor 110 detects the position of each person reflected in the captured image on the basis of the captured image. Processor 110 calculates the position of each person in real space (person position) on the basis of the position of each person on the image (S12). This person position may be an absolute position or a relative position in the passage AL (zone). Here, as an example, the person position is assumed to be a relative position, and the position in the X1 direction (X1 coordinate) and the position in the Y1 direction (Y1 coordinate) are derived, but other person positions may also be derived.

The processor 110 determines the display position of each person's authentication information on the display 20 based on the person's position (S13). Details of the authentication information will be described later. For example, the processor 110 determines the display position in the X2 direction (X2 coordinate) on the display 20 based on the X1 coordinate of the aisle AL of each person. For example, the X1 coordinates of the left and right ends of the aisle AL are (0) and (X1Max), respectively. The X2 coordinates of the left and right ends of the display 20 are (0) and (X2Max), respectively. The X1 coordinate of the position where the person HM is passing on the aisle AL is (HMX1). The X2 coordinate of the position where the authentication information of the person HM is displayed is (HMX2). The processor 110 may determine the display position in the X2 direction (X2 coordinate) based on the ratio (X1Max:X2Max=HMX1:HMX2) between the position of the person HM on the aisle AL and the display position of the person HM on the display. In other words, the processor 110 may determine the display position on the display 20 based on how far the person HM is from the left end of the aisle AL and the ratio between the total width (X1 direction) of the aisle AL and the total width (X2 direction) of the display 20. The processor 110 may also track the position of the person while the person is moving on the aisle, and constantly derive the position on the aisle and the display position.

The processor 110 instructs the display 20 to display the authentication information of each person at the determined display position of each person (S14). In this case, the processor 110 transmits the authentication information, display position, and display instruction of each person to the display 20 via the communication device 130. The display 20 receives the authentication information, display position, and display instruction of each person from the management device 100, and displays the authentication information of each person on the display surface (screen) according to the display instruction and display position.

Here, the authentication information of each person includes a display image of each person and authentication status information of each person. Furthermore, the processor 110 may generate a display image by processing the acquired captured image or by replacing it with a facial image included in the person registration information I1 for the authenticated person. In processing the captured image, the processor 110 may generate a display image as a facial image, for example, by detecting and cutting out a facial area from the captured image. The display image may be an iconized image. The generation of the display image may be performed, for example, in step S11 after the captured image is acquired.

The authentication information IA also has, for example, an authentication information frame WK that surrounds the outer periphery of the display image GD (see FIG. 7 described later). The display mode of the authentication information frame WK may indicate authentication status information. For example, when the authentication information frame WK is green, it may indicate that the person corresponding to the display image in the authentication information frame WK has been successfully authenticated. For example, when the authentication information frame WK is red, it may indicate that the person corresponding to the display image in the authentication information frame WK has failed to be authenticated. Note that the color of the authentication information frame WK is not limited to green or red and may be any color, and the authentication information IA may indicate the authentication status by information other than the display mode of the authentication information frame WK. For example, in addition to the embodiment of the present disclosure, the present disclosure may also support attendance management in educational institutions such as schools by installing a gate 50 at the entrance to a room (e.g., a classroom). In this case, when the gate 50 is installed at the entrance to a classroom, the processor 110 may indicate the authentication status of the person HM attempting to enter the classroom (e.g., whether authentication was successful or unsuccessful) by the presence or absence of a seat number displayed, instead of by the color of the authentication information frame WK. For example, if a seat number is displayed together with the display image of the person HM, this may indicate that the person HM has been successfully authenticated. In this case, the person HM can easily determine that he or she is treated as present. On the other hand, if a seat number is not displayed together with the display image of the person HM, the processor 110 may indicate that authentication has failed. In this case, the person HM can easily determine that he or she is treated as absent despite being present.

Figure 7 is a diagram showing an example of display according to the passage position (passing position) at gate 50. Figure 7 shows that when heading towards gate 50 through aisle AL, person HA, person HC, person HD, and person HB are located, in that order from the negative side (base end side) in the X1 direction. In this case, the display position is determined so that the authentication information of person HA, person HC, person HD, and person HB is arranged, in that order, from the negative side in the X2 direction on the display 20. Therefore, the management device 100 can instruct the display of the authentication information according to the passage position of each person in the aisle AL. The display 20 can display the authentication information according to the passage position of each person in the aisle AL.

Figure 8 is a diagram showing an example of dynamic display changes in response to changes in the passing position at gate 50. Figure 8 shows that when heading toward gate 50 through passage AL, at time t1, person HA, person HB, person HC, and person HD are located in order from the negative side of the X1 direction. At time t1, processor 110 determines the display position so that the authentication information of person HA, person HB, person HC, and person HD is arranged in order from the negative side of the X2 direction on display 20. Then, at time t2, which is later than time t1, person HB, person HC, person HA, and person HD are located in order from the negative side of the X1 direction. At time t2, processor 110 determines the display position so that the authentication information of person HB, person HC, person HA, and person HD is arranged in order from the negative side of the X2 direction on display 20.

That is, the management device 100 may sequentially perform the processes of steps S11 to S14 in FIG. 6. That is, the processor 110 may sequentially obtain captured images in which a person in the passage AL is reflected via the communication device 130, sequentially calculate the person's position, sequentially calculate the display position on the display 20, and sequentially instruct the display of the authentication information at the display position. In this way, the processor 110 may dynamically change the display position of the authentication information of a person passing through the passage AL. Note that the frequency of changing this display position may be high or low. That is, the processor 110 may change the display position smoothly by constantly changing the display position, or may change the display position gradually by periodically changing the display position.

In this way, the management device 100 instructs the display position of each person's authentication information on the display 20 according to the passage position of each person on the aisle AL, and the display 20 may dynamically change the display position of each person's authentication information on the display 20 according to the passage position of each person on the aisle AL in accordance with the instruction from the management device 100. As a result, a person passing through the aisle AL can easily check their own authentication information while proceeding toward the gate 50, since their authentication information is displayed at a position in the X2 direction corresponding to their position in the X1 direction. Therefore, the management device 100 can shorten the time required for a person passing through the gate 50 to check their own authentication information, and can suppress people from accumulating while passing through the gate 50.

[Second Operation Example]
In the second operation example, the management system 5 includes a plurality of (for example, two) displays 20. There is a space between each of the displays 20. As an example, a display 20A and a display 20B are provided as the displays 20.

In addition, in the second operation example, the aisle AL (zone) has multiple regions. In other words, the region to which each position in the aisle AL belongs is determined by its positional relationship with respect to the installation position of the display 20. The aisle AL is divided at any position in the X1 direction to form multiple regions, and each region extends along the Y1 direction.

Figure 9A is a diagram showing an example of multiple regions formed in the passage AL. The passage AL includes a region RA facing the display 20A, a region RB facing the display 20B, and a region RC located between the regions RA and RB and facing the space SP. Each region extends along the Y1 direction.

In the second operation example, the processor 110 instructs the display 20A to display the authentication information of the person located in the area RA. The processor 110 instructs the display 20A to display the authentication information of the person located in the area RB. The processor 110 instructs both the display 20A and the display 20B to display the authentication information of the person located in the area RC.

Figure 9B is a flowchart showing a second operation example by the management system 5. The process in Figure 9 is performed, for example, for each image captured by the camera 10 of each gate 50. Figure 9 shows that face recognition is performed as an example of authentication, but other authentication may be used. In Figure 9, explanations of processes similar to those shown in Figure 6 are omitted or simplified.

First, the management system 5 performs the process of steps S11 to S13 in FIG. 6. In step S13, similar to the first operation example, the processor 110 may determine the display position in the X2 direction (displayed X2 coordinate) for each person HM based on the ratio of the total length of the width (length in the X1 direction) of the aisle AL to the total length of the horizontal width (length in the X2 direction) of the display 20 (X1Max:X2Max=HMX1:HMX2) and the X1 coordinate of the aisle AL of each person. In the second operation example, since multiple displays 20 are installed side by side, the total width measured when each display 20 is connected side by side is compared with the total width of the aisle AL. Next, the processor 110 of the management device 100 determines whether any person HM on the aisle AL is located within the area RC facing the space SP between the displays 20A and 20B (S21).

If any person HM on the passage AL is in the area RC, the processor 110 instructs both displays 20 to display the authentication information of the person HM in the area RC (for example, display on the right edge of display 20A and the left edge of display 20B) (S22). In this case, the processor 110 transmits the authentication information of the person in the area RC and a display instruction to the two displays 20 via the communication device 130. The two displays 20 each receive the authentication information of the person in the area RC and the display instruction, and display the authentication information of the person in the area RC on each screen in accordance with the display instruction.

In other words, the authentication information of the person in region RC is displayed on display 20A together with the authentication information of the person in region RA. Also, the authentication information of the person in region RC is displayed on display 20B together with the authentication information of the person in region RB. That is, the region including region RA and region RC (integrated region RAC obtained by integrating region RA and region RC) is the region displayed on display 20A. Processor 110 determines the display position in the X2 direction on display 20 according to the position in the X1 direction in integrated region RAC. Similarly, the region including region RB and region RC (integrated region RBC obtained by integrating region RB and region RC) is the region displayed on display 20B. Processor 110 determines the display position in the X2 direction on display 20 according to the position in the X1 direction in integrated region RBC.

When none of the persons on the passage AL is in the area RC, the processor 110 instructs the display 20 corresponding to the person's passage position in the passage AL (e.g., the display 20 in front of the passage position) to display the authentication information of each person (S23). For example, when a specific person HM is in the area RA, the processor 110 instructs the display 20A in front of the person HM to display the authentication information of the person HM. In this case, the processor 110 transmits the authentication information of the person in the area RA and a display instruction to the display 20A via the communication device 130. The display 20A receives the authentication information of the person in the area RA and the display instruction, and displays the authentication information of the person in the area RA on each screen according to the display instruction. Similarly, when a specific person HM is in the area RB, the processor 110 instructs the display 20B in front of the person HM to display the authentication information of the person HM.

Figure 10 is a diagram showing an example of multiple areas formed in the passage AL and the positions of people passing through the passage AL. Figure 11 is a diagram showing an example of the display of authentication information on each display 20A, 20B according to the positions of the people shown in Figure 10. In the display example of Figure 11, the description of items similar to the display example of Figure 7 will be omitted or simplified.

In FIG. 10, person HB1, person HC1, and person HD1 are located in area RA. Person HB2, person HC2, and person HD2 are located in area RB. Person HA is located in area RC. That is, in integrated area RAC, person HB1, person HC1, person HD1, and person HA are located in order from the negative side of the X1 direction. In this case, the display positions are determined so that the authentication information of person HB1, person HC1, person HD1, and person HA is arranged in order from the negative side of the X2 direction on display 20A. Therefore, as shown in FIG. 11, the authentication information of person HB1, person HC1, person HD1, and person HA is arranged and displayed in order from the negative side of the X2 direction on display 20A. Also, in integrated area RBC, person HA, person HB2, person HD2, and person HC2 are located in order from the negative side of the X1 direction. In this case, the display positions are determined so that the authentication information of the persons HA, HB2, HD2, and HC2 are arranged in order on the display 20B from the negative side in the X2 direction. Therefore, as shown in FIG. 11, the authentication information of the persons HA, HB2, HD2, and HC2 is arranged and displayed on the display 20B from the negative side in the X2 direction. Therefore, the management device 100 can determine whether to display the authentication information of each person on the display 20 (20A or 20B) corresponding to the passage position of each person in the passage AL, i.e., the position in the X1 direction, or to display it on both displays 20. In addition, each display 20 can display the authentication information of each person according to the passage position of each person in the integrated area RAB or the passage position in the integrated area RCB.

In this way, the management device 100 may divide the passage AL into a number of areas RA, RB, and RC, and display the authentication information of a person located in each area on a display 20 corresponding to each area. As a result, if this person is a person who is reflected on the end of a specific display 20 (e.g., display 20A) on the side of another display 20 (e.g., display 20B) of the multiple displays 20 arranged side by side according to the position in the passage, the person will be reflected on the multiple displays 20A and 20B. Therefore, even if a person is passing through a position on the passage corresponding to a position between the multiple displays 20, their own authentication information will be easily visible.

Even if there are multiple displays 20, the aisle AL does not have to be divided into multiple areas. In this case, the processor 110 of the management device 100 may display the authentication information of a person passing through the aisle AL on the multiple displays 20 with the same display content.

Note that, although an example has been given here in which there is a space between the multiple displays 20 (adjacent displays 20), this is not limiting. For example, the multiple displays 20 may be arranged without gaps along the X1 and X2 directions. Even in this case, an area RC may be provided opposite at least the midpoint between the positions at which the multiple displays 20 (adjacent displays 20) are arranged. Even in this case, when a person located at a position opposite the midpoint between the multiple displays 20 passes by, the authentication information of this person can be displayed on the multiple displays 20.

[Third Operation Example]
In the third operation example, when multiple people pass through the passage AL lined up in the Y1 direction at the same positions in the X1 direction, the management system 5 displays the authentication information of the multiple people lined up in the Y2 direction. The positions in the X1 direction being similar may mean that the positions in the X1 direction are completely the same positions, or may mean that the positions are the same positions with a certain degree of variation in the X1 direction.

Figure 12A is a diagram showing an example of multiple areas formed in an aisle AL. The aisle AL includes multiple areas extending along the Y1 direction, with the length in the X1 direction divided into N equal parts (for example, N=8). In Figure 12A, the areas include regions RG1 to RG8. The fact that the positions in the X1 direction are the same with a certain degree of width means that when multiple people are located in the same area of any of the regions RG1 to RG8, these multiple people are located at the same position in the X1 direction.

Figure 12B is a flowchart showing a third operation example by the management system 5. The process in Figure 12B is performed, for example, for each image captured by the camera 10 of each gate 50. In Figure 12B, the description of the process similar to the process shown in Figure 6 is omitted or simplified.

First, the management system 5 performs the processes of steps S11 to S13 in FIG. 6. In the management device 100, the processor 110 determines whether any of the multiple persons (e.g., person HA and person HB) on the aisle AL are located at the same position in the X1 direction (S31). The same position in the X1 direction does not mean that the X1 coordinates are completely the same, but may refer to a state in which the X1 coordinates have a certain width in the X1 direction and are included in the same region of any of the multiple regions RG1 to RG8 shown in FIG. 12A.

When any of the multiple persons (e.g., person HA and person HB) are located at the same position in the X1 direction, the processor 110 instructs the display 20 to display the authentication information of the multiple persons in a line in the Y2 direction via the communication device 130 (S32). In this case, the processor 110 may instruct the arrangement order of the authentication information of each person in the Y2 direction based on the Y1 coordinate of each person in the passage AL. For example, when the Y1 coordinate of person HA is larger than the Y1 coordinate of person HB, the processor 110 may instruct the display 20 to display the authentication information of person HA at a higher position (the tip side in the Y2 direction) than the display position of the authentication information of person HB. The display 20 receives the above-mentioned information on the arrangement order and the display instruction, and displays the authentication information of the multiple persons in a line in the Y2 direction according to the display instruction and the arrangement order.

On the other hand, if none of the multiple people are located at the same position in the X1 direction, the processor 110 instructs the display 20 via the communication device 130 to display the multiple people without arranging them side by side in the Y2 direction of the display surface (S33). In this case, the processor 110 does not instruct the arrangement order in the Y2 direction of the authentication information of each person. In accordance with the display instruction, the display 20 displays the authentication information of each person without arranging them side by side in the Y2 direction.

As in FIG. 6, the processor 110 instructs the display 20 to display the authentication information of each person via the communication device 130 at a display position in the X2 direction (displayed X2 coordinate) of the display 20 based on the position of each person in the X1 direction of the aisle AL. The display 20 displays the authentication information of each person at a display position in the X2 direction of the display 20 based on the position of each person in the X1 direction of the aisle AL.

Figure 13 is a diagram showing a display example in which authentication information is displayed in an array in the Y2 direction. Figure 13 shows a display example when the third operation example shown in Figure 12 is implemented. In the display example of Figure 13, the explanation of matters similar to the display example of Figure 7 will be omitted or simplified.

In FIG. 13, person HA and person HB are located at the same position in the X1 direction. Therefore, the display 20 displays the authentication information of person HA and person HB at the same position in the X2 direction, that is, side by side in the Y2 direction.

In this way, in the third operation example, when multiple people pass by overlapping in the front-to-back direction (Y1 direction), the display 20 displays them side-by-side in the up-down direction on the screen. This makes it easier for passersby checking the display 20 (e.g., people HA and HB) to search for their own authentication information, since the relationship between the passersby's own movements and the display position of the authentication information on the screen matches.

When people overlap, if they are in the same position in the X1 direction, the position in the Y1 direction does not need to be taken into account, and conversely, the position in the Y1 direction may also be taken into account. In other words, if people are in the same position in the X1 direction and the difference in position in the Y1 direction is within a predetermined distance, the condition of step S31 in FIG. 12B may be satisfied.

[Fourth operation example]
In the fourth operation example, the management system 5 determines the display size of the authentication information of a person passing through the aisle AL based on the position of the person relative to the gate 50, i.e., the distance between any person HM passing through the aisle AL and the gate 50, and displays the authentication information.

Figure 14 is a flowchart showing a fourth operation example by the management system 5. The process in Figure 14 is performed, for example, for each image captured by the camera 10 of each gate 50. In Figure 14, the explanation of the process similar to the process shown in Figure 6 is omitted or simplified.

First, the management system 5 performs the processes of steps S11 to S13 in FIG. 6. In the management device 100, the processor 110 determines the display size of the authentication information of a person passing through the passage AL based on the distance between the person and the gate 50. For example, the processor 110 may determine that the closer the person is to the gate 50, the larger the display size of the authentication information of the person (S41). The processor 110 may also determine that the closer the person is to the gate 50, the smaller the display size of the authentication information of the person (S41). In other words, the processor 110 may determine that the farther the person is from the gate 50, the larger the display size of the authentication information of the person. This display size is determined for each person.

The processor 110 instructs the display of each person's authentication information at the display size determined for each person via the communication device 130 (S42). In this case, the communication device 130 transmits each person's authentication information, display size, and display instructions to the display 20. The display 20 receives each person's authentication information, display size, and display instructions, and displays each person's authentication information at the determined display size in accordance with the display instructions.

As in FIG. 6, the processor 110 instructs the display 20 to display the authentication information of each person via the communication device 130 at a display position in the X2 direction of the display 20 based on the position of each person in the X1 direction of the aisle AL. Thus, the display 20 displays the authentication information of each person at a display position in the X2 direction of the display 20 based on the position of each person in the X1 direction of the aisle AL.

Figure 15A is a diagram showing a first display example of the authentication information of each person in the fourth operation example. Figure 15B is a diagram showing a second display example of the authentication information of each person in the fourth operation example. In the display examples of Figures 15A and 15B, the explanation of matters similar to the display example of Figure 7 will be omitted or simplified.

In FIG. 15A, the management system 5 displays the authentication information of a person larger the closer the person is to the gate 50, i.e., the larger the Y1 coordinate indicating the person's position. In FIG. 15A, as an example, person HA is located further towards the tip in the Y1 direction than person HB, i.e., person HA is located closer to the gate 50 than person HB. Therefore, the Y1 coordinate of the person position of person HA is larger than the Y1 coordinate of the person position of person HB. Therefore, the display 20 displays the authentication information of person HA larger than the authentication information of person HB.

As a result, a passerby (e.g., persons HA and HB) checking the display 20 can easily search for his/her own authentication information since the closer the person is to the gate 50, the larger the person's authentication information is displayed, and the relationship between the passerby's distance from the gate 50 and the display size of the authentication information on the screen matches. This is because, according to the law of perspective, when a person is viewed from the gate 50, the closer the person is to the gate 50, the larger the person appears.

In FIG. 15B, the management system 5 displays the authentication information of a person larger the further the person is from the gate 50, i.e., the smaller the Y1 coordinate indicating the person's position. In FIG. 15B, as an example, person HA is located further towards the tip in the Y1 direction than person HB. Therefore, the Y1 coordinate of the person position of person HA is larger than the Y1 coordinate of the person position of person HB. Therefore, the display 20 displays the authentication information of person HB larger than the authentication information of person HA.

As a result, a passerby (e.g., persons HA and HB) checking the display 20 will see their authentication information displayed larger the further they are from the gate 50. Therefore, even if a person is still far away from the gate 50, it is easy for the person to see the display of the person and to easily check the person's authentication information.

[Fifth operation example]
In the fifth operation example, the management system 5 determines the display position of the person's authentication information in the Y2 direction of the display 20 based on the position of the person passing through the aisle AL relative to the gate 50, i.e., the distance between any person HM passing through the aisle AL and the gate 50, and displays this authentication information.

Figure 16 is a flowchart showing a fifth operation example by the management system 5. The process in Figure 16 is performed, for example, for each image captured by the camera 10 of each gate 50. In Figure 16, the description of the same process as that shown in Figure 6 is omitted or simplified.

First, the management system 5 performs the process of steps S11 to S13 in FIG. 6. The management device 100 has the processor 110 determine the display position of the authentication information of a person passing through the passage AL in the Y2 direction of the display 20 based on the distance between the person and the gate 50. For example, the processor 110 may determine the display position so that the closer the person is to the gate 50, the closer the display position of the authentication information of the person is to the tip side of the Y2 direction of the display 20, that is, the larger the value of the Y2 coordinate indicating the display position (S51). That is, the closer the person is to the gate 50, the processor 110 may move the display position of the authentication information of the person to the top of the screen of the display 20. The processor 110 may also determine the display position so that the closer the person is to the gate 50, the closer the display position of the authentication information of the person is to the negative side of the Y2 direction of the display 20, that is, the smaller the value of the Y2 coordinate indicating the display position (S51). That is, the closer the person gets to the gate 50, the lower the display position of the person's authentication information may be moved by the processor 110 to the bottom of the screen of the display 20. This display position is determined for each person.

The processor 110 instructs the display of each person's authentication information at the display position in the Y2 direction determined for each person via the communication device 130 (S52). In this case, the communication device 130 transmits each person's authentication information, the display position in the Y2 direction, and a display instruction to the display 20. The display 20 receives each person's authentication information, the display position in the Y2 direction, and the display instruction, and displays each person's authentication information at the determined display position according to the display instruction.

As in FIG. 6, the processor 110 instructs the display 20 to display the authentication information of each person via the communication device 130 at a display position in the X2 direction of the display 20 based on the position of each person in the X1 direction of the aisle AL. Thus, the display 20 displays the authentication information of each person at a display position in the X2 direction of the display 20 based on the position of each person in the X1 direction of the aisle AL.

Figure 17 is a diagram showing a first display example of the authentication information of each person in the fifth operation example. Figure 18 is a diagram showing a second display example of the authentication information of each person in the fifth operation example. In the display examples of Figures 17 and 18, the explanation of matters similar to the display example of Figure 7 will be omitted or simplified.

The first display example in FIG. 17 is a display that is easy for passersby to understand, for example, when the display 20 is installed perpendicular to the horizontal plane. The second display example in FIG. 18 is a display that is easy for passersby to understand, for example, when the display 20 is installed at a predetermined angle from the direction perpendicular to the horizontal plane.

In FIG. 17, the management system 5 increases the Y2 coordinate indicating the display position on the display 20 where the authentication information is displayed as the person gets closer to the gate 50, i.e., the larger the Y1 coordinate indicating the person's position. In other words, the leading end of the Y2 direction of the display 20 is set as the direction of travel of the person (authentication information) on the screen. In FIG. 17, as an example, person HA is positioned further forward in the Y1 direction than person HB. Therefore, the Y1 coordinate of the person position of person HA is larger than the Y1 coordinate of the person position of person HB. Therefore, the display 20 displays the authentication information of person HA further forward in the Y2 direction than the authentication information of person HB.

As a result, when the display 20 is installed in front of a person passing through the gate 50, the tip of the display 20 in the Y2 direction corresponds to the direction of travel, which matches the sense of the person. Therefore, by having such a correspondence of directions, it is easy for the passerby to search for his or her own authentication information.

In FIG. 18, the management system 5 reduces the Y2 coordinate indicating the display position on the display 20 where the authentication information is displayed as the person gets closer to the gate 50, i.e., the larger the Y1 coordinate indicating the person's position. In other words, the base end side of the display 20 in the Y2 direction is the direction of travel of the person (authentication information) on the screen. In FIG. 18, as an example, person HA is located closer to the tip end in the Y1 direction than person HB. Therefore, the Y1 coordinate of the person position of person HA is larger than the Y1 coordinate of the person position of person HB. Therefore, the display 20 displays the authentication information of person HA closer to the base end side in the Y2 direction than the authentication information of person HB.

As a result, if the display 20 is installed tilted upward relative to a person passing through the gate 50, the tip end in the Y1 direction, which is the direction of travel, will be closer to the base end in the Y2 direction. Therefore, making the base end of the display 20 in the Y2 direction the direction that corresponds to the direction of travel will match the sense of this person. Therefore, by making the directions correspond in this way, it is easier for passersby to search for their own authentication information.

In addition, by combining the processing of FIG. 6 with the processing of FIG. 16, the processor 110 can dynamically determine the display positions in both the X2 direction and the Y2 direction. Therefore, even when moving diagonally on the horizontal plane within the passage A2, the management system 5 can reproduce the appearance of diagonal movement on the display 20.

[Sixth operation example]
In a sixth operation example, when multiple people passing through the passage AL belong to the same registered group, the management system 5 displays the authentication information of these multiple people in a manner that makes it visible that these multiple people belong to the same registered group.

Figure 19 is a flowchart showing a sixth operation example by the management system 5. The process in Figure 19 is performed, for example, for each image captured by the camera 10 of each gate 50. In Figure 19, explanations of processes similar to those shown in Figure 6 are omitted or simplified.

First, the management system 5 performs the processes of steps S11 to S13 in FIG. 6. In the management device 100, the processor 110 determines whether or not there are multiple people belonging to the same registered group in the captured image (S61). In this case, the processor 110 may refer to the person registration information I1 stored in the memory 120 and obtain information about each person authenticated based on the captured image. The processor 110 may determine whether each authenticated person belongs to any of the same registered groups identified by the group ID included in the person registration information I1.

When it is determined that multiple people belonging to the same registered group are present in the captured image, the processor 110 determines group display information indicating that the authentication information is of multiple people belonging to the same registered group (S62). For example, the processor 110 may determine to add a group frame WKG that surrounds the authentication information of multiple people belonging to the same registered group. In this case, the group display information is the group frame WKG. Also, for example, the processor 110 may determine to change the authentication information frame WK that shows the outline of the authentication information of each of the multiple people belonging to the same registered group to the same display mode DM. In this case, the group display information is an authentication information frame WK in which each of the multiple people belonging to the group is displayed in the same display mode DM. Note that the display mode DM is a display mode different from the display mode of a person not belonging to the group.

The processor 110 instructs the communication device 130 to display the authentication information of each person as well as the group display information (S63). In this case, the communication device 130 transmits the authentication information of each person, the group display information, and a display instruction. The display 20 receives the authentication information of each person, the group display information, and a display instruction from the management device 100, and displays the authentication information of each person and the group display information in accordance with the display instruction.

On the other hand, if it is determined that there are no multiple persons belonging to the same registered group, the processor 110 instructs the display of each person's authentication information via the communication device 130 (S64). The display 20 receives each person's authentication information and a display instruction from the management device 100, and displays each person's authentication information in accordance with the display instruction.

As in FIG. 6, the processor 110 instructs the display 20 to display the authentication information of each person via the communication device 130 at a display position in the X2 direction of the display 20 based on the position of each person in the X1 direction of the aisle AL. Thus, the display 20 displays the authentication information of each person at a display position in the X2 direction of the display 20 based on the position of each person in the X1 direction of the aisle AL.

Figure 20 is a diagram showing a first display example of the authentication information of each person in the sixth operation example. Figure 21 is a diagram showing a second display example of the authentication information of each person in the sixth operation example. In the display examples of Figures 20 and 21, the explanation of matters similar to the display example of Figure 7 will be omitted or simplified.

In FIG. 20, the management system 5 displays a group frame WKG as group display information. In FIG. 21, the management system 5 displays an authentication information frame WK in the same display mode DM as group display information.

In FIG. 20, as an example, person HC and person HD belong to the same registered group. In this case, the processor 110 instructs the display of a group frame WKG indicating that person HC and person HD belong to the same registered group as group display information. The group frame WKG surrounds the authentication information of person HC and person HD outside the authentication information frame WK of the authentication information of person HC and person HD. The display 20 displays the group frame WKG separately from the authentication information frame WK. Note that the shape of the group frame WKG is not limited to a rectangle and may be other shapes. Furthermore, the display mode (e.g. line type, display color (coloring), display pattern, blinking pattern) of the authentication information frame WK and the group frame WKG may be the same or different.

As a result, a person belonging to a registered group can check his/her own authentication information and can easily check the authentication information of other people who belong to the registered group to which this person belongs. Furthermore, by checking the group frame WKG, a person belonging to a registered group can easily find his/her own authentication information, for example, even if it is difficult to find his/her own authentication information alone, by checking the display while keeping the registered group in mind. In other words, it becomes easier to find his/her own authentication information based on the authentication information of someone in the registered group. Furthermore, by checking the authentication information in the group frame WKG, a person belonging to a registered group can find out who in the registered group is not being properly authenticated, and can encourage re-authentication within the group. Furthermore, a person belonging to a registered group can check the registered group in the group frame WKG, and can also check the authentication information (for example, whether authentication was successful or unsuccessful) at the same time.

Note that if there are registered groups to which each authenticated person belongs, for example if person HC and person HD belong to registered group GA and person HA and person HB belong to registered group GB, multiple group frames WKG may be displayed. In this case, the processor 110 may make the display mode DM of each of the multiple group frames WKG different. This allows the people belonging to each registered group to easily understand which registered group each person belongs to by checking the different display modes DM of the multiple group frames WKG.

21, as an example, person HC and person HD belong to the same registration group. In this case, the processor 110 instructs to set the authentication information frames WK of the authentication information of person HC and person HD to the same display mode DM as the group display information. Since the authentication information frame WK is also used as information indicating the authentication status, the processor 110 may determine the display mode DM of the authentication information frames WK of person HC and person HD based on the authentication status and the registration group. The display 20 displays the authentication information frames WK of the authentication information of person HC and person HD in the same display mode DM, taking into account the registration group. In this case, the display mode DM is different from the display mode of the authentication information frames WK of person HA and person HB. Note that the shape of the authentication information frame WK is not limited to a rectangle and may be another shape. In addition, the authentication information frame WK may be in any display mode (for example, line type, display color (coloring), display pattern, blinking pattern) as long as the authentication information frames WK of multiple people belonging to the same registration group have the same display mode DM.

This allows a person belonging to a registered group to check his/her own authentication information and also to easily check the authentication information of other people who belong to the registered group to which the person belongs. In addition, by checking the display mode DM of the authentication information frame WK, a person belonging to a registered group can easily find his/her own authentication information, for example, even if it is difficult to find his/her own authentication information alone, by checking the display while keeping the registered group in mind. In other words, it becomes easier to find his/her own authentication information based on the authentication information of someone in the registered group. In addition, by checking the authentication information having the authentication information frame WK with the same display mode DM, a person belonging to a registered group can know who in the registered group is not successful in authentication and can encourage re-authentication within the group. In addition, the management system 5 does not need to prepare a special frame to indicate that the authentication information is from the same registered group in addition to the authentication information frame WK that is normally used when displaying authentication information, and this can prevent the display on the display 20 from becoming complicated.

It should be noted that there are multiple registered groups to which each authenticated person belongs; for example, persons HC and HD belong to registered group GA, and persons HA and HB belong to registered group GB. In this case, the processor 110 may instruct the display of the authentication information frame WK of the persons belonging to the registered groups in the same display mode DM that differs for each registered group. For example, the display mode DM1 may be used for registered group GA, and the display mode DM2 may be used for registered group HB. In this case, the persons belonging to each registered group can easily know which registered group each person belongs to by checking the authentication information frame WK.

[Seventh operation example]
In the seventh operation example, when any of multiple people passing through the aisle AL is about to deviate from the aisle AL, the management system 5 displays end passing warning information indicating that a person is passing through the end of the aisle AL.

Figure 22A is a diagram showing an example of multiple regions formed in passage AL. Passage AL includes region RG11 where there is no possibility of deviation from passage AL, region RG12 (region RG12A and region RG12B) where there is a possibility of deviation from passage AL, and region RG13 (region RG13A and region RG13B) which is immediately before deviation from passage AL. Region RG12 (region RG12A and region RG12B) is formed on both sides of region RG11 in the X1 direction. Region RG13A is formed on the base end side of region RG12A in the X1 direction. Region RG13B is formed on the tip end side of region RG12B in the X1 direction. That is, regions RG12 and RG13 are formed at both ends of passage AL in the X1 direction. More specifically, on the passage AL, in order from the base end side in the X1 direction, regions RG13A, RG12A, RG11, RG12B, and RG13B are formed. Also, the length along the X1 direction between the end EGA of the passage AL and the end of region RG12A on the RG11 side is length d. The length along the X1 direction between the end EGB of the passage AL and the end of region RG12B on the RG11 side is length d.

Figure 22B is a flowchart showing a seventh operation example by the management system 5. The process in Figure 22B is performed, for example, for each image captured by the camera 10 of each gate 50. In Figure 22B, the description of the process similar to the process shown in Figure 6 is omitted or simplified.

First, the management system 5 performs the processes of steps S11 to S13 in FIG. 6. In the management device 100, the processor 110 determines whether or not there is a person passing through the end of the aisle AL (area RG12 or area RG13) (S71). A person passing through the end of the aisle AL can be said to be a person who may deviate from the aisle AL. For example, the processor 110 determines whether or not the distance between the position of any person passing through the aisle AL and the X1 direction end of the aisle AL (either end EGA or end EGB) is less than the length d. In other words, the processor 110 determines whether or not any person is passing through the end of the aisle AL, that is, whether or not the person is located in area RG12 or area RG13.

If there is a person passing through the end of the aisle AL, the processor 110 determines end passing warning information (S72). For example, the processor 110 may determine to change the authentication information frame WK of this person to a display mode indicating end passing (display mode DM12 or display mode DM13). In this case, the end passing warning information is the authentication information frame WK displayed in a display mode indicating end passing. Also, for example, the processor 110 may determine to change the aisle end line LE indicating the end of the aisle AL on the screen of the display 20 to a display mode indicating end passing (display mode DM22 or display mode DM23). In this case, the end passing warning information is the aisle end line LE displayed in a display mode indicating end passing.

The processor 110 instructs the display of each person's authentication information and edge passing warning information via the communication device 130 (S73). In this case, the communication device 130 transmits each person's authentication information, edge passing warning information, and a display instruction to the display 20. The display 20 receives each person's authentication information, edge passing warning information, and a display instruction from the management device 100, and displays each person's authentication information and edge passing warning information in accordance with the display instruction.

On the other hand, if there is no person passing through the end of the aisle AL, the processor 110 determines normal passage information indicating that there is no possibility that any person will deviate from the aisle AL (normal passage) (S74). For example, the processor 110 may determine to change the authentication information frame WK of this person to a display mode indicating normal passage. In this case, the normal passage information is the authentication information frame WK displayed in a display mode indicating normal passage. Also, for example, the processor 110 may determine to change the display mode of the aisle end line LE to one indicating normal passage. In this case, the normal passage information is the aisle end line LE displayed in a display mode indicating normal passage.

The processor 110 instructs the display of each person's authentication information and normal passage information via the communication device 130 (S75). In this case, the communication device 130 transmits each person's authentication information, normal passage information, and a display instruction to the display 20. The display 20 receives each person's authentication information, normal passage information, and a display instruction from the management device 100, and displays each person's authentication information and normal passage information in accordance with the display instruction.

As in FIG. 6, the processor 110 instructs the display 20 to display the authentication information of each person via the communication device 130 at a display position in the X2 direction of the display 20 based on the position of each person in the X1 direction of the aisle AL. Thus, the display 20 displays the authentication information of each person at a display position in the X2 direction of the display 20 based on the position of each person in the X1 direction of the aisle AL.

Figures 23 to 25 are diagrams showing display examples in which end passing warning information is displayed using the authentication information frame WK in the seventh operation example. Figures 26 to 28 are diagrams showing display examples in which end passing warning information or normal passing information is displayed using the passage end lines LE (LEA and LEB) in the seventh operation example. In the display examples in Figures 23 to 28, explanations of matters similar to those in the display example in Figure 7 will be omitted or simplified.

In FIG. 23, all people, including person HB, are located within area RG11. Therefore, in FIG. 23, the authentication information frame WK indicates normal passage. That is, the display mode of the authentication information frame WK is the normal display mode DM11 (e.g., green indicating successful authentication), and indicates, for example, the authentication status. Therefore, for example, a guard monitoring the passage AL (monitoring passage through gate 50) and passersby can visually confirm that none of the people on the passage AL are passing at the edge, and that there is no possibility of deviation from the passage AL.

In FIG. 24, it is assumed that person HB is in area RG12A and another person is in area RG11. For example, person HB is approaching the end EGA of passage AL. As person HB moves, the display position of person HB's authentication information on display 20 moves closer to the end DEA on the base end side of display 20 in the X2 direction. In FIG. 24, display 20 indicates the presence of a person passing through the edge by the authentication information frame WK, and displays edge passing warning information. That is, the display mode of the authentication information frame WK is display mode DM12 (e.g., orange color) indicating edge passing. This edge passing warning information of display mode DM12 is the first stage of warning information, and indicates that there is a possibility of deviation and that attention should be paid. Therefore, for example, a guard or a passerby can visually recognize that there is a person who may deviate from passage AL, and can pay attention to this person.

In FIG. 25, it is assumed that person HB is located in area RG13A and another person is located in area RG11. For example, person HB is stuck to the end EGA of the passage AL without moving. As person HB's location does not change (is stuck), the display position of person HB's authentication information on the display 20 does not change from the position of the end DEA on the base end side of the X2 direction of the display 20. In FIG. 25, the display 20 indicates the presence of a person passing through the edge by the authentication information frame WK, and displays edge passing warning information. That is, the display mode of the authentication information frame WK is the display mode DM13 (e.g., pink) indicating edge passing. The edge passing warning information of this display mode DM13 is the second stage warning information, and indicates that there is a high possibility of deviation and that immediate action is required, such as urging this person to pass near the center of the passage AL (area RG11). Therefore, for example, a security guard or passerby can visually recognize that there is a person who is likely to deviate from the passage AL and can immediately warn this person.

In FIG. 26, all people, including person HB, are located within area RG11. Thus, FIG. 26 indicates that normal passage is occurring due to the aisle end lines LE. In other words, the display mode of the aisle end lines LE (LEA and LEB) is the display mode DM21 (e.g., blue) that indicates normal passage. Thus, for example, a guard or passerby on aisle AL can visually confirm that none of the people on aisle AL are passing at the edge, and that there is no possibility of deviating from aisle AL.

In FIG. 27, it is assumed that person HB is located in area RG12A and another person is located in area RG11. For example, person HB is approaching the end EGA of passage AL. As person HB moves, the display position of person HB's authentication information on display 20 moves closer to the end DGA on the base end side of the X2 direction of display 20. In FIG. 27, display 20 indicates the presence of a person passing at the end by the passage end line LEA, and displays end passing warning information. That is, the display mode of the passage end line LEA is display mode DM22 (e.g., orange color) indicating end passing. The end passing warning information of this display mode DM22 is a first-stage warning information, indicating that there is a level of possibility of deviation and that attention should be paid. Therefore, for example, a supervisor or a passerby can visually recognize that there is a person who may deviate from passage AL, and can pay attention to this person. Furthermore, since there is no person approaching the end EGB of the aisle AL, the display mode of the aisle end line LEB remains DM21 (e.g., blue).

In FIG. 28, it is assumed that person HB is located in area RG13A and another person is located in area RG11. For example, person HB is stuck to the end EGA of the passage AL without moving. As person HB's location does not change (sticks), the display position of person HB's authentication information on the display 20 does not change from the position of the end DEA on the base end side of the X2 direction of the display 20. In FIG. 28, the display 20 indicates that there is a person passing at the end by the passage end line LEA, and displays end passing warning information. That is, the display mode of the passage end line LEA is the display mode DM23 (e.g., pink) indicating end passing. The end passing warning information of this display mode DM23 is a second-stage warning information, and indicates that there is a high possibility of deviation and that immediate action is required, such as encouraging this person to pass near the center of the passage AL (area RG11). Therefore, for example, a security guard or a passerby can visually recognize that there is a person who is likely to deviate from the aisle AL, and can immediately warn this person. Note that since there is no person approaching the end EGB of the aisle AL, the display mode of the aisle end line LEB remains DM21 (for example, blue).

The processor 110 determines to change the display mode as the passerby approaches the end EG of the aisle AL in the X1 direction. Therefore, a person passing through the aisle AL can understand by checking the display mode that their own movements may affect the person's authentication, and can take measures such as moving closer to the center of the aisle AL. In addition, the management device 100 can change the display mode depending on the distance from the end EG of the aisle AL in the X1 direction, so it can gradually warn people who are likely to deviate from the aisle AL.

As shown in FIG. 28, when a person (e.g., person HB) is located at the end EG of the passage AL, the display mode DM23 may be used in the display range in the Y2 direction of the passage end line LE corresponding to the display position (display range) of the authentication information of this person, and other display modes may be used in the ranges other than this display range of the passage end line LE. For example, the processor 110 may determine the display mode of the display range in the Y2 direction of the passage end line LE corresponding to the display position (display range) of the authentication information of other people according to the position in the X1 direction (distance from the passage end) of the other people. For example, when the people HA, HC, and HD are all located within the region RG11, the processor 110 may set the display mode DM21 indicating normal passage in the display range in the Y2 direction of the passage end line LE corresponding to the display range in the Y2 direction of the authentication information of the people HA, HC, and HD. In this case, the management system 5 can finely divide the display 20 in the Y2 direction and locally present the presence or absence of end passage. Therefore, the monitor or passerby can confirm in detail where in the Y1 direction of the aisle AL corresponding to the Y2 direction a person is located at the end of the aisle (area RG13). This display mode of the display 20, which is finely divided in the Y2 direction, can be applied even in the state of FIG. 27 (first stage warning).

23 to 28 show an example in which the display color of the authentication information frame WK or the aisle end line LE is determined according to the distance from the aisle end, i.e., according to which of the areas RG11 to RG13 the person is located in, but this is not limited to this. The processor 110 may also determine a display mode other than the display color (for example, a line type, a display pattern, or a blinking pattern) according to the distance of the person from the aisle end.

In this way, when a person is likely to deviate from the aisle AL serving as the authentication area while passing through the gate 50, the management device 100 determines the display mode of the authentication information frame WK or the aisle end line LE according to the state of the likely deviation (e.g., the person's distance from the aisle end). This allows an observer or passerby to check whether or not a person is likely to deviate from the aisle AL by checking the display of the authentication information frame WK or the aisle end line LE for each person. In addition, the observer or passerby can determine the degree of likelihood of deviation from the display mode and can take action according to each display mode. For example, an observer who checks the display mode can encourage the person to pass through the center of the aisle AL.

Note that at least two of the first to seventh operation examples may be implemented in combination.

[Presentation using characters]
Next, the presentation of authentication information using a character will be described. The presentation of authentication information using a character is performed, for example, when the gate 50, the camera 10, and the display 20 are installed in an event venue, a leisure facility, or the like.

[First Presentation Example]
FIG. 29 is a diagram showing a first presentation example of authentication information using a character CR.

In the management device 100, the processor 110 instructs the display 20 via the communication device 130 to always display the character CR (an image of the character CR) on a portion of the screen of the display 20. In this case, the communication device 130 transmits an image of the character CR and a display instruction to the display 20. The display 20 receives the image of the character CR and the display instruction, and displays the character CR in accordance with the display instruction. In this case, the display 20 always displays the character CR on a portion of the screen of the display 20, for example, in accordance with the display instruction.

As a result, the management device 100 can guide the gaze of each person passing through the passage AL in the direction of the screen's installation position by having them check the character CR displayed on the display 20 installed at the gate 50. Therefore, in the management system 5, the camera 10 installed at the gate 50, like the display 20, can capture an image suitable for facial recognition, and the authentication server 200 can authenticate a suitable person based on the suitable captured image, thereby improving the authentication accuracy (success rate of authentication) of each person.

[Second Presentation Example]
FIG. 30 is a diagram showing a second presentation example of authentication information using a character CR.

In the management device 100, the processor 110 may determine to display a character CR together with the authentication information according to the authentication result of each person passing through the passage AL. For example, the processor 110 may determine to display the authentication information of a person for whom authentication has been successful as the authentication result, with the character CR attached. The processor 110 instructs the display 20 to display the authentication information and the character CR according to the authentication result of each person via the communication device 130. In this case, the communication device 130 transmits the authentication information, an image of the character CR, and a display instruction to the display 20. The display 20 receives the authentication information, the image of the character CR, and the display instruction, and displays the authentication information and the image of the character CR according to the display instruction. In this case, the display 20 displays the authentication information of a person for whom authentication has been successful as the authentication result, with the character CR attached, for example.

As a result, the management device 100 can guide the gaze of each person passing through the gate 50 toward the screen by having the character CR displayed on the display 20 near the authentication information of a person who has been successfully authenticated (e.g. person HD). Therefore, in the management system 5, the camera 10 installed at the gate 50, like the display 20, can capture an image suitable for face authentication, and the authentication server 200 can authenticate a suitable person based on the suitable captured image, thereby ensuring authentication accuracy.

The processor 110 may issue an instruction via the communication device 130 to change the type and display mode of the character CR displayed together with the authentication information depending on the authentication result of each person passing through the passage AL. The display 20 may display different types and display modes of characters CR depending on the authentication result of each person passing through the passage AL in accordance with the display instruction. The character CR to be displayed when authentication of the person HM is successful may be specified and registered in advance by the person HM. In other words, the processor 110 may input information of the character CR to be displayed when authentication of the person HM is successful via the operation device, and store the inputted character CR information in the memory 120.

[Third Presentation Example]
Fig. 31 is a diagram showing a third presentation example of authentication information using a character CR. The third presentation example of Fig. 31 is a modified example of the second presentation example of Fig. 30. Note that in Fig. 31, illustration of an image of a person included in the authentication information is omitted, and a character frame is illustrated.

The management device 100 may determine that the processor 110 displays a character frame WKC as the authentication information frame WK of a person's authentication information for which successful authentication has been obtained as the authentication result. The processor 110 instructs the display 20 to display the authentication information and the character frame WKC according to the authentication result of each person via the communication device 130. In this case, the communication device 130 transmits the authentication information, the character frame WKC, and the display instruction to the display 20. The display 20 receives the authentication information, the character frame WKC, and the display instruction, and displays the authentication information surrounded by the character frame WKC in accordance with the display instruction. In this case, the display 20 may display the authentication information surrounded by the character frame WKC only for people for whom successful authentication has been obtained as the authentication result.

This allows the management system 5 to achieve the same effect as the second presentation example shown in Figure 30.

[Fourth Presentation Example]
Fig. 32 is a diagram showing a fourth presentation example of authentication information using a character CR. The fourth presentation example in Fig. 32 is a modified example of the first presentation example in Fig. 29. The management system 5 performing the first presentation example includes a speaker that outputs various information by voice or sound. The speaker may be installed at the gate 50, for example.

In the management device 100, the processor 110 instructs the display 20 via the communication device 130 to always display the character CR on a portion of the screen of the display 20, and instructs the speaker to output the character's voice. In this case, the display 20 displays the character CR in accordance with the display instruction. In this case, the communication device 130 also transmits voice information of the character CR and a voice output instruction to the speaker. The speaker receives the voice information of the character CR and the voice output instruction, and outputs the voice of the character CR in accordance with the voice output instruction. The voice of the character CR may include a message such as, for example, "Look at me."

As a result, the management system 5 can guide the person's gaze to look near the display 20 by having the character CR speak to them. Therefore, even if a person passing through the passage AL has difficulty checking the display 20, the person can know what he or she should do by a message such as a voice. For example, the person can know by the message that he or she should look at the character displayed on the display 20. Therefore, the management system 5 can preferably capture an image of the person using the camera 10, and can preferably authenticate each person captured in the captured image using the authentication server 200.

[Fifth Presentation Example]
Fig. 33 is a diagram showing a fifth presentation example of authentication information using a character CR. The fifth presentation example of Fig. 33 is a modified example of the second presentation example of Fig. 30. Note that the management system 5 performing the fifth presentation example includes a speaker that outputs various information by voice or sound, similar to the management system 5 performing the fourth presentation example. The speaker may be installed at the gate 50, for example.

The management device 100 may determine that the processor 110 displays the character CR together with the authentication information according to the authentication result of each person passing through the passage AL, and may also output the voice of the character CR (e.g., a voice message). For example, for a person for whom authentication has been successful as a result of authentication, the processor 110 may determine to display the character CR together with the person's authentication information and to output the voice of the character CR. In this case, the processor 110 may determine the image of the character CR and the content of the character CR's voice based on the characteristics of the person.

The characteristics of a person may include the authority held by the person, the person's visit history to a facility where the gate 50 is installed, or the person's membership rank. The characteristics of a person may be included in the person registration information I1, for example, and may be registered in advance. The visit history of a person may be written by the processor 110 to the person registration information I1 each time the person visits, and stored in the memory 120. Thus, the visit history of a person is stored, for example, in the person registration information I1. For example, the more visits a person has, the higher the member rank may be. The memory 120 may also store information (for example, images and audio) relating to multiple characters CR.

The processor 110 may select an image and sound for the character CR from among multiple options based on the characteristics of the person. In addition, each person's favorite character may be registered in the person registration information I1, and the processor 110 may select an image and sound for the person's favorite character based on the person registration information I1.

The processor 110 may instruct the display 20 to display the authentication information and the character CR according to the authentication result of each person, and may instruct the speaker to provide voice information and a voice output instruction for the character CR via the communication device 130. In this case, the communication device 130 may transmit the authentication information, the character CR, and a display instruction to the display 20, and transmit the voice information and a voice output instruction for the character CR to the speaker. The display 20 receives the authentication information, the character CR, and the display instruction, and displays the authentication information and the character CR according to the display instruction. The speaker receives the voice information and the voice output instruction for the character CR, and outputs the voice of the character CR according to the voice output instruction.

For example, as shown in FIG. 33, the processor 110 may instruct the speaker to attach an image of a female character CR1 to the authentication information of person HD and an image of a male character CR2 to the authentication information of person HB. For example, if person HD is visiting for the first time, the processor 110 may instruct the speaker to output a voice message such as "Welcome, HD! Have fun!" via the communication device 130. For example, if person HA has visited multiple times, the processor 110 may instruct the speaker to output a voice message such as "Thank you for coming again, HA! Have fun today!" via the communication device 130. Note that such a message of thanks for visiting may be presented only to persons who have been successfully authenticated. On the other hand, the processor 110 may instruct the speaker to output a voice message such as "Look at me" via the communication device 130 for persons who have failed to be authenticated.

As mentioned above, the present disclosure can also be utilized by installing part of the management system 5 at the entrance to a classroom or the like. For example, if person HM is a regular attendee, the processor 110 may instruct the speaker via the communication device 130 to output a voice message saying, "HM-san, you're working hard every day with zero absences!". For example, if person HM is absent due to poor health, the processor 110 may instruct the speaker via the communication device 130 to output a voice message saying, "HM-san, you were absent yesterday. Are you feeling better now? Let's do our best starting today!" (not shown).

By outputting audio along with the image of the character CR, the management system 5 can more easily guide the gaze of people passing through the passage AL, improving the accuracy of person authentication. In addition, the management system 5 can display a character CR and output audio messages that are tailored to the characteristics of each person, creating a sense of exclusivity for each person.

[Sixth Presentation Example]
Fig. 34 is a diagram showing a sixth presentation example of authentication information using a character CR. The sixth presentation example of Fig. 34 is a modified example of the third presentation example of Fig. 31. Note that in Fig. 34, illustration of an image of a person included in the authentication information is omitted, and a character frame is illustrated.

In the sixth presentation example, the management device 100 has the processor 110 determine the decoration of the character frame WKC based on the characteristics of the person. For example, for a person who is visiting for the first time, the processor 110 may determine that the authentication information frame WK of this person is a frame without a character attached (e.g., non-character frame WKC0). For a person who has visited multiple times and the number of times is less than the predetermined number, the processor 110 may determine that the authentication information frame WK of this person is a frame with a character attached (e.g., character frame WKC1). For a person who has visited multiple times and the number of times is equal to or more than the predetermined number, the processor 110 may determine that the authentication information frame WK of this person is a luxurious frame with a character attached (e.g., character frame WKC2). A luxurious frame may be, for example, a character frame WKC with a large number of characters or a character frame WKC with sparkling effects added.

The processor 110 instructs the display 20 to display the authentication information and a character frame WKC (e.g., WKC0, WKC1, or WKC2) according to the authentication result of each person via the communication device 130. In this case, the communication device 130 transmits the authentication information, the character frame WKC, and a display instruction to the display 20. The display 20 receives the authentication information, the character frame WKC, and the display instruction, and displays the authentication information surrounded by the character frame WKC in accordance with the display instruction.

As a result, the management device 100 can decorate the authentication information frame WK in a way that suits the characteristics of each person and display it on the display 20, creating a sense of exclusivity for each person. In addition, the management device 100 can gradually make the character frame WKC, which serves as the authentication information frame WK, more luxurious depending on the number of visits, etc., thereby encouraging each person to return.

In this way, according to the management system 5 of this embodiment, the image captured by the camera 10 is processed to generate a display image, and this display image is used as the image to be displayed. Therefore, even when a large number of people are heading towards the gate 50 at the same time, the management system 5 can simultaneously display authentication information including a display image of a large number of people on the display 20, for example, by cutting out a part of the captured image to generate a display image. In other words, the management system 5 simplifies the real-time image acquired from the camera 10 for use as an image to be displayed to the person to be authenticated, and simultaneously displays authentication information including the simplified images of a large number of people on the display 20, thereby shortening the authentication wait time for that person and improving convenience.

In addition, the management device 100 moves the authentication information up, down, left, right (Y2 direction, X2 direction) on the display 20 relative to the display surface in accordance with the forward, backward, left, right (Y1 direction, X1 direction) movement of the person in the aisle AL. Therefore, each person passing through the aisle AL can easily check their own authentication information displayed at a position opposite their own position on the display 20. Therefore, each person passing through the aisle AL can check their own authentication information in a short time, preventing congestion in the aisle AL and enabling smooth authentication.

In addition, the management system 5 is capable of multiple authentications at one passageway, rather than one authentication at each passageway, so it is possible to, for example, increase the utilization rate of the space and allow people to enter by passing through the gate 50 while authenticating each person.

The management device 100 may be installed in any of the gates 50 and may operate as a gate with an authentication device. Alternatively, the management device 100 may not be installed as an independent device, and any of the devices may have the function of the management device 100.

In addition, although the management device 100 and the authentication server 200 are shown as separate devices, this is not limiting. The management device 100 and the authentication server 200 may be an integrated device, and the management device 100 may have the functions of the authentication server 200.

In addition, although the management device 100 and the control PC 30 are shown as separate devices, the control PC 30 and the management device 100 may be an integrated device, and the control PC 30 may have the functions of the management device 100. In addition, when multiple gates 50 are provided and a control PC 30 is provided for each gate 50, any one of the multiple control PCs 30 may have the functions of the management device 100, or any two or more of the multiple control PCs 30 may have the functions of the management device 100 in a distributed manner. Furthermore, at least one of the camera 10 or the display 20 and the management device 100 may be configured as an integrated unit, and at least one of the camera 10 or the display 20 may have the functions of the management device 100.

[Overview of the embodiment]
As described above, the management device 100 of the present embodiment manages people passing through a first point (for example, a point where the gate 50 is installed). The management device 100 includes a processor 110. The processor 110 acquires a first image in which a plurality of people moving through a predetermined passage AL are captured by a camera 10 (an example of an imaging device) that is capable of capturing an image of a person proceeding through a predetermined passage AL toward the first point and is disposed at a second point. The processor 110 acquires authentication status information indicating the status of authentication performed for each of the plurality of people based on the first image and a face image registered in advance. The processor 110 detects the face area of each of the plurality of people included in the first image, and processes the detected face area into a plurality of display images. The processor 110 instructs one or more displays 20 (an example of a display device) disposed at the second point to display multiple pieces of authentication information including the display image and authentication status information of each of the plurality of people at once.

This allows the management device 100 to generate a display image for each person based on the first image (captured image, for example, a real-time image) and assist in displaying authentication information including the display image for each person. Therefore, a person passing through the first point can easily identify and check the authentication information of each person, even if, for example, many people pass through the first point at the same time. Therefore, the management device 100 can assist in each person checking their own authentication result in a short time, preventing congestion in the passage AL and enabling smooth authentication to be performed.

The processor 110 may also determine a display position of the authentication information of each of the multiple persons on the display 20 based on the position of each of the multiple persons relative to the first location.

This allows the display 20 to display the authentication information of a person passing through the first point at a display position on the display 20 that corresponds to the position of the person. Therefore, a person passing through the first point can intuitively check his or her own authentication information while proceeding toward the gate 50.

The display 20 may be arranged parallel to a horizontal plane (e.g., the X1Y1 plane) and in the Y1 direction (an example of a moving direction of multiple people) along the X1 and X2 directions (an example of a first direction). The processor 110 may instruct the display 20 to display the authentication information of each of the multiple people in sequence along the X2 direction based on the positions of each of the multiple people lined up in the X1 direction.

This allows the display 20 to display the authentication information of a person passing through the first point at a display position in the X2 direction on the display 20 that corresponds to the position of the person in the X1 direction. Therefore, a person passing through the first point can intuitively check his or her own authentication information while moving in the X1 direction and proceeding toward the gate 50.

In addition, the processor 110 may dynamically change the display position of the authentication information on the display 20 when a person HA (an example of a first person) among the multiple people passes through a first point while moving in the X1 direction.

This allows the management device 100 to reflect the moving position of a person in the display position of the person's authentication information in real time. Therefore, for example, even if a person moves in the X1 direction, the management device 100 can always maintain the display position of the person's authentication information close to the front of the person.

The one or more displays 20 may include two displays 20A, 20B arranged along the X1 direction. The passage AL may include an area RC (an example of a first area) that faces a midpoint between the positions where the two displays 20A, 20B are arranged and is formed along the travel direction. When a person HA (an example of a second person) included in the multiple people passes through the area RC, the processor 110 may instruct both of the two displays 20A, 20B to display authentication information for the person HA.

As a result, even if a person passes through an area of an aisle AL facing multiple displays 20, the management device 100 can display the authentication information of the person on both displays 20, even though the information is displayed at the edge of one display 20. This makes it easier for the person to check their own authentication information.

The passage AL may include a number of areas (RG1 to RG8) divided in the X1 direction and extending along the Y1 direction. When persons HA and HB (an example of at least two persons) among the multiple persons pass through the same area included in the areas RG1 to RG8, the processor 110 may instruct to display the authentication information of persons HA and HB along the Y2 direction (an example of a second direction) that is parallel to the display surface of the display 20 (e.g., the X2Y2 surface) and perpendicular to the X2 direction.

As a result, the management device 100 can simultaneously display the authentication information for the directions of persons HA and HB on the display 20, even if, for example, persons HA and HB are positioned in the same direction in the X1 direction.

In addition, the processor 110 may increase the display size of the authentication information of person HA (an example of a third person) included in the multiple people, the closer the person HA's location is to the first location.

As a result, the management device 100 displays the same size as if the perspective were followed, making it easier for the user to intuitively understand the authentication information of person HA.

The processor 110 may also increase the display size of the authentication information of a person HA, the farther the position of the person HA, which is included in the multiple people, is from the first location.

As a result, even if the person HA is located far away from the display 20 installed at the first location, the management device 100 can display the person's authentication information large on the display 20, making it easy to check the person's authentication information.

The processor 110 may also instruct the display 20 to move the display position of the authentication information along the Y2 direction, which is parallel to the display surface of the display and perpendicular to the X2 direction, in response to the movement of the person along the direction of travel.

As a result, when a person moves along the passage in the Y1 direction, the management device 100 displays the person's authentication information in the Y2 direction, making it easy to understand intuitively.

The processor 110 may also instruct the display 20 to change the direction in which the display position of the authentication information is moved along the Y2 direction based on the position of the display 20 relative to the horizontal plane.

In this way, for example, when the Y2 direction is perpendicular to the horizontal plane, the management device 100 can make the movement of the person in the Y1 direction toward the tip end side correspond to the movement of the display 20 in the Y2 direction toward the tip end side. In this case, it is easy for the person to intuitively understand that he is moving forward toward the first point. Also, when the Y2 direction is tilted from the direction perpendicular to the horizontal plane, the movement of the person in the Y1 direction toward the tip end side correspond to the movement of the display 20 in the Y2 direction toward the base end side. In this case, if the display 20 is tilted upward so that the person can be seen, the lower end side of the display 20 (the base end side in the Y2 direction) corresponds to the moving direction of the person on the passage. Therefore, in this case too, it is easy for the person to intuitively understand that he is moving forward toward the first point.

The management device 100 may further include a memory 120 that holds person registration information I1 registered for each person. If the specified person belongs to a registered group, the person registration information for a specific person may include identification information of the registered group to which the specified person belongs. The processor 110 may acquire authentication information for each of the multiple people. If, among the multiple people, persons HC and HD (an example of at least two people) for which a successful authentication result has been acquired as authentication information belong to a registered group GA (an example of a specified registered group), the processor 110 may instruct the display of group display information indicating that each of persons HC and HD belong to the same registered group.

As a result, people passing through the passage AL can check the registered group while checking the authentication information of each person. Also, for example, even if person HC has difficulty visually recognizing his/her own authentication information alone, by checking the group display information indicating that he/she is in a registered group, it becomes easier to check the authentication information of person HC displayed together with person HD.

In addition, when the distance between the position of person HB (an example of at least one person) among the multiple people and the end EG of the aisle AL in the X1 direction is within a length d1 (an example of a predetermined distance), the processor 110 may change the display mode of the aisle end line LE indicating the end EG of the aisle AL or the authentication information frame WK (an example of a frame) indicating the authentication information.

This allows, for example, a person passing through the aisle AL or a security guard monitoring the passage of people through the aisle AL to easily confirm the presence of a person who is likely to deviate from the end EG of the aisle AL in the X1 direction.

The authentication status information may also include authentication result information indicating the result of the authentication. The processor 110 may instruct a presentation device (e.g., a display 20 or a speaker) to present an image or audio information of the character CR based on the authentication result information.

As a result, the management device 100 can guide the gaze of people passing through the passage AL using the image or audio information of the character CR. Therefore, the management device 100 can optimally capture images of people using the camera 10, and can assist in optimal authentication of each person captured in the captured image.

The first location and the second location may be the same location. A gate 50 may be installed at the first location. A camera 10 and a display 20 may be installed at the gate 50.

This allows a person passing through the passage AL to smoothly authenticate themselves based on the image captured by the camera 10 and confirm the authentication information displayed on the display 20 while heading toward the gate 50.

The management system 5 of this embodiment includes a management device 100 that manages people passing through a first point, a camera 10 that is capable of capturing an image of a person proceeding along a specified passage AL toward the first point and is arranged at a second point, and a display 20 that is arranged at the second point. The camera 10 captures an image of a plurality of people moving along the specified passage to generate a first image, and transmits the first image to the management device 100. The management device 100 receives the first image, and acquires authentication status information indicating the status of authentication performed for each of the plurality of people based on the first image and a face image registered in advance. The management device 100 detects the face area of each of the plurality of people included in the first image, and processes the detected face area into a plurality of display images. The management device 100 transmits authentication information including the display image and authentication status information of each of the plurality of people to the display 20. The display 20 receives the authentication information of each of the plurality of people, and displays the authentication information of each of the plurality of people in multiple images at once.

As a result, the management system 5 can generate a display image for each person based on the first image (captured image, for example, a real-time image) and display authentication information including the display image for each person. Therefore, people passing through the first point can easily identify and check the authentication information of each person, even if, for example, many people pass through the first point at the same time. Therefore, the management system 5 can help each person check their own authentication result in a short time, prevent congestion in the passage AL, and perform authentication smoothly.

Although various embodiments have been described above with reference to the drawings, it goes without saying that the present disclosure is not limited to such examples. It is clear that a person skilled in the art can come up with various modified or amended examples within the scope of the claims, and it is understood that these also naturally fall within the technical scope of the present disclosure. Furthermore, the components in the above embodiments may be combined in any manner as long as it does not deviate from the spirit of the disclosure.

The order of execution of each process, such as operations, procedures, steps, and stages, in the devices, systems, programs, and methods shown in the claims, specifications, and drawings, is not specifically stated as "before" or "prior to," and can be realized in any order, unless the output of a previous process is used in a later process. Even if the operational flow in the claims, specifications, and drawings is explained using "first," "next," etc. for convenience, it does not mean that it is necessary to perform it in that order.

The present disclosure is useful for a management device, management system, management method, etc., which allows each person to check their own authentication result in a short time, prevents congestion in the passageway, and enables smooth authentication, even when multiple people pass through a given point at the same time.

5 Management system 10 Cameras 20, 20A, 20B Display 30 Control PC
50 Gate 100 Management device 110 Processor 120 Memory 130 Communication device CR Character GD Display image HA, HB, HC, HD, HM Person I1 Person registration information IA Authentication information WK Authentication information frame WKC Character frame WKG Group frame

Claims (16)

A management device for managing people passing through a first location,
A processor is provided.
The processor,
acquiring a first image in which a plurality of people moving along a predetermined passage are captured by an imaging device that is disposed at a second point and is capable of capturing an image of a person moving along the predetermined passage toward the first point;
acquiring authentication status information indicating a status of authentication performed on each of the plurality of persons based on the first image and a face image registered in advance;
detecting a face area of each of the plurality of people included in the first image, and then processing the detected face area into a plurality of display images;
instructing one or more display devices disposed at the second location to simultaneously display a plurality of pieces of authentication information including the display images and the authentication status information of each of the plurality of persons;
Management device. The processor,
determining a display position of the authentication information of each of the plurality of persons on the display device based on the positions of each of the plurality of persons in the predetermined passage;
The management device according to claim 1 . The display devices are arranged along a first direction that is parallel to a horizontal plane and perpendicular to a moving direction of the plurality of people;
The processor,
instructing to display the authentication information of each of the plurality of persons in sequence along the first direction based on the positions of each of the plurality of persons lined up in the first direction;
The management device according to claim 2 . The processor,
dynamically changing a display position of the authentication information on the display device when a first person included in the plurality of people passes through the first point while moving in a first direction that is parallel to a horizontal plane and perpendicular to a moving direction of the plurality of people;
The management device according to claim 2 . The one or more display devices include two display devices arranged along a first direction that is parallel to a horizontal plane and perpendicular to a direction in which the plurality of people are moving,
the passage includes a first region that faces a middle position between positions where the two display devices are disposed and is formed along the traveling direction at a center portion of the passage in the first direction,
The processor,
when a second person included in the plurality of persons passes through the first area, instructing both of the two display devices to display authentication information of the second person;
The management device according to claim 2 . the passage is divided in a first direction, which is a direction parallel to a horizontal plane and perpendicular to a direction of travel of the plurality of persons, and includes a plurality of third regions extending along the direction of travel;
The management device of claim 2, wherein the processor instructs, when at least two of the plurality of persons pass through any same area included in the third area, to display the authentication information of the at least two persons side by side along a second direction parallel to the display surface of the display device and perpendicular to the first direction. The processor,
the closer a location of a third person included in the plurality of persons is to the first location, the larger the display size of the authentication information of the third person is.
The management device according to claim 2 . The processor,
the display size of the authentication information of a third person included in the plurality of people is increased as the position of the third person is farther from the first location;
The management device according to claim 2 . The processor,
instructing the display device to move a display position of the authentication information along a second direction that is parallel to a display surface of the display device, parallel to a horizontal plane, and perpendicular to a first direction that is perpendicular to the moving direction of the plurality of persons, in response to the movement of the persons along the moving direction.
The management device according to claim 2 . The processor,
instructing to change a direction in which a display position of the authentication information along the second direction on the display device is moved based on an arrangement state of the display device with respect to a horizontal plane;
The management device according to claim 9. A memory for storing person registration information registered for each person,
the person registration information of a specific person includes, when the specific person belongs to a registered group, identification information of the registered group to which the specific person belongs;
The processor,
obtaining the authentication information for each of the plurality of persons;
when at least two persons for which a result of successful authentication has been obtained as the authentication information among the plurality of persons belong to a predetermined registered group, instruct to display group display information indicating that each of the at least two persons belongs to the same registered group;
The management device according to claim 1 or 2. The processor,
changing a display mode of a passage end line indicating the end of the passage or a frame indicating the authentication information when a distance between a position of at least one person among the plurality of people and an end of the passage in a first direction, the end being a direction parallel to a horizontal plane of the passage and perpendicular to a moving direction of the plurality of people, is within a predetermined distance;
The management device according to claim 2 . The authentication status information includes authentication result information indicating a result of the authentication,
The processor,
instructing a presentation device to present image or audio information of a character based on the authentication result information;
The management device according to claim 1 or 2. the first point and the second point are the same point,
A gate is provided at the first location;
The imaging device and the display device are installed at the gate.
The management device according to claim 1 or 2. A management system including: a management device that manages people passing through a first point; an imaging device that is arranged at a second point and is capable of imaging people proceeding along a predetermined passage toward the first point; and a display device that is arranged at the second point,
the imaging device captures an image of a plurality of people moving along the predetermined passage to generate a first image, and transmits the first image to the management device;
The management device includes:
receiving the first image;
acquiring authentication status information indicating a status of authentication performed on each of the plurality of persons based on the first image and a face image registered in advance;
detecting a face area of each of the plurality of people included in the first image, and then processing the detected face areas into a plurality of display images;
transmitting, to a display device, authentication information including the display image and the authentication status information of each of the plurality of persons;
The display device includes:
receiving the authentication information for each of the plurality of persons;
displaying a plurality of pieces of authentication information for each of the plurality of persons at once;
Management system. A method for managing a person passing through a first location, comprising the steps of:
The processor:
acquiring a first image in which a plurality of people moving along a predetermined passage are captured by an imaging device that is capable of capturing an image of a person proceeding along the predetermined passage toward the first point and that is disposed at a second point;
acquiring authentication status information indicating a status of authentication performed for each of the plurality of persons based on the first image and a face image registered in advance;
detecting a face region of each of the plurality of people included in the first image, and then processing the detected face region into a plurality of display images;
instructing one or more display devices disposed at the second location to simultaneously display a plurality of pieces of authentication information including the display image and the authentication status information of each of the plurality of persons;
A management method having the following features.

Images