JP2009020735A - Personal authentication device - Google Patents

Abstract

By using image information photographed at the time of finger authentication, an additional operation function can be assigned according to the state of the photographed face image, realizing a high function and simplifying the operation. Get the device.
In order to perform authentication for unlocking control of an electric lock 12 for a user, face authentication means 1-4 for authenticating a face, finger authentication means 5-8 for authenticating a finger, The normal function and the additional function are determined based on the face state detection unit 20 that detects the state, the authentication results of the face authentication units 1 to 4 and the finger authentication units 5 to 8 and the detection result of the face state detection unit 20. A function pattern determination unit 21 and an electric lock control unit 11 that performs unlock control of the electric lock 12 according to the determination result of the function pattern determination unit 21 are provided. The face state detection unit 20 detects the face state during the execution of the authentication process of the finger authentication means 5-8, and the function pattern determination unit 21 combines the normal function with the finger and the face state at the time of finger authentication. Determine additional functions.
[Selection] Figure 1

Description

  The present invention relates to a personal authentication device applied to an entrance / exit management system having an electric lock, and more particularly to a technology for simultaneously and easily operating additional functions such as attendance / exit operation, panic open or hold-up at the time of authentication. Is.

A conventional personal authentication device applies a technique in which fingerprint authentication means and face authentication means are combined (see, for example, Patent Document 1).
The conventional personal authentication device described in Patent Document 1 includes, for example, a camera that captures the vicinity of an electric lock, a face detection unit, a face image collation unit, face data, a fingerprint sensor, a fingerprint detection unit, A fingerprint image verification unit, finger data, a passage permission determination unit, an operation history recording unit, and an electric lock control unit are provided.

  In the personal authentication device, an image photographed by the camera is sent to a face detection unit to detect the presence or absence of a face image. When a face image is detected, the face data matching unit collates the registered data in the face data with the face image. If the face data collation result is OK, then finger data collation is performed.

That is, as in the case of face data collation, an image photographed by the fingerprint sensor is sent to the fingerprint detection unit to detect the presence or absence of the fingerprint image. When the fingerprint image is detected, the registered image in the finger data and the fingerprint image are verified by the fingerprint image verification unit.
If the collation result of the finger data is also OK, the passage is permitted by the passage permission determination unit, and the electric lock is unlocked by the electric lock control unit. The determination result of the passage permission determination unit is recorded as a log in the operation history recording unit.

  Further, as additional operation functions after face and finger authentication, there are an attendance / leaving operation function, a panic open function, a hold-up function, and the like. These operation functions are performed by, for example, a button operation. The attendance / leaving operation function is a function that, after authentication OK, operates buttons such as “attendance”, “leaving work”, “going out”, “return”, etc., and leaving a log corresponding to each operation in the electric lock control unit. It is. The panic open function is a function that unlocks the door in conjunction with a fire alarm, etc., and the hold-up function is a function that notifies that a criminal or other person is threatening to enter or leave the room. .

JP 2006-192011 A

  In the conventional personal authentication device, since the face and the finger are individually authenticated, it is necessary to separately perform an additional operation after the authentication OK using, for example, a button, which takes time and effort. was there.

  The present invention has been made to solve the above-described problem, and was photographed by photographing a state during operation with a face authentication camera at the time of finger authentication and using the photographed image information. An object of the present invention is to obtain a personal authentication device that can assign an additional operation function in accordance with the state of a face image, realizes a high function and simplifies the operation.

  A personal authentication device according to the present invention is a personal authentication device that performs authentication for unlocking control of an electric lock for a user, and authenticates a user's finger and face authentication means for authenticating the user's face. Normal functions and additional functions based on the authentication results of the face authentication means, the face status detection means for detecting the face state of the user, the authentication results of the face authentication means and the finger authentication means, and the detection results of the face state detection means. A function pattern determining unit for determining, and an electric lock control unit for performing unlock control of the electric lock according to a determination result of the function pattern determining unit, and the face state detecting unit is used during the authentication process of the finger authenticating unit The person's face state is detected, and the function pattern determination means determines the normal function and the additional function by combining the finger and the face state at the time of finger authentication.

  According to the present invention, by using the image information photographed at the time of finger authentication, an additional operation function can be assigned according to the state of the photographed face image, realizing a high function and simplifying the operation. can do.

Embodiment 1 FIG.
FIG. 1 is a block diagram showing a personal authentication apparatus according to Embodiment 1 of the present invention.
In FIG. 1, a personal authentication device includes a camera 1 that captures the vicinity of an electric lock 12, a face detection unit 2 that detects a face image from a captured image of the camera 1, and a face that collates the detected face image with registered data. Image collation unit 3, face data 4 storing registration data, fingerprint sensor 5 installed in the vicinity of electric lock 12, fingerprint detection unit 6 for detecting a fingerprint image from a photographed image of fingerprint sensor 5, and detection Fingerprint image collation unit 7 for collating the fingerprint image with registration data, finger data 8 storing registration data, passage permission determination unit 9, and operation history recording unit for recording an operation history by passage permission determination unit 9 10 and an electric lock control unit 11 that controls the electric lock according to the result of the passage permission determination unit 9.

The camera 1 to the electric lock control unit 11 have a configuration corresponding to a conventional device.
The camera 1, the face detection unit 2, the face image matching unit 3, and the face data 4 constitute face authentication means for authenticating the user's face.
The fingerprint sensor 5, the fingerprint detection unit 6, the fingerprint image collation unit 7 and the finger data 8 constitute a face authentication unit for authenticating the user's face.

  In addition, the personal authentication device according to Embodiment 1 of the present invention includes the face direction detection unit 20 that detects the face direction based on the face image detected by the face detection unit 2, and the collation results of the collation units 3 and 7. And a function pattern determination unit 21 that determines an additional function pattern based on the detection result of the face direction detection unit 20, and a function pattern table 22 that belongs to the function pattern determination unit 21.

In the function pattern table 22, data obtained by combining face orientation (up / down / left / right) and finger information is assigned to additional functions such as attendance / leaving operation, panic open, hold-up, and stored in advance as a registered pattern. Yes. Therefore, if the face orientation and finger information are determined, the additional function is also uniquely determined.
The determination result of the function pattern determination unit 21 is input to the passage permission determination unit 9.

Next, referring to the flowchart of FIG. 2, the collating operation and the function pattern determining operation according to the first embodiment of the present invention shown in FIG. 1 will be described. In addition, each step S1, S2, S4, S6, and S8 in FIG. 2 is the same process as a conventional apparatus.
In FIG. 2, first, the face image matching unit 3 associated with the camera 1 and the face detection unit 2 performs face matching using the face data 4 (step S1), and determines whether or not face matching is OK. (Step S2).

If it is determined in step S2 that the face collation is NG (that is, NO), the process proceeds to step S8 (described later).
On the other hand, if it is determined in step S2 that the face collation is OK (that is, YES), the fingerprint image collation unit 7 related to the fingerprint sensor 5 and the fingerprint detection unit 6 uses the finger data 8 subsequently. The fingerprint (finger) is collated (step S3), and it is determined whether the finger collation is OK (step S4).

  At this time, the fingerprint image collation unit 7 determines whether the user's hand placed on the finger placement unit is a right hand or a left hand. For example, when it is determined that the index finger is a right hand, it is used for finger authentication. Collation processing is performed by limiting the registered finger data in the finger data 8 to be limited to only the index finger of the right hand to narrow down the collation conditions.

In parallel (simultaneously) with the finger collation process in step S3, the camera 1 captures a face image, and the face direction detection unit 20 detects the face direction (up / down / left / right) based on the face image.
If it is determined in step S4 that the finger collation is NG (that is, NO), the process proceeds to step S8 (described later).

  On the other hand, if it is determined in step S4 that the finger collation is OK (that is, YES), then the function pattern determination unit 21 and the finger direction collation unit 7 collate with the finger collation unit 7. It is determined whether the combination with the face orientation detected at 20 exists in the registered pattern (registered as a function pattern in the function pattern table 22) (step S5).

  If it is determined in step S5 that the combination of the detected finger and face orientation does not exist as a registered pattern (that is, NO), it is considered that the user does not specifically intend the additional operation function. The function pattern determination unit 21 instructs a normal unlock control of the electric lock 12 via the passage permission determination unit 9 and the electric lock control unit 11 (step S6).

On the other hand, if it is determined in step S5 that the combination of the detected finger and face orientation exists as a registered pattern (that is, YES), the function pattern determination unit 21 determines according to the determined function pattern. The electric lock control unit 11 is instructed to perform control for executing additional functions such as attendance / leaving operation, panic opening, or hold-up (step S7).
Finally, subsequent to steps S6 and S7, the operation history recording unit 10 records the passage operation history (step S8), and ends the processing routine of FIG.

  In this way, when the finger is authenticated, the face authentication camera 1 is photographed at the same time during the authentication operation, and the user's face orientation (face state) is detected using the photographed image information. The function pattern determination unit 21 identifies the control or operation method at the time of authentication OK according to the face state at the time of finger authentication.

As a specific example, for example, the function pattern determination unit 21 determines a “working” operation if the face is facing right during finger authentication, and a “working” operation if the face is facing left.
In addition, if the face is upward at the time of finger authentication, it is determined that the operation is “panic open”, and if the face is downward, it is determined that the operation is “hold up”, and the operation is switched to the control mode corresponding to each function. Send a command for.

  As described above, the personal authentication device according to the first embodiment is a personal authentication device that performs authentication for unlocking control of the electric lock 12 for the user, and authenticates the face of the user. Authentication means (camera 1, face detection unit 2, face image collation unit 3, face data 4) and finger authentication unit (fingerprint sensor 5, fingerprint detection unit 6, fingerprint image collation unit 7, finger authentication unit) for authenticating the user's finger Data 8), a face direction detection unit (face state detection unit) 20 for detecting the face direction (face state) of the user, authentication results of the face authentication unit and finger authentication unit, and detection results of the face direction detection unit 20 And a function pattern determination unit 21 that determines a normal function and an additional function, and an electric lock control unit 11 that controls the unlocking of the electric lock 12 according to the determination result of the function pattern determination unit 21. Yes.

Further, the face orientation detection unit 20 detects the face state (face orientation) of the user during the execution of the authentication process of the finger authentication unit, and the function pattern determination unit 21 determines the finger and face state during finger authentication. Are combined to determine the normal function and the additional function.
Thus, at the time of finger authentication, using the image information captured by the face authentication camera 1, an additional operation function (an unlocking function of an electric lock, a work attendance) depending on the state of the face image (face orientation) An operation function, a panic open function, a hold-up function, etc.) can be assigned, and a high function can be realized and the operation can be simplified.

Embodiment 2. FIG.
In the first embodiment (FIG. 1), the face direction detection unit 20 that detects the direction of the user's face is used as the face state detection unit. However, as shown in FIG. You may use the face pattern detection part 30 and the face pattern data 31 which detect a pattern as a face state.

FIG. 3 is a block diagram showing a personal authentication apparatus according to Embodiment 2 of the present invention. In FIG. 3, the same parts as those described above (see FIG. 1) are denoted by the same reference numerals as those described above, or “A” is added after the reference numerals, and detailed description thereof is omitted.
In this case, the face pattern detection unit 30 collates the face image from the face detection unit 2 with the registered data in the face pattern data 31 at the time of finger authentication, and detects the detected face pattern (a face state indicating an expression of eyes or mouth). ) Is input to the function pattern determination unit 21A.

  The function pattern determination unit 21A refers to the function pattern table 22A to determine an additional function pattern at the time of authentication. In the function pattern table 22A, combinations of fingers collated by the fingerprint image collating unit 7 and face patterns detected by the face pattern detecting unit 30 are stored in advance as a table.

Next, referring to the flowchart of FIG. 4, the collating operation and the function pattern determining operation according to the second embodiment of the present invention will be described.
In FIG. 4, the same processing (steps S1, S2, S4, S6 to S7) as described above (see FIG. 2) is denoted by the same reference numeral. Further, the process (step S3A) of the fingerprint image matching unit 7 and the face pattern detection unit 30 and the process (step S5A) of the function pattern determination unit 21A correspond to steps S3 and S5 in FIG. 2, respectively. .

First, as described above, the face image matching unit 3 performs face matching (step S1), determines whether the face matching is OK (step S2), and if the face matching is NG (that is, NO), Proceed to step S8.
On the other hand, if the face collation is OK (ie, YES) in step S2, fingerprint (finger) collation is subsequently performed by the fingerprint image collation unit 7, and at the same time, the face pattern (wink, Alternatively, a state where the mouth is opened is detected (step S3A).

Subsequently, the fingerprint image collation unit 7 determines whether or not the finger collation is OK (step S4). If the finger collation is NG (that is, NO), the process proceeds to step S8.
On the other hand, if the finger collation is OK (that is, YES) in step S4, then the function pattern determination unit 21A has detected the finger collated by the fingerprint image collation unit 7 and the face pattern detection unit 30. It is determined whether the combination with the face pattern exists in the registered pattern (registered as a function pattern in the function pattern table 22A) (step S5A).

  Hereinafter, if it is determined in step S5A that the combination of the detected finger and face pattern does not exist as a registered pattern (that is, NO), it is considered that the user does not particularly intend the additional operation function. The function pattern determination unit 21A instructs the normal unlock control of the electric lock 12 via the passage permission determination unit 9 and the electric lock control unit 11 (step S6).

On the other hand, if it is determined in step S5A that the combination of the detected finger and face pattern exists as a registered pattern (that is, YES), the function pattern determination unit 21A determines that the function pattern has been determined. The electric lock control unit 11 is instructed to perform control for executing each additional function of the attendance / leaving operation, panic opening, or hold-up (step S7).
Finally, subsequent to steps S6 and S7, the operation history recording unit 10 records the passage operation history (step S8) and ends the processing routine of FIG.

  In this way, at the time of finger authentication, by photographing the state during the authentication operation with the face authentication camera 1 at the same time and detecting the user's face pattern (face state) using the captured image information, The function pattern determination unit 21A identifies the control or operation method at the time of authentication OK according to the face state at the time of finger authentication.

As a specific example, for example, the function pattern determination unit 21 </ b> A determines a “working” operation if the right eye is closed during finger authentication, and a “working” operation if the left eye is closed.
Further, if the mouth is opened at the time of finger authentication, it is determined that the operation is “panic open”, and if both eyes are closed, the operation is “hold up”, and the control mode corresponding to each function is switched to the electric lock control unit 11. Send a command for.

  As described above, the personal authentication device according to the second embodiment is a personal authentication device that performs authentication for unlocking control of the electric lock 12 for the user, and authenticates the user's face. Authentication means (camera 1, face detection unit 2, face image collation unit 3, face data 4) and finger authentication unit (fingerprint sensor 5, fingerprint detection unit 6, fingerprint image collation unit 7, finger authentication unit) for authenticating the user's finger Data 8), face pattern detection unit (face state detection means) 30 and face pattern data 31 for detecting a user's face pattern (face state), authentication results of face authentication means and finger authentication means, and face pattern detection. Based on the detection result of the unit 30, a function pattern determination unit 21A that determines a normal function and an additional function, and an electric lock control unit that performs unlock control of the electric lock 12 according to the determination result of the function pattern determination unit 21A 11.

In addition, the face pattern detection unit 30 detects the face pattern (face state) of the user during the authentication process of the finger authentication unit, and the function pattern determination unit 21A detects the finger and face state (wink) at the time of finger authentication. , Open mouth, etc.) to determine normal functions and additional functions.
Thus, during finger authentication, using the image information captured by the face authentication camera 1, an additional operation function (an unlocking function of an electric lock, an attendance / leaving operation) according to the state of the face image (face pattern) Function, panic open function, hold-up function, etc.) can be assigned, realizing high functions and simplifying operation.

Embodiment 3 FIG.
In the second embodiment (FIG. 3), the face pattern detecting unit 30 and the face pattern data 31 for detecting the user's face pattern are used as the face state detecting means. However, as shown in FIG. A face / motion pattern detector 40 and face / motion pattern data 41 for detecting a motion pattern (face / motion pattern) related to a person's face as a face state may be used.

FIG. 5 is a block diagram showing a personal authentication apparatus according to Embodiment 3 of the present invention. In FIG. 5, the same components as those described above (see FIGS. 1 and 3) are denoted by the same reference numerals as those described above, or “B” after the symbols, and detailed description thereof is omitted.
In this case, at the time of finger authentication, the face / motion pattern detection unit 40 collates the face image from the face detection unit 2 with the registered data in the face / motion pattern data 41 and detects the detected face / motion pattern (left and right hand). (A face state such as covering the eyes or mouth with a hand) is input to the function pattern determination unit 21B.

  The function pattern determination unit 21B refers to the function pattern table 22B to determine an additional function pattern at the time of authentication. In the function pattern table 22B, combinations of fingers collated by the fingerprint image collation unit 7 and faces / motion patterns detected by the face / motion pattern detection unit 40 are stored in advance as a table.

Next, referring to the flowchart of FIG. 6, the collating operation and the function pattern determining operation according to the third embodiment of the present invention will be described.
In FIG. 6, the same processes (steps S1, S2, S4, S6 to S7) as those described above (see FIGS. 2 and 4) are denoted by the same reference numerals as described above. Also, the processing of the fingerprint image matching unit 7 and the face / motion pattern detection unit 40 (step S3B) and the processing of the function pattern determination unit 21B (step S5B) correspond to steps S3A and S5A in FIG. 4, respectively. ing.

First, as described above, the face image matching unit 3 performs face matching (step S1), determines whether the face matching is OK (step S2), and if the face matching is NG (that is, NO), Proceed to step S8.
On the other hand, if the face collation is OK (that is, YES) in step S2, fingerprint (finger) collation is subsequently performed by the fingerprint image collation unit 7, and at the same time, the face / motion pattern detection unit 40 performs the face / motion. A pattern is detected (step S3B).

Subsequently, the fingerprint image collation unit 7 determines whether or not the finger collation is OK (step S4). If the finger collation is NG (that is, NO), the process proceeds to step S8.
On the other hand, if the finger collation is OK (that is, YES) in step S4, then the function pattern determination unit 21B detects the finger collated by the fingerprint image collation unit 7 and the face / motion pattern detection unit 40. It is determined whether or not the combination with the face / motion pattern thus registered exists in the registered pattern (registered as a function pattern in the function pattern table 22B) (step S5B).

  Hereinafter, in step S5B, if it is determined that the combination of the detected finger and the face / motion pattern does not exist as a registered pattern (that is, NO), it is regarded that the user does not particularly intend the additional operation function. Therefore, the function pattern determination unit 21B instructs the normal unlock control of the electric lock 12 via the passage permission determination unit 9 and the electric lock control unit 11 (step S6).

On the other hand, if it is determined in step S5B that the combination of the detected finger and the face / motion pattern exists as a registered pattern (that is, YES), the function pattern determination unit 21B responds to the determined function pattern. Thus, the electric lock control unit 11 is instructed to perform control for executing each of the additional functions of the attendance / leaving operation, panic opening, or hold-up (step S7).
Finally, subsequent to steps S6 and S7, the operation history recording unit 10 records the passage operation history (step S8), and ends the processing routine of FIG.

  In this way, at the time of finger authentication, the face authentication camera 1 is simultaneously photographed during the authentication operation, and the user's face / motion pattern (face state) is detected using the photographed image information. Thus, the function pattern determination unit 21B identifies the control or operation method at the time of authentication OK according to the face state at the time of finger authentication.

As a specific example, for example, the function pattern determination unit 21 </ b> B determines a “working” operation if the right hand is raised near the face during finger authentication, and a “working” operation if the left hand is raised.
Also, if the mouth is covered with a hand at the time of finger authentication, it is determined that the operation is “panic open”, and if both hands are raised, it is determined that the operation is “hold up”, and the control mode corresponding to each function is switched to the electric lock control. A command for the unit 11 is transmitted.

  As described above, the personal authentication device according to the third embodiment is a personal authentication device that performs authentication for unlocking control of the electric lock 12 for a user, and authenticates the user's face. Authentication means (camera 1, face detection unit 2, face image collation unit 3, face data 4) and finger authentication unit (fingerprint sensor 5, fingerprint detection unit 6, fingerprint image collation unit 7, finger authentication unit) for authenticating the user's finger Data 8), a face / motion pattern detection unit (face state detection means) 40 for detecting a user's face / motion pattern (face state) and face / motion pattern data 41, and authentication of face authentication means and finger authentication means Based on the result and the detection result of the face / motion pattern detection unit 40, the function pattern determination unit 21B that determines the normal function and the additional function, and the unlocking of the electric lock 12 according to the determination result of the function pattern determination unit 21B An electric lock control unit 11 for performing control; It is provided.

Further, the face / motion pattern detection unit 40 detects a user's face / motion pattern (face state) during execution of the authentication process of the finger authentication means, and the function pattern determination unit 21B A normal function and an additional function are determined in combination with a face state (such as raising a hand near the face or covering eyes and mouth with a hand).
Thereby, at the time of finger authentication, using the image information captured by the face authentication camera 1, an additional operation function (an unlocking function of an electric lock, Attendance / exit operation function, panic open function, hold-up function, etc.) can be assigned, and high functions can be realized and operation can be simplified.

It is a block diagram which shows the personal authentication apparatus which concerns on Embodiment 1 of this invention. It is a flowchart which shows the authentication process and function pattern determination process by Embodiment 1 of this invention. It is a block diagram which shows the personal authentication apparatus which concerns on Embodiment 2 of this invention. It is a flowchart which shows the authentication process and function pattern determination process by Embodiment 2 of this invention. It is a block diagram which shows the personal authentication apparatus which concerns on Embodiment 3 of this invention. It is a flowchart which shows the authentication process and function pattern determination process by Embodiment 3 of this invention.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 Camera, 2 Face detection part, 3 Face image collation part, 4 Face data, 5 Fingerprint sensor, 6 Fingerprint detection part, 7 Fingerprint image collation part, 8 Finger data, 9 Traffic permission determination part, 10 Operation history recording part, 11 Electric lock control unit, 12 Electric lock, 20 Face direction detection unit, 21, 21A, 21B Function pattern determination unit, 22, 22A, 22B Function pattern table, 30 Face pattern detection unit, 31 Face pattern data, 40 Face / motion pattern Detection unit, 41 Face / motion pattern data.

Claims (4)

A personal authentication device that authenticates a user for unlocking control of an electric lock,
Face authentication means for authenticating the user's face;
Finger authentication means for authenticating the user's finger;
Face state detecting means for detecting the user's face state;
A function pattern determination unit that determines a normal function and an additional function based on an authentication result of the face authentication unit and the finger authentication unit and a detection result of the face state detection unit;
An electric lock control unit that performs unlock control of the electric lock according to the determination result of the function pattern determination means,
The face state detection means detects the face state of the user during the authentication process of the finger authentication means,
The function authentication unit determines the normal function and the additional function by combining the finger and the face state at the time of authentication of the finger.   The personal authentication apparatus according to claim 1, wherein the face state detection unit detects a face direction of the user as the face state.   The personal authentication apparatus according to claim 1, wherein the face state detecting unit detects a face pattern of the user as the face state.   The personal authentication apparatus according to claim 1, wherein the face state detection unit detects an operation pattern related to the user's face as the face state.

Images