JP7577035B2 - Automated cash transaction system - Google Patents

Description

The present invention relates to an automated cash transaction system that transmits and receives information to and from mobile phone terminals to perform automated cash transactions.

In recent years, there has been a demand for financial institution branches to be able to use their own mobile phone terminals to carry out transactions at automated teller machines, without using a cash card.

In order to confirm that the person using the mobile phone terminal is the person in question, a facial comparison is first performed between the facial image on the driver's license or other identification document and the facial image in the photograph. If the person's identity can be confirmed, a two-dimensional barcode showing the comparison result is downloaded to the mobile phone terminal, and the automated teller machine reads the two-dimensional barcode displayed on the mobile phone terminal, making it possible to carry out the transaction without using a cash card.

However, due to security risks such as identity theft and phishing that occur with cashless payments, it is necessary to implement security measures such as encrypting the data downloaded to the mobile phone terminal and using multi-stage authentication methods in order to realize safe cardless transactions.

Here, a method of identity verification using a mobile phone terminal has been proposed (see Patent Document 1). This method is a method in which the data required for identity verification is obtained using only the mobile phone terminal carried by the user. Also, an automated teller machine capable of identity verification has been proposed (see Patent Document 2). This automated teller machine can carry out temporary transactions by verifying the identity of the user using a function for photographing facial images and identity documents.

JP 2020-077421 A JP 2019-106005 A

According to Patent Document 1, it is possible to obtain the data required for identity verification using only the mobile phone terminal carried by the user. Also, according to Patent Document 2, a temporary transaction is possible by verifying the identity of the user using a function provided in the automated teller machine to capture a facial image and an identity document. However, the methods described in each of the Patent Documents are not sufficient as a security measure when conducting automated cash transactions.

The object of the present invention is to perform automated cash transactions on the condition that a multi-stage process, including facial recognition processing, is completed.

In order to achieve the above object, the present invention provides a system that includes a card reader that reads account information recorded on a cash card, a first camera that photographs the face of the holder of the cash card, a second camera that photographs the face of the holder of the cash card, a first information reader that reads information displayed on the screen of a mobile phone terminal held by the holder, an identity verification device having a display screen that displays information, a third camera that photographs the face of the holder, and a second information reader that reads information displayed on the screen of the mobile phone terminal or the display screen of the identity verification device, and processes cash transactions for the account of the holder based on the operation of the holder. the card reader, the identity verification device, and a server for transmitting and receiving information to and from the automated teller machine and the mobile phone terminal, wherein the identity verification device performs a first face authentication process for comparing a first face image captured by the first camera with a second face image captured by the second camera, and when the first face image and the second face image match, generates identity authentication data for identifying the face of the holder, the server performs a pre-registration process for generating at least a two-dimensional barcode of a provisional registration management number based on the identity authentication data, and the identity verification device displays the provisional registration management number two-dimensional barcode on a screen of the mobile phone terminal. When an original barcode is displayed, a second facial authentication process is executed based on the two-dimensional barcode of the temporary registration management number, and a result of the second facial authentication process is transmitted to the server, and the server executes an update process to transition from temporary registration to official registration on condition that a result indicating that the second facial authentication process has been successful is received from the personal identification device, and when a cardless transaction is selected, the automated teller machine executes a third facial authentication process on condition that the PIN of the cash card has been input, and on condition that the third facial authentication process is successful, updates the balance of a target account identified by the account information based on the account information and the PIN of the cash card. and, on condition that the balance inquiry is normal, executing a formal registration process to formally register a cardless transaction for the holder who holds the cash card, transmitting a completion of the formal registration to the server, and, after the formal registration of the cardless transaction is completed, if the cardless transaction is selected, executing a fourth facial recognition process on condition that the PIN number of the cash card is entered, and, if the fourth facial recognition process is successful, initiating a transaction for a target account identified by the account information based on the account information and the PIN number of the cash card, on condition that the expiration date of the cash card is normal.

According to the present invention, automated cash transactions can be performed on the condition that a multi-stage process including facial recognition processing is completed, resulting in improved security measures for automated cash transactions and improved convenience for customers.

1 is a system configuration diagram of a financial institution to which an automated teller system according to a first embodiment of the present invention is applied. FIG. 4 is a diagram illustrating a configuration of a management table according to the first embodiment of the present invention. 4 is a flowchart for explaining an outline of a process of the automated teller system according to the first embodiment of the present invention. FIG. 1 is a transition diagram of a personal information advance registration process (download method) in the automated teller transaction system according to the first embodiment of the present invention. FIG. 1 is a transition diagram of a personal information advance registration process (two-dimensional barcode reading method) in the automated teller transaction system according to the first embodiment of the present invention. FIG. 1 is a transition diagram of a personal information advance registration process (two-dimensional barcode photographing method) in the automated teller transaction system according to the first embodiment of the present invention. FIG. 11 is a transition diagram of an identity reconfirmation process (download method) in the automated teller transaction system according to the first embodiment of the present invention. FIG. 2 is a transition diagram of identity reconfirmation processing (two-dimensional barcode reading method) in the automated teller transaction system according to the first embodiment of the present invention. FIG. 2 is a transition diagram of identity reconfirmation processing (two-dimensional barcode photographing method) in the automated teller transaction system according to the first embodiment of the present invention. FIG. 2 is a transition diagram of a personal information formal registration process in the automated teller system according to the first embodiment of the present invention. FIG. 2 is a transition diagram of a cardless transaction process in the automated teller system according to the first embodiment of the present invention.

The preferred embodiment of the present invention will be described in detail below with reference to the drawings.

First, we will use a system configuration diagram of a financial institution to explain the system configuration and functions of each device required to conduct cardless transactions.

1 is a system configuration diagram of a financial institution to which an automated teller system according to the first embodiment of the present invention is applied. In FIG. 1, an accounting system 310 and a cardless transaction/identification management server 320 are installed in a financial institution center 300, and a router 110, an automated teller machine 120, an identity verification control device 130, an identity verification device 140, and a card reader 150 are installed in a financial institution store 100. The accounting system 310 and the cardless transaction/identification management server 320 are connected to each other via a network 330. The identity verification control device 130 is connected to the cardless transaction/identification management server 320 via a network 340, a router 110, and a network 112, and the accounting system 310 is connected to the automated teller machine 120 via a network 350, a router 110, and a network 114. In addition, a mobile phone terminal 210 belonging to a customer's possessions 200 is connected to the accounting system 310 via wireless 360, 370. A card reader 150 is connected to the personal identification control device 130 via a USB (Universal Serial Bus) interface 132, and a personal identification device 140 is connected via a USB interface 134. The networks 330, 112, and 114 can be LANs (Local Area Networks), and the networks 340 and 350 can be based on WANs (Wide Area Networks), for example. The wireless 360 can use HTTP (Hypertext Transfer Protocol), and the wireless 370 can use SMS (Short Message Service).

The accounting system 310, the cardless transaction/identification management server 320, the automated teller machine 120, and the identity verification control device 130 are configured, for example, by a computer (not shown) equipped with a processor, a main memory device, an auxiliary memory device, an input device, an output device, and a communication device.

The processor is configured, for example, using a CPU (Central Processing Unit) or an MPU (Micro Processing Unit).

The main memory device is a device that stores computer programs and data, and is, for example, a ROM (Read Only Memory), a RAM (Random Access Memory), or a non-volatile semiconductor memory.

Examples of auxiliary storage devices include hard disk drives, SSDs (Solid State Drives), optical storage media (e.g., CDs (Compact Discs) and DVDs (Digital Versatile Discs)), storage systems, IC cards (Integrated Circuit Cards), SD (Secure Digital) memory cards, and other storage medium read/write devices, as well as the storage area of a cloud server. Computer programs and data stored in the auxiliary storage device are loaded into the main storage device as needed.

Examples of input devices include keyboards, mice, touch panels, card readers, and audio input devices. Output devices (display devices) are user interfaces that provide the user with various information such as the progress and results of processing. Examples of output devices include screen display devices (i.e., liquid crystal monitors, LCDs (Liquid Crystal Display), or graphics cards), audio output devices (i.e., speakers, etc.), or printing devices.

The communication device is a wired or wireless communication interface that realizes communication with other devices via a communication means such as a LAN or the Internet. The communication device is, for example, a NIC (Network Interface Card), a wireless communication module, a USB (Universal Serial Bus) module, or a serial communication module.

The card reader 150 reads the magnetic information (account information) recorded on a cash card 220 belonging to the customer's belongings 200, and transfers the read magnetic information to the identity verification control device 130. The identity verification device 140 has a face camera (first camera) that photographs the face of the holder (customer) who holds the cash card, a media camera (second camera) that photographs the face of an identity verification document 230 that identifies the holder, for example, a driver's license, an information reader (first information reader) that reads information displayed on the screen of a mobile phone terminal (for example, a smartphone) 210 held by the holder, and a display screen that displays the information (all not shown).

At this time, the identity verification device 140 imports information on the face image (first face image) captured by the media camera of the face photo on the identity verification document 230, photographs the face of the customer holding the mobile phone terminal 210 with the face camera, imports information on the captured face image (second face image), and executes a first face authentication process that compares the first face image with the second face image based on the imported information. If the first face image and the second face image match, it generates identity face authentication data that identifies the face of the holder and transfers the generated identity face authentication data to the identity verification control device 130. The identity verification control device 130 compiles the information from the identity verification device 140 and the information from the card read 150 and transfers them to the cardless transaction/identification management server 320 via the router 110.

The automated teller machine 120 has a face camera (third camera) that photographs the face of the holder, and an information reader (second information reader) that reads information displayed on the screen of the mobile phone terminal 210 or the display screen of the identity verification device 140, and processes cash transactions for the holder's account based on the holder's operation. At this time, the automated teller machine 120 imports information (two-dimensional barcode) from the mobile phone terminal 210, and also imports facial image information taken with the built-in face camera from the identity verification document 230 belonging to the customer's possessions 200, such as a driver's license, and transfers each of the imported information to the accounting system 310 and the cardless transaction/identification management server 320 via the router 110.

The cardless transaction/identification management server 320 transmits and receives information via the card reader 150, the identity verification device 140, the automated teller machine 120, the router 110, and the identity verification control device 130, and also transmits and receives information with the mobile phone terminal 210 via the accounting system 310.

At this time, the cardless transaction/identification management server 320 executes a pre-registration process to generate at least a two-dimensional barcode of the provisional registration management number based on the personal face authentication data generated by the personal identification device 140, and transfers the result of the pre-registration process to the personal identification device 140. When the provisional registration management number two-dimensional barcode is displayed on the screen of the mobile phone terminal 210, the personal identification device 140 executes a second face authentication process based on the provisional registration management number two-dimensional barcode, and transmits the result of the second face authentication process to the cardless transaction/identification management server 320. On condition that the cardless transaction/identification management server 320 receives a result from the personal identification device 140 indicating that the second face authentication process was successful, it executes an update process to move from provisional registration to official registration.

After the update process is executed by the cardless transaction/identification management server 320, if cardless transaction is selected, the automated teller machine 120 executes a third facial recognition process, provided that the PIN number of the cash card 220 has been entered, and, provided that the third facial recognition process is successful, performs a balance inquiry with the accounting system 310 for the target account identified in the account information based on the account information and the PIN number of the cash card 220, and, provided that the balance inquiry is normal, executes a formal registration process to formally register the cardless transaction for the holder (customer) of the cash card 220, and sends the completion of the formal registration to the cardless transaction/identification management server 320. Thereafter, after the official registration of the cardless transaction is completed, if the cardless transaction is selected, the automated teller machine 120 executes a fourth facial recognition process on condition that the PIN number of the cash card 220 is entered, and if the fourth facial recognition process is successful, it starts a transaction for the target account identified by the account information based on the account information and the PIN number of the cash card 220 on condition that the expiration date of the cash card 220 is normal.

Fig. 2 is a configuration diagram of a management table according to the first embodiment of the present invention. In Fig. 2, the management table 400 is a table stored in a storage device of the cardless transaction/identification management server 320, and is composed of server registration information 410 and a two-dimensional barcode 420. The two-dimensional barcode 420 is composed of a download/reading method 430 and a photographing method 440. The server registration information 410 is composed of the following items of information recorded in the storage device of the cardless transaction/identification management server 320: case number 450, temporary/formal type 452, temporary/formal registration management number 454, personal face authentication data 456, account information (magnetic information) 458, personal telephone number 460, PIN (Personal Identification Number) code 462, temporary/formal expiration date 464, temporary/formal reference URL (Uniform Resource Locator) information 466, temporary registration management number two-dimensional barcode 468, and cardless transaction two-dimensional barcode 470.

When the download/read method 430 is adopted to register the server registration information 410 as a two-dimensional barcode 420, information is recorded for all items, including the case number 450, temporary/formal type 452, temporary/formal registration management number 454, personal face recognition data 456, account information (magnetic information) 458, personal telephone number 460, PIN code 462, temporary/formal expiration date 464, temporary/formal reference URL information 466, temporary registration management number two-dimensional barcode 468, and cardless transaction two-dimensional barcode 470. On the other hand, when the imaging method 440 is adopted, the following information is recorded, excluding the items PIN code 462 and temporary/formal reference URL information 466: case number 450, temporary/formal type 452, temporary/formal registration management number 454, personal face authentication data 456, account information (magnetic information) 458, personal phone number 460, temporary/formal expiration date 464, temporary registration management number two-dimensional barcode 468, and cardless transaction two-dimensional barcode 470. In other words, the presence or absence of temporary/formal reference URL information 466 and the PIN code 462 for accessing it differs depending on the download method of the two-dimensional barcode. Note that when information is recorded in the download/reading method 430 and imaging method 440 columns, a circle is added.

Figure 3 is a flow chart for explaining an outline of the processing of the automated cash transaction system according to the first embodiment of the present invention. In Figure 3, the identity verification device 140 performs a pre-registration process (first identity verification face authentication process) by, for example, comparing the face image information of the face photo attached to the identity verification document 230 with the face image information obtained by photographing the face with a face camera and determining whether the two pieces of information match (S1), and determines whether the identity of the person has been confirmed based on the results of the face authentication process (S2). If a negative determination result is obtained in step S2 (NG), the process returns to step S1 and the processes of steps S1 to S2 are repeated. If a positive determination result is obtained in step S2 (OK), the identity verification authentication data is transferred to the cardless transaction/identification management server 320 via the identity verification control device 130.

The cardless transaction/identification management server 320 imports magnetic information including account information recorded on the cash card 220 from the identity verification control device 130 as information acquired by the card reader 150, and also imports identity verification authentication data from the identity verification control device 130, and registers the imported various information in the storage device in association with the provisional registration management number (S3). After this, the cardless transaction/identification management server 320 generates a two-dimensional barcode as a provisional registration management number two-dimensional barcode based on the provisional registration information including the provisional registration management number, the identity verification data, and the account information, and transfers the generated provisional registration management number two-dimensional barcode to the accounting system 310 (S4). After this, the mobile phone terminal 210 accesses the accounting system 310 and acquires the provisional registration management number two-dimensional barcode from the accounting system 310 (S5). Next, the cardless transaction/identification management server 320 deletes the two-dimensional barcode in the server (S6).

Then, as a process for re-identifying the identity of the person, the identity confirmation device 140 performs a facial authentication process (second facial authentication process) to check whether the two pieces of information match, for example, by comparing the facial image information of the face photograph attached to the identity confirmation document 230 with the facial image information captured by the face camera (S7), and determines whether the identity of the person has been confirmed based on the results of the facial authentication process (S8). If a negative determination result is obtained in step S8 (NG), the process returns to step S1 and the processes of steps S1 to S7 are repeated. If a positive determination result is obtained in step S8 (OK), the identity confirmation data is transferred to the cardless transaction/identification management server 320 via the identity confirmation control device 130.

The cardless transaction/identification management server 320 generates a two-dimensional barcode for cardless transactions based on the official registration information including the official management number, the person's facial authentication data, and account information, and transfers the generated two-dimensional barcode for cardless transactions to the accounting system 310 (S9). After this, the mobile phone terminal 210 accesses the accounting system 310 and obtains the two-dimensional barcode for cardless transactions from the accounting system 310 (S10). Next, the cardless transaction/identification management server 320 deletes the two-dimensional barcode from the server (S11).

After this, the automated teller machine 120 transmits and receives information including the two-dimensional barcode for cardless transactions to and from the mobile phone terminal 210, and executes a formal registration process for identity verification (S12). For example, the automated teller machine 120 compares the facial image information of the face photo attached to the identity verification document 230 with the facial image information extracted from the two-dimensional barcode for cardless transactions, and executes a facial authentication process (third facial authentication process) to determine whether the two pieces of information match. At this time, the automated teller machine 120 determines whether the identity of the person has been confirmed based on the result of the facial authentication process (S13). If a negative determination result is obtained in step S13 (NG), the automated teller machine 120 returns to step S1 and repeats the processes of steps S1 to S13. If a positive determination result is obtained in step S13 (OK), the automated teller machine 120 notifies the cardless transaction/identification management server 320 that the formal registration has been completed, provided that a balance inquiry to the accounting system 310 has been completed.

Then, the automated teller machine 120 transmits and receives information including the two-dimensional barcode for cardless transactions to and from the mobile phone terminal 210, compares the facial image information captured by the face camera with the facial image information extracted from the two-dimensional barcode for cardless transactions, and performs face authentication processing (fourth face authentication processing) to determine whether the two pieces of information match. If the identity of the person is confirmed, the cardless transaction processing is performed (S15), and then the processing in this routine ends.

Figure 4 is a transition diagram of the personal information pre-registration process (download method) in the automated teller transaction system according to the first embodiment of the present invention. In Figure 4, the process of receiving a two-dimensional barcode by the download method when pre-registering personal information for cardless transactions is described.

The card reader 140 connected to the identity verification control device 130 reads the magnetic information including the account information recorded on the cash card 220 (A1), and transfers the read magnetic information to the cardless transaction/identification management server 320 via the identity verification control device 130 (A2, A3).

The identity verification device 140 connected to the identity verification control device 130 takes a facial photograph of the identity verification document 230 with a built-in media camera to generate a facial image, and takes a facial photograph of the person holding the mobile phone terminal 210 with a built-in face camera to generate a facial image (A4), and executes a facial authentication process (first face authentication process) to determine whether the generated facial images match. At this time, if the identity verification device 140 confirms that the generated facial images match, it generates identity facial authentication data and transfers the generated identity facial authentication data to the cardless transaction/identification management server 320 via the identity verification control device 130 (A5, A3).

When the telephone number of the mobile phone terminal 210 is input, the identity verification device 140 transfers the input telephone number of the mobile phone terminal 210 to the cardless transaction/identification management server 320 via the identity verification control device 130 (A5, A3).

When a PIN code (personal identification number code) for accessing the URL for receiving the temporary registration management number two-dimensional barcode and the cardless transaction two-dimensional barcode is input, the identity verification device 140 transfers the information of the input PIN code to the cardless transaction/identification management server 320 via the identity verification control device 130 (A5, A3).

When the cardless transaction/identification management server 320 receives magnetic information from the card reader 140 or information from the identity verification device 140 (identity face authentication data, telephone number, PIN code), it generates a provisional registration management number for formal registration based on the received information, and generates a two-dimensional barcode with provisional registration information including the provisional registration management number, identity face authentication data, and account information. Furthermore, the cardless transaction/identification management server 320 generates a URL for receiving the provisional registration management number two-dimensional barcode including the identity face authentication data. After that, the cardless transaction/identification management server 320 transmits the URL for receiving the provisional registration management number two-dimensional barcode to the telephone number of the preregistered mobile phone terminal 210 by wireless 370 (SMS) as the destination (A6). After that, the cardless transaction/identification management server 320 registers information that provisional registration has been completed in the management table that manages the mobile phone terminal 210. This completes the preregistration of identity information regarding the person who possesses the mobile phone terminal 210.

Figure 5 is a transition diagram of the personal information pre-registration process (two-dimensional barcode reading method) in the automated cash transaction system according to the first embodiment of the present invention. In Figure 5, the process of receiving a two-dimensional barcode and reading the two-dimensional barcode displayed on the personal identification device 140 in the pre-registration of personal information for cardless transactions is described.

The card reader 140 connected to the identity verification control device 130 reads the magnetic information including the account information recorded on the cash card 220 (A1), and transfers the read magnetic information to the cardless transaction/identification management server 320 via the identity verification control device 130 (A2, A3).

The identity verification device 140 connected to the identity verification control device 130 takes a facial photograph of the identity verification document 230 with a built-in media camera to generate a facial image, and takes a facial photograph of the person holding the mobile phone terminal 210 with a built-in face camera to generate a facial image (A4), and executes a facial authentication process (first face authentication process) to determine whether the generated facial images match. At this time, if the identity verification device 140 confirms that the generated facial images match, it generates identity facial authentication data and transfers the generated identity facial authentication data to the cardless transaction/identification management server 320 via the identity verification control device 130 (A5, A3).

When a PIN code is input to access the URL for receiving the temporary registration management number two-dimensional barcode and the cardless transaction two-dimensional barcode, the identity verification device 140 transfers the information of the input PIN code to the cardless transaction/identification management server 320 via the identity verification control device 130 (A5, A3).

When the cardless transaction/identification management server 320 receives magnetic information from the card reader 140 or information from the identity verification device 140 (identity face authentication data, PIN code), it generates a temporary registration management number for formal registration based on the received information, and generates a two-dimensional barcode with temporary registration information including the temporary registration management number, identity face authentication data, and account information. Furthermore, the cardless transaction/identification management server 320 generates a URL for receiving the temporary registration management number two-dimensional barcode including the identity face authentication data, and generates a two-dimensional barcode with a URL for receiving the temporary registration information two-dimensional barcode. The cardless transaction/identification management server 320 then transfers the two-dimensional barcode of the URL for receiving the temporary registration management number two-dimensional barcode to the identity verification device 140 via the identity verification control device 130 (A6, A7).

The identity verification device 140 displays the two-dimensional barcode of the URL for receiving the received two-dimensional barcode of the temporary registration management number. At this time, the mobile phone terminal 210 reads the two-dimensional barcode of the displayed URL for receiving the two-dimensional barcode of the temporary registration management number using its two-dimensional barcode reading function (A8).

Then, the identity verification device 140 notifies the cardless transaction/identity verification management server 320 via the identity verification control device 130 of information that provisional registration has been completed (A5, A3). When the cardless transaction/identity verification management server 320 receives the notification from the identity verification device 140, it registers information that provisional registration has been completed in the management table that manages the mobile phone terminal 210. This completes the pre-registration of identity information for the holder of the mobile phone terminal 210.

Figure 6 is a transition diagram of the personal information pre-registration process (two-dimensional barcode capture method) in the automated cash transaction system according to the first embodiment of the present invention. In Figure 6, the process of the two-dimensional barcode capture method in which a two-dimensional barcode is received and obtained by capturing an image of the two-dimensional barcode displayed on the personal identification device 140 using the camera function of the mobile phone terminal 210 during pre-registration of personal information for cardless transactions is described.

In FIG. 6, the card reader 140 connected to the identity verification control device 130 reads magnetic information including account information recorded on the cash card 220 (A1), and transfers the read magnetic information to the cardless transaction/identification management server 320 via the identity verification control device 130 (A2, A3).

The identity verification device 140 connected to the identity verification control device 130 takes a facial photograph of the identity verification document 230 with a built-in media camera to generate a facial image, and takes a facial photograph of the person holding the mobile phone terminal 210 with a built-in face camera to generate a facial image (A4), and executes a facial authentication process (first face authentication process) to determine whether the generated facial images match. At this time, if the identity verification device 140 confirms that the generated facial images match, it generates identity facial authentication data and transfers the generated identity facial authentication data to the cardless transaction/identification management server 320 via the identity verification control device 130 (A5, A3).

When the cardless transaction/identification management server 320 receives magnetic information from the card reader 140 or information (identification face authentication data) from the identity verification device 140, it generates a provisional registration management number for formal registration based on the received information, and generates a two-dimensional barcode (provisional registration management number two-dimensional barcode) from the provisional registration information including the provisional registration management number, the identity verification data, and the account information. The cardless transaction/identification management server 320 then transfers the provisional registration management number two-dimensional barcode to the identity verification device 140 via the identity verification control device 130 (A6, A7).

The identity verification device 140 displays the received two-dimensional temporary registration management number barcode. At this time, the mobile phone terminal 210 uses its camera function to capture the displayed two-dimensional temporary registration management number barcode (A8) and displays the captured two-dimensional temporary registration management number barcode. At this time, the identity verification device 140 reads the displayed two-dimensional temporary registration management number barcode (A9), compares the facial image of the identity verification data obtained by decoding the read two-dimensional temporary registration management number barcode with the facial image obtained by capturing a facial photograph of the identity verification document 230 with the built-in media camera, and if it is confirmed that the two facial images match, notifies the cardless transaction/identification management server 320 via the identity verification control device 130 of information that the temporary registration has been completed (A5, A3).

When the cardless transaction/identification management server 320 receives a notification from the identity verification device 140, it registers information that provisional registration has been completed in the management table that manages the mobile phone terminal 210. This completes the pre-registration of identity information for the person who possesses the mobile phone terminal 210.

Figure 7 is a transition diagram of identity reconfirmation processing (download method) in the automated teller transaction system according to the first embodiment of the present invention. In Figure 7, the process of receiving a two-dimensional barcode by download method in identity reconfirmation for cardless transactions is described.

In FIG. 7, the mobile phone terminal 210 accesses a URL for receiving the temporary registration management number two-dimensional barcode, inputs a PIN code previously registered on the mobile phone terminal 210, downloads the information of the temporary registration management number two-dimensional barcode from the accessed destination, and displays the downloaded temporary registration management number two-dimensional barcode on the display screen.

The identity verification device 140 connected to the identity verification control device 130 reads the information of the two-dimensional barcode of the temporary registration management number displayed on the mobile phone terminal 210 (A1). At this time, the identity verification device 140 decodes the information of the two-dimensional barcode of the temporary registration management number that it reads, and acquires the identity face authentication data contained in the two-dimensional barcode of the temporary registration management number. After this, the identity verification device 140 executes a face authentication process (second face authentication process) that compares the face image of the acquired identity face authentication data with the face image of the identity (person holding the mobile phone terminal 210) captured by the face camera of the identity verification device 140, and if it is confirmed that the identity is the identity from the comparison result, it notifies the cardless transaction/identification management server 320 via the identity verification control device 130 of information that the face authentication is OK (that the face authentication process was successful) (A2, A3).

When the cardless transaction/identification management server 320 receives information indicating that face authentication is OK, it executes an update process to update the provisional registration information to the official registration information. At this time, the cardless transaction/identification management server 320 generates a two-dimensional barcode for cardless transactions using the official registration information including the official registration number and account information, and the expiration date (expiration date of the cash card), and also generates a URL for receiving the two-dimensional barcode for cardless transactions. The cardless transaction/identification management server 320 then wirelessly transmits the URL for receiving the two-dimensional barcode for cardless transactions to the telephone number of the mobile phone terminal 210 registered in advance via SMS 370 (A4).

When the mobile phone terminal 210 receives the URL for receiving the two-dimensional barcode for cardless transactions, it accesses the received URL. At this time, the mobile phone terminal 210 inputs a pre-registered PIN code and downloads the two-dimensional barcode for cardless transactions from the access destination. The cardless transaction/identification management server 320 deletes the two-dimensional barcode data for cardless transactions from the server. This completes the process of reconfirming the identity of the person who possesses the mobile phone terminal 210 and the update process.

Figure 8 is a transition diagram of identity reconfirmation processing (two-dimensional barcode reading method) in the automated cash transaction system according to the first embodiment of the present invention. In Figure 8, the process of receiving a two-dimensional barcode and reading the two-dimensional barcode displayed on the identity verification device 140 in identity reconfirmation for cardless transactions is described.

In FIG. 8, the mobile phone terminal 210 accesses a URL for receiving the temporary registration management number two-dimensional barcode, inputs a PIN code previously registered on the mobile phone terminal 210, downloads the information of the temporary registration management number two-dimensional barcode from the accessed destination, and displays the downloaded temporary registration management number two-dimensional barcode on the display screen.

The identity verification device 140 connected to the identity verification control device 130 reads the information of the two-dimensional barcode of the temporary registration management number displayed on the mobile phone terminal 210 (A1). At this time, the identity verification device 140 decodes the information of the two-dimensional barcode of the temporary registration management number that it reads, and acquires the identity face authentication data contained in the two-dimensional barcode of the temporary registration management number. After this, the identity verification device 140 performs a face authentication process (second face authentication process) that compares the face image of the acquired identity face authentication data with the face image of the identity (person holding the mobile phone terminal 210) captured by the face camera of the identity verification device 140, and if it is confirmed that the identity is the identity from the comparison result, it notifies the cardless transaction/identification management server 320 via the identity verification control device 130 of information that the face authentication is OK (A2, A3).

When the cardless transaction/identification management server 320 receives information indicating that face authentication is OK, it executes an update process to update the provisional registration information to the formal registration information. At this time, the cardless transaction/identification management server 320 generates a two-dimensional barcode for cardless transactions with the formal registration information including the formal registration number and account information, and the expiration date, and generates a URL for receiving the two-dimensional barcode for cardless transactions. The cardless transaction/identification management server 320 then generates a two-dimensional barcode with the URL for receiving the two-dimensional barcode for cardless transactions, and transfers the generated two-dimensional barcode (the two-dimensional barcode of the URL for receiving the two-dimensional barcode for cardless transactions) to the identity confirmation device 140 via the identity confirmation control device 130 (A4, A5).

When the identity verification device 140 receives the two-dimensional barcode of the URL for receiving the two-dimensional barcode for cardless transactions, it displays the two-dimensional barcode of the received URL for receiving the two-dimensional barcode for cardless transactions on the screen. At this time, the mobile phone terminal 210 reads the two-dimensional barcode of the displayed URL for receiving the two-dimensional barcode for cardless transactions using the two-dimensional barcode reading function, and accesses the read URL for receiving the two-dimensional barcode for cardless transactions. After this, the mobile phone terminal 210 inputs the PIN code registered in advance, and downloads the two-dimensional barcode for cardless transactions from the access destination. The cardless transaction/identification management server 320 deletes the two-dimensional barcode data for cardless transactions from the server. This completes the process of reconfirming the identity of the person who possesses the mobile phone terminal 210 and the update process.

Figure 9 is a transition diagram of identity reconfirmation processing (two-dimensional barcode photographing method) in the automated cash transaction system according to the first embodiment of the present invention. In Figure 9, the process of the two-dimensional barcode photographing method in which a two-dimensional barcode is received and obtained by photographing the two-dimensional barcode displayed on the identity verification device 140 with the camera function of the mobile phone terminal 210 during identity reconfirmation for cardless transactions is described.

In FIG. 9, the mobile phone terminal 210 displays the two-dimensional temporary registration management number barcode captured by the camera function on the screen. The personal identification device 140 connected to the personal identification control device 130 reads the information of the two-dimensional temporary registration management number barcode displayed on the mobile phone terminal 210 (A1). At this time, the personal identification device 140 decodes the information of the read two-dimensional temporary registration management number barcode and acquires the personal face authentication data contained in the two-dimensional temporary registration management number barcode. After this, the personal identification device 140 executes a face authentication process (second face authentication process) that compares the face image of the acquired personal face authentication data with the face image of the person (the person holding the mobile phone terminal 210) captured by the face camera of the personal identification device 140, and if it is confirmed that the person is the person from the comparison result, it notifies the cardless transaction/personal identification management server 320 via the personal identification control device 130 of information that the face authentication is OK (A2, A3).

When the cardless transaction/identification management server 320 receives information indicating that face authentication is OK, it executes an update process to update the provisional registration information to the official registration information. At this time, the cardless transaction/identification management server 320 generates a two-dimensional barcode for cardless transactions using the official registration information including the official registration number and account information, and the expiration date, and transfers the generated two-dimensional barcode for cardless transactions to the identity verification device 140 via the identity verification control device 130 (A4, A5).

When the identity verification device 140 receives a two-dimensional barcode for cardless transactions, it displays the received two-dimensional barcode for cardless transactions on the screen. At this time, the mobile phone terminal 210 uses its camera function to capture an image of the displayed two-dimensional barcode for cardless transactions, and displays information about the captured two-dimensional barcode for cardless transactions on the screen.

The identity verification device 140 reads the information of the two-dimensional barcode for cardless transactions displayed on the mobile phone terminal 210 (A1). At this time, the identity verification device 140 decodes the information of the two-dimensional barcode for cardless transactions that it has read, and acquires identity face authentication data contained in the two-dimensional barcode for cardless transactions. After this, the identity verification device 140 compares the facial image of the acquired identity face authentication data with the facial image of the person (the person holding the mobile phone terminal 210) captured by the face camera of the identity verification device 140, and if it is confirmed that the person is the identity based on the comparison result, it notifies the cardless transaction/identification management server 320 via the identity verification control device 130 of information that the face authentication is OK (A2, A3). The cardless transaction/identification management server 320 deletes the two-dimensional barcode data for cardless transactions in the server. This completes the process of reconfirming the identity of the person holding the mobile phone terminal 210 and the update process.

Figure 10 is a transition diagram of the process of officially registering personal information in the automated teller transaction system according to the first embodiment of the present invention. In Figure 10, the process of officially registering personal information for cardless transactions is described.

In FIG. 10, the mobile phone terminal 210 displays a two-dimensional barcode for cardless transactions on the screen. At this time, the cardless transaction is selected in the automated teller machine 120. At this time, the automated teller machine 120 reads the information of the two-dimensional barcode for cardless transactions displayed on the mobile phone terminal 210 by using the barcode reading function (A1). The automated teller machine 120 uses the face image capturing function (third camera) to capture a face image of the person (the person holding the mobile phone terminal 210), and executes a face authentication process (third face authentication process) that compares the captured face image with a face image in the face authentication data obtained by decoding the two-dimensional barcode for cardless transactions, and checks whether the two face images match. If the two face images match and the person is confirmed to be the person, the automated teller machine 120 decodes the two-dimensional barcode for cardless transactions and obtains account information from the two-dimensional barcode for cardless transactions. When a PIN number for a target account is entered, the automated teller machine 120 inquires about the balance of the target account with the accounting system 310 (A2). When the automated teller machine 120 receives information from the accounting system 310 that the balance inquiry was successful (A3), it notifies the cardless transaction/identification management server 320 that official registration has been completed (A4). This completes the official identity registration process for officially registering the person who possesses the mobile phone terminal 210.

Figure 11 is a transition diagram of the cardless transaction processing in the automated teller system according to the first embodiment of the present invention. In Figure 11, the cardless transaction processing after the completion of the formal registration is explained.

In FIG. 11, the mobile phone terminal 210 displays a two-dimensional barcode for cardless transactions on the screen. At this time, the cardless transaction is selected in the automated teller machine 120. After this, the automated teller machine 120 reads the information of the two-dimensional barcode for cardless transactions displayed on the mobile phone terminal 210 by using the barcode reading function (A1). The automated teller machine 120 decodes the two-dimensional barcode for cardless transactions that has been read, and obtains the person's face authentication data, account information, and expiration date (expiration date of the cash card) from the two-dimensional barcode for cardless transactions. The automated teller machine 120 checks whether the obtained expiration date is within the expiration date, and performs a process (fourth face authentication process) of comparing the face image obtained from the person's face authentication data with the face image obtained by taking a face image of the person (the person holding the mobile phone terminal 210) by using the face image taking function, and checking whether the two face images match.

If the facial images of both parties match and the identity of the person is confirmed, the automated teller machine 120 requests the accounting system 310 to carry out a transaction for the target account, provided that the PIN for the target account has been entered (A2). The automated teller machine 120 then receives the processing results for the target account from the accounting system 310 (A3), and completes the processing of the transaction for the target account. This completes the processing of the transaction for the target account.

According to this embodiment, automated cash transactions can be performed on the condition that multiple steps, including facial recognition processing, are completed, resulting in improved security measures for automated cash transactions and improved customer convenience. In other words, after a person who possesses a mobile phone terminal with a camera function pre-registers their personal information, they can perform automated cash transactions on the condition that multiple steps, including facial recognition processing, are completed, without using a cash card at the automated cash transaction device, as the mobile phone terminal transmits and receives information to and from the automated cash transaction device and the financial institution center.

The present invention is not limited to the above-described embodiments, but includes various modified examples and equivalent configurations within the spirit of the appended claims. For example, the cardless transaction/identification management server 320 and the accounting system 310 can be integrated to configure a server. The above-described embodiments have been described in detail to clearly explain the present invention, and the present invention is not necessarily limited to having all of the configurations described.

Furthermore, each of the configurations, functions, etc. described above may be realized in part or in whole in hardware, for example by designing them as integrated circuits, or in software, by a processor interpreting and executing a program that realizes each function.

Information such as programs, tables, and files that realize each function can be stored in a storage device such as a memory, a hard disk, or an SSD (Solid State Drive), or in a recording medium such as an IC (Integrated Circuit) card, an SD card, or a DVD (Digital Versatile Disc).

100: Financial institution store, 110: Router, 120: Automatic transaction machine, 130: Personal identification control device, 140: Personal identification device, 150: Card reader, 200: Customer's belongings, 210: Mobile phone terminal, 220: Cash card, 300: Financial institution center, 310: Accounting system, 320: Cardless transaction/personal identification management server

Claims (11)

A card reader for reading account information recorded on a cash card;
a first camera that photographs the face of a person who holds the cash card; a second camera that photographs the face of an identification document that identifies the cardholder; a first information reader that reads information displayed on the screen of a mobile phone terminal held by the cardholder; and an identification device having a display screen that displays information;
an automated teller machine having a third camera for photographing the face of the account holder and a second information reader for reading information displayed on the screen of the mobile phone terminal or the display screen of the personal identification device, and for executing a cash transaction process for the account holder based on an operation by the account holder;
a server that transmits and receives information to and from the card reader, the identity verification device, the automated teller machine, and the mobile phone terminal;
The identity verification device includes:
execute a first face authentication process for comparing a first face image captured by the first camera with a second face image captured by the second camera, and generate personal face authentication data for identifying the face of the holder when the first face image and the second face image match;
The server,
Executing a pre-registration process to generate at least a two-dimensional barcode of a provisional registration management number based on the face authentication data;
The identity verification device includes:
When the two-dimensional barcode of the temporary registration management number is displayed on the screen of the mobile phone terminal, a second face authentication process is executed based on the two-dimensional barcode of the temporary registration management number, and a result of the second face authentication process is transmitted to the server;
The server,
executes an update process for transitioning from provisional registration to formal registration on condition that a result indicating that the second face authentication process has been successful is received from the personal identification device;
The automated teller machine includes:
if a cardless transaction is selected, on condition that a PIN for the cash card has been input, execute a third facial authentication process, on condition that the third facial authentication process is successful, perform a balance inquiry for a target account identified by the account information based on the account information and the PIN for the cash card, and on condition that the balance inquiry is normal, execute a formal registration process to formally register a cardless transaction for the holder who holds the cash card, and transmit completion of the formal registration to the server;
an automated cash transaction system characterized in that, when the cardless transaction is selected after completion of official registration of the cardless transaction, a fourth facial recognition process is executed on condition that the PIN number of the cash card is entered, and, when the fourth facial recognition process is successful, a transaction is initiated for a target account identified in the account information based on the account information and the PIN number of the cash card on condition that the expiration date of the cash card is normal. 2. The automated cash transaction system according to claim 1,
The server,
and generating a temporary registration management number for identifying the cardholder based on the input information, generating a temporary registration management number two-dimensional barcode based on the generated temporary registration management number, the personal face authentication data, and temporary registration information including the personal face authentication data and the account information, generating a URL for receiving the temporary registration management number two-dimensional barcode including the personal face authentication data, and sending the generated URL for receiving the temporary registration management number two-dimensional barcode to the telephone number of the mobile phone terminal as a destination. 2. The automated cash transaction system according to claim 1,
The server,
and generating a temporary registration management number that identifies the cardholder based on the input information, generating a temporary registration management number two-dimensional barcode based on the generated temporary registration management number, the personal face authentication data, and temporary registration information including the account information, generating a URL for receiving the temporary registration management number two-dimensional barcode, generating a two-dimensional barcode of the temporary registration management number two-dimensional barcode based on the temporary registration management number two-dimensional barcode receiving URL, and transmitting the generated two-dimensional barcode of the temporary registration management number two-dimensional barcode receiving URL to the personal identification device. 2. The automated cash transaction system according to claim 1,
The server,
The pre-registration process includes inputting the card holder's account information from the card reader and the face authentication data from the identity verification device, generating a temporary registration management number that identifies the card holder based on the input information, generating a two-dimensional barcode of the temporary registration management number based on the generated temporary registration management number and temporary registration information including the face authentication data and the account information, and transmitting the generated two-dimensional barcode of the temporary registration management number to the identity verification device. 2. The automated cash transaction system according to claim 1,
The identity verification device includes:
an automated cash transaction system, characterized in that, as the second face authentication process, a two-dimensional barcode of the temporary registration management number is read, the read two-dimensional barcode of the temporary registration management number is decoded to obtain the personal face authentication data, a third face image obtained from the obtained personal face authentication data is compared with a fourth face image captured by the first camera, and if the third face image and the fourth face image match, a result indicating that the second face authentication process was successful is transmitted to the server. 2. The automated cash transaction system according to claim 1,
The identity verification device includes:
an automated cash transaction system comprising: when a two-dimensional barcode of a URL for receiving the temporary registration management number two-dimensional barcode is received from the server as the second face authentication process, the two-dimensional barcode of the received URL for receiving the temporary registration management number two-dimensional barcode is displayed; and when the temporary registration management number two-dimensional barcode is then displayed on the screen of the mobile phone terminal, the two-dimensional barcode of the temporary registration management number is read, the read temporary registration management number two-dimensional barcode is decoded to obtain the personal face authentication data, a third face image obtained from the obtained personal face authentication data is compared with a fourth face image captured by the first camera, and when the third face image and the fourth face image match, a result indicating that the second face authentication process was successful is transmitted to the server. 2. The automated cash transaction system according to claim 1,
The identity verification device includes:
and if a two-dimensional barcode equivalent to the temporary registration management number two-dimensional barcode is displayed on the screen of the mobile phone terminal, the information of the two-dimensional barcode displayed on the screen of the mobile phone terminal is read, and a determination is made as to whether or not the information of the read two-dimensional barcode matches the information of the temporary registration management number two-dimensional barcode received from the server. Thereafter, if the temporary registration management number two-dimensional barcode is displayed on the screen of the mobile phone terminal, the two-dimensional barcode of the temporary registration management number is read, and the read two-dimensional barcode of the temporary registration management number is decoded to obtain the personal face authentication data. A third face image obtained from the obtained personal face authentication data is compared with a fourth face image captured by the first camera, and if the third face image and the fourth face image match, a result indicating that the second face authentication process was successful is transmitted to the server. 2. The automated cash transaction system according to claim 1,
The server,
The automated cash transaction system is characterized in that, as the update process, when a result indicating that the second facial recognition process was successful is received, a formal registration management number that identifies the holder is generated, a two-dimensional barcode for cardless transactions is generated based on the generated formal registration management number, temporary registration information including the account information, and information on the expiration date of the cash card, and a URL for receiving the generated two-dimensional barcode for cardless transactions is sent to the telephone number of the mobile phone terminal as a destination. 2. The automated cash transaction system according to claim 1,
The server,
as the update process, when a result indicating that the second face authentication process was successful is received, a formal registration management number for identifying the holder is generated, a two-dimensional barcode for cardless transactions is generated based on the generated formal registration management number, temporary registration information including the account information, and information on the expiration date of the cash card, and a URL for receiving the two-dimensional barcode for cardless transactions is generated, and the two-dimensional barcode of the generated URL for receiving the two-dimensional barcode for cardless transactions is transmitted to the identity verification device,
The identity verification device includes:
When a two-dimensional barcode of a URL for receiving the two-dimensional barcode for cardless transactions is received from the server, the two-dimensional barcode of the received URL for receiving the two-dimensional barcode for cardless transactions is displayed. 2. The automated cash transaction system according to claim 1,
The server,
as the update process, when a result indicating that the second face authentication process was successful is received, a formal registration management number for identifying the holder is generated, a two-dimensional barcode for cardless transactions is generated based on the generated formal registration management number, temporary registration information including the account information, and information on the expiration date of the cash card, and information on the generated two-dimensional barcode for cardless transactions is transmitted to the identity verification device;
The identity verification device includes:
When information of the two-dimensional barcode for cardless transaction is received from the server, the received information of the two-dimensional barcode for cardless transaction is displayed. 2. The automated cash transaction system according to claim 1,
The automated teller machine includes:
As the third face authentication process, information of a two-dimensional barcode for cardless transactions displayed on a screen of the mobile phone terminal is read, the read information of the two-dimensional barcode for cardless transactions is decoded to obtain the personal face authentication data, a fifth face image obtained from the obtained personal face authentication data is compared with a sixth face image captured by the third camera, and if the fifth face image and the sixth face image match, the read information of the two-dimensional barcode for cardless transactions is decoded to obtain the account information;
The automated cash transaction system is characterized in that, as the fourth face authentication process, information of the two-dimensional barcode for cardless transactions displayed on a screen of the mobile phone terminal is read, the read information of the two-dimensional barcode for cardless transactions is decoded to obtain the personal face authentication data, a seventh face image obtained from the obtained personal face authentication data is compared with an eighth face image captured by the third camera, and if the seventh face image and the eighth face image match, the information of the read two-dimensional barcode for cardless transactions is decoded to obtain the account information.

Images