JP7013193B2 - System, system control method, voice control device, voice control device control method, and program - Google Patents

Description

The present invention relates to a system for providing a secure authentication method and improving user convenience.

In recent years, FIDO (Fast Identity Online) has been attracting attention as a new authentication system including biometric authentication. Biometric information such as fingerprints and veins used in biometric authentication cannot be rewritten unlike the password in conventional ID / password authentication when the information leaks to the outside, so information leakage is fatal. Become.

On the other hand, FIDO performs registration processing in advance between the device in the user's hand and the server that provides the Web service. In the registration process, the device stores the private key associated with the biometric information of the user, and the server registers information such as the authentication identification information associated with the biometric authentication and the public key that is a pair of the private key. Then, the authentication is performed not on the server via the Internet but on the device in the user's hand, and the authentication result signed with the private key flows on the network. In other words, since biometric information does not flow on the network, it can be said that the risk of information leakage is low.

On the other hand, in recent years, a voice assistant device (voice operation device) having a speaker function has been generally used. Hereinafter, the voice assistant device will be referred to as a voice assistant. The voice assistant is an information device having a function of interpreting a user's utterance by a voice recognition function and executing various instructions by the user. The voice assistant has an advantage that it is possible to give instructions by voice, which saves the trouble of key operation and touch input in a conventional personal computer or smartphone.

As an example of how to use the voice assistant, install the voice assistant in the living room at home and play the desired music by the user giving instructions by voice, or use the mail-order service published on the Internet. You can order products. In addition, voice assistants are being introduced not only to homes but also to public facilities such as hotels and other accommodation facilities.

Accommodations such as hotels generally provide comprehensive services such as room service, searching for events for guests, and purchasing tickets for them. In providing such a service, a voice assistant is expected as a means for the guest to easily receive the service without the need for troublesome work.

Patent Document 1 discloses a hotel visitor server system that provides services and makes payments using a room key and a personal identification number at a hotel. Patent Document 1 discloses that an RFID wireless tag that stores information such as a room number, a personal identification number, a customer number, or a payment amount is attached to a hotel room key in advance, and payment is made in a lump sum at checkout. ing.

Japanese Patent Application Laid-Open No. 2003-132435

The conventional authentication method using an ID and password is convenient because it is necessary for the user to enter the ID and password when receiving various services, and it is necessary to take the trouble of inputting and to remember the information. Not really. There is also a risk that ID and password information will be leaked.

However, when a user uses a service via a voice assistant in a public place such as a hotel that can be used by an unspecified number of people, in order to use an authentication method such as FIDO described above, the voice assistant is provided with biometric information. It is necessary to save various information associated with. Hereinafter, various types of information associated with biometric information will be referred to as biometric authentication information. If it is a voice assistant used at home, there is no problem in storing biometric information, but registering biometric information on a device placed in a place used by an unspecified number of people is a leak of biometric information. It is expected that the user will feel resistance from the possibility.

An object of the present invention is to provide a system capable of improving user convenience and providing a secure authentication method.

The system of one embodiment of the present invention is an information processing terminal provided with an authentication module for bioauthentication and a tamper-resistant storage means for storing user biometric information necessary for performing authentication processing by the authentication module. A system including a voice operating device that receives a voice input and executes a process corresponding to the input, and the voice operating device receives the input of the user's voice and receives the input to the external system. A first requesting means for making a corresponding processing request, a receiving means for receiving an authentication request from the external system, and an authentication process for the user's information processing terminal are requested via wireless communication in accordance with the authentication request. It has a second requesting means and a transmitting means for transmitting an authentication result from the information processing terminal to the external system, and the information processing terminal responds to a request for authentication processing from the voice operating device. Correspondingly, there are an execution means for executing the bioauthentication process using the biometric information stored in the authentication module and the storage means, and a transmission means for transmitting the authentication result by the bioauthentication process to the voice operation device. Then, the authentication result by the biometric authentication process is the verification data issued by the external system in which the private key stored in the storage means in association with the biometric information and the public key to be a pair of the private key are registered. Includes signatures created by using and .

According to the system of the present invention, it is possible to improve the convenience of the user and provide a secure authentication method.

It is a figure which shows the whole structure of the system which concerns on one Embodiment of this invention. It is a figure which shows the hardware configuration example of a server. It is a figure which shows the hardware configuration example of a mobile terminal. It is a figure which shows the hardware configuration example of a voice assistant. It is a figure which shows an example of the functional structure of each apparatus. It is a sequence diagram which shows the process of starting the use of a service. It is a sequence diagram which shows the process at the time of using a service. It is a sequence diagram which shows the process which ends the use of a service. It is a figure which shows an example of the check-in screen. It is a figure which shows an example of the biometric information registration screen. It is a figure which shows an example of the input request screen of a biological information. It is a figure which shows an example of the checkout screen. It is a sequence diagram which shows the process at the time of using a music distribution service. It is a sequence diagram which shows the modification of the process at the time of using a music distribution service. It is a sequence diagram which shows the modification of the process at the time of using a music distribution service.

Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings and the like.
In the present invention, in order for a service provided from an external system via a network to authenticate the user, biometric authentication is performed on the device (information processing terminal) in the user's hand, and the service is based on the result. It is related to the mechanism for authenticating users. This can be realized by registering in advance information associated with biometric authentication on the device in the user's hand, such as authentication identification information and public key, in the service.

Although FIDO is mentioned as an example of such a mechanism, it should be noted in advance that the present invention is not limited to FIDO. In the present embodiment, the mobile terminal 103 owned by the user will be described as an example of the device for performing biometric authentication in the user's hand, but the present invention is not limited to this. In the second embodiment, as another example, a case where the voice assistant 105 and the server 102 perform biometric authentication will be described.

[First Embodiment]
FIG. 1 is a diagram showing an example of an overall configuration of a system according to an embodiment of the present invention.
The system shown in FIG. 1 includes a server 102, a mobile terminal 103, and voice assistants (voice control devices) 105a to 105c.

For the sake of explanation, the matters common to the voice assistants 105a to 105c will be described as the voice assistant 105. FIG. 1 shows that three voice assistants 105 are connected to the network 101 and a plurality of voice assistants 105 are installed, but the present invention is not limited to this, and even one voice assistant 105 may be installed. There may be a plurality of units. Further, the server 102 is an external system that provides services, and may be configured by a plurality of devices, or a part or all of the server 102 may be constructed by using resources such as virtual machines and storage.

The server 102 and the voice assistant 105 are connected via the network 101. The network 101 is, for example, any one such as a LAN such as the Internet, a WAN, a telephone line, a dedicated digital line, an ATM or a frame relay line, a cable television line, and a wireless line for data broadcasting. Further, the network 101 is a so-called communication network realized by a combination of these. The network 101 may be capable of transmitting and receiving data.

The server 102 and the voice assistant 105 are connected to the mobile terminal 103 via the network 106. The network 106 includes, for example, short-range wireless communication such as NFC (Near Field Communication) and Bluetooth (registered trademark) in addition to the above-mentioned network line such as LAN.

In this embodiment, it is assumed that the voice assistant is installed in an accommodation facility such as a hotel. The voice assistants 105a to 105c are installed in the rooms of the hotel, Room 104a to 104c, respectively. That is, a voice assistant 105a is installed in the Room 104a. For the sake of explanation, the matters common to Room 104a to 104c will be described as Room 104.

FIG. 2 is a diagram showing a hardware configuration example of the server 102.
The CPU 201 executes a program stored in the ROM 203 and a program such as an OS (operating system) or an application loaded from the external memory 210 into the RAM 202. That is, the CPU 201 functions as each processing unit that executes the processing of each flowchart described later by executing the program stored in the readable storage medium.

The RAM 202 is the main memory of the CPU 201 and functions as a work area or the like. The keyboard controller 204 controls operation inputs from the keyboard 208 and a pointing device (not shown). The pointing device is, for example, a mouse, a touch pad, a touch panel, a trackball, or the like. The display controller 205 controls the display of the display 209.

The disk controller 206 controls data access to an external memory 210 such as a hard disk (HD) or a flexible disk (FD) for storing various data. The network I / F 207 is connected to the network and executes communication control processing with other devices connected to the network. The proximity communication I / F211 is a network I / F corresponding to a communication method for proximity communication such as NFC and Bluetooth (registered trademark), and communicates with a mobile terminal 103 or the like to exchange data.

FIG. 3 is a diagram showing a hardware configuration example of the mobile terminal 103.
The CPU 222 executes a program stored in the ROM 224 and the storage device 225, and comprehensively controls each configuration described later via the internal bus 221. The program also includes a program that realizes each flowchart described later. The RAM 223 functions as a memory or a work area of the CPU 222.

The storage device 225 is a storage device such as a solid state drive (SSD) or an SD memory card, and functions as an external storage device. The Tamper Module (TPM) 226 is a storage means having tamper resistance that prevents the stored data from being read from the outside for the purpose of processing or storing confidential information. The network I / F 227 exchanges data with an external network device in one direction or two directions.

The biometric information sensor 228 is a sensor that reads biometric information of the user, and converts biometric information such as a user's fingerprint, iris, vein, voiceprint, and facial image into a reading signal. The biometric information is not limited to these. The touch panel 229 has two functions, display and input, and displays the screen of an application, a keyboard, etc., and the screen position touched by the user by applying pressure to the screen with a hand or a dedicated pen. The information is output to the outside as signal information.

By using the output signal information by the application, the user can operate the application through the touch panel 229. The proximity communication I / F 230 is a network I / F corresponding to a communication method for proximity communication such as NFC and Bluetooth (registered trademark), and communicates with a server 102 or the like to exchange data.

FIG. 4 is a diagram showing a hardware configuration example of the voice assistant 105.
The CPU 241 executes a program stored in the ROM 243 and a program such as an OS (operating system) or an application loaded from the external memory 248 into the RAM 242. That is, the CPU 241 functions as each processing unit that executes the processing of each flowchart described later by executing the program stored in the readable storage medium.

The RAM 242 is the main memory of the CPU 241 and functions as a work area or the like. The disk controller 244 controls data access to an external memory 248 such as a hard disk (HD) or a flexible disk (FD) for storing various data. The network I / F 245 is connected to the network and executes communication control processing with other devices connected to the network. The speaker controller 246 controls the speaker 249. The microphone controller 247 controls the microphone 250.

The voice assistant 105 is not limited to the hardware configuration shown in FIG. The voice assistant is a voice operation device that receives a voice input and executes a process corresponding to the input, and for example, in the second embodiment described later, it is also possible to execute a biometric authentication process. In this case, the voice assistant 105 may be equipped with hardware for reading biometric information, such as a camera.

FIG. 5A is a diagram showing an example of the functional configuration of the server 102.
On the server 102, the hotel service 310 operates as an example of the service provided to the user. The hotel service 310 is realized by the CPU 201 reading the program stored in the ROM 203 of the server 102 into the RAM 202 and executing the program.

The hotel service 310 includes a registration processing unit 311, a data storage unit 312, an authenticator information processing unit 313, an authenticator information storage unit 314, a biometric authentication control unit 315, a service processing unit 316, and a communication unit 317. The registration processing unit 311 is a software module that stores data such as user information and a user's accommodation history in the data storage unit 312.

The Authenticator information processing unit 313 is a software module that stores information about the Authenticator 330, which will be described later, in the Authenticator information storage unit 314 using the credentials received by the communication unit 317. Further, the Authenticator information processing unit 313 verifies the assertion information (Assertion) to be described later received by the communication unit 317.

The communication unit 317 is a software module for communicating with an external device such as a voice assistant 105 or a mobile terminal 103 via a network I / F 207. The Authenticator information storage unit 314 is a software module that stores information (Authenticator information) related to the Authenticator 330, which will be described later, in an external memory 210 or an external storage system (not shown) using Table G.

The biometric authentication control unit 315 is a software module that requests biometric authentication from the Authenticator 330 and receives the result of biometric authentication. In the present embodiment, the biometric authentication control unit 315 requests biometric authentication from the Assistant 330 of the mobile terminal 103 via the voice assistant 105. In the present embodiment, the biometric authentication control unit 315 is included in the hotel service 310, but is not limited to this.

For example, the biometric authentication control unit 315 may be configured independently of the hotel service 310, and the hotel service 310 may call the independent biometric authentication control unit 315. In this way, by making the biometric authentication control unit 315 independent from the hotel service 310, it is possible to configure the structure so that not only the hotel service 310 but also other services can call the biometric authentication control unit 315.

The service processing unit 316 is a software module that searches for service information and makes a service reservation in response to a service request received by the communication unit 317. The service processing unit 316 stores information (service provision information) related to service provision, which will be described later, in the data storage unit 312 using Table D.

FIG. 5B is a diagram showing an example of the functional configuration of the mobile terminal 103.
On the mobile terminal 103, the application 320 and the Authenticator 330 operate. The application 320 and the Assistant 330 are realized by the CPU 222 reading the program stored in the ROM 224 of the mobile terminal 103 into the RAM 223 and executing the program.

The application 320 cooperates with the server 102 to provide the user with an authentication function using biometric information and a service of the server 102 in the present embodiment. The application 320 is a native application or a Web browser installed on the mobile terminal 103. The application 320 has a display unit 321 and a communication unit 322, and an authenticator registration control unit 323.

The display unit 321 is a software module that provides the UI of the application installed on the mobile terminal 103 and accepts the user's operation via the touch panel 229. The communication unit 322 is a software module for communicating with an external device such as a server 102 via the network I / F227 or the proximity communication I / F230. The Authenticator registration control unit 323 is a software module that requests the Authenticator 330 to create a credential, which will be described later.

In the present embodiment, the Authenticator registration control unit 323 is included in the application 320, but the present invention is not limited to this. For example, the Authenticator registration control unit 323 may be configured independently of the application 320, and the application 320 may call the independent Authenticator registration control unit 323. Further, the Authenticator registration control unit 313 may be installed as standard in the OS.

In this way, by making the Authenticator registration control unit 323 independent from the application 320, not only the application 320 but also other applications can call the Authenticator registration control unit 323.

The Authenticator 330 is an authentication module for biometric authentication using biometric information read from the biometric information sensor 228. The Authenticator 330 has an Authenticator registration processing unit 331, a biometric authentication processing unit 332, an authentication information storage unit 333, and a biometric information requesting unit 334.

The Authenticator registration processing unit 331 receives a credential creation request from the Authenticator registration control unit 323 or the like of the application 320. It is a software module that creates paired keys (private key and public key) and creates credentials. The biometric authentication processing unit 332 is a software module that receives a biometric authentication request from the biometric authentication control unit 315 of the hotel service 310 and performs biometric authentication using the biometric information read by the biometric information sensor 228.

The authentication information storage unit 333 is a software module that stores authentication information and the like in the TPM 226. The authentication information is, for example, the information shown in Table A described later. The biometric information requesting unit 334 is a software module that provides a UI for accepting input of biometric information to a user via a touch panel 229.

FIG. 5C is a diagram showing an example of the functional configuration of the voice assistant 105.
In the voice assistant 105, the voice service 340 operates. The voice service 340 is realized by the CPU 241 reading the program stored in the ROM 243 of the voice assistant 105 into the RAM 242 and executing the program. The voice service 340 cooperates with the server 102 to provide the service of the server 102 to the user.

The voice service 340 includes a voice receiving unit 341, a voice analysis unit 342, a voice utterance unit 343, a biometric authentication control unit 344, and a communication unit 345. The voice receiving unit 341 is a software module that receives the voice emitted by the user through the microphone 250 included in the voice assistant 105. The voice analysis unit 342 is a software module that analyzes the voice received by the voice receiving unit 341.

The voice utterance unit 343 is a software module that provides voice guidance to the user via the speaker 249 of the voice assistant 105. The biometric authentication control unit 344 is a software module that requests biometric authentication from the Authenticator 330 and receives the result of biometric authentication. The communication unit 345 is a software module for communicating with an external device such as a server 102 or a mobile terminal 103 via a network I / F 245.

Next, various data stored in the mobile terminal 103 and the server 102 will be described.
Table A is an example of data stored in the TPM 226 by the authentication information storage unit 333 of the Assistant 330 possessed by the mobile terminal 103.

In the authentication information management table shown in Table A, one record indicates one authentication information entry. The record of Table A is created when the mobile terminal 103 registers the Authenticator 330 with the hotel service 310 of the server 102, and is added to Table A. In the authentication information ID column, an ID for uniquely identifying each authentication information is stored. In the service ID column, an ID for uniquely identifying the service that uses the authentication function using biometric information is stored.

In this embodiment, the domain name of the service is used as the service ID, and in detail, the information of the top-level domain and the second-level domain is used. For example, when the URL of the hotel service 310 is http: //www.hotel-service.com, the service ID of the hotel service 310 is hotel-service.com. The private key of the created pair of keys is stored in the private key string. The public key (paired) corresponding to the private key is registered in the service shown in the service ID column.

In the biometric information ID column, an ID corresponding to the feature amount of the biometric information is stored. The procedure for storing the information corresponding to each column of the authentication information management table and the procedure for storing the public key in the service will be described later. The authentication information management table shown in Table A is an example, and is not limited to this, and other information may be stored. For example, an ID for the service to uniquely identify the user, which is used in authentication for verifying the match between the conventional user ID and the password in each service, may be stored.

Tables B to G are examples of data stored in the external memory 210 or the like by the data storage unit 312 and the authenticator information storage unit 314 of the hotel service 310 of the server 102.

The user information management table shown in Table B is data managed by the data storage unit 312 of the hotel service 310. In the user information management table, one record represents one user information. In the user ID column, an ID for uniquely identifying the user of the hotel service 310 is stored. The password column stores the password for authenticating the user. The password is specified when the user registers with the hotel service 310. In addition, the user information management table may also store attribute information about the user requested at the time of hotel check-in, such as the user's name, address, age, and occupation.

The accommodation history management table shown in Table C is data managed by the data storage unit 312 of the hotel service 310. In the accommodation history management table, one record shows one accommodation information of one user. In the user ID column, the value of the user ID column of the user information managed in the user information management table (Table B) is stored. In addition, the accommodation history management table stores the check-in date and time, the check-out date and time, the room number of the room where the guest stayed, and the ID for identifying the voice assistant installed in the room where the guest stayed, as one-time accommodation information. ..

The service information management table shown in Table D is data managed by the data storage unit 312 of the hotel service 310. In the service information management table, one record shows one service provision status to one user. In the user ID example, the same values as the user ID columns in Table B and Table C described above are stored. In addition, the service information management table stores the following items as information for specifying the service to be provided to the user. That is, information such as a service ID indicating the content of service provision, service details, the date and time when the service was provided, and if the service is a service accompanied by payment, the amount of money, payment information, and the like are stored.

The association information management table shown in Table E is data managed by the data storage unit 312 of the hotel service 310. The associating information management table associates the voice assistant 105 installed in the room where the user stayed with the mobile terminal 103 owned by the user, and the Ausienticator 330 registered in the hotel service 310.

As an example, the case where one voice assistant 105 is installed in one room will be described. A voice assistant 105a is installed in Room 104a. When the user staying at Room 104a registers the Authenticator 330 in the Authenticator registration process described later, the ID of the voice assistant 105a and the registered Authenticator ID are stored in association with each other.

In some cases, two or more users may use the voice assistant 105 in one room. In this case, the Authenticator is registered for the Authenticator 330 of the mobile terminal 103 owned by each user. Then, two or more Assistants 330 are associated and registered in the association information management table with respect to one assistant 105.

The attestation challenge management table shown in Table F is data managed by the data storage unit 312 of the hotel service 310. In the attestation challenge management table, one record shows the information of one attestation challenge. The attestation challenge is a parameter used as verification data for performing challenge response authentication, and is issued for each user.

The issuance process of the attestation challenge will be described later. The value of the attestation challenge is stored in the attestation challenge column. In the user ID column, the user ID of the user who issued the attestation challenge is stored. The expiration date of the attestation challenge is stored in the expiration date column.

The Authenticator information management table shown in Table G is data managed by the Authenticator information storage unit 314 of the hotel service 310. In the Authenticator information management table, one record indicates one Authenticator information. When the Authenticator 330 is registered in the server 102, the record is added to the Authenticator information management table.

In the authentication information ID column, the value of the authentication information ID column of the authentication information managed by the registered Assistant 330 in the authentication information management table (Table A) is stored. In the public key string, the public key (paired) corresponding to the private key created by the Authenticator 330 and managed in the authentication information management table (Table A) is stored.

That is, in the private key and the public key having the same authentication information ID value in the authentication information management table (Table A) and the attendantor information management table (Table G), the data encrypted with the private key in Table A is shown in Table G. It means that it can be decrypted with the public key of. In the user ID column, an ID for the hotel service 310 to uniquely identify the user is stored.

Next, with reference to FIG. 6, a process of starting the use of the hotel service 310 when a new guest (user) of the hotel checks in to the hotel will be described.
In the process of starting the use of the hotel service 310, the process of registering the Assistant 330 of the mobile terminal 103 owned by the user to the server 102 is executed.

Hereinafter, the case of registering the Authenticator 330 of the mobile terminal 103 will be described, but the same applies even when the voice assistant 105 has the Authenticator. Registering the information of Authenticator 330 in the server 102 is simply called registration of Authenticator.

In order to use the hotel service 310, the user shall install the application 320 linked with the hotel service 310 on the mobile terminal 103 in advance. Alternatively, in the Web browser of the mobile terminal 103, the URL of the Web service provided by the hotel service 310 may be specified to display the service screen for using the hotel service 310.

Hereinafter, a case where the user executes a process of starting the use of the hotel service 310 by using the application 320 of the mobile terminal 103 will be described. First, the application 320 displays the check-in screen by the operation of the user. Specifically, the check-in screen is displayed by operating the menu display (not shown) of the application 320.

FIG. 9 is an example of a check-in screen displayed by the display unit 321 of the application 320.
The user inputs attribute information about the user required for hotel check-in, such as name, address, age, occupation, and a password used in the hotel service 310.

Returning to the description of FIG. In step S401, when the application 320 receives the input of the user information, the application 320 transmits the user registration request to the hotel service 310 via the communication unit 322. The request includes attribute information and a password entered by the user. The communication unit 317 of the hotel service 310 receives the request transmitted from the application 320 in step S401.

In step S402, the registration processing unit 311 of the hotel service 310 issues a user ID, and stores the user information including the user ID in the user information management table (Table B) of the data storage unit 312. The user information includes the attribute information and the password received in step S401. In step S403, the authenticator information processing unit 313 of the hotel service 310 transmits a credential creation request to the application 320 via the communication unit 317.

Hereinafter, the parameters included in the credential creation request will be described.
The parameters included in the credential creation request consist of account information, encryption parameters, attribution challenge, and authentication extension area. In the account information, the user ID registered in step S402 in the hotel service 310 and the attribute information associated with the user ID are stored.

The encryption parameter stores attribute information related to the authentication information to be registered, such as an encryption algorithm supported by the hotel service 310. Verification data used for challenge-response authentication is stored in the attestation challenge. The verification data, that is, the attribution challenge is created when the parameters included in the credential creation request are created in step S402.

Then, the created attribution challenge is stored in the attribution challenge management table (Table F) in association with the user ID, the expiration date, and the like. Extension parameters that can be specified by the hotel service 310 are stored in the authentication extension area. For example, the authentication extension area stores parameters for controlling the operation of the Authenticator 330 and the like.

Returning to the description of FIG. The communication unit 322 of the application 320 receives the credential creation request transmitted in step S403. Upon receiving the credential creation request, the display unit 321 of the application 320 displays a biometric information registration screen asking the user to input biometric information using biometric authentication.

FIG. 10 is an example of the biometric information registration screen.
On the biometric information registration screen, the user is urged to input biometric information in order to register the Authenticator 330 in the hotel service 310. The button 721 is a button for reading biometric information such as a fingerprint, and includes a biometric information sensor 228. Information such as veins, irises, voiceprints, and facial images can be used as biological information, and is not limited to any of them.

Here, the mobile terminal 103 is configured so that any one of the biometric information or a combination of any plurality of biometric information is input as the biometric information used for biometric authentication. Further, in the present embodiment, the input of biometric information is requested at the time of such check-in, but the present invention is not limited to this. For example, when checking in, biometric information may not be required to be input, and biometric authentication may be performed later when biometric authentication is actually required.

When the biometric information is read by the biometric information sensor 228 on the biometric information registration screen, the authenticator registration control unit 323 of the application 320 passes the biometric information to the authenticator 330 and requests the creation of credentials. At this time, the request includes, in addition to the read biometric information, the parameters included in the credential creation request received from the hotel service 310 in step S403, and the service ID.

The service ID is an ID for uniquely identifying the service to be registered in the Authenticator 330 described in the authentication information management table (Table A). In this case, the service ID of the hotel service 310 will be included. Further, an application ID or the like, which is an ID for uniquely identifying the application 320 used when registering the Assistant 330 in the hotel service 310, may be included.

Returning to the description of FIG. In step S404, the biometric authentication processing unit 332 of the Assistant 330 creates a biometric information ID for uniquely identifying the feature amount of the biometric information received from the application 320 and the biometric information. The feature amount of biometric information is obtained by converting what is unique to an individual such as a fingerprint pattern, an iris pattern, a vein shape, and a voiceprint into a value that does not impair the uniqueness. In biometric authentication, an individual is identified by using the feature amount unique to the individual.

In step S405, the Authenticator registration processing unit 331 creates an authentication information ID for uniquely identifying the pair of the private key and the public key and the authentication information. Then, the Authenticator registration processing unit 331 stores the following information in the authentication information management table (Table A) stored in the TPM 226 via the authentication information storage unit 333. That is, the biometric information ID created in step S404, the private key and authentication information ID created in step S405, and the service ID to be registered by the Authenticator are stored.

In the present embodiment, as the service ID, the service ID of the hotel service 310 included in the request for creating the credential received by the Authenticator 330 from the application 320 is stored. In step S406, the Authenticator registration processing unit 331 creates the credentials.

Hereinafter, the credentials will be described.
The credential consists of an authentication information ID, an algorithm, a public key, and an attestation. The authentication information ID is an authentication information ID created in step S405 and stored in the authentication information management table (Table A). The public key is the public key of the key pair created in step S405.

The algorithm used when creating the key pair in step S405 is stored in the algorithm. Further, the attestation is data obtained by encrypting the attestation challenge of the parameter included in the credential creation request received in step S403 using the private key generated in step S405. The Authenticator registration processing unit 331 passes the credential created in step S406 and the Authenticator ID that identifies its own Authenticator 330 to the application 320.

In step S407, the communication unit 322 of the application 320 transmits the credential and the Authenticator ID received from the Authenticator 330 to the hotel service 310. In step S408, the authenticator information processing unit 313 of the hotel service 310 performs the registration process of the authenticator 330 using the received credentials.

Hereinafter, the credential registration process executed by the Authenticator information processing unit 313 will be described.
First, the Authenticator information processing unit 313 decodes the attribution included in the credential with the public key included in the same credential, and verifies that the registration request is not an illegal one.

Further, the Authenticator information processing unit 313 identifies a record having the same value in the attribution challenge column as the value obtained by decrypting the attachment with the public key in the attachment challenge management table (Table F). Then, the Authenticator information processing unit 313 sets the user ID of the specified record as the user ID associated with the credential.

Then, the Authenticator information processing unit 313 stores (registers) the authentication information ID and the public key included in the credential and the user ID associated with the credential in the Authenticator information management table (Table G).

Returning to the description of FIG. In step S409, the registration processing unit 311 associates and stores the voice assistant 105 installed in the room where the user stays in the association information management table (Table E) and the Authenticator ID received in step S407. do. Finally, the communication unit 317 of the hotel service 310 notifies the application 320 of the mobile terminal 103 that the registration process of the Authenticator has been completed normally.

Next, with reference to FIG. 7, a process in which the user uses the hotel service 310 via the voice assistant 105 will be described.
The user requests the voice assistant 105 to use the hotel service 310 by utterance (voice). For example, if you want room service, make a request by saying "Tell me a list of room service."

The room service is an example of the service provided by the hotel service 310, and is not limited to this. By using the hotel service 310, it is possible to reserve tickets, taxis, and the like. In addition, by using the hotel service 310, it is possible to make a notification that the room in which the hotel is staying does not need to be cleaned.

In step S501, the voice receiving unit 341 of the voice service 340 included in the voice assistant 105 receives a voice service provision request from the user. In step S502, the voice analysis unit 342 analyzes the received voice and determines the content of the request. In step S503, the communication unit 345 transmits the processing request analyzed in step S502 to the hotel service 310.

The communication unit 317 of the hotel service 310 receives the request from the voice assistant 105. In step S504, the service processing unit 316 of the hotel service 310 executes processing according to the received request. Specifically, first, the service processing unit 316 determines whether or not user authentication is required when executing the received request. The necessity of user authentication is set in advance when registering information about the service in the hotel service 310.

For example, a request accompanied by payment is set to require user authentication. When the service processing unit 316 determines that user authentication is not required when executing the request, the service processing unit 316 executes the process according to the request without requesting the user authentication. Here, the case where the content of the request is "Tell me the list of room service" will be described. That is, a list of available room services may be sent to the requesting voice assistant 105.

Since this request does not involve payment, the service processing unit 316 determines that user authentication is not required. Then, the service processing unit 316 searches for room service as a process according to the request "tell me the list of room service". The process when user authentication is required will be described later in step S510.

In step S505, the service processing unit 316 returns the list of room services to the voice assistant 105 via the communication unit 317. At this time, the service processing unit 316 searches the service information management table (Table D) for the past order history of the user's room service associated with the requesting voice assistant 105, and obtains recommended room service proposal information. You may return it together.

The communication unit 345 of the voice service 340 receives a list of room services from the hotel service 310. In step S506, the voice utterance unit 343 of the voice service 340 guides the user to the list of received room services by voice. The user further orders a specific menu of room service from the voice assistant 105 by utterance (voice). That is, a request is made to the hotel service 310.

Since the processing of steps S507 to S509 in which the voice assistant 105 receives the request and transmits the user's request to the hotel service 310 is the same as the processing of steps S501 to S503, the description thereof will be omitted. In step S510, the service processing unit 316 of the hotel service 310 executes processing according to the received request. Specifically, the service processing unit 316 determines whether or not user authentication is required when executing the received request, as in step S504.

Here, since the content of the request is an order for a specific menu of room service and is a request accompanied by payment, the service processing unit 316 determines that user authentication is required. Therefore, in step S511, the Authenticator information processing unit 313 of the hotel service 310 requests the voice assistant 105 for user authentication, that is, biometric authentication via the communication unit 317. At this time, the Authenticator information processing unit 313 creates a biometric authentication parameter and includes the generated biometric authentication parameter in the request.

Hereinafter, biometric authentication parameters will be described.
The biometric authentication parameter is data used by the hotel service 310 to authenticate the application 320. The biometric parameter consists of an Assertion challenge and an Assertion extension area. The Assertion challenge stores verification data used for challenge-response authentication.

In the Assertion extension area, extension parameters that can be specified by the hotel service 310 that the hotel service 310 uses to control the operation of the Assistant 330 and the like are stored. For example, the authentication extension area stores parameters for controlling the operation of the Authenticator 330 and the like.

Returning to the description of FIG. In step S511, when the Authenticator information processing unit 313 of the hotel service 310 makes a biometric authentication request to the voice assistant 105 via the communication unit 317, the following information is further included in the request. That is, the Authenticator information processing unit 313 includes the Authenticator ID that identifies the Authenticator 330 associated with the requesting voice assistant 105 in the association information management table (Table E).

In addition, the Authenticator information processing unit 313 includes information such as an order amount in the request. At this time, the Authenticator information processing unit 313 may include the proposal information recommended for the relevant user in the request. For example, the Authenticator information processing unit 313 identifies the user information of the room (Room 104) corresponding to the requesting voice assistant 105 from the accommodation history management table (Table C) via the service processing unit 316.

Then, the Authenticator information processing unit 313 acquires the past service history of the relevant user from the service information management table (Table D) based on the user information, and includes recommended proposal information for the relevant user in the request. In addition, the Authenticator information processing unit 313 may include user-independent service advertising information and the like in the request.

In step S512, the biometric authentication control unit 344 of the voice service 340 identifies the authenticator 330 to be notified of the biometric authentication request from the authenticator ID included in the request received in step S511. In step S513, the biometric authentication control unit 344 requests the mobile terminal 103 for biometric authentication. The biometric authentication request includes the Out biometric authentication parameter.

Hereinafter, the Out biometric authentication parameters included in the biometric authentication request transmitted from the voice assistant 105 to the mobile terminal 103 will be described.
The Authenticator biometric authentication parameter includes the biometric authentication parameter created by the Authenticator information processing unit 313 of the hotel service 310 in step S511 described above and transmitted from the hotel service 310 to the voice assistant 105. In addition, the Out biometric parameters include the service ID and Web Origin.

The service ID stores information on the top-level domain and the second-level domain of the hotel service 310. For example, if the URL of the hotel service 310 is http: //www.hotel-service.com, the service ID is hotel-service.com. The Web Origin is a combination of a protocol, a host name, and a port, and in the present embodiment, the Origin of the hotel service 310 is stored.

Returning to the description of FIG. When the mobile terminal 103 receives the biometric authentication request in step S514, the biometric authentication process is executed. Hereinafter, the biometric authentication process executed by the mobile terminal 103 will be described.
When the mobile terminal 103 receives the biometric authentication request, the display unit 321 of the application 320 displays the biometric information input request screen.

FIG. 11 is an example of a biometric information input request screen displayed by the display unit 321 of the application 320.
On the biometric information input request screen, the user is urged to input biometric information in order to execute biometric authentication on the mobile terminal 103. In the present embodiment, the display unit 321 of the application 320 displays the biometric information input request screen, but the Authenticator 330 may have a display unit (not shown) to display the screen.

The button 811 is a button for reading biometric information, and includes a biometric information sensor 228. On the biometric information input request screen, various information included in the biometric authentication request from the hotel service 310 to the voice assistant 105 in step S511 is also displayed. For example, information such as the amount of the menu ordered by the user, recommended proposal information for the user, promotion information of other services, and the like.

When the biometric information is read by the biometric information sensor 228 on the biometric information input request screen, the Authenticator registration control unit 323 of the application 320 passes the biometric information to the Authenticator 330 and makes an authentication request. The Authenticator registration control unit 323 includes the Authenticator biometric authentication parameter received from the voice assistant 105 in step S513 in the authentication request.

The biometric authentication processing unit 332 of the Authenticator 330 acquires the feature amount of the received biometric information. The biometric authentication processing unit 332 identifies a record from the authentication information management table (Table A) managed by the authentication information storage unit 333 based on the acquired feature amount. Specifically, since the biometric information ID indicated by the feature amount is specified, the authentication information ID and the private key corresponding to the biometric information are specified in the authentication information management table (Table A).

That is, the Assistant 330 executes biometric authentication, and if the authentication is successful, the private key is taken out. In Table A, it may be verified whether the service ID included in the Out biometric authentication parameter matches as well as the feature amount. Then, the biometric authentication processing unit 332 creates a signature in which the Assertion challenge included in the Out biometric authentication parameter is encrypted using the specified private key. Further, the biometric authentication processing unit 332 creates Assertion information including the specified authentication information ID and the created signature.

In step S515, the biometric authentication processing unit 332 returns the created Assertion information to the voice assistant 105. In step S516, the communication unit 345 of the voice service 340 returns the Assertion information received in step S515 to the hotel service 310.

If the result of the biometric authentication process in step S514 is authentication failure, or if the user does not input the biometric information for a certain period of time, the display unit 321 of the application 320 displays the biometric information input request screen. Displays that the process cannot be authenticated and the process is terminated. Then, in steps S515 and S516, information indicating that the result of the biometric authentication process is authentication failure is returned. When the hotel service 310 receives the information indicating that the authentication has failed, the hotel service 310 ends the process of FIG. 7.

In step S517, the Authenticator information processing unit 313 of the hotel service 310 verifies the Assertion information received in step S516. Specifically, the Authenticator information processing unit 313 verifies whether it matches the Assertion challenge included in the authentication parameter 810 created in S707. The authenticator information management table (Table E) is used to specify the public key.

The signature included in the Assertion information is decrypted using the public key specified by the authentication ID included in the Assertion information. The Authenticator information management table (Table G) is used to specify the public key. Then, it is verified whether the decoded value matches the Assertion challenge included in the biometric authentication parameter created in step S510.

If the decrypted value does not match the Assertion challenge included in the biometric authentication parameter created in step S510, the service processing unit 316 of the hotel service 310 returns information indicating that the user authentication has failed to the voice assistant 105. do. Then, the service processing unit 316 ends the processing. Upon receiving the information indicating that the user authentication has failed, the voice utterance unit 343 of the voice service 340 notifies the user by voice that the request received in step S507 has not been executed.

On the other hand, if the decoded value matches the Assertion challenge included in the biometric authentication parameter created in step S510, the process proceeds to step S518. In step S518, the service processing unit 316 of the hotel service 310 provides the service according to the request received in step S507, and confirms the order of the room service menu here.

The service processing unit 316 stores information for the confirmed service in the service information management table (Table D). Since the settlement is performed collectively at the time of check-out, the settlement information in the service information management table stores data indicating that the settlement is incomplete. Then, the service processing unit 316 requests the person in charge of the corresponding service to provide the service.

In step S519, the service processing unit 316 transmits to the voice assistant 105 the acceptance result of the service provision request received from the voice assistant 105 in step S509. In step S520, the voice utterance unit 343 of the voice service 340 notifies the user of the reception result received in step S519 by voice.

Next, with reference to FIG. 8, a process of terminating the use of the hotel service 310 when a hotel guest (user) checks out from the hotel will be described.
In the process of terminating the use of the hotel service 310, the deregistration process of the hotel service 310 of the Assistant 330 owned by the user's mobile terminal 103 is executed.

First, the user displays the checkout screen by the user's operation of the application 320 of the mobile terminal 103. Specifically, the checkout screen is displayed by operating the menu display (not shown) of the application 320.

FIG. 12 is an example of a checkout screen displayed by the display unit 321 of the application 320.
The check-out screen displays the usage fee of the service received by the user during the stay at the hotel. When the application 320 receives a display instruction on the checkout screen by the user's operation, the application 320 inquires of the hotel service 310 via the communication unit 322 about the content of the service received while the user is staying at the hotel.

The hotel service 310 acquires the content of the service received by the corresponding user from the service information management table (table D) stored in the data storage unit 312, and transmits it to the application 320. Based on the content of the received service, the application 320 calculates, for example, the total amount of the service received by the corresponding user in the service information management table, and displays it on the checkout screen as a usage fee. On the check-out screen, the user confirms the content of the service received and the usage fee, and processes the payment at the front desk of the hotel.

The checkout screen has a means for selecting whether or not to retain the biometric authentication information. Biometric information is various types of information associated with biometric information. In the example shown in FIG. 12, whether or not to retain the biometric authentication information can be selected in the check box. When the user chooses to retain the biometric authentication information, the registration process (S403 to S408) of the Assistant 330 to the server 102 is performed in the process of starting the use of the hotel service 310 shown in FIG. 6 at the next stay. It can be omitted.

If the user who chooses to retain the biometric information stays at the same hotel next time, the user will see the user ID issued at the time of previous check-in on the check-in screen of FIG. 9 at the time of check-in. Just enter the password you set earlier. As the user ID, the one issued in step S402 of FIG. 4 executed at the time of the previous check-in is used.

As a result, the registration processing unit 311 of the hotel service 310 collates with the existing user information using the user information management table (Table B), and determines that the user is the same person as the user of the record whose user ID and password match. to decide. Then, the registration processing unit 311 of the hotel service 310 determines whether or not a record having the corresponding user ID exists in the Authenticator information management table (Table G).

When a record having the corresponding user ID exists, the registration processing unit 311 omits the processing of steps S403 to S408 in FIG. When the "OK" button on the checkout screen is pressed, the application 320 is instructed to execute the process (checkout process) for terminating the use of the hotel service 310, and the execution of the process shown in FIG. 8 starts. Will be done.

Returning to the description of FIG. In step S601, when the application 320 receives the execution instruction of the checkout process by the user, the application 320 sends a checkout request to the hotel service 310. The request includes the selection result of whether or not to retain the biometric authentication information selected by the user on the checkout screen.

In the subsequent steps S602 to S603, the registration information about the user of the mobile terminal 103 stored in the server 102 is updated. First, in step S602, the registration processing unit 311 of the hotel service 310 releases the association between the voice assistant 105 installed in the room where the user has stayed and the Austinicator 330 of the mobile terminal 103. That is, the record in which the voice assistant 105 stored in the association information management table (Table E) is associated with the Authenticator ID for identifying the corresponding Authenticator 330 is deleted.

In step S603, the registration processing unit 311 deletes the following records when it is selected not to retain the biometric authentication information on the checkout screen. That is, the record of the corresponding user in the attitude challenge management table (table F) and the authenticator information management table (table G) is deleted. The records of the corresponding users in the user information management table (Table B), accommodation history management table (Table C), and service information management table (Table D) are for improving the service when the same user next stays. Do not delete it, but keep it.

In step S604, the registration processing unit 311 returns the information indicating that the checkout process is completed to the application 320 of the mobile terminal 103. The information indicating that the checkout process is completed includes the selection result of whether or not to retain the biometric authentication information selected by the user on the checkout screen.

In step S605, application 320 requests the Authenticator 330 to delete the record for the hotel service 310 in the authentication information management table (Table A) if it is selected not to retain the biometric information. Upon receiving the request to delete the record from the application 320, the Authenticator registration processing unit 331 of the Authenticator 330 deletes the corresponding record. That is, the record related to the hotel service 310 in the authentication information management table (Table A) stored in the TPM 226 via the authentication information storage unit 333 is deleted.

As described above, according to the present embodiment, it is possible to provide a secure authentication method without registering biometric authentication information in a device placed in a place used by an unspecified number of people.

[Second Embodiment]
In the first embodiment, various processes executed when a hotel guest uses a service provided by the hotel such as room service by using a voice assistant have been described. On the other hand, in the present embodiment, the case where the guest uses the voice assistant to use the service provided by another external system outside the hotel, that is, different from the server 102 will be described.

In the present embodiment, the same reference numerals are given to the same devices in the configuration of each device and the procedures of various processes according to the first embodiment, and the description thereof will be omitted. In this embodiment, a case where the music distribution service 107 is used as an example of the service outside the hotel will be described. The music distribution service 107 is connected to the voice assistant 105 via the network 101. Further, the music distribution service 107 is connected to the mobile terminal 103 via the network 106.

It is assumed that the user has contracted with the music distribution service 107 in advance in order to receive the service with the voice assistant at home, has acquired an ID and a password from the service, and has registered as a user in the service. That is, the service is a service dedicated to the authenticated user. Further, it is assumed that the music distribution service 107 corresponds to the same authentication method as the hotel service 310 described in the first embodiment.

That is, the music distribution service 107 has a mechanism for performing biometric authentication on the device in the user's hand in order to authenticate the user, and the service authenticates the user based on the result. Then, it is assumed that the user has previously registered information associated with biometric authentication using the mobile terminal 103, such as authentication identification information and a public key, in the music distribution service 107.

FIG. 13 is a diagram illustrating a process of using the music distribution service 107 via the voice assistant 105 in the room where the guest (user) of the hotel stays.
The user requests the voice assistant 105 to use the music distribution service 107 by utterance (voice). For example, when music distribution is desired, the request is made by saying "play a song on a music distribution service".

In step S1001, the voice receiving unit 341 of the voice service 340 included in the voice assistant 105 receives a voice service provision request from the user. In step S1002, the voice analysis unit 342 analyzes the received voice and determines the content of the request. In step S1003, the communication unit 345 transmits the processing request analyzed in step S1002 to the music distribution service 107.

When the music distribution service 107 receives a request from the voice assistant 105, the music distribution service 107 executes a process according to the received request in step S1004. Here, it is assumed that user authentication is required when receiving the service provided by the music distribution service. Therefore, in step S1005, the music distribution service 107 requests the voice assistant 105 for user authentication.

The user authentication here uses the authentication mechanism (FIG. 7) used by the hotel service 310 in the first embodiment. Specifically, biometric authentication is performed on the device in the user's hand, and the user is authenticated based on the result. That is, in step S1005, the music distribution service 107 requests the voice assistant 105 for biometric authentication.

At this time, the music distribution service 107 includes the generated biometric authentication parameter in the request, as in the process of step S511 of FIG. In addition, the music distribution service 107 may include other information in the request. For example, any information may be included, such as promotional information and various information regarding fees.

In step S511 of FIG. 7, when the hotel service 310 transmits the user authentication request, the authenticator ID that identifies the authenticator 330 associated with the voice assistant 105 is transmitted together with the biometric authentication parameter. However, since the music distribution service 107 does not hold information such as the association information management table (Table E), information corresponding to this is not transmitted.

Therefore, in the present embodiment, the voice assistant 105 performs a process for identifying the Assistant 330, which is the notification destination of the biometric authentication request. In step S1006, the biometric authentication control unit 344 of the voice service 340 inquires the hotel service 310 about the Assistant 330 of the mobile terminal 103 to be notified of the biometric authentication request.

In step S1007, the service processing unit 316 of the hotel service 310 identifies the Assistant 330 of the mobile terminal 103 associated with the requesting voice assistant 105 in the association information management table (Table E). Then, in step S1008, the service processing unit 316 returns the Authenticator ID indicating the Authenticator 330 specified in the voice assistant 105.

In step S1009, the biometric authentication control unit 344 of the voice service 340 identifies the authenticator 330 to be notified of the biometric authentication request from the authenticator ID included in the result of the inquiry received in step S1008. Then, the biometric authentication control unit 344 requests the mobile terminal 103 for biometric authentication. The biometric authentication request includes the Auto biometric authentication parameter described in the first embodiment.

Since the biometric authentication process executed in steps S1010 to S1013 is the same as the process of steps S514 to S517 of the first embodiment, the description thereof will be omitted. If the user authentication is successful as a result of the verification of the Assertion information executed in step S1013, the music distribution service 107 starts providing the service to the voice assistant 105 in step S1014. That is, the music distribution service 107 distributes music data to the voice assistant 105.

On the other hand, if the user authentication fails as a result of the verification of the Assertion information executed in step S1013, the music distribution service 107 returns the information indicating that the user authentication has failed to the voice assistant 105, and ends the process. .. Upon receiving the information indicating that the user authentication has failed, the voice utterance unit 343 of the voice service 340 notifies the user by voice that the request received in step S1001 has not been executed. In step S1015, the voice utterance unit 343 of the voice service 340 plays music according to the provision of the service from the music distribution service 107.

<Modification 1 of the second embodiment>
With reference to FIG. 14, a modified example of the process (FIG. 13) of using the music distribution service via the voice assistant 105 in the room where the guest (user) of the hotel stays will be described. In the process shown in FIG. 13, a service provision request was made to the music distribution service 107 via the voice assistant 105 (S1003).

On the other hand, in the modified example shown in FIG. 14, a request is made to the music distribution service 107 directly from the mobile terminal 103 without going through the voice assistant 105. The request for providing the service is, for example, a request for designating a song name and acquiring music data from the music distribution service 107.

The mobile terminal 103 installs an application provided by the music distribution service 107 that cooperates with the music distribution service 107, and makes a request for service provision using the application. Alternatively, in the Web browser of the mobile terminal 103, the service provision may be requested via the service screen for using the music distribution service 107 by designating the URL of the Web service provided by the music distribution service 107. Hereinafter, the application provided by the music distribution service 107 linked with the music distribution service 107 will be referred to as a linked application.

In step S1021, the linked application of the mobile terminal 103 requests the music distribution service to provide the service according to the instruction from the user. In step S1022, the music distribution service 107 receives a processing request from the mobile terminal 103, and executes processing according to the received request. Here, it is assumed that user authentication is required when receiving the service provided by the music distribution service. Therefore, in step S1023, the music distribution service 107 requests the voice assistant 105 for user authentication.

The user authentication here uses the authentication mechanism (FIGS. 7 and 13) used by the hotel service 310 and the music distribution service 107 in the first embodiment and the second embodiment. Specifically, biometric authentication is performed on the device in the user's hand, and the user is authenticated based on the result. That is, in step S1023, the music distribution service 107 requests the mobile terminal 103 for biometric authentication.

In step S1024, the mobile terminal 103 executes the biometric authentication process. Since the biometric authentication process is the same as the process described in the first embodiment and the second embodiment, the description thereof will be omitted. In step S1025, the mobile terminal 103 returns the Assertion information to the music distribution service 107. In step S1026, the music distribution service 107 verifies the Assertion information received in step S1025.

If the user authentication is successful as a result of the verification of the Assertion information, the music distribution service 107 starts providing the service to the mobile terminal 103 in step S1027. That is, the music distribution service 107 distributes the music data requested in step S1021 to the mobile terminal 103.

On the other hand, if the user authentication fails as a result of the verification of the Assertion information, the music distribution service 107 returns the information indicating that the user authentication has failed to the mobile terminal 103, and ends the process. Upon receiving the information indicating that the user authentication has failed, in step S1028, the mobile terminal 103 transfers the music data to the voice assistant 105 installed in the room where the user of the mobile terminal 103 stays. Then, the user makes a request to the voice assistant 105 by utterance (voice). For example, the name of the song transferred in step S1028 is specified, and a request is made to play the music.

In step S1029, the voice receiving unit 341 of the voice service 340 of the voice assistant 105 receives the voice request from the user. In step S1030, the voice analysis unit 342 analyzes the received voice and determines the content of the request. In step S1031, the voice uttering unit 343 plays music according to the analyzed request content.

<Modification 2 of the second embodiment>
FIG. 15 will be described with reference to another modification of the process (FIG. 13) of using the music distribution service via the voice assistant 105 in the room where the guest (user) of the hotel is staying. In the first embodiment, when the music distribution service 107 authenticates the user, biometric authentication is performed on the mobile terminal 103 as a device in the user's hand, and the user is authenticated based on the result. On the other hand, in the modified example shown in FIG. 15, the voice assistant 105 is used as a device at the user's hand, and biometric authentication is performed on the voice operation device.

The music distribution service 107 and the hotel service 310 are linked, and the guest can use the service of the music distribution service 107 in the hotel room. For example, it is assumed that music data is distributed from the music distribution service 107 to the voice assistant 105, and the voice assistant 105 can play the distributed music.

The music distribution service 107 confirms that the content of the service provision request from the voice assistant 105 of the linked hotel and the user who made the service provision request are the correct guests, and sends music data to the voice assistant 105. To deliver. For this, user authentication is performed using the authentication mechanism performed in the first embodiment and the second embodiment. Specifically, biometric authentication is performed on the device in the user's hand, and the user is authenticated based on the result.

However, the difference from the first embodiment and the second embodiment is that the voice assistant 105 is used instead of using the mobile terminal 103 as the device at the user's hand. Information that identifies the voice assistant 105 used in the hotel is registered (stored) in the music distribution service 107 in advance.

When the user checks in at the hotel, the voice assistant 105 registers the biometric authentication information. In the first embodiment, the biometric authentication information is registered by the same process as the registration process (S403 to S408) of the Assistant 330 possessed by the mobile terminal 103 to the server 102 when checking in to the hotel.

In this modification, similarly to the mobile terminal 103, the voice assistant 105 has the Authenticator 330, and the Authenticator 330 possessed by the voice assistant 105 executes the processes of steps S403 to S408 described above. As a result, the biometric information of the user is stored in the voice assistant 105. The biometric information may be any as in the other embodiments. For example, here, it is voiceprint information. The guest (user) talks to the voice assistant 105, and the voiceprint information is registered in the voice assistant 105.

When the user wants to receive the service provision from the music distribution service 107, the user requests the voice assistant 105 to provide the service by utterance (voice). For example, a request is made to specify a song name and play music.

In step S1041, the voice receiving unit 341 of the voice service 340 of the voice assistant 105 receives the voice request from the user. In step S1042, the voice analysis unit 342 analyzes the received voice and determines the content of the request. In step S1043, the communication unit 345 transmits the processing request analyzed in step S1042 to the music distribution service 107.

When the music distribution service 107 receives a request from the voice assistant 105, the music distribution service 107 executes a process according to the received request in step S1044. Specifically, first, the music distribution service 107 determines whether or not user authentication is required when executing the received request. It is assumed that the necessity of user authentication is set in advance in the music distribution service 107.
For example, it is determined that user authentication is not required for a request to acquire a music list, and user authentication is required for a request to play music.

Here, since the content of the request is music reproduction, the music distribution service 107 determines that user authentication is required. Therefore, in step S1045, the music distribution service 107 requests the voice assistant 105 for user authentication, that is, biometric authentication. At this time, the music distribution service 107 creates a biometric authentication parameter and includes the generated biometric authentication parameter in the request, as in the case of the first embodiment. As described above, the biometric authentication parameter includes an Assertion challenge, which is verification data used for performing challenge-response authentication.

Upon receiving the biometric authentication request, the voice assistant 105 executes the biometric authentication process in step S1046. In the biometric authentication process performed by the voice assistant 105, the voice utterance unit 343 of the voice service 340 notifies the user by voice that biometric authentication is to be performed, and requests input of biometric information. For example, the voice utterance unit 343 notifies by voice that "Voiceprint authentication is performed. Please speak something." And prompts the input of biometric information.

In step S1046, when the voice assistant 105 receives the voice from the user, the voice assistant 105 executes the biometric authentication process based on the voiceprint information of the received voice. The voice assistant 105 has the same function as the Authenticator 330 in the mobile terminal 103 described in the first embodiment. Then, in step S1046, the voice assistant 105 performs the same processing as the biometric authentication process (S514) executed by the mobile terminal 103 shown in FIG.

If the result of the biometric authentication process in step S1046 is successful, the voice assistant 105 returns the Assertion information created in step S1047 to the music distribution service 107. The Assertion information includes a signature created by using the secret key stored in association with the biometric information as a result of the biometric authentication process and the Assertion challenge included in the Assertion biometric authentication parameter received in step S1045.

If the result of the biometric authentication process in step S1046 is authentication failure, or if the biometric information is not input from the user for a certain period of time, the voice utterance unit 343 of the voice service 340 cannot authenticate the user and processes. Notify the user by voice that the process is finished. Then, in step S1047, the information indicating that the result of the biometric authentication process is the authentication failure is returned. When the music distribution service 107 receives the information indicating that the authentication has failed, the music distribution service 107 ends the process of FIG.

In step S1048, the music distribution service 107 verifies the Assertion information received in step S1047. Since the verification of Assertion is the same as the process executed by the hotel service 310 in S517 of FIG. 7 in the first embodiment, the description thereof will be omitted.

If the user authentication is successful as a result of the verification of the Assertion information executed in step S1048, the music distribution service 107 starts providing the service to the voice assistant 105 in step S1049. That is, the music distribution service 107 distributes music data to the voice assistant 105.

On the other hand, if the user authentication fails as a result of the verification of the Assertion information executed in step S1048, the music distribution service 107 returns the information indicating that the user authentication has failed to the voice assistant 105, and ends the process. .. Upon receiving the information indicating that the user authentication has failed, the voice utterance unit 343 of the voice service 340 notifies the user by voice that the request received in step S1041 has not been executed.

In step S1050, the voice utterance unit 343 of the voice service 340 plays music according to the service provided by the music distribution service 107. In this modification, an example of registering biometric information in the voice assistant 105 has been described, but the present invention is not limited to this. For example, the server 102 may have an Assistant 330, and the biometric information of the user may be stored in the server 102.

In that case, when the voice assistant 105 receives the voice from the user in step S1046, the voiceprint information of the received voice is transmitted to the hotel service 310. Then, the hotel service 310 passes the received voiceprint information to its own authenticator, and the biometric authentication process is executed by the authenticator. The result of the biometric authentication process is returned from the hotel service 310 to the voice assistant 105.

Further, in this modification, the case where the music distribution service 107 performs biometric authentication of the user as a method of performing user authentication has been described, but the present invention is not limited to this. For example, it may be a method using a keyword. In this case, at the time of check-in, the user sets an arbitrary keyword for the voice assistant 105. The keyword registration is performed, for example, by the user speaking the keyword to the voice assistant 105 by voice.

The voice assistant 105 receives a user confirmation request from the music distribution service in step S1045, and requests the user for the keyword registered at the time of check-in. When the voice assistant 105 receives the input of the keyword by the user's voice, the voice assistant 105 performs voice analysis, and if it matches the keyword set at the time of check-in, it is determined that the confirmation process of the user is successful.

[Other embodiments]
The present invention supplies a program that realizes one or more functions of the above-described embodiment to a system or device via a network or storage medium, and one or more processors in the computer of the system or device reads and executes the program. It can also be realized by the processing to be performed. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and modifications can be made within the scope of the gist thereof.

Claims (23)

An information processing terminal equipped with an authentication module for bioauthentication and a storage means having tamper resistance for storing the biometric information of the user required when performing authentication processing by the authentication module, and the input by accepting voice input. A system that includes a voice control device that performs processing corresponding to
The voice control device is
A first request means for making a processing request corresponding to the input to an external system in response to a user's voice input.
A receiving means for receiving an authentication request from the external system,
A second requesting means for requesting an authentication process for the user's information processing terminal via wireless communication in accordance with the authentication request.
A transmission means for transmitting the authentication result from the information processing terminal to the external system,
Have,
The information processing terminal is
An execution means for executing a biometric authentication process using biometric information stored in the authentication module and the storage means in response to a request for the authentication process from the voice operating device.
It has a transmission means for transmitting the authentication result by the biometric authentication process to the voice operation device.
The authentication result by the biometric authentication process includes a private key stored in the storage means in association with biometric information and verification data issued by the external system in which a public key to be a pair of the private key is registered. A system characterized by containing a signature created by use . The authentication request received from the external system includes identification information that identifies the authentication module of the information processing terminal of the user who has input voice to the voice operating device.
The system according to claim 1 , wherein the second requesting means of the voice operating device requests the authentication process from the authentication module of the information processing terminal specified based on the identification information of the authentication module. An information processing terminal equipped with an authentication module for bioauthentication and a storage means having tamper resistance for storing the biometric information of the user required when performing authentication processing by the authentication module, and the input by accepting voice input. A system that includes a voice control device that performs processing corresponding to
The voice control device is
A first request means for making a processing request corresponding to the input to an external system in response to a user's voice input.
A receiving means for receiving an authentication request from the external system,
A second requesting means for requesting an authentication process for the user's information processing terminal via wireless communication in accordance with the authentication request.
A transmission means for transmitting the authentication result from the information processing terminal to the external system,
Have,
The information processing terminal is
An execution means for executing a biometric authentication process using biometric information stored in the authentication module and the storage means in response to a request for the authentication process from the voice operating device.
It has a transmission means for transmitting the authentication result by the biometric authentication process to the voice operation device.
The authentication request received from the external system includes identification information that identifies the authentication module of the information processing terminal of the user who has input voice to the voice operating device.
The second requesting means of the voice operating device is a system characterized in that the authentication process is requested from the authentication module of the information processing terminal specified based on the identification information of the authentication module . The information processing terminal is characterized in that it displays a screen for reading biometric information by a biometric information sensor in order to register user registration information including a public key generated in association with biometric information in the external system. The system according to any one of claims 1 to 3. The information processing terminal has a third requesting means for requesting the external system to register the registration information.
The external system is characterized in that, in response to a registration request from the information processing terminal, the authentication module of the information processing terminal and the voice operation device used by the user of the information processing terminal are associated and managed. The system according to claim 4. The authentication request received from an external system different from the external system in which the registration information is registered does not include identification information that identifies the authentication module of the information processing terminal of the user who has input voice to the voice operation device.
When the voice operation device requests the authentication process for the information processing terminal, the voice operation device acquires the identification information of the authentication module of the information processing terminal associated with the voice operation device from the external system in which the registration information is registered. The system according to claim 5, wherein the system is characterized by the above. The information processing terminal has a fourth requesting means for requesting the external system to cancel the registration of the registration information.
The system according to any one of claims 4 to 6, wherein the external system deletes the registration information of the corresponding user in response to a request for cancellation of registration from the information processing terminal. The information processing terminal is characterized in that when the biometric authentication process is executed in response to a request for the authentication process from the voice operating device, the information processing terminal displays a screen for reading biometric information by a biometric information sensor. Item 5. The system according to any one of Items 1 to 7. The claim is characterized in that, in accordance with the success of the verification according to the authentication result, the voice operating device is provided with a service dedicated to the authenticated user from an external system, and the voice operating device executes the service dedicated to the user. Item 5. The system according to any one of Items 1 to 8. An information processing terminal equipped with an authentication module for bio-authentication and a storage means having tamper resistance for storing user's bio-information necessary for performing authentication processing by the authentication module, and receiving voice input and performing the input. It is a control method of a system including a voice operation device that executes processing corresponding to the above.
A step in which the voice operating device makes a processing request corresponding to the input to an external system in response to a user's voice input.
The process in which the voice operating device receives an authentication request from the external system,
A step in which the voice operating device requests an authentication process for the information processing terminal of the user via wireless communication in accordance with the authentication request.
A step in which the information processing terminal executes biometric authentication processing using biometric information stored in the authentication module and the storage means in response to a request for authentication processing from the voice operation device.
The step of the information processing terminal transmitting the authentication result by the biometric authentication process to the voice operation device,
A step in which the voice operating device transmits an authentication result from the information processing terminal to the external system.
Have,
The authentication result by the biometric authentication process includes a private key stored in the storage means in association with biometric information and verification data issued by the external system in which a public key to be a pair of the private key is registered. A method of controlling a system, characterized in that it contains a signature created by use . An information processing terminal equipped with an authentication module for bio-authentication and a storage means having tamper resistance for storing the bio-information of the user necessary for performing authentication processing by the authentication module, and the input by accepting voice input. A program that causes a computer to execute a control method of a system including a voice operation device that executes a process corresponding to the above.
A step in which the voice operating device makes a processing request corresponding to the input to an external system in response to a user's voice input.
The process in which the voice operating device receives an authentication request from the external system,
A step in which the voice operating device requests an authentication process for the information processing terminal of the user via wireless communication in accordance with the authentication request.
A step in which the information processing terminal executes biometric authentication processing using biometric information stored in the authentication module and the storage means in response to a request for authentication processing from the voice operation device.
The step of the information processing terminal transmitting the authentication result by the biometric authentication process to the voice operation device,
A step in which the voice operating device transmits an authentication result from the information processing terminal to the external system.
Have,
The authentication result by the biometric authentication process includes a private key stored in the storage means in association with biometric information and verification data issued by the external system in which a public key to be a pair of the private key is registered. A program characterized by containing a signature created by use. A voice operating device that receives voice input and executes processing corresponding to the input.
A first request means for making a processing request corresponding to the input to an external system in response to a user's voice input.
A receiving means for receiving an authentication request from the external system,
A second requesting means for requesting an authentication process for the user's information processing terminal via wireless communication in accordance with the authentication request.
As a response to the request for the authentication process, the information processing terminal performs a bioauthentication process using the biometric information stored in the authentication module for bioauthentication included in the information processing terminal and the storage means included in the information processing terminal. It has a transmission means for receiving the executed authentication result and transmitting the received authentication result to the external system .
Created by using the private key stored in the storage means in association with the biometric information and the verification data issued by the external system in which the public key to be a pair of the private key is registered as the authentication result. A voice control device, characterized in that it contains a signed signature . A voice operating device that receives voice input and executes processing corresponding to the input.
A first request means for making a processing request corresponding to the input to an external system in response to a user's voice input.
A receiving means for receiving an authentication request from the external system, which includes identification information corresponding to the information processing terminal of the user who has input voice to the voice operating device.
A second requesting means for requesting an authentication process for the information processing terminal of the user specified based on the identification information in accordance with the authentication request via wireless communication.
As a response to the request for the authentication process, the information processing terminal performs a bioauthentication process using the biometric information stored in the authentication module for bioauthentication included in the information processing terminal and the storage means included in the information processing terminal. A voice operation device comprising a transmission means for receiving an executed authentication result and transmitting the received authentication result to the external system. It is a control method of a voice operating device that receives voice input and executes a process corresponding to the input.
In response to a user's voice input, a process of making a processing request corresponding to the input to an external system, and
The process of receiving an authentication request from the external system and
In accordance with the authentication request, a process of requesting an authentication process for the user's information processing terminal via wireless communication, and a process of requesting the authentication process.
In response to the request for authentication processing from the information processing terminal, biometric authentication processing using biometric information stored in the authentication module for biometric authentication provided in the information processing terminal and the storage means provided in the information processing terminal is performed. It has a step of receiving an executed authentication result and transmitting the received authentication result to the external system.
Created by using the private key stored in the storage means in association with the biometric information and the verification data issued by the external system in which the public key to be a pair of the private key is registered as the authentication result. A method of controlling a voice control device, characterized in that it contains a signed signature. A program that causes a computer to execute a control method of a voice operating device that receives voice input and executes a process corresponding to the input, and the control method is
In response to a user's voice input, a process of making a processing request corresponding to the input to an external system, and
The process of receiving an authentication request from the external system and
In accordance with the authentication request, a process of requesting an authentication process for the user's information processing terminal via wireless communication, and a process of requesting the authentication process.
In response to the request for authentication processing from the information processing terminal, biometric authentication processing using biometric information stored in the authentication module for biometric authentication provided in the information processing terminal and the storage means provided in the information processing terminal is performed. It has a step of receiving an executed authentication result and transmitting the received authentication result to the external system.
Created by using the private key stored in the storage means in association with the biometric information and the verification data issued by the external system in which the public key to be a pair of the private key is registered as the authentication result. A program characterized by containing a signed signature. It is a control method of a voice operating device that receives voice input and executes a process corresponding to the input.
In response to a user's voice input, a process of making a processing request corresponding to the input to an external system, and
A process of receiving an authentication request from the external system, which includes identification information corresponding to the information processing terminal of the user who has input voice to the voice operation device.
A process of requesting an authentication process for an information processing terminal of the user specified based on the identification information in accordance with the authentication request via wireless communication.
As a response to the request for the authentication process, the information processing terminal performs a biometric authentication process using the biometric information stored in the authentication module for biometric authentication provided in the information processing terminal and the storage means provided in the information processing terminal. A method for controlling a voice operating device, comprising a step of receiving an executed authentication result and transmitting the received authentication result to the external system. A program that causes a computer to execute a control method of a voice operating device that receives voice input and executes a process corresponding to the input, and the control method is
In response to a user's voice input, a process of making a processing request corresponding to the input to an external system, and
A process of receiving an authentication request from the external system, which includes identification information corresponding to the information processing terminal of the user who has input voice to the voice operation device.
A process of requesting an authentication process for an information processing terminal of the user specified based on the identification information in accordance with the authentication request via wireless communication.
As a response to the request for the authentication process, the information processing terminal performs a biometric authentication process using the biometric information stored in the authentication module for biometric authentication provided in the information processing terminal and the storage means provided in the information processing terminal. A program comprising a step of receiving an executed authentication result and transmitting the received authentication result to the external system. An external system that provides a service that verifies the result of user authentication, an authentication module for biometric authentication, and tamper resistance that stores the user's biometric information required when performing authentication processing by the authentication module. A system including an information processing terminal provided with a storage means, and a voice operation device that receives an input of voice and executes a process corresponding to the input.
The voice control device is
It has a first request means for making a processing request corresponding to the input to the external system in response to a user's voice input.
The information processing terminal is
A living body by the authentication module using the biometric information presented by the user and the biometric information stored in the storage means in response to the request for authentication processing based on the processing request performed by the voice operating device. Has an execution means to execute the authentication process
The external system is
A verification means for receiving information created in response to the success of authentication by the biometric authentication process executed by the information processing terminal and verifying the received information.
If the verification by the verification means is successful, the providing means for providing the service corresponding to the processing request and the providing means.
It has a transmission means for transmitting the result regarding the provided service to the voice control device.
In the information processing terminal, the secret key is stored in the storage means in association with the biometric information.
A public key corresponding to the private key is registered in the external system, and the public key is registered.
The verification means of the external system uses the verification data issued by the external system and the secret key as information created in response to the success of authentication by the biometric authentication process executed by the information processing terminal. The signature created in the above is verified using the registered public key.
A system characterized by that. The system according to claim 18 , wherein in the external system, the public key is registered in association with the identification information of the user. The system according to claim 18 or 19 , wherein the service provided by the external system is room service provided to the user who has checked in to the hotel. The system according to claim 20, wherein the external system manages the identification information of the user who has checked in to the hotel, the room number of the hotel, and the identification information of the voice operating device in association with each other. The service provided by the external system is a music distribution service contracted by the user.
The system according to claim 18 or 19 , wherein the voice control device plays music provided by a music distribution service as a service provided by the providing means. An external system that provides a service that verifies the result of user authentication, an authentication module for bio-authentication, and tamper resistance that stores the user's bio-information required for authentication processing by the authentication module. A control method for a system including an information processing terminal provided with a storage means, and a voice operating device that receives an input of voice and executes a process corresponding to the input.
A step in which the voice operating device makes a processing request corresponding to the input to the external system in response to the input of the user's voice.
The information processing terminal uses the biometric information presented by the user and the biometric information stored in the storage means in response to the request for the authentication process based on the process request performed by the voice operating device. The process of executing the biometric authentication process by the authentication module
The step of receiving the information created in response to the success of the authentication by the biometric authentication process executed by the information processing terminal by the external system and verifying the received information.
When the external system succeeds in the verification by the verification process, the process of providing the service corresponding to the processing request and the process of providing the service.
The external system comprises a step of transmitting the result regarding the provided service to the voice control device.
In the information processing terminal, the secret key is stored in the storage means in association with the biometric information.
A public key corresponding to the private key is registered in the external system, and the public key is registered.
In the verification step of the external system, the verification data issued by the external system and the secret key are used as information created in response to the success of authentication by the biometric authentication process executed by the information processing terminal. A method for controlling a system, characterized in that the signature created by using the signature is verified by using the registered public key.

Images