JP7525343B2 - Payment system and payment method - Google Patents

Description

The present invention relates to a payment system and a payment method.

In recent years, videoconferencing systems using the Internet have become widespread, and telepresence robots are being used that not only allow users to talk face-to-face, but also allow users in remote locations to control the camera's direction and position.

For example, the following Patent Document 1 describes a mobile object (telepresence robot) equipped with a camera that provides captured images to a remote operator.

JP 2019-062308 A

As examples of uses for telepresence robots (hereafter simply referred to as "robots"), methods have been proposed for attending meetings at a remote headquarters or inspecting factories, but the use of robots is still limited. For example, if a robot were installed in a commercial facility such as a local store, users would be able to operate the robot to purchase products and services from the store without having to go there in person, but no method has yet been proposed to realize such uses.

The present invention was made in consideration of the circumstances described above, and one of its objectives is to provide a payment technology that utilizes robots.

The payment system according to one aspect of the present disclosure is a payment system that uses an unfixed robot and a computer that can communicate with the robot to make payment for products, in which the robot has a camera, a receiving unit that receives a product purchase request from the computer, and an accepting unit that accepts input of purchase-related information that indicates the purchase details of the product in response to the purchase request, and the computer has a display unit that displays an image captured by the camera and the purchase-related information, and a payment unit that initiates payment for the product when consent to the purchase details of the product is obtained based on the purchase-related information.

The present invention provides a payment technology that utilizes robots.

FIG. 2 is a diagram showing a network configuration of the payment system according to the present embodiment. FIG. 1 is an image diagram for explaining an overview of a payment system. FIG. 2 is a block diagram showing the functional configuration of a computer. FIG. 2 is a block diagram showing a functional configuration of the robot. FIG. 1 is a diagram showing the physical configuration of a computer. FIG. 2 is a diagram showing the physical configuration of a robot. FIG. 13 is a sequence diagram showing a payment flow for a product. FIG. 13 is an image diagram of a conversation between a user and a person in charge. FIG. 13 is a diagram illustrating an example of a product purchase presentation screen. FIG. 13 is a sequence diagram showing a payment flow for a product according to a modified example. FIG. 13 is a diagram illustrating a product purchase presentation screen according to a modified example.

The following describes an embodiment of the present invention with reference to the attached drawings. In each drawing, the same reference numerals denote the same or similar configurations.

A. This embodiment Fig. 1 is a diagram showing a network configuration of a payment system 100 according to this embodiment. The payment system 100 includes a plurality of unfixed robots 20, a computer 10 capable of operating each robot 20, and a payment server 30. Each robot 20, the computer 10, and the payment server 30 are capable of communicating with each other via a network N. Although Fig. 1 illustrates three robots 20 and one computer 10, the number of robots 20 and the number of computers 10 are each arbitrary.

One or more portions of network N may be wired or wireless. Network N may include, by way of example and without limitation, an ad hoc network, an intranet, an extranet, a virtual private network (VPN), a local area network (LAN), a wireless LAN (WLAN), a wide area network (WAN), a wireless WAN (WWAN), a metropolitan area network (MAN), a portion of the Internet, a portion of the public switched telephone network (PSTN), a mobile telephone network, integrated service digital networks (ISDNs), wireless LANs, long term evolution (LTE), code division multiple access (CDMA), short range wireless communication such as Bluetooth (registered trademark), satellite communication, or a combination of two or more thereof.

<Overview of payment system 100>
FIG. 2 is a conceptual diagram for explaining an overview of payment system 100. As shown in FIG.
Each robot 20 is installed in a commercial facility such as a local store, a shopping mall, or a convenience store. A user operates the computer 10 to remotely access the robot 20 installed in a desired commercial facility (hereinafter, assumed to be "store A") and visits store A. The user uses the computer 10 to appropriately operate the robot 20 in store A to look around the store A. When the user finds a product he likes, he makes a purchase request for the product to the person in charge of store A (step S1). In this specification, the term "product" includes not only all things that can be the subject of commercial transactions, i.e., tangible movable property that can be mass-produced and has liquidity and fungibility, but also so-called services.

When the staff member receives the purchase request, he/she inputs the information necessary for the user to purchase the product via the robot 20 (step S2). Here, the information necessary for the user to make a purchase is information that indicates the purchase details, such as the purchase price, the name of the product, and the quantity purchased (hereinafter also referred to as "purchase-related information"). The purchase-related information is sent from the robot 20 to the user's computer 10. The user checks the purchase-related information displayed on the computer 10 and inputs their consent (step S3). When this input is made, the computer 10 cooperates with the payment server 30 to make payment for the product (step S4).

According to the payment system 100 of this embodiment, a user can operate the robot 20 to purchase a favorite product found in a store without having to go to the store in person. The configurations of the computer 10, the robot 20, and the payment server 30 are described below.

<Functional configuration>
(Computer 10)
The computer 10 is an information processing device that operates the robot 20 and inputs information necessary for user authentication when using the robot 20. The computer 10 is a general-purpose or dedicated information processing device such as a smartphone, a tablet terminal, a PDA, a personal computer, or a wearable terminal.

FIG. 3 is a block diagram showing the functional configuration of the computer 10. As shown in FIG.
The computer 10 includes a reception function 11 , an image/audio input function 12 , a communication function 13 , a display function 14 , an audio output function 15 , and a payment function 16 .

The reception function 11 receives input of various commands, including the operation of the robot 20. The image/audio input function 12 inputs images and audio captured by the camera and microphone of the computer 10. The images and audio input to the computer 10 include, for example, the user's facial image and audio.

The communication function 13 transmits and receives various data between the robot 20, the payment server 30, etc. Specifically, the communication function 13 receives images and audio captured by the camera and microphone of the robot 20 and purchase-related information (such as the purchase price, name, and quantity of the purchased product) while transmitting images and audio captured by the camera and microphone of the computer 10 to the robot 20. The communication function 13 also transmits purchase-related information and the like to the payment server 30.

The display function 14 displays images captured by the cameras of the computer 10 and the robot 20, purchase-related information, etc. The audio output function 15 outputs audio captured by the microphones of the computer 10 and the robot 20, etc.
The settlement function 16 cooperates with the settlement server 30 to settle the payment for the product when the user inputs an input indicating that he/she agrees to purchase the product.

(Robot 20)
The robot 20 is an unfixed robot, and one or more robots are installed at each of the various commercial facilities described above. Here, the fact that the robot 20 is unfixed includes a case where the robot 20 is a mobile type having a moving part such as wheels, and a case where the robot 20 is a wearable type that can be worn by a person and has a driving part such as a manipulator. In this embodiment, a mobile robot is assumed. Mobile robots are shown in, for example, Patent Document 1. The moving parts of mobile robots include those that run on one wheel, two wheels, or multiple wheels, those that run on caterpillar tracks, those that run on rails, those that move by hopping, those that walk on two legs, four legs, or multiple legs, those that navigate on or underwater with a screw, and those that fly with a propeller or the like. The wearable robot is disclosed, for example, in MHD Yamen Saraiji, Tomoya Sasaki, Reo Matsumura, Kouta Minamizawa and Masahiko Inami, "Fusion: full body surrogacy for collaborative communication," Proceeding SIGGRAPH '18 ACM SIGGRAPH 2018 Emerging Technologies Article No. 7. Furthermore, the robot 20 includes vehicles and heavy machinery capable of autonomous or semi-autonomous driving, drones and airplanes. Furthermore, the robot 20 includes a robot equipped with a camera capable of moving on rails. Furthermore, the robot 20 may be a so-called avatar robot.

The robot 20 operates based on commands from the computer 10 that has successfully authenticated the user. Here, the user authentication may be performed using a known method, and the information for user authentication may be registered in advance.

FIG. 4 is a block diagram showing the functional configuration of the robot 20.
The robot 20 includes a reception function 21 , an image/audio input function 22 , a communication function 23 , a display function 24 , and an audio output function 25 .

The reception function 21 receives purchase-related information and the like input by, for example, a person in charge at store A by operating a touch panel or the like of the robot 20 .
The image/audio input function 22 inputs images and audio captured by the camera and microphone of the robot 20. The images and audio input to the robot 20 include, for example, images of products in the store A where the robot 20 is installed, and facial images and audio of the staff involved in providing the products.
The communication function 23 transmits and receives various data to and from the computer 10, etc. Specifically, the communication function 23 receives images and audio captured by the camera and microphone of the computer 10, and transmits images and audio captured by the camera and microphone of the robot 20 and purchase-related information to the computer 10.

The display function 24 displays images captured by the camera of the robot 20 or the computer 10, purchase-related information, etc. The audio output function 25 outputs audio picked up by the microphone of the robot 20 or the computer 10, etc.

(Payment server 30)
The payment server 30 performs electronic payment for products purchased by the user. The payment server 30 is composed of an information processing device such as a server computer. The payment server 30 may be composed of one information processing device, or may be composed of multiple information processing devices such as cloud computing and edge computing. The payment server 30 includes a payment management database DB1 (see FIG. 1). In the payment management database DB1, basic information such as a user ID, password, name, age, address, and contact information, payment type information such as a bank account number and a credit card number, and payment history information indicating past payment history are registered in association with each other for each user.

When the payment server 30 receives the user's purchase-related information from the computer 10, etc., it performs payment based on the purchase-related information, for example by debiting the purchase amount of the product from the user's bank account. When the payment is successfully completed, the payment server 30 registers information indicating the payment details of the product (for example, product name, purchase amount, purchase date and time, purchase location, etc.) in the payment management database DB1 as payment history information.

<Physical configuration>
(Computer 10)
FIG. 5 is a diagram showing the physical configuration of the computer 10 according to the present embodiment. The computer 10 has a CPU (Central Processing Unit) 10a corresponding to a calculation unit, a RAM (Random Access Memory) 10b corresponding to a storage unit, a ROM (Read only Memory) 10c corresponding to a storage unit, a communication unit 10d, an input unit 10e, a display unit 10f, an output unit 10g, and a camera 10h. These components are connected to each other via a bus so that data can be transmitted and received. In this example, the computer 10 is configured by one computer, but the computer 10 may be realized by combining multiple computers. In addition, the configuration shown in FIG. 5 is an example, and the computer 10 may have other configurations than these, or may not have some of these configurations.

The CPU 10a is a control unit that controls the execution of programs stored in the RAM 10b or ROM 10c and calculates and processes data. The CPU 10a is a calculation unit that executes a program for making payments for products using the robot 20 (hereinafter, the payment program). The CPU 10a receives various data from the input unit 10e, communication unit 10d, and camera 10h, and displays the results of calculations on the data on the display unit 10f, outputs the data as audio from the output unit 10g, and stores the data in the RAM 10b.

RAM 10b is a storage unit in which data can be rewritten, and may be composed of, for example, a semiconductor memory element. RAM 10b may store data such as various programs executed by CPU 10a and user information. Note that these are merely examples, and RAM 10b may store data other than these, or some of these data may not be stored.

ROM 10c is a memory unit from which data can be read, and may be configured, for example, with a semiconductor memory element. ROM 10c may store, for example, a payment program or data that is not rewritten.

The communication unit 10d is an interface that connects the computer 10 to other devices via the network N.

The input unit 10e accepts data input from a user and may include, for example, a keyboard and a touch panel. The input unit 10e may also include a microphone for voice input.

The display unit 10f visually displays the results of calculations performed by the CPU 10a, and may be configured, for example, with an LCD (Liquid Crystal Display). The display unit 10f may display images captured by the camera 20h of the robot 20, images captured by the camera 10h mounted on the computer 10, a product payment screen, etc.

The output unit 10g is for outputting audio and may include, for example, an audio decoder and a speaker.

The camera 10h includes an imaging element that captures still images or videos, and transmits the captured still images or videos to the display unit 10f and the robot 20 via the communication unit 10d.

The payment program may be provided by being stored in a computer-readable storage medium such as RAM 10b or ROM 10c, or may be provided via a network N connected by a communication unit 10d. In the computer 10, the CPU 10a executes the payment program to realize functions required for paying for products using the robot 20 (see FIG. 3). Note that these physical configurations are merely examples and do not necessarily have to be independent configurations. For example, the computer 10 may be provided with an LSI (Large-Scale Integration) in which the CPU 10a is integrated with the RAM 10b and ROM 10c.

(Robot 20)
FIG. 6 is a diagram showing the physical configuration of the robot 20 according to this embodiment.
The robot 20 has a CPU 20a corresponding to a calculation unit, a RAM 20b corresponding to a storage unit, a ROM 20c corresponding to a storage unit, a communication unit 20d, an input unit 20e, a display unit 20f, a drive unit 20g, a camera 20h, and an output unit 20i. Each of these components is connected to each other via a bus so that data can be transmitted and received. Note that the configuration shown in FIG. 6 is an example, and the robot 20 may have other components or may not have some of these components.

The CPU 20a is a control unit that controls the execution of programs stored in the RAM 20b or the ROM 20c and calculates and processes data. The CPU 20a is a calculation unit that executes a program for making payments for products using the robot 20 (hereinafter, the payment program). The CPU 20a receives various data from the input unit 20e and the communication unit 20d, and displays the results of calculations on the data on the display unit 20f or stores them in the RAM 20b. The CPU 20a also controls the drive unit 20g, which controls the operation of the robot 20.

RAM 20b is a storage unit in which data can be rewritten, and may be configured, for example, with a semiconductor memory element. RAM 20b may store various programs executed by CPU 20a. Note that these are merely examples, and RAM 20b may store data other than these, or may not store some of these.

ROM 20c is a memory unit from which data can be read, and may be configured, for example, with a semiconductor memory element. ROM 20c may store, for example, a payment program or data that is not rewritten.

The communication unit 20d is an interface that connects the robot 20 to other devices via the network N.

The input unit 20e receives data input from a user and may include, for example, a touch panel. The input unit 20e may also include a microphone for voice input.

The display unit 20f visually displays the results of calculations performed by the CPU 20a, and may be configured, for example, with an LCD. The display unit 20f may display images captured by the camera 10h of the computer 10, images captured by the camera 20h of the robot 20, a product payment screen, etc.

The driving unit 20g includes a remotely controlled actuator, and includes a moving part such as wheels, a manipulator, etc. When the robot 20 is a mobile robot, the driving unit 20g includes at least a moving part such as wheels, but may also include a manipulator. When the robot 20 is a wearable robot, the driving unit 20g includes at least a manipulator.

The camera 20h includes an imaging element that captures still images or videos, and transmits the captured still images or videos to the display unit 20f and the computer 10 via the communication unit 20d.

The payment program may be provided by being stored in a computer-readable storage medium such as RAM 20b or ROM 20c, or may be provided via a network N connected by communication unit 20d. In robot 20, CPU 20a executes the payment program to realize functions required for paying for products using robot 20 (see FIG. 4). Note that these physical configurations are examples and do not necessarily have to be independent configurations. For example, robot 20 may have an LSI in which CPU 20a is integrated with RAM 20b and ROM 20c.

<Processing flow>
7 is a sequence diagram showing a payment flow for a commodity in the payment system 100 according to the present embodiment. This flow is realized by the CPUs of the computer 10 and the robot 20 executing a payment program or the like. It is assumed that the user is permitted to use, for example, his/her own computer 10 to operate the robot 20 installed in store A (i.e., the user authentication has been successful).

The user uses computer 10 to operate robot 20 installed in store A to look around store A. When the user finds a product they like, they face the camera of computer 10, for example, and speak into the microphone to call a staff member at store A. Computer 10 sends an image of the user captured by the camera to robot 20, and also transmits the voice input from the microphone (here, the call to the staff member) to robot 20 as voice data (step Sa1).

When the robot 20 receives the user's image and voice data from the computer 10, it displays the user's image on the display unit 20f and outputs the user's voice from the speaker. When the person in charge realizes that the user is calling him, he or she responds to the user's call, for example, by facing the camera of the robot 20 and speaking into the microphone. The robot 20 transmits an image of the person in charge taken by the camera to the computer 10, and transmits the voice (here, the response) input from the microphone to the computer 10 as voice data (step Sa2). When the user confirms that the person in charge has responded via the speaker of the computer 10, they begin a conversation with the person in charge.

FIG. 8 is an image diagram of a conversation between a user and a person in charge.
An image P1 of the user is displayed on the display unit 20f of the robot 20, and the user's voice is output from the speaker of the robot 20. In response to the user's request, the staff member explains the product I1 that the user likes while presenting it to the camera of the robot 20. As an example, the staff member explains the brand name, product name, price, etc. of the product I1. The computer (display unit) 10 displays an image of the product I1, and outputs the staff member's voice explaining the product I1 from the speaker. The user listens to the staff member's explanation output from the speaker while checking the image of the product I1 displayed on the display unit 10f of the computer 10.

Returning to FIG. 7, when the user decides to purchase product I1, he or she speaks into the microphone of computer 10 to the effect that he or she wishes to purchase product I1 (i.e., a purchase request for product I1). Computer 10 transmits the user's purchase request for product I1 to robot 20 (step Sa3). When robot (receiving unit) 20 receives the purchase request for product I1, it outputs the purchase request from its speaker. When the staff member confirms via robot 20 that there has been a purchase request for product I1, he or she touches, for example, display unit 20f of robot 20 to display a product purchase presentation screen on display unit 20f.

FIG. 9 is a diagram showing an example of a product purchase presentation screen D1.
As shown in FIG. 9, the purchase presentation screen D1 displays an image P1 of the user as well as a window W1 for inputting purchase-related information for the product I1.
The person in charge touches window W1 to input purchase-related information for the product I1 that the user wishes to purchase (i.e., the purchase price, name, and quantity of product I1), and then presses send button B1. In this example, it is assumed that one product is purchased, but multiple products may be purchased. Furthermore, the purchase-related information only needs to include at least the purchase price of product I1, and other information can be set or changed as appropriate depending on the system design, etc.

Returning to FIG. 7, after the robot (reception unit) 20 receives the purchase-related information for product I1 input by the person in charge (step Sa4), when it detects that the send button B1 has been pressed, it transmits the input purchase-related information for product I1 to the computer 10 (step Sa5).

When the computer (display unit) 10 receives the purchase-related information from the robot 20, it displays it on the display unit 10f (step Sa6). When the user checks the purchase-related information for the product I1 and decides to purchase the product I1, the user inputs consent to the purchase details of the product I1, for example, by touching an agreement button (not shown) displayed on the display unit 10f.

If the user does not agree with the purchase of product I1 because the presented purchase price is higher than expected, the user may request the person in charge to review the purchase-related information (e.g., review the purchase price).

When the computer (payment unit) 10 detects that the user has input an agreement to the purchase details of the product I1 (step Sa7), it accesses the payment server 30 to start the payment for the product I1. The computer 10 then requests payment by sending the purchase-related information for the product I1 purchased by the user, including the user ID, etc., to the payment server (step Sa8). When the payment server 30 receives the payment request from the computer 10, it refers to the payment management database DB1 and performs payment, for example by debiting the purchase amount of the product I1 from the user's bank account based on the received purchase-related information (step Sa9). When the payment server 30 confirms that the payment has been completed successfully, it notifies the computer 10 that the payment has been completed (step Sa10). When the computer 10 receives the payment completion notification from the payment server 30, it displays on the display unit 10f that the payment has been completed successfully (step Sa11).

As described above, according to the payment system 100 of this embodiment, a user can operate the robot 20 to purchase a favorite product found in a store without having to go to the store in person. Meanwhile, the store that installs the robot 20 can conduct online product transactions without being forced to perform particularly cumbersome tasks (for example, listing details of the products handled and registering them in a database) or incur significant implementation costs.

B. Modification Fig. 10 is a sequence diagram showing the payment flow of a product in the payment system 100 according to the modification. In the above-mentioned embodiment, the person in charge inputs the purchase-related information of the product I1, and the user inputs an input indicating that he/she agrees with the purchase details of the product I1. In contrast, the modification is different in that the user inputs the purchase-related information of the product I1, and the person in charge inputs an input indicating that he/she agrees with the purchase details of the product I1. Note that other processes are similar to the embodiment, so the same reference numerals are used for corresponding steps, and detailed explanations are omitted.

When the user decides to purchase product I1, computer 10 transmits a user's purchase request for product I1 to robot 20 (step Sa3). Furthermore, the user acquires purchase-related information, including the purchase price of product I1, by talking to the person in charge. When the user acquires the purchase-related information for product I1 from the person in charge, the user, for example, touches display unit 10f of computer 10 to display a product purchase presentation screen on display unit 10f.

FIG. 11 is a diagram showing an example of a product purchase presentation screen D2.
11, the purchase presentation screen D2 displays an image P2 of the interior of the store A (images of products, etc.) and a window W2 for inputting purchase-related information for the product I1. The user inputs the purchase-related information for the product I1 that the user wishes to purchase by touching the window W2.

Returning to FIG. 10, the computer 10 transmits the purchase-related information for the product I1 input by the user to the robot 20 (step Sb1). When the robot (reception unit) 20 receives the input of the purchase-related information for the product I1 that the user wishes to purchase via the computer 10 (step Sa4), it displays it on the display unit 20f. When the staff member checks the purchase-related information for the product I1 displayed on the display unit 20f, he or she inputs consent to the purchase details of the product I1, for example by touching an consent button (not shown) displayed on the display unit 20f. The robot 20 notifies the computer 10 that consent has been input (step Sb2).

When the computer (payment unit) 10 detects that the person in charge has input an agreement to the purchase details of product I1 via the robot 20 (step Sa7), it accesses the payment server 30 to start the payment for product I1. Note that the operation thereafter is the same as in this embodiment, so further explanation is omitted.

In this way, instead of a staff member at store A inputting the purchase-related information for product I1, the user may input the purchase-related information for product I1 themselves. Note that in this embodiment and the modified example, a case has been described in which the purchase-related information for product I1 is inputted by a touch operation, but this is not intended to be limiting. For example, the purchase-related information for product I1 may be inputted by voice input, etc.

The above-described embodiment and modified examples are intended to facilitate understanding of the present invention, and are not intended to limit the present invention. Each element and its arrangement, material, conditions, shape, size, etc. are not limited to those exemplified, and can be changed as appropriate. In addition, each element can be partially replaced or combined with another element.
Furthermore, in this embodiment and the modified examples, a "unit" does not simply mean a physical means, but also includes cases where the functions of the "unit" are realized by software. Also, the functions of one "unit" or device may be realized by two or more physical means or devices, and the functions of two or more "units" or devices may be realized by one physical means or device.

10...Computer, 10a...CPU, 10b...RAM, 10c...ROM, 10d...Communication unit, 10e...Input unit, 10f...Display unit, 10g...Output unit, 10h...Camera, 20...Robot, 20a...CPU, 20b...RAM, 20c...ROM, 20d...Communication unit, 20e...Input unit, 20f...Display unit, 20g...Drive unit, 20h...Camera, 20i...Output unit, 100...Payment system

Claims (5)

A payment system for making payment for goods using a non-fixed robot and a computer capable of communicating with the robot,
The robot comprises:
A camera and
A receiving unit that receives a product purchase request from the computer;
a reception unit that receives input of purchase-related information that indicates the purchase details of the product in response to the purchase request,
The computer includes:
a display unit that displays the image captured by the camera and the purchase-related information;
a payment unit that starts payment for the product when consent to the purchase of the product is obtained based on the purchase-related information,
the reception unit receives, via the computer, an input of the purchase-related information by a user who wishes to purchase the product;
The settlement unit initiates settlement for the product when a person in charge of the product inputs, via the robot, an input indicating that the person in charge agrees with the purchase details of the product. There are a plurality of computers capable of communicating with the robot;
The payment system according to claim 1 , wherein the receiving unit receives the product purchase request from a computer that has been successfully authenticated as a user of the computer among a plurality of computers. The purchase-related information includes at least the purchase amount.
A payment system according to any one of claims 1 to 2 . At least a window for inputting the purchase-related information is displayed on the display unit.
The payment system according to claim 1 . A payment method for making payment for goods using a non-fixed robot equipped with a camera and a computer capable of communicating with the robot, comprising:
a receiving step of the robot receiving a request to purchase a product from the computer;
a receiving step in which the robot receives input of purchase-related information indicating the purchase details of the product in response to the purchase request;
a display step in which the computer displays an image captured by the camera of the robot and the purchase-related information;
a payment step of the computer initiating payment for the product when consent to the purchase of the product is obtained based on the purchase-related information,
the receiving step includes receiving, via the computer, an input of the purchase-related information by a user who wishes to purchase the product;
The payment step starts payment for the product when the person in charge of the product inputs, via the robot, an input indicating that the person in charge agrees with the purchase details of the product.