JP3437148B2 - Electronic payment method by mobile terminal - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an electronic payment method, an authentication server, and a mobile terminal using a mobile terminal incorporating an electronic camera or an artificial retina chip.

[0002]

2. Description of the Related Art Conventionally, a payment method for a trading price is mainly a plastic card with a magnetic tape attached, as represented by a credit card, and a card reader reads personal information stored on the magnetic tape. By identifying the individual by matching it with the unique data of the company that manages it, it extends to payment. However, in the present situation where criminal acts such as card forgery frequently occur, in recent years, IC cards that are difficult to forge are being developed. Electronic payments using online authentication are also beginning to be performed, and in addition to credit cards, encryption technology and personal identification numbers have been combined to enhance security, and measures have been taken to make it difficult for the card number to be decrypted from the outside. There is. IC
The card has a significantly large amount of information that can be stored and is excellent in portability, but it lacks a sense of portability as a consciousness, and is only recognized as "certainly in a wallet." In addition, the credit card itself is often stored in a wallet, and there is a risk of encountering theft such as pickpockets and storage.

In recent years, mobile phones, which have become extremely popular, are inferior in portability to credit cards and the like, but have an appropriate mobile feeling. In addition, compared with a wallet, a mobile phone is less likely to be stolen due to the usage values of the third party, and an electronic payment method using the mobile phone has been developed. For example, a method of making a credit card payment by making a voice call to a payment server system and inputting important information such as a credit card number with a push button after placing a product order from a mobile phone is known. In this electronic payment method, when transmitting and receiving important information such as a credit card number, the Internet is switched to a voice call mode and information is transmitted by push-button input without using the Internet, which has a high risk of being abused. However, although the transmission signal is encrypted, it cannot be said that the safety is sufficiently secured.

[0004]

SUMMARY OF THE INVENTION The present invention is intended to propose an extremely safe electronic settlement method by using a portable terminal incorporating an electronic camera or an artificial retina chip.

[0005]

An electronic payment method using a mobile terminal according to the present invention is a product information display device arranged at a price settlement site, a sales management server for managing and operating the product information display device,
A mobile terminal server for operating and managing a mobile terminal incorporating an electronic camera or an artificial retina chip and an authentication server for authenticating the mobile terminal are connected via a network such as the Internet, and the authentication server and the sales management A method for connecting between servers by a dedicated line and making an electronic payment using the mobile terminal, wherein the mobile terminal captures textual product information displayed on the display device, and then captures the captured image data. After transmitting to the authentication server via the mobile terminal server, the authentication server authenticates the mobile terminal and restores the image data into text product information, the personal information based on the authentication and the product information are described above. The information is transmitted to the sales management server via a dedicated line. It is preferable to display encrypted character product information on the display.
It is preferable to display duplicated character product information on the display.

The authentication server according to the present invention registers a terminal ID in advance by registering the terminal ID and a mail folder monitoring section for monitoring the arrival of an electronic mail (hereinafter, also referred to as E-mail) including the terminal ID and image data. A terminal ID storage unit for storing, a personal information storage unit for storing personal information corresponding to the registered terminal ID, and whether the terminal ID separated by analyzing the incoming mail is registered A terminal ID determination unit for determining, an image recognition block for image-recognizing the separated image data to generate product information including character information, and a permission information generation unit for generating permission information including the product information and personal information. And are provided. A mobile terminal according to the present invention includes an artificial retina chip in which a lens and an artificial retina LSI are integrated, a control unit thereof,
A program that comprises a communication unit and constitutes the control unit,
It is characterized by comprising a system control unit for controlling the entire system, a photographing control unit for controlling photographing, and an image memory unit for temporarily storing photographed image data.

[0007]

BEST MODE FOR CARRYING OUT THE INVENTION Preferred embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is an overall explanatory view of an electronic payment method according to the present invention. In a range 20 surrounded by a dotted line in the figure, product information, etc. to be arranged at a site for providing or selling various products or services. A display device (register) 21, a vending machine 22 having a display unit for displaying product information, and a sales management server 23 for managing and operating these are connected by a network 50 such as the Internet. . Reference numeral 24 is a network line connecting the display (register) 21, the vending machine 22 and the sales management server 23. Conventionally, payment by credit card, cash card, debit card, etc. is carried out within this range 20 by directly connecting a display (register) 21 or a vending machine 22 and a sales management server 23 with a network line 24. Therefore, when using a credit card, a separate card reader is combined to establish personal authentication.

In FIG. 1, a network 50 is connected to a mobile terminal server 31 for operating and managing the mobile terminals 30, 30, ... Represented by mobile phones, and each mobile terminal 30 and the mobile terminal server. It is connected to 31 by radio 32. Reference numeral 10 is an authentication server that decodes a signal transmitted from the mobile terminal 30 and provides personal authentication, is connected to the network 50, and is also connected to the sales management server 23 by a dedicated line 60. Further, reference numeral 11 is a mail server used exclusively for receiving image information, and together with the storage medium 12 of the mail server 11.
Are shown with the folder 13 inside.

The basic flow of the settlement method according to the present invention will be described with reference to FIG. In the present invention, the mobile terminal 30 has an artificial retina sensor module 30a (hereinafter, may be simply referred to as a “retina chip”) built therein, and the camera mechanism thereof allows the display 21 (or the display of the vending machine 22 to be displayed. The product (service) information calculated and displayed by the container is photographed as image data (path 201).

The product (service) information is, for example, as shown in a table form in FIG. 601, item name 602, display item name 60
3 and code 604 are provided, and the states in which the respective records are multiplexed are represented by 608 to 613. Item No. 1 and item number. 2 (608), 3 and 4
(609), 5 and 6 (610), 7 and 8 (611), 9
And 10 (612) are almost overlapped (in this case, duplicated) in order to prevent erroneous reading in image recognition described later. That is, in the value of alphanumeric characters after image recognition,
The image recognition work ends only when the code values of item Nos. 1 and 2 (608) are the same, and in other cases, the retransmission request work is performed. This is the other item (609, 610, 61
The same applies to 1, 612). In addition, as an example of each content, an item name group 605 and a display item name group 60
6, code group 607 is shown.

It is desirable to encrypt the product information after confirming the contents and before photographing. FIG. 3 shows a screen 30 displayed on the liquid crystal screen 301 or the like of the display 21.
3, display contents 304 thereof, and transmission data 305 transmitted from the mobile terminal 30 are illustrated. As shown in the figure, the product sale information is preferably encrypted in alphanumeric characters. However, the product sale information in characters is photographed and becomes image data, so encryption is not always necessary. In the kanji kana display, alphanumeric characters are preferable because there is a risk of misidentification during image recognition processing. Note that the display 21 may be a monitor of a personal computer terminal connected to the Internet, as long as it can display the product trade information.

The image data is transmitted from the portable terminal 30 to the authentication server 10 via the portable terminal server 31 which is a signal conversion server for connecting to the network 50 (route 202). The image data received by the authentication server 10 is character-recognized by an image recognition unit provided therein, and the authentication server 10 operates the mobile terminal 30.
After performing the authentication, the product information and the personal information are transmitted to the sales management server 23 (route 203). The transmission route at this time is a route that does not allow access to the outside such as the private line 60. In addition to using the private line 60 for transmission, it is possible to further enhance security by using a two-party encryption system or the like. Finally, the sales management server 23 transmits the payment permission information to the display 21 or the like based on the normal procedure of the credit company (route 204), and the payment settlement is completed. In the method of the present invention, since the display screen 303 of the display 21 is transmitted as an image signal from the mobile terminal 30 to the authentication server 10, there is no risk of interception even on a communication line with weak security such as the Internet. The authentication server 1
0 and the sales management server 23 may be physically the same server.

Next, a method of fetching and transmitting the image data will be described. FIG. 4 shows the configuration of the portable terminal 30 with a built-in retina chip. The portable terminal 30 has a lens-integrated artificial retina LSI 401 in which a lens 402 and an artificial retina LSI 403 are integrated with respect to the image data acquisition and transmission functions. The control unit 404 and the communication unit 405.
have. Further, the authentication server 10 includes an image processing algorithm mechanism 408, and reference numeral 406 is an image of an image signal transmitted from the communication unit 405 of the mobile terminal 30 to the authentication server 10. The display screen 303 of the display 21 is a lens-integrated artificial retina LSI of the mobile terminal 30.
An image is taken by 401, converted into image data by the artificial retina LSI 403 that receives an instruction from the control unit 404 through the lens 402, and is taken into the control unit 404. The image data is transmitted to the authentication server 10 as an image signal in the form of an image 406 via the communication unit 405,
Image processing algorithm mechanism 4 which is a part of the internal mechanism
It is restored to alphanumeric characters by 08.

FIG. 5 is a software block diagram of the control unit 404, and the program of this part is the authentication server 10.
Every time you access the
Is transferred to the control unit 404. Control unit 404
Is a system control unit 500 for controlling the entire system,
A shooting control unit 501 that controls shooting when shooting a target image, an image memory unit 502 that temporarily stores the shot image data, and a file name given in advance from the authentication server 10 for the image data. An image file name memory unit 504 for temporarily storing
It is composed of a mail generation unit 503 that generates a mail in which the image data and the file name are associated with each other, and a destination name memory unit 505 that holds a destination given in advance from the authentication server 10 until the time of mail transmission. ing.

The operation based on the software program transferred from the authentication server 10 will be described using a portable terminal compatible with the Internet. When you select the specific service menu of the mobile terminal 30 that supports the Internet,
From the authentication server 10 that sends the menu,
A program such as a program for controlling the mobile terminal 30 is transmitted, and the program operates in the mobile terminal 30. The authentication server 10 sends the menu at the same time
A file name and a destination (mail address) for the image data are issued, and these are transmitted together with the transfer program and held in the image file name memory unit 504 and the destination name memory unit 505, respectively.

The lens-integrated artificial retina LSI 401 is controlled by the imaging control unit 5 according to an instruction from the system control unit 500.
01 is started, and the photographing instruction is waited for. Here, for example, when the owner of the mobile terminal selects the “photographing” item in the menu, the photographing control unit 501 instructed by the system control unit 500 starts and finishes the photographing. Of course, if the shutter button is provided on the mobile terminal 30, it is possible to shoot without depending on the menu program. The captured image data is stored in the image memory unit 5 according to an instruction from the system control unit 500.
Accumulated in 02. The system control unit 500 instructs the mail generation unit 503 to associate the accumulated image data with the file name, and to associate this with the destination name memory unit 505.
The system control unit 500 instructs the communication unit 405 to send the e-mail.

FIG. 7 shows the authentication server 1 from the mobile terminal 30.
It is explanatory drawing which shows the flow of the data transmitted to the sales management server 23 via 0. The terminal ID 711 unique to the mobile terminal 30 is entered in the title portion of the email 700 transmitted from the mobile terminal 30 to the authentication server 10, and the image file name 714 of the attached image file 713 is captured in the email body 712. Has been. Further, the photographed image data 305 (or 406) is attached as an attached image file 713 of the email 700. The authentication server 10 analyzes the e-mail 700 as the composite signal into an original individual signal and separates it (721), character-recognizes the separated image data (722), and personally authenticates the separated and analyzed signal. It is created as a transmission signal 730 including sales permission data 731 consisting of data and product data (723). This transmission signal 730 is the above-mentioned dedicated line 60.
Through the sales management server 23. The sales management server 23 uses the credit information means it possesses to determine whether to sell or sell, and notifies the display 21 or the like of the result.

Next, the configuration of the authentication server 10 will be described with reference to the block diagram shown in FIG. The authentication server 10
A control unit 802 that controls the overall operation of the authentication server 10, a processing unit 803 that performs data processing, various input / output devices, and the network 50, as constituent units that should normally be provided for processing, inputting / outputting, and transmitting / receiving various data. I / O interface 801 connected to the input / output interface 801 and an input unit 8 for receiving data from the I / O interface 801
05, an output unit 806 for outputting data, a storage unit 804 for temporarily storing data during data processing, a receiving unit 807 for receiving various data, and a transmitting unit 808 for transmitting various data. ing.

The authentication server 10 further includes an e-mail 70 from the portable terminal 30 in addition to the above-mentioned components that should normally be provided.
0 has arrived in the designated folder 13 of the mail server 11, and the mail folder monitoring unit 811 that monitors whether or not
A mailer unit 810 that fetches the incoming mail into the authentication server 10, a mail data separating unit 812 that analyzes and separates the incoming mail into the original individual signal, and a terminal ID that determines whether or not the separated terminal ID is registered in advance. Judgment unit 8
13. Terminal I that stores the terminal ID registered in advance
D storage unit 814, input pattern correction unit 816 that corrects the separated image data, feature extraction unit 815 that detects the features of image characters from the image data, standard pattern that stores a standard pattern for image recognition Accumulator 81
7. An identification unit 81 which analyzes and recognizes as a character by using the standard pattern of the standard pattern storage unit 817 based on the characteristics thereof.
8, a personal information storage unit 819 for storing personal information corresponding to the registered terminal ID, and a permission information generation unit 820 for generating permission information including product information and personal information.

Next, the operation of the authentication server 10 will be described. Email 700 with image file 713 attached
Arrives at the designated folder 13 of the mail server 11 in FIG. The mail folder monitoring unit 811 that has sensed this incoming call reports the incoming email to the control unit 802. Upon receiving the report, the control unit 802 instructs the processing unit 803 to cause the mailer unit 810 to store the incoming mail to the storage unit 804.
Transfer to. The transferred mail is separated by the mail data separation unit 812 into each data regarding the terminal ID, the image file, and the image file name.

Of the separated data, first, for the terminal ID data, the terminal ID determination unit 813 determines whether the terminal ID data is already registered terminal ID storage unit 814.
Refer to and judge. If the terminal ID data is not already registered here, the fact is transmitted to the sales management server 23, and the display 21 or the like which receives the instruction from the sales management server 23 refuses the transaction of the product or service. Become. When the terminal ID is registered, the image file is transferred from the image recognition block to the permission information generation unit 820 as the next step. That is, in the image recognition block, first, the image pattern is corrected by the input pattern correction unit 816, the character characteristic is detected by the characteristic extraction unit 815, and then the standard pattern storage unit 817 detects the character characteristic. Using the standard pattern, the identification unit 818 performs character recognition to restore the product data. At this time, the identification unit 818 also collates the multiplexed data, as described with reference to FIG. 6, and determines whether the recognition is normal.

Next, the permission information generation unit 820 extracts the personal attribute information corresponding to the terminal ID from the personal information storage unit 819, combines this with the product data obtained from the image file, and is shown in FIG. A transmission signal 730 containing the sales permission data 731 is generated. This transmitted signal 73
0 is transmitted to the sales management server 23 by the processing unit 803 via the transmission unit 808 and the input / output interface 801.

In the above embodiment, the display (register)
Although all of the trade information displayed in 21 is transmitted as image data from the mobile terminal 30 to the authentication server 10, it is not always necessary to transmit all of the trade information. For example, the details of the product information are confirmed between the on-site display (register) 21 and the sales management server 23, and the sales management server 23 is notified when the authentication of the mobile terminal 30 is completed by the authentication server 10. The payment procedure may be completed. According to such a method, it is possible to reduce the work in the image recognition block of the authentication server 10.

[0024]

According to the invention of claim 1 or 2,
In the electronic payment method using a mobile terminal, the Internet, which is vulnerable to security, such as the Internet, sends only the product trading information converted into image data, and the personal information required for payment is communicated through a dedicated line with security. It is a payment method. According to the invention of the authentication server of claim 3, extremely secure electronic payment can be realized. According to the mobile terminal invention of the fourth aspect, extremely safe electronic payment can be realized.

[Brief description of drawings]

FIG. 1 is an overall explanatory diagram of an electronic payment method according to the present invention.

FIG. 2 is an explanatory diagram showing the basic principle of the settlement method according to the present invention.

FIG. 3 is an example of contents displayed on a monitor screen of a display device 21.

FIG. 4 is an internal configuration diagram of a mobile terminal incorporating a retina chip.

FIG. 5 is a software block configuration diagram in a control unit of a mobile terminal incorporating a retina chip.

FIG. 6 is an example in which the product information displayed on the display 21 is shown in a table format.

FIG. 7 is an explanatory diagram showing a flow of data transmitted from a mobile terminal to a sales management server via an authentication server.

FIG. 8 is a block diagram showing a configuration of an authentication server.

[Explanation of symbols]

10 Authentication server 21 Display of product information (register) 23 Sales Management Server 30 mobile terminals 30a artificial retina chip 50 network 60 leased lines

─────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁷ Identification code FI G07G 1/14 G07G 1/14 (56) References JP 2000-341657 (JP, A) JP 6-259557 (JP, A) JP 2001-222483 (JP, A) International publication 97/045814 (WO, A1) (58) Fields investigated (Int.Cl. ⁷ , DB name) G06F 17/60 G07G 1/12-1/14 G07F 7/00 H04B 7/26 H04N 1/00 G06K 7/00-9/00

Claims (4)

(57) [Claims] 1. A display device for merchandise information to be arranged at a payment site, a sales management server for managing and operating the display device, and a mobile terminal server for operating and managing a mobile terminal having an electronic camera or an artificial retina chip incorporated therein. said together to connect the authentication server to provide the authentication in the network to the mobile terminal, between the sales management server and the authentication server is connected by a dedicated line, there is provided a method of electronic payment using the mobile terminal , The sales management server or the display
The character product information encrypted by is displayed on the display.
Is, the portable terminal has been captured by said mobile terminal said
The encrypted text item information as images data via the portable terminal server and transmitted to the authentication server, after the authentication server is restored to the character commodity information the image data performs authentication of the mobile terminal, said authentication An electronic payment method using a mobile terminal, comprising transmitting personal information based on the above and the product information to the sales management server via the dedicated line. 2. A product information display device to be arranged at the price settlement site, a sales management server that manages and operates the product information device, and a mobile terminal server that manages and manages a mobile device incorporating an electronic camera or an artificial retina chip. A method of connecting an authentication server for giving authentication to the mobile terminal via a network, connecting the authentication server and the sales management server with a dedicated line, and making an electronic payment using the mobile terminal, Text product information duplicated by the sales management server or the display is displayed on the display, and the mobile terminal uses the duplicate text product information captured by the mobile terminal as image data via the mobile terminal server. Send to the authentication server, the authentication server authenticates the mobile terminal, and restores the image data to text product information. After that, the personal settlement based on the authentication and the merchandise information are transmitted to the sales management server via the dedicated line to the electronic settlement method using a mobile terminal. 3. A mail folder monitoring unit that monitors the arrival of an electronic mail including the terminal ID of the mobile terminal and the image data, and a terminal ID storage unit that registers and stores the terminal ID in advance. The personal information storage unit that stores personal information corresponding to the terminal ID, the terminal ID determination unit that analyzes the incoming mail and determines whether the separated terminal ID is registered, and the separated 7. An image recognition block for image-recognizing image data to generate product information composed of character information, and a permission information generation unit for generating permission information composed of the product information and personal information. An authentication server used in the electronic payment method according to claim 1 or 2 . 4. An artificial retina chip having a lens and an artificial retina LSI integrated therein, a control unit for the artificial retina chip, a communication unit, and a program forming the control unit, a system control unit for controlling the entire system, and an image capturing operation. an imaging control unit for controlling the, characterized by comprising the photographed image data from the temporary storing the image memory unit according to claim 1 or claim 2
A mobile terminal used in the described electronic payment method.