CN113643489B - Public transit pos machine based on face identification - Google Patents
Public transit pos machine based on face identification Download PDFInfo
- Publication number
- CN113643489B CN113643489B CN202110691888.8A CN202110691888A CN113643489B CN 113643489 B CN113643489 B CN 113643489B CN 202110691888 A CN202110691888 A CN 202110691888A CN 113643489 B CN113643489 B CN 113643489B
- Authority
- CN
- China
- Prior art keywords
- payment
- information
- verification
- face
- fingerprint
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07G—REGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS
- G07G1/00—Cash registers
- G07G1/12—Cash registers electronically operated
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q20/00—Payment architectures, schemes or protocols
- G06Q20/38—Payment protocols; Details thereof
- G06Q20/40—Authorisation, e.g. identification of payer or payee, verification of customer or shop credentials; Review and approval of payers, e.g. check credit lines or negative lists
- G06Q20/401—Transaction verification
- G06Q20/4014—Identity check for transactions
- G06Q20/40145—Biometric identity checks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
- H04L63/0861—Network architectures or network communication protocols for network security for authentication of entities using biometrical features, e.g. fingerprint, retina-scan
Landscapes
- Engineering & Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Business, Economics & Management (AREA)
- Computer Hardware Design (AREA)
- Accounting & Taxation (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Computing Systems (AREA)
- Strategic Management (AREA)
- General Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- Health & Medical Sciences (AREA)
- Theoretical Computer Science (AREA)
- General Business, Economics & Management (AREA)
- Finance (AREA)
- Financial Or Insurance-Related Operations Such As Payment And Settlement (AREA)
- Devices For Checking Fares Or Tickets At Control Points (AREA)
- Cash Registers Or Receiving Machines (AREA)
Abstract
Description
技术领域technical field
本发明涉及智能公交乘车支付技术领域,尤其涉及一种基于人脸识别的公交pos机。The invention relates to the technical field of intelligent public transportation payment technology, in particular to a public transportation POS machine based on face recognition.
背景技术Background technique
随着信息网络技术的不断发展,人们在生活中应用数字人民币的场景越来越多,目前,使用数字人民币的主要方式是扫二维码通过绑定的银行账户支付,扫码支付的方式随早已可以应用在公交、地铁乘车支付上,但每次乘车仍需用手机进行打开二维码的操作,不够方便;同时,目前公交车上的二维码识别设备的识别率一般,经常会出现因上车乘客扫码失败堵在车门口而影响后面的上车乘客的现象。另外,公交车乘客中还包含大量的特殊乘客,其中有老人、儿童、军人、残疾人等,这些特殊乘客的乘车待遇不同,因此二维码支付乘车享受优惠待遇尚不能实现。With the continuous development of information network technology, people are using digital renminbi in more and more scenarios in their lives. At present, the main way to use digital renminbi is to scan the QR code and pay through the bound bank account. It can already be applied to bus and subway ride payment, but it is not convenient to open the QR code with a mobile phone every time you take a bus. There will be a phenomenon that the passengers who get on the bus will be blocked at the door due to the failure to scan the code, which will affect the passengers who get on the bus behind. In addition, bus passengers also include a large number of special passengers, including the elderly, children, soldiers, disabled people, etc. These special passengers have different ride treatment, so the preferential treatment of paying by QR code is not yet realized.
目前,公开的现有技术中包括一些通过采集乘客生物特征进行支付的公交车乘车支付方法,但当生物特征识别系统对采集到的个体生物特征无法准确判定时(比如:用户长时间未更新本人生物特征信息、乘客是“大众脸”等),便会导致生物特征识别验证失败。At present, the disclosed prior art includes some payment methods for bus rides by collecting passenger biometrics for payment, but when the biometric identification system cannot accurately determine the collected individual biometrics (such as: the user has not updated for a long time Personal biometric information, passenger is "public face", etc.), it will cause the biometric verification to fail.
发明内容Contents of the invention
本发明提供一种基于人脸识别的公交pos机,以克服上述技术问题。The present invention provides a bus pos machine based on face recognition to overcome the above technical problems.
本发明一种基于人脸识别的公交pos机,包括车载支付终端,通过实时与远程支付控制中心通信以进行支付确认,所述远程支付控制中心,包括:多个区域验证服务器以及总端验证服务器;所述车载支付终端包括支付采集设备、主控单元以及支付提示设备;所述区域验证服务器用于在给定的通讯距离内与所述车载支付终端进行实时通讯,并对所述主控单元上传的经加密打包后的乘客支付数据包进行解析后验证乘客身份信息;若验证成功,则通过扣费模块对乘客绑定账户进行扣费;若验证失败,则将所述乘客支付数据包发送所述总端验证服务器验证;所述乘客绑定账户为数字人民币账户;当所述总端验证服务器返回验证成功信息,则通过扣费模块对乘客绑定账户进行扣费,否则判定支付失败;所述区域验证服务器将支付验证结果发送所述主控单元;所述总端验证服务器,用于以所述区域验证服务器对应的服务器身份验证码对所述乘客支付数据包解密后进行二次身份验证,若验证通过,则将验证成功信息发送所述区域验证服务器,并将所述区域验证服务器返回的支付信息归类存储;否则向所述区域验证服务器发送验证失败信息;所述支付采集设备,用于以生物特征识别支付的采集方式采集乘客支付信息,并发送所述主控单元;所述主控单元,用于向所述总端验证服务器发送车载身份识别信息,并在车载身份验证成功后,调用预设的车载终端排班表确定车载终端线路途径的总端验证服务器并通知总端验证服务器为车载支付终端配置支付扣费运行环境;用于将所述乘客支付信息加密打包为所述乘客支付数据包,发送所述区域验证服务器;并接收所述支付验证结果,发送所述支付提示设备;所述支付提示设备,用于根据所述主控单元发送的支付验证结果进行同步语音提醒。A bus pos machine based on face recognition in the present invention includes a vehicle-mounted payment terminal, which communicates with a remote payment control center in real time to confirm payment. The remote payment control center includes: multiple regional verification servers and a headquarter verification server The vehicle-mounted payment terminal includes a payment acquisition device, a main control unit, and a payment reminder device; the regional verification server is used for real-time communication with the vehicle-mounted payment terminal within a given communication distance, and the main control unit The uploaded encrypted and packaged passenger payment data package is parsed and verified to verify the passenger’s identity information; if the verification is successful, the passenger’s binding account is deducted through the deduction module; if the verification fails, the passenger’s payment data package is sent to The head end verification server verifies; the passenger binding account is a digital RMB account; when the head end verification server returns verification success information, the passenger binding account is deducted through the fee deduction module, otherwise it is determined that the payment fails; The area verification server sends the payment verification result to the main control unit; the head end verification server is used to decrypt the passenger payment data packet with the server identity verification code corresponding to the area verification server and perform secondary identity verification. verification, if the verification is passed, then the verification success information is sent to the regional verification server, and the payment information returned by the regional verification server is classified and stored; otherwise, the verification failure information is sent to the regional verification server; the payment collection device , used to collect passenger payment information in the collection mode of biometric identification payment, and send the main control unit; the main control unit is used to send the vehicle identification information to the head verification server, and verify After success, call the preset on-board terminal schedule to determine the head-end verification server of the on-board terminal line route and notify the head-end verification server to configure the payment deduction operating environment for the on-board payment terminal; to encrypt and package the passenger payment information as The passenger payment data packet is sent to the regional verification server; and the payment verification result is received and sent to the payment prompt device; the payment prompt device is used to synchronize according to the payment verification result sent by the main control unit Voice reminder.
进一步地,所述支付采集设备包括第一支付采集设备、第二支付采集设备;所述第一支付采集设备,用于以自动投币支付、刷卡支付、扫码支付的采集方式采集乘客支付信息;所述第二支付采集设备,用于以生物特征识别支付的采集方式采集乘客支付信息;所述生物特征识别支付包括指纹、人脸、声纹及虹膜中至少两种识别支付方式。Further, the payment collection device includes a first payment collection device and a second payment collection device; the first payment collection device is used to collect passenger payment information in the collection methods of automatic coin-operated payment, card swiping payment, and code scanning payment The second payment collection device is used to collect payment information of passengers by means of biometric payment collection; the biometric payment includes at least two recognition payment methods among fingerprint, face, voiceprint and iris.
进一步地,所述扣费模块,包括第一扣费子模块以及第二扣费子模块;所述第一扣费子模块,用于在乘客采用所述第一支付采集设备的支付扣费运行环境下进行自动扣费;所述第二支付扣费子模块,用于在乘客采用所述第二支付采集设备的支付扣费运行环境下进行自动扣费。Further, the fee deduction module includes a first fee deduction submodule and a second fee deduction submodule; the first fee deduction submodule is used for the operation of deduction of fees when passengers use the first payment collection device The automatic fee deduction is performed under the environment; the second payment deduction sub-module is used to perform automatic deduction under the payment deduction operation environment in which the passenger uses the second payment collection device.
进一步地,所述第一扣费子模块,用于识别出乘客的支付方式是属于刷卡支付还是扫码支付;若属于刷卡支付,则基于预设的扣费列表确定当前乘客公交卡信息是否与所述扣费列表内的某一注册信息匹配,匹配则自动后台扣费;若属于扫码支付,则启动关联程序与各大支付平台通信,并确定用户提供的扫码信息是否与任意支付平台的用户列表内信息相匹配,匹配则自动扣费;所述第二支付扣费子模块,用于同时采集乘客的指纹识别支付以及人脸识别支付信息,并基于两者生成用户身份识别信息数据包;分别核验指纹信息、人脸信息是否均为设备认证的合法用户;是则确定用户信息正确并授权进行支付结算;否则提示验证失败不能继续后续的支付结算,所述结算方式采用数字人民币形式。Further, the first fee deduction sub-module is used to identify whether the payment method of the passenger belongs to payment by card or code scanning; A certain registration information in the deduction list matches, and if the match is automatically deducted in the background; if it belongs to scanning code payment, then start the associated program to communicate with major payment platforms, and determine whether the scanning code information provided by the user is compatible with any payment platform The information in the user list matches, and the matching will automatically deduct the fee; the second payment deduction sub-module is used to collect the passenger’s fingerprint recognition payment and face recognition payment information at the same time, and generate user identification information data based on the two package; respectively verify whether the fingerprint information and face information are legal users authenticated by the device; if yes, confirm that the user information is correct and authorize payment and settlement; otherwise, it will prompt that the verification fails and the subsequent payment and settlement cannot be continued, and the settlement method is in the form of digital RMB .
进一步地,所述核验指纹信息、人脸信息是否均为设备认证的合法用户,包括:与所述区域验证服务器通信,确定当前所上传的指纹信息是否能够在指纹信息数据库内找到,是则确定验证通过;Further, the verification of whether the fingerprint information and face information are legitimate users of device authentication includes: communicating with the regional verification server to determine whether the currently uploaded fingerprint information can be found in the fingerprint information database, and if so, determine Verification passed;
通过式(1)判断当前所上传的指纹信息是否能够在指纹信息数据库内找到;Judging whether the currently uploaded fingerprint information can be found in the fingerprint information database by formula (1);
式中,o为当前所上传的指纹信息,p是指纹信息数据库内指纹,Vm表示当前所上传的指纹信息特征的置信度,Vn表示指纹信息数据库内指纹特征的置信度,取值范围[0,1],ln(*)表示使用对比损失训练的孪生网络抽取后的特征,fo(*)表示对指纹信息进行去噪处理,表示轮廓三阶导数,o′,p′表示二值化后的指纹信息;fa表示当前所上传的指纹与指纹信息数据库内指纹的最大相似度,相似度大于阈值则表示当前所上传的指纹信息能够在指纹信息数据库内找到;In the formula, o is the currently uploaded fingerprint information, p is the fingerprint in the fingerprint information database, V m represents the confidence degree of the currently uploaded fingerprint information feature, V n represents the confidence degree of the fingerprint feature in the fingerprint information database, and the value range [0,1], l n (*) represents the features extracted by the Siamese network trained with contrastive loss, f o (*) represents the denoising processing of fingerprint information, Indicates the third-order derivative of the contour, o', p'indicates the fingerprint information after binarization; fa indicates the maximum similarity between the currently uploaded fingerprint and the fingerprint in the fingerprint information database, and if the similarity is greater than the threshold, it indicates the currently uploaded fingerprint information Can be found in the fingerprint information database;
与所述区域验证服务器通信,确定当前所上传的人脸信息是否能够在人脸信息数据库内找到,是则确定验证通过;Communicate with the regional verification server to determine whether the currently uploaded face information can be found in the face information database, and if so, determine that the verification is passed;
通过式(2)判断所上传的人脸信息是否能够在人脸信息数据库内找到;Whether the uploaded face information can be found in the face information database by formula (2);
式中,r为当前所上传的人脸信息,b是人脸信息数据库内人脸,Vc表示当前所上传的人脸信息特征的置信度,Vd表示人脸信息数据库内人脸特征的置信度,取值范围[0,1],ld(*)表示使用对比损失训练的孪生网络抽取后的特征,fr(*)表示使用交叉熵训练的卷积网络提取五官特征,r′,b′表示序列化后的人脸信息;rl表示当前所上传的人脸与人脸信息数据库内人脸的最大相似度,相似度大于阈值则表示当前所上传的人脸信息能够在人脸信息数据库内找到。In the formula, r is the currently uploaded face information, b is the face in the face information database, V c represents the confidence degree of the currently uploaded face information feature, V d represents the face feature in the face information database Confidence, value range [0,1], l d (*) represents the feature extracted by the Siamese network trained with contrastive loss, f r (*) represents the facial features extracted by the convolutional network trained by cross entropy, r′ ,b' represents the serialized face information; rl represents the maximum similarity between the currently uploaded face and the face in the face information database, and if the similarity is greater than the threshold, it means that the currently uploaded face information can be included in the face found in the information database.
进一步地,所述将所述乘客支付信息加密打包为所述乘客支付数据包的过程包括:基于第一加密算法对所述第二支付信息、上传时的时间以及位置信息进行加密成固定位数的加密信息;基于第二加密算法对车载身份识别信息进行加密成固定位数的加密信息;两者加密信息组成一个完整信息;所述第一加密算法的密级高于所述第二加密算法;相应的区域验证服务器内置所述第一加密算法的解密算法以及所述第二加密算法的解密算法;并配置所述第二加密算法或者第三加密算法对区域验证服务身份验证码进行加密。Further, the process of encrypting and packaging the passenger payment information into the passenger payment data package includes: encrypting the second payment information, upload time and location information into a fixed number of digits based on a first encryption algorithm encrypted information; based on the second encryption algorithm, the vehicle identification information is encrypted into encrypted information with a fixed number of digits; the two encrypted information form a complete message; the encryption level of the first encryption algorithm is higher than that of the second encryption algorithm; The corresponding area verification server has a built-in decryption algorithm of the first encryption algorithm and a decryption algorithm of the second encryption algorithm; and configures the second encryption algorithm or the third encryption algorithm to encrypt the identity verification code of the area verification service.
进一步地,所述乘客支付数据包,包括:指纹信息、人脸信息以及用户信息-临时id;所述区域验证服务器核验指纹信息、人脸信息均为设备认证的合法用户后,确定所述用户信息-临时id为用户可授权信息并授权进行支付结算;否则提示验证失败不能继续后续的支付结算。Further, the passenger payment data package includes: fingerprint information, face information, and user information-temporary id; after the regional verification server verifies that the fingerprint information and face information are all legitimate users authenticated by the device, it determines that the user Information-Temporary id is the information that the user can authorize and authorize the payment and settlement; otherwise, it will prompt that the verification fails and the subsequent payment and settlement cannot be continued.
进一步地,所述确定所述用户信息-临时id为用户可授权信息并授权进行支付结算,包括:将所述用户信息-临时id替换为用户可授权信息,所述用户可授权信息为所述指纹信息与人脸信息组合加密后生成的验证信息;查找授权信息数据库内是否存在与所述验证信息相匹配的信息,在匹配度一致时确定可以进行授权进行支付结算。Further, the determining that the user information-temporary id is user-authorizable information and authorizing payment and settlement includes: replacing the user information-temporary id with user-authorizable information, and the user-authorizable information is the user-authorizable information The verification information generated after fingerprint information and face information are combined and encrypted; check whether there is information matching the verification information in the authorization information database, and determine that authorization can be carried out for payment and settlement when the matching degree is consistent.
进一步地,所述第一支付采集设备设有图像采集器;所述图像采集器用于识别投币的面值并记录每次投币金额。Further, the first payment collection device is provided with an image collector; the image collector is used to identify the face value of the coin and record the amount of each coin.
进一步地,所述第一支付采集设备还设有报警提示器,当所述投币金额小于规定最小金额时进行报警。Further, the first payment collection device is also provided with an alarm prompter, which will give an alarm when the amount of the coin inserted is less than the specified minimum amount.
本发明通过实时与远程支付控制中心通信进行支付确认;远程支付控制中心,包括:多个区域验证服务器以及总端验证服务器;区域验证服务器用于在给定的通讯距离内与车载支付终端进行实时通讯,并对车载支付终端上传的生物特征识别支付信息进行乘客身份验证;若验证成功,则直接扣费,若验证失败,则将乘客的生物特征识别支付信息发送总端验证服务器进行二次验证,若二次验证成功则向区域验证服务器返回成功信息进行扣费,若失败,则返回判定失败信息。通过一次验证不成功的情况下再进行二次验证,两次均失败才判定为验证失败,从而提高了对生物特征验证的识别率和准确性。The present invention confirms the payment by communicating with the remote payment control center in real time; the remote payment control center includes: a plurality of regional verification servers and a head end verification server; Communication, and conduct passenger identity verification on the biometric payment information uploaded by the vehicle payment terminal; if the verification is successful, the fee will be deducted directly; if the verification fails, the passenger’s biometric payment information will be sent to the main terminal verification server for secondary verification , if the secondary verification is successful, it will return a success message to the regional verification server for fee deduction, and if it fails, it will return a judgment failure message. If the first verification is unsuccessful, the second verification is performed, and it is judged that the verification fails only if the verification fails twice, thereby improving the recognition rate and accuracy of biometric verification.
附图说明Description of drawings
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作以简单地介绍,显而易见地,下面描述中的附图是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description These are some embodiments of the present invention. For those skilled in the art, other drawings can also be obtained according to these drawings without any creative effort.
图1为本发明一种基于人脸识别的公交pos机的结构示意图。Fig. 1 is a schematic structural diagram of a bus pos machine based on face recognition in the present invention.
具体实施方式Detailed ways
为使本发明实施例的目的、技术方案和优点更加清楚,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.
如图1所示,本实施例提供了一种基于人脸识别的公交pos机,包括车载支付终端,通过实时与远程支付控制中心通信以进行支付确认,远程支付控制中心,包括多个区域验证服务器以及总端验证服务器;车载支付终端包括支付采集设备、主控单元以及支付提示设备;As shown in Figure 1, this embodiment provides a bus pos machine based on face recognition, including a vehicle payment terminal, through real-time communication with the remote payment control center for payment confirmation, remote payment control center, including multiple area verification The server and the terminal verification server; the vehicle payment terminal includes a payment collection device, a main control unit and a payment reminder device;
区域验证服务器用于在给定的通讯距离内与车载支付终端进行实时通讯,并对主控单元上传的经加密打包后的乘客支付数据包进行解析后验证乘客身份信息;若验证成功,则通过扣费模块对乘客绑定账户进行扣费;若验证失败,则将乘客支付数据包发送总端验证服务器验证;当总端验证服务器返回验证成功信息,则通过扣费模块对乘客绑定账户进行扣费,否则判定支付失败;区域验证服务器将支付验证结果发送主控单元;The regional verification server is used for real-time communication with the vehicle payment terminal within a given communication distance, and verifies the identity information of the passenger after analyzing the encrypted and packaged passenger payment data package uploaded by the main control unit; if the verification is successful, it passes The deduction module deducts the fee from the passenger’s bound account; if the verification fails, the passenger’s payment data packet is sent to the verification server at the head end for verification; Deduct the fee, otherwise it will be determined that the payment has failed; the regional verification server will send the payment verification result to the main control unit;
多个区域验证服务器分布设置在城市的各公交线路区域,区域验证服务器,区域验证服务器包括了支付验证系统、生物特征验证系统以及用户账户数据库和生物特征数据库。用户乘车前预先登录到公交车服务系统,公交车服务系统连接区域验证服务器。用户需要录入个人基本信息、个人银行卡信息,并绑定银行卡充值金额,信息保存在用户账户数据库中。再录入个人生物特征信息,生物特征信息包括人脸信息、指纹信息,还可以录入虹膜、声纹等信息,个人生物特征信息保存在生物特征数据库中。A plurality of regional verification servers are distributed in various bus line areas of the city, and the regional verification servers include a payment verification system, a biometric verification system, a user account database, and a biometric database. The user logs in to the bus service system in advance before taking the bus, and the bus service system connects to the regional verification server. Users need to enter personal basic information, personal bank card information, and bind the bank card recharge amount, and the information is stored in the user account database. Then enter personal biometric information, which includes face information, fingerprint information, iris, voiceprint and other information, and personal biometric information is stored in the biometric database.
总端验证服务器,用于以区域验证服务器对应的服务器身份验证码对乘客支付数据包解密后进行二次身份验证,若验证通过,则将验证成功信息发送区域验证服务器,并将区域验证服务器返回的支付信息归类存储;否则向区域验证服务器发送验证失败信息;The terminal verification server is used to decrypt the passenger payment data packet with the server identity verification code corresponding to the regional verification server and perform secondary identity verification. If the verification is passed, the verification success information will be sent to the regional verification server, and the regional verification server will return The payment information is classified and stored; otherwise, the verification failure information is sent to the regional verification server;
总端验证服务器,同样包括了支付验证系统、生物特征验证系统以及用户账户数据库和生物特征数据库。但总端验证服务器中的生物特征数据库中的数据基于公安系统的生物特征数据,相对于区域验证服务器中的生物特征数据可信度和识别度更高。The terminal verification server also includes a payment verification system, a biometric verification system, a user account database, and a biometric database. However, the data in the biometric database in the headquarter verification server is based on the biometric data of the public security system, which is more reliable and recognizable than the biometric data in the regional verification server.
支付采集设备,用于以生物特征识别支付的采集方式采集乘客支付信息,并发送主控单元;The payment collection device is used to collect passenger payment information by means of biometric payment collection and send it to the main control unit;
主控单元的第一个重要作用是在车载支付终端开启时,向总端验证服务器发送车载身份识别信息,并在车载身份验证成功后,调用预设的车载终端排班表确定车载终端线路途径的总端验证服务器并通知总端验证服务器为车载支付终端配置支付扣费运行环境;第二个作用是用于将乘客支付信息加密打包为乘客支付数据包,发送区域验证服务器,并接收支付验证结果,发送支付提示设备。The first important function of the main control unit is to send the vehicle identification information to the terminal verification server when the vehicle payment terminal is turned on, and after the vehicle identity verification is successful, call the preset vehicle terminal schedule to determine the vehicle terminal line route The main terminal verification server and notify the main terminal verification server to configure the payment deduction operating environment for the vehicle payment terminal; the second function is to encrypt and package the passenger payment information into a passenger payment data package, send it to the regional verification server, and receive payment verification As a result, a payment reminder device is sent.
支付提示设备,用于根据主控单元发送的支付验证结果进行同步语音提醒。支付提示可以仅通过显示屏显示支付结果,也可以增加语音提醒。The payment reminder device is used for synchronous voice reminder according to the payment verification result sent by the main control unit. The payment reminder can only display the payment result through the display screen, or add a voice reminder.
本实施例,支付采集设备包括第一支付采集设备、第二支付采集设备;In this embodiment, the payment collection device includes a first payment collection device and a second payment collection device;
第一支付采集设备,用于以自动投币支付、刷卡支付、扫码支付的采集方式采集乘客支付信息;The first payment collection device is used to collect passenger payment information in the collection methods of automatic coin-operated payment, credit card payment, and code-scanning payment;
第二支付采集设备,用于以生物特征识别支付的采集方式采集乘客支付信息;生物特征识别支付包括指纹识别支付以及人脸识别支付。第二支付采集设备,包括人脸识别器、指纹识别器、虹膜识别器、声纹识别器中至少两种,采用双重身份验证的目的是,因为有的人脸识别设备,在面对大众脸时候可能出现B被识别为A的风险,双重认证的好处是在降低风险的同时,对人脸识别设备的精度要求适当降低,减少设备成本。The second payment acquisition device is used to collect payment information of passengers by means of biometric identification payment; biometric identification payment includes fingerprint identification payment and face recognition payment. The second payment collection device includes at least two types of face recognition devices, fingerprint recognition devices, iris recognition devices, and voiceprint recognition devices. Sometimes there may be a risk that B is identified as A. The advantage of double authentication is that while reducing the risk, the accuracy requirements for face recognition equipment are appropriately reduced, and equipment costs are reduced.
本实施例中采用的是人脸识别器和指纹识别器的生物特征识别组合,乘客登车后,正脸看向人脸识别器,人脸识别器对第一生物特征信息人脸特征信息进行识别,用采集到的人脸信息匹配生物特征服务器中存储的用户人脸特征信息,得出匹配度结果1。乘客再通过指纹识别器录入指纹信息,指纹识别器对第二生物特征信息指纹特征信息进行识别,用采集到的指纹信息匹配生物特征服务器中存储的用户指纹信息,得出匹配度结果2,根据匹配度结果在支付服务器中调取与用户的生物特征信息所属的用户账号信息发送支付信息确认指令。In this embodiment, the biometric combination of a face recognizer and a fingerprint recognizer is used. After the passenger boards the car, he looks directly at the face recognizer, and the face recognizer performs the first biometric feature information on the facial feature information. Identify, use the collected face information to match the user's face feature information stored in the biometric server, and obtain a matching result of 1. The passenger then enters the fingerprint information through the fingerprint reader, and the fingerprint reader recognizes the fingerprint feature information of the second biometric information, matches the fingerprint information of the user stored in the biometric server with the collected fingerprint information, and obtains the matching result 2, according to As a result of the matching degree, the payment server retrieves the user account information to which the biometric information of the user belongs and sends a payment information confirmation instruction.
本实施例,扣费模块,包括第一扣费子模块以及第二扣费子模块;第一扣费子模块,用于在乘客采用第一支付采集设备的支付扣费运行环境下进行自动扣费;第二支付扣费子模块,用于在乘客采用第二支付采集设备的支付扣费运行环境下进行自动扣费。In this embodiment, the fee deduction module includes a first fee deduction submodule and a second fee deduction submodule; the first fee deduction submodule is used to perform automatic deduction under the payment deduction operation environment in which the passenger adopts the first payment collection device fee; the second payment deduction sub-module is used for automatic deduction in the payment and deduction operation environment where the passenger adopts the second payment acquisition device.
其中,乘客采用第一支付采集设备的支付扣费运行环境下进行自动扣费的过程,包括:识别出乘客的支付方式是属于刷卡支付还是扫码支付;若属于刷卡支付,则基于预设的扣费列表确定当前乘客公交卡信息是否与扣费列表内的某一注册信息匹配,匹配则自动后台扣费;若属于扫码支付,则启动关联程序与各大支付平台通信,并确定用户提供的扫码信息是否与任意支付平台的用户列表内信息相匹配,匹配则自动扣费;Among them, the process of automatically deducting fees under the payment deduction operating environment of the first payment collection device for passengers includes: identifying whether the passenger's payment method belongs to payment by card or scanning code; if it belongs to payment by card, then based on the preset The deduction list determines whether the current passenger’s bus card information matches a certain registration information in the deduction list, and if it matches, it will automatically deduct the fee in the background; if it belongs to scanning code payment, it will start the associated program to communicate with major payment platforms, and determine the user’s provided information. Whether the scanned code information matches the information in the user list of any payment platform, and if the match is matched, the fee will be automatically deducted;
乘客采用第二支付采集设备的支付扣费运行环境下进行自动扣费的过程,包括:同时采集乘客的指纹识别支付以及人脸识别支付信息,并基于两者生成用户身份识别信息数据包;分别核验指纹信息、人脸信息是否均为设备认证的合法用户;是则确定用户信息正确并授权进行支付结算;否则提示验证失败不能继续后续的支付结算,结算方式采用数字人民币形式。The process of automatically deducting fees under the payment deduction operating environment of the second payment collection device for passengers includes: simultaneously collecting the passenger's fingerprint recognition payment and face recognition payment information, and generating user identification information data packets based on the two; respectively Verify whether the fingerprint information and face information are legitimate users authenticated by the device; if yes, confirm that the user information is correct and authorize payment and settlement; otherwise, it will prompt that the verification fails and the subsequent payment and settlement cannot continue, and the settlement method is in the form of digital RMB.
其中,核验指纹信息、人脸信息是否均为设备认证的合法用户的过程,包括:与区域验证服务器通信,确定当前所上传的指纹信息是否能够在指纹信息数据库内找到,是则确定验证通过;Among them, the process of verifying whether the fingerprint information and face information are legitimate users of device authentication includes: communicating with the regional verification server to determine whether the currently uploaded fingerprint information can be found in the fingerprint information database, and if so, confirm that the verification is passed;
通过式(1)判断当前所上传的指纹信息是否能够在指纹信息数据库内找到;Judging whether the currently uploaded fingerprint information can be found in the fingerprint information database by formula (1);
式中,o为当前所上传的指纹信息,p是指纹信息数据库内指纹,Vm表示当前所上传的指纹信息特征的置信度,Vn表示指纹信息数据库内指纹特征的置信度,取值范围[0,1],ln(*)表示使用对比损失训练的孪生网络抽取后的特征,fo(*)表示对指纹信息进行去噪处理,表示轮廓三阶导数,o′,p′表示二值化后的指纹信息;fa表示当前所上传的指纹与指纹信息数据库内指纹的最大相似度,相似度大于阈值则表示当前所上传的指纹信息能够在指纹信息数据库内找到;In the formula, o is the currently uploaded fingerprint information, p is the fingerprint in the fingerprint information database, V m represents the confidence degree of the currently uploaded fingerprint information feature, V n represents the confidence degree of the fingerprint feature in the fingerprint information database, and the value range [0,1], l n (*) represents the features extracted by the Siamese network trained with contrastive loss, f o (*) represents the denoising processing of fingerprint information, Indicates the third-order derivative of the contour, o', p'indicates the fingerprint information after binarization; fa indicates the maximum similarity between the currently uploaded fingerprint and the fingerprint in the fingerprint information database, and if the similarity is greater than the threshold, it indicates the currently uploaded fingerprint information Can be found in the fingerprint information database;
与区域验证服务器通信,确定当前所上传的人脸信息是否能够在人脸信息数据库内找到,是则确定验证通过;Communicate with the regional verification server to determine whether the currently uploaded face information can be found in the face information database, and if so, determine that the verification is passed;
通过式(2)判断所上传的人脸信息是否能够在人脸信息数据库内找到;Whether the uploaded face information can be found in the face information database by formula (2);
式中,r为当前所上传的人脸信息,b是人脸信息数据库内人脸,Vc表示当前所上传的人脸信息特征的置信度,Vd表示人脸信息数据库内人脸特征的置信度,取值范围[0,1],ld(*)表示使用对比损失训练的孪生网络抽取后的特征,fr(*)表示使用交叉熵训练的卷积网络提取五官特征,r′,b′表示序列化后的人脸信息;rl表示当前所上传的人脸与人脸信息数据库内人脸的最大相似度,相似度大于阈值则表示当前所上传的人脸信息能够在人脸信息数据库内找到。In the formula, r is the currently uploaded face information, b is the face in the face information database, V c represents the confidence degree of the currently uploaded face information feature, V d represents the face feature in the face information database Confidence, value range [0,1], l d (*) represents the feature extracted by the Siamese network trained with contrastive loss, f r (*) represents the facial features extracted by the convolutional network trained by cross entropy, r′ ,b' represents the serialized face information; rl represents the maximum similarity between the currently uploaded face and the face in the face information database, and if the similarity is greater than the threshold, it means that the currently uploaded face information can be included in the face found in the information database.
本实施例,第二乘客支付数据包经加密打包的过程包括:基于第一加密算法对第二支付信息、上传时的时间以及位置信息进行加密成固定位数的加密信息;基于第二加密算法对车载身份识别信息进行加密成固定位数的加密信息;两者加密信息组成一个完整信息;第一加密算法的密级高于第二加密算法;相应的区域验证服务器内置第一加密算法的解密算法以及第二加密算法的解密算法;并配置第二加密算法或者第三加密算法对区域验证服务身份验证码进行加密。In this embodiment, the process of encrypting and packaging the second passenger payment data package includes: encrypting the second payment information, upload time and location information based on the first encryption algorithm into encrypted information with a fixed number of digits; Encrypt the vehicle identification information into encrypted information with a fixed number of digits; the two encrypted information form a complete message; the encryption level of the first encryption algorithm is higher than that of the second encryption algorithm; the corresponding regional verification server has a built-in decryption algorithm of the first encryption algorithm and the decryption algorithm of the second encryption algorithm; and configure the second encryption algorithm or the third encryption algorithm to encrypt the identity verification code of the regional verification service.
本实施例,用户身份识别信息数据包,包括:指纹信息、人脸信息以及用户信息-临时id;核验指纹信息、人脸信息均为设备认证的合法用户后,确定用户信息-临时id为用户可授权信息并授权进行支付结算;否则提示验证失败不能继续后续的支付结算。In this embodiment, the user identification information data package includes: fingerprint information, face information and user information-temporary id; You can authorize the information and authorize the payment and settlement; otherwise, it will prompt that the verification fails and you cannot continue the subsequent payment and settlement.
其中,确定用户信息-临时id为用户可授权信息并授权进行支付结算,包括:将用户信息-临时id替换为用户可授权信息,用户可授权信息为指纹信息与人脸信息组合加密后生成的验证信息;查找授权信息数据库内是否存在与验证信息相匹配的信息,在匹配度一致时确定可以进行授权进行支付结算。Among them, determining the user information-temporary id as user-authorizable information and authorizing payment and settlement includes: replacing the user information-temporary id with user-authorizable information, and the user-authorizable information is generated after fingerprint information and face information are combined and encrypted Verify information; check whether there is information matching the verification information in the authorization information database, and determine that authorization can be performed for payment and settlement when the matching degree is consistent.
本实施例,第一支付采集设备的收钱箱内设置有图像采集器,其用于识别自动投币的面值并记录每次投币金额,以便于后续进行金额统计。In this embodiment, the cash collection box of the first payment collection device is provided with an image collector, which is used to identify the face value of the automatic coin insertion and record the amount of each coin insertion, so as to facilitate subsequent amount statistics.
本实施例,第一支付采集设备还设有报警提示器,当所述投币金额小于规定最小金额时进行报警,防止一些不文明乘客逃票或不按规定投币支付乘车。In this embodiment, the first payment acquisition device is also provided with an alarm prompter, which will alarm when the coin amount is less than the specified minimum amount, so as to prevent some uncivilized passengers from evading fares or paying for rides by inserting coins in violation of regulations.
最后应说明的是:以上各实施例仅用以说明本发明的技术方案,而非对其限制;尽管参照前述各实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分或者全部技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本发明各实施例技术方案的范围。Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present invention, rather than limiting them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: It is still possible to modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the technical solutions of the various embodiments of the present invention. scope.
Claims (6)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110691888.8A CN113643489B (en) | 2021-06-22 | 2021-06-22 | Public transit pos machine based on face identification |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110691888.8A CN113643489B (en) | 2021-06-22 | 2021-06-22 | Public transit pos machine based on face identification |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113643489A CN113643489A (en) | 2021-11-12 |
| CN113643489B true CN113643489B (en) | 2023-02-03 |
Family
ID=78416015
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110691888.8A Active CN113643489B (en) | 2021-06-22 | 2021-06-22 | Public transit pos machine based on face identification |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113643489B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115063871B (en) * | 2022-07-28 | 2022-11-15 | 广州市保伦电子有限公司 | An artificial intelligence conference system based on face recognition technology |
| CN115271747B (en) * | 2022-10-01 | 2023-09-15 | 北京晟邦知享科技发展有限公司 | A security verification method based on facial and voice recognition |
| CN121351051A (en) * | 2024-07-16 | 2026-01-16 | 腾讯科技(深圳)有限公司 | Identification methods, devices, equipment, media and program products |
| CN120048036A (en) * | 2025-04-21 | 2025-05-27 | 深圳市深圳通有限公司 | Riding traffic method, riding traffic device, riding traffic equipment, riding traffic medium and riding traffic product |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB0004656D0 (en) * | 2000-02-28 | 2000-04-19 | Edentity Limited | Information processing system and method |
| CN109285008A (en) * | 2018-09-02 | 2019-01-29 | 珠海横琴现联盛科技发展有限公司 | Face recognition payment information anti-counterfeiting method combined with spatial information |
| CN208848246U (en) * | 2018-09-27 | 2019-05-10 | 深圳瑞为智能科技有限公司 | A kind of public transport payment system based on biometric identity identification |
| CN110135845A (en) * | 2019-05-08 | 2019-08-16 | 厦门路桥信息股份有限公司 | Electronic certificate third party access system, implementation method, medium and equipment |
| CN110135852A (en) * | 2019-04-17 | 2019-08-16 | 深圳市雄帝科技股份有限公司 | Riding payment method, system, payment accepting device and server |
| CN110490592A (en) * | 2018-05-15 | 2019-11-22 | 上海博泰悦臻网络技术服务有限公司 | Interior consumption and payment method and cloud server based on recognition of face |
| CN110782241A (en) * | 2019-10-31 | 2020-02-11 | 郑州天迈科技股份有限公司 | Hybrid face recognition public transportation payment system and method |
| CN111370003A (en) * | 2020-02-27 | 2020-07-03 | 杭州雄迈集成电路技术股份有限公司 | A Voiceprint Comparison Method Based on Siamese Neural Network |
-
2021
- 2021-06-22 CN CN202110691888.8A patent/CN113643489B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB0004656D0 (en) * | 2000-02-28 | 2000-04-19 | Edentity Limited | Information processing system and method |
| CN110490592A (en) * | 2018-05-15 | 2019-11-22 | 上海博泰悦臻网络技术服务有限公司 | Interior consumption and payment method and cloud server based on recognition of face |
| CN109285008A (en) * | 2018-09-02 | 2019-01-29 | 珠海横琴现联盛科技发展有限公司 | Face recognition payment information anti-counterfeiting method combined with spatial information |
| CN208848246U (en) * | 2018-09-27 | 2019-05-10 | 深圳瑞为智能科技有限公司 | A kind of public transport payment system based on biometric identity identification |
| CN110135852A (en) * | 2019-04-17 | 2019-08-16 | 深圳市雄帝科技股份有限公司 | Riding payment method, system, payment accepting device and server |
| CN110135845A (en) * | 2019-05-08 | 2019-08-16 | 厦门路桥信息股份有限公司 | Electronic certificate third party access system, implementation method, medium and equipment |
| CN110782241A (en) * | 2019-10-31 | 2020-02-11 | 郑州天迈科技股份有限公司 | Hybrid face recognition public transportation payment system and method |
| CN111370003A (en) * | 2020-02-27 | 2020-07-03 | 杭州雄迈集成电路技术股份有限公司 | A Voiceprint Comparison Method Based on Siamese Neural Network |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113643489A (en) | 2021-11-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113643489B (en) | Public transit pos machine based on face identification | |
| CN110415367A (en) | Vehicle mobile-payment system and method | |
| CN109711133A (en) | Authentication method, device and the server of identity information | |
| US20080010464A1 (en) | System and method for automated border-crossing checks | |
| US8775259B2 (en) | Secure system and process for identification and identity registration | |
| CN110135852A (en) | Riding payment method, system, payment accepting device and server | |
| CN110543957A (en) | Intelligent hotel check-in method and corresponding device | |
| US11270527B2 (en) | Use of multiple sensory inputs for determining vehicle occupancy in tolling applications | |
| CN103258270A (en) | Bank paying method and device | |
| JP2001508563A (en) | Security system and method for remote services provided by financial institutions | |
| CN111047718A (en) | An urban rail transit security check ticketing integration system | |
| CN109583529A (en) | A kind of certificate chain electronic driving certificate system | |
| JP2001508955A (en) | Security system and method for services provided by telecommunications operators | |
| CN109242645A (en) | A kind of shared bicycle charging method based on precise positioning and safe barcode scanning | |
| CN110458970A (en) | A kind of risk control method and system of parking lot payment | |
| CN107038509A (en) | Self-service registration-management system | |
| EP3140825B1 (en) | Authentication method for vehicular number plate recognition | |
| CN110544138B (en) | Method and system for acquiring non-stop toll collection invoice and vehicle-mounted unit | |
| TWM563013U (en) | Fast mobile payment systems integrated with the systems of a station and a mobile communication devices | |
| CN113538814A (en) | A smart bus on-board terminal that supports digital RMB payment | |
| WO2019062986A1 (en) | Highway toll collection method, server, system and storage medium | |
| CN105989711B (en) | Portable terminal is used in operation station exit door detecting method, system and door inspection | |
| CN111783059A (en) | A system and method for crossing the gate with a combination of people and codes | |
| CN208580415U (en) | A ticket checking device based on face recognition | |
| CN109584132A (en) | A kind of certificate chain electronics residence permit system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address | ||
| CP03 | Change of name, title or address |
Address after: 14 / F, Hualu building, 717 Huangpu Road, Dalian hi tech Industrial Park, Liaoning 116000 Patentee after: Hualu Zhida Technology Co.,Ltd. Address before: No. 717, Huangpu Road, high tech park, Dalian, Liaoning 116000 Patentee before: Hualu Zhida Technology Co.,Ltd. |








