[go: up one dir, main page]

CN114550265A - Image processing method, face recognition method and system - Google Patents

Image processing method, face recognition method and system Download PDF

Info

Publication number
CN114550265A
CN114550265A CN202210187388.5A CN202210187388A CN114550265A CN 114550265 A CN114550265 A CN 114550265A CN 202210187388 A CN202210187388 A CN 202210187388A CN 114550265 A CN114550265 A CN 114550265A
Authority
CN
China
Prior art keywords
target
target user
face recognition
face
model version
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210187388.5A
Other languages
Chinese (zh)
Inventor
周婧
高斌
李俊
郭俊琪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Sensetime Intelligent Technology Co Ltd
Original Assignee
Shanghai Sensetime Intelligent Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Sensetime Intelligent Technology Co Ltd filed Critical Shanghai Sensetime Intelligent Technology Co Ltd
Priority to CN202210187388.5A priority Critical patent/CN114550265A/en
Publication of CN114550265A publication Critical patent/CN114550265A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Collating Specific Patterns (AREA)

Abstract

The present disclosure relates to an image processing method, a face recognition method and a system, wherein the image processing method is applied to a server and comprises the following steps: receiving a feature extraction request sent by a data platform, wherein the feature extraction request comprises a target face image and a model version identifier, and the model version identifier is used for indicating a face recognition model; based on the model version identification, calling a corresponding feature extraction algorithm to extract features of the target face image to obtain reference face features of the target face image determined based on the model version identification, wherein the reference face features of the target face image determined based on the model version identification are used for carrying out face recognition on a target user corresponding to the target face image on a target terminal of a face recognition model indicated by the model version identification; and deleting the target face image in the local cache. The embodiment of the disclosure can effectively improve the data security in the face recognition process and reduce the risk of personal privacy leakage.

Description

图像处理方法、人脸识别方法及系统Image processing method, face recognition method and system

技术领域technical field

本公开涉及计算机视觉技术领域,尤其涉及一种图像处理方法、人脸识别方法及系统。The present disclosure relates to the technical field of computer vision, and in particular, to an image processing method, a face recognition method and a system.

背景技术Background technique

目前在通行场景的人脸识别应用中,需要将参考人脸图像的发送至服务器,服务器存储参考人脸图像,并将参考人脸图像同步下发给前端设备,以使得前端设备基于参考人脸图像进行人脸特征比对,实现人脸识别。At present, in the face recognition application of the traffic scene, the reference face image needs to be sent to the server, the server stores the reference face image, and sends the reference face image to the front-end device synchronously, so that the front-end device can base on the reference face image. The images are compared with face features to realize face recognition.

发明内容SUMMARY OF THE INVENTION

本公开提出了一种图像处理方法、人脸识别方法及系统的技术方案。The present disclosure provides technical solutions of an image processing method, a face recognition method and a system.

根据本公开的一方面,提供了一种图像处理方法,所述方法应用于服务器,所述方法包括:接收数据平台发送的特征提取请求,其中,所述特征提取请求中包括目标人脸图像、模型版本标识,所述模型版本标识用于指示人脸识别模型;基于所述模型版本标识,调用对应的特征提取算法,对所述目标人脸图像进行特征提取,得到所述目标人脸图像基于所述模型版本标识确定的参考人脸特征,其中,所述目标人脸图像基于所述模型版本标识确定的参考人脸特征,用于在具有所述模型版本标识指示的人脸识别模型的目标终端上,对所述目标人脸图像对应的目标用户进行人脸识别;删除本地缓存中的所述目标人脸图像。According to an aspect of the present disclosure, an image processing method is provided, the method is applied to a server, and the method includes: receiving a feature extraction request sent by a data platform, wherein the feature extraction request includes a target face image, Model version identification, the model version identification is used to indicate the face recognition model; based on the model version identification, call the corresponding feature extraction algorithm, perform feature extraction on the target face image, and obtain the target face image based on The reference face feature determined by the model version identifier, wherein the target face image is based on the reference face feature determined by the model version identifier, and is used in the target face recognition model with the model version identifier indicated. On the terminal, face recognition is performed on the target user corresponding to the target face image; and the target face image in the local cache is deleted.

在一种可能的实现方式中,所述方法还包括:将所述目标人脸图像基于所述模型版本标识确定的参考人脸特征发送至所述数据平台;接收所述数据平台发送的所述目标用户的人脸识别数据、以及所述目标用户的权限信息,其中,所述人脸识别数据包括:所述目标用户的身份标识、所述模型版本标识、所述目标用户基于所述模型版本标识确定的参考人脸特征、所述目标用户的个人信息。In a possible implementation manner, the method further includes: sending the reference face feature determined by the target face image based on the model version identifier to the data platform; receiving the data platform sent by the data platform. The face recognition data of the target user and the permission information of the target user, wherein the face recognition data includes: the identity identifier of the target user, the model version identifier, the target user based on the model version Identify the determined reference facial features and the personal information of the target user.

在一种可能的实现方式中,所述数据平台包括:人像数据平台、信息数据平台;所述接收所述数据平台发送的所述目标用户的人脸识别数据、以及所述目标用户的权限信息,包括:接收所述人像数据平台发送的所述目标用户的身份标识、所述模型版本标识、所述目标用户基于所述模型版本标识确定的参考人脸特征;接收所述信息数据平台发送的所述目标用户的个人信息、所述目标用户的权限信息In a possible implementation manner, the data platform includes: a portrait data platform and an information data platform; the face recognition data of the target user and the permission information of the target user sent by the data platform are received. , including: receiving the identity identifier of the target user, the model version identifier, and the reference face feature determined by the target user based on the model version identifier sent by the portrait data platform; receiving the information sent by the information data platform. Personal information of the target user, permission information of the target user

在一种可能的实现方式中,所述方法还包括:基于所述目标用户的权限信息,确定所述目标用户具有人脸识别权限的所述目标终端;将所述人脸识别数据发送至所述目标终端。In a possible implementation manner, the method further includes: determining, based on the permission information of the target user, the target terminal to which the target user has face recognition authority; sending the face recognition data to the target terminal. the target terminal.

在一种可能的实现方式中,所述方法还包括:接收所述目标终端发送的所述目标用户的人脸识别记录,其中,所述人脸识别记录中包括:本次人脸识别的抓拍人脸图、本次人脸识别的时空信息。In a possible implementation manner, the method further includes: receiving a face recognition record of the target user sent by the target terminal, wherein the face recognition record includes: a snapshot of this face recognition The face map, the spatiotemporal information of this face recognition.

在一种可能的实现方式中,所述方法还包括:在接收到所述数据平台发送的多个目标用户的人脸识别数据的情况下,根据每个目标用户的权限信息,对所述多个目标用户的人脸识别数据进行分组存储。In a possible implementation manner, the method further includes: in the case of receiving the face recognition data of multiple target users sent by the data platform, according to the permission information of each target user The face recognition data of each target user is grouped and stored.

在一种可能的实现方式中,所述方法还包括:对所述目标人脸图像进行质量检测;在所述目标人脸图像的质量检测结果不符合预设质量条件的情况下,向所述数据平台发送图像更新请求。包括:In a possible implementation manner, the method further includes: performing quality detection on the target face image; if the quality detection result of the target face image does not meet a preset quality condition, sending a The data platform sends an image update request. include:

根据本公开的一方面,提供了一种图像处理方法,所述方法应用于数据平台,所述方法包括:获取目标用户的目标人脸图像;向服务器发送特征提取请求,其中,所述特征提取请求中包括所述目标人脸图像、模型版本标识,所述模型版本标识用于指示人脸识别模型;接收所述服务器发送的所述目标人脸图像基于所述模型版本标识确定的参考人脸特征,其中,所述目标人脸图像基于所述模型版本标识确定的参考人脸特征,用于在具有所述模型版本标识指示的人脸识别模型的目标终端上,对所述目标用户进行人脸识别;向所述服务器发送所述目标用户的人脸识别数据、以及所述目标用户的权限信息,其中,所述人脸识别数据包括:所述目标用户的身份标识、所述模型版本标识、所述目标用户基于所述模型版本标识确定的参考人脸特征、所述目标用户的个人信息。According to an aspect of the present disclosure, an image processing method is provided, the method is applied to a data platform, and the method includes: acquiring a target face image of a target user; sending a feature extraction request to a server, wherein the feature extraction The request includes the target face image and the model version identification, the model version identification is used to indicate the face recognition model; the reference face determined based on the model version identification of the target face image sent by the server is received feature, wherein the target face image is based on the reference face feature determined by the model version ID, and is used to perform a human face recognition on the target user on the target terminal with the face recognition model indicated by the model version ID. face recognition; sending the target user's face recognition data and the target user's authority information to the server, wherein the face recognition data includes: the target user's identity identifier, the model version identifier , the reference face feature determined by the target user based on the model version identifier, and the personal information of the target user.

在一种可能的实现方式中,所述数据平台包括:人像数据平台;所述向所述服务器发送所述目标用户的人脸识别数据,包括:所述人像数据平台确定所述目标用户的身份标识;所述人像数据平台将所述目标用户的身份标识、所述模型版本标识、所述目标用户基于所述模型版本标识确定的参考人脸特征,发送至所述服务器。In a possible implementation manner, the data platform includes: a portrait data platform; the sending the face recognition data of the target user to the server includes: the portrait data platform determining the identity of the target user identification; the portrait data platform sends the identity identification of the target user, the model version identification, and the reference face feature determined by the target user based on the model version identification to the server.

在一种可能的实现方式中,所述数据平台包括:信息数据平台;所述向所述服务器发送所述目标用户的人脸识别数据、以及所述目标用户的权限信息,包括:所述信息数据平台基于所述目标用户的身份标识,确定所述目标用户的个人信息、所述目标用户的权限信息;所述信息数据平台将所述目标用户的个人信息、所述目标用户的权限信息,发送至所述服务器。In a possible implementation manner, the data platform includes: an information data platform; the sending to the server the face recognition data of the target user and the permission information of the target user includes: the information The data platform determines the personal information of the target user and the authority information of the target user based on the identity of the target user; the information data platform combines the personal information of the target user, the authority information of the target user, sent to the server.

在一种可能的实现方式中,所述方法还包括:接收所述服务器发送的图像更新请求;响应于所述图像更新请求,重新获取目标用户的人脸图像,以及利用重新获取的人脸图像,更新所述目标人脸图像。In a possible implementation manner, the method further includes: receiving an image update request sent by the server; in response to the image update request, re-acquiring the face image of the target user, and using the re-acquired face image , and update the target face image.

根据本公开的一方面,提供了一种人脸识别方法,所述方法应用于目标终端,所述目标终端具有所述模型版本标识指示的人脸识别模型,目标用户在所述目标终端具有人脸识别权限,所述方法包括:接收服务器发送的所述目标用户的人脸识别数据,所述人脸识别数据包括:所述目标用户的身份标识、所述模型版本标识、所述目标用户基于所述模型版本标识确定的参考人脸特征、所述目标用户的个人信息;基于所述人脸识别数据,对所述目标用户进行人脸识别。According to an aspect of the present disclosure, a face recognition method is provided, the method is applied to a target terminal, the target terminal has a face recognition model indicated by the model version identifier, and the target user has a human face on the target terminal face recognition authority, the method includes: receiving the face recognition data of the target user sent by the server, the face recognition data including: the identity identifier of the target user, the model version identifier, the target user based on The model version identifies the determined reference face feature and the personal information of the target user; based on the face recognition data, face recognition is performed on the target user.

在一种可能的实现方式中,所述基于所述人脸识别数据,对所述目标用户进行人脸识别,包括:获取待识别用户的本次人脸识别的抓拍人脸图;基于所述模型版本标识指示的人脸识别模型,对本次人脸识别的抓拍人脸图进行特征提取,得到所述待识别用户的待识别人脸特征;在所述待识别用户的待识别人脸,与所述目标用户的参考人脸特征匹配成功的情况下,确定本次人脸识别成功。In a possible implementation manner, the performing face recognition on the target user based on the face recognition data includes: acquiring a captured face image of the user to be recognized for this face recognition; based on the face recognition data; For the face recognition model indicated by the model version identifier, feature extraction is performed on the captured face image of this face recognition to obtain the to-be-recognized face features of the to-be-recognized user; in the to-be-recognized user's to-be-recognized face, If it is successfully matched with the reference face feature of the target user, it is determined that the face recognition is successful this time.

在一种可能的实现方式中,所述方法还包括:将所述目标用户的个人信息,在所述目标终端的显示屏幕上进行脱敏显示。In a possible implementation manner, the method further includes: desensitizing and displaying the personal information of the target user on the display screen of the target terminal.

在一种可能的实现方式中,所述方法还包括:基于本次人脸识别的抓拍人脸图、本次人脸识别的时空信息,生成所述目标用户的人脸识别记录;将所述目标用户的人脸识别记录发送至所述服务器。In a possible implementation manner, the method further includes: generating a face recognition record of the target user based on the captured face image of this face recognition and the spatiotemporal information of this face recognition; The face recognition record of the target user is sent to the server.

根据本公开的一方面,提供了一种人脸识别系统,其特征在于,所述人脸识别系统包括:数据平台、服务器、目标终端,其中:所述目标终端获取目标用户的目标人脸图像;所述目标终端向所述服务器发送特征提取请求,其中,所述特征提取请求中包括所述目标人脸图像、模型版本标识;所述服务器基于所述模型版本标识,调用对应的特征提取算法,对所述目标人脸图像进行特征提取,得到所述目标人脸图像基于所述模型版本标识确定的参考人脸特征,并删除本地缓存中的所述目标人脸图像;所述目标终端接收所述服务器发送的所述目标用户的人脸识别数据,所述人脸识别数据包括:所述目标用户的身份标识、所述模型版本标识、所述目标用户基于所述模型版本标识确定的参考人脸特征、所述目标用户的个人信息;所述目标终端基于所述人脸识别数据,对所述目标用户进行人脸识别。According to an aspect of the present disclosure, a face recognition system is provided, wherein the face recognition system includes: a data platform, a server, and a target terminal, wherein: the target terminal obtains a target face image of a target user The target terminal sends a feature extraction request to the server, wherein the feature extraction request includes the target face image and the model version identifier; the server calls the corresponding feature extraction algorithm based on the model version identifier , perform feature extraction on the target face image, obtain the reference face feature determined by the target face image based on the model version identifier, and delete the target face image in the local cache; the target terminal receives The face recognition data of the target user sent by the server, where the face recognition data includes: the identity identifier of the target user, the model version identifier, and the reference determined by the target user based on the model version identifier face features and personal information of the target user; the target terminal performs face recognition on the target user based on the face recognition data.

在本公开实施例中,服务器接收数据平台发送的,包括目标人脸图像、模型版本标识特征提取请求,基于模型版本标识,调用对应的特征提取算法,对目标人脸图像进行特征提取,得到目标人脸图像基于模型版本标识确定的参考人脸特征,并删除本地缓存中的目标人脸图像,其中,目标人脸图像基于模型版本标识确定的参考人脸特征,用于在具有模型版本标识对应的特征提取算法的目标终端上,对目标人脸图像对应的目标用户进行人脸识别。由于服务器仅基于模型版本标识对目标人脸图像进行特征提取,得到用于后续人脸识别的参考人脸特征,而不对目标人脸图像进行存储,以使得涉及个人隐私的目标人脸图像仅存储在数据平台本地,有效提高了人脸识别过程中的数据安全,降低了个人隐私泄漏的风险。In the embodiment of the present disclosure, the server receives the feature extraction request sent by the data platform, including the target face image and the model version identification, and calls the corresponding feature extraction algorithm based on the model version identification, performs feature extraction on the target face image, and obtains the target face image. The face image is based on the reference face feature determined by the model version ID, and the target face image in the local cache is deleted, wherein the target face image is based on the reference face feature determined by the model version ID. On the target terminal of the feature extraction algorithm, perform face recognition on the target user corresponding to the target face image. Because the server only performs feature extraction on the target face image based on the model version identification, and obtains the reference face features for subsequent face recognition without storing the target face image, so that only the target face image involving personal privacy is stored. Locally on the data platform, the data security in the face recognition process is effectively improved, and the risk of personal privacy leakage is reduced.

应当理解的是,以上的一般描述和后文的细节描述仅是示例性和解释性的,而非限制本公开。根据下面参考附图对示例性实施例的详细说明,本公开的其它特征及方面将变得清楚。It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. Other features and aspects of the present disclosure will become apparent from the following detailed description of exemplary embodiments with reference to the accompanying drawings.

附图说明Description of drawings

此处的附图被并入说明书中并构成本说明书的一部分,这些附图示出了符合本公开的实施例,并与说明书一起用于说明本公开的技术方案。The accompanying drawings, which are incorporated into and constitute a part of this specification, illustrate embodiments consistent with the present disclosure, and together with the description, serve to explain the technical solutions of the present disclosure.

图1示出相关技术中的人脸识别场景的示意图;1 shows a schematic diagram of a face recognition scene in the related art;

图2示出根据本公开实施例的人脸识别场景的示意图;2 shows a schematic diagram of a face recognition scene according to an embodiment of the present disclosure;

图3示出根据本公开实施例的一种图像处理方法的流程图;FIG. 3 shows a flowchart of an image processing method according to an embodiment of the present disclosure;

图4示出根据本公开实施例的一种人脸识别系统的示意图;4 shows a schematic diagram of a face recognition system according to an embodiment of the present disclosure;

图5示出根据本公开实施例的一种图像处理方法的流程图;FIG. 5 shows a flowchart of an image processing method according to an embodiment of the present disclosure;

图6示出根据本公开实施例的一种人脸识别方法的流程图;FIG. 6 shows a flowchart of a face recognition method according to an embodiment of the present disclosure;

图7示出根据本公开实施例的一种服务器的框图;FIG. 7 shows a block diagram of a server according to an embodiment of the present disclosure;

图8示出根据本公开实施例的一种数据平台的框图;8 shows a block diagram of a data platform according to an embodiment of the present disclosure;

图9示出根据本公开实施例的一种目标终端的框图;FIG. 9 shows a block diagram of a target terminal according to an embodiment of the present disclosure;

图10示出根据本公开实施例的一种电子设备的框图;10 shows a block diagram of an electronic device according to an embodiment of the present disclosure;

图11示出根据本公开实施例的一种电子设备的框图。FIG. 11 shows a block diagram of an electronic device according to an embodiment of the present disclosure.

具体实施方式Detailed ways

以下将参考附图详细说明本公开的各种示例性实施例、特征和方面。附图中相同的附图标记表示功能相同或相似的元件。尽管在附图中示出了实施例的各种方面,但是除非特别指出,不必按比例绘制附图。Various exemplary embodiments, features and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. The same reference numbers in the figures denote elements that have the same or similar functions. While various aspects of the embodiments are shown in the drawings, the drawings are not necessarily drawn to scale unless otherwise indicated.

在这里专用的词“示例性”意为“用作例子、实施例或说明性”。这里作为“示例性”所说明的任何实施例不必解释为优于或好于其它实施例。The word "exemplary" is used exclusively herein to mean "serving as an example, embodiment, or illustration." Any embodiment described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments.

本文中术语“和/或”,仅仅是一种描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。另外,本文中术语“至少一种”表示多种中的任意一种或多种中的至少两种的任意组合,例如,包括A、B、C中的至少一种,可以表示包括从A、B和C构成的集合中选择的任意一个或多个元素。The term "and/or" in this article is only an association relationship to describe the associated objects, indicating that there can be three kinds of relationships, for example, A and/or B, it can mean that A exists alone, A and B exist at the same time, and A and B exist independently B these three cases. In addition, the term "at least one" herein refers to any combination of any one of the plurality or at least two of the plurality, for example, including at least one of A, B, and C, and can mean including from A, B, and C. Any one or more elements selected from the set of B and C.

另外,为了更好地说明本公开,在下文的具体实施方式中给出了众多的具体细节。本领域技术人员应当理解,没有某些具体细节,本公开同样可以实施。在一些实例中,对于本领域技术人员熟知的方法、手段、元件和电路未作详细描述,以便于凸显本公开的主旨。In addition, in order to better illustrate the present disclosure, numerous specific details are set forth in the following detailed description. It will be understood by those skilled in the art that the present disclosure may be practiced without certain specific details. In some instances, methods, means, components and circuits well known to those skilled in the art have not been described in detail so as not to obscure the subject matter of the present disclosure.

目前在通行场景的人脸识别应用中,需要将参考人脸图像发送至服务器,服务器存储参考人脸图像,并将参考人脸图像同步下发给前端设备,以使得前端设备基于参考人脸图像进行人脸特征比对,实现人脸识别。前端设备可以是指具有人脸识别功能的目标,例如,人脸识别门禁机、人脸识别闸机等。At present, in the face recognition application of the traffic scene, the reference face image needs to be sent to the server, the server stores the reference face image, and sends the reference face image to the front-end device synchronously, so that the front-end device can use the reference face image based on the reference face image. Perform face feature comparison to realize face recognition. Front-end equipment may refer to a target with face recognition function, such as face recognition access control machine, face recognition gate, etc.

图1示出相关技术中的人脸识别场景的示意图。如图1所示,人脸识别场景中包括服务器11和目标终端12。将参考人脸图像上传至服务器10,服务器10存储参考人脸图像,并将参考人脸图像同步下发至目标终端20。目标终端20基于对待识别用户采集的人脸抓拍图、与参考人脸图像进行人脸特征对比,以实现对待识别用户的人脸识别。但是,由于参考人脸图像需要存储在服务器中,导致存在个人隐私泄露的风险。FIG. 1 shows a schematic diagram of a face recognition scene in the related art. As shown in FIG. 1 , the face recognition scene includes a server 11 and a target terminal 12 . The reference face image is uploaded to the server 10 , the server 10 stores the reference face image, and sends the reference face image to the target terminal 20 synchronously. The target terminal 20 performs face feature comparison with the reference face image based on the face snapshot image collected by the user to be identified, so as to realize the face recognition of the user to be identified. However, since the reference face image needs to be stored in the server, there is a risk of personal privacy leakage.

图2示出根据本公开实施例的人脸识别场景的示意图。如图2所示,本公开实施例的人脸识别场景中包括服务器21、数据平台22、目标终端23。如图2所示,服务器21接收数据平台22发送的,包括目标人脸图像、用于指示人脸识别模型的模型版本标识的特征提取请求,服务器21基于模型版本标识,调用对应的特征提取算法,对目标人脸图像进行特征提取,得到目标人脸图像基于模型版本标识确定的参考人脸特征,目标人脸图像基于模型版本标识确定的参考人脸特征,用于在具有模型版本标识指示的人脸识别模型的目标终端23上,对目标人脸图像对应的目标用户进行人脸识别。FIG. 2 shows a schematic diagram of a face recognition scene according to an embodiment of the present disclosure. As shown in FIG. 2 , the face recognition scene in the embodiment of the present disclosure includes a server 21 , a data platform 22 , and a target terminal 23 . As shown in FIG. 2, the server 21 receives the feature extraction request sent by the data platform 22, including the target face image and the model version identification used to indicate the face recognition model, and the server 21 calls the corresponding feature extraction algorithm based on the model version identification. , perform feature extraction on the target face image to obtain the reference face feature determined based on the model version identification of the target face image, and the reference face feature determined based on the model version identification of the target face image is used for On the target terminal 23 of the face recognition model, face recognition is performed on the target user corresponding to the target face image.

由于不同目标终端可能是不同厂商生产的,导致不同目标终端中的人脸识别模型不同,因此,为了使得后续可以在对应的目标终端中进行人脸识别,需要将对应的模型版本标识发送至服务器,以使得服务器基于模型版本标识,提取对应的参考人脸特征。Different target terminals may be produced by different manufacturers, resulting in different face recognition models in different target terminals. Therefore, in order to enable subsequent face recognition in the corresponding target terminals, the corresponding model version identification needs to be sent to the server. , so that the server extracts the corresponding reference face features based on the model version identifier.

此外,在提取得到目标人脸图像基于模型版本标识确定的参考人脸特征之后,服务器21删除本地缓存中的目标人脸图像,也就是说,服务器21仅基于模型版本标识对目标人脸图像进行特征提取,而不对目标人脸图像进行存储,也不会将目标人脸图像下发至目标终端23,以使得涉及个人隐私的目标人脸图像仅存储在数据平台22本地,有效提高了人脸识别过程中的数据安全,降低了个人隐私泄漏的风险。In addition, after extracting and obtaining the reference face feature of the target face image determined based on the model version identifier, the server 21 deletes the target face image in the local cache, that is, the server 21 only performs the target face image based on the model version identifier. Feature extraction, without storing the target face image, nor sending the target face image to the target terminal 23, so that the target face image involving personal privacy is only stored locally on the data platform 22, effectively improving the face Data security in the identification process reduces the risk of personal privacy leakage.

下面对本公开实施例提供的图像处理方法、人脸识别方法进行详细描述。这里的图像处理方法是对人脸图像进行预处理的方法,为了后续人脸识别做准备。The image processing method and the face recognition method provided by the embodiments of the present disclosure are described in detail below. The image processing method here is a method of preprocessing a face image to prepare for subsequent face recognition.

图3示出根据本公开实施例的一种图像处理方法的流程图。该图像处理方法可以应用于上述图2中的服务器21。如图3所示,该图像处理方法可以包括:FIG. 3 shows a flowchart of an image processing method according to an embodiment of the present disclosure. This image processing method can be applied to the server 21 in FIG. 2 described above. As shown in Figure 3, the image processing method may include:

在步骤S31中,接收数据平台发送的特征提取请求,其中,特征提取请求中包括目标人脸图像、模型版本标识。In step S31, a feature extraction request sent by the data platform is received, wherein the feature extraction request includes the target face image and the model version identifier.

这里的数据平台可以是专门对数据信息进行统一存储、管理的平台,数据平台的具体形式可以根据实际需要确定,本公开对此不作具体限定。The data platform here can be a platform dedicated to unified storage and management of data information, and the specific form of the data platform can be determined according to actual needs, which is not specifically limited in this disclosure.

在一示例中,当人脸识别应用于学校的人员通行场景时,数据平台可以是学校的学生信息管理平台。图4示出根据本公开实施例的一种人脸识别系统的示意图。图4所示的人脸识别系统应用于学校的人员通行场景,图4中所示的数据平台可以是学校的学生信息管理平台,学生可以将自身的人脸图像、个人信息上传至数据平台。In an example, when face recognition is applied to a school's passage of people, the data platform may be a school's student information management platform. FIG. 4 shows a schematic diagram of a face recognition system according to an embodiment of the present disclosure. The face recognition system shown in FIG. 4 is applied to the scene of people passing by the school. The data platform shown in FIG. 4 can be the student information management platform of the school, and students can upload their own face images and personal information to the data platform.

为了实现人脸识别通行,数据平台向服务器发送特征提取请求,由于人脸识别通行场景中可能涉及多个不同目标终端,也即涉及多个不同模型版本标识指示的人脸识别模型,因此,特征提取请求中除了包括目标人脸图像之外,还包括模型版本标识,以使得后续能够调用与人脸识别模型对应的特征提取算法进行特征提取。In order to achieve face recognition access, the data platform sends a feature extraction request to the server. Since the face recognition access scene may involve multiple different target terminals, that is, multiple face recognition models indicated by different model version identifiers, the feature In addition to the target face image, the extraction request also includes a model version identifier, so that the feature extraction algorithm corresponding to the face recognition model can be subsequently invoked to perform feature extraction.

在一示例中,服务器可以预先获取其内嵌或对接的内部产品/组件/平台所包含的所有人脸识别模型的多个模型版本标识,并将多个模型版本标识发送至数据平台,以使得数据平台在发送特征提取请求时,可以选择至少一个服务器支持且与目标终端匹配的模型版本标识。In one example, the server may obtain multiple model version identifiers of all face recognition models included in its embedded or docked internal product/component/platform in advance, and send the multiple model version identifiers to the data platform, so that the When sending the feature extraction request, the data platform may select at least one model version identifier supported by the server and matching the target terminal.

在步骤S32中,基于模型版本标识,调用对应的特征提取算法,对目标人脸图像进行特征提取,得到目标人脸图像基于模型版本标识确定的参考人脸特征,目标人脸图像基于模型版本标识确定的参考人脸特征,用于在具有模型版本标识指示的人脸识别模型的目标终端上,对目标人脸图像对应的目标用户进行人脸识别。In step S32, based on the model version identification, a corresponding feature extraction algorithm is invoked to perform feature extraction on the target face image to obtain a reference face feature determined based on the model version identification of the target face image, and the target face image is based on the model version identification. The determined reference face feature is used to perform face recognition on the target user corresponding to the target face image on the target terminal having the face recognition model indicated by the model version identifier.

服务器基于特征提取中包括的模型版本标识,调用与该模型版本标识指示的人脸识别模型对应的特征提取算法,对目标人脸图像进行特征提取,得到目标人脸图像基于该模型版本标识确定的参考人脸特征,后续可以利用该参考人脸特征,在具有该模型版本标识指示的人脸识别模型的目标终端上,对目标人脸图像对应的目标用户进行人脸识别。Based on the model version ID included in the feature extraction, the server invokes the feature extraction algorithm corresponding to the face recognition model indicated by the model version ID, performs feature extraction on the target face image, and obtains the target face image determined based on the model version ID. With reference to the face feature, the reference face feature can be used subsequently to perform face recognition on the target user corresponding to the target face image on the target terminal having the face recognition model indicated by the model version identifier.

在一示例中,服务器中包括提取节点。提取节点基于模型版本标识,调用对应的特征提取算法,对目标人脸图像进行特征提取。In one example, an extraction node is included in the server. The extraction node calls the corresponding feature extraction algorithm based on the model version identification to perform feature extraction on the target face image.

以上述图4为例,如图4所示,服务器中包括提取节点,提取节点可以直接调用服务器内嵌的模型版本标识对应的特征提取算法,对目标人脸图像进行特征提取。Taking the above FIG. 4 as an example, as shown in FIG. 4 , the server includes an extraction node, and the extraction node can directly call the feature extraction algorithm corresponding to the model version identifier embedded in the server to perform feature extraction on the target face image.

在一示例中,服务器中还包括内嵌的智能物联云平台,在服务器不存在内嵌的模型版本标识对应的特征提取算法的情况下,提取节点还可以基于智能物联云平台,调用外部与服务器对接的,模型版本标识指示的人脸识别模型对应的特征提取算法,对目标人脸图像进行特征提取。In an example, the server also includes an embedded intelligent IoT cloud platform. In the case where the server does not have a feature extraction algorithm corresponding to the embedded model version identifier, the extraction node can also call an external platform based on the intelligent IoT cloud platform. Connected with the server, the feature extraction algorithm corresponding to the face recognition model indicated by the model version identifier performs feature extraction on the target face image.

在步骤S33中,删除本地缓存中的目标人脸图像。In step S33, delete the target face image in the local cache.

服务器对目标人脸图像进行特征提取,得到目标人脸图像基于模型版本标识确定的参考人脸特征之后,删除本地缓存中的目标人脸图像,以确保服务器中不存储涉及个人隐私的目标人脸图像,降低个人隐私泄漏的风险。The server performs feature extraction on the target face image, and after obtaining the reference face feature of the target face image based on the model version identification, deletes the target face image in the local cache to ensure that the target face involving personal privacy is not stored in the server. images, reducing the risk of personal privacy leakage.

在本公开实施例中,服务器接收数据平台发送的,包括目标人脸图像、模型版本标识特征提取请求,基于模型版本标识,调用对应的特征提取算法,对目标人脸图像进行特征提取,得到目标人脸图像基于模型版本标识确定的参考人脸特征,并删除本地缓存中的目标人脸图像,其中,目标人脸图像基于模型版本标识确定的参考人脸特征,用于在具有模型版本标识指示的人脸识别模型的目标终端上,对目标人脸图像对应的目标用户进行人脸识别。由于服务器仅基于模型版本标识对目标人脸图像进行特征提取,得到用于后续人脸识别的参考人脸特征,而不对目标人脸图像进行存储,以使得涉及个人隐私的目标人脸图像仅存储在数据平台本地,有效提高了人脸识别过程中的数据安全,降低了个人隐私泄漏的风险。In the embodiment of the present disclosure, the server receives the feature extraction request sent by the data platform, including the target face image and the model version identification, and calls the corresponding feature extraction algorithm based on the model version identification, performs feature extraction on the target face image, and obtains the target face image. The face image is based on the reference face feature determined by the model version ID, and the target face image in the local cache is deleted, wherein the target face image is based on the reference face feature determined by the model version ID. On the target terminal of the face recognition model, perform face recognition on the target user corresponding to the target face image. Because the server only performs feature extraction on the target face image based on the model version identification, and obtains the reference face features for subsequent face recognition without storing the target face image, so that only the target face image involving personal privacy is stored. Locally on the data platform, the data security in the face recognition process is effectively improved, and the risk of personal privacy leakage is reduced.

在一种可能的实现方式中,该图像处理方法还包括:对目标人脸图像进行质量检测;在目标人脸图像的质量检测结果不符合预设质量条件的情况下,向数据平台发送图像更新请求。In a possible implementation manner, the image processing method further includes: performing quality detection on the target face image; if the quality detection result of the target face image does not meet the preset quality conditions, sending an image update to the data platform ask.

在上述步骤S31中接收到特征提取请求中包括的目标人脸图像之后,在进行特征提取之前,先对目标人脸图像进行质量检测,只有在目标人脸图像的质量检测结果符合预设质量条件的情况下,才进行后续特征提取,以确保提取得到的参考人脸特征的准确度。After receiving the target face image included in the feature extraction request in the above step S31, before the feature extraction is performed, the quality detection of the target face image is performed first, and only if the quality detection result of the target face image meets the preset quality conditions In the case of , the subsequent feature extraction is performed to ensure the accuracy of the extracted reference face features.

在目标人脸图像的质量检测结果不符合预设质量条件的情况下,服务器可以向数据平台返回图像更新请求,以请求数据平台重新发送目标人脸图像,直至最新发送的目标人脸图像的质量检测结果符合预设质量条件。In the case that the quality detection result of the target face image does not meet the preset quality conditions, the server may return an image update request to the data platform to request the data platform to resend the target face image until the quality of the latest sent target face image is reached. The test results meet the preset quality conditions.

预设质量条件可以根据实际情况设置,例如,人脸完整性、人脸清晰度等,本公开对此不作具体限定。The preset quality conditions may be set according to actual conditions, for example, face integrity, face clarity, etc., which are not specifically limited in the present disclosure.

在一种可能的实现方式中,该图像处理方法还包括:将目标人脸图像基于模型版本标识确定的参考人脸特征发送至数据平台;接收数据平台发送的目标用户的人脸识别数据、以及目标用户的权限信息,其中,人脸识别数据包括:目标用户的身份标识、模型版本标识、目标用户基于模型版本标识确定的参考人脸特征、目标用户的个人信息。In a possible implementation manner, the image processing method further includes: sending the reference face feature determined by the target face image based on the model version identification to the data platform; receiving the face recognition data of the target user sent by the data platform, and Permission information of the target user, wherein the face recognition data includes: the identity identifier of the target user, the model version identifier, the reference face feature determined by the target user based on the model version identifier, and the personal information of the target user.

服务器将目标人脸图像基于模型版本标识确定的参考人脸特征,返回至数据平台,经过数据平台的数据整合之后,服务器接收数据平台发送的目标用户的人脸识别数据、以及目标用户的权限信息。后文会结合本公开可能的实现方式,对数据平台进行数据整合确定目标用户的人脸识别数据、以及目标用户的权限信息的过程进行详细描述,此处不作赘述。The server returns the target face image based on the reference face features determined by the model version identification to the data platform. After the data integration of the data platform, the server receives the target user's face recognition data and the target user's permission information sent by the data platform. . The process of performing data integration on the data platform to determine the face recognition data of the target user and the permission information of the target user will be described in detail later in combination with possible implementations of the present disclosure, which will not be repeated here.

在一种可能的实现方式中,数据平台包括:人像数据平台、信息数据平台;接收数据平台发送的目标用户的人脸识别数据、以及目标用户的权限信息,包括:接收人像数据平台发送的目标用户的身份标识、模型版本标识、目标用户基于模型版本标识确定的参考人脸特征;接收信息数据平台发送的目标用户的个人信息、目标用户的权限信息。In a possible implementation manner, the data platform includes: a portrait data platform and an information data platform; receiving the face recognition data of the target user sent by the data platform and the permission information of the target user, including: receiving the target sent by the portrait data platform User's identity identifier, model version identifier, and reference face features determined by the target user based on the model version identifier; receive the personal information of the target user and the permission information of the target user sent by the information data platform.

数据平台中可以包括专门存储人脸图像的人像数据平台,以及存储其它信息数据的信息数据平台,服务器接收人像数据平台发送的目标用户的身份标识、模型版本标识、目标用户基于模型版本标识确定的参考人脸特征,以及接收信息数据平台发送的目标用户的个人信息、目标用户的权限信息。The data platform may include a portrait data platform that specifically stores face images, and an information data platform that stores other information data. The server receives the target user's identity and model version identification sent by the portrait data platform, and the target user is determined based on the model version identification. Refer to the facial features, as well as the personal information of the target user and the permission information of the target user sent by the information data platform.

在一示例中,数据平台利用身份标识,区分人像数据平台、信息数据平台中存储的,不同用户的人脸图像、其它信息数据。In an example, the data platform uses the identity identifier to distinguish the face images and other information data of different users stored in the portrait data platform and the information data platform.

以上述图4为例,如图4所示,数据平台(学生信息管理平台)将每个学生的学号(身份标识)、模型版本标识、基于模型版本标识确定的参考人脸特征存储在人像数据平台,将每个学生的学号(身份标识)、姓名、身份证号、通行权限信息(权限信息)等存储在信息数据平台。Taking the above-mentioned Fig. 4 as an example, as shown in Fig. 4, the data platform (student information management platform) stores each student's student ID (identity identifier), model version identifier, and reference facial features determined based on the model version identifier in the portrait. The data platform stores each student's student number (identity identifier), name, ID number, access authority information (authority information), etc. on the information data platform.

以上述图4为例,服务器中还包括应用节点,应用节点接收到人像数据平台发送的目标用户的身份标识、模型版本标识、目标用户基于模型版本标识确定的参考人脸特征之后,将目标用户的身份标识返回至数据平台,以使得信息数据平台基于目标用户的身份标识,向服务器发送目标用户的个人信息、目标用户的权限信息,从而实现服务器对目标用户的人脸识别数据进行数据补齐处理,并对数据补齐之后的目标用户的人脸识别数据进行入库存储。Taking the above-mentioned FIG. 4 as an example, the server also includes an application node. After the application node receives the identity of the target user sent by the portrait data platform, the model version identifier, and the reference face feature determined by the target user based on the model version identifier, the target user The identity of the target user is returned to the data platform, so that the information data platform sends the personal information of the target user and the authority information of the target user to the server based on the identity of the target user, so that the server can complete the data of the target user's face recognition data. process, and store and store the face recognition data of the target user after the data is completed.

以上述图4为例,如图4所示,服务器接收到人像数据平台发送的多个学生的学号(身份标识)、模型版本标识、基于模型版本标识确定的参考人脸特征之后,将多个学生的学号返回至学生信息管理平台,以使得信息数据平台基于多个学生的学号,查找多个学生的姓名、身份证号、通行权限信息发送至服务器,从而实现服务器对多个学生的人脸识别数据进行数据补齐处理。Taking the above-mentioned Fig. 4 as an example, as shown in Fig. 4, after the server receives the student numbers (identities) of multiple students sent by the portrait data platform, the model version identification, and the reference facial features determined based on the model version identification, the The student number of each student is returned to the student information management platform, so that the information data platform can search for the name, ID number, and access authority information of multiple students based on the student number of multiple students and send it to the server, so as to realize the server to multiple students. The face recognition data is processed for data completion.

不同学生的通行权限信息可能不同,可以根据实际情况对不同学生的通信权限信息进行设置,本公开对此不作具体限定。例如,针对学生A(男),其通行权限信息包括:教学楼、图书馆、男生宿舍楼等;针对学生B(女),其通行权限信息包括:教学楼、图书馆、女生宿舍楼等。The access authority information of different students may be different, and the communication authority information of different students may be set according to the actual situation, which is not specifically limited in this disclosure. For example, for student A (male), the access authority information includes: teaching building, library, male dormitory, etc.; for student B (female), the access authority information includes: teaching building, library, female dormitory, etc.

在一种可能的实现方式中,该图像处理方法还包括:在接收到数据平台发送的多个目标用户的人脸识别数据的情况下,根据每个目标用户的权限信息,对多个目标用户的人脸识别数据进行分组存储。In a possible implementation manner, the image processing method further includes: in the case of receiving the face recognition data of multiple target users sent by the data platform, according to the permission information of each target user The face recognition data are grouped and stored.

为了对多个目标用户的人脸识别数据进行合理管理,可以根据每个目标用户的权限信息,对多个目标用户的人脸识别数据进行分组存储。In order to reasonably manage the face recognition data of multiple target users, the face recognition data of multiple target users may be grouped and stored according to the permission information of each target user.

在一示例中,将具有相同的权限信息的目标用户的人脸识别数据存储到相同的分组中。In an example, face recognition data of target users with the same authority information are stored in the same group.

在一示例中,服务器可以接收信息数据平台发送的每个目标用户的分组标识,不同组标识用于指示不同分组。服务器基于不同组标识,构建不同分组,并基于每个用户的分组标识,将每个目标用户的人脸识别数据存储到相同的分组中。In an example, the server may receive a group identifier of each target user sent by the information data platform, and different group identifiers are used to indicate different groups. The server constructs different groups based on different group identifiers, and stores the face recognition data of each target user in the same group based on the group identifier of each user.

在一种可能的实现方式中,该图像处理方法还包括:基于目标用户的权限信息,确定目标用户具有人脸识别权限的目标终端;将人脸识别数据发送至目标终端。In a possible implementation manner, the image processing method further includes: determining, based on the permission information of the target user, a target terminal to which the target user has face recognition authority; and sending the face recognition data to the target terminal.

服务器基于目标用户的权限信息,确定目标用户具有人脸识别权限的目标终端,进而服务器调用智能物联云平台,将人脸识别数据发送至目标终端,以使得目标用户可以在目标终端进行人脸识别。Based on the permission information of the target user, the server determines the target terminal to which the target user has face recognition authority, and then the server calls the intelligent IoT cloud platform to send the face recognition data to the target terminal, so that the target user can perform face recognition on the target terminal. identify.

例如,目标终端为人脸门禁机,目标用户可以在人脸门禁机进行人脸识别,并在识别成功后通行。For example, the target terminal is a face access control machine, and the target user can perform face recognition on the face access control machine, and pass after the recognition is successful.

在一示例中,服务器可以将具有相同权限信息的分组内的所有人脸识别数据,全部下发至该权限信息对应的目标终端。In an example, the server may deliver all face recognition data in groups with the same authority information to the target terminal corresponding to the authority information.

在一种可能的实现方式中,该图像处理方法还包括:接收目标终端发送的目标用户的人脸识别记录,其中,人脸识别记录中包括:本次人脸识别的抓拍人脸图、本次人脸识别的时空信息。In a possible implementation manner, the image processing method further includes: receiving a face recognition record of the target user sent by the target terminal, wherein the face recognition record includes: Spatiotemporal information of sub-face recognition.

目标用户在目标终端进行人脸识别之后,目标终端可以生成本次人脸识别的人脸识别记录,并将本次人脸识别的人脸识别记录发送至服务器,以使得服务器可以对目标用户的人脸识别记录进行存储,以待后续查看。After the target user performs face recognition on the target terminal, the target terminal can generate the face recognition record of this face recognition, and send the face recognition record of this face recognition to the server, so that the server can check the target user's face recognition record. The face recognition records are stored for subsequent review.

人脸识别记录中包括的本次人脸识别的时空信息,指的是本次人脸识别的时间信息、空间信息等。The spatiotemporal information of the current face recognition included in the face recognition record refers to the time information and spatial information of the current face recognition.

人脸识别记录中除了包括本次人脸识别的抓拍人脸图、本次人脸识别的时空信息之外,还可以根据实际情况,包括其它需要记录存储的信息,本公开对此不作具体限定。The face recognition record includes, in addition to the captured face image of this face recognition and the spatiotemporal information of this face recognition, other information that needs to be recorded and stored according to the actual situation, which is not specifically limited in this disclosure. .

图5示出根据本公开实施例的一种图像处理方法的流程图。该图像处理方法可以应用于上述图2中的数据平台22。如图5所示,该图像处理方法可以包括:FIG. 5 shows a flowchart of an image processing method according to an embodiment of the present disclosure. The image processing method can be applied to the data platform 22 in FIG. 2 described above. As shown in Figure 5, the image processing method may include:

在步骤S51中,获取目标用户的目标人脸图像。In step S51, a target face image of the target user is acquired.

目标用户基于自身持有的终端设备采集人脸图像,并上传至数据平台。Target users collect face images based on their own terminal equipment and upload them to the data platform.

以上述图4为例,如图4所示,学生可以利用自身持有的手机,拍摄人脸图像后上传至学生信息管理平台。Taking the above Figure 4 as an example, as shown in Figure 4, students can use their own mobile phones to capture face images and upload them to the student information management platform.

在步骤S52中,向服务器发送特征提取请求,其中,特征提取请求中包括目标人脸图像、模型版本标识,模型版本标识用于指示人脸识别模型。In step S52, a feature extraction request is sent to the server, wherein the feature extraction request includes the target face image and the model version identifier, and the model version identifier is used to indicate the face recognition model.

为了实现人脸识别,数据平台向服务器发送特征提取请求,由于人脸识别场景中可能涉及多个不同目标终端,也即涉及多个不同模型版本标识指示的人脸识别模型,因此,特征提取请求中除了包括目标人脸图像之外,还包括模型版本标识,以使得服务器后续能够调用与人脸识别模型对应的特征提取算法进行特征提取。In order to realize face recognition, the data platform sends a feature extraction request to the server. Since the face recognition scene may involve multiple different target terminals, that is, multiple face recognition models indicated by different model version identifiers, the feature extraction request In addition to the target face image, it also includes the model version identifier, so that the server can subsequently call the feature extraction algorithm corresponding to the face recognition model to perform feature extraction.

在步骤S53中,接收服务器发送的目标人脸图像基于模型版本标识确定的参考人脸特征,其中,目标人脸图像基于模型版本标识确定的参考人脸特征,用于在具有模型版本标识对应的特征提取算法的目标终端上,对目标用户进行人脸识别。In step S53, the reference face feature determined based on the model version identifier of the target face image sent by the server is received, wherein the reference face feature determined based on the model version identifier of the target face image is used for On the target terminal of the feature extraction algorithm, face recognition is performed on the target user.

服务器确定目标人脸图像基于模型版本标识确定的参考人脸特征的过程,可以参考上述实施例的相关内容,此处不作赘述。The process for the server to determine the reference face feature determined by the target face image based on the model version identifier may refer to the relevant content of the above-mentioned embodiment, which will not be repeated here.

在步骤S54中,向服务器发送目标用户的人脸识别数据、以及目标用户的权限信息,其中,人脸识别数据包括:目标用户的身份标识、模型版本标识、目标用户基于模型版本标识确定的参考人脸特征、目标用户的个人信息。In step S54, the face recognition data of the target user and the authority information of the target user are sent to the server, wherein the face recognition data includes: the identity identifier of the target user, the model version identifier, the reference determined by the target user based on the model version identifier Facial features, personal information of target users.

在本公开实施例中,数据平台获取目标用户的目标人脸图像,向服务器发送包括目标人脸图像、用于指示人脸识别模型的模型版本标识的特征提取请求,以及接收服务器发送的目标人脸图像基于模型版本标识确定的参考人脸特征,其中,目标人脸图像基于模型版本标识确定的参考人脸特征,用于在具有模型版本标识指示的的人脸识别模型的目标终端上,对目标用户进行人脸识别,进而向服务器发送目标用户的人脸识别数据、以及目标用户的权限信息,其中,人脸识别数据包括:目标用户的身份标识、模型版本标识、目标用户基于模型版本标识确定的参考人脸特征、目标用户的个人信息。由于服务器仅基于模型版本标识对目标人脸图像进行特征提取,得到用于后续人脸识别的参考人脸特征,而不对目标人脸图像进行存储,以使得涉及个人隐私的目标人脸图像仅存储在数据平台本地,有效提高了人脸识别过程中的数据安全,降低了个人隐私泄漏的风险。In the embodiment of the present disclosure, the data platform obtains the target face image of the target user, sends to the server a feature extraction request including the target face image and the model version identifier used to indicate the face recognition model, and receives the target person sent by the server. The reference face feature determined by the face image based on the model version identifier, wherein the target face image is based on the reference face feature determined by the model version identifier, and is used for the target terminal with the face recognition model indicated by the model version identifier. The target user performs face recognition, and then sends the target user's face recognition data and the target user's authority information to the server, wherein the face recognition data includes: the target user's identity identification, model version identification, target user-based model version identification The determined reference facial features and the personal information of the target user. Because the server only performs feature extraction on the target face image based on the model version identification, and obtains the reference face features for subsequent face recognition without storing the target face image, so that only the target face image involving personal privacy is stored. Locally on the data platform, the data security in the face recognition process is effectively improved, and the risk of personal privacy leakage is reduced.

在一种可能的实现方式中,该图像处理方法还包括:接收服务器发送的图像更新请求;响应于图像更新请求,重新获取目标用户的人脸图像,以及利用重新获取的人脸图像,更新目标人脸图像。In a possible implementation manner, the image processing method further includes: receiving an image update request sent by the server; in response to the image update request, re-acquiring the face image of the target user, and using the re-acquired face image to update the target face image.

在步骤S52中,数据平台向服务器发送包括目标人脸图像的特征提取请求之后,服务器可以对目标人脸图像进行质量检测,在目标人脸图像的质量检测结果不符合预设质量条件的情况下,服务器向数据平台返回图像更新请求。对目标人脸图像进行质量检测的过程可以参考上述实施例的相关内容,此处不作赘述。In step S52, after the data platform sends the feature extraction request including the target face image to the server, the server can perform quality detection on the target face image, and in the case that the quality detection result of the target face image does not meet the preset quality conditions , the server returns an image update request to the data platform. For the process of performing quality detection on the target face image, reference may be made to the relevant content of the foregoing embodiments, which will not be repeated here.

数据平台响应图像更新请求,重新获取目标用户的人脸图像,以及利用重新获取的人脸图像,更新目标人脸图像,并将更新后的目标人脸图像再次发送至服务器,直至最新发送的目标人脸图像的质量检测结果符合预设质量条件。In response to the image update request, the data platform re-acquires the face image of the target user, and uses the re-acquired face image to update the target face image, and sends the updated target face image to the server again until the latest sent target The quality detection result of the face image conforms to the preset quality condition.

在一种可能的实现方式中,数据平台包括:人像数据平台;向服务器发送目标用户的权限信息,包括:人像数据平台确定目标用户的身份标识;人像数据平台将目标用户的身份标识、模型版本标识、目标用户基于模型版本标识确定的参考人脸特征,发送至服务器。In a possible implementation manner, the data platform includes: a portrait data platform; sending the permission information of the target user to the server, including: the portrait data platform determines the identity of the target user; the portrait data platform converts the identity of the target user, the model version The identifier and the reference face feature determined by the target user based on the model version identifier are sent to the server.

数据平台中可以包括专门存储人脸图像的人像数据平台,数据平台接收到服务器返回的目标人脸图像基于模型版本标识确定的参考人脸特征之后,将目标人脸图像基于模型版本标识确定的参考人脸特征存储在人像数据平台。The data platform may include a portrait data platform that specifically stores face images. After the data platform receives the reference face features of the target face image returned by the server based on the model version identification, the data platform uses the target face image to determine the reference face based on the model version identification. The facial features are stored in the portrait data platform.

进而,人像数据平台确定目标用户的身份标识,并将目标用户的身份标识、模型版本标识、目标用户基于模型版本标识确定的参考人脸特征,再次发送至服务器,进行人脸识别数据的入库。Further, the portrait data platform determines the identity of the target user, and sends the identity of the target user, the model version, and the reference face feature determined by the target user based on the model version to the server again, and the face recognition data is stored in the database. .

在一种可能的实现方式中,数据平台包括:信息数据平台;向服务器发送目标用户的人脸识别数据、以及目标用户的权限信息,包括:信息数据平台基于目标用户的身份标识,确定目标用户的个人信息、目标用户的权限信息;信息数据平台将目标用户的个人信息、目标用户的权限信息,发送至服务器。In a possible implementation manner, the data platform includes: an information data platform; sending the face recognition data of the target user and the permission information of the target user to the server, including: the information data platform determines the target user based on the identity of the target user The personal information of the target user and the authority information of the target user; the information data platform sends the personal information of the target user and the authority information of the target user to the server.

服务器接收到人像数据平台发送的目标用户的身份标识、模型版本标识、目标用户基于模型版本标识确定的参考人脸特征之后,将目标用户的身份标识返回至数据平台,以使得信息数据平台基于目标用户的身份标识,向服务器发送目标用户的个人信息、目标用户的权限信息,从而实现服务器对目标用户的人脸识别数据进行数据补齐处理,并对数据补齐之后的目标用户的人脸识别数据进行入库存储。After the server receives the target user's identity identifier, model version identifier, and the reference face feature determined by the target user based on the model version identifier sent by the portrait data platform, the server returns the target user's identity identifier to the data platform, so that the information data platform is based on the target user. The user's identity identifier sends the personal information of the target user and the permission information of the target user to the server, so that the server can perform data completion processing on the face recognition data of the target user, and recognize the face recognition of the target user after the data is completed. Data is stored in the warehouse.

图6示出根据本公开实施例的一种人脸识别方法的流程图。该人脸识别方法可以应用于上述图2中的目标终端23,目标终端23中具有模型版本标识指示的人脸识别模型,目标用户在目标终端23具有人脸识别权限。如图6所示,该人脸识别方法可以包括:FIG. 6 shows a flowchart of a face recognition method according to an embodiment of the present disclosure. The face recognition method can be applied to the target terminal 23 in the above-mentioned FIG. 2 . The target terminal 23 has a face recognition model indicated by the model version identifier, and the target user has face recognition authority in the target terminal 23 . As shown in Figure 6, the face recognition method may include:

在步骤S61中,接收服务器发送的目标用户的人脸识别数据,人脸识别数据包括:目标用户的身份标识、模型版本标识、目标用户基于所述模型版本标识确定的参考人脸特征、目标用户的个人信息。In step S61, the face recognition data of the target user sent by the server is received, and the face recognition data includes: the identity identifier of the target user, the model version identifier, the reference face feature determined by the target user based on the model version identifier, the target user personal information.

服务器将目标用户的人脸识别数据发送至目标终端,以使得目标用户可以在目标终端进行人脸识别。服务器确定目标用户对应的目标终端的过程可以参考上述实施例的相关内容,此处不作赘述。The server sends the face recognition data of the target user to the target terminal, so that the target user can perform face recognition on the target terminal. For the process of determining the target terminal corresponding to the target user by the server, reference may be made to the relevant content of the foregoing embodiment, which will not be repeated here.

在步骤S62中,基于人脸识别数据,对目标用户进行人脸识别。In step S62, face recognition is performed on the target user based on the face recognition data.

目标终端可以基于人脸识别数据,对目标用户进行人脸识别。例如,目标终端为人脸门禁机,目标用户可以在人脸门禁机进行人脸识别,并在识别成功后通行。The target terminal may perform face recognition on the target user based on the face recognition data. For example, the target terminal is a face access control machine, and the target user can perform face recognition on the face access control machine, and pass after the recognition is successful.

在一种可能的实现方式中,基于人脸识别数据,对目标用户进行人脸识别,包括:获取待识别用户的本次人脸识别的抓拍人脸图;基于模型版本标识指示的人脸识别模型,对本次人脸识别的抓拍人脸图进行特征提取,得到待识别用户的待识别人脸特征;在待识别用户的待识别人脸特征,与目标用户的参考人脸特征匹配成功的情况下,确定本次人脸识别成功。In a possible implementation manner, performing face recognition on the target user based on the face recognition data includes: obtaining a snapshot face image of the user to be identified for this face recognition; face recognition based on the indication of the model version identification Model, extract the features of the captured face image of this face recognition, and obtain the face features to be recognized of the user to be recognized; the face features to be recognized of the user to be recognized are successfully matched with the reference face features of the target user. In this case, it is determined that the face recognition is successful this time.

在待识别用户在目标终端前进行人脸识别时,目标终端获取待识别用户的本次人脸识别的抓拍人脸图,进而基于本地的人脸识别模型,对本次人脸识别的抓拍人脸图进行特征提取,得到待识别用户的待识别人脸特征,进而,将待识别人脸特征与目标终端本地存储的多个参考人脸特征相匹配,在待识别人脸特征与目标用户的参考人脸特征匹配成功的情况下,确定本次人脸识别成功,待识别用户即为目标用户。When the user to be identified performs face recognition in front of the target terminal, the target terminal obtains the face image captured by the face recognition of the user to be identified, and then based on the local face recognition model, the captured face image of the face recognition. Feature extraction is performed on the face image to obtain the to-be-recognized facial features of the to-be-identified user, and then, the to-be-identified facial features are matched with multiple reference facial features stored locally by the target terminal, and the to-be-identified facial features are matched with the target user's facial features. If the reference face feature is successfully matched, it is determined that the face recognition is successful this time, and the user to be identified is the target user.

例如,目标终端为人脸门禁机,在目标用户在人脸门禁机的本次人脸识别成功之后,开启人脸,允许目标用户。For example, if the target terminal is a face access control machine, after the target user's face recognition on the face access control machine is successful, the face is turned on to allow the target user.

在一种可能的实现方式中,该人脸识别方法还包括:将目标用户的个人信息,在目标终端的显示屏幕上进行脱敏显示。In a possible implementation manner, the face recognition method further includes: desensitizing and displaying the personal information of the target user on the display screen of the target terminal.

在目标用户的本次人脸识别成功之后,可以将目标用户的人脸识别数据中的个人信息,在目标终端的显示屏幕上进行脱敏显示。After the face recognition of the target user is successful, the personal information in the face recognition data of the target user can be desensitized and displayed on the display screen of the target terminal.

在一示例中,可以默认显示目标用户的姓名,且可以对目标用户的姓名进行脱敏显示。例如,对姓名中的姓进行正常显示,而对姓名中的名用*替换显示,以对个人隐私进行保护。In an example, the name of the target user may be displayed by default, and the name of the target user may be desensitized and displayed. For example, the surname in the name is displayed normally, and the first name in the name is displayed with * to protect personal privacy.

在一示例中,目标终端可以根据实际需要选择显示更多的个人信息。例如,可以显示工号、部门、身份证号等。其中,身份证号也可以进行脱敏显示,以对个人隐私进行保护。In an example, the target terminal may choose to display more personal information according to actual needs. For example, the job number, department, ID number, etc. can be displayed. Among them, the ID number can also be desensitized and displayed to protect personal privacy.

目标终端实际展示的个人信息的具体内容可以根据实际需要进行设置,本公开对此不作具体限定。The specific content of the personal information actually displayed by the target terminal may be set according to actual needs, which is not specifically limited in the present disclosure.

在一种可能的实现方式中,该人脸识别方法还包括:基于本次人脸识别的抓拍人脸图、本次人脸识别的时空信息,生成目标用户的人脸识别记录;将目标用户的人脸识别记录发送至服务器。In a possible implementation manner, the face recognition method further includes: generating a face recognition record of the target user based on the captured face image of the face recognition and the spatiotemporal information of the face recognition; The facial recognition records are sent to the server.

目标用户在目标终端进行人脸识别之后,目标终端可以生成本次人脸识别的人脸识别记录,并将本次人脸识别的人脸识别记录发送至服务器,以使得服务器可以对目标用户的人脸识别记录进行存储,以待后续查看。After the target user performs face recognition on the target terminal, the target terminal can generate the face recognition record of this face recognition, and send the face recognition record of this face recognition to the server, so that the server can check the target user's face recognition record. The face recognition records are stored for subsequent review.

人脸识别记录中包括的本次人脸识别的时空信息,指的是本次人脸识别的时间信息、空间信息等。The spatiotemporal information of the current face recognition included in the face recognition record refers to the time information and spatial information of the current face recognition.

人脸识别记录中除了包括本次人脸识别的抓拍人脸图、本次人脸识别的时空信息之外,还可以根据实际情况,包括其它需要记录存储的信息,本公开对此不作具体限定。The face recognition record includes, in addition to the captured face image of this face recognition and the spatiotemporal information of this face recognition, other information that needs to be recorded and stored according to the actual situation, which is not specifically limited in this disclosure. .

本公开实施例还提供了一种人脸识别系统,该人脸识别系统包括:数据平台、服务器、目标终端,其中:目标终端获取目标用户的目标人脸图像;目标终端向服务器发送特征提取请求,其中,特征提取请求中包括目标人脸图像、模型版本标识;服务器基于模型版本标识,调用对应的特征提取算法,对目标人脸图像进行特征提取,得到目标人脸图像基于模型版本标识确定的参考人脸特征,并删除本地缓存中的目标人脸图像;目标终端接收服务器发送的目标用户的人脸识别数据,人脸识别数据包括:目标用户的身份标识、模型版本标识、目标用户基于模型版本标识确定的参考人脸特征、目标用户的个人信息;目标终端基于人脸识别数据,对目标用户进行人脸识别。An embodiment of the present disclosure further provides a face recognition system, which includes: a data platform, a server, and a target terminal, wherein: the target terminal obtains a target face image of a target user; the target terminal sends a feature extraction request to the server , wherein the feature extraction request includes the target face image and the model version ID; the server calls the corresponding feature extraction algorithm based on the model version ID, performs feature extraction on the target face image, and obtains the target face image determined based on the model version ID. Refer to the facial features, and delete the target face image in the local cache; the target terminal receives the target user's face recognition data sent by the server, and the face recognition data includes: the target user's identity identifier, model version identifier, target user based on the model The reference face features and the personal information of the target user determined by the version identification; the target terminal performs face recognition on the target user based on the face recognition data.

人脸识别系统的具体形式可以如上述图4所示的人脸识别系统。服务器、数据平台、服务终端的具体处理流程可以参考上述实施例的相关内容,此处不作赘述。The specific form of the face recognition system may be the face recognition system shown in FIG. 4 above. For the specific processing flow of the server, the data platform, and the service terminal, reference may be made to the relevant content of the foregoing embodiments, which will not be repeated here.

图7示出根据本公开实施例的一种服务器的框图。如图7所示,服务器70,包括:FIG. 7 shows a block diagram of a server according to an embodiment of the present disclosure. As shown in FIG. 7, the server 70 includes:

接收模块71,用于接收数据平台发送的特征提取请求,其中,特征提取请求中包括目标人脸图像、模型版本标识,模型版本标识用于指示人脸识别模型;The receiving module 71 is configured to receive a feature extraction request sent by the data platform, wherein the feature extraction request includes a target face image and a model version identifier, and the model version identifier is used to indicate the face recognition model;

特征提取模块72,用于基于模型版本标识,调用对应的特征提取算法,对目标人脸图像进行特征提取,得到目标人脸图像基于模型版本标识确定的参考人脸特征,其中,目标人脸图像基于模型版本标识确定的参考人脸特征,用于在具有模型版本标识指示的人脸识别模型的目标终端上,对目标人脸图像对应的目标用户进行人脸识别;The feature extraction module 72 is configured to call a corresponding feature extraction algorithm based on the model version identification, perform feature extraction on the target face image, and obtain the reference face feature determined by the target face image based on the model version identification, wherein the target face image The reference face feature determined based on the model version identifier is used to perform face recognition on the target user corresponding to the target face image on the target terminal having the face recognition model indicated by the model version identifier;

删除模块73,用于删除本地缓存中的目标人脸图像。The deletion module 73 is used for deleting the target face image in the local cache.

在一种可能的实现方式中,服务器70,还包括:In a possible implementation manner, the server 70 further includes:

第一发送模块,用于将目标人脸图像基于模型版本标识确定的参考人脸特征发送至数据平台;The first sending module is used to send the reference face feature determined by the target face image based on the model version identification to the data platform;

接收模块71,还用于接收数据平台发送的目标用户的人脸识别数据、以及目标用户的权限信息,其中,人脸识别数据包括:目标用户的身份标识、模型版本标识、目标用户基于模型版本标识确定的参考人脸特征、目标用户的个人信息。The receiving module 71 is further configured to receive the face recognition data of the target user and the authority information of the target user sent by the data platform, wherein the face recognition data includes: the identity mark of the target user, the model version mark, the target user based on the model version Identify the determined reference facial features and the personal information of the target user.

在一种可能的实现方式中,数据平台包括:人像数据平台、信息数据平台;In a possible implementation manner, the data platform includes: a portrait data platform and an information data platform;

接收模块71,具体用于:The receiving module 71 is specifically used for:

接收人像数据平台发送的目标用户的身份标识、模型版本标识、目标用户基于模型版本标识确定的参考人脸特征;Receive the target user's identity identifier, model version identifier, and reference facial features determined by the target user based on the model version identifier sent by the portrait data platform;

接收信息数据平台发送的目标用户的个人信息、目标用户的权限信息。Receive the personal information of the target user and the permission information of the target user sent by the information data platform.

在一种可能的实现方式中,服务器70,还包括:In a possible implementation manner, the server 70 further includes:

确定模块,用于基于目标用户的权限信息,确定目标用户具有人脸识别权限的目标终端;a determination module, used for determining the target terminal of the target user with the face recognition authority based on the authority information of the target user;

第二发送模块,用于将人脸识别数据发送至目标终端。The second sending module is used for sending the face recognition data to the target terminal.

在一种可能的实现方式中,接收模块71,还用于接收目标终端发送的目标用户的人脸识别记录,其中,人脸识别记录中包括:本次人脸识别的抓拍人脸图、本次人脸识别的时空信息。In a possible implementation manner, the receiving module 71 is further configured to receive the face recognition record of the target user sent by the target terminal, wherein the face recognition record includes: Spatiotemporal information of sub-face recognition.

在一种可能的实现方式中,服务器70,还包括:In a possible implementation manner, the server 70 further includes:

分组模块,用于在接收到数据平台发送的多个目标用户的人脸识别数据的情况下,根据每个目标用户的权限信息,对多个目标用户的人脸识别数据进行分组存储。The grouping module is used for grouping and storing the face recognition data of the multiple target users according to the permission information of each target user in the case of receiving the face recognition data of the multiple target users sent by the data platform.

在一种可能的实现方式中,服务器70,还包括:In a possible implementation manner, the server 70 further includes:

质量检测模块,用于对目标人脸图像进行质量检测;The quality detection module is used to perform quality detection on the target face image;

第一发送模块,还用于在目标人脸图像的质量检测结果不符合预设质量条件的情况下,向数据平台发送图像更新请求。The first sending module is further configured to send an image update request to the data platform when the quality detection result of the target face image does not meet the preset quality condition.

图8示出根据本公开实施例的一种数据平台的框图。如图8所示,数据平台80,包括:FIG. 8 shows a block diagram of a data platform according to an embodiment of the present disclosure. As shown in Figure 8, the data platform 80 includes:

获取模块81,用于获取目标用户的目标人脸图像;an acquisition module 81, configured to acquire the target face image of the target user;

第一发送模块82,用于向服务器发送特征提取请求,其中,特征提取请求中包括目标人脸图像、模型版本标识,模型版本标识用于指示人脸识别模型;The first sending module 82 is configured to send a feature extraction request to the server, wherein the feature extraction request includes the target face image and the model version identifier, and the model version identifier is used to indicate the face recognition model;

接收模块83,用于接收服务器发送的目标人脸图像基于模型版本标识确定的参考人脸特征,其中,目标人脸图像基于模型版本标识确定的参考人脸特征,用于在具有模型版本标识指示的的人脸识别模型的目标终端上,对目标用户进行人脸识别;The receiving module 83 is configured to receive the reference face feature determined based on the model version identification of the target face image sent by the server, wherein the reference face feature determined based on the model version identification of the target face image is used to indicate that the target face image is based on the model version identification. On the target terminal of the face recognition model, perform face recognition on the target user;

第二发送模块84,还用于向服务器发送目标用户的人脸识别数据、以及目标用户的权限信息,其中,人脸识别数据包括:目标用户的身份标识、模型版本标识、目标用户基于模型版本标识确定的参考人脸特征、目标用户的个人信息。The second sending module 84 is further configured to send the face recognition data of the target user and the authority information of the target user to the server, wherein the face recognition data includes: the identity identification of the target user, the model version identification, the target user based on the model version Identify the determined reference facial features and the personal information of the target user.

在一种可能的实现方式中,数据平台80,包括:人像数据平台;In a possible implementation manner, the data platform 80 includes: a portrait data platform;

第二发送模块84,具体用于:The second sending module 84 is specifically used for:

第一确定子模块,用于控制人像数据平台确定目标用户的身份标识;The first determination submodule is used to control the portrait data platform to determine the identity of the target user;

第一发送子模块,用于控制人像数据平台将目标用户的身份标识、模型版本标识、目标用户基于模型版本标识确定的参考人脸特征,发送至服务器。The first sending sub-module is used to control the portrait data platform to send the target user's identity identifier, model version identifier, and reference face features determined by the target user based on the model version identifier to the server.

在一种可能的实现方式中,数据平台80,包括:信息数据平台;In a possible implementation manner, the data platform 80 includes: an information data platform;

第二发送模块84,具体用于:The second sending module 84 is specifically used for:

第二确定子模块,用于控制信息数据平台基于目标用户的身份标识,确定目标用户的个人信息、目标用户的权限信息;The second determination sub-module is used to control the information data platform to determine the personal information of the target user and the authority information of the target user based on the identity of the target user;

第二发送子模块,用于控制信息数据平台将目标用户的个人信息、目标用户的权限信息,发送至服务器。The second sending sub-module is used to control the information data platform to send the personal information of the target user and the permission information of the target user to the server.

在一种可能的实现方式中,接收模块83,还用于接收所述服务器发送的图像更新请求;In a possible implementation manner, the receiving module 83 is further configured to receive an image update request sent by the server;

获取模块81,还用于响应于图像更新请求,重新获取目标用户的人脸图像,以及利用重新获取的人脸图像,更新目标人脸图像。The acquiring module 81 is further configured to re-acquire the face image of the target user in response to the image update request, and update the target face image using the re-acquired face image.

图9示出根据本公开实施例的一种目标终端的框图。目标终端具有模型版本标识指示的人脸识别模型,目标用户在目标终端具有人脸识别权限。如图9所示,目标终端90,包括:FIG. 9 shows a block diagram of a target terminal according to an embodiment of the present disclosure. The target terminal has the face recognition model indicated by the model version identifier, and the target user has face recognition authority on the target terminal. As shown in Figure 9, the target terminal 90 includes:

接收模块91,用于接收服务器发送的目标用户的人脸识别数据,人脸识别数据包括:目标用户的身份标识、模型版本标识、目标用户基于模型版本标识确定的参考人脸特征、目标用户的个人信息;The receiving module 91 is used for receiving the face recognition data of the target user sent by the server. The face recognition data includes: the target user's identity mark, the model version mark, the reference face feature determined by the target user based on the model version mark, the target user's identity mark. Personal information;

人脸识别模块92,用于基于人脸识别数据,对目标用户进行人脸识别。The face recognition module 92 is configured to perform face recognition on the target user based on the face recognition data.

在一种可能的实现方式中,人脸识别模块92,具体用于:In a possible implementation, the face recognition module 92 is specifically used for:

获取待识别用户的本次人脸识别的抓拍人脸图;Obtain the captured face image of the face recognition of the user to be identified;

基于模型版本标识指示的人脸识别模型,对本次人脸识别的抓拍人脸图进行特征提取,得到待识别用户的待识别人脸特征;Based on the face recognition model indicated by the model version identifier, feature extraction is performed on the captured face image of this face recognition, and the face features to be recognized of the user to be recognized are obtained;

在待识别用户的待识别人脸,与目标用户的参考人脸特征匹配成功的情况下,确定本次人脸识别成功。In the case that the to-be-recognized face of the user to be recognized is successfully matched with the reference face feature of the target user, it is determined that the face recognition is successful this time.

在一种可能的实现方式中,目标终端90,还包括:In a possible implementation manner, the target terminal 90 further includes:

显示模块,用于将目标用户的个人信息,在目标终端的显示屏幕上进行脱敏显示。The display module is used to desensitize and display the personal information of the target user on the display screen of the target terminal.

在一种可能的实现方式中,目标终端90,还包括:In a possible implementation manner, the target terminal 90 further includes:

记录生成模块,用于基于本次人脸识别的抓拍人脸图、本次人脸识别的时空信息,生成目标用户的人脸识别记录;The record generation module is used to generate the face recognition record of the target user based on the captured face image of this face recognition and the spatiotemporal information of this face recognition;

发送模块,用于将目标用户的人脸识别记录发送至服务器。The sending module is used to send the face recognition record of the target user to the server.

可以理解,本公开提及的上述各个方法实施例,在不违背原理逻辑的情况下,均可以彼此相互结合形成结合后的实施例,限于篇幅,本公开不再赘述。本领域技术人员可以理解,在具体实施方式的上述方法中,各步骤的具体执行顺序应当以其功能和可能的内在逻辑确定。It can be understood that the above-mentioned method embodiments mentioned in the present disclosure can be combined with each other to form a combined embodiment without violating the principle and logic. Those skilled in the art can understand that, in the above method of the specific embodiment, the specific execution order of each step should be determined by its function and possible internal logic.

该方法与计算机系统的内部结构存在特定技术关联,且能够解决如何提升硬件运算效率或执行效果的技术问题(包括减少数据存储量、减少数据传输量、提高硬件处理速度等),从而获得符合自然规律的计算机系统内部性能改进的技术效果。The method has a specific technical relationship with the internal structure of the computer system, and can solve the technical problem of how to improve the hardware operation efficiency or execution effect (including reducing the amount of data storage, reducing the amount of data transmission, improving the hardware processing speed, etc.), so as to obtain a natural The technical effects of regular computer system internal performance improvements.

在一些实施例中,本公开实施例提供的装置具有的功能或包含的模块可以用于执行上文方法实施例描述的方法,其具体实现可以参照上文方法实施例的描述,为了简洁,这里不再赘述。In some embodiments, the functions or modules included in the apparatuses provided in the embodiments of the present disclosure may be used to execute the methods described in the above method embodiments. For specific implementation, reference may be made to the descriptions of the above method embodiments. For brevity, here No longer.

本公开实施例还提出一种计算机可读存储介质,其上存储有计算机程序指令,所述计算机程序指令被处理器执行时实现上述方法。计算机可读存储介质可以是易失性或非易失性计算机可读存储介质。Embodiments of the present disclosure further provide a computer-readable storage medium, on which computer program instructions are stored, and when the computer program instructions are executed by a processor, the foregoing method is implemented. Computer-readable storage media can be volatile or non-volatile computer-readable storage media.

本公开实施例还提出一种电子设备,包括:处理器;用于存储处理器可执行指令的存储器;其中,所述处理器被配置为调用所述存储器存储的指令,以执行上述方法。An embodiment of the present disclosure further provides an electronic device, including: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to invoke the instructions stored in the memory to execute the above method.

本公开实施例还提供了一种计算机程序产品,包括计算机可读代码,或者承载有计算机可读代码的非易失性计算机可读存储介质,当所述计算机可读代码在电子设备的处理器中运行时,所述电子设备中的处理器执行上述方法。Embodiments of the present disclosure also provide a computer program product, including computer-readable codes, or a non-volatile computer-readable storage medium carrying computer-readable codes, when the computer-readable codes are stored in a processor of an electronic device When running in the electronic device, the processor in the electronic device executes the above method.

电子设备可以被提供为终端、服务器或其它形态的设备。The electronic device may be provided as a terminal, server or other form of device.

图10示出根据本公开实施例的一种电子设备的框图。参照图10,电子设备1000可以是用户设备(User Equipment,UE)、移动设备、用户终端、终端、蜂窝电话、无绳电话、个人数字处理(Personal Digital Assistant,PDA)、手持设备、计算设备、车载设备、可穿戴设备等终端设备。FIG. 10 shows a block diagram of an electronic device according to an embodiment of the present disclosure. 10 , the electronic device 1000 may be a user equipment (User Equipment, UE), a mobile device, a user terminal, a terminal, a cellular phone, a cordless phone, a Personal Digital Assistant (PDA), a handheld device, a computing device, a vehicle Devices, wearable devices and other terminal equipment.

参照图10,电子设备1000可以包括以下一个或多个组件:处理组件1002,存储器1004,电源组件1006,多媒体组件1008,音频组件1010,输入/输出(I/O)接口1012,传感器组件1014,以及通信组件1016。10, an electronic device 1000 may include one or more of the following components: a processing component 1002, a memory 1004, a power supply component 1006, a multimedia component 1008, an audio component 1010, an input/output (I/O) interface 1012, a sensor component 1014, and communication component 1016.

处理组件1002通常控制电子设备1000的整体操作,诸如与显示,电话呼叫,数据通信,相机操作和记录操作相关联的操作。处理组件1002可以包括一个或多个处理器1020来执行指令,以完成上述的方法的全部或部分步骤。此外,处理组件1002可以包括一个或多个模块,便于处理组件1002和其他组件之间的交互。例如,处理组件1002可以包括多媒体模块,以方便多媒体组件1008和处理组件1002之间的交互。The processing component 1002 generally controls the overall operation of the electronic device 1000, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 1002 can include one or more processors 1020 to execute instructions to perform all or some of the steps of the methods described above. Additionally, processing component 1002 may include one or more modules that facilitate interaction between processing component 1002 and other components. For example, processing component 1002 may include a multimedia module to facilitate interaction between multimedia component 1008 and processing component 1002.

存储器1004被配置为存储各种类型的数据以支持在电子设备1000的操作。这些数据的示例包括用于在电子设备1000上操作的任何应用程序或方法的指令,联系人数据,电话簿数据,消息,图片,视频等。存储器1004可以由任何类型的易失性或非易失性存储设备或者它们的组合实现,如静态随机存取存储器(SRAM),电可擦除可编程只读存储器(EEPROM),可擦除可编程只读存储器(EPROM),可编程只读存储器(PROM),只读存储器(ROM),磁存储器,快闪存储器,磁盘或光盘。The memory 1004 is configured to store various types of data to support the operation of the electronic device 1000 . Examples of such data include instructions for any application or method operating on the electronic device 1000, contact data, phonebook data, messages, pictures, videos, and the like. Memory 1004 may be implemented by any type of volatile or nonvolatile storage device or combination thereof, such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic or Optical Disk.

电源组件1006为电子设备1000的各种组件提供电力。电源组件1006可以包括电源管理系统,一个或多个电源,及其他与为电子设备1000生成、管理和分配电力相关联的组件。Power supply assembly 1006 provides power to various components of electronic device 1000 . Power supply components 1006 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to electronic device 1000 .

多媒体组件1008包括在所述电子设备1000和用户之间的提供一个输出接口的屏幕。在一些实施例中,屏幕可以包括液晶显示器(LCD)和触摸面板(TP)。如果屏幕包括触摸面板,屏幕可以被实现为触摸屏,以接收来自用户的输入信号。触摸面板包括一个或多个触摸传感器以感测触摸、滑动和触摸面板上的手势。所述触摸传感器可以不仅感测触摸或滑动动作的边界,而且还检测与所述触摸或滑动操作相关的持续时间和压力。在一些实施例中,多媒体组件1008包括一个前置摄像头和/或后置摄像头。当电子设备1000处于操作模式,如拍摄模式或视频模式时,前置摄像头和/或后置摄像头可以接收外部的多媒体数据。每个前置摄像头和后置摄像头可以是一个固定的光学透镜系统或具有焦距和光学变焦能力。Multimedia component 1008 includes a screen that provides an output interface between the electronic device 1000 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touch, swipe, and gestures on the touch panel. The touch sensor may not only sense the boundaries of a touch or swipe action, but also detect the duration and pressure associated with the touch or swipe action. In some embodiments, the multimedia component 1008 includes a front-facing camera and/or a rear-facing camera. When the electronic device 1000 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera may receive external multimedia data. Each of the front and rear cameras can be a fixed optical lens system or have focal length and optical zoom capability.

音频组件1010被配置为输出和/或输入音频信号。例如,音频组件1010包括一个麦克风(MIC),当电子设备1000处于操作模式,如呼叫模式、记录模式和语音识别模式时,麦克风被配置为接收外部音频信号。所接收的音频信号可以被进一步存储在存储器1004或经由通信组件1016发送。在一些实施例中,音频组件1010还包括一个扬声器,用于输出音频信号。Audio component 1010 is configured to output and/or input audio signals. For example, audio component 1010 includes a microphone (MIC) that is configured to receive external audio signals when electronic device 1000 is in operating modes, such as call mode, recording mode, and voice recognition mode. The received audio signal may be further stored in memory 1004 or transmitted via communication component 1016 . In some embodiments, audio component 1010 also includes a speaker for outputting audio signals.

I/O接口1012为处理组件1002和外围接口模块之间提供接口,上述外围接口模块可以是键盘,点击轮,按钮等。这些按钮可包括但不限于:主页按钮、音量按钮、启动按钮和锁定按钮。The I/O interface 1012 provides an interface between the processing component 1002 and a peripheral interface module, which may be a keyboard, a click wheel, a button, or the like. These buttons may include, but are not limited to: home button, volume buttons, start button, and lock button.

传感器组件1014包括一个或多个传感器,用于为电子设备1000提供各个方面的状态评估。例如,传感器组件1014可以检测到电子设备1000的打开/关闭状态,组件的相对定位,例如所述组件为电子设备1000的显示器和小键盘,传感器组件1014还可以检测电子设备1000或电子设备1000一个组件的位置改变,用户与电子设备1000接触的存在或不存在,电子设备1000方位或加速/减速和电子设备1000的温度变化。传感器组件1014可以包括接近传感器,被配置用来在没有任何的物理接触时检测附近物体的存在。传感器组件1014还可以包括光传感器,如互补金属氧化物半导体(CMOS)或电荷耦合装置(CCD)图像传感器,用于在成像应用中使用。在一些实施例中,该传感器组件1014还可以包括加速度传感器,陀螺仪传感器,磁传感器,压力传感器或温度传感器。Sensor assembly 1014 includes one or more sensors for providing status assessment of various aspects of electronic device 1000 . For example, the sensor assembly 1014 can detect the open/closed state of the electronic device 1000, the relative positioning of the components, such as the display and the keypad of the electronic device 1000, the sensor assembly 1014 can also detect the electronic device 1000 or one of the electronic devices 1000 The position of components changes, the presence or absence of user contact with the electronic device 1000 , the orientation or acceleration/deceleration of the electronic device 1000 and the temperature of the electronic device 1000 changes. Sensor assembly 1014 may include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact. The sensor assembly 1014 may also include a light sensor, such as a complementary metal oxide semiconductor (CMOS) or charge coupled device (CCD) image sensor, for use in imaging applications. In some embodiments, the sensor assembly 1014 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

通信组件1016被配置为便于电子设备1000和其他设备之间有线或无线方式的通信。电子设备1000可以接入基于通信标准的无线网络,如无线网络(Wi-Fi)、第二代移动通信技术(2G)、第三代移动通信技术(3G)、第四代移动通信技术(4G)、通用移动通信技术的长期演进(LTE)、第五代移动通信技术(5G)或它们的组合。在一个示例性实施例中,通信组件1016经由广播信道接收来自外部广播管理系统的广播信号或广播相关信息。在一个示例性实施例中,所述通信组件1016还包括近场通信(NFC)模块,以促进短程通信。例如,在NFC模块可基于射频识别(RFID)技术,红外数据协会(IrDA)技术,超宽带(UWB)技术,蓝牙(BT)技术和其他技术来实现。Communication component 1016 is configured to facilitate wired or wireless communication between electronic device 1000 and other devices. The electronic device 1000 can access a wireless network based on communication standards, such as wireless network (Wi-Fi), second generation mobile communication technology (2G), third generation mobile communication technology (3G), fourth generation mobile communication technology (4G) ), Long Term Evolution (LTE) of Universal Mobile Telecommunications Technology, Fifth Generation Mobile Telecommunications Technology (5G), or a combination thereof. In one exemplary embodiment, the communication component 1016 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 1016 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

在示例性实施例中,电子设备1000可以被一个或多个应用专用集成电路(ASIC)、数字信号处理器(DSP)、数字信号处理设备(DSPD)、可编程逻辑器件(PLD)、现场可编程门阵列(FPGA)、控制器、微控制器、微处理器或其他电子元件实现,用于执行上述方法。In an exemplary embodiment, electronic device 1000 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable A programmed gate array (FPGA), controller, microcontroller, microprocessor or other electronic component implementation is used to perform the above method.

在示例性实施例中,还提供了一种非易失性计算机可读存储介质,例如包括计算机程序指令的存储器1004,上述计算机程序指令可由电子设备1000的处理器1020执行以完成上述方法。In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as a memory 1004 comprising computer program instructions executable by the processor 1020 of the electronic device 1000 to perform the above method.

本公开涉及增强现实领域,通过获取现实环境中的目标对象的图像信息,进而借助各类视觉相关算法实现对目标对象的相关特征、状态及属性进行检测或识别处理,从而得到与具体应用匹配的虚拟与现实相结合的AR效果。示例性的,目标对象可涉及与人体相关的脸部、肢体、手势、动作等,或者与物体相关的标识物、标志物,或者与场馆或场所相关的沙盘、展示区域或展示物品等。视觉相关算法可涉及视觉定位、SLAM、三维重建、图像注册、背景分割、对象的关键点提取及跟踪、对象的位姿或深度检测等。具体应用不仅可以涉及跟真实场景或物品相关的导览、导航、讲解、重建、虚拟效果叠加展示等交互场景,还可以涉及与人相关的特效处理,比如妆容美化、肢体美化、特效展示、虚拟模型展示等交互场景。可通过卷积神经网络,实现对目标对象的相关特征、状态及属性进行检测或识别处理。上述卷积神经网络是基于深度学习框架进行模型训练而得到的网络模型。The present disclosure relates to the field of augmented reality. By acquiring the image information of the target object in the real environment, the relevant features, states and attributes of the target object can be detected or recognized with the help of various visual correlation algorithms, so as to obtain the image information matching the specific application. AR effect that combines virtual and reality. Exemplarily, the target object may involve faces, limbs, gestures, movements, etc. related to the human body, or objects, markers, or sandboxes, display areas, or display items related to venues or venues. Vision-related algorithms may involve visual localization, SLAM, 3D reconstruction, image registration, background segmentation, object keypoint extraction and tracking, object pose or depth detection, etc. The specific application can not only involve interactive scenes such as navigation, navigation, explanation, reconstruction, and virtual effect overlay display related to real scenes or items, but also special effects processing related to people, such as makeup beautification, body beautification, special effects display, virtual Model display and other interactive scenarios. The relevant features, states and attributes of the target object can be detected or recognized through the convolutional neural network. The above convolutional neural network is a network model obtained by model training based on a deep learning framework.

图11示出根据本公开实施例的一种电子设备的框图。参照图11,电子设备1900可以被提供为一服务器或终端设备。参照图11,电子设备1900包括处理组件1922,其进一步包括一个或多个处理器,以及由存储器1932所代表的存储器资源,用于存储可由处理组件1922的执行的指令,例如应用程序。存储器1932中存储的应用程序可以包括一个或一个以上的每一个对应于一组指令的模块。此外,处理组件1922被配置为执行指令,以执行上述方法。FIG. 11 shows a block diagram of an electronic device according to an embodiment of the present disclosure. Referring to FIG. 11, the electronic device 1900 may be provided as a server or a terminal device. 11, electronic device 1900 includes a processing component 1922, which further includes one or more processors, and a memory resource, represented by memory 1932, for storing instructions executable by processing component 1922, such as applications. An application program stored in memory 1932 may include one or more modules, each corresponding to a set of instructions. Additionally, the processing component 1922 is configured to execute instructions to perform the above-described methods.

电子设备1900还可以包括一个电源组件1926被配置为执行电子设备1900的电源管理,一个有线或无线网络接口1950被配置为将电子设备1900连接到网络,和一个输入输出(I/O)接口1958。电子设备1900可以操作基于存储在存储器1932的操作系统,例如微软服务器操作系统(Windows ServerTM),苹果公司推出的基于图形用户界面操作系统(Mac OSXTM),多用户多进程的计算机操作系统(UnixTM),自由和开放原代码的类Unix操作系统(LinuxTM),开放原代码的类Unix操作系统(FreeBSDTM)或类似。The electronic device 1900 may also include a power supply assembly 1926 configured to perform power management of the electronic device 1900, a wired or wireless network interface 1950 configured to connect the electronic device 1900 to a network, and an input output (I/O) interface 1958 . The electronic device 1900 can operate based on an operating system stored in the memory 1932, such as a Microsoft server operating system (Windows Server ), a graphical user interface based operating system (Mac OSX ) introduced by Apple, a multi-user multi-process computer operating system ( Unix ), Free and Open Source Unix-like Operating System (Linux ), Open Source Unix-like Operating System (FreeBSD ) or the like.

在示例性实施例中,还提供了一种非易失性计算机可读存储介质,例如包括计算机程序指令的存储器1932,上述计算机程序指令可由电子设备1900的处理组件1922执行以完成上述方法。In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as memory 1932 comprising computer program instructions executable by processing component 1922 of electronic device 1900 to perform the above-described method.

本公开可以是系统、方法和/或计算机程序产品。计算机程序产品可以包括计算机可读存储介质,其上载有用于使处理器实现本公开的各个方面的计算机可读程序指令。The present disclosure may be a system, method and/or computer program product. The computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for causing a processor to implement various aspects of the present disclosure.

计算机可读存储介质可以是可以保持和存储由指令执行设备使用的指令的有形设备。计算机可读存储介质例如可以是(但不限于)电存储设备、磁存储设备、光存储设备、电磁存储设备、半导体存储设备或者上述的任意合适的组合。计算机可读存储介质的更具体的例子(非穷举的列表)包括:便携式计算机盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、静态随机存取存储器(SRAM)、便携式压缩盘只读存储器(CD-ROM)、数字多功能盘(DVD)、记忆棒、软盘、机械编码设备、例如其上存储有指令的打孔卡或凹槽内凸起结构、以及上述的任意合适的组合。这里所使用的计算机可读存储介质不被解释为瞬时信号本身,诸如无线电波或者其他自由传播的电磁波、通过波导或其他传输媒介传播的电磁波(例如,通过光纤电缆的光脉冲)、或者通过电线传输的电信号。A computer-readable storage medium may be a tangible device that can hold and store instructions for use by the instruction execution device. The computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (non-exhaustive list) of computer readable storage media include: portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM) or flash memory), static random access memory (SRAM), portable compact disk read only memory (CD-ROM), digital versatile disk (DVD), memory sticks, floppy disks, mechanically coded devices, such as printers with instructions stored thereon Hole cards or raised structures in grooves, and any suitable combination of the above. Computer-readable storage media, as used herein, are not to be construed as transient signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (eg, light pulses through fiber optic cables), or through electrical wires transmitted electrical signals.

这里所描述的计算机可读程序指令可以从计算机可读存储介质下载到各个计算/处理设备,或者通过网络、例如因特网、局域网、广域网和/或无线网下载到外部计算机或外部存储设备。网络可以包括铜传输电缆、光纤传输、无线传输、路由器、防火墙、交换机、网关计算机和/或边缘服务器。每个计算/处理设备中的网络适配卡或者网络接口从网络接收计算机可读程序指令,并转发该计算机可读程序指令,以供存储在各个计算/处理设备中的计算机可读存储介质中。The computer readable program instructions described herein may be downloaded to various computing/processing devices from a computer readable storage medium, or to an external computer or external storage device over a network such as the Internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and/or edge servers. A network adapter card or network interface in each computing/processing device receives computer-readable program instructions from a network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in each computing/processing device .

用于执行本公开操作的计算机程序指令可以是汇编指令、指令集架构(ISA)指令、机器指令、机器相关指令、微代码、固件指令、状态设置数据、或者以一种或多种编程语言的任意组合编写的源代码或目标代码,所述编程语言包括面向对象的编程语言—诸如Smalltalk、C++等,以及常规的过程式编程语言—诸如“C”语言或类似的编程语言。计算机可读程序指令可以完全地在用户计算机上执行、部分地在用户计算机上执行、作为一个独立的软件包执行、部分在用户计算机上部分在远程计算机上执行、或者完全在远程计算机或服务器上执行。在涉及远程计算机的情形中,远程计算机可以通过任意种类的网络—包括局域网(LAN)或广域网(WAN)—连接到用户计算机,或者,可以连接到外部计算机(例如利用因特网服务提供商来通过因特网连接)。在一些实施例中,通过利用计算机可读程序指令的状态信息来个性化定制电子电路,例如可编程逻辑电路、现场可编程门阵列(FPGA)或可编程逻辑阵列(PLA),该电子电路可以执行计算机可读程序指令,从而实现本公开的各个方面。Computer program instructions for carrying out operations of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or instructions in one or more programming languages. Source or object code, written in any combination, including object-oriented programming languages, such as Smalltalk, C++, etc., and conventional procedural programming languages, such as the "C" language or similar programming languages. The computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server implement. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (eg, using an Internet service provider through the Internet connect). In some embodiments, custom electronic circuits, such as programmable logic circuits, field programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), can be personalized by utilizing state information of computer readable program instructions. Computer readable program instructions are executed to implement various aspects of the present disclosure.

这里参照根据本公开实施例的方法、装置(系统)和计算机程序产品的流程图和/或框图描述了本公开的各个方面。应当理解,流程图和/或框图的每个方框以及流程图和/或框图中各方框的组合,都可以由计算机可读程序指令实现。Aspects of the present disclosure are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the disclosure. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer readable program instructions.

这些计算机可读程序指令可以提供给通用计算机、专用计算机或其它可编程数据处理装置的处理器,从而生产出一种机器,使得这些指令在通过计算机或其它可编程数据处理装置的处理器执行时,产生了实现流程图和/或框图中的一个或多个方框中规定的功能/动作的装置。也可以把这些计算机可读程序指令存储在计算机可读存储介质中,这些指令使得计算机、可编程数据处理装置和/或其他设备以特定方式工作,从而,存储有指令的计算机可读介质则包括一个制造品,其包括实现流程图和/或框图中的一个或多个方框中规定的功能/动作的各个方面的指令。These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer or other programmable data processing apparatus to produce a machine that causes the instructions when executed by the processor of the computer or other programmable data processing apparatus , resulting in means for implementing the functions/acts specified in one or more blocks of the flowchart and/or block diagrams. These computer readable program instructions can also be stored in a computer readable storage medium, these instructions cause a computer, programmable data processing apparatus and/or other equipment to operate in a specific manner, so that the computer readable medium on which the instructions are stored includes An article of manufacture comprising instructions for implementing various aspects of the functions/acts specified in one or more blocks of the flowchart and/or block diagrams.

也可以把计算机可读程序指令加载到计算机、其它可编程数据处理装置、或其它设备上,使得在计算机、其它可编程数据处理装置或其它设备上执行一系列操作步骤,以产生计算机实现的过程,从而使得在计算机、其它可编程数据处理装置、或其它设备上执行的指令实现流程图和/或框图中的一个或多个方框中规定的功能/动作。Computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other equipment to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other equipment to produce a computer-implemented process , thereby causing instructions executing on a computer, other programmable data processing apparatus, or other device to implement the functions/acts specified in one or more blocks of the flowcharts and/or block diagrams.

附图中的流程图和框图显示了根据本公开的多个实施例的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上,流程图或框图中的每个方框可以代表一个模块、程序段或指令的一部分,所述模块、程序段或指令的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。在有些作为替换的实现中,方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如,两个连续的方框实际上可以基本并行地执行,它们有时也可以按相反的顺序执行,这依所涉及的功能而定。也要注意的是,框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合,可以用执行规定的功能或动作的专用的基于硬件的系统来实现,或者可以用专用硬件与计算机指令的组合来实现。The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more functions for implementing the specified logical function(s) executable instructions. In some alternative implementations, the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It is also noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented in dedicated hardware-based systems that perform the specified functions or actions , or can be implemented in a combination of dedicated hardware and computer instructions.

该计算机程序产品可以具体通过硬件、软件或其结合的方式实现。在一个可选实施例中,所述计算机程序产品具体体现为计算机存储介质,在另一个可选实施例中,计算机程序产品具体体现为软件产品,例如软件开发包(Software Development Kit,SDK)等等。The computer program product can be specifically implemented by hardware, software or a combination thereof. In an optional embodiment, the computer program product is embodied as a computer storage medium, and in another optional embodiment, the computer program product is embodied as a software product, such as a software development kit (Software Development Kit, SDK), etc. Wait.

上文对各个实施例的描述倾向于强调各个实施例之间的不同之处,其相同或相似之处可以互相参考,为了简洁,本文不再赘述。The above descriptions of the various embodiments tend to emphasize the differences between the various embodiments, and the similarities or similarities can be referred to each other. For the sake of brevity, details are not repeated herein.

本领域技术人员可以理解,在具体实施方式的上述方法中,各步骤的撰写顺序并不意味着严格的执行顺序而对实施过程构成任何限定,各步骤的具体执行顺序应当以其功能和可能的内在逻辑确定。Those skilled in the art can understand that in the above method of the specific implementation, the writing order of each step does not mean a strict execution order but constitutes any limitation on the implementation process, and the specific execution order of each step should be based on its function and possible Internal logic is determined.

若本申请技术方案涉及个人信息,应用本申请技术方案的产品在处理个人信息前,已明确告知个人信息处理规则,并取得个人自主同意。若本申请技术方案涉及敏感个人信息,应用本申请技术方案的产品在处理敏感个人信息前,已取得个人单独同意,并且同时满足“明示同意”的要求。例如,在摄像头等个人信息采集装置处,设置明确显著的标识告知已进入个人信息采集范围,将会对个人信息进行采集,若个人自愿进入采集范围即视为同意对其个人信息进行采集;或者在个人信息处理的装置上,利用明显的标识/信息告知个人信息处理规则的情况下,通过弹窗信息或请个人自行上传其个人信息等方式获得个人授权;其中,个人信息处理规则可包括个人信息处理者、个人信息处理目的、处理方式以及处理的个人信息种类等信息。If the technical solution of this application involves personal information, the product applying the technical solution of this application has clearly informed the personal information processing rules and obtained the individual's voluntary consent before processing personal information. If the technical solution of the present application involves sensitive personal information, the product applying the technical solution of the present application has obtained the individual's individual consent before processing sensitive personal information, and at the same time satisfies the requirement of "express consent". For example, at the personal information collection device such as a camera, a clear and conspicuous sign is set to inform that the personal information has entered the collection range, and the personal information will be collected. If the individual voluntarily enters the collection range, it is deemed to agree to the collection of their personal information; or On the personal information processing device, if the personal information processing rules are informed by obvious signs/information, the personal authorization can be obtained by means of pop-up information or asking individuals to upload their personal information; among them, the personal information processing rules may include personal information Information processor, purpose of processing personal information, method of processing, and types of personal information processed.

以上已经描述了本公开的各实施例,上述说明是示例性的,并非穷尽性的,并且也不限于所披露的各实施例。在不偏离所说明的各实施例的范围和精神的情况下,对于本技术领域的普通技术人员来说许多修改和变更都是显而易见的。本文中所用术语的选择,旨在最好地解释各实施例的原理、实际应用或对市场中的技术的改进,或者使本技术领域的其它普通技术人员能理解本文披露的各实施例。Various embodiments of the present disclosure have been described above, and the foregoing descriptions are exemplary, not exhaustive, and not limiting of the disclosed embodiments. Numerous modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein was chosen to best explain the principles of the various embodiments, the practical application or improvement over the technology in the marketplace, or to enable others of ordinary skill in the art to understand the various embodiments disclosed herein.

Claims (16)

1.一种图像处理方法,其特征在于,所述方法应用于服务器,所述方法包括:1. An image processing method, wherein the method is applied to a server, and the method comprises: 接收数据平台发送的特征提取请求,其中,所述特征提取请求中包括目标人脸图像、模型版本标识,所述模型版本标识用于指示人脸识别模型;receiving a feature extraction request sent by the data platform, wherein the feature extraction request includes a target face image and a model version identifier, where the model version identifier is used to indicate a face recognition model; 基于所述模型版本标识,调用对应的特征提取算法,对所述目标人脸图像进行特征提取,得到所述目标人脸图像基于所述模型版本标识确定的参考人脸特征,其中,所述目标人脸图像基于所述模型版本标识确定的参考人脸特征,用于在具有所述模型版本标识指示的人脸识别模型的目标终端上,对所述目标人脸图像对应的目标用户进行人脸识别;Based on the model version identification, the corresponding feature extraction algorithm is invoked to perform feature extraction on the target face image to obtain the reference face feature determined by the target face image based on the model version identification, wherein the target face image The reference face feature determined by the face image based on the model version identifier is used to perform face recognition on the target user corresponding to the target face image on the target terminal having the face recognition model indicated by the model version identifier. identify; 删除本地缓存中的所述目标人脸图像。Delete the target face image in the local cache. 2.根据权利要求1所述的方法,其特征在于,所述方法还包括:2. The method according to claim 1, wherein the method further comprises: 将所述目标人脸图像基于所述模型版本标识确定的参考人脸特征发送至所述数据平台;sending the target face image to the data platform based on the reference face feature determined by the model version identifier; 接收所述数据平台发送的所述目标用户的人脸识别数据、以及所述目标用户的权限信息,其中,所述人脸识别数据包括:所述目标用户的身份标识、所述模型版本标识、所述目标用户基于所述模型版本标识确定的参考人脸特征、所述目标用户的个人信息。Receive the face recognition data of the target user and the permission information of the target user sent by the data platform, wherein the face recognition data includes: the identity identifier of the target user, the model version identifier, The target user is based on the reference face feature determined by the model version identification and the personal information of the target user. 3.根据权利要求2所述的方法,其特征在于,所述数据平台包括:人像数据平台、信息数据平台;3. The method according to claim 2, wherein the data platform comprises: a portrait data platform and an information data platform; 所述接收所述数据平台发送的所述目标用户的人脸识别数据、以及所述目标用户的权限信息,包括:The receiving the face recognition data of the target user and the permission information of the target user sent by the data platform includes: 接收所述人像数据平台发送的所述目标用户的身份标识、所述模型版本标识、所述目标用户基于所述模型版本标识确定的参考人脸特征;Receive the identity identifier of the target user, the model version identifier, and the reference face feature determined by the target user based on the model version identifier sent by the portrait data platform; 接收所述信息数据平台发送的所述目标用户的个人信息、所述目标用户的权限信息。Receive the personal information of the target user and the permission information of the target user sent by the information data platform. 4.根据权利要求2或3所述的方法,其特征在于,所述方法还包括:4. The method according to claim 2 or 3, wherein the method further comprises: 基于所述目标用户的权限信息,确定所述目标用户具有人脸识别权限的所述目标终端;Determine, based on the permission information of the target user, the target terminal to which the target user has face recognition permission; 将所述人脸识别数据发送至所述目标终端。Send the face recognition data to the target terminal. 5.根据权利要求4所述的方法,其特征在于,所述方法还包括:5. The method according to claim 4, wherein the method further comprises: 接收所述目标终端发送的所述目标用户的人脸识别记录,其中,所述人脸识别记录中包括:本次人脸识别的抓拍人脸图、本次人脸识别的时空信息。Receive the face recognition record of the target user sent by the target terminal, wherein the face recognition record includes: a snapshot of the face image of the current face recognition, and the spatiotemporal information of the current face recognition. 6.根据权利要求2至5中任意一项所述的方法,其特征在于,所述方法还包括:6. The method according to any one of claims 2 to 5, wherein the method further comprises: 在接收到所述数据平台发送的多个目标用户的人脸识别数据的情况下,根据每个目标用户的权限信息,对所述多个目标用户的人脸识别数据进行分组存储。In the case of receiving the face recognition data of multiple target users sent by the data platform, the face recognition data of the multiple target users are grouped and stored according to the permission information of each target user. 7.根据权利要求1至6中任意一项所述的方法,其特征在于,所述方法还包括:7. The method according to any one of claims 1 to 6, wherein the method further comprises: 对所述目标人脸图像进行质量检测;performing quality detection on the target face image; 在所述目标人脸图像的质量检测结果不符合预设质量条件的情况下,向所述数据平台发送图像更新请求。In the case that the quality detection result of the target face image does not meet the preset quality condition, an image update request is sent to the data platform. 8.一种图像处理方法,其特征在于,所述方法应用于数据平台,所述方法包括:8. An image processing method, wherein the method is applied to a data platform, and the method comprises: 获取目标用户的目标人脸图像;Obtain the target face image of the target user; 向服务器发送特征提取请求,其中,所述特征提取请求中包括所述目标人脸图像、模型版本标识,所述模型版本标识用于指示人脸识别模型;Sending a feature extraction request to the server, wherein the feature extraction request includes the target face image and a model version identifier, where the model version identifier is used to indicate a face recognition model; 接收所述服务器发送的所述目标人脸图像基于所述模型版本标识确定的参考人脸特征,其中,所述目标人脸图像基于所述模型版本标识确定的参考人脸特征,用于在具有所述模型版本标识指示的的人脸识别模型的目标终端上,对所述目标用户进行人脸识别;Receive the reference face feature determined based on the model version identifier of the target face image sent by the server, wherein the target face image is based on the model version identifier. performing face recognition on the target user on the target terminal of the face recognition model indicated by the model version identifier; 向所述服务器发送所述目标用户的人脸识别数据、以及所述目标用户的权限信息,其中,所述人脸识别数据包括:所述目标用户的身份标识、所述模型版本标识、所述目标用户基于所述模型版本标识确定的参考人脸特征、所述目标用户的个人信息。Send the face recognition data of the target user and the permission information of the target user to the server, wherein the face recognition data includes: the identity identifier of the target user, the model version identifier, the The target user is based on the reference facial feature determined based on the model version identification, and the personal information of the target user. 9.根据权利要求8所述的方法,其特征在于,所述数据平台包括:人像数据平台;9. The method according to claim 8, wherein the data platform comprises: a portrait data platform; 所述向所述服务器发送所述目标用户的人脸识别数据,包括:The sending the face recognition data of the target user to the server includes: 所述人像数据平台确定所述目标用户的身份标识;The portrait data platform determines the identity of the target user; 所述人像数据平台将所述目标用户的身份标识、所述模型版本标识、所述目标用户基于所述模型版本标识确定的参考人脸特征,发送至所述服务器。The portrait data platform sends the identity identifier of the target user, the model version identifier, and the reference face feature determined by the target user based on the model version identifier to the server. 10.根据权利要求9所述的方法,其特征在于,所述数据平台包括:信息数据平台;10. The method according to claim 9, wherein the data platform comprises: an information data platform; 所述向所述服务器发送所述目标用户的人脸识别数据、以及所述目标用户的权限信息,包括:The sending the face recognition data of the target user and the permission information of the target user to the server includes: 所述信息数据平台基于所述目标用户的身份标识,确定所述目标用户的个人信息、所述目标用户的权限信息;The information data platform determines the personal information of the target user and the permission information of the target user based on the identity of the target user; 所述信息数据平台将所述目标用户的个人信息、所述目标用户的权限信息,发送至所述服务器。The information data platform sends the personal information of the target user and the permission information of the target user to the server. 11.根据权利要求8至10中任意一项所述的方法,其特征在于,所述方法还包括:11. The method according to any one of claims 8 to 10, wherein the method further comprises: 接收所述服务器发送的图像更新请求;receiving an image update request sent by the server; 响应于所述图像更新请求,重新获取目标用户的人脸图像,以及利用重新获取的人脸图像,更新所述目标人脸图像。In response to the image update request, the face image of the target user is re-acquired, and the target face image is updated using the re-acquired face image. 12.一种人脸识别方法,其特征在于,所述方法应用于目标终端,所述目标终端具有所述模型版本标识指示的人脸识别模型,目标用户在所述目标终端具有人脸识别权限,所述方法包括:12. A face recognition method, wherein the method is applied to a target terminal, the target terminal has a face recognition model indicated by the model version identifier, and the target user has a face recognition authority in the target terminal , the method includes: 接收服务器发送的所述目标用户的人脸识别数据,所述人脸识别数据包括:所述目标用户的身份标识、所述模型版本标识、所述目标用户基于所述模型版本标识确定的参考人脸特征、所述目标用户的个人信息;Receive the face recognition data of the target user sent by the server, where the face recognition data includes: the identity of the target user, the model version identifier, and the reference person determined by the target user based on the model version identifier facial features, personal information of the target user; 基于所述人脸识别数据,对所述目标用户进行人脸识别。Based on the face recognition data, face recognition is performed on the target user. 13.根据权利要求12所述的方法,其特征在于,所述基于所述人脸识别数据,对所述目标用户进行人脸识别,包括:13. The method according to claim 12, wherein the performing face recognition on the target user based on the face recognition data comprises: 获取待识别用户的本次人脸识别的抓拍人脸图;Obtain the captured face image of the face recognition of the user to be identified; 基于所述模型版本标识指示的人脸识别模型,对本次人脸识别的抓拍人脸图进行特征提取,得到所述待识别用户的待识别人脸特征;Based on the face recognition model indicated by the model version identifier, feature extraction is performed on the face image captured by this face recognition to obtain the face features to be recognized of the user to be recognized; 在所述待识别用户的待识别人脸,与所述目标用户的参考人脸特征匹配成功的情况下,确定本次人脸识别成功。In the case that the to-be-recognized face of the to-be-recognized user is successfully matched with the reference face feature of the target user, it is determined that the current face recognition is successful. 14.根据权利要求13所述的方法,其特征在于,所述方法还包括:14. The method of claim 13, wherein the method further comprises: 将所述目标用户的个人信息,在所述目标终端的显示屏幕上进行脱敏显示。The personal information of the target user is desensitized and displayed on the display screen of the target terminal. 15.根据权利要求13或14所述的方法,其特征在于,所述方法还包括:15. The method according to claim 13 or 14, wherein the method further comprises: 基于本次人脸识别的抓拍人脸图、本次人脸识别的时空信息,生成所述目标用户的人脸识别记录;Based on the face image captured by this face recognition and the spatiotemporal information of this face recognition, a face recognition record of the target user is generated; 将所述目标用户的人脸识别记录发送至所述服务器。Send the face recognition record of the target user to the server. 16.一种人脸识别系统,其特征在于,所述人脸识别系统包括:数据平台、服务器、目标终端,其中:16. A face recognition system, wherein the face recognition system comprises: a data platform, a server, and a target terminal, wherein: 所述目标终端获取目标用户的目标人脸图像;The target terminal acquires the target face image of the target user; 所述目标终端向所述服务器发送特征提取请求,其中,所述特征提取请求中包括所述目标人脸图像、模型版本标识;The target terminal sends a feature extraction request to the server, wherein the feature extraction request includes the target face image and the model version identifier; 所述服务器基于所述模型版本标识,调用对应的特征提取算法,对所述目标人脸图像进行特征提取,得到所述目标人脸图像基于所述模型版本标识确定的参考人脸特征,并删除本地缓存中的所述目标人脸图像;The server invokes the corresponding feature extraction algorithm based on the model version identifier, performs feature extraction on the target face image, obtains the reference face feature determined by the target face image based on the model version identifier, and deletes the the target face image in the local cache; 所述目标终端接收所述服务器发送的所述目标用户的人脸识别数据,所述人脸识别数据包括:所述目标用户的身份标识、所述模型版本标识、所述目标用户基于所述模型版本标识确定的参考人脸特征、所述目标用户的个人信息;The target terminal receives the face recognition data of the target user sent by the server, and the face recognition data includes: the identity identifier of the target user, the model version identifier, the target user based on the model The reference facial features determined by the version identification, and the personal information of the target user; 所述目标终端基于所述人脸识别数据,对所述目标用户进行人脸识别。The target terminal performs face recognition on the target user based on the face recognition data.
CN202210187388.5A 2022-02-28 2022-02-28 Image processing method, face recognition method and system Pending CN114550265A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210187388.5A CN114550265A (en) 2022-02-28 2022-02-28 Image processing method, face recognition method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210187388.5A CN114550265A (en) 2022-02-28 2022-02-28 Image processing method, face recognition method and system

Publications (1)

Publication Number Publication Date
CN114550265A true CN114550265A (en) 2022-05-27

Family

ID=81680461

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210187388.5A Pending CN114550265A (en) 2022-02-28 2022-02-28 Image processing method, face recognition method and system

Country Status (1)

Country Link
CN (1) CN114550265A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115061631A (en) * 2022-06-30 2022-09-16 杭州海康威视数字技术股份有限公司 Method, device and equipment for issuing face data

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105956022A (en) * 2016-04-22 2016-09-21 腾讯科技(深圳)有限公司 Method and device for processing electron mirror image, and method and device for processing image
CN108282527A (en) * 2018-01-22 2018-07-13 北京百度网讯科技有限公司 Generate the distributed system and method for Service Instance
CN110458154A (en) * 2019-09-12 2019-11-15 腾讯科技(深圳)有限公司 Face identification method, device and computer readable storage medium
CN112883350A (en) * 2019-11-29 2021-06-01 腾讯科技(深圳)有限公司 Data processing method and device, electronic equipment and storage medium
CN113688657A (en) * 2020-05-19 2021-11-23 深圳云天励飞技术有限公司 Face recognition method, device, electronic device and storage medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105956022A (en) * 2016-04-22 2016-09-21 腾讯科技(深圳)有限公司 Method and device for processing electron mirror image, and method and device for processing image
CN108282527A (en) * 2018-01-22 2018-07-13 北京百度网讯科技有限公司 Generate the distributed system and method for Service Instance
CN110458154A (en) * 2019-09-12 2019-11-15 腾讯科技(深圳)有限公司 Face identification method, device and computer readable storage medium
CN112883350A (en) * 2019-11-29 2021-06-01 腾讯科技(深圳)有限公司 Data processing method and device, electronic equipment and storage medium
CN113688657A (en) * 2020-05-19 2021-11-23 深圳云天励飞技术有限公司 Face recognition method, device, electronic device and storage medium

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115061631A (en) * 2022-06-30 2022-09-16 杭州海康威视数字技术股份有限公司 Method, device and equipment for issuing face data
WO2024001882A1 (en) * 2022-06-30 2024-01-04 杭州海康威视数字技术股份有限公司 Method and apparatus for issuing facial data, and device
CN115061631B (en) * 2022-06-30 2025-12-05 杭州海康威视数字技术股份有限公司 Methods, devices and equipment for distributing facial data

Similar Documents

Publication Publication Date Title
WO2022043741A1 (en) Network training method and apparatus, person re-identification method and apparatus, storage medium, and computer program
CN110363150A (en) Data update method and device, electronic device and storage medium
CN110503023A (en) Living body detection method and device, electronic device and storage medium
WO2021036382A9 (en) Image processing method and apparatus, electronic device and storage medium
CN109948494A (en) Image processing method and device, electronic device and storage medium
CN112991553B (en) Information display method and device, electronic equipment and storage medium
CN112270288A (en) Living body recognition, access control equipment control method and device, electronic equipment
CN111626183A (en) Target object display method and device, electronic equipment and storage medium
US20220270352A1 (en) Methods, apparatuses, devices, storage media and program products for determining performance parameters
CN111401230A (en) Attitude estimation method and apparatus, electronic device, and storage medium
CN111523346A (en) Image recognition method and device, electronic equipment and storage medium
CN111062407A (en) Image processing method and device, electronic device and storage medium
WO2022142298A1 (en) Key point detection method and apparatus, and electronic device and storage medium
WO2023123840A1 (en) Payment method and apparatus, electronic device, storage medium, and computer program product
CN114550086A (en) Crowd positioning method and device, electronic equipment and storage medium
CN114581525A (en) Attitude determination method and device, electronic device and storage medium
CN111859003B (en) Visual positioning method and device, electronic equipment and storage medium
CN114638817B (en) Image segmentation method and device, electronic equipment and storage medium
WO2023173659A1 (en) Face matching method and apparatus, electronic device, storage medium, computer program product, and computer program
CN115171677A (en) Voice processing method, device, electronic equipment, storage medium and product
CN114677648A (en) Network training method, pedestrian re-identification method, network training device, pedestrian re-identification device, electronic equipment and storage medium
CN114550265A (en) Image processing method, face recognition method and system
CN111339964B (en) Image processing method and device, electronic equipment and storage medium
CN112949568A (en) Method and device for matching human face and human body, electronic equipment and storage medium
CN114550085B (en) Crowd positioning method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination