[go: up one dir, main page]

CN110473135B - Image processing method, system, readable storage medium and intelligent device - Google Patents

Image processing method, system, readable storage medium and intelligent device Download PDF

Info

Publication number
CN110473135B
CN110473135B CN201910701385.7A CN201910701385A CN110473135B CN 110473135 B CN110473135 B CN 110473135B CN 201910701385 A CN201910701385 A CN 201910701385A CN 110473135 B CN110473135 B CN 110473135B
Authority
CN
China
Prior art keywords
image
target
marked
error
mark
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910701385.7A
Other languages
Chinese (zh)
Other versions
CN110473135A (en
Inventor
廖清
丁烨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Harbin Institute of Technology Shenzhen
Original Assignee
Harbin Institute of Technology Shenzhen
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Harbin Institute of Technology Shenzhen filed Critical Harbin Institute of Technology Shenzhen
Priority to CN201910701385.7A priority Critical patent/CN110473135B/en
Publication of CN110473135A publication Critical patent/CN110473135A/en
Application granted granted Critical
Publication of CN110473135B publication Critical patent/CN110473135B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00General purpose image data processing
    • G06T1/0021Image watermarking

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Editing Of Facsimile Originals (AREA)

Abstract

本发明公开了一种图像处理方法、系统、可读存储介质及智能设备,所述方法包括:获取一目标标记图像,通过对抗生成网络模型对所述目标标记图像进行干扰,以得到至少一干扰图像;通过收敛模型对所述干扰图像进行收敛,将收敛合格的干扰图像作为对抗样本,并将所述对抗样本覆盖于目标标记图像上;对进行对抗样本覆盖的目标标记图像进行图像识别,以得到错误标记图像,每个用户所得到的错误标记图片均不相同;根据所述错误标记图像与当前目标标记图像中目标区域的匹配度确定错误标记图像的目标标记图像。本发明能够解决现有水印易被识别和易被干扰这的问题,提高了用户图像隐私体验的满意度,满足了实际应用需求。

Figure 201910701385

The invention discloses an image processing method, system, readable storage medium and intelligent equipment. The method includes: acquiring a target mark image, and interfering with the target mark image through an adversarial generation network model to obtain at least one disturbance image; the interference image is converged through the convergence model, and the interference image that is qualified for convergence is used as an adversarial sample, and the adversarial sample is covered on the target mark image; image recognition is performed on the target mark image covered by the adversarial sample, to The wrongly marked image is obtained, and the wrongly marked picture obtained by each user is different; the target mark image of the wrongly marked image is determined according to the matching degree between the wrongly marked image and the target area in the current target marked image. The present invention can solve the problem that the existing watermark is easy to be identified and easily interfered, improves the user's image privacy experience satisfaction, and meets the practical application requirements.

Figure 201910701385

Description

图像处理方法、系统、可读存储介质及智能设备Image processing method, system, readable storage medium and intelligent device

技术领域technical field

本发明涉及数字信息安全技术领域,特别是涉及一种图像处理方法、系统、可读存储介质及智能设备。The present invention relates to the technical field of digital information security, in particular to an image processing method, system, readable storage medium and intelligent equipment.

背景技术Background technique

随着摄影及图像处理技术的不断发展,增强现实技术也逐渐成熟,增强现实技术是通过实时地计算摄影机影像的位置及角度并加上相应图像的技术,以实现在拍摄得到的图片上把虚拟物体渲染在现实世界并进行互动的一种高科技技术,被广泛运用在生活当中,同时图像资产也应用而生。With the continuous development of photography and image processing technology, augmented reality technology has gradually matured. Augmented reality technology is a technology that calculates the position and angle of camera images in real time and adds corresponding images to realize virtual reality on the captured pictures. A high-tech technology in which objects are rendered and interacted with in the real world is widely used in daily life, and image assets are also applied.

与内容不敏感的图像资产(如新闻照片等)不同,对于内容敏感的图像资产,如私人照片、漫画作品、秘密文件等,因为版权拥有者通常不愿或需收费才可以私密公开给指定的被授权人,其版权侵权者通常不会于公开图像时透露自己的身份,因此侦测和识别此类侵权者是一个亟待解决的问题。为了侦测和识别此类侵权者,现有技术通常会在图片上加上针对不同被授权人的多样性水印,即对于不同的被授权人,其收到的图片上所附带的水印均不相同。当发现未授权被公开的侵权图片时,通过提取图片上的水印,即可侦测到对应侵权者的身份,并就此提出诉讼或赔偿。Different from content-insensitive image assets (such as news photos, etc.), for content-sensitive image assets, such as private photos, comic works, secret documents, etc., because copyright owners are usually unwilling or need to charge for private disclosure to specified Licensees, whose copyright infringers usually do not reveal their identities when publishing images, therefore detecting and identifying such infringers is an urgent problem. In order to detect and identify such infringers, the existing technology usually adds diverse watermarks for different licensees on the pictures, that is, for different licensees, the watermarks attached to the pictures they receive are all different. same. When an unauthorized infringing picture is found, the identity of the corresponding infringer can be detected by extracting the watermark on the picture, and a lawsuit or compensation can be filed.

然而,现有技术通常面临着水印易被识别和易被干扰这两个问题。如果水印人眼可以识别,那么会一定程度影响用户对于图片的观感。例如在图片的关键位置添加一个二维码,那么用户在观看图片时由于会观看到二维码覆盖于图片的关键位置上,用户体验会严重下降。此外,由于无法正确提取水印,则会导致侦测和识别侵权者身份的过程失效,因此无法就此提出诉讼或赔偿。However, the existing technology usually faces the two problems of easy identification and interference of the watermark. If the watermark can be recognized by the human eye, it will affect the user's perception of the picture to a certain extent. For example, if a QR code is added to a key position of a picture, the user experience will be severely degraded because the user will see the QR code covering the key position of the picture when viewing the picture. Furthermore, since the failure to extract the watermark correctly would invalidate the process of detecting and identifying the infringer, no action or compensation can be brought.

发明内容Contents of the invention

为了解决上述问题,本发明的目的是提供一种能够提高图片水印安全性,具有防篡改功能的图像处理方法、系统、可读存储介质。In order to solve the above problems, the purpose of the present invention is to provide an image processing method, system, and readable storage medium that can improve the security of image watermarks and have anti-tampering functions.

根据本发明提供的图像处理方法包括:The image processing method provided according to the present invention comprises:

获取一目标标记图像,通过对抗生成网络模型对所述目标标记图像进行干扰,以得到至少一干扰图像;Acquiring a target marked image, and interfering with the target marked image through an adversarial generative network model to obtain at least one disturbed image;

通过收敛模型对所述干扰图像进行收敛,将收敛合格的干扰图像作为对抗样本,并将所述对抗样本覆盖于目标标记图像上;Converging the interference image through a convergence model, using the interference image that converges qualified as an adversarial example, and covering the adversarial example on the target mark image;

对进行对抗样本覆盖的目标标记图像进行图像识别,以得到错误标记图像,每个用户所得到的错误标记图片均不相同;Perform image recognition on the target labeled image covered by the adversarial example to obtain the wrongly labeled image, and the wrongly labeled images obtained by each user are different;

根据所述错误标记图像与当前目标标记图像中目标区域的匹配度确定错误标记图像的目标标记图像。The target marker image of the wrong marker image is determined according to the matching degree between the wrong marker image and the target area in the current target marker image.

根据本发明提供的图像处理方法,首先获取一目标标记图像,通过对抗生成网络模型对所述目标标记图像进行干扰,以得到至少一干扰图像;通过收敛模型对所述干扰图像进行收敛,将收敛合格的干扰图像作为对抗样本,并将所述对抗样本覆盖于目标标记图像上;对进行对抗样本覆盖的目标标记图像进行图像识别,以得到错误标记图像,每个用户所得到的错误标记图片均不相同;根据所述错误标记图像与当前目标标记图像中目标区域的匹配度确定错误标记图像的目标标记图像。本发明提供的图像处理方法,通过对每个用户制造不同的水印,由于生成的水印人眼无法识别,不会影响用户对图片的观感,且在不确定所使用图像识别模型的类型时算法也无法识别,因此无法定位可识别区域。即使可识别区域被定位,由于添加的水印为特定区域针对性的对抗训练结果,算法很难识别其中附加的信息,此外由于对抗样本的特点和多可识别区域的设计,即使图片污损,其水印仍可被识别及匹配,可以准确匹配侵权用户。According to the image processing method provided by the present invention, firstly, a target mark image is acquired, and the target mark image is interfered by an adversarial generation network model to obtain at least one interference image; the interference image is converged by a convergence model, and the convergent The qualified interference image is used as an adversarial sample, and the adversarial sample is covered on the target marked image; image recognition is performed on the target marked image covered by the adversarial sample to obtain a wrongly marked image, and the wrongly marked pictures obtained by each user are Not the same; determine the target marker image of the wrong marker image according to the matching degree between the wrong marker image and the target area in the current target marker image. The image processing method provided by the present invention creates different watermarks for each user. Since the generated watermarks cannot be recognized by the human eye, it will not affect the user's perception of the picture, and the algorithm will not be affected when the type of the image recognition model used is uncertain. Unrecognized, so the recognizable area cannot be located. Even if the identifiable area is located, since the added watermark is the result of targeted adversarial training for a specific area, it is difficult for the algorithm to identify the additional information in it. In addition, due to the characteristics of the adversarial samples and the design of multiple identifiable areas, even if the image is defaced, its Watermarks can still be identified and matched to accurately match infringing users.

另外,根据本发明上述的图像处理方法,还可以具有如下附加的技术特征:In addition, according to the above-mentioned image processing method of the present invention, it can also have the following additional technical features:

进一步地,获取一目标标记图像,通过对抗生成网络模型对所述目标标记图像进行干扰,以得到至少一干扰图像的步骤包括:Further, the step of obtaining a target marked image, and interfering with the target marked image through an adversarial generation network model to obtain at least one disturbed image includes:

获取原图像的图像信息,并根据所述图像信息对原图像进行离散化处理,从而将该原图像划分为若干可识别区域;acquiring image information of the original image, and discretizing the original image according to the image information, thereby dividing the original image into several identifiable regions;

通过图像识别模型对所述原图像的若干可识别区域进行标记,以得到所述目标标记图像,该目标标记图像携带有可识别区域的正确标签;Marking several identifiable areas of the original image by an image recognition model to obtain the target marked image, the target marked image carries the correct label of the identifiable area;

通过对抗生成网络模型对所述目标标记图像进干扰,以得到对应的干扰图像,该干扰图像携带有可识别区域的错误标签。Interference is performed on the target label image by using an adversarial generative network model to obtain a corresponding interference image, and the interference image carries an erroneous label of an identifiable region.

进一步地,通过图像识别模型对所述原图像的若干可识别区域进行标记,以得到所述目标标记图像的步骤包括:Further, the step of marking several identifiable regions of the original image through an image recognition model to obtain the target marked image includes:

对所述原图像的若干可识别区域进行抽取与分解形成标记因子;Extracting and decomposing several identifiable regions of the original image to form marking factors;

根据所述标记因子进行机器算法学习后得可识别区域的正确标签。The correct label of the identifiable region is obtained after machine algorithm learning is performed according to the labeling factor.

进一步地,根据所述标记因子进行机器算法学习后得可识别区域的正确标签的计算公式为:Further, the formula for calculating the correct label of the identifiable region after machine algorithm learning according to the labeling factor is:

Figure BDA0002150905470000031
Figure BDA0002150905470000031

其中,φ()为激活函数,Vk为调节系数,Wi为初始权重,Xi为标记因子,Bk为偏移累加量。Among them, φ() is the activation function, V k is the adjustment coefficient, W i is the initial weight, Xi is the marking factor, and B k is the offset accumulation.

进一步地,所述错误标记图像对应有一初始权重矩阵,根据所述错误标记图像与当前目标标记图像中目标区域的匹配度确定错误标记图像的目标标记图像的步骤包括:Further, the wrongly marked image corresponds to an initial weight matrix, and the step of determining the target mark image of the wrongly marked image according to the matching degree between the wrongly marked image and the target area in the current target mark image includes:

计算所述错误标记图像与当前目标标记图像之间的相关度矩阵;calculating a correlation matrix between the wrongly marked image and the current target marked image;

根据所述相关度矩阵对所述初始权重矩阵进行修正以得到一目标权重矩阵,所述目标权重矩阵用于在所述错误标记图像与所述当前目标标记图像进行匹配时,对所述初始权重矩阵进行替换;Modify the initial weight matrix according to the correlation matrix to obtain a target weight matrix, and the target weight matrix is used to adjust the initial weight when the wrongly marked image matches the current target marked image Matrix to replace;

判断对所述初始权重矩阵进行替换后所对应的错误标记图像与当前目标标记图像之间的匹配度;judging the degree of matching between the error-marked image corresponding to the replacement of the initial weight matrix and the current target-marked image;

当所述错误标记图像与当前目标标记图像之间的匹配度大于预设匹配值时,则将所述当前目标标记图像作为所述错误标记图像的目标标记图像。When the matching degree between the wrongly marked image and the current target marked image is greater than a preset matching value, the current target marked image is used as the target marked image of the wrongly marked image.

进一步地,所述预设匹配值的取值范围为93%~98%。Further, the preset matching value ranges from 93% to 98%.

进一步地,判断对所述初始权重矩阵进行替换后所对应的错误标记图像与当前目标标记图像之间的匹配度的步骤之后所述方法还包括:Further, after the step of judging the matching degree between the corresponding wrongly marked image after replacing the initial weight matrix and the current target marked image, the method further includes:

当所述错误标记图像与当前目标标记图像之间的匹配度小于预设匹配值时,判断所述错误标记图像是否携带当前目标标记图像的关联标识;When the matching degree between the wrongly marked image and the current target marked image is less than a preset matching value, it is judged whether the wrongly marked image carries the associated identification of the current target marked image;

若是,则根据所述关联标识查询关联匹配库,并将所述关联匹配库与所述错误标记图像进行匹配,以得到关联数据,根据所述关联数据确定所述错误标记图像的目标标记图像;If so, querying the associated matching library according to the associated identification, and matching the associated matching library with the wrongly marked image to obtain associated data, and determining the target tagged image of the incorrectly marked image according to the associated data;

若否,则发出报警提示。If not, an alarm prompt is issued.

本发明的另一实施例提出一种图像处理系统,解决现有水印易被识别和易被干扰这的问题,提高了用户图像隐私体验的满意度。Another embodiment of the present invention proposes an image processing system, which solves the problems of easy recognition and interference of existing watermarks, and improves user satisfaction with image privacy experience.

根据本发明实施例的图像处理系统,包括:An image processing system according to an embodiment of the present invention includes:

确定模块,用于根据访问周期内当前源地址的空间访问量确定当前源地址是否为冷源地址;A determining module, configured to determine whether the current source address is a cold source address according to the space access amount of the current source address within the access period;

判断模块,用于当所述当前源地址为冷源地址时,判断所述当前源地址在第一访问位置的数据块的引用计数是否小于预设值;A judging module, configured to judge whether the reference count of the data block at the first access location of the current source address is less than a preset value when the current source address is a cold source address;

删除模块,用于将所述当前源地址删除;A deletion module, configured to delete the current source address;

迁移模块,用于将所述当前源地址移动至第二访问位置并进行保存,所述当前源地址在第二访问位置的数据块的引用计数大于第一访问位置。A migration module, configured to move and store the current source address to a second access location, where the reference count of the data block at the second access location is greater than that at the first access location.

本发明的另一个实施例还提出一种存储介质,其上存储有计算机程序,该程序被处理器执行时实现上述方法的步骤。Another embodiment of the present invention also proposes a storage medium on which a computer program is stored, and when the program is executed by a processor, the steps of the above method are implemented.

本发明的另一个实施例还提出一种智能设备,包括存储器、处理器以及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述程序时实现上述方法的步骤。Another embodiment of the present invention also proposes an intelligent device, including a memory, a processor, and a computer program stored in the memory and operable on the processor, and the processor implements the steps of the above method when executing the program.

本发明的附加方面和优点将在下面的描述中部分给出,部分将从下面的描述中变得明显,或通过本发明的实施例了解到。Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be apparent from the description which follows, or may be learned by practice of the invention.

附图说明Description of drawings

图1是本发明第一实施例提出的图像处理方法的流程图;Fig. 1 is the flowchart of the image processing method that the first embodiment of the present invention proposes;

图2是图1中步骤S101的具体流程图;Fig. 2 is the specific flowchart of step S101 in Fig. 1;

图3是图1中步骤S104的具体流程图;Fig. 3 is the specific flowchart of step S104 in Fig. 1;

图4是本发明第二实施例提出的图像处理系统的结构框图。FIG. 4 is a structural block diagram of an image processing system proposed by a second embodiment of the present invention.

具体实施方式detailed description

为使本发明实施例的目的、技术方案和优点更加清楚,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

请参阅图1,本发明第一实施例提出的一种图像处理方法,其中,包括步骤S101~S104:Please refer to FIG. 1, an image processing method proposed in the first embodiment of the present invention, which includes steps S101 to S104:

步骤S101,获取一目标标记图像,通过对抗生成网络模型对所述目标标记图像进行干扰,以得到至少一干扰图像。Step S101 , acquiring a target marked image, and interfering with the target marked image through an adversarial generative network model to obtain at least one disturbed image.

本实施例中,以图像处理设备为例进行说明,但需要了解的是,本发明实施例并不限于此,本发明实施例的方法可以应用在任何智能设备中,即任何可进行图像处理的电子设备中。具体的,现有技术中,通常会在图片上加上针对不同被授权人的多样性水印,即对于不同的被授权人,其收到的图片上所附带的水印均不相同。当发现未授权被公开的侵权图片时,通过提取图片上的水印,即可侦测到对应侵权者的身份,并就此提出诉讼或赔偿,然而却面临着水印易被识别和易被干扰的。因此,如果水印人眼可以识别,那么会一定程度影响用户对于图片的观感,如果水印容易被去除或干扰,那么当侵权图片被公开时,由于无法正确提取水印,则会导致侦测和识别侵权者身份的过程失效,因此无法就此提出诉讼或赔偿。In this embodiment, an image processing device is taken as an example for illustration, but it should be understood that the embodiment of the present invention is not limited thereto, and the method of the embodiment of the present invention can be applied to any smart device, that is, any device capable of image processing in electronic equipment. Specifically, in the prior art, multiple watermarks for different authorized persons are usually added to the pictures, that is, for different authorized persons, the watermarks attached to the pictures they receive are all different. When an unauthorized infringing picture is found, the identity of the corresponding infringer can be detected by extracting the watermark on the picture, and a lawsuit or compensation can be filed. However, the watermark is easily recognized and easily disturbed. Therefore, if the watermark can be recognized by the human eye, it will affect the user's perception of the picture to a certain extent. If the watermark is easy to remove or interfere, then when the infringing picture is made public, the watermark cannot be extracted correctly, which will lead to the detection and identification of infringement. The process of lapse of the identity of the owner makes it impossible to sue or indemnify for it.

本实施例中,当接收到一目标图像获取指令时;则获取目标标记图像,通过对抗生成网络模型对所述目标标记图像进行干扰,以得到至少一干扰图像,从而使未被授权的用户对图像进行公开时,能够追溯其身份,以提出诉讼或赔偿,此外还可使未授权的用户并不能正确识别该图像的图像信息,提高了图像的安全性。In this embodiment, when a target image acquisition instruction is received; the target marked image is acquired, and the target marked image is interfered with by an adversarial generation network model to obtain at least one disturbed image, so that unauthorized users can When an image is made public, its identity can be traced to bring a lawsuit or compensation. In addition, it can prevent unauthorized users from correctly identifying the image information of the image, which improves the security of the image.

请参阅图2,获取一目标标记图像,通过对抗生成网络模型对所述目标标记图像进行干扰,以得到至少一干扰图像的方法包括如下步骤:Please refer to FIG. 2 , to obtain a target mark image, and to interfere with the target mark image through the confrontation generation network model, so as to obtain at least one interference image. The method includes the following steps:

步骤S1011,获取原图像的图像信息,并根据所述图像信息对原图像进行离散化处理,从而将该原图像划分为若干可识别区域。Step S1011, acquiring image information of the original image, and performing discretization processing on the original image according to the image information, so as to divide the original image into several identifiable regions.

步骤S1012,通过图像识别模型对所述原图像的若干可识别区域进行标记,以得到所述目标标记图像,该目标标记图像携带有可识别区域的正确标签。Step S1012, using an image recognition model to mark several identifiable regions of the original image to obtain the target marked image, and the target marked image carries the correct label of the identifiable region.

具体的,对所述原图像的若干可识别区域进行抽取与分解形成标记因子;根据所述标记因子进行机器算法学习后得可识别区域的正确标签。Specifically, several identifiable regions of the original image are extracted and decomposed to form marking factors; machine algorithm learning is performed according to the marking factors to obtain correct labels of identifiable regions.

根据所述标记因子进行机器算法学习后得可识别区域的正确标签的计算公式为:The formula for calculating the correct label of the identifiable region after machine algorithm learning according to the labeling factor is:

Figure BDA0002150905470000061
Figure BDA0002150905470000061

其中,φ()为激活函数,Vk为调节系数,Wi为初始权重,Xi为标记因子,Bk为偏移累加量。Among them, φ() is the activation function, V k is the adjustment coefficient, W i is the initial weight, Xi is the marking factor, and B k is the offset accumulation.

如上所述,通过输入原图像的图像信息,经过数据标准化与抽取分解,获得原图像的标记因子Xi,配置对应的初始权重Wi,进行求和与Bk偏移累加,通过Vk系数调节,激活函数φ(),输出可识别区域的正确标签。As mentioned above, by inputting the image information of the original image, after data standardization and extraction decomposition, the marking factor X i of the original image is obtained, and the corresponding initial weight W i is configured, and the summation and B k offset accumulation are carried out, and the V k coefficient Conditioning, the activation function φ(), outputs the correct labels for recognizable regions.

步骤S1013,通过对抗生成网络模型对所述目标标记图像进干扰,以得到对应的干扰图像,该干扰图像携带有可识别区域的错误标签。In step S1013, the object label image is interfered with by using the confrontation generative network model to obtain a corresponding interference image, and the interference image carries the wrong label of the identifiable region.

如上所述,通过对原图形进行离散化处理,从而将该原图像划分为若干可识别区域,并非随机选择、固定位置、整张图片、或电子信息,以便于用户根据对可识别区域的识别结果确定对应的目标标记图像,每张图片可以支持mn个用户,其中m为图片可识别区域的数量,n为图像识别模型可识别的标记数量,且各可识别区域的大小可以一致,也可以不一致;通过图像识别模型(如YOLOv3)对所述原图像的若干可识别区域进行标记,以得到所述目标标记图像,其中该目标标记图像携带有可识别区域的正确标签,该正确标签覆盖于整个原始图像,如可识别区域1被识别为标签a、可识别区域2被识别为标签b、可识别区域3被识别为标签c。As mentioned above, by discretizing the original image, the original image is divided into several identifiable areas, rather than random selection, fixed positions, the entire picture, or electronic information, so that users can identify the identifiable areas based on the As a result, the corresponding target mark image is determined. Each picture can support m n users, where m is the number of identifiable areas in the picture, and n is the number of marks identifiable by the image recognition model, and the size of each identifiable area can be consistent. Can be inconsistent; several identifiable regions of the original image are marked by an image recognition model (such as YOLOv3) to obtain the target marker image, wherein the target marker image carries the correct label of the identifiable region, and the correct label covers For the entire original image, for example, identifiable area 1 is identified as label a, identifiable area 2 is identified as label b, and identifiable area 3 is identified as label c.

进一步地,通过对抗生成网络模型对所述目标标记图像进干扰,以得到对应的干扰图像,该干扰图像携带有可识别区域的错误标签,可以理解的,错误标签是由识别错误而产生的,该识别错误被称为差异值(loss),通过制定不同的训练目标,对抗生成网络模型可以生成不同的干扰图像,并产生不同的差异值,直至收敛并得到稳定的识别错误。例如,当对抗生成网络通过指定的收敛模型(如BP-Gradient)收敛时,其产生的干扰图像可以使得图像识别模型准确稳定的将可识别区域1错误的识别为标签x、可识别区域2错误的识别为标签y、可识别区域3错误的识别为标签z。Further, the target marker image is interfered with by an adversarial generative network model to obtain a corresponding interference image, which carries an erroneous label of an identifiable region. It can be understood that the erroneous label is generated by a recognition error, This recognition error is called the difference value (loss). By setting different training objectives, the confrontation generative network model can generate different interference images and produce different difference values until it converges and obtains a stable recognition error. For example, when the confrontation generation network converges through the specified convergence model (such as BP-Gradient), the interference image generated by it can make the image recognition model accurately and stably identify the identifiable area 1 as the label x, and the identifiable area 2 is wrong is identified as label y, and the identifiable area 3 is incorrectly identified as label z.

步骤S102,通过收敛模型对所述干扰图像进行收敛,将收敛合格的干扰图像作为对抗样本,并将所述对抗样本覆盖于目标标记图像上。In step S102, the interference image is converged through a convergence model, and the interference image that is qualified for convergence is used as an adversarial example, and the adversarial example is overlaid on the target marked image.

如上所述,当对抗生成网络通过指定的收敛模型(如BP-Gradient)收敛时,所产生的干扰图像被称为对抗样本,将所述对抗样本覆盖于当前目标标记图像上,以便于对当前目标标记图像进行标记,即使图片污损,其水印仍可被识别及匹配,可以准确匹配侵权用户。由于对抗样本的生成特点,其通常为像素扰动,而像素扰动对于人眼来说难以识别,且通过不同的识别错误,其序列和位置可以嵌入不同的用户识别信息。例如:用户A得到的图像是经过将可识别区域1、2、3分别错误的识别为x、y、z的对抗样本所覆盖后的图像;用户B得到的图像是经过将可识别区域1、2、3分别错误的识别为i、j、k的对抗样本所覆盖后的图像。则用户A和用户B所得到的图片分别携带了可标示其身份的不同信息,从而可寻找图片的所有者。As mentioned above, when the adversarial generation network converges through the specified convergence model (such as BP-Gradient), the generated interference image is called an adversarial sample, and the adversarial sample is overlaid on the current target image to facilitate the current Even if the image is defaced, its watermark can still be identified and matched, and the infringing user can be accurately matched. Due to the generation characteristics of adversarial samples, they are usually pixel perturbations, which are difficult for human eyes to recognize, and through different recognition errors, their sequences and positions can be embedded with different user identification information. For example: the image obtained by user A is the image covered by the adversarial samples that mistakenly identify the identifiable areas 1, 2, and 3 as x, y, and z respectively; the image obtained by user B is the image obtained by identifiable areas 1, 2 and 3 are respectively wrongly identified as the images covered by the adversarial examples of i, j, and k. The pictures obtained by user A and user B respectively carry different information that can indicate their identities, so that the owner of the picture can be found.

步骤S103,对进行对抗样本覆盖的目标标记图像进行图像识别,以得到错误标记图像,其中,每个用户所得到的错误标记图片均不相同。Step S103 , image recognition is performed on the target labeled image covered by the adversarial example to obtain an incorrectly labeled image, wherein the incorrectly labeled images obtained by each user are different.

具体的,图像识别模型对对抗样本覆盖后的原始图像进行图像识别,可以得到该图像可识别区域的所对应的目标错误标签,可识别区域1被识别为标签x、可识别区域2被识别为标签y、可识别区域3被识别为标签z,其“错误标签”特指由指定图像识别模型所标记的与其在原始图像中所标记的标签不符的标签。由于每个用户所得到的错误标记图片均不相同,从而可追溯该图片的所有者。Specifically, the image recognition model performs image recognition on the original image covered by the adversarial example, and can obtain the target error label corresponding to the identifiable area of the image. The identifiable area 1 is identified as label x, and the identifiable area 2 is identified as Label y and recognizable area 3 are recognized as label z, and its "wrong label" specifically refers to the label marked by the specified image recognition model that does not match the label marked in the original image. Since each user gets a different mislabeled picture, the owner of the picture can be traced.

步骤S104,根据所述错误标记图像与当前目标标记图像中目标区域的匹配度确定错误标记图像的目标标记图像。Step S104, determining the target marker image of the wrong marker image according to the matching degree between the wrong marker image and the target area in the current target marker image.

请参阅图3,所述错误标记图像对应有一初始权重矩阵,根据所述错误标记图像与当前目标标记图像中目标区域的匹配度确定错误标记图像的目标标记图像的步骤包括:Please refer to FIG. 3 , the wrongly marked image corresponds to an initial weight matrix, and the step of determining the target mark image of the wrongly marked image according to the degree of matching between the wrongly marked image and the target region in the current target mark image includes:

步骤S1041,计算所述错误标记图像与当前目标标记图像之间的相关度矩阵。Step S1041, calculating a correlation matrix between the wrongly marked image and the current target marked image.

步骤S1042,根据所述相关度矩阵对所述初始权重矩阵进行修正以得到一目标权重矩阵,所述目标权重矩阵用于在所述错误标记图像与所述当前目标标记图像进行匹配时,对所述初始权重矩阵进行替换。Step S1042, correcting the initial weight matrix according to the correlation matrix to obtain a target weight matrix, and the target weight matrix is used for matching the wrongly marked image with the current target marked image. The above initial weight matrix is replaced.

步骤S1043,判断对所述初始权重矩阵进行替换后所对应的错误标记图像与当前目标标记图像之间的匹配度。Step S1043 , judging the matching degree between the error mark image corresponding to the replacement of the initial weight matrix and the current target mark image.

步骤S1044,当所述错误标记图像与当前目标标记图像之间的匹配度大于预设匹配值时,则将所述当前目标标记图像作为所述错误标记图像的目标标记图像。所述预设匹配值的取值范围为93%~98%。Step S1044, when the matching degree between the wrongly marked image and the current target marked image is greater than a preset matching value, use the current target marked image as the target marked image of the wrongly marked image. The value range of the preset matching value is 93%-98%.

如上所述,在将错误标记图像与当前目标标记图像进行匹配比较时,先计算所述错误标记图像与当前目标标记图像之间的相关度矩阵M(i,j),根据得到的相关度矩阵M(i,j)对所述初始权重矩阵进行修正以得到一目标权重矩阵K'(i,j),在确定了目标权重矩阵K'(i,j)之后,判断对所述初始权重矩阵K(i,j)进行替换后所对应的错误标记图像与当前目标标记图像之间的匹配度。由于该相关度矩阵对应的相关度值存在大小差异,直接反应了错误标记图像与当前目标标记图像之间的匹配程度,因此可以根据该相关度矩阵M(i,j)的值,对初始权重矩阵K(i,j)进行修正得到目标权重矩阵K'(i,j)。在进行实际匹配时,将原来的初始权重矩阵替换为目标权重矩阵K'(i,j),以使得替换后的目标权重矩阵K'(i,j)的值与上述的相关度矩阵的值更为吻合,从而提高相互匹配时对应的匹配精度。当所述错误标记图像与当前目标标记图像之间的匹配度大于预设匹配值93%~98%时,则将所述当前目标标记图像作为所述错误标记图像的目标标记图像。As mentioned above, when matching and comparing the wrongly marked image with the current target marked image, first calculate the correlation matrix M(i, j) between the wrongly marked image and the current target marked image, and according to the obtained correlation matrix M(i,j) modifies the initial weight matrix to obtain a target weight matrix K'(i,j), after determining the target weight matrix K'(i,j), judge the initial weight matrix K(i, j) is the matching degree between the corresponding wrongly labeled image and the current target labeled image after replacement. Since there is a difference in the correlation value corresponding to the correlation matrix, which directly reflects the matching degree between the wrongly marked image and the current target marked image, the initial weight The matrix K(i,j) is corrected to obtain the target weight matrix K'(i,j). When performing actual matching, replace the original initial weight matrix with the target weight matrix K'(i,j), so that the value of the replaced target weight matrix K'(i,j) is the same as the value of the above-mentioned correlation matrix It is more consistent, thereby improving the corresponding matching accuracy when matching each other. When the matching degree between the wrongly marked image and the current target marked image is greater than a preset matching value of 93%-98%, the current target marked image is used as the target marked image of the wrongly marked image.

在此还需要说明的是,判断对所述初始权重矩阵进行替换后所对应的错误标记图像与当前目标标记图像之间的匹配度的步骤之后所述方法还包括:当所述错误标记图像与当前目标标记图像之间的匹配度小于预设匹配值时,判断所述错误标记图像是否携带当前目标标记图像的关联标识;若是,则根据所述关联标识查询关联匹配库,并将所述关联匹配库与所述错误标记图像进行匹配,以得到关联数据,根据所述关联数据确定所述错误标记图像的目标标记图像;若否,则发出报警提示。It should also be noted here that after the step of judging the matching degree between the wrongly marked image corresponding to the replacement of the initial weight matrix and the current target marked image, the method further includes: when the wrongly marked image and When the matching degree between the current target mark images is less than the preset matching value, it is judged whether the wrong mark image carries the association mark of the current target mark image; The matching library is matched with the wrongly marked image to obtain associated data, and the target marked image of the wrongly marked image is determined according to the associated data; if not, an alarm prompt is issued.

如上所述,通过判断所述错误标记图像是否携带当前目标标记图像的关联标识,当所述错误标记图像携带当前目标标记图像的关联标识时,则根据所述关联标识查询关联匹配库,并将所述关联匹配库与所述错误标记图像进行匹配,以得到关联数据,从而实现根据所述关联数据确定所述错误标记图像的目标标记图像,便于用户通过多方平台进行图像信息的验证,此外通过报警信息的提示,以便于用户及时维护自己的权益,且具有一定的威慑作用。As mentioned above, by judging whether the erroneous tagged image carries the associated identifier of the current target tagged image, when the erroneously tagged image carries the associated identifier of the current target tagged image, query the associated matching library according to the associated identifier, and The association matching library is matched with the wrongly marked image to obtain associated data, so as to determine the target marked image of the wrongly marked image according to the associated data, which is convenient for users to verify image information through a multi-party platform. In addition, through The reminder of the alarm information is convenient for users to protect their own rights and interests in a timely manner, and has a certain deterrent effect.

作为一个具体的实施例,由于不同的错误标记信息对应着不同的用户,例如,图像A经过图像识别模型对对抗样本覆盖后的原始图像进行图像识别得到的标签为x、y、z;而图像B经过图像识别模型对对抗样本覆盖后的原始图像进行图像识别得到的标签为i、j、k。则可通过数据库匹配得知图像A属于用户A、图像B属于用户B。另外,由于信息序列可以嵌入一定的抗干扰特性,即使图片污损导致图像识别模型无法正确识别部分可识别区域的标签,其结果仍然可以匹配对应的用户。例如,即使图像A经过图像识别模型对对抗样本覆盖后的原始图像进行图像识别得到的标签为x、y,而可识别区域3并未被正确识别,由于x、y与i、j、k相比,前者与用户A的标签x、y、z更近似,仍可断定图片A属于用户A。As a specific example, since different error labeling information corresponds to different users, for example, the labels of image A obtained by image recognition of the original image covered by the adversarial example through the image recognition model are x, y, z; and the image B uses the image recognition model to perform image recognition on the original image covered by the adversarial example, and the labels obtained are i, j, and k. Then it can be known that image A belongs to user A and image B belongs to user B through database matching. In addition, since the information sequence can be embedded with certain anti-jamming properties, even if the image recognition model cannot correctly identify the labels of some recognizable areas due to image defacement, the result can still match the corresponding user. For example, even if image A is labeled as x, y by image recognition of the original image covered by the adversarial example through the image recognition model, but the recognizable area 3 is not correctly identified, because x, y is related to i, j, k The former is more similar to user A's labels x, y, and z, and it can still be concluded that picture A belongs to user A.

根据本发明提供的图像处理方法,首先获取一目标标记图像,通过对抗生成网络模型对所述目标标记图像进行干扰,以得到至少一干扰图像;通过收敛模型对所述干扰图像进行收敛,将收敛合格的干扰图像作为对抗样本,并将所述对抗样本覆盖于目标标记图像上;对进行对抗样本覆盖的目标标记图像进行图像识别,以得到错误标记图像,每个用户所得到的错误标记图片均不相同;根据所述错误标记图像与当前目标标记图像中目标区域的匹配度确定错误标记图像的目标标记图像。本发明提供的图像处理方法,通过对每个用户制造不同的水印,由于生成的水印人眼无法识别,不会影响用户对图片的观感,且在不确定所使用图像识别模型的类型时算法也无法识别,因此无法定位可识别区域。即使可识别区域被定位,由于添加的水印为特定区域针对性的对抗训练结果,算法很难识别其中附加的信息,此外由于对抗样本的特点和多可识别区域的设计,即使图片污损,其水印仍可被识别及匹配,可以准确匹配侵权用户。According to the image processing method provided by the present invention, firstly, a target mark image is acquired, and the target mark image is interfered by an adversarial generation network model to obtain at least one interference image; the interference image is converged by a convergence model, and the convergent The qualified interference image is used as an adversarial sample, and the adversarial sample is covered on the target marked image; image recognition is performed on the target marked image covered by the adversarial sample to obtain a wrongly marked image, and the wrongly marked pictures obtained by each user are Not the same; determine the target marker image of the wrong marker image according to the matching degree between the wrong marker image and the target area in the current target marker image. The image processing method provided by the present invention creates different watermarks for each user. Since the generated watermarks cannot be recognized by the human eye, it will not affect the user's perception of the picture, and the algorithm will not be affected when the type of the image recognition model used is uncertain. Unrecognized, so the recognizable area cannot be located. Even if the identifiable area is located, since the added watermark is the result of targeted adversarial training for a specific area, it is difficult for the algorithm to identify the additional information in it. In addition, due to the characteristics of the adversarial samples and the design of multiple identifiable areas, even if the image is defaced, its Watermarks can still be identified and matched to accurately match infringing users.

请参阅图4,基于同一发明构思,本发明第二实施例提供的图像处理系统,包括:Please refer to Fig. 4, based on the same inventive concept, the image processing system provided by the second embodiment of the present invention includes:

获取模块10,用于获取一目标标记图像,通过对抗生成网络模型对所述目标标记图像进行干扰,以得到至少一干扰图像。The acquiring module 10 is configured to acquire an image of a target mark, and interfere with the image of the target mark by using an adversarial generative network model to obtain at least one interference image.

本实施例中,所述获取模块10包括:In this embodiment, the acquisition module 10 includes:

获取单元11,用于获取原图像的图像信息,并根据所述图像信息对原图像进行离散化处理,从而将该原图像划分为若干可识别区域。The acquiring unit 11 is configured to acquire image information of the original image, and perform discretization processing on the original image according to the image information, so as to divide the original image into several identifiable regions.

标记单元12,用于通过图像识别模型对所述原图像的若干可识别区域进行标记,以得到所述目标标记图像,该目标标记图像携带有可识别区域的正确标签。The marking unit 12 is configured to mark several identifiable areas of the original image through an image recognition model to obtain the target marked image, and the target marked image carries the correct label of the identifiable area.

具体的,对所述原图像的若干可识别区域进行抽取与分解形成标记因子;根据所述标记因子进行机器算法学习后得可识别区域的正确标签。Specifically, several identifiable regions of the original image are extracted and decomposed to form marking factors; machine algorithm learning is performed according to the marking factors to obtain correct labels of identifiable regions.

根据所述标记因子进行机器算法学习后得可识别区域的正确标签的计算公式为:The formula for calculating the correct label of the identifiable region after machine algorithm learning according to the labeling factor is:

Figure BDA0002150905470000111
Figure BDA0002150905470000111

其中,φ()为激活函数,Vk为调节系数,Wi为初始权重,Xi为标记因子,Bk为偏移累加量。Among them, φ() is the activation function, V k is the adjustment coefficient, W i is the initial weight, Xi is the marking factor, and B k is the offset accumulation.

干扰单元13,用于通过对抗生成网络模型对所述目标标记图像进干扰,以得到对应的干扰图像,该干扰图像携带有可识别区域的错误标签。The interference unit 13 is configured to interfere with the target marker image by using an adversarial generative network model to obtain a corresponding interference image, and the interference image carries an erroneous label of an identifiable region.

收敛模块20,用于通过收敛模型对所述干扰图像进行收敛,将收敛合格的干扰图像作为对抗样本,并将所述对抗样本覆盖于目标标记图像上。The convergence module 20 is configured to converge the interference image through a convergence model, use the interference image that has converged qualified as an adversarial example, and cover the adversarial example on the target marked image.

识别模块30,用于对进行对抗样本覆盖的目标标记图像进行图像识别,以得到错误标记图像,每个用户所得到的错误标记图片均不相同。The recognition module 30 is configured to perform image recognition on the target marked image covered by the adversarial example to obtain the wrongly marked image, and the wrongly marked pictures obtained by each user are different.

确定模块40,用于根据所述错误标记图像与当前目标标记图像中目标区域的匹配度确定错误标记图像的目标标记图像。The determination module 40 is configured to determine the target mark image of the wrong mark image according to the matching degree between the wrong mark image and the target area in the current target mark image.

本实施例中,所述确定模块40包括:In this embodiment, the determination module 40 includes:

计算单元41,用于计算所述错误标记图像与当前目标标记图像之间的相关度矩阵。The calculation unit 41 is configured to calculate a correlation matrix between the wrongly marked image and the current target marked image.

修正单元42,用于根据所述相关度矩阵对所述初始权重矩阵进行修正以得到一目标权重矩阵,所述目标权重矩阵用于在所述错误标记图像与所述当前目标标记图像进行匹配时,对所述初始权重矩阵进行替换。A correction unit 42, configured to correct the initial weight matrix according to the correlation matrix to obtain a target weight matrix, and the target weight matrix is used when the wrongly marked image is matched with the current target marked image , to replace the initial weight matrix.

判断单元43,用于判断对所述初始权重矩阵进行替换后所对应的错误标记图像与当前目标标记图像之间的匹配度。The judging unit 43 is configured to judge the matching degree between the error mark image corresponding to the replacement of the initial weight matrix and the current target mark image.

确定单元44,用于当所述错误标记图像与当前目标标记图像之间的匹配度大于预设匹配值时,则将所述当前目标标记图像作为所述错误标记图像的目标标记图像。所述预设匹配值的取值范围为93%~98%。The determining unit 44 is configured to use the current target marker image as the target marker image of the wrong marker image when the matching degree between the wrong marker image and the current target marker image is greater than a preset matching value. The value range of the preset matching value is 93%-98%.

所述判断单元43,还用于当所述错误标记图像与当前目标标记图像之间的匹配度小于预设匹配值时,判断所述错误标记图像是否携带当前目标标记图像的关联标识;若是,则根据所述关联标识查询关联匹配库,并将所述关联匹配库与所述错误标记图像进行匹配,以得到关联数据,根据所述关联数据确定所述错误标记图像的目标标记图像;若否,则发出报警提示。The judging unit 43 is further configured to determine whether the wrongly marked image carries an association identifier of the current target marked image when the matching degree between the wrongly marked image and the current target marked image is less than a preset matching value; if so, Then query the associated matching library according to the associated identification, and match the associated matching library with the wrongly marked image to obtain associated data, and determine the target tagged image of the incorrectly marked image according to the associated data; if not , an alarm will be issued.

根据本发明提供的图像处理系统,首先获取一目标标记图像,通过对抗生成网络模型对所述目标标记图像进行干扰,以得到至少一干扰图像;通过收敛模型对所述干扰图像进行收敛,将收敛合格的干扰图像作为对抗样本,并将所述对抗样本覆盖于目标标记图像上;对进行对抗样本覆盖的目标标记图像进行图像识别,以得到错误标记图像,每个用户所得到的错误标记图片均不相同;根据所述错误标记图像与当前目标标记图像中目标区域的匹配度确定错误标记图像的目标标记图像。本发明提供的图像处理方法,通过对每个用户制造不同的水印,由于生成的水印人眼无法识别,不会影响用户对图片的观感,且在不确定所使用图像识别模型的类型时算法也无法识别,因此无法定位可识别区域。即使可识别区域被定位,由于添加的水印为特定区域针对性的对抗训练结果,算法很难识别其中附加的信息,此外由于对抗样本的特点和多可识别区域的设计,即使图片污损,其水印仍可被识别及匹配,可以准确匹配侵权用户。According to the image processing system provided by the present invention, firstly, a target mark image is obtained, and the target mark image is interfered with by an adversarial generation network model to obtain at least one interference image; the convergence model is used to converge the interference image, and the converged The qualified interference image is used as an adversarial sample, and the adversarial sample is covered on the target marked image; image recognition is performed on the target marked image covered by the adversarial sample to obtain a wrongly marked image, and the wrongly marked pictures obtained by each user are Not the same; determine the target marker image of the wrong marker image according to the matching degree between the wrong marker image and the target area in the current target marker image. The image processing method provided by the present invention creates different watermarks for each user. Since the generated watermarks cannot be recognized by the human eye, it will not affect the user's perception of the picture, and the algorithm will not be affected when the type of the image recognition model used is uncertain. Unrecognized, so the recognizable area cannot be located. Even if the identifiable area is located, since the added watermark is the result of targeted adversarial training for a specific area, it is difficult for the algorithm to identify the additional information in it. In addition, due to the characteristics of the adversarial samples and the design of multiple identifiable areas, even if the image is defaced, its Watermarks can still be identified and matched to accurately match infringing users.

本发明实施例提出的图像处理系统的技术特征和技术效果与本发明实施例提出的方法相同,在此不予赘述。The technical features and technical effects of the image processing system proposed in the embodiment of the present invention are the same as those of the method proposed in the embodiment of the present invention, and will not be repeated here.

此外,本发明的实施例还提出一种存储介质,其上存储有计算机程序,该程序被处理器执行时实现上述方法的步骤。In addition, an embodiment of the present invention also proposes a storage medium on which a computer program is stored, and when the program is executed by a processor, the steps of the above method are implemented.

此外,本发明的实施例还提出一种智能设备,包括存储器、处理器以及存储在存储器上并可在处理器上运行的计算机程序,其中,所述处理器执行所述程序时实现上述方法的步骤。In addition, an embodiment of the present invention also proposes an intelligent device, including a memory, a processor, and a computer program stored in the memory and operable on the processor, wherein the processor implements the above method when executing the program step.

在流程图中表示或在此以其他方式描述的逻辑和/或步骤,例如,可以被认为是用于实现逻辑功能的可执行指令的定序列表,可以具体实现在任何计算机可读介质中,以供指令执行系统、装置或设备(如基于计算机的系统、包括处理器的系统或其他可以从指令执行系统、装置或设备取指令并执行指令的系统)使用,或结合这些指令执行系统、装置或设备而使用。就本说明书而言,“计算机可读介质”可以是任何可以包含、存储、通信、传播或传输程序以供指令执行系统、装置或设备或结合这些指令执行系统、装置或设备而使用的装置。The logic and/or steps represented in the flowcharts or otherwise described herein, for example, can be considered as a sequenced listing of executable instructions for implementing logical functions, can be embodied in any computer-readable medium, For use with instruction execution systems, devices, or devices (such as computer-based systems, systems including processors, or other systems that can fetch instructions from instruction execution systems, devices, or devices and execute instructions), or in conjunction with these instruction execution systems, devices or equipment for use. For the purposes of this specification, a "computer-readable medium" may be any device that can contain, store, communicate, propagate or transmit a program for use in or in conjunction with an instruction execution system, device or device.

计算机可读介质的更具体的示例(非穷尽性列表)包括以下:具有一个或多个布线的电连接部(电子装置),便携式计算机盘盒(磁装置),随机存取存储器(RAM),只读存储器(ROM),可擦除可编辑只读存储器(EPROM或闪速存储器),光纤装置,以及便携式光盘只读存储器(CDROM)。另外,计算机可读介质甚至可以是可在其上打印所述程序的纸或其他合适的介质,因为可以例如通过对纸或其他介质进行光学扫描,接着进行编辑、解译或必要时以其他合适方式进行处理来以电子方式获得所述程序,然后将其存储在计算机存储器中。More specific examples (non-exhaustive list) of computer-readable media include the following: electrical connection with one or more wires (electronic device), portable computer disk case (magnetic device), random access memory (RAM), Read Only Memory (ROM), Erasable and Editable Read Only Memory (EPROM or Flash Memory), Fiber Optic Devices, and Portable Compact Disc Read Only Memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program can be printed, since the program can be read, for example, by optically scanning the paper or other medium, followed by editing, interpretation or other suitable processing if necessary. processing to obtain the program electronically and store it in computer memory.

应当理解,本发明的各部分可以用硬件、软件、固件或它们的组合来实现。在上述实施方式中,多个步骤或方法可以用存储在存储器中且由合适的指令执行系统执行的软件或固件来实现。例如,如果用硬件来实现,和在另一实施方式中一样,可用本领域公知的下列技术中的任一项或他们的组合来实现:具有用于对数据信号实现逻辑功能的逻辑门电路的离散逻辑电路,具有合适的组合逻辑门电路的专用集成电路,可编程门阵列(PGA),现场可编程门阵列(FPGA)等。It should be understood that various parts of the present invention can be realized by hardware, software, firmware or their combination. In the above described embodiments, various steps or methods may be implemented by software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or combination of the following techniques known in the art: Discrete logic circuits, ASICs with suitable combinational logic gates, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.

在本说明书的描述中,参考术语“一个实施例”、“一些实施例”、“示例”、“具体示例”、或“一些示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本发明的至少一个实施例或示例中。在本说明书中,对上述术语的示意性表述不一定指的是相同的实施例或示例。而且,描述的具体特征、结构、材料或者特点可以在任何的一个或多个实施例或示例中以合适的方式结合。In the description of this specification, descriptions referring to the terms "one embodiment", "some embodiments", "example", "specific examples", or "some examples" mean that specific features described in connection with the embodiment or example , structure, material or characteristic is included in at least one embodiment or example of the present invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.

尽管已经示出和描述了本发明的实施例,本领域的普通技术人员可以理解:在不脱离本发明的原理和宗旨的情况下可以对这些实施例进行多种变化、修改、替换和变型,本发明的范围由权利要求及其等同物限定。Although the embodiments of the present invention have been shown and described, those skilled in the art can understand that various changes, modifications, substitutions and modifications can be made to these embodiments without departing from the principle and spirit of the present invention. The scope of the invention is defined by the claims and their equivalents.

最后应说明的是:以上所述实施例,仅为本发明的具体实施方式,用以说明本发明的技术方案,而非对其限制,本发明的保护范围并不局限于此,尽管参照前述实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:任何熟悉本技术领域的技术人员在本发明揭露的技术范围内,其依然可以对前述实施例所记载的技术方案进行修改或可轻易想到变化,或者对其中部分技术特征进行等同替换;而这些修改、变化或者替换,并不使相应技术方案的本质脱离本发明实施例技术方案的精神和范围,都应涵盖在本发明的保护范围之内。因此,本发明的保护范围应以所述权利要求的保护范围为准。Finally, it should be noted that: the above-described embodiments are only specific implementations of the present invention, to illustrate the technical solutions of the present invention, rather than to limit it, and the scope of protection of the present invention is not limited thereto, although referring to the foregoing The embodiment has described the present invention in detail, and those of ordinary skill in the art should understand that any person familiar with the technical field can still modify the technical solutions described in the foregoing embodiments within the technical scope disclosed in the present invention Changes can be easily thought of, or equivalent replacements are made to some of the technical features; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, and should be covered by the scope of the present invention. within the scope of protection. Therefore, the protection scope of the present invention should be determined by the protection scope of the claims.

Claims (10)

1. An image processing method, characterized in that it comprises the steps of:
obtaining a target mark image, and interfering the target mark image through a countermeasure generation network model to obtain at least one interference image;
converging the interference image through a convergence model, taking the interference image qualified in convergence as a countermeasure sample, and covering the countermeasure sample on a target mark image;
carrying out image recognition on the target marked image covered by the countermeasure sample to obtain error marked images, wherein the error marked images obtained by each user are different;
and determining the target marking image of the error marking image according to the matching degree of the error marking image and the target area in the current target marking image.
2. The image processing method of claim 1, wherein the step of obtaining a target marker image, and disturbing the target marker image by countering the generative network model to obtain at least one disturbed image comprises:
acquiring image information of an original image, and performing discretization processing on the original image according to the image information so as to divide the original image into a plurality of recognizable areas;
marking a plurality of identifiable regions of the original image through an image identification model to obtain a target marking image, wherein the target marking image carries correct labels of the identifiable regions;
and interfering the target mark image by a counter-generation network model to obtain a corresponding interference image, wherein the interference image carries an error label of an identifiable region.
3. The image processing method according to claim 2, wherein the step of marking a plurality of recognizable areas of the original image by an image recognition model to obtain the target mark image comprises:
extracting and decomposing a plurality of identifiable regions of the original image to form marking factors;
and obtaining the correct label of the identifiable region after machine algorithm learning according to the marking factor.
4. The image processing method according to claim 3, wherein the calculation formula of the correct label of the recognizable area obtained by machine algorithm learning according to the labeling factor is as follows:
Figure FDA0002150905460000021
where φ () is an activation function, V k To adjust the coefficient, W i As an initial weight, X i As a marker factor, B k Is the offset accumulation.
5. The image processing method according to claim 1, wherein the error marked image corresponds to an initial weight matrix, and the step of determining the target marked image of the error marked image according to the matching degree of the error marked image and the target area in the current target marked image comprises:
calculating a correlation matrix between the error marked image and the current target marked image;
correcting the initial weight matrix according to the correlation matrix to obtain a target weight matrix, wherein the target weight matrix is used for replacing the initial weight matrix when the error marked image is matched with the current target marked image;
judging the matching degree between the corresponding error marked image and the current target marked image after the initial weight matrix is replaced;
and when the matching degree between the error mark image and the current target mark image is greater than a preset matching value, taking the current target mark image as the target mark image of the error mark image.
6. The image processing method according to claim 5, wherein the preset matching value ranges from 93% to 98%.
7. The image processing method according to claim 5, wherein after the step of determining the matching degree between the error marked image corresponding to the replaced initial weight matrix and the current target marked image, the method further comprises:
when the matching degree between the error marked image and the current target marked image is smaller than a preset matching value, judging whether the error marked image carries an associated identifier of the current target marked image;
if yes, inquiring an association matching library according to the association identifier, matching the association matching library with the error marked image to obtain association data, and determining a target marked image of the error marked image according to the association data;
if not, an alarm prompt is sent out.
8. An image processing system, characterized in that the system comprises:
the acquisition module is used for acquiring a target mark image and interfering the target mark image through a countermeasure generation network model to obtain at least one interference image;
the convergence module is used for converging the interference image through a convergence model, taking the interference image qualified in convergence as a countermeasure sample, and covering the countermeasure sample on a target mark image;
the identification module is used for carrying out image identification on the target mark image covered by the countermeasure sample to obtain error mark images, and the error mark images obtained by each user are different;
and the determining module is used for determining the target mark image of the error mark image according to the matching degree of the error mark image and the target area in the current target mark image.
9. A readable storage medium on which a computer program is stored which, when being executed by a processor, carries out the image processing method of any one of claims 1 to 7.
10. An intelligent device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the image processing method of any of claims 1 to 7 when executing the program.
CN201910701385.7A 2019-07-31 2019-07-31 Image processing method, system, readable storage medium and intelligent device Active CN110473135B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910701385.7A CN110473135B (en) 2019-07-31 2019-07-31 Image processing method, system, readable storage medium and intelligent device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910701385.7A CN110473135B (en) 2019-07-31 2019-07-31 Image processing method, system, readable storage medium and intelligent device

Publications (2)

Publication Number Publication Date
CN110473135A CN110473135A (en) 2019-11-19
CN110473135B true CN110473135B (en) 2022-12-27

Family

ID=68508424

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910701385.7A Active CN110473135B (en) 2019-07-31 2019-07-31 Image processing method, system, readable storage medium and intelligent device

Country Status (1)

Country Link
CN (1) CN110473135B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111177757A (en) * 2019-12-27 2020-05-19 支付宝(杭州)信息技术有限公司 Processing method and device for protecting privacy information in picture
CN117034212B (en) * 2020-03-10 2024-06-28 百度在线网络技术(北京)有限公司 Method, apparatus, electronic device and computer storage medium for processing image data
CN113689318B (en) * 2021-07-30 2023-07-07 南京信息工程大学 Deep semi-fragile watermarking method for image authentication and anti-sample defense

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2449171A1 (en) * 2001-06-06 2002-12-12 Spectra Systems Corporation Marking and authenticating articles
CN108921764A (en) * 2018-03-15 2018-11-30 中山大学 A kind of image latent writing method and system based on generation confrontation network
CN109447895A (en) * 2018-09-03 2019-03-08 腾讯科技(武汉)有限公司 Picture Generation Method and device, storage medium and electronic device
CN109615582A (en) * 2018-11-30 2019-04-12 北京工业大学 A face image super-resolution reconstruction method based on attribute description generative adversarial network

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9965850B2 (en) * 2012-07-05 2018-05-08 Bernard Fryshman Object image recognition and instant active response with enhanced application and utility
US10937540B2 (en) * 2017-12-21 2021-03-02 International Business Machines Coporation Medical image classification based on a generative adversarial network trained discriminator

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2449171A1 (en) * 2001-06-06 2002-12-12 Spectra Systems Corporation Marking and authenticating articles
CN108921764A (en) * 2018-03-15 2018-11-30 中山大学 A kind of image latent writing method and system based on generation confrontation network
CN109447895A (en) * 2018-09-03 2019-03-08 腾讯科技(武汉)有限公司 Picture Generation Method and device, storage medium and electronic device
CN109615582A (en) * 2018-11-30 2019-04-12 北京工业大学 A face image super-resolution reconstruction method based on attribute description generative adversarial network

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
数字图像隐写与隐写分析技术的研究;魏程程;《信息与电脑(理论版)》;20180625(第12期);全文 *

Also Published As

Publication number Publication date
CN110473135A (en) 2019-11-19

Similar Documents

Publication Publication Date Title
US20220405522A1 (en) Method for protecting the intellectual property rights of a trained machine learning network model using digital watermarking by adding, on purpose, an anomaly to the training data
JP5404644B2 (en) Computer program for temporal event-based image printing and apparatus for automatically detecting image piracy
Hsu et al. Detecting image splicing using geometry invariants and camera characteristics consistency
KR102099019B1 (en) Identifying method of user based on generative model for watermark and watermarking method based on generative model
CN110473135B (en) Image processing method, system, readable storage medium and intelligent device
CN100583750C (en) Desynchronized fingerprinting method and system for digital multimedia data
Bhagtani et al. An overview of recent work in media forensics: Methods and threats
GB2464123A (en) Event-based temporal video fingerprinting
Ouyang et al. A semi-fragile watermarking tamper localization method based on QDFT and multi-view fusion
CN108564520B (en) GIS vector data copyright authentication method based on Moran index
Zhang et al. Multi-scale segmentation strategies in PRNU-based image tampering localization
CN117615075A (en) Watermark adding and watermark identification method, device, equipment and readable storage medium
Deng et al. A survey of defenses against ai-generated visual media: Detection, disruption, and authentication
Sarma et al. A study on digital image forgery detection
Diwan et al. Systematic analysis of video tampering and detection techniques
Chaitra et al. Digital image forgery: taxonomy, techniques, and tools–a comprehensive study
Rajkumar et al. A robust and forensic transform for copy move digital image forgery detection based on dense depth block matching
Guo et al. Copyrightshield: Spatial similarity guided backdoor defense against copyright infringement in diffusion models
Mishra et al. Effective dense detection method for tampering detection on high quality images using PH-SIFT and RANSAC algorithm
Parasuraman et al. Reversible image watermarking using interpolation technique
Prakash et al. Keypoint-based passive method for image manipulation detection
Taktak et al. Digital image forensics: A two-step approach for identifying source and detecting forgeries
CN113542908A (en) Video detection method and device and electronic equipment
Koundinya et al. Characteristic overview of digital image forensics tools
CN119723026A (en) Video image watermark detection method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant