CN115829502A - Machine inspection task display method and device and electronic equipment - Google Patents
Machine inspection task display method and device and electronic equipment Download PDFInfo
- Publication number
- CN115829502A CN115829502A CN202211512698.6A CN202211512698A CN115829502A CN 115829502 A CN115829502 A CN 115829502A CN 202211512698 A CN202211512698 A CN 202211512698A CN 115829502 A CN115829502 A CN 115829502A
- Authority
- CN
- China
- Prior art keywords
- image analysis
- image
- analysis operation
- target
- operation combination
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
Description
技术领域technical field
本公开涉及机检查验技术领域,具体而言,涉及一种机检查验任务展示方法、装置与电子设备。The present disclosure relates to the field of machine inspection technology, and in particular, to a machine inspection task display method, device and electronic equipment.
背景技术Background technique
在机检查验领域,通常对机检查验对象的扫描图像进行图像分析以确定该机检查验对象是否存在夹藏、限禁品。图像分析包括多种图像分析操作,机检查验人员基于待分析图像的实际情况选择一或多种图像分析操作进行组合,以对待分析图像进行处理,并基于对处理后的待分析图像的观察结果得到分析结论。In the field of machine inspection inspection, image analysis is usually performed on the scanned image of the machine inspection object to determine whether the machine inspection object has contained or restricted items. Image analysis includes a variety of image analysis operations. The machine inspection inspector selects one or more image analysis operations to combine based on the actual situation of the image to be analyzed to process the image to be analyzed, and based on the observation results of the processed image to be analyzed Get the analysis conclusion.
在相关技术中,由于图像分析操作种类众多、参数众多,机检查验的图像分析通常需要经验丰富的机检查验人员来操作,且培训过程通常需要人工指导,经验较少的机检查验人员得到的分析结论通常不足够全面准确,存在疏漏的可能。In related technologies, due to the large variety of image analysis operations and numerous parameters, the image analysis of machine inspection inspection usually requires experienced machine inspection personnel to operate, and the training process usually requires manual guidance, and less experienced machine inspection personnel can obtain The analysis conclusions are usually not comprehensive and accurate enough, and there may be omissions.
因此,提高人工机检查验过程中图像分析操作的操作准确性和效率,成为机检查验领域的一大需求。Therefore, improving the operational accuracy and efficiency of image analysis operations in the manual machine inspection process has become a major demand in the field of machine inspection.
需要说明的是,在上述背景技术部分公开的信息仅用于加强对本公开的背景的理解,因此可以包括不构成对本领域普通技术人员已知的现有技术的信息。It should be noted that the information disclosed in the above background section is only for enhancing the understanding of the background of the present disclosure, and therefore may include information that does not constitute the prior art known to those of ordinary skill in the art.
发明内容Contents of the invention
本公开的目的在于提供一种机检查验任务展示方法、装置与电子设备,用于提高机检查验过程中人工进行图像分析的效率和准确率。The purpose of the present disclosure is to provide a machine inspection task display method, device and electronic equipment for improving the efficiency and accuracy of manual image analysis in the machine inspection process.
根据本公开实施例的第一方面,提供一种机检查验任务展示方法,包括:获取待分析图像,确定所述待分析图像中的目标分析对象的种类信息;确定所述待分析图像对应的目标查验人;根据所述目标分析对象的种类信息以及所述目标分析对象的历史操作数据,在所述目标查验人对应的查验终端展示所述待分析图像、所述待分析图像对应的推荐图像分析操作组合队列。According to the first aspect of the embodiments of the present disclosure, there is provided a machine inspection inspection task display method, including: acquiring an image to be analyzed, determining the type information of the target analysis object in the image to be analyzed; determining the corresponding The target inspector; according to the type information of the target analysis object and the historical operation data of the target analysis object, the image to be analyzed and the recommended image corresponding to the image to be analyzed are displayed on the inspection terminal corresponding to the target inspector Analyze operation composition queues.
在本公开的一种示例性实施例中,所述推荐图像分析操作组合队列包括第一图像分析操作组合,所述根据所述目标分析对象的种类信息以及所述目标分析对象的历史操作数据,在所述目标查验人对应的查验终端展示所述待分析图像、所述待分析图像对应的推荐图像分析操作组合队列包括:根据所述目标分析对象的种类信息以及所述目标分析对象的历史操作数据获取所述目标分析对象的历史查验人对所述目标分析对象的第一图像分析操作组合队列,所述第一图像分析操作组合队列包括按第一顺序排列的多个图像分析操作组合,在所述第一图像分析操作组合队列中确定排序最先的图像分析操作组合为第一图像分析操作组合;在所述推荐图像分析操作组合队列中显示所述第一图像分析操作组合以及所述第一图像分析操作组合的操作控件。In an exemplary embodiment of the present disclosure, the recommended image analysis operation combination queue includes a first image analysis operation combination, and according to the type information of the target analysis object and the historical operation data of the target analysis object, Displaying the image to be analyzed and the recommended image analysis operation combination queue corresponding to the image to be analyzed on the inspection terminal corresponding to the target inspector includes: according to the type information of the target analysis object and the historical operation of the target analysis object The historical inspector of the data acquisition target analysis object performs a first image analysis operation combination queue on the target analysis object, and the first image analysis operation combination queue includes a plurality of image analysis operation combinations arranged in a first order. Determining the first image analysis operation combination in the first image analysis operation combination queue as the first image analysis operation combination; displaying the first image analysis operation combination and the second image analysis operation combination in the recommended image analysis operation combination queue An operation control for an image analysis operation combination.
在本公开的一种示例性实施例中,所述推荐图像分析操作组合队列包括第二图像分析操作组合,所述根据所述目标分析对象的种类信息以及所述目标分析对象的历史操作数据,在所述目标查验人对应的查验终端展示所述待分析图像、所述待分析图像对应的推荐图像分析操作组合队列包括:根据所述目标查验人的历史操作数据和所述目标分析对象的种类信息,确定所述目标查验人所在的目标区域对所述目标分析对象的第二图像分析操作组合队列,所述第二图像分析操作组合队列包括按第二顺序排列的多个图像分析操作组合,在所述第二图像分析操作组合队列中确定排序最先的图像分析操作组合为第二图像分析操作组合;在所述推荐图像分析操作组合队列中显示所述第二图像分析操作组合以及所述第二图像分析操作组合的操作控件。In an exemplary embodiment of the present disclosure, the recommended image analysis operation combination queue includes a second image analysis operation combination, and according to the type information of the target analysis object and the historical operation data of the target analysis object, Displaying the image to be analyzed and the recommended image analysis operation combination queue corresponding to the image to be analyzed on the inspection terminal corresponding to the target inspector includes: according to the historical operation data of the target inspector and the type of the target analysis object information, determining a second image analysis operation combination queue for the target analysis object in the target area where the target inspector is located, the second image analysis operation combination queue includes a plurality of image analysis operation combinations arranged in a second order, Determine the first image analysis operation combination in the second image analysis operation combination queue to be the second image analysis operation combination; display the second image analysis operation combination and the recommended image analysis operation combination queue in the recommended image analysis operation combination queue Operational controls for the second image analysis operation combination.
在本公开的一种示例性实施例中,所述推荐图像分析操作组合队列包括第三图像分析操作组合,所述根据所述目标分析对象的种类信息以及所述目标分析对象的历史操作数据,在所述目标查验人对应的查验终端展示所述待分析图像、所述待分析图像对应的推荐图像分析操作组合队列包括:根据所述目标查验人的历史操作数据和所述目标分析对象的种类信息,确定按照所述目标查验人对所述目标分析对象的操作频率排列的第三图像分析操作组合队列,所述第三图像分析操作组合队列包括按第三顺序排列的多个图像分析操作组合,在所述第三图像分析操作组合队列中确定排序最先的图像分析操作组合为第三图像分析操作组合;在所述推荐图像分析操作组合队列中所述第三图像分析操作组合以及所述第三图像分析操作组合的操作控件。In an exemplary embodiment of the present disclosure, the recommended image analysis operation combination queue includes a third image analysis operation combination, according to the type information of the target analysis object and the historical operation data of the target analysis object, Displaying the image to be analyzed and the recommended image analysis operation combination queue corresponding to the image to be analyzed on the inspection terminal corresponding to the target inspector includes: according to the historical operation data of the target inspector and the type of the target analysis object information, determining a third image analysis operation combination queue arranged according to the operation frequency of the target inspector on the target analysis object, the third image analysis operation combination queue including a plurality of image analysis operation combinations arranged in a third order , determining the first image analysis operation combination in the third image analysis operation combination queue to be the third image analysis operation combination; in the recommended image analysis operation combination queue, the third image analysis operation combination and the Operation controls for the third image analysis operation combination.
在本公开的一种示例性实施例中,所述第一图像分析操作组合队列的形成过程包括:定期获取预设时间范围内的机检查验结论正确的机检查验任务:确定每个所述机检查验结论正确的机检查验任务对应的图像分析操作组合以及目标分析对象;确定每个所述目标分析对象对应的图像分析操作组合集合;根据每个所述图像分析操作组合集合中同一个图像分析操作组合的出现数量由大到小,形成所述图像分析操作组合对应的所述目标分析对象的所述第一图像分析操作组合队列。In an exemplary embodiment of the present disclosure, the formation process of the first image analysis operation combination queue includes: regularly acquiring machine-check inspection tasks with correct machine-check inspection conclusions within a preset time range: determining each of the The image analysis operation combination and the target analysis object corresponding to the machine inspection inspection task with a correct machine inspection conclusion; determine the image analysis operation combination set corresponding to each target analysis object; according to the same one in each image analysis operation combination set The number of image analysis operation combinations appearing from large to small forms the first image analysis operation combination queue of the target analysis object corresponding to the image analysis operation combination.
在本公开的一种示例性实施例中,还包括:根据所述第一图像分析操作组合队列、所述第二图像分析操作组合队列、所述第三图像分析操作组合队列确定多个候选图像分析操作组合;确定每个所述候选图像分析操作组合对应的一或多个序号,所述一或多个序号包括所述候选图像分析操作组合在所述第一图像分析操作组合队列中的第一序号,和/或,在所述第二图像分析操作组合队列中的第二序号,和/或,在所述第二图像分析操作组合队列中的第三序号;根据所述第一图像分析操作组合队列对应的第一权重、所述第二图像分析操作组合队列对应的第二权重、所述第三图像分析操作组合队列对应的第三权重,以及每个所述候选图像分析操作组合的所述一或多个序号,确定每个所述候选图像分析操作组合的评分;根据每个所述候选图像分析操作组合的评分由大到小生成所述待分析图像对应的综合推荐图像分析操作组合队列。In an exemplary embodiment of the present disclosure, further comprising: determining a plurality of candidate images according to the first image analysis operation combination queue, the second image analysis operation combination queue, and the third image analysis operation combination queue Analyzing operation combinations; determining one or more sequence numbers corresponding to each of the candidate image analysis operation combinations, the one or more sequence numbers including the candidate image analysis operation combination in the first image analysis operation combination queue A sequence number, and/or, a second sequence number in the combination queue of the second image analysis operation, and/or, a third sequence number in the combination queue of the second image analysis operation; according to the first image analysis The first weight corresponding to the operation combination queue, the second weight corresponding to the second image analysis operation combination queue, the third weight corresponding to the third image analysis operation combination queue, and each of the candidate image analysis operation combination The one or more serial numbers determine the score of each of the candidate image analysis operation combinations; according to the scores of each of the candidate image analysis operation combinations, a comprehensive recommended image analysis operation corresponding to the image to be analyzed is generated from large to small Combined queue.
在本公开的一种示例性实施例中,所述确定所述待分析图像中的目标分析对象的种类信息包括:确定所述待分析图像中面积占比最大的目标分析对象;识别所述目标分析对象的种类,以形成所述目标分析对象的种类信息。In an exemplary embodiment of the present disclosure, the determining the type information of the target analysis object in the image to be analyzed includes: determining the target analysis object with the largest area ratio in the image to be analyzed; identifying the target The type of the analysis object to form the type information of the target analysis object.
在本公开的一种示例性实施例中,所述确定所述待分析图像中的目标分析对象的种类信息包括:确定所述待分析图像对应的申报信息,所述申报信息包括多个分析对象的种类和价值信息;根据所述多个分析对象的价值信息,确定价值最大的分析对象为所述目标分析对象。In an exemplary embodiment of the present disclosure, the determining the type information of the target analysis object in the image to be analyzed includes: determining the declaration information corresponding to the image to be analyzed, and the declaration information includes a plurality of analysis objects type and value information; according to the value information of the plurality of analysis objects, determine the analysis object with the highest value as the target analysis object.
在本公开的一种示例性实施例中,所述在所述目标查验人对应的查验终端展示所述待分析图像、所述待分析图像对应的推荐图像分析操作组合队列包括:根据所述推荐图像分析操作组合队列中对应的多个图像分析操作组合对所述待分析图像进行图像处理,以生成与所述推荐图像分析操作组合队列中每个图像分析操作组合对应的效果图像;将所述待分析图像、每个所述图像分析操作组合对应的效果图像、每个所述效果图像对应的图像分析操作组合一同展示在所述查验终端。In an exemplary embodiment of the present disclosure, the displaying the image to be analyzed on the inspection terminal corresponding to the target inspector and the recommended image analysis operation combination queue corresponding to the image to be analyzed includes: according to the recommendation A plurality of corresponding image analysis operation combinations in the image analysis operation combination queue perform image processing on the image to be analyzed to generate an effect image corresponding to each image analysis operation combination in the recommended image analysis operation combination queue; The image to be analyzed, the effect image corresponding to each image analysis operation combination, and the image analysis operation combination corresponding to each effect image are displayed together on the inspection terminal.
在本公开的一种示例性实施例中,还包括:根据所述目标分析对象的种类信息,在所述目标查验人对应的查验终端展示所述待分析图像对应的推荐查验结论队列。In an exemplary embodiment of the present disclosure, it further includes: according to the category information of the target analysis object, displaying a queue of recommended inspection conclusions corresponding to the image to be analyzed on the inspection terminal corresponding to the target inspector.
根据本公开实施例的第二方面,提供一种机检查验任务展示装置,包括:According to the second aspect of the embodiments of the present disclosure, there is provided a machine inspection task display device, including:
目标分析对象确定模块,设置为获取待分析图像,确定所述待分析图像中的目标分析对象的种类信息;The target analysis object determination module is configured to acquire the image to be analyzed, and determine the type information of the target analysis object in the image to be analyzed;
目标查验人确定模块,设置为确定所述待分析图像对应的目标查验人;A target inspector determination module, configured to determine the target inspector corresponding to the image to be analyzed;
推荐操作展示模块,设置为根据所述目标分析对象的种类信息以及所述目标分析对象的历史操作数据,在所述目标查验人对应的查验终端展示所述待分析图像、所述待分析图像对应的推荐图像分析操作组合队列。The recommended operation display module is configured to display the image to be analyzed and the image corresponding to the image to be analyzed on the inspection terminal corresponding to the target inspector according to the type information of the target analysis object and the historical operation data of the target analysis object. A combined queue of recommended image analysis operations.
根据本公开的第三方面,提供一种电子设备,包括:存储器;以及耦合到所述存储器的处理器,所述处理器被配置为基于存储在所述存储器中的指令,执行如上述任意一项所述的方法。According to a third aspect of the present disclosure, there is provided an electronic device, including: a memory; and a processor coupled to the memory, the processor is configured to execute any one of the above-mentioned operations based on instructions stored in the memory. method described in the item.
根据本公开的第四方面,提供一种计算机可读存储介质,其上存储有程序,该程序被处理器执行时实现如上述任意一项所述的机检查验任务展示方法。According to a fourth aspect of the present disclosure, there is provided a computer-readable storage medium, on which a program is stored, and when the program is executed by a processor, the method for presenting a machine inspection inspection task as described in any one of the above items is implemented.
本公开实施例通过根据机检查验任务的目标分析对象和目标分析对象的历史查验操作数据,能够自动生成并展示最利于得到准确分析结论的推荐图像分析操作组合队列,进而提高查验人的查验效率,降低对查验人的经验要求,同时提高查验人的分析准确率。According to the target analysis object of the machine inspection task and the historical inspection operation data of the target analysis object, the embodiment of the present disclosure can automatically generate and display the recommended image analysis operation combination queue that is most conducive to obtaining accurate analysis conclusions, thereby improving the inspection efficiency of the inspector , reduce the experience requirements for inspectors, and at the same time improve the analysis accuracy of inspectors.
应当理解的是,以上的一般描述和后文的细节描述仅是示例性和解释性的,并不能限制本公开。It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure.
附图说明Description of drawings
此处的附图被并入说明书中并构成本说明书的一部分,示出了符合本公开的实施例,并与说明书一起用于解释本公开的原理。显而易见地,下面描述中的附图仅仅是本公开的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description serve to explain the principles of the disclosure. Apparently, the drawings in the following description are only some embodiments of the present disclosure, and those skilled in the art can obtain other drawings according to these drawings without creative efforts.
图1是本公开示例性实施例中机检查验任务展示方法的流程图。Fig. 1 is a flowchart of a method for presenting a machine inspection inspection task in an exemplary embodiment of the present disclosure.
图2A~图2C分别是本公开三个实施例中步骤S3的子流程图。FIG. 2A to FIG. 2C are respectively sub-flow charts of step S3 in three embodiments of the present disclosure.
图3是本公开一个实施例中第一图像分析操作组合队列的形成过程流程图。Fig. 3 is a flow chart of the formation process of the first image analysis operation combination queue in one embodiment of the present disclosure.
图4是本公开另一个实施例中步骤S3的子流程图。Fig. 4 is a sub-flow chart of step S3 in another embodiment of the present disclosure.
图5是本公开再一个实施例中步骤S3的子流程图。Fig. 5 is a sub-flowchart of step S3 in yet another embodiment of the present disclosure.
图6A~图6C是本公开一个实施例中展示推荐图像分析操作组合队列的示意图。6A to 6C are schematic diagrams showing a combination queue of recommended image analysis operations in an embodiment of the present disclosure.
图7是本公开一个实施例中查验任务的执行流程图。Fig. 7 is a flow chart of execution of inspection tasks in one embodiment of the present disclosure.
图8是本公开示例性实施例中一种机检查验任务展示装置的方框图。Fig. 8 is a block diagram of a machine inspection task display device in an exemplary embodiment of the present disclosure.
图9是本公开示例性实施例中一种电子设备的方框图。FIG. 9 is a block diagram of an electronic device in an exemplary embodiment of the present disclosure.
具体实施方式Detailed ways
现在将参考附图更全面地描述示例实施方式。然而,示例实施方式能够以多种形式实施,且不应被理解为限于在此阐述的范例;相反,提供这些实施方式使得本公开将更加全面和完整,并将示例实施方式的构思全面地传达给本领域的技术人员。所描述的特征、结构或特性可以以任何合适的方式结合在一个或更多实施方式中。在下面的描述中,提供许多具体细节从而给出对本公开的实施方式的充分理解。然而,本领域技术人员将意识到,可以实践本公开的技术方案而省略所述特定细节中的一个或更多,或者可以采用其它的方法、组元、装置、步骤等。在其它情况下,不详细示出或描述公知技术方案以避免喧宾夺主而使得本公开的各方面变得模糊。Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided in order to give a thorough understanding of embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced without one or more of the specific details being omitted, or other methods, components, devices, steps, etc. may be adopted. In other instances, well-known technical solutions have not been shown or described in detail to avoid obscuring aspects of the present disclosure.
此外,附图仅为本公开的示意性图解,图中相同的附图标记表示相同或类似的部分,因而将省略对它们的重复描述。附图中所示的一些方框图是功能实体,不一定必须与物理或逻辑上独立的实体相对应。可以采用软件形式来实现这些功能实体,或在一个或多个硬件模块或集成电路中实现这些功能实体,或在不同网络和/或处理器装置和/或微控制器装置中实现这些功能实体。In addition, the drawings are only schematic illustrations of the present disclosure, the same reference numerals in the drawings denote the same or similar parts, and thus repeated descriptions thereof will be omitted. Some of the block diagrams shown in the drawings are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in software, or in one or more hardware modules or integrated circuits, or in different network and/or processor means and/or microcontroller means.
下面结合附图对本公开示例实施方式进行详细说明。Exemplary implementations of the present disclosure will be described in detail below in conjunction with the accompanying drawings.
图1是本公开示例性实施例中机检查验任务展示方法的流程图。Fig. 1 is a flowchart of a method for presenting a machine inspection inspection task in an exemplary embodiment of the present disclosure.
参考图1,机检查验任务展示方法100可以包括:Referring to FIG. 1 , a
步骤S1,获取待分析图像,确定所述待分析图像中的目标分析对象的种类信息;Step S1, acquiring the image to be analyzed, and determining the type information of the target analysis object in the image to be analyzed;
步骤S2,确定所述待分析图像对应的目标查验人;Step S2, determining the target inspector corresponding to the image to be analyzed;
步骤S3,根据所述目标分析对象的种类信息以及所述目标分析对象的历史操作数据,在所述目标查验人对应的查验终端展示所述待分析图像、所述待分析图像对应的推荐图像分析操作组合队列。Step S3, according to the type information of the target analysis object and the historical operation data of the target analysis object, display the image to be analyzed and the recommended image analysis corresponding to the image to be analyzed on the inspection terminal corresponding to the target inspector. Operates on a combined queue.
本公开实施例通过根据机检查验任务的目标分析对象和目标分析对象的历史查验操作数据,能够自动生成并展示最利于得到准确分析结论的推荐图像分析操作组合队列,进而提高查验人的查验效率,降低对查验人的经验要求,同时提高查验人的分析准确率。According to the target analysis object of the machine inspection task and the historical inspection operation data of the target analysis object, the embodiment of the present disclosure can automatically generate and display the recommended image analysis operation combination queue that is most conducive to obtaining accurate analysis conclusions, thereby improving the inspection efficiency of the inspector , reduce the experience requirements for inspectors, and at the same time improve the analysis accuracy of inspectors.
本公开实施例的待分析图像可以为机检查验过程中的扫描图像,本公开实施例的方法可以在待分析图像形成之后、机检查验过程的人工审图任务生成之前执行。在一些实施例中,人工审图任务之前设置有智能审图环节,智能审图环节中被判断存在可疑要素的查验任务将生成人工审图任务。在另一些实施例中,也可以不设置智能审图环节,只要形成机检查验任务对应的待分析图像,即执行本公开实施例的方法。The image to be analyzed in the embodiment of the present disclosure may be a scanned image in the machine inspection process, and the method in the embodiment of the present disclosure may be executed after the image to be analyzed is formed and before the manual image review task in the machine inspection process is generated. In some embodiments, an intelligent map review link is set before the manual map review task, and an inspection task judged to have suspicious elements in the intelligent map review link will generate a manual map review task. In some other embodiments, it is also possible not to set an intelligent image review link, as long as the image to be analyzed corresponding to the machine inspection task is formed, the method of the embodiment of the present disclosure is executed.
下面,对机检查验任务展示方法100的各步骤进行详细说明。Next, each step of the
在步骤S1,获取待分析图像,确定所述待分析图像中的目标分析对象的种类信息。In step S1, an image to be analyzed is acquired, and type information of a target analysis object in the image to be analyzed is determined.
在一个实施例中,在获取到待分析图像之后,可以确定所述待分析图像中面积占比最大的目标分析对象,然后自动识别所述目标分析对象的种类,以形成所述目标分析对象的种类信息。In one embodiment, after the image to be analyzed is acquired, the target analysis object with the largest area ratio in the image to be analyzed can be determined, and then the type of the target analysis object can be automatically identified to form the target analysis object. Kind information.
其中,自动识别目标分析对象的过程可以为提取待分析图像中的图像特征点,并将根据这些特征点自动识别出一或多个物品,并基于预设数据库中记录的每种物品对应的特征点种类,识别该一或多个物品的种类。可以仅识别占待分析图像面积最大(即涉及的像素占待分析图像全部像素的比例)的一或多个物品的种类。例如,在待分析图像中分别识别到A物品、B物品、C物品、D物品,这四种物品占待分析图像的面积比例分别为37%、26%、15%、8%,此时,既可以仅识别占用面积最大的A物品的种类,也可以识别占用面积前预设值(预设值例如为3)的A物品、B物品、C物品的种类,还可以识别占用面积在预设阈值(例如为20%)以上的A物品、B物品的种类。Among them, the process of automatically identifying the target analysis object can be to extract the image feature points in the image to be analyzed, and automatically identify one or more items according to these feature points, and based on the corresponding features of each item recorded in the preset database Click Type to identify the type of the one or more items. Only one or more types of items occupying the largest area of the image to be analyzed (that is, the proportion of the involved pixels to all pixels of the image to be analyzed) may be identified. For example, item A, item B, item C, and item D are respectively identified in the image to be analyzed, and the proportions of these four items in the image to be analyzed are 37%, 26%, 15%, and 8% respectively. At this time, It is possible to identify only the type of item A with the largest occupied area, or to identify the types of item A, item B, and item C with a preset value before the occupied area (the default value is, for example, 3), or to identify the types of items whose occupied area is within the preset value. Types of A and B items above a threshold (for example, 20%).
当识别一个物品的种类时,将该物品设置为目标分析对象,并根据识别结果记录其种类信息;当识别多个物品的种类时,可以将每个物品设置为目标分析对象,并基于每个物品生成并显示推荐图像分析操作组合队列。When identifying the type of an item, set the item as the target analysis object, and record its type information according to the recognition result; when identifying multiple types of items, each item can be set as the target analysis object, and based on each The article generates and displays a queue of recommended image analysis operations combinations.
在本公开的另一个实施例中,如果机检查验任务存在申报信息,例如海关的机检查验任务,可以获取申报信息中记录的物品种类和价值信息(包括单价或总价),然后将价值最大的物品确定为目标分析对象。这种情况下可以直接确定最具分析价值的物品作为查验的主要物品,效率较高。In another embodiment of the present disclosure, if there is declaration information for the machine inspection task, such as the customs machine inspection task, the item type and value information (including unit price or total price) recorded in the declaration information can be obtained, and then the value The largest item is identified as the target analysis object. In this case, the item with the most analytical value can be directly determined as the main item for inspection, and the efficiency is high.
此外,还可以将识别到的物品轮流作为目标分析物品显示,对每种识别出的物品均执行本公开实施例提供的方法,通过标签或者其他控件切换对每种物品的推荐图像分析操作组合队列。In addition, the identified items may be displayed as target analysis items in turn, and the method provided by the embodiment of the present disclosure is executed for each identified item, and the recommended image analysis operation combination queue for each item is switched through a label or other controls .
在步骤S2,确定所述待分析图像对应的目标查验人。In step S2, the target inspector corresponding to the image to be analyzed is determined.
为待分析图像生成人工审图任务的过程中,可以根据预设规则实时确定执行该机检查验任务的目标查验人。In the process of generating a manual image review task for the image to be analyzed, the target inspector who performs the machine inspection and inspection task can be determined in real time according to the preset rules.
目标查验人的数量可以为一个或多个,例如一个机检查验任务(人工审图任务)可以对应多个查验岗位,每个查验岗位可以对应多个查验人,则每个查验人均作为目标查验人。The number of target inspectors can be one or more. For example, a machine-based inspection task (manual drawing review task) can correspond to multiple inspection posts, and each inspection post can correspond to multiple inspectors, so each inspector can be used as the target inspection people.
由于每个目标查验人分别对应一个查验终端,因此,对每个目标查验人均执行本公开实施例的方法,以分别对每个目标查验人生成推荐图像分析操作组合队列,并对应展示在每个目标查验人所在的查验终端上。Since each target inspector corresponds to an inspection terminal, the methods of the embodiments of the present disclosure are executed for each target inspector to generate a combined queue of recommended image analysis operations for each target inspector, and correspondingly displayed in each On the inspection terminal where the target inspector is located.
多个目标查验人对应的多个查验终端可以在一个地理位置(例如一个办公室),也可以在不同的地理位置(例如两个城市),无论在何位置,均可以通过有线或无线网络传输该机检查验任务对应的信息。在一些实施例中,本公开实施例提供的方法可以由多个查验终端连接的服务器执行。Multiple inspection terminals corresponding to multiple target inspectors can be located in one geographic location (such as an office) or in different geographic locations (such as two cities). No matter where they are, the information can be transmitted through a wired or wireless network. The information corresponding to the machine inspection inspection task. In some embodiments, the method provided by the embodiments of the present disclosure may be executed by multiple servers that check the connection of the terminals.
此外,由于一个查验终端可能在不同时间归属不同的查验人使用,因此,识别目标查验人的过程不以查验终端的识别符为准,而是按照每个查验人登录机检查验系统的识别符(ID)为准,以准确匹配目标查验人及其当前使用的查验终端。在此情况下,可以将每个查验人的历史操作信息根据其识别符(ID)保存在服务器中,以避免查验人更换查验信息后历史操作数据丢失。In addition, since an inspection terminal may be used by different inspectors at different times, the process of identifying the target inspector is not based on the identifier of the inspection terminal, but on the basis of the identifier of each inspector logging into the machine inspection inspection system. (ID) shall prevail to accurately match the target inspector and the inspection terminal currently used. In this case, the historical operation information of each inspector can be saved in the server according to its identifier (ID), so as to avoid the loss of historical operation data after the inspector replaces the inspection information.
在步骤S3,根据所述目标分析对象的种类信息以及所述目标分析对象的历史操作数据,在所述目标查验人对应的查验终端展示所述待分析图像、所述待分析图像对应的推荐图像分析操作组合队列。In step S3, according to the type information of the target analysis object and the historical operation data of the target analysis object, the image to be analyzed and the recommended image corresponding to the image to be analyzed are displayed on the inspection terminal corresponding to the target inspector Analyze operation composition queues.
历史操作数据包括多个查验人的历史查验操作数据以及与每组历史查验操作数据对应的分析对象和历史查验结果。历史操作数据可以是在每个查验任务结束后,对查验过程中的图像分析记录数据进行清洗、加工、提取得到。例如,现场查验人员通过移动端PAD或者PC端电脑完成查验标注操作后,可以自动对该任务执行结果进行多维度分析,统计分析内容包括但不限于以下维度:任务进口、出口类型(进境、出境)/口岸地点/来源地(国家)/目的地(国家)/当前时间、季节/当前操作人员/查验结果/嫌疑区域智能审图结果以及操作人员确认最终结果。最终,以任务为单位,对以上维度数据进行统计汇总,并更新历史统计数据。The historical operation data includes the historical inspection operation data of multiple inspectors, and the analysis objects and historical inspection results corresponding to each set of historical inspection operation data. The historical operation data can be obtained by cleaning, processing and extracting the image analysis record data during the inspection process after each inspection task is completed. For example, after the on-site inspectors complete the inspection and labeling operation through the mobile PAD or PC computer, they can automatically conduct multi-dimensional analysis of the task execution results. The statistical analysis content includes but is not limited to the following dimensions: task import, export type (entry, Exit)/port location/origin (country)/destination (country)/current time, season/current operator/inspection result/suspicious area intelligent map review result and final result confirmed by the operator. In the end, the task is used as a unit to perform statistical summary on the above dimension data, and update the historical statistical data.
在业务现场,可能遇到一些特殊场景、非典型任务,如业务现场流程测试、智能审图违禁品制图等,该类数据纳入历史统计数据范围,会对系统推荐情况产生一定影响。因此具有系统管理员权限的操作人员,可以对此类任务增加标签,不将此类任务纳入历史统计数据。At the business site, some special scenarios and atypical tasks may be encountered, such as business site process testing, smart map review and contraband mapping, etc. Such data will be included in the scope of historical statistical data, which will have a certain impact on the system recommendation. Therefore, operators with system administrator privileges can add tags to such tasks, and do not include such tasks in historical statistics.
可以对每个查验人的历史操作数据进行定期汇总和分析,以生成每种物品对应的历史查验操作数据。在确定目标分析对象后,直接提取该目标分析对象的历史查验操作数据。The historical operation data of each inspector can be periodically summarized and analyzed to generate historical inspection operation data corresponding to each item. After the target analysis object is determined, the historical inspection operation data of the target analysis object is directly extracted.
历史操作数据也包括目标查验人的历史操作数据。在确定目标查验人后,可以提取该目标查验人的历史操作数据及分析结论,提高生成推荐图像分析操作组合队列的效率。The historical operation data also includes the historical operation data of the target inspector. After the target inspector is determined, the historical operation data and analysis conclusions of the target inspector can be extracted to improve the efficiency of generating the recommended image analysis operation combination queue.
基于历史统计数据形成的历史操作数据至少包括每个查验人执行过的查验任务、每个查验任务的查验结论、根据后续信息确定的每个查验结论的正确性,以及每个查验任务对应的图像分析操作组合。其中,图像分析操作组合包括一或多个图像分析操作。The historical operation data formed based on historical statistical data includes at least the inspection tasks performed by each inspector, the inspection conclusion of each inspection task, the correctness of each inspection conclusion determined based on subsequent information, and the image corresponding to each inspection task Analyze operation combinations. Wherein, the combination of image analysis operations includes one or more image analysis operations.
图像分析操作也可以称为图像分析算法,由查验人通过点选、输入字符等方式操作图像分析软件进行选择,以对待分析图像进行全局图像处理,形成不同的图像处理效果。例如,当图像分析操作包括1、2、3、4、5这五种操作时,对一个待分析图像,查验人可以先后使用3、5、2进行图像处理,并基于处理后的图像效果进行人工观察得到查验结论。Image analysis operations can also be called image analysis algorithms, which are selected by the inspector by operating the image analysis software by clicking, inputting characters, etc., so as to perform global image processing on the image to be analyzed to form different image processing effects. For example, when the image analysis operation includes five operations of 1, 2, 3, 4, and 5, for an image to be analyzed, the inspector can use 3, 5, and 2 to perform image processing successively, and perform image processing based on the processed image effect. The conclusions were obtained by manual observation.
由于不同查验人的操作习惯不同、每种目标分析对象的特征不同,不同查验人对不同目标分析对象设置的图像分析操作组合也不相同。因此,本公开实施例的目的在于基于目标查验人和目标分析对象,推荐出一个合适的图像分析操作组合的排序,使目标查验人可以在推荐图像分析操作组合队列中选取图像分析操作组合,以降低目标查验人的主观因素对图像分析操作顺序的影响。当目标查验人在推荐图像分析操作组合队列中选择一个图像分析操作组合时,可以自动按照该图像分析操作组合的顺序执行多个图像分析操作,使目标查验人可以通过一次选择执行多个图像分析操作,极大提高图像分析的效率。Due to the different operating habits of different inspectors and the different characteristics of each target analysis object, the image analysis operation combinations set by different inspectors for different target analysis objects are also different. Therefore, the purpose of the embodiments of the present disclosure is to recommend an appropriate sequence of image analysis operation combinations based on the target inspector and the target analysis object, so that the target inspector can select an image analysis operation combination from the queue of recommended image analysis operation combinations to Reduce the impact of the subjective factors of the target inspector on the sequence of image analysis operations. When the target inspector selects an image analysis operation combination in the recommended image analysis operation combination queue, multiple image analysis operations can be automatically performed in the order of the image analysis operation combination, so that the target inspector can perform multiple image analysis through one selection operation, greatly improving the efficiency of image analysis.
图像分析操作可以包括表1所示的操作。Image analysis operations may include operations shown in Table 1.
表1Table 1
表1中的操作和子操作仅为示例,在实际应用中,图像分析操作可以包括更多内容或者其他内容,本公开实施例不对图像分析操作的具体内容进行限制,本领域技术人员可以根据实际情况自行设置。The operations and sub-operations in Table 1 are only examples. In actual applications, the image analysis operation may include more content or other content. Embodiments of the present disclosure do not limit the specific content of the image analysis operation. Those skilled in the art can Set it up yourself.
需要补充的是,图像分析操作除了包括操作种类,还可以包括操作参数,例如上述的对数变化操作中,可以预先设置多个操作参数(对数1、对数2、对数3)以供选择,该操作参数的选择过程也可以称为子操作。在实际应用中,查验人可以修改每个操作对应的操作参数,当其修改的操作参数不存在于历史记录中时,自动生成新的子操作进行记录,以供后续直接选择即可。What needs to be added is that, in addition to the type of operation, the image analysis operation can also include operating parameters. For example, in the above-mentioned logarithmic change operation, multiple operating parameters (
表1所示仅为示例,实际应用中,图像分析操作还可以包括更多操作种类和子操作种类。What is shown in Table 1 is only an example. In practical applications, the image analysis operation may also include more types of operations and sub-types of operations.
表2是查验人对一个机检查验任务的待分析图像的历史操作记录的示意。Table 2 is a schematic illustration of historical operation records of inspectors on images to be analyzed for a machine inspection inspection task.
表2:Table 2:
参考表2,在一个查验任务中,历史操作记录可以包括操作日期、操作时间、图像分析操作及其编码,随着操作的增加,图像分析操作组合实时变化,记录每种图像分析操作及其被执行的顺序。该查验任务完成后,记录最终的图像分析操作顺序作为该查验任务对应的图像分析操作组合。表2中图像分析操作可以为不同的图像分析操作,仅为示例。Referring to Table 2, in an inspection task, historical operation records can include operation date, operation time, image analysis operations and their codes. With the increase of operations, the combination of image analysis operations changes in real time, recording each image analysis operation and its code. order of execution. After the inspection task is completed, record the final image analysis operation sequence as the image analysis operation combination corresponding to the inspection task. The image analysis operations in Table 2 may be different image analysis operations, which are only examples.
对每个已完成的查验任务均记录其图像分析操作组合、该查验任务对应的目标查验对象(主要查验的物品种类)以及查验结论,最后,定期获取该查验任务对应的后续查获数据和复核数据,以记录该查验结论是否正确。复核数据是更高级的审图岗位对同一查验任务的分析结论,后续查获数据包括但不限于通过开箱查验、手动查验、犬类嗅闻查验、其他执法部门查获的结果。For each completed inspection task, record its image analysis operation combination, the target inspection object corresponding to the inspection task (main types of items to be inspected), and the inspection conclusion. Finally, obtain the follow-up seized data and review data corresponding to the inspection task on a regular basis , to record whether the inspection conclusion is correct. The re-inspection data is the analysis conclusion of the same inspection task by a higher-level drawing review post, and the subsequent seizure data includes but is not limited to the results of unpacking inspection, manual inspection, dog sniffing inspection, and other law enforcement agencies.
如果查验结论为未见异常,但是后续复核数据或者查获数据为出现异常,则查验结论不正确;如果查验结论为发现异常,但是后续复核数据或者查获数据为未见异常,则查验结论不正确;如果查验结论为未见异常,后续复核数据或者查获数据为未见异常,则查验结论正确;如果查验结论为发现异常,后续复核数据或者查获数据为出现异常,则查验结论正确。If the inspection conclusion is that there is no abnormality, but the subsequent review data or seized data is abnormal, the inspection conclusion is incorrect; if the inspection conclusion is that an abnormality is found, but the subsequent review data or seized data is no abnormality, the inspection conclusion is incorrect; If the inspection conclusion is that there is no abnormality, and the subsequent review data or seized data shows that there is no abnormality, the inspection conclusion is correct;
对查验结论的判断可以定期根据最新的数据进行,并在一定周期内结束。例如,在查验任务结束的三天内,更新一次复核数据,每日更新后续查获数据,并在查验任务结束的第四天结束数据更新,保存对该查验结论的最终判断。Judgments on inspection conclusions can be made on a regular basis based on the latest data and end within a certain period. For example, within three days after the end of the inspection task, update the re-inspection data once, update the subsequent seized data every day, and end the data update on the fourth day after the end of the inspection task, and save the final judgment on the inspection conclusion.
接下来,可以综合利用历史操作数据以及当前查验任务对应的待分析图像和目标分析对象,确定待分析图像对应的推荐图像分析操作组合队列。Next, the historical operation data, the image to be analyzed and the target analysis object corresponding to the current inspection task can be comprehensively used to determine the recommended image analysis operation combination queue corresponding to the image to be analyzed.
图2A~图2C分别是本公开三个实施例中步骤S3的子流程图。FIG. 2A to FIG. 2C are respectively sub-flow charts of step S3 in three embodiments of the present disclosure.
参考图2A,在一个实施例中,推荐图像分析操作组合队列包括第一图像分析操作组合,步骤S3可以包括:Referring to FIG. 2A, in one embodiment, the recommended image analysis operation combination queue includes a first image analysis operation combination, and step S3 may include:
步骤S31,根据所述目标分析对象的种类信息以及所述目标分析对象的历史查验操作数据获取所述目标分析对象的历史查验人对所述目标分析对象的第一图像分析操作组合队列,所述第一图像分析操作组合队列包括按第一顺序排列的多个图像分析操作组合,在所述第一图像分析操作组合队列中确定排序最先的图像分析操作组合为第一图像分析操作组合;Step S31, according to the type information of the target analysis object and the historical inspection operation data of the target analysis object, obtain the first image analysis operation combination queue of the target analysis object's historical inspector on the target analysis object, the The first image analysis operation combination queue includes a plurality of image analysis operation combinations arranged in a first order, and the first image analysis operation combination in the first image analysis operation combination queue is determined to be the first image analysis operation combination;
步骤S32,在所述推荐图像分析操作组合队列中显示所述第一图像分析操作组合以及所述第一图像分析操作组合的操作控件。Step S32, displaying the first image analysis operation combination and the operation controls of the first image analysis operation combination in the recommended image analysis operation combination queue.
参考图2B,在一个实施例中,推荐图像分析操作组合队列包括第二图像分析操作组合,步骤S3可以包括:Referring to FIG. 2B, in one embodiment, the recommended image analysis operation combination queue includes a second image analysis operation combination, and step S3 may include:
步骤S33,根据所述目标查验人的历史操作数据和所述目标分析对象的种类信息,确定所述目标查验人所在区域对所述目标分析对象的第二图像分析操作组合队列,所述第二图像分析操作组合队列包括按第二顺序排列的多个图像分析操作组合,在所述第二图像分析操作组合队列中确定排序最先的图像分析操作组合为第二图像分析操作组合;Step S33, according to the historical operation data of the target inspector and the type information of the target analysis object, determine the second image analysis operation combination queue for the target analysis object in the area where the target inspector is located, the second The image analysis operation combination queue includes a plurality of image analysis operation combinations arranged in a second order, and the first image analysis operation combination in the second image analysis operation combination queue is determined to be the second image analysis operation combination;
步骤S34,在所述推荐图像分析操作组合队列中显示所述第二图像分析操作组合以及所述第二图像分析操作组合的操作控件。Step S34, displaying the second image analysis operation combination and the operation controls of the second image analysis operation combination in the recommended image analysis operation combination queue.
参考图2C,在一个实施例中,推荐图像分析操作组合队列包括第三图像分析操作组合,步骤S3可以包括:Referring to FIG. 2C, in one embodiment, the recommended image analysis operation combination queue includes a third image analysis operation combination, and step S3 may include:
步骤S35,根据所述目标查验人的历史操作数据和所述目标分析对象的种类信息,确定按照所述目标查验人对所述目标分析对象的操作频率排列的第三图像分析操作组合队列,所述第三图像分析操作组合队列包括按第三顺序排列的多个图像分析操作组合,在所述第三图像分析操作组合队列中确定排序最先的图像分析操作组合为第三图像分析操作组合;Step S35, according to the historical operation data of the target inspector and the type information of the target analysis object, determine the third image analysis operation combination queue arranged according to the operation frequency of the target inspector on the target analysis object, so The third image analysis operation combination queue includes a plurality of image analysis operation combinations arranged in a third order, and the first image analysis operation combination in the third image analysis operation combination queue is determined to be the third image analysis operation combination;
步骤S36,在所述推荐图像分析操作组合队列中显示所述第三图像分析操作组合的操作控件。Step S36 , displaying the operation controls of the third image analysis operation combination in the recommended image analysis operation combination queue.
在本公开的一个实施例中,推荐图像分析操作组合队列也可以同时包括由上述三种因素形成的三个图像分析操作组合中的两个或者三个。此外,本领域技术人员可以自行设置通过其他因素形成图像分析操作组合队列,并将该图像分析操作组合队列中的图像分析操作组合中的一或多个图像分析操作组合在推荐图像分析操作组合队列中显示。虽然上述实施例中,仅选取每个图像分析操作组合队列中的一个图像分析操作组合显示在推荐图像分析操作组合中,但是可以理解的是,每次也可以按序在每个图像分析操作组合队列中选择两个或者更多的图像分析操作组合显示在推荐图像分析操作组合队列中。In an embodiment of the present disclosure, the recommended image analysis operation combination queue may also include two or three of the three image analysis operation combinations formed by the above three factors. In addition, those skilled in the art can set the image analysis operation combination queue formed by other factors by themselves, and combine one or more image analysis operations in the image analysis operation combination in the image analysis operation combination queue into the recommended image analysis operation combination queue displayed in . Although in the above-mentioned embodiment, only one image analysis operation combination in each image analysis operation combination queue is selected to be displayed in the recommended image analysis operation combination, it can be understood that each image analysis operation combination can also be sequentially displayed each time. Select two or more image analysis operation combinations in the queue to be displayed in the recommended image analysis operation combination queue.
下面,详细介绍上述三种图像分析操作组合队列的形成过程。Next, the formation process of the combination queues of the above three image analysis operations will be described in detail.
首先,读取数据库,根据目标分析对象的种类直接获取其对应的生成第一图像分析操作组合队列。Firstly, the database is read, and the corresponding combination queue for generating the first image analysis operation is directly acquired according to the type of the target analysis object.
图3是本公开一个实施例中第一图像分析操作组合队列的形成过程流程图。Fig. 3 is a flow chart of the formation process of the first image analysis operation combination queue in one embodiment of the present disclosure.
参考图3,第一图像分析操作组合队列的形成过程可以包括:Referring to FIG. 3, the formation process of the first image analysis operation combination queue may include:
步骤S311,定期获取预设时间范围内的机检查验结论正确的机检查验任务:Step S311, regularly obtain the machine-checked inspection tasks with correct machine-checked inspection conclusions within the preset time range:
步骤S312,确定每个所述机检查验结论正确的机检查验任务对应的图像分析操作组合以及目标分析对象;Step S312, determining the image analysis operation combination and the target analysis object corresponding to each machine-inspection inspection task whose machine-inspection inspection conclusion is correct;
步骤S313,确定每个所述目标分析对象对应的图像分析操作组合集合;Step S313, determining an image analysis operation combination set corresponding to each target analysis object;
步骤S314,根据每个所述图像分析操作组合集合中同一个图像分析操作组合的出现数量由大到小,形成所述图像分析操作组合对应的所述目标分析对象的所述第一图像分析操作组合队列。Step S314, according to the number of occurrences of the same image analysis operation combination in each of the image analysis operation combination sets from large to small, forming the first image analysis operation of the target analysis object corresponding to the image analysis operation combination Combined queue.
在图3所示实施例中,仅选择查验结论正确的查验任务进行分析,以保证图像分析结论的准确性。其中,查验结论正确的查验任务来自全部已完成查验任务的历史数据库,由不同查验人执行。In the embodiment shown in FIG. 3 , only inspection tasks with correct inspection conclusions are selected for analysis to ensure the accuracy of image analysis conclusions. Among them, the inspection tasks with correct inspection conclusions come from the historical database of all completed inspection tasks, and are performed by different inspectors.
接下来,汇总并分类每个查验结论正确的查验任务的目标分析对象,得到每种目标分析对象对应的图像分析操作组合集合,比如物品A对应的图像分析操作组合集合包括5个图像分析操作,图像分析操作组合a出现3次,图像分析操作组合b出现4次,图像分析操作组合c出现1次,图像分析操作组合d出现10次,图像分析操作组合e出现6次。Next, summarize and classify the target analysis objects of each inspection task with correct inspection conclusions, and obtain the image analysis operation combination set corresponding to each target analysis object. For example, the image analysis operation combination set corresponding to item A includes 5 image analysis operations. Image analysis operation combination a appeared 3 times, image analysis operation combination b appeared 4 times, image analysis operation combination c appeared 1 time, image analysis operation combination d appeared 10 times, image analysis operation combination e appeared 6 times.
最后,可以按照每个图像分析操作组合的出现数量由大到小形成与物品A对应的第一图像分析操作组合队列,在上例中,物品A对应的第一图像分析操作组合队列的图像操作组合编号为(d,e,b,a,c),需要注意的是,其中每个编号是一个图像分析操作组合,而不是一个图像分析操作。Finally, the first image analysis operation combination queue corresponding to item A can be formed according to the occurrence number of each image analysis operation combination from large to small. In the above example, the image operation of the first image analysis operation combination queue corresponding to item A The combination numbers are (d, e, b, a, c), and it should be noted that each number is a combination of image analysis operations rather than an image analysis operation.
第一图像分析操作组合队列可以定期形成并存储在数据库中,从而在确定目标分析对象后,直接从数据库中读取该目标分析对象对应的第一图像分析操作组合队列。The first image analysis operation combination queue may be formed regularly and stored in the database, so that after the target analysis object is determined, the first image analysis operation combination queue corresponding to the target analysis object is directly read from the database.
形成第一图像分析操作组合后,可以选取第一图像分析操作组合队列中排序最先的图像分析操作组合为推荐图像分析操作组合队列中的第一图像分析操作组合。After the first image analysis operation combination is formed, the first image analysis operation combination in the first image analysis operation combination queue may be selected as the first image analysis operation combination in the recommended image analysis operation combination queue.
此外,还可以根据目标查验人所在的目标区域形成对目标分析对象的第二图像分析操作组合队列。目标查验人所在的目标区域的范围可以由本领域技术人员自行设置,例如目标查验人所在的海关查验站、目标查验人所在的市、目标查验人所在的省等。基于目标查验人所在的目标区域形成第二图像分析操作组合队列的过程与形成第一图像分析操作组合队列的过程相似,区别仅在于使用的历史操作数据并非全部查验任务对应的历史操作数据,而是目标查验人所在的目标区域对应的历史操作数据。第二图像分析操作组合队列也可以定期形成并存储在数据库中,从而在确定目标分析对象后,直接从数据库中读取该目标分析对象对应的第二图像分析操作组合队列。In addition, a second image analysis operation combination queue for the target analysis object may also be formed according to the target area where the target inspector is located. The scope of the target area where the target inspector is located can be set by those skilled in the art, such as the customs inspection station where the target inspector is located, the city where the target inspector is located, the province where the target inspector is located, etc. The process of forming the second image analysis operation combination queue based on the target area where the target inspector is located is similar to the process of forming the first image analysis operation combination queue. The only difference is that the historical operation data used is not the historical operation data corresponding to all inspection tasks, but It is the historical operation data corresponding to the target area where the target inspector is located. The second combination queue of image analysis operations may also be periodically formed and stored in the database, so that after the target analysis object is determined, the second image analysis operation combination queue corresponding to the target analysis object is directly read from the database.
形成第二图像分析操作组合后,可以选取第二图像分析操作组合队列中排序最先的图像分析操作组合为推荐图像分析操作组合队列中的第二图像分析操作组合。After the second image analysis operation combination is formed, the first image analysis operation combination in the second image analysis operation combination queue may be selected as the second image analysis operation combination in the recommended image analysis operation combination queue.
在查验人的查验任务执行历史中,每个查验人对不同分析对象通常具有常规图像分析操作组合。可以定期分析每个查验人对每个分析对象的查验结论正确的常规图像分析操作组合,按照每个图像分析操作组合的使用频率生成每个查验人对每个分析对象的第三图像分析操作组合队列,从而在确定目标查验人和目标查验对象后,直接读取数据库获取第三图像分析操作组合队列。形成第三图像分析操作组合后,可以选取第三图像分析操作组合队列中排序最先的图像分析操作组合为推荐图像分析操作组合队列中的第三图像分析操作组合。In the inspector's inspection task execution history, each inspector usually has a combination of conventional image analysis operations for different analysis objects. It is possible to regularly analyze the combination of conventional image analysis operations with correct inspection conclusions of each inspector for each analysis object, and generate a third image analysis operation combination for each inspector for each analysis object according to the frequency of use of each image analysis operation combination queue, so that after the target inspector and the target inspection object are determined, the database is directly read to obtain the third image analysis operation combination queue. After the third image analysis operation combination is formed, the first image analysis operation combination in the third image analysis operation combination queue may be selected as the third image analysis operation combination in the recommended image analysis operation combination queue.
第三图像分析操作组合队列的使用可以提高图像分析过程与目标查验人的适配性,提高目标查验人对图像处理后的待分析图像的效果的熟悉程度,从而提高目标查验人得出查验结论的效率和准确性。The use of the third image analysis operation combination queue can improve the adaptability of the image analysis process and the target inspector, improve the familiarity of the target inspector with the effect of the image to be analyzed after image processing, thereby improving the inspection conclusion drawn by the target inspector efficiency and accuracy.
在本公开的其他实施例中,第二图像分析操作组合队列和第三图像分析操作组合队列的获取均可以通过手动或者自动设置来使能或者禁用。当第二图像分析操作组合队列和/或第三图像分析操作组合队列被禁用时,设置被禁用的图像分析操作组合队列为空。In other embodiments of the present disclosure, the acquisition of the second image analysis operation combination queue and the third image analysis operation combination queue can be enabled or disabled through manual or automatic settings. When the second image analysis operation combination queue and/or the third image analysis operation combination queue are disabled, the disabled image analysis operation combination queue is set to be empty.
最后,可以在待分析图像所在的页面,展示第一图像分析操作组合以及所述第一图像分析操作组合的操作控件、所述第二图像分析操作组合以及所述第二图像分析操作组合的操作控件、所述第三图像分析操作组合以及所述第三图像分析操作组合的操作控件。操作控件包括但不限于按钮、下拉框、复选框等,详细展示效果请见后续实施例。Finally, the first image analysis operation combination and the operation controls of the first image analysis operation combination, the second image analysis operation combination and the operations of the second image analysis operation combination can be displayed on the page where the image to be analyzed is located controls, the third image analysis operation combination, and operation controls of the third image analysis operation combination. Operation controls include but are not limited to buttons, drop-down boxes, check boxes, etc. For detailed display effects, please refer to subsequent embodiments.
在本公开的另一个实施例中,还可以基于上述三个图像分析操作组合队列,生成一个综合推荐图像分析操作组合队列,并在推荐图像分析操作组合队列中展示该综合推荐图像分析操作组合队列中的一或多个元素。In another embodiment of the present disclosure, a comprehensive recommended image analysis operation combination queue can also be generated based on the above three image analysis operation combination queues, and the comprehensive recommended image analysis operation combination queue is displayed in the recommended image analysis operation combination queue One or more elements in .
图4是本公开另一个实施例中步骤S3的子流程图。Fig. 4 is a sub-flow chart of step S3 in another embodiment of the present disclosure.
参考图4,在一个实施例中,步骤S3还可以包括:Referring to Fig. 4, in one embodiment, step S3 may also include:
步骤S371,根据所述第一图像分析操作组合队列、所述第二图像分析操作组合队列、所述第三图像分析操作组合队列确定多个候选图像分析操作组合;Step S371, determining multiple candidate image analysis operation combinations according to the first image analysis operation combination queue, the second image analysis operation combination queue, and the third image analysis operation combination queue;
步骤S372,确定每个所述候选图像分析操作组合对应的一或多个序号,所述一或多个序号包括所述候选图像分析操作组合在所述第一图像分析操作组合队列中的第一序号,和/或,在所述第二图像分析操作组合队列中的第二序号,和/或,在所述第二图像分析操作组合队列中的第三序号;Step S372, determining one or more serial numbers corresponding to each of the candidate image analysis operation combinations, the one or more serial numbers including the first one of the candidate image analysis operation combination in the first image analysis operation combination queue A sequence number, and/or, a second sequence number in the second image analysis operation combination queue, and/or, a third sequence number in the second image analysis operation combination queue;
步骤S373,根据所述第一图像分析操作组合队列对应的第一权重、所述第二图像分析操作组合队列对应的第二权重、所述第三图像分析操作组合队列对应的第三权重,以及每个所述候选图像分析操作组合的所述一或多个序号,确定每个所述候选图像分析操作组合的评分;Step S373, according to the first weight corresponding to the first image analysis operation combination queue, the second weight corresponding to the second image analysis operation combination queue, the third weight corresponding to the third image analysis operation combination queue, and said one or more sequence numbers of each of said candidate image analysis operation combinations, determining a score for each of said candidate image analysis operation combinations;
步骤S374,根据每个所述候选图像分析操作组合的评分由大到小生成所述待分析图像对应的推荐图像分析操作组合队列。Step S374, generating a queue of recommended image analysis operation combinations corresponding to the image to be analyzed according to the scores of each candidate image analysis operation combination in descending order.
首先,可以将第一图像分析操作组合队列、第二图像分析操作组合队列、第三图像分析操作组合队列涉及的图像分析操作组合进行汇总,以得到目标查验人和目标分析对象涉及的全部候选图像分析操作组合,便于后续进行综合分析。First, the image analysis operation combinations involved in the first image analysis operation combination queue, the second image analysis operation combination queue, and the third image analysis operation combination queue can be summarized to obtain all candidate images involving the target inspector and the target analysis object The combination of analysis operations facilitates subsequent comprehensive analysis.
然后,确定各候选图像分析操作组合在各队列中的序号,序号靠前的候选图像分析操作组合对分析结果的正确性的影响较大。有第二图像分析操作组合队列和第三图像分析操作组合队列可能为空,或者,某候选图像分析操作组合仅出现在一个或者两个队列中,所以有可能仅得到一个序号或者两个序号。Then, the serial numbers of each candidate image analysis operation combination in each queue are determined, and the candidate image analysis operation combinations with higher serial numbers have a greater impact on the correctness of the analysis results. The second image analysis operation combination queue and the third image analysis operation combination queue may be empty, or a candidate image analysis operation combination only appears in one or two queues, so it is possible to obtain only one sequence number or two sequence numbers.
此外,由于第一图像分析操作组合队列、第二图像分析操作组合队列、第三图像分析操作组合队列对最终图像分析结果正确性的影响力不同,第一图像分析操作组合队列的影响力大于第三图像分析操作组合队列的影响力,第三图像分析操作组合队列的影响力大于第二图像分析操作组合队列的影响力,因此,可以预先对每个图像分析操作组合队列预先设置权重值,例如将第一图像分析操作组合队列的权重设置为第一权重0.6,将第三图像分析操作组合队列的权重设置为第三权重0.25,将第二图像分析操作组合队列的权重设置为第二权重0.15,以协调每个图像分析操作组合的实际重要性。上述第一权重、第二权重、第三权重的数值仅为示例,本领域技术人员可以根据实际需求自行调整。In addition, because the first image analysis operation combination queue, the second image analysis operation combination queue, and the third image analysis operation combination queue have different influences on the correctness of the final image analysis result, the influence of the first image analysis operation combination queue is greater than that of the second image analysis operation combination queue. The influence of the three image analysis operation combination queues, the influence of the third image analysis operation combination queue is greater than the influence of the second image analysis operation combination queue, therefore, the weight value can be preset for each image analysis operation combination queue, for example Set the weight of the first image analysis operation combination queue to the first weight 0.6, set the weight of the third image analysis operation combination queue to the third weight 0.25, and set the weight of the second image analysis operation combination queue to the second weight 0.15 , to coordinate the practical importance of each combination of image analysis operations. The above numerical values of the first weight, the second weight, and the third weight are only examples, and those skilled in the art can make adjustments according to actual needs.
最后,根据每个候选图像分析操作组合在各队列中的序号以及各队列的权重,计算每个候选图像分析操作组合的评分。其中,不同序号对应的初始评分不同,例如在某个队列中序号为1的图像分析操作组合的初始评分为100,序号为2的图像分析操作组合的初始评分为80,序号为3的图像分析操作组合的初始评分为60,以此类推。不同队列的初始评分的设置可以相同,以便于后续计算。Finally, according to the serial number of each candidate image analysis operation combination in each queue and the weight of each queue, the score of each candidate image analysis operation combination is calculated. Among them, the initial scores corresponding to different serial numbers are different. For example, in a certain queue, the initial score of the image analysis operation combination with the
假设一个候选图像分析操作组合在第一图像分析操作组合队列中的序号为1,没有在第二图像分析操作组合队列中出现,在第三图像分析操作组合队列的序号为3,且第一权重、第二权重、第三权重的数值如上例,那么该候选图像分析操作组合的最终评分S按照上述例子中的数值计算为:S=100*0.6+0*0.15+60*0.25=75。Assume that the sequence number of a candidate image analysis operation combination in the first image analysis operation combination queue is 1, does not appear in the second image analysis operation combination queue, and the sequence number in the third image analysis operation combination queue is 3, and the first weight , the second weight, and the third weight are as in the above example, then the final score S of the candidate image analysis operation combination is calculated according to the value in the above example: S=100*0.6+0*0.15+60*0.25=75.
对每个候选图像分析操作组合计算评分后,按照评分由大到小生成待分析图像对应的综合推荐图像分析操作组合队列。After the score is calculated for each candidate image analysis operation combination, a queue of comprehensively recommended image analysis operation combinations corresponding to the image to be analyzed is generated according to the scores from large to small.
上述评分的生成规则可以由本领域技术人员自行设置,本公开不以此为限。The above scoring generation rules can be set by those skilled in the art, and the present disclosure is not limited thereto.
生成推荐图像分析操作组合队列后,可以将待分析图像及推荐图像分析操作组合队列一同展示在目标查验人当前登录的终端屏幕上。当目标查验人进行查验操作时,可以使用功能选项如选择框、下拉列表、复选操作、备注文本信息等选择推荐图像分析操作组合队列中的图像分析操作组合。当操作人员认为推荐选项不正确时,可以点击进行更改操作,更改图像分析操作组合,例如在第一图像分析操作组合的操作控件上将第一图像分析操作组合调整为第一图像分析操作组合队列中的其他操作组合,或者在推荐图像分析操作组合的操作控件上调整第一图像分析操作组合队列、第二图像分析操作组合队列、第三图像分析操作组合队列中的使能或禁用、权重值。After the recommended image analysis operation combination queue is generated, the image to be analyzed and the recommended image analysis operation combination queue can be displayed together on the terminal screen of the target inspector currently logged in. When the target inspector performs the inspection operation, he can use functional options such as selection box, drop-down list, check operation, note text information, etc. to select the image analysis operation combination in the recommended image analysis operation combination queue. When the operator thinks that the recommended option is incorrect, he can click to perform a change operation to change the image analysis operation combination, for example, adjust the first image analysis operation combination to the first image analysis operation combination queue on the operation control of the first image analysis operation combination Other operation combinations in , or adjust the enabling or disabling and weight values of the first image analysis operation combination queue, the second image analysis operation combination queue, and the third image analysis operation combination queue on the operation control of the recommended image analysis operation combination .
图5是本公开再一个实施例中步骤S3的子流程图。Fig. 5 is a sub-flowchart of step S3 in yet another embodiment of the present disclosure.
参考图5,在一个实施中,步骤S3中展示待分析图像的过程可以包括:Referring to Fig. 5, in one implementation, the process of showing the image to be analyzed in step S3 may include:
步骤S38,根据所述推荐图像分析操作组合队列中对应的多个图像分析操作组合对所述待分析图像进行图像处理,以生成与所述推荐图像分析操作组合队列中每个图像分析操作组合对应的效果图像;Step S38: Perform image processing on the image to be analyzed according to the corresponding multiple image analysis operation combinations in the recommended image analysis operation combination queue to generate an image corresponding to each image analysis operation combination in the recommended image analysis operation combination queue. effect image;
步骤S39,将所述待分析图像、每个所述图像分析操作组合对应的效果图像、每个所述效果图像对应的图像分析操作组合一同展示在所述查验终端。Step S39, displaying the image to be analyzed, the effect image corresponding to each of the image analysis operation combinations, and the image analysis operation combination corresponding to each of the effect images on the inspection terminal.
在图5所示实施例中,为了提高目标查验人的处理效率,可以直接使用推荐图像分析操作组合队列中的各图像分析操作组合,直接对待分析图像进行图像处理,并将处理后的图像展示在查验终端上。其中,排序在前的图像分析操作组合可以通过高亮、加粗、闪烁等方式进行展示,减少操作人员的操作过程,有效提高工作效率。In the embodiment shown in Figure 5, in order to improve the processing efficiency of the target inspector, the image analysis operation combinations in the recommended image analysis operation combination queue can be directly used to directly perform image processing on the image to be analyzed, and display the processed image on the inspection terminal. Among them, the top-ranked image analysis operation combinations can be displayed by highlighting, bolding, flashing, etc., reducing the operator's operation process and effectively improving work efficiency.
在本公开另一个实施例中,还可以根据根据目标分析对象的种类信息,在目标查验人对应的查验终端展示待分析图像对应的推荐查验结论队列。该推荐查验结论队列可以根据对目标分析对象的种类识别以及该目标分析对象对应的历史查验结论形成,其中,推荐查验结论队列中的查验结论的顺序可以根据目标分析对象对应的历史查验结论的出现频率确定。例如,商品A的推荐查验结论队列可以为(a区域存在夹藏,b区域存在夹藏,无夹藏)。可根据该任务进出口类型、口岸地点等维度统计信息,对推荐结论进行推荐排序,方便操作人员快速选择合适选项。In another embodiment of the present disclosure, according to the type information of the target analysis object, a queue of recommended inspection conclusions corresponding to the image to be analyzed may be displayed on the inspection terminal corresponding to the target inspector. The recommended inspection conclusion queue can be formed according to the type identification of the target analysis object and the historical inspection conclusion corresponding to the target analysis object, wherein, the order of the inspection conclusions in the recommended inspection conclusion queue can be based on the appearance of the historical inspection conclusion corresponding to the target analysis object The frequency is determined. For example, the sequence of recommended inspection conclusions for commodity A may be (inclusions in area a, inclusions in area b, and no inclusions). According to the dimensional statistical information such as the type of import and export of the task, the location of the port, etc., the recommendation conclusions can be sorted to facilitate the operator to quickly select the appropriate option.
除了展示推荐查验结论,还可以展示该推荐查验结论对应的查验标记、备注信息,查验标记可以为多个查验人的历史操作数据中,对该目标查验对象进行的风险区域标记;备注信息可以为文字信息或者多个种类的标注信息,以在待分析图像中指示该目标分析对象的某个区域的风险(漏报、误报)信息或者图像处理建议。每个目标分析对象的备注信息的内容均可以由多个查验人输入,并汇总展示在后续的图像分析过程中。In addition to displaying the recommended inspection conclusion, it can also display the inspection mark and remark information corresponding to the recommended inspection conclusion. The inspection mark can be the risk area mark of the target inspection object in the historical operation data of multiple inspectors; the remark information can be Text information or multiple types of annotation information to indicate the risk (missing negative, false positive) information or image processing suggestions of a certain area of the target analysis object in the image to be analyzed. The content of the remark information of each target analysis object can be input by multiple inspectors, and will be summarized and displayed in the subsequent image analysis process.
最后,可以将推荐图像分析操作组合队列、推荐查验结论队列同时展示在查验终端,供目标查验人分析。Finally, the recommended image analysis operation combination queue and the recommended inspection conclusion queue can be simultaneously displayed on the inspection terminal for analysis by the target inspector.
图6A~图6C是本公开一个实施例中展示推荐图像分析操作组合队列的示意图。6A to 6C are schematic diagrams showing a combination queue of recommended image analysis operations in an embodiment of the present disclosure.
参考图6A,在一个实施例中,可以同时展示待分析图像61、推荐图像分析操作组合队列62,推荐图像分析操作组合队列62中包括多个图像分析操作组合621~62N,每个图像分析操作组合均可供目标查验人选择,以对待分析图像61进行自动图像处理,最后将图像处理结果63展示在待分析图像61所在的位置,如果图6A右侧。其中,多个图像分析操作组合621~62N既可以包括第一图像分析操作组合的操作控件、第二图像分析操作组合的操作控件、第三图像分析操作组合的操作控件,还可以包括综合推荐分析操作组合的操作控件。Referring to FIG. 6A, in one embodiment, an image to be analyzed 61 and a recommended image analysis
参考图6B,在另一个实施例中,可以同时展示待分析图像61、推荐图像分析操作组合队列62以及与推荐图像分析操作组合队列62中的每个图像分析操作组合621~62N对应的效果图像631~63i,如果一个屏幕展示不出,可以通过滑动条65等工具展示更多效果图像。其中,N为推荐图像分析操作组合队列62中的图像分析操作组合的数量,i为图像分析操作组合在推荐图像分析操作组合队列62中的序号。Referring to FIG. 6B, in another embodiment, the image to be analyzed 61, the recommended image analysis
参考图6C,在再一个实施例中,可以同时展示待分析图像61、推荐图像分析操作组合队列62以及推荐查验结论队列64、标记推荐65和备注信息66,或者,也可以同时展示推荐图像分析操作组合队列62中的每个图像分析操作组合621~62N对应的效果图像631~63i。Referring to Fig. 6C, in another embodiment, the image to be analyzed 61, the recommended image analysis
由图6A~图6C可以看出,相比传统方案中仅展示待分析图像和可供选择的图像分析操作,本公开实施例为目标查验人提供更直观的操作推荐,有该操作推荐是根据全部查验任务和目标查验人的历史操作数据得出,能够兼顾准确性和目标查验人的操作习惯,极大提高目标查验人的查验效率和查验准确度。It can be seen from FIG. 6A to FIG. 6C that, compared with the traditional solution, which only shows images to be analyzed and optional image analysis operations, the embodiments of the present disclosure provide more intuitive operation recommendations for target inspectors. The operation recommendations are based on All inspection tasks and the historical operation data of the target inspector can be obtained, which can take into account the accuracy and the operating habits of the target inspector, and greatly improve the inspection efficiency and accuracy of the target inspector.
在另一些实施例中,展示待分析图像61之前也可以首先对待分析图像61进行预处理,以提高识别准确度。In some other embodiments, before displaying the
例如,可以在获取到待分析图像后,自动识别到集装箱和驾驶室在图像中的位置,再根据查验货物(目标分析对象)、目标查验人等信息,获取推荐图像分析操作组合队列,加载优先级最高的操作组合对应的处理效果(图标高亮显示)并将其他操作组合作为推荐项加载到工具栏汇总,供目标查验人进行选择,同时获取常用集装箱驾驶室相对图像位置,自动在所有推荐图像分析操作组合中叠加水平翻转(机检查验设备来回扫描,导致部分图像驾驶室右侧,部分驾驶室位于图像左侧),以更准确地显示待分析图像。For example, after acquiring the image to be analyzed, it can automatically identify the position of the container and cab in the image, and then obtain the recommended image analysis operation combination queue according to the inspection cargo (target analysis object), target inspection person and other information, and load priority The processing effect corresponding to the highest-level operation combination (the icon is highlighted) and other operation combinations are loaded into the toolbar as a recommendation item for the target inspector to choose. Horizontal flip is superimposed in the combination of image analysis operations (the machine inspection equipment scans back and forth, causing part of the image to be on the right side of the cab and part of the cab to be on the left side of the image) to more accurately display the image to be analyzed.
图7是本公开一个实施例中查验任务的执行流程图。Fig. 7 is a flow chart of execution of inspection tasks in one embodiment of the present disclosure.
参考图7,在一个实施例中,查验人任务的执行流程可以包括:Referring to FIG. 7 , in one embodiment, the execution process of the inspector task may include:
步骤S701,扫描系统对待查验物品进行扫描,生成扫描图像;Step S701, the scanning system scans the item to be inspected to generate a scanned image;
步骤S702,扫描系统将扫描图像发送智能审图系统,请求智审运算;Step S702, the scanning system sends the scanned image to the intelligent image review system, requesting intelligent review calculation;
步骤S703,智能审图系统接收扫描图像,进行智审运算;Step S703, the intelligent image review system receives the scanned image and performs intelligent review calculation;
步骤S704,智能审图系统完成图像智能分析,分析结论发送机检查验系统;Step S704, the intelligent image review system completes the intelligent image analysis, and sends the analysis conclusion to the machine inspection system;
步骤S705,机检查验系统接收智审结论,向扫描系统获取扫描图像信息,完成结论与扫描图像的关联、绑定;Step S705, the machine-based inspection system receives the intelligent trial conclusion, obtains the scanned image information from the scanning system, and completes the association and binding of the conclusion and the scanned image;
步骤S706,机检查验系统获取历史统计数据以及查验人员历史操作数据;Step S706, the machine-based inspection system acquires historical statistical data and historical operation data of inspectors;
步骤S707,机检查验系统根据查验货物或机检查验人员给出确定推荐图像分析操作组合队列和推荐分析结论队列;Step S707, the machine inspection system determines the recommended image analysis operation combination queue and the recommended analysis conclusion queue according to the inspected goods or the machine inspection personnel;
步骤S708,查验人员根据推荐指导,结合经验,对图像进行分析;Step S708, the inspector analyzes the image according to the recommended guidance and experience;
步骤S709,机检查验系统记录操作人员操作过程,获得查验任务对应的图像分析操作记录;Step S709, the machine-based inspection system records the operation process of the operator, and obtains the image analysis operation record corresponding to the inspection task;
步骤S710,图像分析完成后,自动进行多维度历史数据统计并更新历史数据;Step S710, after the image analysis is completed, automatically perform multi-dimensional historical data statistics and update historical data;
步骤S711,机检查验系统对图像分析操作记录进行数据清洗,对用户有效行为进行分析;Step S711, the machine inspection system performs data cleaning on the image analysis operation records, and analyzes effective user behaviors;
步骤S712,查验完成,查验结论发送智能审图系统以及扫描系统;Step S712, the inspection is completed, and the inspection conclusion is sent to the intelligent drawing review system and the scanning system;
步骤S713,智能审图系统接收智审确认结论,进行操作学习优化;Step S713, the intelligent drawing review system receives the confirmation conclusion of the intelligent review, and performs operation learning optimization;
步骤S714,扫描系统接收查验结论,进行放行或下一步处置;Step S714, the scanning system receives the inspection conclusion, and performs release or next step of disposal;
步骤S715,流程结束。Step S715, the process ends.
综上所述,本公开实施例通过在查验过程中,对查验人的操作过程进行记录并分析,根据查验人员查验结论准确的查验任务使用的图像分析功能、多维度的查验历史统计数据以及查验人员历史操作行为分析,对查验货物、查验结论准确性、查验标记准确性等数据进行分析聚类,获得与当前查验货物以及当前查验人对应的推荐图像分析操作组合、查验人员高频图像分析操作组合、查验人员个性化图像分析操作组合,针对查验任务提供最佳图像分析功能组合,对查验人员操作进行推荐、对选择项进行合理排序,以供查验人员进行选择操作,可以根据海量历史查验记录,提供查验操作最佳实践,提升查验系统可用性。To sum up, the embodiment of the present disclosure records and analyzes the operation process of the inspector during the inspection process, and uses the image analysis function, multi-dimensional inspection historical statistical data, and inspection tasks based on the inspection conclusions of the inspectors. Analyzing personnel’s historical operation behavior, analyzing and clustering data such as inspection goods, accuracy of inspection conclusions, and accuracy of inspection marks, etc., to obtain recommended image analysis operation combinations corresponding to the current inspection goods and current inspectors, and high-frequency image analysis operations for inspectors Combination, personalized image analysis operation combination of inspectors, providing the best combination of image analysis functions for inspection tasks, recommending the operations of inspectors, and sorting the options reasonably for the inspectors to choose and operate, based on massive historical inspection records , providing best practices for inspection operations and improving the availability of the inspection system.
对应于上述方法实施例,本公开还提供一种机检查验任务展示装置,可以用于执行上述方法实施例。Corresponding to the above-mentioned method embodiments, the present disclosure further provides a machine inspection task display device, which can be used to execute the above-mentioned method embodiments.
图8是本公开示例性实施例中一种机检查验任务展示装置的方框图。Fig. 8 is a block diagram of a machine inspection task display device in an exemplary embodiment of the present disclosure.
参考图8,机检查验任务展示装置800可以包括:Referring to FIG. 8 , the machine inspection
目标分析对象确定模块81,设置为获取待分析图像,确定所述待分析图像中的目标分析对象的种类信息;The target analysis object determination module 81 is configured to acquire the image to be analyzed, and determine the type information of the target analysis object in the image to be analyzed;
目标查验人确定模块82,设置为确定所述待分析图像对应的目标查验人;The target inspector determination module 82 is configured to determine the target inspector corresponding to the image to be analyzed;
推荐操作展示模块83,设置为根据所述目标分析对象的种类信息以及所述目标分析对象的历史操作数据,在所述目标查验人对应的查验终端展示所述待分析图像、所述待分析图像对应的推荐图像分析操作组合队列。The recommended operation display module 83 is configured to display the image to be analyzed and the image to be analyzed on the inspection terminal corresponding to the target inspector according to the type information of the target analysis object and the historical operation data of the target analysis object. The corresponding recommended image analysis operation composition queue.
由于装置800的各功能已在其对应的方法实施例中予以详细说明,本公开于此不再赘述。Since each function of the
应当注意,尽管在上文详细描述中提及了用于动作执行的设备的若干模块或者单元,但是这种划分并非强制性的。实际上,根据本公开的实施方式,上文描述的两个或更多模块或者单元的特征和功能可以在一个模块或者单元中具体化。反之,上文描述的一个模块或者单元的特征和功能可以进一步划分为由多个模块或者单元来具体化。It should be noted that although several modules or units of the device for action execution are mentioned in the above detailed description, this division is not mandatory. Actually, according to the embodiment of the present disclosure, the features and functions of two or more modules or units described above may be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided to be embodied by a plurality of modules or units.
在本公开的示例性实施例中,还提供了一种能够实现上述方法的电子设备。In an exemplary embodiment of the present disclosure, an electronic device capable of implementing the above method is also provided.
所属技术领域的技术人员能够理解,本发明的各个方面可以实现为系统、方法或程序产品。因此,本发明的各个方面可以具体实现为以下形式,即:完全的硬件实施方式、完全的软件实施方式(包括固件、微代码等),或硬件和软件方面结合的实施方式,这里可以统称为“电路”、“模块”或“系统”。Those skilled in the art can understand that various aspects of the present invention can be implemented as systems, methods or program products. Therefore, various aspects of the present invention can be embodied in the following forms, that is: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software implementations, which can be collectively referred to herein as "circuit", "module" or "system".
下面参照图9来描述根据本发明的这种实施方式的电子设备900。图9显示的电子设备900仅仅是一个示例,不应对本发明实施例的功能和使用范围带来任何限制。An
如图9所示,电子设备900以通用计算设备的形式表现。电子设备900的组件可以包括但不限于:上述至少一个处理单元910、上述至少一个存储单元920、连接不同系统组件(包括存储单元920和处理单元910)的总线930。As shown in FIG. 9,
其中,所述存储单元存储有程序代码,所述程序代码可以被所述处理单元910执行,使得所述处理单元910执行本说明书上述“示例性方法”部分中描述的根据本发明各种示例性实施方式的步骤。例如,所述处理单元910可以执行如本公开实施例所示的方法。Wherein, the storage unit stores program codes, and the program codes can be executed by the
存储单元920可以包括易失性存储单元形式的可读介质,例如随机存取存储单元(RAM)9201和/或高速缓存存储单元9202,还可以进一步包括只读存储单元(ROM)9203。The
存储单元920还可以包括具有一组(至少一个)程序模块9205的程序/实用工具9204,这样的程序模块9205包括但不限于:操作系统、一个或者多个应用程序、其它程序模块以及程序数据,这些示例中的每一个或某种组合中可能包括网络环境的实现。The
总线930可以为表示几类总线结构中的一种或多种,包括存储单元总线或者存储单元控制器、外围总线、图形加速端口、处理单元或者使用多种总线结构中的任意总线结构的局域总线。
电子设备900也可以与一个或多个外部设备1000(例如键盘、指向设备、蓝牙设备等)通信,还可与一个或者多个使得用户能与该电子设备900交互的设备通信,和/或与使得该电子设备900能与一个或多个其它计算设备进行通信的任何设备(例如路由器、调制解调器等等)通信。这种通信可以通过输入/输出(I/O)接口950进行。并且,电子设备900还可以通过网络适配器960与一个或者多个网络(例如局域网(LAN),广域网(WAN)和/或公共网络,例如因特网)通信。如图所示,网络适配器960通过总线930与电子设备900的其它模块通信。应当明白,尽管图中未示出,可以结合电子设备900使用其它硬件和/或软件模块,包括但不限于:微代码、设备驱动器、冗余处理单元、外部磁盘驱动阵列、RAID系统、磁带驱动器以及数据备份存储系统等。The
通过以上的实施方式的描述,本领域的技术人员易于理解,这里描述的示例实施方式可以通过软件实现,也可以通过软件结合必要的硬件的方式来实现。因此,根据本公开实施方式的技术方案可以以软件产品的形式体现出来,该软件产品可以存储在一个非易失性存储介质(可以是CD-ROM,U盘,移动硬盘等)中或网络上,包括若干指令以使得一台计算设备(可以是个人计算机、服务器、终端装置、或者网络设备等)执行根据本公开实施方式的方法。Through the description of the above implementations, those skilled in the art can easily understand that the example implementations described here can be implemented by software, or by combining software with necessary hardware. Therefore, the technical solutions according to the embodiments of the present disclosure can be embodied in the form of software products, and the software products can be stored in a non-volatile storage medium (which can be CD-ROM, U disk, mobile hard disk, etc.) or on the network , including several instructions to make a computing device (which may be a personal computer, a server, a terminal device, or a network device, etc.) execute the method according to the embodiments of the present disclosure.
在本公开的示例性实施例中,还提供了一种计算机可读存储介质,其上存储有能够实现本说明书上述方法的程序产品。在一些可能的实施方式中,本发明的各个方面还可以实现为一种程序产品的形式,其包括程序代码,当所述程序产品在终端设备上运行时,所述程序代码用于使所述终端设备执行本说明书上述“示例性方法”部分中描述的根据本发明各种示例性实施方式的步骤。In an exemplary embodiment of the present disclosure, there is also provided a computer-readable storage medium on which a program product capable of implementing the above-mentioned method in this specification is stored. In some possible implementations, various aspects of the present invention can also be implemented in the form of a program product, which includes program code, and when the program product is run on a terminal device, the program code is used to make the The terminal device executes the steps according to various exemplary embodiments of the present invention described in the "Exemplary Method" section above in this specification.
根据本发明的实施方式的用于实现上述方法的程序产品可以采用便携式紧凑盘只读存储器(CD-ROM)并包括程序代码,并可以在终端设备,例如个人电脑上运行。然而,本发明的程序产品不限于此,在本文件中,可读存储介质可以是任何包含或存储程序的有形介质,该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。The program product for implementing the above method according to the embodiment of the present invention may adopt a portable compact disk read-only memory (CD-ROM) and include program codes, and may run on a terminal device such as a personal computer. However, the program product of the present invention is not limited thereto. In this document, a readable storage medium may be any tangible medium containing or storing a program, and the program may be used by or in combination with an instruction execution system, apparatus or device.
所述程序产品可以采用一个或多个可读介质的任意组合。可读介质可以是可读信号介质或者可读存储介质。可读存储介质例如可以为但不限于电、磁、光、电磁、红外线、或半导体的系统、装置或器件,或者任意以上的组合。可读存储介质的更具体的例子(非穷举的列表)包括:具有一个或多个导线的电连接、便携式盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。The program product may reside on any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any combination thereof. More specific examples (non-exhaustive list) of readable storage media include: electrical connection with one or more conductors, portable disk, hard disk, random access memory (RAM), read only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.
计算机可读信号介质可以包括在基带中或者作为载波一部分传播的数据信号,其中承载了可读程序代码。这种传播的数据信号可以采用多种形式,包括但不限于电磁信号、光信号或上述的任意合适的组合。可读信号介质还可以是可读存储介质以外的任何可读介质,该可读介质可以发送、传播或者传输用于由指令执行系统、装置或者器件使用或者与其结合使用的程序。A computer readable signal medium may include a data signal carrying readable program code in baseband or as part of a carrier wave. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. A readable signal medium may also be any readable medium other than a readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device.
可读介质上包含的程序代码可以用任何适当的介质传输,包括但不限于无线、有线、光缆、RF等等,或者上述的任意合适的组合。Program code embodied on a readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
可以以一种或多种程序设计语言的任意组合来编写用于执行本发明操作的程序代码,所述程序设计语言包括面向对象的程序设计语言—诸如Java、C++等,还包括常规的过程式程序设计语言—诸如“C”语言或类似的程序设计语言。程序代码可以完全地在用户计算设备上执行、部分地在用户设备上执行、作为一个独立的软件包执行、部分在用户计算设备上部分在远程计算设备上执行、或者完全在远程计算设备或服务器上执行。在涉及远程计算设备的情形中,远程计算设备可以通过任意种类的网络,包括局域网(LAN)或广域网(WAN),连接到用户计算设备,或者,可以连接到外部计算设备(例如利用因特网服务提供商来通过因特网连接)。Program code for carrying out the operations of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages—such as Java, C++, etc., as well as conventional procedural programming languages. Programming language - such as "C" or a similar programming language. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server to execute. In cases involving a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., using an Internet service provider). business to connect via the Internet).
此外,上述附图仅是根据本发明示例性实施例的方法所包括的处理的示意性说明,而不是限制目的。易于理解,上述附图所示的处理并不表明或限制这些处理的时间顺序。另外,也易于理解,这些处理可以是例如在多个模块中同步或异步执行的。In addition, the above-mentioned figures are only schematic illustrations of the processes included in the method according to the exemplary embodiments of the present invention, and are not intended to be limiting. It is easy to understand that the processes shown in the above figures do not imply or limit the chronological order of these processes. In addition, it is also easy to understand that these processes may be executed synchronously or asynchronously in multiple modules, for example.
本领域技术人员在考虑说明书及实践这里公开的发明后,将容易想到本公开的其它实施方案。本申请旨在涵盖本公开的任何变型、用途或者适应性变化,这些变型、用途或者适应性变化遵循本公开的一般性原理并包括本公开未公开的本技术领域中的公知常识或惯用技术手段。说明书和实施例仅被视为示例性的,本公开的真正范围和构思由权利要求指出。Other embodiments of the present disclosure will be readily apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any modification, use or adaptation of the present disclosure, and these modifications, uses or adaptations follow the general principles of the present disclosure and include common knowledge or conventional technical means in the technical field not disclosed in the present disclosure . The specification and examples are to be considered exemplary only, with the true scope and concept of the disclosure indicated by the appended claims.
Claims (13)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211512698.6A CN115829502A (en) | 2022-11-28 | 2022-11-28 | Machine inspection task display method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211512698.6A CN115829502A (en) | 2022-11-28 | 2022-11-28 | Machine inspection task display method and device and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115829502A true CN115829502A (en) | 2023-03-21 |
Family
ID=85532667
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211512698.6A Pending CN115829502A (en) | 2022-11-28 | 2022-11-28 | Machine inspection task display method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115829502A (en) |
-
2022
- 2022-11-28 CN CN202211512698.6A patent/CN115829502A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3806021A1 (en) | Commodity recommendation method, apparatus and system, and computer readable storage medium | |
| US9720912B2 (en) | Document management system, document management method, and document management program | |
| CN113761334A (en) | Visual recommendation method, device, equipment and storage medium | |
| US20210279411A1 (en) | Visual data mapping | |
| CN113705072B (en) | Data processing method, device, computer equipment and storage medium | |
| CN110647523B (en) | Data quality analysis method and device, storage medium and electronic equipment | |
| CN115098644A (en) | Image and text matching method and device, electronic equipment and storage medium | |
| CN110033284A (en) | Source of houses verification method, apparatus, equipment and storage medium | |
| CN115631374A (en) | Control operation method, control detection model training method, device and equipment | |
| CN111680165A (en) | Information matching method and device, readable storage medium and electronic equipment | |
| CN117522538A (en) | Bid information processing method, device, computer equipment and storage medium | |
| CN117094391B (en) | Method, device, computer equipment and storage medium for processing causal events | |
| CN115966274A (en) | Method and device for screening questionnaire questions, electronic equipment and storage medium | |
| CN120872809A (en) | Page detection method and device, electronic equipment and storage medium | |
| CN114140135A (en) | Work order intelligent analysis method and device, electronic equipment and storage medium | |
| CN117422519B (en) | Information processing method, information processing device, storage medium and electronic equipment | |
| CN119739987A (en) | Label system construction, label providing method, device, equipment and storage medium | |
| CN115829502A (en) | Machine inspection task display method and device and electronic equipment | |
| CN114895836B (en) | Touch control method and device based on intelligent full-flow data touch screen and electronic equipment | |
| CN114722789B (en) | Data report integrating method, device, electronic equipment and storage medium | |
| CN116542779A (en) | Product recommendation method, device, equipment and storage medium based on artificial intelligence | |
| CN116911769A (en) | ESG-based role-data interaction method, device, equipment and storage medium | |
| CN109710369B (en) | full-graphical user interface display method and device | |
| CN117149991A (en) | Demand determining method and electronic equipment | |
| CN112528112B (en) | Data collection and analysis method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |

