[go: up one dir, main page]

CN107016353B - A kind of integrated method and system of variable resolution target detection and identification - Google Patents

A kind of integrated method and system of variable resolution target detection and identification Download PDF

Info

Publication number
CN107016353B
CN107016353B CN201710147950.0A CN201710147950A CN107016353B CN 107016353 B CN107016353 B CN 107016353B CN 201710147950 A CN201710147950 A CN 201710147950A CN 107016353 B CN107016353 B CN 107016353B
Authority
CN
China
Prior art keywords
target
recognition
target detection
image
detection
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710147950.0A
Other languages
Chinese (zh)
Other versions
CN107016353A (en
Inventor
曹杰
郝群
王子寒
张芳华
肖宇晴
蒋阳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Institute of Technology BIT
Original Assignee
Beijing Institute of Technology BIT
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Institute of Technology BIT filed Critical Beijing Institute of Technology BIT
Priority to CN201710147950.0A priority Critical patent/CN107016353B/en
Publication of CN107016353A publication Critical patent/CN107016353A/en
Application granted granted Critical
Publication of CN107016353B publication Critical patent/CN107016353B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • G06F18/241Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2411Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on the proximity to a decision surface, e.g. support vector machines
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00Indexing scheme relating to image or video recognition or understanding
    • G06V2201/07Target detection

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • General Physics & Mathematics (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • General Engineering & Computer Science (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Multimedia (AREA)
  • Studio Devices (AREA)
  • Image Analysis (AREA)

Abstract

本发明公开的一种变分辨率目标探测与识别一体化的方法与系统,涉及探测与识别一体化的方法与系统,属于光学成像技术领域。本发明的方法包括如下步骤:根据变分辨率探测与识别一体化系统的当前状态设置CMOS相机的图像传感器分辨率模式;对采集的图像进行预处理,提高图像质量;根据系统的当前状态,对得到的图像进行目标探测或目标识别算法处理分别实现目标探测或识别;根据系统当前状态和得到的目标探测或目标识别结果,设置系统状态,直至实现一体化目标探测与识别。本发明还公开变分辨率探测与识别一体化的系统包括主控制模块、图像接口、CMOS相机、镜头。本发明要解决的技术问题是实现目标探测与识别一体化,具有精度高、体积小、鲁棒性强等优点。

The invention discloses an integrated method and system for variable resolution target detection and identification, relates to an integrated method and system for detection and identification, and belongs to the technical field of optical imaging. The method of the present invention comprises the steps of: setting the image sensor resolution mode of the CMOS camera according to the current state of the variable resolution detection and identification integrated system; preprocessing the collected image to improve the image quality; according to the current state of the system, The obtained images are processed by target detection or target recognition algorithms to realize target detection or recognition respectively; according to the current state of the system and the obtained target detection or target recognition results, the system status is set until the integrated target detection and recognition is realized. The invention also discloses an integrated system of variable resolution detection and identification, including a main control module, an image interface, a CMOS camera, and a lens. The technical problem to be solved by the invention is to realize the integration of target detection and recognition, which has the advantages of high precision, small volume, strong robustness and the like.

Description

一种变分辨率目标探测与识别一体化的方法与系统A method and system for integrating variable resolution target detection and recognition

技术领域technical field

本发明属于光学成像技术领域,特别是涉及一种变分辨率探测与识别一体化的方法与系统。The invention belongs to the technical field of optical imaging, and in particular relates to a method and system for integrating variable resolution detection and identification.

背景技术Background technique

目标探测与识别技术是对固定或移动目标的非接触测量,测量的信号中包含距离、位置、方位角或高度信息等,这种测量的装置可以是固定,也可以是运动的,而测量到的信号经过特殊的识别方法能正确地给出相关的信息。随着高灵敏探测器、图像传感器以及机器视觉的迅猛发展,相比较过去的探测识别技术,现在具有更远的探测距离及更精确的识别精度。因此,可广泛应用在监控、导航、航空、航天等领域。Target detection and recognition technology is a non-contact measurement of fixed or moving targets. The measured signal contains distance, position, azimuth or height information, etc. The measurement device can be fixed or moving, and the measurement to The signal can correctly give relevant information through a special identification method. With the rapid development of high-sensitivity detectors, image sensors and machine vision, compared with the past detection and recognition technology, it now has a longer detection distance and more precise recognition accuracy. Therefore, it can be widely used in monitoring, navigation, aviation, aerospace and other fields.

传统目标探测与识别是通过不同的探测器或传感器完成,虽然功能较为完善,但由于不同功能需要由不同的部件完成,导致系统体积庞大,集成度不高。随着诸多研究领域对目标探测与识别一体化的需求不断增加,要求目标探测、识别一体化系统具有精度高、体积小、鲁棒性强等优点。传统的依靠多个传感器集成的目标探测与识别系统已不能满足需求。Traditional target detection and recognition is accomplished through different detectors or sensors. Although the functions are relatively complete, because different functions need to be completed by different components, the system is bulky and the integration level is not high. With the increasing demand for the integration of target detection and recognition in many research fields, the integrated system of target detection and recognition is required to have the advantages of high precision, small size, and strong robustness. Traditional target detection and recognition systems relying on the integration of multiple sensors can no longer meet the needs.

发明内容Contents of the invention

为解决传统的多传感器目标探测与识别系统难以实现高度集成化和小型化的问题,本发明公开的一种变分辨率目标探测与识别一体化的方法与系统,要解决的技术问题是实现目标探测与识别一体化,具有精度高、体积小、鲁棒性强等优点。In order to solve the problem that the traditional multi-sensor target detection and recognition system is difficult to achieve high integration and miniaturization, the present invention discloses a method and system for the integration of variable resolution target detection and recognition. The technical problem to be solved is to realize the target The integration of detection and identification has the advantages of high precision, small size, and strong robustness.

本发明的目的是通过下述技术方案实现的:The purpose of the present invention is achieved through the following technical solutions:

本发明公开的一种变分辨率目标探测与识别一体化的方法,采用可变分辨率CMOS相机进行图像采集,并能够完成自动方式/手动方式两种目标探测与识别方法。其中自动方式的原理为:首先系统默认处于目标探测状态,由CMOS相机采用低分辨率模式,对视野内场景进行图像采集;然后采用目标探测算法判断视野内是否包含疑似目标;若发现疑似目标,则系统自动转换为目标识别状态,并由CMOS相机采用高分辨率模式,对视野内场景再次成像;然后采用目标识别算法判定,并根据目标识别结果,自动调整系统的下一时刻状态以及CMOS相机的分辨率模式,从而实现目标探测与识别的自动转换。手动方式的原理与自动方式区别在于,系统的状态(目标探测或目标识别)、CMOS相机的分辨率模式以及目标探测与目标识别的结果,均由操作者进行控制和判定。The invention discloses a variable-resolution target detection and recognition integrated method, which adopts a variable-resolution CMOS camera to collect images, and can complete two target detection and recognition methods of automatic mode/manual mode. The principle of the automatic mode is as follows: first, the system is in the target detection state by default, and the CMOS camera adopts a low-resolution mode to collect images of the scene in the field of view; then the target detection algorithm is used to judge whether there is a suspected target in the field of view; if a suspected target is found, Then the system automatically switches to the target recognition state, and the CMOS camera uses high-resolution mode to image the scene in the field of view again; then uses the target recognition algorithm to judge, and automatically adjusts the next moment state of the system and the CMOS camera according to the target recognition result. resolution mode, so as to realize the automatic conversion of target detection and recognition. The principle of the manual method differs from the automatic method in that the state of the system (target detection or target recognition), the resolution mode of the CMOS camera, and the results of target detection and target recognition are all controlled and judged by the operator.

为实现基于变分辨率目标探测与识别一体化,采用如下技术方案:In order to realize the integration of target detection and recognition based on variable resolution, the following technical solutions are adopted:

本发明公开的一种变分辨率目标探测与识别一体化的系统,包括主控制模块、图像接口、CMOS相机和镜头。其中主控制模块通过图像处理算法实现目标探测与识别,并根据目标探测与识别的结果实时控制CMOS相机的分辨率模式,所述的分辨率模式分为用于目标探测的低分辨率模式和用于目标识别的高分辨率模式。图像接口用于CMOS相机和主控制模块之间的数据传输。CMOS相机通过光电转换,对当前目标进行图像采集,且CMOS芯片需具有分辨率可调功能。镜头用于控制CMOS相机的视场角和成像距离。The invention discloses a variable resolution target detection and recognition integrated system, which includes a main control module, an image interface, a CMOS camera and a lens. The main control module realizes target detection and recognition through image processing algorithms, and controls the resolution mode of the CMOS camera in real time according to the results of target detection and recognition. The resolution mode is divided into a low-resolution mode for target detection and a low-resolution mode for High-resolution mode for object recognition. The image interface is used for data transmission between the CMOS camera and the main control module. The CMOS camera collects images of the current target through photoelectric conversion, and the CMOS chip needs to have the function of adjustable resolution. The lens is used to control the field of view and imaging distance of the CMOS camera.

本发明公开的一种变分辨率目标探测与识别一体化的方法,包括如下步骤:A method for integrating variable resolution target detection and recognition disclosed by the present invention includes the following steps:

步骤一:根据变分辨率探测与识别一体化系统的当前状态设置CMOS相机的图像传感器分辨率模式。Step 1: Set the image sensor resolution mode of the CMOS camera according to the current state of the variable resolution detection and recognition integrated system.

根据变分辨率探测与识别一体化的系统(以下简称系统)当前状态,设置CMOS相机的图像传感器分辨率模式。若系统处于目标探测状态,则设为低分辨率模式,所述的低分辨率模式通过合并相邻像素的方法实现;如系统处于目标识别状态,则设为高分辨率模式。According to the current state of the integrated system of variable resolution detection and identification (hereinafter referred to as the system), the resolution mode of the image sensor of the CMOS camera is set. If the system is in the state of target detection, it is set to a low-resolution mode, and the low-resolution mode is realized by combining adjacent pixels; if the system is in a state of target recognition, it is set to a high-resolution mode.

所述的变分辨率探测与识别一体化的系统包括主控制模块、图像接口、CMOS相机、镜头。其中主控制模块通过图像处理算法实现目标探测与识别,并根据目标探测与识别的结果实时控制CMOS相机的分辨率模式,所述的分辨率模式分为用于目标探测的低分辨率模式和用于目标识别的高分辨率模式。图像接口用于CMOS相机和主控制模块之间的数据传输。CMOS相机通过光电转换,对当前目标进行图像采集,且CMOS芯片需具有分辨率可调功能。镜头用于控制CMOS相机的视场角和成像距离。The integrated variable resolution detection and identification system includes a main control module, an image interface, a CMOS camera, and a lens. The main control module realizes target detection and recognition through image processing algorithms, and controls the resolution mode of the CMOS camera in real time according to the results of target detection and recognition. The resolution mode is divided into a low-resolution mode for target detection and a low-resolution mode for High-resolution mode for object recognition. The image interface is used for data transmission between the CMOS camera and the main control module. The CMOS camera collects images of the current target through photoelectric conversion, and the CMOS chip needs to have the function of adjustable resolution. The lens is used to control the field of view and imaging distance of the CMOS camera.

步骤二:对采集的图像进行预处理,以去除噪声,提高图像质量。Step 2: Preprocessing the collected images to remove noise and improve image quality.

步骤三:根据系统的当前状态,对步骤二得到的图像进行目标探测或目标识别算法处理分别实现目标探测或识别。Step 3: According to the current state of the system, perform target detection or target recognition algorithm processing on the image obtained in step 2 to realize target detection or recognition respectively.

若系统的当前状态为目标探测,则运行目标探测算法,实现目标探测。目标探测算法首先采用基于图论的视觉显著性模型(Graph-Based Visual Saliency,GBVS)实现图像的显著性分析,得到显著图,并利用区域生长法进行显著性区域分割,得到感兴趣区域;然后以感兴趣区域和目标模板图像的灰度直方图作为图像特征,计算归一化相关系数,其计算公式为:If the current state of the system is target detection, run the target detection algorithm to realize target detection. The target detection algorithm first uses the Graph-Based Visual Saliency (GBVS) model to realize the saliency analysis of the image, obtains the saliency map, and uses the region growing method to segment the saliency region to obtain the region of interest; and then Using the gray histogram of the region of interest and the target template image as image features, the normalized correlation coefficient is calculated, and its calculation formula is:

其中:α和β分别为感兴趣区域和模板的特征向量,分别为向量α和β的均值。由于灰度直方图特征对光照变化敏感,因此为提高系统对光照变化的鲁棒性,先利用相关匹配算法对两个向量进行配准,得到两个向量的最佳匹配位置,并根据该位置进行向量对准,再计算两个特征向量的归一化相关系数γ(α,β)。所得的归一化相关系数γ(α,β)用于判断是否存在疑似目标,即完成目标探测。Among them: α and β are the feature vectors of the region of interest and the template, respectively, and are the mean values of vectors α and β, respectively. Since the gray histogram feature is sensitive to illumination changes, in order to improve the robustness of the system to illumination changes, the correlation matching algorithm is used to register the two vectors to obtain the best matching position of the two vectors, and according to the position Perform vector alignment, and then calculate the normalized correlation coefficient γ(α, β) of the two feature vectors. The obtained normalized correlation coefficient γ(α, β) is used to judge whether there is a suspected target, that is, to complete target detection.

若系统的当前状态为目标识别,则运行目标识别算法,实现目标识别。目标识别算法首先对当前帧图像进行感兴趣区域分割,得到新的感兴趣区域;然后利用稀疏编码算法,对感兴趣区域进行稀疏编码,所得向量即为相应图像的特征向量;然后将特征向量输入到线下训练好的支持向量机,所得结果用于判断是否发现真实目标,即完成目标识别。If the current state of the system is target recognition, run the target recognition algorithm to realize target recognition. The target recognition algorithm first divides the region of interest of the current frame image to obtain a new region of interest; then uses the sparse coding algorithm to perform sparse coding on the region of interest, and the obtained vector is the feature vector of the corresponding image; then the feature vector is input Go to the support vector machine trained offline, and the obtained results are used to judge whether the real target is found, that is, to complete the target recognition.

步骤四:根据系统当前状态和步骤三得到的目标探测或目标识别结果,设置系统状态,直至基于变分辨率实现一体化目标探测与识别。Step 4: According to the current state of the system and the target detection or target recognition results obtained in Step 3, set the system state until the integrated target detection and recognition is realized based on variable resolution.

当系统处于目标探测状态时,如果步骤三的目标探测算法发现疑似目标,则系统进入目标识别状态,返回步骤一;若未发现疑似目标,则系统继续保持目标探测状态,返回步骤一。当系统处于目标识别状态时,若经过步骤三未发现真实目标,则系统进入目标探测状态,返回步骤一;如果发现真实目标,则系统进入目标跟踪任务或其他任务,即基于变分辨率实现一体化目标探测与识别。When the system is in the target detection state, if the target detection algorithm in step three finds a suspected target, the system enters the target recognition state and returns to step one; if no suspected target is found, the system continues to maintain the target detection state and returns to step one. When the system is in the target recognition state, if no real target is found after step 3, the system will enter the target detection state and return to step 1; if a real target is found, the system will enter the target tracking task or other tasks, that is, realize integration based on variable resolution Target detection and recognition.

步骤三所述的目标探测或目标识别的结果通过自动方式或手动方式判断是否存在疑似目标或真实目标。The result of the target detection or target recognition described in step three is judged automatically or manually whether there is a suspected target or a real target.

通过自动方式判断是否存在疑似目标或真实目标具体实现方法为:对于目标探测,按所述目标探测算法得到归一化相关系数,并将其与预设的阈值做对比,所得结果作为唯一分类标准,自动判断是否发现疑似目标;对于目标识别,首先利用上一帧图像的感兴趣区域轮廓提取当前帧的感兴趣区域,然后按照所述目标识别算法,得到支持向量机的输出结果,并将其作为唯一分类标准,自动判断是否发现真实目标,即实现自动方式判断是否存在疑似目标或真实目标。The specific implementation method for judging whether there is a suspected target or a real target by automatic means is as follows: for target detection, the normalized correlation coefficient is obtained according to the target detection algorithm, and compared with the preset threshold, and the obtained result is used as the only classification standard , to automatically determine whether a suspected target is found; for target recognition, firstly, the region of interest of the current frame is extracted using the contour of the region of interest of the previous frame image, and then according to the target recognition algorithm, the output result of the support vector machine is obtained, and its As the only classification standard, it automatically judges whether a real target is found, that is, realizes an automatic way to judge whether there is a suspected target or a real target.

通过自动方式判断是否存在疑似目标或真实目标,由于系统每次进入目标识别状态只处理单帧图像便转换为其它状态,因此简化了目标识别的感兴趣区域提取算法,提高了系统效率,此外系统的分辨率和工作状态可实现自动切换,提高了系统的智能性。By automatically judging whether there is a suspected target or a real target, since the system only processes a single frame of image each time it enters the target recognition state and then converts to other states, it simplifies the algorithm for extracting regions of interest for target recognition and improves system efficiency. In addition, the system The resolution and working status can be automatically switched, which improves the intelligence of the system.

通过手动方式判断是否存在疑似目标或真实目标具体实现方法为:对于目标探测,按所述目标探测算法得到归一化相关系数,并将该系数作为辅助分类标准显示到图像上,最终由操作者决定是否发现疑似目标;对于目标识别,首先利用如上所述的视觉显著性模型和区域生长法提取感兴趣区域,再用稀疏编码算法得到特征向量,然后输入到线下训练好的支持向量机并得到其计算结果,并将该结果作为辅助分类标准显示到图像上,最终由操作者决定是否发现真实目标,即实现手动方式判断是否存在疑似目标或真实目标。The specific implementation method of manually judging whether there is a suspected target or a real target is as follows: for target detection, the normalized correlation coefficient is obtained according to the target detection algorithm, and the coefficient is displayed on the image as an auxiliary classification standard, and finally the operator Decide whether to find a suspected target; for target recognition, first use the above-mentioned visual saliency model and region growing method to extract the region of interest, then use the sparse coding algorithm to obtain the feature vector, and then input it into the offline trained support vector machine and The calculation result is obtained, and the result is displayed on the image as an auxiliary classification standard, and finally the operator decides whether to find a real target, that is, to manually judge whether there is a suspected target or a real target.

通过手动方式判断是否存在疑似目标或真实目标,该方法不仅充分利用线下训练的先验知识,而且结合了操作者特有的先验知识,降低系统误差,弥补了线下训练的先验知识不足的缺陷,提高了系统的鲁棒性和精度。By manually judging whether there is a suspected target or a real target, this method not only makes full use of the prior knowledge of offline training, but also combines the operator's unique prior knowledge to reduce system errors and make up for the lack of prior knowledge of offline training. defects, improving the robustness and accuracy of the system.

所述的步骤三目标识别算法的具体实现方法包括如下步骤:The concrete realization method of described step three target identification algorithm comprises the following steps:

由于采用支持向量机作为目标识别分类器,因此目标识别的具体实现由线下训练和线上测试两部分组成。目标识别线下训练的过程具体方法如下:Since the support vector machine is used as the target recognition classifier, the specific realization of the target recognition consists of two parts: offline training and online testing. The specific method of target recognition offline training process is as follows:

步骤(1):对含标签的所有训练集图像采用同上所述的显著性分析算法进行处理。Step (1): All the images in the training set with labels are processed using the same saliency analysis algorithm as described above.

步骤(2):采用同上所述的区域生长法,对训练集图像进行显著性区域提取,得到训练集感兴趣区域。Step (2): Using the same region growing method as above, extract the salient region of the training set image to obtain the region of interest in the training set.

步骤(3):利用稀疏编码算法,对所得到的各个训练集感兴趣区域进行稀疏编码,所得向量即为相应图像的特征向量。Step (3): Using the sparse coding algorithm, perform sparse coding on the regions of interest in each training set obtained, and the obtained vectors are the feature vectors of the corresponding images.

步骤(4):将步骤(3)所得的特征向量及其相应的标签作为输入,训练支持向量机,并将训练好的支持向量机作为线上测试的目标识别分类器。Step (4): Take the feature vector and its corresponding label obtained in step (3) as input, train the support vector machine, and use the trained support vector machine as the object recognition classifier for the online test.

目标识别的线上测试流程具体方法如下:The specific method of the online test process of target recognition is as follows:

步骤(1):对步骤二所得图像进行显著性区域提取,得到感兴趣区域。Step (1): Extract the salient region from the image obtained in step 2 to obtain the region of interest.

步骤(2):对步骤(1)中得到的感兴趣区域,采用如上所述的稀疏编码算法,得到感兴趣区域的特征向量。Step (2): For the region of interest obtained in step (1), use the above-mentioned sparse coding algorithm to obtain the feature vector of the region of interest.

步骤(3):将步骤(2)中所得的特征向量输入训练好的支持向量机,得到输出结果。Step (3): Input the feature vector obtained in step (2) into the trained support vector machine to obtain the output result.

步骤(4):基于步骤(3)所得的输出结果,采用自动方式或手动方式判断是否存在疑似目标或真实目标。Step (4): Based on the output result obtained in step (3), whether there is a suspected target or a real target is judged by automatic or manual means.

有益效果:Beneficial effect:

1、本发明公开的一种变分辨率探测与识别一体化的方法与系统,可根据不同需求,通过对定分辨率图像传感器进行像素合并满足探测与识别需求,具有精度高、体积小、鲁棒性强等优点。自动方式和手动方式相结合的方法进行目标存在与否的判定,能够提高系统的效率,且能够弥补单纯的自动方式先验知识不完备的缺陷,提高目标探测和识别精度;利用可变分辨率图像传感器实现探测与识别一体化的方法,简化目标探测和识别系统的结构,有利于系统的小型化;所设计的基于灰度直方图的目标探测算法对光照变化引起的特征变化具有鲁棒性。1. A method and system for the integration of variable resolution detection and recognition disclosed in the present invention can meet the detection and recognition requirements by performing pixel combination on fixed resolution image sensors according to different requirements, and has high precision, small size, and robustness. Strong stick and other advantages. The combination of automatic and manual methods to determine the existence of targets can improve the efficiency of the system, and can make up for the incomplete prior knowledge of the simple automatic method, improving the accuracy of target detection and recognition; using variable resolution The image sensor realizes the integration of detection and recognition, simplifies the structure of the target detection and recognition system, and is conducive to the miniaturization of the system; the designed target detection algorithm based on the gray histogram is robust to the characteristic changes caused by the illumination changes .

2、本发明公开的一种变分辨率探测与识别一体化的方法与系统,具有手动与自动模式,手动模式可与具有先验知识的成像对接,自动模式可与不具有先验知识或者通过线下训练的图像数据库对接,因此,本发明系统扩展性良好,易于升级。2. A method and system for integrating variable resolution detection and recognition disclosed in the present invention has manual and automatic modes. The manual mode can be connected with imaging with prior knowledge, and the automatic mode can be connected with imaging without prior knowledge or through The image database for offline training is docked, so the system of the present invention has good scalability and is easy to upgrade.

3、本发明公开的一种变分辨率探测与识别一体化的方法与系统,可自适应从目标探测到识别过渡,亦可只工作在探测或者识别模式,具有更强的通用性。3. A method and system for integrating variable resolution detection and recognition disclosed in the present invention can adapt to the transition from target detection to recognition, and can also only work in detection or recognition mode, which has stronger versatility.

附图说明Description of drawings

图1为本发明公开的一种变分辨率探测与识别一体化的系统结构图;Fig. 1 is a system structure diagram of the integration of variable resolution detection and identification disclosed by the present invention;

图2为本发明公开的一种变分辨率探测与识别一体化的系统的工作流程图;Fig. 2 is a working flow chart of a system integrating variable resolution detection and identification disclosed by the present invention;

图3为探测子模块流程图;Fig. 3 is the detection sub-module flowchart;

图4为识别子模块流程图;Fig. 4 is the identification sub-module flowchart;

图5为原分辨率采样示意图;Figure 5 is a schematic diagram of original resolution sampling;

图6为变分辨率采样示意图(2×2);Fig. 6 is a schematic diagram of variable resolution sampling (2×2);

图7为变分辨率采样示意图(4×4)。Fig. 7 is a schematic diagram of variable resolution sampling (4×4).

其中:1-主控制模块,2-图像接口,3-CMOS相机,4-镜头。Among them: 1-main control module, 2-image interface, 3-CMOS camera, 4-lens.

具体实施方式Detailed ways

以下结合附图对本发明的具体实施方式进行说明。Specific embodiments of the present invention will be described below in conjunction with the accompanying drawings.

实施例1:Example 1:

本实施例利用自动方式实现一种变分辨率目标探测与识别一体化的方法与系统。In this embodiment, an automatic method is used to realize a method and system for integrating variable resolution target detection and recognition.

如图1所示,本实施例公开的一种变分辨率目标探测与识别一体化的系统包括主控制模块1、图像接口2、CMOS相机3、和镜头4。其中主控制模块1用于实现目标探测与识别,以及实时控制CMOS相机3的分辨率模式。CMOS相机3的图像传感器应具有像素合并功能,本实施例采用的图像传感器型号为MT9V032。As shown in FIG. 1 , a variable resolution target detection and recognition integrated system disclosed in this embodiment includes a main control module 1 , an image interface 2 , a CMOS camera 3 , and a lens 4 . The main control module 1 is used to realize target detection and recognition, and to control the resolution mode of the CMOS camera 3 in real time. The image sensor of the CMOS camera 3 should have a pixel merging function, and the image sensor model adopted in this embodiment is MT9V032.

如图2所示,本实施例利用自动方式实现一种变分辨率目标探测与识别一体化的方法,包括如下步骤:As shown in Figure 2, this embodiment uses an automatic method to realize a method for integrating variable resolution target detection and recognition, including the following steps:

步骤一:根据变分辨率探测与识别一体化的系统当前状态设置CMOS相机3的图像传感器分辨率模式。Step 1: Set the resolution mode of the image sensor of the CMOS camera 3 according to the current state of the integrated system of variable resolution detection and identification.

根据变分辨率探测与识别一体化的系统(以下简称系统)当前状态,设置CMOS相机3的图像传感器分辨率模式。若系统处于目标探测状态,则设为低分辨率模式,所述的低分辨率模式通过合并相邻像素的方法实现;如系统处于目标识别状态,则设为高分辨率模式。According to the current state of the integrated system of variable resolution detection and recognition (hereinafter referred to as the system), the resolution mode of the image sensor of the CMOS camera 3 is set. If the system is in the state of target detection, it is set to a low-resolution mode, and the low-resolution mode is realized by combining adjacent pixels; if the system is in a state of target recognition, it is set to a high-resolution mode.

所述的变分辨率探测与识别一体化的系统包括主控制模块1、图像接口2、CMOS相机3、镜头4。其中主控制模块1通过图像处理算法实现目标探测与识别,并根据目标探测与识别的结果实时控制CMOS相机3的分辨率模式,所述的分辨率模式分为用于目标探测的低分辨率模式和用于目标识别的高分辨率模式。图像接口用于CMOS相机3和主控制模块1之间的数据传输。CMOS相机3通过光电转换,对当前目标进行图像采集,且CMOS芯片需具有分辨率可调功能。镜头用于控制CMOS相机3的视场角和成像距离。The integrated variable resolution detection and recognition system includes a main control module 1 , an image interface 2 , a CMOS camera 3 , and a lens 4 . Wherein the main control module 1 realizes target detection and recognition through an image processing algorithm, and controls the resolution mode of the CMOS camera 3 in real time according to the result of target detection and recognition, and the resolution mode is divided into a low-resolution mode for target detection and a high-resolution mode for object recognition. The image interface is used for data transmission between the CMOS camera 3 and the main control module 1 . The CMOS camera 3 collects images of the current target through photoelectric conversion, and the CMOS chip needs to have a resolution-adjustable function. The lens is used to control the field of view and imaging distance of the CMOS camera 3 .

步骤二:对采集的图像进行预处理,以去除噪声,提高图像质量。Step 2: Preprocessing the collected images to remove noise and improve image quality.

步骤三:根据系统的当前状态,对步骤二得到的图像进行目标探测或目标识别算法处理分别实现目标探测或识别。Step 3: According to the current state of the system, perform target detection or target recognition algorithm processing on the image obtained in step 2 to realize target detection or recognition respectively.

若系统的当前状态为目标探测,则运行目标探测算法,实现目标探测。目标探测算法首先采用如上所述的视觉显著性模型实现图像的显著性分析,得到显著图,并利用区域生长法进行显著性区域分割,得到感兴趣区域;然后以感兴趣区域和目标模板图像的灰度直方图作为图像特征,计算归一化相关系数,其计算公式为:If the current state of the system is target detection, run the target detection algorithm to realize target detection. The target detection algorithm first uses the above-mentioned visual saliency model to realize the saliency analysis of the image, obtains the saliency map, and uses the region growing method to segment the saliency region to obtain the region of interest; then the region of interest and the target template image The gray histogram is used as an image feature to calculate the normalized correlation coefficient. The calculation formula is:

其中:α和β分别为感兴趣区域和模板的特征向量,分别为向量α和β的均值。由于灰度直方图特征对光照变化敏感,因此为提高系统对光照变化的鲁棒性,先利用相关匹配算法对两个向量进行配准,得到两个向量的最佳匹配位置,并根据该位置进行向量对准,再计算两个特征向量的归一化相关系数γ(α,β)。所得的归一化相关系数γ(α,β)用于判断是否存在疑似目标,即完成目标探测。Among them: α and β are the feature vectors of the region of interest and the template, respectively, and are the mean values of vectors α and β, respectively. Since the gray histogram feature is sensitive to illumination changes, in order to improve the robustness of the system to illumination changes, the correlation matching algorithm is used to register the two vectors to obtain the best matching position of the two vectors, and according to the position Perform vector alignment, and then calculate the normalized correlation coefficient γ(α, β) of the two feature vectors. The obtained normalized correlation coefficient γ(α, β) is used to judge whether there is a suspected target, that is, to complete target detection.

若系统的当前状态为目标识别,则运行目标识别算法,实现目标识别。目标识别算法先将上一帧图像的感兴趣区域轮廓映射到当前图像,以实现显著性区域分割,得到感兴趣区域;然后利用稀疏编码算法,对感兴趣区域进行稀疏编码,所得向量即为相应图像的特征向量;然后将特征向量输入到线下训练好的支持向量机,利用所得结果自动判断是否发现真实目标,即完成目标识别。If the current state of the system is target recognition, run the target recognition algorithm to realize target recognition. The object recognition algorithm first maps the contour of the region of interest of the previous frame image to the current image to achieve the segmentation of the salient region and obtain the region of interest; then use the sparse coding algorithm to sparsely encode the region of interest, and the obtained vector is the corresponding The feature vector of the image; then input the feature vector to the offline trained support vector machine, and use the obtained results to automatically judge whether the real target is found, that is, to complete the target recognition.

步骤四:根据系统当前状态和步骤三得到的目标探测或目标识别结果,设置系统状态。Step 4: Set the system status according to the current status of the system and the target detection or target recognition results obtained in Step 3.

当系统处于目标探测状态时,如果步骤三的目标探测算法发现疑似目标,则系统进入目标识别状态,返回步骤一;若未发现疑似目标,则系统继续保持目标探测状态,返回步骤一。当系统处于目标识别状态时,若经过步骤三未发现真实目标,则系统进入目标探测状态,返回步骤一;如果发现真实目标,则系统进入目标跟踪任务或其他任务,即基于变分辨率实现一体化目标探测与识别。When the system is in the target detection state, if the target detection algorithm in step three finds a suspected target, the system enters the target recognition state and returns to step one; if no suspected target is found, the system continues to maintain the target detection state and returns to step one. When the system is in the target recognition state, if no real target is found after step 3, the system will enter the target detection state and return to step 1; if a real target is found, the system will enter the target tracking task or other tasks, that is, realize integration based on variable resolution Target detection and recognition.

实施例2:Example 2:

本发明利用手动方式实现一种变分辨率目标探测与识别一体化的方法与系统。The present invention uses a manual method to realize a method and system for integrating variable resolution target detection and recognition.

如图1所示,本实施例公开的一种变分辨率目标探测与识别一体化的系统包括主控制模块1、图像接口2、CMOS相机3、和镜头4。其中主控制模块1用于实现目标探测与识别,以及实时控制CMOS相机3的分辨率模式。CMOS相机3的图像传感器应具有像素合并功能,本实施例采用的图像传感器型号为MT9V032。As shown in FIG. 1 , a variable resolution target detection and recognition integrated system disclosed in this embodiment includes a main control module 1 , an image interface 2 , a CMOS camera 3 , and a lens 4 . The main control module 1 is used to realize target detection and recognition, and to control the resolution mode of the CMOS camera 3 in real time. The image sensor of the CMOS camera 3 should have a pixel merging function, and the image sensor model adopted in this embodiment is MT9V032.

如图2所示,本实施例利用手动方式实现一种变分辨率目标探测与识别一体化的方法,包括如下步骤:As shown in Figure 2, this embodiment uses a manual method to implement a method for integrating variable resolution target detection and recognition, including the following steps:

步骤一:根据变分辨率探测与识别一体化的系统当前状态设置CMOS相机3的图像传感器分辨率模式。Step 1: Set the resolution mode of the image sensor of the CMOS camera 3 according to the current state of the integrated system of variable resolution detection and recognition.

根据变分辨率探测与识别一体化的系统(以下简称系统)当前状态,设置CMOS相机3的图像传感器分辨率模式。若系统处于目标探测状态,则设为低分辨率模式,所述的低分辨率模式通过合并相邻像素的方法实现;如系统处于目标识别状态,则设为高分辨率模式。According to the current state of the integrated system of variable resolution detection and recognition (hereinafter referred to as the system), the resolution mode of the image sensor of the CMOS camera 3 is set. If the system is in the state of target detection, it is set to a low-resolution mode, and the low-resolution mode is realized by combining adjacent pixels; if the system is in a state of target recognition, it is set to a high-resolution mode.

所述的变分辨率探测与识别一体化的系统包括主控制模块1、图像接口2、CMOS相机3、镜头4。其中主控制模块1通过图像处理算法实现目标探测与识别,并根据目标探测与识别的结果实时控制CMOS相机3的分辨率模式,所述的分辨率模式分为用于目标探测的低分辨率模式和用于目标识别的高分辨率模式。图像接口用于CMOS相机3和主控制模块1之间的数据传输。CMOS相机3通过光电转换,对当前目标进行图像采集,且CMOS芯片需具有分辨率可调功能。镜头用于控制CMOS相机3的视场角和成像距离。The integrated variable resolution detection and recognition system includes a main control module 1 , an image interface 2 , a CMOS camera 3 , and a lens 4 . Wherein the main control module 1 realizes target detection and recognition through an image processing algorithm, and controls the resolution mode of the CMOS camera 3 in real time according to the result of target detection and recognition, and the resolution mode is divided into a low-resolution mode for target detection and a high-resolution mode for object recognition. The image interface is used for data transmission between the CMOS camera 3 and the main control module 1 . The CMOS camera 3 collects images of the current target through photoelectric conversion, and the CMOS chip needs to have a resolution-adjustable function. The lens is used to control the field of view and imaging distance of the CMOS camera 3 .

步骤二:对采集的图像进行预处理,以去除噪声,提高图像质量。Step 2: Preprocessing the collected images to remove noise and improve image quality.

步骤三:根据系统的当前状态,对步骤二得到的图像进行目标探测或目标识别算法处理分别实现目标探测或识别。Step 3: According to the current state of the system, perform target detection or target recognition algorithm processing on the image obtained in step 2 to realize target detection or recognition respectively.

若系统的当前状态为目标探测,则运行目标探测算法,实现目标探测。目标探测算法首先采用如上所述的视觉显著性模型实现图像的显著性分析,得到显著图,并利用区域生长法进行显著性区域分割,得到感兴趣区域;然后以感兴趣区域和目标模板图像的灰度直方图作为图像特征,计算归一化相关系数,其计算公式为:If the current state of the system is target detection, run the target detection algorithm to realize target detection. The target detection algorithm first uses the above-mentioned visual saliency model to realize the saliency analysis of the image, obtains the saliency map, and uses the region growing method to segment the saliency region to obtain the region of interest; then the region of interest and the target template image The gray histogram is used as an image feature to calculate the normalized correlation coefficient. The calculation formula is:

其中:α和β分别为感兴趣区域和模板的特征向量,分别为向量α和β的均值。由于灰度直方图特征对光照变化敏感,因此为提高系统对光照变化的鲁棒性,先利用相关匹配算法对两个向量进行配准,得到两个向量的最佳匹配位置,并根据该位置进行向量对准,再计算两个特征向量的归一化相关系数γ(α,β)。将所得的归一化相关系数γ(α,β)与预设的阈值进行对比,并将对比结果显示到图像上,由操作者判定是否发现疑似目标,即完成目标探测。Among them: α and β are the feature vectors of the region of interest and the template, respectively, and are the mean values of vectors α and β, respectively. Since the gray histogram feature is sensitive to illumination changes, in order to improve the robustness of the system to illumination changes, the correlation matching algorithm is used to register the two vectors to obtain the best matching position of the two vectors, and according to the position Perform vector alignment, and then calculate the normalized correlation coefficient γ(α, β) of the two feature vectors. The obtained normalized correlation coefficient γ(α, β) is compared with the preset threshold, and the comparison result is displayed on the image, and the operator determines whether a suspected target is found, that is, the target detection is completed.

若系统的当前状态为目标识别,则运行目标识别算法,实现目标识别。目标识别算法先利用如上所述的视觉显著性模型和区域生长法对图像进行显著性区域分割,得到感兴趣区域;然后利用稀疏编码算法,对感兴趣区域进行稀疏编码,所得向量即为相应图像的特征向量;然后将特征向量输入到线下训练好的支持向量机,当所得结果为真实目标时,则在图像中用绿色轮廓标注该感兴趣区域,否则用红色轮廓标注。对于是否发现真实目标由操作者进行判定,即完成目标识别。If the current state of the system is target recognition, run the target recognition algorithm to realize target recognition. The target recognition algorithm first uses the above-mentioned visual saliency model and region growing method to segment the salient region of the image to obtain the region of interest; then uses the sparse coding algorithm to perform sparse coding on the region of interest, and the obtained vector is the corresponding image The eigenvector; then input the eigenvector to the offline trained support vector machine, when the obtained result is a real target, mark the region of interest in the image with a green outline, otherwise mark it with a red outline. It is up to the operator to judge whether the real target is found, that is, target recognition is completed.

步骤四:根据系统当前状态和步骤三得到的目标探测或目标识别结果,设置系统状态。Step 4: Set the system status according to the current status of the system and the target detection or target recognition results obtained in Step 3.

当系统处于目标探测状态时,如果步骤三中操作者判定发现疑似目标,则系统进入目标识别状态,返回步骤一;如果操作者判定未发现疑似目标,或操作者未做出判定,则系统继续保持目标探测状态,返回步骤一。当系统处于目标识别状态时,如果操作者未做出判定,则系统继续保持目标识别状态,返回步骤一;如果步骤三中操作者判定未发现真实目标,则系统进入目标探测状态,返回步骤一;如果操作者判定发现真实目标,则系统进入目标跟踪任务或其他任务,即实现基于变分辨率的一体化目标探测与识别。When the system is in the target detection state, if the operator determines that a suspected target is found in step 3, the system enters the target recognition state and returns to step 1; if the operator determines that no suspected target is found, or the operator does not make a judgment, the system continues Keep the target detection state and return to step 1. When the system is in the target recognition state, if the operator does not make a judgment, the system will continue to maintain the target recognition state and return to step 1; if the operator determines in step 3 that no real target has been found, the system will enter the target detection state and return to step 1 ; If the operator determines that a real target is found, the system enters the target tracking task or other tasks, that is, the integrated target detection and recognition based on variable resolution is realized.

以上仅为本发明的较佳实例而已,并非用于限定本发明的保护范围。凡在本发明的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。The above are only preferred examples of the present invention, and are not intended to limit the protection scope of the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention shall be included within the protection scope of the present invention.

Claims (5)

1.一种变分辨率目标探测与识别一体化的方法,其特征在于:包括如下步骤:1. A method for variable resolution target detection and recognition integration, characterized in that: comprise the steps: 步骤一:根据变分辨率探测与识别一体化系统的当前状态设置CMOS相机(3)的图像传感器分辨率模式;Step 1: set the image sensor resolution mode of the CMOS camera (3) according to the current state of the variable resolution detection and identification integrated system; 根据变分辨率探测与识别一体化的系统(以下简称系统)当前状态,设置CMOS相机(3)的图像传感器分辨率模式;若系统处于目标探测状态,则设为低分辨率模式,所述的低分辨率模式通过合并相邻像素的方法实现;如系统处于目标识别状态,则设为高分辨率模式;According to the current state of the integrated system (hereinafter referred to as the system) of variable resolution detection and identification, the image sensor resolution mode of the CMOS camera (3) is set; if the system is in the target detection state, it is set as the low resolution mode, and the described The low-resolution mode is realized by merging adjacent pixels; if the system is in the target recognition state, it is set to high-resolution mode; 步骤二:对采集的图像进行预处理,以去除噪声,提高图像质量;Step 2: Preprocessing the collected images to remove noise and improve image quality; 步骤三:根据系统的当前状态,对步骤二得到的图像进行目标探测或目标识别算法处理分别实现目标探测或识别;Step 3: According to the current state of the system, perform target detection or target recognition algorithm processing on the image obtained in step 2 to realize target detection or recognition respectively; 若系统的当前状态为目标探测,则运行目标探测算法,实现目标探测;目标探测算法首先采用基于图论的视觉显著性模型(Graph-Based Visual Saliency,GBVS)实现图像的显著性分析,得到显著图,并利用区域生长法进行显著性区域分割,得到感兴趣区域;然后以感兴趣区域和目标模板图像的灰度直方图作为图像特征,计算归一化相关系数,其计算公式为:If the current state of the system is target detection, run the target detection algorithm to achieve target detection; the target detection algorithm first uses the Graph-Based Visual Saliency Model (Graph-Based Visual Saliency, GBVS) to realize the saliency analysis of the image, and obtain the saliency , and use the region growing method to segment the salient region to obtain the region of interest; then use the gray histogram of the region of interest and the target template image as image features to calculate the normalized correlation coefficient, and the calculation formula is: 其中:α和β分别为感兴趣区域和模板的特征向量,分别为向量α和β的均值;由于灰度直方图特征对光照变化敏感,因此为提高系统对光照变化的鲁棒性,先利用相关匹配算法对两个向量进行配准,得到两个向量的最佳匹配位置,并根据该位置进行向量对准,再计算两个特征向量的归一化相关系数γ(α,β);所得的归一化相关系数γ(α,β)用于判断是否存在疑似目标,即完成目标探测;Among them: α and β are the feature vectors of the region of interest and the template, respectively, and are the mean values of vectors α and β, respectively; since the gray histogram feature is sensitive to illumination changes, in order to improve the robustness of the system to illumination changes, first use the correlation matching algorithm to register the two vectors, and obtain the two vectors The best matching position, and vector alignment according to the position, and then calculate the normalized correlation coefficient γ(α, β) of the two feature vectors; the obtained normalized correlation coefficient γ(α, β) is used to judge whether If there is a suspected target, the target detection is completed; 若系统的当前状态为目标识别,则运行目标识别算法,实现目标识别;目标识别算法首先提取输入图像的显著性区域分割,得到新的感兴趣区域;然后利用稀疏编码算法,对感兴趣区域进行稀疏编码,所得向量即为相应图像的特征向量;然后将特征向量输入到线下训练好的支持向量机,所得结果用于判断是否发现真实目标,即完成目标识别;If the current state of the system is target recognition, run the target recognition algorithm to achieve target recognition; the target recognition algorithm first extracts the salient region segmentation of the input image to obtain a new region of interest; Sparse coding, the obtained vector is the feature vector of the corresponding image; then the feature vector is input to the support vector machine trained offline, and the obtained result is used to judge whether the real target is found, that is, to complete the target recognition; 步骤四:根据系统当前状态和步骤三得到的目标探测或目标识别结果,设置系统状态,直至基于变分辨率实现一体化目标探测与识别;Step 4: According to the current state of the system and the target detection or target recognition results obtained in Step 3, set the system state until the integrated target detection and recognition is realized based on variable resolution; 当系统处于目标探测状态时,如果步骤三的目标探测算法发现疑似目标,则系统进入目标识别状态,返回步骤一;若未发现疑似目标,则系统继续保持目标探测状态,返回步骤一;当系统处于目标识别状态时,若经过步骤三未发现真实目标,则系统进入目标探测状态,返回步骤一;如果发现真实目标,则系统进入目标跟踪任务,即基于变分辨率实现一体化目标探测与识别。When the system is in the target detection state, if the target detection algorithm in step 3 finds a suspected target, the system enters the target recognition state and returns to step 1; if no suspected target is found, the system continues to maintain the target detection state and returns to step 1; when the system When in the target recognition state, if no real target is found after step 3, the system enters the target detection state and returns to step 1; if a real target is found, the system enters the target tracking task, that is, realizes integrated target detection and recognition based on variable resolution . 2.根据权利要求1所述的一种变分辨率目标探测与识别一体化的方法,其特征在于:2. A method for integrating variable resolution target detection and recognition according to claim 1, characterized in that: 步骤一所述的变分辨率探测与识别一体化的系统包括主控制模块(1)、图像接口(2)、CMOS相机(3)、镜头(4);其中主控制模块(1)通过图像处理算法实现目标探测与识别,并根据目标探测与识别的结果实时控制CMOS相机(3)的分辨率模式,所述的分辨率模式分为用于目标探测的低分辨率模式和用于目标识别的高分辨率模式;图像接口(2)用于CMOS相机(3)和主控制模块(1)之间的数据传输;CMOS相机(3)通过光电转换,对当前目标进行图像采集,且CMOS芯片需具有分辨率可调功能;镜头用于控制CMOS相机(2)的视场角和成像距离。The integrated system of variable resolution detection and identification described in step 1 includes a main control module (1), an image interface (2), a CMOS camera (3), and a lens (4); wherein the main control module (1) passes the image processing The algorithm realizes target detection and recognition, and controls the resolution mode of the CMOS camera (3) in real time according to the results of target detection and recognition. The resolution mode is divided into a low-resolution mode for target detection and a low-resolution mode for target recognition. High-resolution mode; the image interface (2) is used for data transmission between the CMOS camera (3) and the main control module (1); the CMOS camera (3) collects images of the current target through photoelectric conversion, and the CMOS chip needs to It has an adjustable resolution function; the lens is used to control the viewing angle and imaging distance of the CMOS camera (2). 3.根据权利要求1或2所述的一种变分辨率目标探测与识别一体化的方法,其特征在于:3. A method for integrating variable resolution target detection and recognition according to claim 1 or 2, characterized in that: 步骤三所述的目标探测或目标识别的结果通过自动方式或手动方式判断是否存在疑似目标或真实目标;The result of target detection or target recognition described in step 3 is judged whether there is a suspected target or a real target by automatic or manual means; 通过自动方式判断是否存在疑似目标或真实目标具体实现方法为:对于目标探测,按所述目标探测算法得到归一化相关系数,并将其与预设的阈值做对比,所得结果作为唯一分类标准,自动判断是否发现疑似目标;对于目标识别,首先利用上一帧图像的感兴趣区域轮廓提取当前帧的感兴趣区域,然后按照所述目标探测算法,得到支持向量机的输出结果,并将其作为唯一分类标准,自动判断是否发现真实目标,即实现自动方式判断是否存在疑似目标或真实目标;The specific implementation method for judging whether there is a suspected target or a real target by automatic means is as follows: for target detection, the normalized correlation coefficient is obtained according to the target detection algorithm, and compared with the preset threshold, and the obtained result is used as the only classification standard , to automatically determine whether a suspected target is found; for target recognition, firstly, the region of interest of the current frame is extracted using the region of interest contour of the previous frame image, and then according to the target detection algorithm, the output result of the support vector machine is obtained, and its As the only classification standard, it automatically judges whether a real target is found, that is, realizes an automatic way to judge whether there is a suspected target or a real target; 通过手动方式判断是否存在疑似目标或真实目标具体实现方法为:对于目标探测,按所述目标探测算法得到归一化相关系数,并将该系数作为辅助分类标准显示到图像上,最终由操作者决定是否发现疑似目标;对于目标识别,首先利用如上所述的视觉显著性模型和区域生长法提取感兴趣区域,再用稀疏编码算法得到特征向量,然后输入到线下训练好的支持向量机并得到其计算结果,并将该结果作为辅助分类标准显示到图像上,最终由操作者决定是否发现真实目标,即实现手动方式判断是否存在疑似目标或真实目标。The specific implementation method of manually judging whether there is a suspected target or a real target is as follows: for target detection, the normalized correlation coefficient is obtained according to the target detection algorithm, and the coefficient is displayed on the image as an auxiliary classification standard, and finally the operator Decide whether to find a suspected target; for target recognition, first use the above-mentioned visual saliency model and region growing method to extract the region of interest, then use the sparse coding algorithm to obtain the feature vector, and then input it into the offline trained support vector machine and The calculation result is obtained, and the result is displayed on the image as an auxiliary classification standard, and finally the operator decides whether to find a real target, that is, to manually judge whether there is a suspected target or a real target. 4.根据权利要求1或2所述的一种变分辨率目标探测与识别一体化的方法,其特征在于:4. A method for integrating variable resolution target detection and recognition according to claim 1 or 2, characterized in that: 由于采用支持向量机作为目标识别分类器,因此目标识别的具体实现由线下训练和线上测试两部分组成;目标识别线下训练的过程具体方法如下:Since the support vector machine is used as the target recognition classifier, the specific realization of the target recognition consists of two parts: offline training and online testing; the specific method of the target recognition offline training process is as follows: 步骤(1):对含标签的所有训练集图像采用同上所述的显著性分析算法进行处理;Step (1): All training set images containing labels are processed using the same saliency analysis algorithm as described above; 步骤(2):采用同上所述的区域生长法,对训练集图像进行显著性区域提取,得到训练集感兴趣区域;Step (2): Using the same region growing method as above, extract the salient region of the training set image to obtain the region of interest in the training set; 步骤(3):利用稀疏编码算法,对所得到的各个训练集感兴趣区域进行稀疏编码,所得向量即为相应图像的特征向量;Step (3): Using the sparse coding algorithm, perform sparse coding on the obtained regions of interest in each training set, and the obtained vector is the feature vector of the corresponding image; 步骤(4):将步骤(3)所得的特征向量及其相应的标签作为输入,训练支持向量机,并将训练好的支持向量机作为线上测试的目标识别分类器;Step (4): Using the feature vector and its corresponding label obtained in step (3) as input, train the support vector machine, and use the trained support vector machine as the target recognition classifier for the online test; 目标识别的线上测试流程具体方法如下:The specific method of the online test process of target recognition is as follows: 步骤(1):对步骤二所得图像进行显著性区域提取,得到感兴趣区域;Step (1): extracting the salient region of the image obtained in step 2 to obtain the region of interest; 步骤(2):对步骤(1)中得到的感兴趣区域,采用如上所述的稀疏编码算法,得到感兴趣区域的特征向量;Step (2): For the region of interest obtained in step (1), use the sparse coding algorithm as described above to obtain the feature vector of the region of interest; 步骤(3):将步骤(2)中所得的特征向量输入训练好的支持向量机,得到输出结果;Step (3): Input the feature vector obtained in step (2) into the trained support vector machine to obtain the output result; 步骤(4):基于步骤(3)所得的输出结果,采用自动方式或手动方式判断是否存在疑似目标或真实目标。Step (4): Based on the output result obtained in step (3), whether there is a suspected target or a real target is judged by automatic or manual means. 5.实现如权利要求1至4任意一项所述的方法的系统,其特征在于:包括主控制模块(1)、图像接口(2)、CMOS相机(3)、镜头(4);其中主控制模块(1)通过图像处理算法实现目标探测与识别,并根据目标探测与识别的结果实时控制CMOS相机(3)的分辨率模式,所述的分辨率模式分为用于目标探测的低分辨率模式和用于目标识别的高分辨率模式;图像接口(2)用于CMOS相机(3)和主控制模块(1)之间的数据传输;CMOS相机(3)通过光电转换,对当前目标进行图像采集,且CMOS芯片需具有分辨率可调功能;镜头用于控制CMOS相机(2)的视场角和成像距离。5. The system realizing the method according to any one of claims 1 to 4, is characterized in that: comprising a main control module (1), an image interface (2), a CMOS camera (3), a camera lens (4); wherein the main The control module (1) realizes target detection and recognition through image processing algorithms, and controls the resolution mode of the CMOS camera (3) in real time according to the results of target detection and recognition, and the resolution modes are divided into low-resolution modes for target detection high-resolution mode and high-resolution mode for target recognition; the image interface (2) is used for data transmission between the CMOS camera (3) and the main control module (1); For image acquisition, the CMOS chip needs to have an adjustable resolution function; the lens is used to control the field of view and imaging distance of the CMOS camera (2).
CN201710147950.0A 2017-03-13 2017-03-13 A kind of integrated method and system of variable resolution target detection and identification Active CN107016353B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710147950.0A CN107016353B (en) 2017-03-13 2017-03-13 A kind of integrated method and system of variable resolution target detection and identification

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710147950.0A CN107016353B (en) 2017-03-13 2017-03-13 A kind of integrated method and system of variable resolution target detection and identification

Publications (2)

Publication Number Publication Date
CN107016353A CN107016353A (en) 2017-08-04
CN107016353B true CN107016353B (en) 2019-08-23

Family

ID=59440861

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710147950.0A Active CN107016353B (en) 2017-03-13 2017-03-13 A kind of integrated method and system of variable resolution target detection and identification

Country Status (1)

Country Link
CN (1) CN107016353B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107505628B (en) * 2017-08-15 2020-06-16 北京理工大学 Optical phased array variable resolution imaging system and method
CN112514373B (en) 2018-08-14 2023-09-15 华为技术有限公司 Image processing apparatus and method for feature extraction
CN110458198B (en) * 2019-07-10 2022-03-29 哈尔滨工业大学(深圳) Multi-resolution target identification method and device
CN111553262B (en) * 2020-04-26 2023-09-01 上海微阱电子科技有限公司 Detection device and method for rapidly detecting target graph
CN111798634B (en) * 2020-06-29 2022-02-01 杭州海康威视数字技术股份有限公司 Perimeter detection method and device
CN112987291A (en) * 2021-04-09 2021-06-18 西安文理学院 Novel variable-resolution optical system for eliminating aberration by using deformable mirror and imaging method thereof

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104819991A (en) * 2015-05-15 2015-08-05 北京华力兴科技发展有限责任公司 Radiation imaging method, system and device capable of changing resolution ratio
CN204679638U (en) * 2015-06-24 2015-09-30 武汉万集信息技术有限公司 A kind of laser range sensor of variable sweep resolution
CN105158769A (en) * 2015-07-29 2015-12-16 北京理工大学 Double-linkage bionic eye laser scanning imaging system based on MOEMS device
CN105898308A (en) * 2015-12-18 2016-08-24 乐视云计算有限公司 Resolution-variable coding mode prediction method and device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104819991A (en) * 2015-05-15 2015-08-05 北京华力兴科技发展有限责任公司 Radiation imaging method, system and device capable of changing resolution ratio
CN204679638U (en) * 2015-06-24 2015-09-30 武汉万集信息技术有限公司 A kind of laser range sensor of variable sweep resolution
CN105158769A (en) * 2015-07-29 2015-12-16 北京理工大学 Double-linkage bionic eye laser scanning imaging system based on MOEMS device
CN105898308A (en) * 2015-12-18 2016-08-24 乐视云计算有限公司 Resolution-variable coding mode prediction method and device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
一种空间变分辨率传感系统设计与实现;刘越;《中国优秀硕士学位论文库》;20150715;第10,19,25页

Also Published As

Publication number Publication date
CN107016353A (en) 2017-08-04

Similar Documents

Publication Publication Date Title
CN107016353B (en) A kind of integrated method and system of variable resolution target detection and identification
CN110414334B (en) An intelligent water quality identification method based on drone inspection
CN109145830B (en) Intelligent water gauge identification method
CN106548182B (en) Pavement crack detection method and device based on deep learning and principal cause analysis
CN111340797A (en) Laser radar and binocular camera data fusion detection method and system
CN107993258B (en) Image registration method and device
GB2569751A (en) Static infrared thermal image processing-based underground pipe leakage detection method
CN105957090B (en) A kind of monocular vision pose measuring method and system based on Davinci technology
CN105574488A (en) Low-altitude aerial infrared image based pedestrian detection method
CN105373135A (en) Method and system for guiding airplane docking and identifying airplane type based on machine vision
CN112381870B (en) Binocular vision-based ship identification and navigational speed measurement system and method
CN109946304A (en) On-line detection system and detection method for surface defects of parts based on feature matching
CN110619328A (en) Intelligent ship water gauge reading identification method based on image processing and deep learning
CN113627427B (en) Instrument reading method and system based on image detection technology
CN111126183A (en) Method for detecting damage of building after earthquake based on near-ground image data
CN111739003B (en) Machine vision method for appearance detection
CN102393902A (en) Vehicle color detection method based on H_S two-dimensional histogram and regional color matching
CN108596040A (en) A kind of channels in series fusion pedestrian detection method based on binocular vision
CN109359577A (en) A system for detecting people in complex backgrounds based on machine learning
CN109410272B (en) A transformer nut identification and positioning device and method
CN109086763A (en) A kind of pointer instrument read method and device
CN116681979A (en) Power equipment target detection method under complex environment
CN109063669B (en) Bridge area ship navigation situation analysis method and device based on image recognition
CN106683125A (en) RGB-D image registration method based on 2D/3D mode switching
CN113536895A (en) Disc pointer meter identification method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant