[go: up one dir, main page]

CN105486751A - Equipment defect comprehensive detection system - Google Patents

Equipment defect comprehensive detection system Download PDF

Info

Publication number
CN105486751A
CN105486751A CN201610053064.7A CN201610053064A CN105486751A CN 105486751 A CN105486751 A CN 105486751A CN 201610053064 A CN201610053064 A CN 201610053064A CN 105486751 A CN105486751 A CN 105486751A
Authority
CN
China
Prior art keywords
image
ultrasonic
infrared
equipment
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610053064.7A
Other languages
Chinese (zh)
Inventor
陆启宇
韩东
徐鹏
傅晨钊
高凯
林敏�
张佳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SHANGHAI ENERGYFUTURE CO Ltd
State Grid Shanghai Electric Power Co Ltd
East China Power Test and Research Institute Co Ltd
Original Assignee
SHANGHAI ENERGYFUTURE CO Ltd
State Grid Shanghai Electric Power Co Ltd
East China Power Test and Research Institute Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SHANGHAI ENERGYFUTURE CO Ltd, State Grid Shanghai Electric Power Co Ltd, East China Power Test and Research Institute Co Ltd filed Critical SHANGHAI ENERGYFUTURE CO Ltd
Priority to CN201610053064.7A priority Critical patent/CN105486751A/en
Publication of CN105486751A publication Critical patent/CN105486751A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N29/00Investigating or analysing materials by the use of ultrasonic, sonic or infrasonic waves; Visualisation of the interior of objects by transmitting ultrasonic or sonic waves through the object
    • G01N29/04Analysing solids
    • G01N29/06Visualisation of the interior, e.g. acoustic microscopy
    • G01N29/0654Imaging
    • G01N29/069Defect imaging, localisation and sizing using, e.g. time of flight diffraction [TOFD], synthetic aperture focusing technique [SAFT], Amplituden-Laufzeit-Ortskurven [ALOK] technique
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination

Landscapes

  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Biochemistry (AREA)
  • General Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Acoustics & Sound (AREA)
  • Radiation Pyrometers (AREA)

Abstract

本发明涉及一种设备缺陷综合检测系统,该检测系统基于超声、红外及紫外进行设备缺陷检测,包括:综合检测装置,基于超声、红外及紫外对被测设备进行图像采集;设备缺陷库,存储有各类被测设备的检测案例和故障案例;状态分析装置,接收所述综合检测装置采集的图像数据,将该图像数据与设备缺陷库进行比对,获得被测设备的状态并输出。与现有技术相比,本发明具有设备缺陷检测精确度高、可以及早发现变电设备缺陷等优点。

The invention relates to a comprehensive detection system for equipment defects. The detection system detects equipment defects based on ultrasound, infrared and ultraviolet, and includes: a comprehensive detection device that collects images of the equipment under test based on ultrasound, infrared and ultraviolet; There are detection cases and failure cases of various types of equipment under test; the state analysis device receives the image data collected by the comprehensive detection device, compares the image data with the equipment defect database, obtains the state of the equipment under test and outputs it. Compared with the prior art, the invention has the advantages of high equipment defect detection accuracy, early detection of substation equipment defects and the like.

Description

一种设备缺陷综合检测系统A comprehensive detection system for equipment defects

技术领域technical field

本发明涉及属于电气设备检测领域,尤其是涉及一种设备缺陷综合检测系统。The invention relates to the field of electrical equipment detection, in particular to a comprehensive detection system for equipment defects.

背景技术Background technique

随着电网规模的快速发展,电气设备的数量飞速增长。由于绝大部分高压电气设备为户外布置,受环境影响较大。户外变电设备在发生故障前,往往会发生局部放电,放电源会产生声、电和化学效应。有经验的运行人员往往能够利用超声、紫外及红外设备,提前发现设备隐患杜绝事故的发生。With the rapid development of grid scale, the number of electrical equipment is increasing rapidly. Since most of the high-voltage electrical equipment is arranged outdoors, it is greatly affected by the environment. Before the failure of outdoor substation equipment, partial discharge often occurs, and the discharge source will produce acoustic, electrical and chemical effects. Experienced operators can often use ultrasonic, ultraviolet and infrared equipment to detect hidden dangers in advance and prevent accidents.

在多年的实践中,超声、紫外和红外等检测设备的有效性已经得到了极大的肯定,但是受检测技术水平的限制,单一原理的检测设备都各有其优缺点。In many years of practice, the effectiveness of ultrasonic, ultraviolet and infrared testing equipment has been greatly affirmed, but limited by the level of testing technology, single-principle testing equipment has its own advantages and disadvantages.

1、利用超声检测放电非常有效,而且可以减少可听声的干扰,但是超声波的指向性较强,在空气中传播容易衰减,往往需要检测设备具有较高的灵敏度,同时需要检测者具有较为丰富的经验;1. The use of ultrasound to detect discharge is very effective, and can reduce the interference of audible sound, but the directivity of ultrasound is strong, and it is easy to attenuate in the air. It often requires high sensitivity of the detection equipment, and at the same time, the detector needs to be rich. experience of;

2、常用的非制冷焦平面原理的红外热像仪对发热性缺陷的检出率较高,但对于放电性故障往往无能为力;2. The commonly used infrared thermal imaging camera with the principle of uncooled focal plane has a high detection rate for heating defects, but it is often powerless for discharge faults;

3、紫外成像仪对于放电的检测灵敏度较高,但是容易被遮挡,对于处于隐蔽部位或内部的放电无能为力。3. The ultraviolet imager has high detection sensitivity for discharge, but it is easy to be blocked, and it is powerless to discharge in hidden parts or inside.

现有上述单一检测设备难以满足更高精度的要求。It is difficult for the existing single detection equipment mentioned above to meet the requirements of higher precision.

发明内容Contents of the invention

本发明的目的就是为了克服上述现有技术存在的缺陷而提供一种设备缺陷检测精确度高、可以及早发现变电设备缺陷的设备缺陷综合检测系统。The object of the present invention is to provide a comprehensive equipment defect detection system which has high detection accuracy of equipment defects and can detect defects of substation equipment early in order to overcome the above-mentioned defects in the prior art.

本发明的目的可以通过以下技术方案来实现:The purpose of the present invention can be achieved through the following technical solutions:

一种设备缺陷综合检测系统,该检测系统基于超声、红外及紫外进行设备缺陷检测,包括:A comprehensive detection system for equipment defects, which detects equipment defects based on ultrasound, infrared and ultraviolet, including:

综合检测装置,基于超声、红外及紫外对被测设备进行图像采集;Comprehensive detection device, based on ultrasonic, infrared and ultraviolet image acquisition for the equipment under test;

设备缺陷库,存储有各类被测设备的检测案例和故障案例;The equipment defect library stores the detection cases and failure cases of various tested equipment;

状态分析装置,接收所述综合检测装置采集的图像数据,将该图像数据与设备缺陷库进行比对,获得被测设备的状态并输出。The state analysis device receives the image data collected by the comprehensive detection device, compares the image data with the equipment defect database, obtains the state of the tested equipment and outputs it.

所述综合检测装置包括:The comprehensive detection device includes:

超声波可视模块,用于同步采集超声阵列信号和可见光图像并对超声阵列信号和可见光图像进行合成,获得超声可见光图像;The ultrasonic visualization module is used for synchronously collecting ultrasonic array signals and visible light images and synthesizing the ultrasonic array signals and visible light images to obtain ultrasonic visible light images;

红外检测模块,用于与所述超声波可视模块同步采集红外图像;An infrared detection module, used to collect infrared images synchronously with the ultrasonic visualization module;

紫外检测模块,用于与所述超声波可视模块同步采集紫外图像;An ultraviolet detection module, used to collect ultraviolet images synchronously with the ultrasonic visualization module;

控制显示模块,用于对所获取的超声可见光图像、红外图像和紫外图像进行合成处理并显示;The control display module is used to synthesize and display the acquired ultrasonic visible light image, infrared image and ultraviolet image;

电源,用于对所述超声波可视模块、红外检测模块、紫外检测模块和控制显示模块供电。The power supply is used to supply power to the ultrasonic visual module, infrared detection module, ultraviolet detection module and control display module.

所述超声波可视模块包括超声传感器阵列、超声放大电路、摄像头、模数转换器、第一图像合成单元和第一显示器,所述超声传感器阵列、超声放大电路和模数转换器依次连接,所述摄像头与模数转换器连接,所述模数转换器、第一图像合成单元和第一显示器依次连接,第一图像合成单元将超声传感器阵列采集的超声阵列信号和摄像头采集的可见光图像进行合成,并显示于第一显示器中。The ultrasonic visual module includes an ultrasonic sensor array, an ultrasonic amplifying circuit, a camera, an analog-to-digital converter, a first image synthesis unit, and a first display, and the ultrasonic sensor array, the ultrasonic amplifying circuit and the analog-to-digital converter are connected in sequence, so that The camera is connected to the analog-to-digital converter, the analog-to-digital converter, the first image synthesis unit and the first display are connected in sequence, and the first image synthesis unit synthesizes the ultrasonic array signal collected by the ultrasonic sensor array and the visible light image collected by the camera , and displayed on the first display.

所述超声传感器阵列由16只摆放在不同位置的超声传感器组成;The ultrasonic sensor array is composed of 16 ultrasonic sensors placed in different positions;

16只所述超声传感器具体摆放位置为:每四个超声传感器构成一组线型阵,形成上、下、左、右四组线型阵,组成二维方形阵。The specific placement positions of the 16 ultrasonic sensors are as follows: every four ultrasonic sensors form a set of linear arrays, forming four sets of upper, lower, left, and right linear arrays, forming a two-dimensional square array.

所述超声放大电路为双极放大电路,该双极放大电路的每级电路都采用负反馈放大电路,且两级放大电路之间用电容隔离直流成分。The ultrasonic amplifying circuit is a bipolar amplifying circuit, each stage of the bipolar amplifying circuit adopts a negative feedback amplifying circuit, and a capacitor is used to isolate the DC component between the two amplifying circuits.

所述第一图像合成单元将超声阵列信号和可见光图像进行合成的具体过程为:The specific process of synthesizing the ultrasonic array signal and the visible light image by the first image synthesizing unit is as follows:

S101、将每组线型阵中每个超声传感器采集的超声信号进行叠加生成指向性信号;S101. Superimposing the ultrasonic signals collected by each ultrasonic sensor in each group of linear arrays to generate a directional signal;

S102、利用以下公式分别对上下线型阵和左右线型阵的指向信号进行延时相关计算:S102. Use the following formulas to perform delay correlation calculations on the pointing signals of the upper and lower linear arrays and the left and right linear arrays:

CTB(n)=ΣST(t+n)·SB(t)C TB (n)=ΣS T (t+n)·S B (t)

CLR(n)=ΣSL(t+n)·SR(t)C LR (n)=ΣS L (t+n)·S R (t)

其中,CTB(n)和CLR(n)分别为上下线型阵和左右线型阵指向信号的相关系数,ST(t)、SB(t)、SL(t)和SR(t)为上、下、左、右线型阵的指向性信号;Among them, C TB (n) and C LR (n) are the correlation coefficients of the pointing signals of the upper and lower linear arrays and the left and right linear arrays respectively, and S T (t), S B (t), S L (t) and S R (t) is the directivity signal of the up, down, left and right linear array;

S103、分别选取CTB(n)和CLR(n)的最大值作为超声源位置的垂直坐标和水平坐标;S103. Respectively select the maximum value of C TB (n) and C LR (n) as the vertical coordinate and horizontal coordinate of the ultrasonic source position;

S104、以步骤S103中所述的超声源位置为中心,CTB(n)和CLR(n)的最大值为幅值,生成二维高斯函数,形成二维矩阵;S104, taking the ultrasonic source position described in step S103 as the center, and the maximum value of C TB (n) and C LR (n) as the amplitude, generating a two-dimensional Gaussian function to form a two-dimensional matrix;

S105、将可见光图像作为背景、步骤S104中所述的二维矩阵作为前景,合成为超声可见光图像并发送给第一显示器进行显示。S105. Using the visible light image as the background and the two-dimensional matrix described in step S104 as the foreground, synthesize an ultrasonic visible light image and send it to the first display for display.

所述红外检测模块包括红外热像仪,所述紫外检测模块包括紫外热像仪。The infrared detection module includes an infrared thermal imager, and the ultraviolet detection module includes an ultraviolet thermal imager.

所述控制显示模块包括相连接的第二图像合成单元与第二显示器,所述第二图像合成单元分别连接超声波可视模块、红外检测模块和紫外检测模块,利用图像融合算法将所述超声可见光图像、红外图像和紫外图像进行融合并在第二显示器上进行显示。The control display module includes a connected second image synthesis unit and a second display, and the second image synthesis unit is respectively connected to an ultrasonic visual module, an infrared detection module and an ultraviolet detection module, and uses an image fusion algorithm to combine the ultrasonic visible light The image, infrared image and ultraviolet image are fused and displayed on a second display.

所述第二图像合成单元利用图像融合算法进行融合的具体过程为:The specific process of the fusion by the second image synthesis unit using the image fusion algorithm is as follows:

S201、提取所述红外图像中的红外目标得到红外目标区域图像,将所述红外目标区域图像、超声可见光图像进行融合得到红外目标图像;S201. Extract the infrared target in the infrared image to obtain an infrared target area image, and fuse the infrared target area image and the ultrasonic visible light image to obtain an infrared target image;

S202、对所述超声可见光图像、红外目标图像以及紫外图像进行图像增强;S202. Perform image enhancement on the ultrasonic visible light image, the infrared target image, and the ultraviolet image;

S203、对增强后的图像进行图像配准;S203. Perform image registration on the enhanced image;

S204、对配准后的图像进行融合。S204. Fusion the registered images.

所述状态分析装置通过实时方式或离线方式接收综合检测装置采集的图像数据。The state analysis device receives the image data collected by the comprehensive detection device in real-time or offline.

与现有技术相比,本发明具有以下有益效果:Compared with the prior art, the present invention has the following beneficial effects:

(1)本发明通过综合检测装置获得被测对象基于超声、红外、紫外的图像信息,解决了单一设备检测存在的问题,综合了超声、红外、紫外的优点,有效提高了设备检测的精确度,可以及早的发现变电设备的缺陷,避免发生不必要的损失。(1) The present invention obtains the image information of the measured object based on ultrasound, infrared, and ultraviolet through a comprehensive detection device, solves the problem of single equipment detection, integrates the advantages of ultrasound, infrared, and ultraviolet, and effectively improves the accuracy of equipment detection , can detect the defects of substation equipment early and avoid unnecessary losses.

(2)本发明首先通过综合检测装置测量多种被测设备获得检测案例和电气设备常见故障案例,通过这些案例及实际测量数据方便地获得实际被测电气设备的工作状态,方便可靠。(2) The present invention firstly obtains detection cases and common failure cases of electrical equipment by measuring multiple tested equipments with a comprehensive detection device, and obtains the working status of the actual tested electrical equipment conveniently through these cases and actual measurement data, which is convenient and reliable.

(3)本发明综合检测装置测量可通过实时或离线方式将数据传输给状态分析装置,使用方便。(3) The measurement of the comprehensive detection device of the present invention can transmit data to the state analysis device in real-time or off-line, which is convenient to use.

(4)本发明超声波可视模块利用超声源定位算法估计空间中各个方位的超声强度,同时结合摄像头采集到的空间视觉场景信息共同显示。通过这种方式,检修人员可直接观察到超声源的位置,并判断设备的放电点,尤其适用于需要远距离设备检修,如输电高杆、高压变电站等应用场合。检修人员可以直观地发现异常超声源的产生位置,由不可听的超声信号源成像标识为可视的图像放电点,帮助检修人员直观、快速地判断出故障点。该技术可以实现对目标超声源的定向采集,有效地抑制来自其它方向的噪音,从而克服工作现场的折射、干扰等问题。(4) The ultrasonic visualization module of the present invention uses the ultrasonic source positioning algorithm to estimate the ultrasonic intensity in various directions in space, and simultaneously displays the spatial visual scene information collected by the camera. In this way, maintenance personnel can directly observe the position of the ultrasonic source and judge the discharge point of the equipment, which is especially suitable for applications that require long-distance equipment maintenance, such as power transmission poles and high-voltage substations. The maintenance personnel can intuitively find the location of the abnormal ultrasonic source, and the inaudible ultrasonic signal source is imaged and marked as a visible image discharge point, which helps the maintenance personnel to judge the fault point intuitively and quickly. This technology can achieve directional acquisition of the target ultrasonic source, effectively suppress noise from other directions, and thus overcome problems such as refraction and interference at the work site.

(5)本发明将超声可见光图像、红外图像和紫外图像通过图像融合方法合成为一混合图像,通过该混合图像与设备缺陷库进行比对,消除了单一检测设备在空间上的位置和角度差异,实现多种图像的选择性重叠,从而进一步提高了设备缺陷检测的精度。(5) In the present invention, ultrasonic visible light images, infrared images and ultraviolet images are synthesized into a mixed image through an image fusion method, and the mixed image is compared with the equipment defect library to eliminate the spatial position and angle difference of a single detection equipment , realizing the selective overlapping of multiple images, thereby further improving the accuracy of equipment defect detection.

附图说明Description of drawings

图1为本发明检测系统的实现原理图;Fig. 1 is the realization schematic diagram of detection system of the present invention;

图2为本发明的结构示意图;Fig. 2 is a structural representation of the present invention;

图3为本发明超声传感器阵列设计示意图;Fig. 3 is a schematic diagram of the design of the ultrasonic sensor array of the present invention;

图4为本发明超声信号放大电路示意图。Fig. 4 is a schematic diagram of an ultrasonic signal amplification circuit of the present invention.

具体实施方式detailed description

下面结合附图和具体实施例对本发明进行详细说明。本实施例以本发明技术方案为前提进行实施,给出了详细的实施方式和具体的操作过程,但本发明的保护范围不限于下述的实施例。The present invention will be described in detail below in conjunction with the accompanying drawings and specific embodiments. This embodiment is carried out on the premise of the technical solution of the present invention, and detailed implementation and specific operation process are given, but the protection scope of the present invention is not limited to the following embodiments.

如图1-图2所示,本实施例提供一种设备缺陷综合检测系统,该检测系统基于超声、红外及紫外进行设备缺陷检测,包括综合检测装置1、设备缺陷库2和状态分析装置3,状态分析装置3分别连接综合检测装置1和设备缺陷库2,其中,综合检测装置1基于超声、红外及紫外对被测设备进行图像采集;设备缺陷库2存储有各类被测设备的检测案例和故障案例;状态分析装置3通过实时方式或离线方式接收所述综合检测装置1采集的图像数据,将该图像数据与设备缺陷库2进行比对,获得被测设备的状态并输出。该检测系统可以判断各类变电站中的变电设备是否处于正常的工作中,以便及早的发现变电设备的缺陷,避免发生不必要的损失。As shown in Figures 1-2, this embodiment provides a comprehensive detection system for equipment defects. The detection system detects equipment defects based on ultrasound, infrared and ultraviolet light, and includes a comprehensive detection device 1, an equipment defect database 2 and a state analysis device 3 , the state analysis device 3 is respectively connected to the comprehensive detection device 1 and the equipment defect database 2, wherein the comprehensive detection device 1 collects images of the equipment under test based on ultrasound, infrared and ultraviolet; Cases and fault cases; the state analysis device 3 receives the image data collected by the comprehensive detection device 1 in real-time or offline, compares the image data with the equipment defect database 2, obtains the state of the equipment under test and outputs it. The detection system can judge whether the substation equipment in various substations is working normally, so as to detect the defects of the substation equipment early and avoid unnecessary losses.

设备缺陷库2中,各类被测设备的检测案例是由综合检测装置1对各类变电设备进行检测得到的;故障案例为电气设备常见故障案例。In the equipment defect library 2, the detection cases of various types of equipment under test are obtained from the detection of various types of substation equipment by the comprehensive detection device 1; the fault cases are common fault cases of electrical equipment.

综合检测装置1包括超声波可视模块101、红外检测模块102、紫外检测模块103、控制显示模块104和电源105,控制显示模块104分别连接超声波可视模块101、红外检测模块102和紫外检测模块103,电源105分别连接超声波可视模块101、红外检测模块102、紫外检测模块103和控制显示模块104。超声波可视模块101用于同步采集超声阵列信号和可见光图像并对超声阵列信号和可见光图像进行合成,获得超声可见光图像;红外检测模块102用于与所述超声波可视模块同步采集红外图像;紫外检测模块103用于与所述超声波可视模块同步采集紫外图像;控制显示模块104用于对所获取的超声可见光图像、红外图像和紫外图像进行合成处理并显示;电源105用于对所述超声波可视模块101、红外检测模块102、紫外检测模块103和控制显示模块104供电。The comprehensive detection device 1 comprises an ultrasonic visual module 101, an infrared detection module 102, an ultraviolet detection module 103, a control display module 104 and a power supply 105, and the control display module 104 is respectively connected to the ultrasonic visual module 101, the infrared detection module 102 and the ultraviolet detection module 103 , the power supply 105 is respectively connected to the ultrasonic visual module 101 , the infrared detection module 102 , the ultraviolet detection module 103 and the control display module 104 . Ultrasonic visual module 101 is used for synchronously collecting ultrasonic array signals and visible light images and synthesizing ultrasonic array signals and visible light images to obtain ultrasonic visible light images; infrared detection module 102 is used for synchronously collecting infrared images with the ultrasonic visual module; The detection module 103 is used to collect ultraviolet images synchronously with the ultrasonic visual module; the control display module 104 is used to synthesize and display the acquired ultrasonic visible light images, infrared images and ultraviolet images; the power supply 105 is used to monitor the ultrasonic The visual module 101 , the infrared detection module 102 , the ultraviolet detection module 103 and the control display module 104 supply power.

本实施例所述的综合检测装置可由现场工作人员手持,对各类变电设备进行检测,检测结果包括超声波可视检测结果、红外测温检测结果、紫外放电检测结果以及综合检测结果。The comprehensive detection device described in this embodiment can be held by on-site staff to detect various types of substation equipment. The detection results include ultrasonic visual detection results, infrared temperature measurement detection results, ultraviolet discharge detection results and comprehensive detection results.

在一个实施例中,所述超声波可视模块101包括超声传感器阵列、超声放大电路、摄像头、模数转换器、第一图像合成单元和第一显示器,超声传感器阵列、超声放大电路和模数转换器依次连接,用于将超声传感器阵列采集的超声阵列信号进行放大后转换为数字形式的超声阵列信号;摄像头与模数转换器连接,用于将采集到的可见光图像转换为数字形式的可见光图像;模数转换器、第一图像合成单元和第一显示器依次连接,第一图像合成单元将超声传感器阵列采集的超声阵列信号和摄像头采集的可见光图像进行合成,并显示于第一显示器中。In one embodiment, the ultrasonic visualization module 101 includes an array of ultrasonic sensors, an ultrasonic amplification circuit, a camera, an analog-to-digital converter, a first image synthesis unit, and a first display, an array of ultrasonic sensors, an ultrasonic amplification circuit, and an analog-to-digital conversion connected in sequence to amplify the ultrasonic array signal collected by the ultrasonic sensor array and convert it into a digital ultrasonic array signal; the camera is connected to an analog-to-digital converter to convert the collected visible light image into a digital visible light image The analog-to-digital converter, the first image synthesis unit and the first display are connected in sequence, and the first image synthesis unit synthesizes the ultrasonic array signal collected by the ultrasonic sensor array and the visible light image collected by the camera, and displays it on the first display.

本实施例所述的超声波可视模块基本原理是利用超声传感器阵列采集超声信号,利用超声源定位算法估计空间中各个方位的超声强度,同时结合摄像头采集到的空间视觉场景信息共同显示。通过这种方式,检修人员可直接观察到超声源的位置,并判断设备的放电点。尤其适用于需要远距离设备检修,如输电高杆、高压变电站等应用场合。检修人员可以直观地发现异常超声源的产生位置,由不可听的超声信号源成像标识为可视的图像放电点,帮助检修人员直观、快速地判断出故障点。该技术可以实现对目标超声源的定向采集,有效地抑制来自其它方向的噪音,从而克服工作现场的折射、干扰等问题。The basic principle of the ultrasonic visualization module described in this embodiment is to use the ultrasonic sensor array to collect ultrasonic signals, use the ultrasonic source positioning algorithm to estimate the ultrasonic intensity in various directions in space, and simultaneously display the spatial visual scene information collected by the camera. In this way, maintenance personnel can directly observe the position of the ultrasonic source and judge the discharge point of the equipment. It is especially suitable for applications that require long-distance equipment maintenance, such as power transmission high poles, high-voltage substations, etc. The maintenance personnel can intuitively find the location of the abnormal ultrasonic source, and the inaudible ultrasonic signal source is imaged and marked as a visible image discharge point, which helps the maintenance personnel to judge the fault point intuitively and quickly. This technology can achieve directional acquisition of the target ultrasonic source, effectively suppress noise from other directions, and thus overcome problems such as refraction and interference at the work site.

在一个实施例中,所述超声放大电路为双极放大电路,该双极放大电路的每级电路都采用负反馈放大电路,且两级放大电路之间用电容隔离直流成分。本实施例超声放大电路形式如图4所示,超声信号经长距离传输衰减很严重,传感器采集到的信号十分微弱,需要经过放大后才能进一步处理。研究中设计了双级放大电路,每级采用负反馈放大电路,放大100倍。两级之间利用电容隔离直流成分,级联后的放大增益可达10000倍。In one embodiment, the ultrasonic amplifying circuit is a bipolar amplifying circuit, each stage of the bipolar amplifying circuit adopts a negative feedback amplifying circuit, and a capacitor is used to isolate the DC component between the two stages of amplifying circuits. The form of the ultrasonic amplification circuit in this embodiment is shown in Figure 4. The ultrasonic signal is seriously attenuated through long-distance transmission, and the signal collected by the sensor is very weak and needs to be amplified before further processing. In the research, a double-stage amplifier circuit is designed, each stage uses a negative feedback amplifier circuit, and the amplifier is amplified 100 times. Capacitors are used to isolate the DC component between the two stages, and the amplification gain after cascading can reach 10,000 times.

在一个实施例中,所述超声传感器阵列由16只摆放在不同位置的超声传感器组成;16只所述超声传感器具体摆放位置为:每四个超声传感器构成一组线型阵,形成上、下、左、右四组线型阵,组成二维方形阵,如图3所示。方形阵的长边为30cm,短边为20cm。通过这种方形阵列方式可对二维空间中的声源进行定位。In one embodiment, the ultrasonic sensor array is composed of 16 ultrasonic sensors placed in different positions; the specific placement of the 16 ultrasonic sensors is: every four ultrasonic sensors form a set of linear arrays, forming an upper , down, left, and right four groups of linear arrays form a two-dimensional square array, as shown in Figure 3. The long side of the square array is 30cm, and the short side is 20cm. The sound source in two-dimensional space can be localized by this square array method.

在本实施例中,利用延时相关方法来估计超声源位置。将每一个四元线阵作为一组具有指向性的超声采集探头。利用上下两组探头并通过互相关方法来估计超声源的垂直位置,利用左右两组探头以及同样方法估计超声源的水平位置。具体原理为:将四元线阵中每一个传感器采集的信号叠加,以此形成指向正前方的波束,而抑制其它方向上的噪声干扰。In this embodiment, the time-delay correlation method is used to estimate the position of the ultrasound source. Each four-element linear array is used as a group of directional ultrasonic acquisition probes. The vertical position of the ultrasonic source is estimated by using the upper and lower sets of probes and the cross-correlation method, and the horizontal position of the ultrasonic source is estimated by using the left and right sets of probes and the same method. The specific principle is: superimpose the signals collected by each sensor in the four-element linear array to form a beam pointing straight ahead, while suppressing noise interference in other directions.

在本实施例中,数字形式的超声信号和可见光图像通过USB接口输出到第一图像合成单元,完成信号处理及显示功能。In this embodiment, digital ultrasound signals and visible light images are output to the first image synthesis unit through the USB interface to complete signal processing and display functions.

在一个实施例中,所述第一图像合成单元将超声阵列信号和可见光图像进行合成的具体过程为:In one embodiment, the specific process for the first image synthesis unit to synthesize the ultrasound array signal and the visible light image is as follows:

S101、将每组线型阵中每个超声传感器采集的超声信号进行叠加生成指向性信号;S101. Superimposing the ultrasonic signals collected by each ultrasonic sensor in each group of linear arrays to generate a directional signal;

S102、利用以下公式分别对上下线型阵和左右线型阵的指向信号进行延时相关计算:S102. Use the following formulas to perform delay correlation calculations on the pointing signals of the upper and lower linear arrays and the left and right linear arrays:

CTB(n)=ΣST(t+n)·SB(t)C TB (n)=ΣS T (t+n)·S B (t)

CLR(n)=ΣSL(t+n)·SR(t)C LR (n)=ΣS L (t+n)·S R (t)

其中,CTB(n)和CLR(n)分别为上下线型阵和左右线型阵指向信号的相关系数,ST(t)、SB(t)、SL(t)和SR(t)为上、下、左、右线型阵的指向性信号;Among them, C TB (n) and C LR (n) are the correlation coefficients of the pointing signals of the upper and lower linear arrays and the left and right linear arrays respectively, and S T (t), S B (t), S L (t) and S R (t) is the directivity signal of the up, down, left and right linear array;

S103、分别选取CTB(n)和CLR(n)的最大值作为超声源位置的垂直坐标和水平坐标;S103. Respectively select the maximum value of C TB (n) and C LR (n) as the vertical coordinate and horizontal coordinate of the ultrasonic source position;

S104、以步骤S103中所述的超声源的位置坐标为中心,CTB(n)和CLR(n)的最大值为幅值,生成二维高斯函数,形成二维矩阵;S104, taking the position coordinates of the ultrasonic source described in step S103 as the center, and the maximum value of C TB (n) and C LR (n) as the amplitude, generating a two-dimensional Gaussian function to form a two-dimensional matrix;

S105、将可见光图像作为背景、步骤S104中所述的二维矩阵作为前景,合成为超声可见光图像并发送给第一显示器进行显示。S105. Using the visible light image as the background and the two-dimensional matrix described in step S104 as the foreground, synthesize an ultrasonic visible light image and send it to the first display for display.

在一个实施例中,红外检测模块包括红外热像仪。红外热像仪可以同时测量物体表面各点温度的高低,并以图像形式显示出来;可以同时显示出两点的温度值,因而能准确区分很小的温差,甚至可达0.01。红外热像仪输出的图像信号包含目标的大量信息,可用多种方式显示出来。例如,对图像信号进行假彩色处理,便可由不同颜色显示不同温度的热图像;若反图像信号进行模数转换处理,即可用数字显示物体各点的温度值。In one embodiment, the infrared detection module includes an infrared camera. The thermal imaging camera can simultaneously measure the temperature of each point on the surface of the object and display it in the form of an image; it can display the temperature values of two points at the same time, so it can accurately distinguish a small temperature difference, even up to 0.01. The image signal output by the infrared thermal imaging camera contains a large amount of information of the target, which can be displayed in various ways. For example, by performing false color processing on the image signal, thermal images of different temperatures can be displayed in different colors; if the inverse image signal is processed by analog-to-digital conversion, the temperature value of each point of the object can be displayed digitally.

在一个实施例中,紫外检测模块包括紫外热像仪。紫外成像仪与红外热像仪相比,紫外成像仪检测和红外成像是一种互补性而非冲突性技术。电力设施一个完整的检测应该包括紫外成像、红外成像和可见光检测。电晕是一种发光的表面局部放电,由于空气局部高强度电场而产生电离。该过程引起微小的热量,通常红外检测不能发现。红外检测通常是在高电阻处产生热点。紫外成像仪可以看到的现象往往红外成像仪不能看到,而红外成像仪可以看到的现象往往紫外成像仪不能看到。In one embodiment, the ultraviolet detection module includes an ultraviolet thermal imager. Compared with infrared thermal imaging cameras, ultraviolet imager detection and infrared imaging are complementary rather than conflicting technologies. A complete inspection of power facilities should include ultraviolet imaging, infrared imaging and visible light inspection. A corona is a luminous surface partial discharge that ionizes due to a localized high-intensity electric field in the air. This process induces a tiny amount of heat that normally cannot be detected by infrared detection. Infrared detection typically creates hot spots at high resistance. What can be seen with a UV imager is often invisible to an infrared imager, and what can be seen with an infrared imager is often not visible to a UV imager.

在一个实施例中,所述控制显示模块104包括相连接的第二图像合成单元与第二显示器,所述第二图像合成单元分别连接超声波可视模块101、红外检测模块102和紫外检测模块103,利用图像融合算法将所述超声可见光图像、红外图像和紫外图像进行融合并在第二显示器上进行显示。In one embodiment, the control display module 104 includes a connected second image synthesis unit and a second display, and the second image synthesis unit is respectively connected to the ultrasonic visual module 101, the infrared detection module 102 and the ultraviolet detection module 103 , using an image fusion algorithm to fuse the ultrasound visible light image, the infrared image and the ultraviolet image and display it on the second display.

本实施例所述的第二图像合成单元基于多源图像合成技术将所述超声可见光图像、红外图像信号和紫外图像信号进行融合并在第二显示器上进行显示,具体为:The second image synthesis unit described in this embodiment fuses the ultrasonic visible light image, the infrared image signal and the ultraviolet image signal based on the multi-source image synthesis technology and displays them on the second display, specifically:

由于单独分析红外图像,因其成像分辨率低,场景细节模糊不清,分离出的运动目标很难准确定位。所以将红外运动目标融合到可见光图像中,充分利用可见光图像的空间结构信息确定红外目标在场景中的位置,方便对红外目标的观察与监视。Due to the separate analysis of infrared images, due to the low imaging resolution and blurred scene details, it is difficult to accurately locate the separated moving targets. Therefore, the infrared moving target is fused into the visible light image, and the spatial structure information of the visible light image is fully utilized to determine the position of the infrared target in the scene, so as to facilitate the observation and monitoring of the infrared target.

在可见光和红外图像进行配准和融合之前,必须对图像或者图像序列进行预处理。因为高质量的图像对于后续阶段的应用具有很重要的作用,例如它对图像的分割、目标识别的准确性和图像跟踪等都具有很重要的影响,甚至可以说它的质量好坏在很大程度上会决定后期运算的结果。许多成像系统,如红外热像仪和可见光照相机等,在快速采集宽视场图像的过程中,受其固有的传感器阵列排列密度的限制,图像的分辨率不可能很高,而且实际应用中图像传输速度以及图像存储容量等因素也限制了图像分辨率的提高;同时成像过程中的欠采样(连续图像离散化)效应又会造成图像的频谱混叠,使获取的图像发生降质。如果采用增加传感器阵列密度的办法来提高图像分辨率,则费用可能很昂贵或很难实现。图像预处理技术能能够消除加性噪声以及由有限的传感器阵列密度和光学成像过程的点扩散函数造成的模糊现象。对于红外图像来说,由于外界环境的随机干扰和热成像系统的不完善,给红外图像带来多种多样的噪声,这些噪声严重影响着红外图像的质量。而且,层次感差是红外图像的主要特征,因此对红外图像进行噪声滤波及灰度增强对于提高融合图像质量,更好地对目标进行识别是非常重要的。对可见光和红外图像进行预处理研究的关键在于找寻适合可见光和红外图像的滤波增强算法。另外,由于多源图像是由不同成像传感器或者是由同种成像传感器的不同成像方式或不同成像时间获得的多幅图像,图像间可能出现相对平移、旋转和比例缩放等,不能直接进行融合,而必须先进行图像配准,以建立图像间像素和像素的对应关系。Before the registration and fusion of visible and infrared images, the images or image sequences must be preprocessed. Because high-quality images play a very important role in the application of subsequent stages, for example, it has a very important impact on image segmentation, target recognition accuracy and image tracking, etc., and it can even be said that its quality varies greatly. The degree will determine the result of the later operation. Many imaging systems, such as thermal imaging cameras and visible light cameras, etc., are limited by their inherent sensor array density in the process of quickly collecting wide-field images, so the resolution of the images cannot be very high, and the images in practical applications Factors such as transmission speed and image storage capacity also limit the improvement of image resolution; at the same time, the undersampling (discretization of continuous images) effect in the imaging process will cause image spectrum aliasing and degrade the acquired image. Improving image resolution by increasing sensor array density can be expensive or difficult to achieve. Image preprocessing techniques can remove additive noise and blur caused by the limited sensor array density and the point spread function of the optical imaging process. For infrared images, due to the random interference of the external environment and the imperfection of the thermal imaging system, various noises are brought to the infrared images, which seriously affect the quality of the infrared images. Moreover, poor layering is the main feature of infrared images, so it is very important to perform noise filtering and gray level enhancement on infrared images to improve the quality of fusion images and better identify targets. The key to preprocessing research on visible light and infrared images is to find filter enhancement algorithms suitable for visible light and infrared images. In addition, since multi-source images are obtained by different imaging sensors or by different imaging methods or different imaging times of the same imaging sensor, there may be relative translation, rotation, and scaling between images, which cannot be directly fused. Instead, image registration must be performed first to establish the pixel-to-pixel correspondence between images.

紫外、红外与可见光工作于不同的波段,这种图像信息的互补性使得它们融合后的结果可以有效的应用于自动目标跟踪和伪装识别。这三种图像的配准具有一般的多传感器图像配准的特点,但还有特殊性要考虑。首先,紫外、红外与可见光图像之间的一个重要区别是对比度。可见光图像对比度相对较高。红外图像对比度相对较低,且可以在很大的一个范围内变化。其次,在红外图像中出现的特征并不一定在可见光图像中也出现,同样紫外图像中出现的特征并不一定在可见光图像中也出现。因此,对紫外、红外和可见光图像的配准的特征点提出了更高的要求。首先是要有相当数量的一致性特征点,其次应有有效的一致性检查方法消除错误的匹配点对。适合可见光、红外图像配准的特征点应该具有下列特征:Ultraviolet, infrared and visible light work in different wave bands. The complementarity of this image information makes their fusion results can be effectively applied to automatic target tracking and camouflage recognition. The registration of these three images has the characteristics of general multi-sensor image registration, but there are specificities to consider. First, an important difference between UV, IR, and visible images is contrast. Visible light image contrast is relatively high. Infrared image contrast is relatively low and can vary over a wide range. Second, features that appear in infrared images do not necessarily appear in visible light images, and similarly, features that appear in ultraviolet images do not necessarily appear in visible light images. Therefore, higher requirements are put forward for the feature points of the registration of ultraviolet, infrared and visible light images. Firstly, there must be a considerable number of consistent feature points, and secondly, there should be an effective consistency checking method to eliminate wrong matching point pairs. Feature points suitable for visible light and infrared image registration should have the following characteristics:

①可见光、紫外和红外图像中处于同一位置;① The same position in visible light, ultraviolet and infrared images;

②在图像中均匀分布;② Evenly distributed in the image;

③位于高对比度区域;③Located in high-contrast areas;

④在其周围区域是独特的。④ It is unique in its surrounding area.

因此,配准算法分为两步:Therefore, the registration algorithm is divided into two steps:

(1)是特征点的选取;(1) is the selection of feature points;

(2)是采用仿射变换模型来实现两者间的配准。(2) The affine transformation model is used to realize the registration between the two.

在对三个源序列图像进行合成时,首先进行对预处理后的序列图像进行运动目标轮廓的提取,以获得场景中的目标信息,并用来指导后续的融合处理;接着对各序列图像逐帧进行多尺度分解;最后根据运动目标检测获得的目标信息,采用基于多尺度分解的融合算法逐帧进行基于区域的图像融合。When synthesizing the three source sequence images, the preprocessed sequence images are firstly extracted from the moving target contour to obtain the target information in the scene, which is used to guide the subsequent fusion processing; then each sequence image is frame by frame Carry out multi-scale decomposition; finally, according to the target information obtained by moving target detection, the fusion algorithm based on multi-scale decomposition is used to perform region-based image fusion frame by frame.

因此,本实施例中,第二图像合成单元利用图像融合算法进行融合的具体过程为:Therefore, in this embodiment, the specific process of fusion by the second image synthesis unit using the image fusion algorithm is as follows:

S201、提取所述红外图像中的红外目标得到红外目标区域图像,将所述红外目标区域图像、超声可见光图像进行融合得到红外目标图像;S201. Extract the infrared target in the infrared image to obtain an infrared target area image, and fuse the infrared target area image and the ultrasonic visible light image to obtain an infrared target image;

S202、对所述超声可见光图像、红外目标图像以及紫外图像进行图像增强;S202. Perform image enhancement on the ultrasonic visible light image, the infrared target image, and the ultraviolet image;

S203、对增强后的图像进行图像配准;S203. Perform image registration on the enhanced image;

S204、对配准后的图像进行融合。S204. Fusion the registered images.

在本实施例中,所述步骤S201提取所述红外图像中的红外目标具体包括:利用连续多帧红外图像之间的相关性,计算出红外图像的背景;将当前帧红外图像与所述红外图像的背景作差实现对红外目标提取。本实施例中所述红外图像中,成像热信号的灰度值通常要比周围背景的灰度值要大,表现为目标更亮一些。基于这一特性,将红外视频序列中一组图像每个像素点位置对应的像素值提取出来,采用阈值分割方法对直方图进行操作,高于阈值T的视为红外目标,低于阈值T的视为背景。采用背景减除法实现红外目标的提取,将当前帧红外图像与建立的背景图像相减,如果差值大于或等于设定的阈值T1,那么就认为该像素点是目标点。建立一个二元掩膜图Imask,目标区域用1值表示,否则用0值表示,实现对红外目标的提取。In this embodiment, the step S201 of extracting the infrared target in the infrared image specifically includes: calculating the background of the infrared image by using the correlation between multiple consecutive frames of infrared images; The background of the image is subtracted to realize the extraction of infrared targets. In the infrared image described in this embodiment, the gray value of the imaging thermal signal is usually larger than the gray value of the surrounding background, which means that the target is brighter. Based on this characteristic, the pixel value corresponding to each pixel position of a group of images in the infrared video sequence is extracted, and the threshold segmentation method is used to operate the histogram. Those above the threshold T are regarded as infrared targets, and those below the threshold T as the background. The infrared target is extracted using the background subtraction method. The current frame infrared image is subtracted from the established background image. If the difference is greater than or equal to the set threshold T 1 , then the pixel is considered to be the target point. Establish a binary mask map I mask , the target area is represented by a value of 1, otherwise it is represented by a value of 0, so as to realize the extraction of infrared targets.

在本实施例中,所述步骤S202中所述的图像增强所采用的方法包括中值滤波、均值滤波或其它空间域增强方法。本实施例根据不同的情况对不同的图像采用不同的图像增强方法,一种图像增强方法的优劣不是绝对的。由于具体应用的目的和要求不同,所需要的增强技术也大不相同,因此从根本上讲,并没有图像增强的通用标准,观察者才是某种增强方法优劣的最终判断者。增强算法处理的效果,除与算法本身有一定关系外,还与图像的数据特征直接相关。实际应用中应当根据图像数据特征和处理要求来选择合适的方法。In this embodiment, the image enhancement method in step S202 includes median filtering, mean filtering or other spatial domain enhancement methods. In this embodiment, different image enhancement methods are used for different images according to different situations, and the advantages and disadvantages of one image enhancement method are not absolute. Due to the different purposes and requirements of specific applications, the required enhancement techniques are also very different. Therefore, fundamentally speaking, there is no general standard for image enhancement, and the observer is the final judge of the quality of a certain enhancement method. The effect of enhanced algorithm processing is not only related to the algorithm itself, but also directly related to the data characteristics of the image. In practical applications, the appropriate method should be selected according to the image data characteristics and processing requirements.

在本实施例中,步骤S203具体包括以下步骤:In this embodiment, step S203 specifically includes the following steps:

S2031、提取增强后的可见光图像、红外目标图像和紫外图像中的轮廓;S2031. Extracting contours in the enhanced visible light image, infrared target image, and ultraviolet image;

S2032、利用不变矩和链码表示对步骤S2031中提取的轮廓进行匹配得到匹配轮廓对;S2032. Matching the contour extracted in step S2031 by using invariant moment and chain code representation to obtain a pair of matching contours;

S2033、将匹配轮廓对中的开轮廓对转化为闭合轮廓对;S2033. Convert the open contour pairs in the matched contour pairs into closed contour pairs;

S2034、去除轮廓匹配过程中产生的误匹配轮廓对;S2034. Remove false matching contour pairs generated during the contour matching process;

S2035、根据匹配的闭合轮廓的质心和长轴估计配准参数并基于放射变换来实现图像配准。S2035. Estimating registration parameters according to the centroid and long axis of the matched closed contours and implementing image registration based on radial transformation.

本实施例所述的紫外、红外目标与超声可见光图像是从不同类型传感器获得的多源图像,尽管它们的灰度分布特性之间有很大差异,但物体的一些明显轮廓在图像中均能得到较好的保持,这些轮廓特征可用来进行图像配准。以未配准的紫外、红外与可见光图像为例,通过提取输入图像中的显著轮廓,可以发现三幅图像中有许多相似的轮廓,这些相似的轮廓是进行图像配准的依据。在依据这些轮廓进行配准之前,先要采用一定的算法对这些轮廓进行匹配,在这些匹配的轮廓对中包括匹配的闭合轮廓对和匹配的开轮廓对,对于匹配的闭合轮廓可以求出其质心和长轴。The ultraviolet, infrared target and ultrasonic visible light images described in this embodiment are multi-source images obtained from different types of sensors. Although there are great differences between their gray distribution characteristics, some obvious outlines of objects can be seen in the images. are well preserved, these contour features can be used for image registration. Taking the unregistered ultraviolet, infrared and visible light images as an example, by extracting the salient contours in the input images, it can be found that there are many similar contours in the three images, and these similar contours are the basis for image registration. Before registration based on these contours, a certain algorithm must be used to match these contours. These matched contour pairs include matching closed contour pairs and matching open contour pairs. For the matched closed contours, the other Centroid and major axis.

DaiX.L.和KhorramS.根据匹配后的闭合轮廓的质心求取配准参数,但在实际配准图像中很难从输入图像提取足够的闭合轮廓,而且匹配的闭合轮廓对的数量会影响配准参数估计的精度,如果不能从输入图像中提取到匹配的闭合轮廓对,则这种配准算法将不能适用。为克服以上算法的缺点,本发明提出依据闭合轮廓的质心和长轴的方向来进行图像配准,这就涉及到如何利用匹配的开轮廓对提供的信息进行配准,如何定义其质心和长轴方向,本文做法是将匹配的开轮廓的三个端点用直线段连接以构成闭合轮廓,然后再求取该闭合轮廓的质心和长轴方向。如果两幅图像之间的坐标变换关系为刚体变换,那么图像之间的旋转量可以根据匹配的闭合轮廓的长轴之间的夹角来求得,图像之间的平移量可以根据匹配的闭合轮廓的质心之间的位置关系来求得。DaiX.L. and KhorramS. Calculate the registration parameters according to the centroid of the matched closed contours, but it is difficult to extract enough closed contours from the input image in the actual registration image, and the number of matched closed contour pairs will affect the registration The accuracy of quasi-parameter estimation, such a registration algorithm will not be applicable if no matching closed contour pair can be extracted from the input image. In order to overcome the shortcomings of the above algorithms, the present invention proposes to perform image registration according to the centroid and long axis direction of the closed contour, which involves how to use the matched open contour to register the information provided, and how to define its centroid and long axis. In this paper, the three endpoints of the matching open contour are connected by straight line segments to form a closed contour, and then the centroid and long axis direction of the closed contour are calculated. If the coordinate transformation relationship between the two images is a rigid body transformation, then the rotation between the images can be obtained according to the angle between the long axes of the matching closed contours, and the translation between the images can be obtained according to the matching closed contours The positional relationship between the centroids of the contours is obtained.

在本实施例中,所述步骤S204包括以下步骤:In this embodiment, the step S204 includes the following steps:

S2041、对步骤S2035中实现图像配准后的超声可见光图像、红外目标图像和紫外图像进行多尺度分解;S2041. Perform multi-scale decomposition on the ultrasonic visible light image, infrared target image and ultraviolet image after image registration in step S2035;

S2042、对步骤S2041中相同尺度的超声可见光图像、红外目标图像和紫外图像基于步骤S2035中所述的闭合轮廓利用基于区域的融合算法进行图像融合得到多尺度融合图像;S2042, performing image fusion on the ultrasonic visible light image, infrared target image and ultraviolet image of the same scale in step S2041 based on the closed contour described in step S2035 using a region-based fusion algorithm to obtain a multi-scale fusion image;

S2043、将步骤S2042中的多尺度融合图像转换到相同的尺度,进行叠加得到最终的融合图像。S2043. Convert the multi-scale fused image in step S2042 to the same scale, and perform superposition to obtain a final fused image.

在一个实施例中,所述电源105采用4节5V电池供电,每节电池的容量为2500mAh。本实施例的综合检测装置1需采用电池供电方式,考虑到超声信号电路供电电压在3-36V,红外检测模块供电电压在12V,紫外检测模块电压在12V,检测仪工作总电流在2000mA左右。因此,采用4节5V可充电电池供电,每节容量2500mAh。后接15WDC-DC模块,保持稳定的12V输出电压,为超声采集与放大电路模块供电。电源根据最终选定的平台类型确定供电方式。In one embodiment, the power supply 105 is powered by four 5V batteries, and each battery has a capacity of 2500mAh. The comprehensive detection device 1 of this embodiment needs to be powered by batteries. Considering that the power supply voltage of the ultrasonic signal circuit is 3-36V, the power supply voltage of the infrared detection module is 12V, the voltage of the ultraviolet detection module is 12V, and the total working current of the detector is about 2000mA. Therefore, it is powered by four 5V rechargeable batteries, each with a capacity of 2500mAh. Followed by a 15WDC-DC module to maintain a stable 12V output voltage to supply power for the ultrasonic acquisition and amplification circuit module. The power supply determines the power supply method according to the final selected platform type.

Claims (10)

1. an equipment deficiency comprehensive detection system, is characterized in that, this detection system carries out equipment deficiency detection based on ultrasonic, infrared and ultraviolet, comprising:
Comprehensive detection device, carries out image acquisition based on ultrasonic, infrared and ultraviolet to equipment under test;
Equipment deficiency storehouse, stores detection case and the fault case of all kinds of equipment under test;
State analysis device, receives the view data that described comprehensive detection device gathers, this view data and equipment deficiency storehouse is compared, and obtains the state of equipment under test and exports.
2. equipment deficiency comprehensive detection system according to claim 1, is characterized in that, described comprehensive detection device comprises:
Ultrasound wave visual module, synthesizes supersonic array signal and visible images for synchronous acquisition supersonic array signal and visible images, obtains ultrasonic visible images;
Infrared detection module, for gathering infrared image with the visual module synchronization of described ultrasound wave;
UV detect module, for gathering ultraviolet image with the visual module synchronization of described ultrasound wave;
Control display module, process for carrying out synthesis to obtained ultrasonic visible images, infrared image and ultraviolet image and show;
Power supply, for powering to the visual module of described ultrasound wave, infrared detection module, UV detect module and control display module.
3. equipment deficiency comprehensive detection system according to claim 2, it is characterized in that, the visual module of described ultrasound wave comprises ultrasonic sensor array, ultrasonic amplifying circuit, camera, analog to digital converter, first image composing unit and the first display, described ultrasonic sensor array, ultrasonic amplifying circuit is connected successively with analog to digital converter, described camera is connected with analog to digital converter, described analog to digital converter, first image composing unit is connected successively with the first display, the supersonic array signal of ultrasonic sensor array collection and the visible images of camera collection synthesize by the first image composing unit, and be shown in the first display.
4. equipment deficiency comprehensive detection system according to claim 3, is characterized in that, described ultrasonic sensor array is made up of the sonac that 16 are placed in diverse location;
16 described ultrasonic sensing implement body putting positions are: every four sonacs form one group of line style battle array, form four groups, upper and lower, left and right line style battle array, form two-dimentional square battle array.
5. equipment deficiency comprehensive detection system according to claim 3, it is characterized in that, described ultrasonic amplifying circuit is bipolar amplifying circuit, and every grade of circuit of this bipolar amplifying circuit all adopts negative feedback amplifier circuit, and with electric capacity isolated DC composition between two-stage amplifying circuit.
6. equipment deficiency comprehensive detection system according to claim 4, is characterized in that, the detailed process that supersonic array signal and visible images carry out synthesizing is by described first image composing unit:
S101, the ultrasonic signal often organizing each sonac collection in line style battle array carried out superposition and generate directional signal;
S102, following formula is utilized to carry out time delay correlation computations to the directional signal of upper and lower line style battle array and left and right line style battle array respectively:
C TB(n)=ΣS T(t+n)·S B(t)
C LR(n)=ΣS L(t+n)·S R(t)
Wherein, C tB(n) and C lRn () is respectively the related coefficient of upper and lower line style battle array and left and right line style battle array directional signal, S t(t), S b(t), S l(t) and S rt () is the directional signal of upper and lower, left and right line style battle array;
S103, choose C respectively tB(n) and C lRn the maximal value of () is as the vertical coordinate of supersonic source position and horizontal coordinate;
S104, centered by the supersonic source position described in step S103, C tB(n) and C lRn the maximal value of () is amplitude, generate two-dimensional Gaussian function, forms two-dimensional matrix;
S105, using visible images as a setting, the two-dimensional matrix described in step S104 as prospect, synthesize ultrasonic visible images and send to the first display to show.
7. equipment deficiency comprehensive detection system according to claim 2, is characterized in that, described infrared detection module comprises thermal infrared imager, and described UV detect module comprises ultraviolet thermal imaging system.
8. equipment deficiency comprehensive detection system according to claim 2, it is characterized in that, described control display module comprises the second image composing unit and second display that are connected, described second image composing unit connects the visual module of ultrasound wave, infrared detection module and UV detect module respectively, utilizes Image Fusion described ultrasonic visible images, infrared image and ultraviolet image carried out fusion and show on the second display.
9. equipment deficiency comprehensive detection system according to claim 8, is characterized in that, the detailed process that described second image composing unit utilizes Image Fusion to carry out merging is:
S201, the infrared target extracted in described infrared image obtain infrared target area image, and described infrared target area image, ultrasonic visible images are carried out fusion and obtain infrared target image;
S202, image enhaucament is carried out to described ultrasonic visible images, infrared target image and ultraviolet image;
S203, to strengthen after image carry out image registration;
S204, the image after registration to be merged.
10. equipment deficiency comprehensive detection system according to claim 1, is characterized in that, described state analysis device receives the view data of comprehensive detection device collection by real-time mode or offline mode.
CN201610053064.7A 2016-01-26 2016-01-26 Equipment defect comprehensive detection system Pending CN105486751A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610053064.7A CN105486751A (en) 2016-01-26 2016-01-26 Equipment defect comprehensive detection system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610053064.7A CN105486751A (en) 2016-01-26 2016-01-26 Equipment defect comprehensive detection system

Publications (1)

Publication Number Publication Date
CN105486751A true CN105486751A (en) 2016-04-13

Family

ID=55673869

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610053064.7A Pending CN105486751A (en) 2016-01-26 2016-01-26 Equipment defect comprehensive detection system

Country Status (1)

Country Link
CN (1) CN105486751A (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106228472A (en) * 2016-08-26 2016-12-14 云南电网有限责任公司普洱供电局 A kind of substation equipment intelligent patrol detection failure analysis methods
CN106932692A (en) * 2017-03-07 2017-07-07 北京瑞盈智拓科技发展有限公司 Detection means and detection method based on infrared and ultraviolet visual image fusion
CN107843818A (en) * 2017-09-06 2018-03-27 同济大学 Based on heterologous image temperature rise and local discharge characteristic high-voltage isulation method for diagnosing faults
CN108731814A (en) * 2017-04-21 2018-11-02 富泰华工业(深圳)有限公司 Mainboard analytical equipment and method
CN109030562A (en) * 2016-10-26 2018-12-18 王琪 The detection method of geared cable aging lateral position
CN109100364A (en) * 2018-06-29 2018-12-28 杭州国翌科技有限公司 A kind of tunnel defect monitoring system and monitoring method based on spectrum analysis
CN111678926A (en) * 2020-06-16 2020-09-18 南京工业职业技术学院 A scanning and mapping system for corrosion of tank wall and bottom plate
CN111832763A (en) * 2020-08-13 2020-10-27 国网河南省电力公司灵宝市供电公司 A device defect detection and query system
CN112419301A (en) * 2020-12-03 2021-02-26 国网山西省电力公司大同供电公司 Power equipment defect diagnosis device and method based on multi-source data fusion
CN112698169A (en) * 2021-01-11 2021-04-23 中国科学院声学研究所 Corona discharge positioning method and device, electronic equipment and storage medium
CN114295154A (en) * 2021-10-21 2022-04-08 重庆华网智能传感器研究院股份有限公司 Multifunctional array sensor monitoring method, system, medium, networking and inspection equipment
CN115775248A (en) * 2022-12-14 2023-03-10 西安电子科技大学 Fault Diagnosis Method of Circuit Infrared Heat Map Based on Transmission Transformation and Convolutional Neural Network
CN116228778A (en) * 2023-05-10 2023-06-06 国网山东省电力公司菏泽供电公司 Insulator rupture detection method and system based on multi-mode information fusion

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1612545A2 (en) * 2004-06-08 2006-01-04 Agilent Technologies, Inc. Optically-augmented microwave imaging system and method
CN202178515U (en) * 2011-07-30 2012-03-28 山东鲁能智能技术有限公司 Transformer station intelligent robot inspection system
CN102636434A (en) * 2012-02-26 2012-08-15 曾吕明 Portable three-dimensional visual photoacoustic imaging system
CN202649176U (en) * 2012-06-13 2013-01-02 云南电力试验研究院(集团)有限公司电力研究院 Ultrasonic endoscope real-time scanning and detecting device for electric powder
CN103969561A (en) * 2014-05-28 2014-08-06 上海艾飞能源科技有限公司 Visual ultrasonic detection method for partial discharge failure detection

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1612545A2 (en) * 2004-06-08 2006-01-04 Agilent Technologies, Inc. Optically-augmented microwave imaging system and method
CN202178515U (en) * 2011-07-30 2012-03-28 山东鲁能智能技术有限公司 Transformer station intelligent robot inspection system
CN102636434A (en) * 2012-02-26 2012-08-15 曾吕明 Portable three-dimensional visual photoacoustic imaging system
CN202649176U (en) * 2012-06-13 2013-01-02 云南电力试验研究院(集团)有限公司电力研究院 Ultrasonic endoscope real-time scanning and detecting device for electric powder
CN103969561A (en) * 2014-05-28 2014-08-06 上海艾飞能源科技有限公司 Visual ultrasonic detection method for partial discharge failure detection

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106228472A (en) * 2016-08-26 2016-12-14 云南电网有限责任公司普洱供电局 A kind of substation equipment intelligent patrol detection failure analysis methods
CN106228472B (en) * 2016-08-26 2017-12-22 云南电网有限责任公司普洱供电局 A kind of substation equipment intelligent patrol detection failure analysis methods
CN109030562A (en) * 2016-10-26 2018-12-18 王琪 The detection method of geared cable aging lateral position
CN106932692A (en) * 2017-03-07 2017-07-07 北京瑞盈智拓科技发展有限公司 Detection means and detection method based on infrared and ultraviolet visual image fusion
CN108731814A (en) * 2017-04-21 2018-11-02 富泰华工业(深圳)有限公司 Mainboard analytical equipment and method
CN107843818A (en) * 2017-09-06 2018-03-27 同济大学 Based on heterologous image temperature rise and local discharge characteristic high-voltage isulation method for diagnosing faults
CN109100364A (en) * 2018-06-29 2018-12-28 杭州国翌科技有限公司 A kind of tunnel defect monitoring system and monitoring method based on spectrum analysis
CN111678926A (en) * 2020-06-16 2020-09-18 南京工业职业技术学院 A scanning and mapping system for corrosion of tank wall and bottom plate
CN111832763A (en) * 2020-08-13 2020-10-27 国网河南省电力公司灵宝市供电公司 A device defect detection and query system
CN112419301A (en) * 2020-12-03 2021-02-26 国网山西省电力公司大同供电公司 Power equipment defect diagnosis device and method based on multi-source data fusion
CN112698169A (en) * 2021-01-11 2021-04-23 中国科学院声学研究所 Corona discharge positioning method and device, electronic equipment and storage medium
CN112698169B (en) * 2021-01-11 2022-02-01 中国科学院声学研究所 Corona discharge positioning method and device, electronic equipment and storage medium
CN114295154A (en) * 2021-10-21 2022-04-08 重庆华网智能传感器研究院股份有限公司 Multifunctional array sensor monitoring method, system, medium, networking and inspection equipment
CN115775248A (en) * 2022-12-14 2023-03-10 西安电子科技大学 Fault Diagnosis Method of Circuit Infrared Heat Map Based on Transmission Transformation and Convolutional Neural Network
CN116228778A (en) * 2023-05-10 2023-06-06 国网山东省电力公司菏泽供电公司 Insulator rupture detection method and system based on multi-mode information fusion
CN116228778B (en) * 2023-05-10 2023-09-08 国网山东省电力公司菏泽供电公司 A detection method and system for insulator rupture based on multi-modal information fusion

Similar Documents

Publication Publication Date Title
CN105486751A (en) Equipment defect comprehensive detection system
CN105510787A (en) Portable ultrasonic, infrared and ultraviolet detector based on image synthesis technology
CN205507005U (en) Portable supersound, infrared, ultraviolet detector
CN103868460B (en) Binocular stereo vision method for automatic measurement based on parallax optimized algorithm
CN106780725A (en) A kind of binocular three-dimensional reconstructing method and system
CN105741379A (en) Method for panoramic inspection on substation
CN111753712A (en) Power production personnel safety monitoring method, system and equipment
CN104361314A (en) Method and device for positioning power transformation equipment on basis of infrared and visible image fusion
CN102927448A (en) Undamaged detection method for pipeline
CN112686938A (en) Electric transmission line clear distance calculation and safety warning method based on binocular image ranging
CN109034272A (en) A kind of transmission line of electricity heat generating components automatic identifying method
CN103440389A (en) Infrared camouflage effect simulation system and infrared camouflage effect evaluation method based on full link
CN109272484B (en) A Rainfall Detection Method Based on Video Image
CN108830840A (en) A kind of active intelligent detecting method of circuit board defect and its application
CN109523528A (en) A kind of transmission line of electricity extracting method based on unmanned plane binocular vision SGC algorithm
CN110045242B (en) Method, system, medium and equipment for monitoring arc light in switch cabinet
CN113762161A (en) Intelligent obstacle monitoring method and system
CN113421301A (en) Method and system for positioning central area of field crop
CN108898187A (en) A kind of method and device of automatic identification power distribution room indicating equipment image
CN115909025A (en) Terrain vision autonomous detection and identification method for small celestial body surface sampling point
CN107977938A (en) A Kinect Depth Image Restoration Method Based on Light Field
CN101122540A (en) Laser imaging SF6 leakage positioning device
CN113884017B (en) Non-contact deformation detection method and system for insulator based on three-eye vision
CN118864276A (en) Substation defect early warning method and device based on image fusion
CN119375540A (en) A high-altitude non-contact electrical testing method for unmanned aerial vehicles

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20160413