CN111652857B - A kind of infrared detection method of insulator defect - Google Patents
A kind of infrared detection method of insulator defect Download PDFInfo
- Publication number
- CN111652857B CN111652857B CN202010432395.8A CN202010432395A CN111652857B CN 111652857 B CN111652857 B CN 111652857B CN 202010432395 A CN202010432395 A CN 202010432395A CN 111652857 B CN111652857 B CN 111652857B
- Authority
- CN
- China
- Prior art keywords
- insulator
- image
- grayscale
- images
- segmentation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 239000012212 insulator Substances 0.000 title claims abstract description 298
- 238000001514 detection method Methods 0.000 title claims abstract description 59
- 230000007547 defect Effects 0.000 title claims abstract description 36
- 238000007781 pre-processing Methods 0.000 claims abstract description 38
- 230000011218 segmentation Effects 0.000 claims abstract description 28
- 238000000034 method Methods 0.000 claims abstract description 21
- 238000012545 processing Methods 0.000 claims abstract description 16
- 238000001914 filtration Methods 0.000 claims abstract description 12
- 238000004880 explosion Methods 0.000 claims description 14
- 230000003628 erosive effect Effects 0.000 claims description 12
- 238000003709 image segmentation Methods 0.000 claims description 11
- 239000011159 matrix material Substances 0.000 claims description 10
- 230000000877 morphologic effect Effects 0.000 claims description 6
- 239000000428 dust Substances 0.000 claims description 4
- 230000010339 dilation Effects 0.000 claims description 3
- 230000001131 transforming effect Effects 0.000 claims 1
- 230000005540 biological transmission Effects 0.000 description 9
- 239000000284 extract Substances 0.000 description 6
- 238000007689 inspection Methods 0.000 description 6
- 238000011160 research Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 5
- 230000002159 abnormal effect Effects 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 4
- 230000009466 transformation Effects 0.000 description 4
- 238000000605 extraction Methods 0.000 description 3
- 238000010845 search algorithm Methods 0.000 description 3
- 230000005856 abnormality Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000012937 correction Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 238000000844 transformation Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000004020 conductor Substances 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000007797 corrosion Effects 0.000 description 1
- 238000005260 corrosion Methods 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 230000000246 remedial effect Effects 0.000 description 1
- 238000004904 shortening Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/8851—Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/94—Investigating contamination, e.g. dust
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/95—Investigating the presence of flaws or contamination characterised by the material or shape of the object to be examined
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N25/00—Investigating or analyzing materials by the use of thermal means
- G01N25/72—Investigating presence of flaws
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/70—Denoising; Smoothing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/11—Region-based segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/187—Segmentation; Edge detection involving region growing; involving region merging; involving connected component labelling
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/26—Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
- G06V10/267—Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion by performing operations on regions, e.g. growing, shrinking or watersheds
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/30—Noise filtering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
- G06V20/13—Satellite images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10048—Infrared image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20024—Filtering details
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20036—Morphological image processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Immunology (AREA)
- Pathology (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- General Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Remote Sensing (AREA)
- Astronomy & Astrophysics (AREA)
- Quality & Reliability (AREA)
- Signal Processing (AREA)
- Radiation Pyrometers (AREA)
- Image Processing (AREA)
- Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
- Image Analysis (AREA)
Abstract
Description
技术领域technical field
本发明涉及绝缘子缺陷红外识别技术领域,尤其涉及一种绝缘子缺陷红外检测方法。The invention relates to the technical field of infrared identification of insulator defects, in particular to an infrared detection method of insulator defects.
背景技术Background technique
随着智能电网建设的日益推进,对输电线路巡检智能化的要求越来越高,使用基于图像识别技术的巡检机器人和无人机逐步替代烦琐的人工巡检和昂贵的直升机巡检已成为必然的趋势。绝缘子是输电线路中最常见的部件,一旦发生故障,就会导致输电线与输电线之间或输电线与塔台之间发生接触,导致供电中断,严重时甚至会发生大范围停电的事故。由于长时间暴露在野外,常受到暴风、雨、雪等恶劣环境的侵蚀,绝缘子不可避免的会出现各种故障: 自爆、闪络放电、异物、掉串等问题。其中绝缘子片自爆问题是最常见且急需解决的一种缺陷,主要出现在玻璃绝缘子上。正确识别定位玻璃绝缘子,找到自爆缺陷并及时采取补救措施,从而利于输电线路的有效利用及其寿命的延长。传统的绝缘子自爆缺陷的检测方法需要大量的工作人员人工判读,耗时耗力,效率低下,成本高昂。With the increasing development of smart grid construction, the requirements for intelligent inspection of transmission lines are getting higher and higher. The use of inspection robots and drones based on image recognition technology to gradually replace cumbersome manual inspections and expensive helicopter inspections has been become an inevitable trend. Insulators are the most common components in transmission lines. Once a fault occurs, it will lead to contact between transmission lines and transmission lines or between transmission lines and towers, resulting in interruption of power supply, and even large-scale power outages in severe cases. Due to long-term exposure to the wild, it is often eroded by harsh environments such as storms, rain, and snow. Insulators will inevitably experience various failures: self-explosion, flashover discharge, foreign objects, and dropped strings. Among them, the self-explosion problem of insulator sheets is the most common and urgently needed defect, which mainly occurs on glass insulators. Correctly identify and locate glass insulators, find self-explosion defects and take remedial measures in time, so as to facilitate the effective use of transmission lines and prolong their life. The traditional detection method of insulator self-explosion defect requires a large number of workers to manually interpret, which is time-consuming, labor-intensive, inefficient and expensive.
传统的绝缘子自爆缺陷的检测方法需要大量的工作人员人工判读,耗时耗力,效率低下,成本高昂;在此背景下,无人机在电力巡检中得到了广泛的应用。目前,国内外关于绝缘子缺陷检测的相关研究有深度学习技术、计算机视觉技术、图像识别技术等方面;但是,这些绝缘子缺陷检测技术仍存在着许多问题,难以满足当前绝缘子缺陷的故障识别要求,一种合适的绝缘子缺陷红外识别方法是非常有必要的。The traditional detection method of insulator self-explosion defect requires a large number of workers to manually interpret, which is time-consuming, labor-intensive, inefficient and expensive. In this context, drones have been widely used in power inspection. At present, related researches on insulator defect detection at home and abroad include deep learning technology, computer vision technology, image recognition technology, etc. However, there are still many problems in these insulator defect detection technologies, and it is difficult to meet the current fault identification requirements of insulator defects. A suitable infrared identification method for insulator defects is very necessary.
现有技术问题及思考:Existing technical problems and thinking:
如何解决识别绝缘子缺陷的技术问题。How to solve the technical problem of identifying insulator defects.
发明内容SUMMARY OF THE INVENTION
本发明所要解决的技术问题是提供一种绝缘子缺陷红外检测方法,其通过S1图像预处理、S2绝缘子分割和S3绝缘子故障检测的步骤等,实现了识别绝缘子缺陷。The technical problem to be solved by the present invention is to provide an infrared detection method for insulator defects, which realizes the identification of insulator defects through the steps of S1 image preprocessing, S2 insulator segmentation, and S3 insulator fault detection.
为解决上述技术问题,本发明所采取的技术方案是:一种绝缘子缺陷红外检测方法包括S1图像预处理、S2绝缘子分割和S3绝缘子故障检测的步骤,所述步骤S1图像预处理,将采集到的绝缘子航拍图像进行灰度化处理并得到灰度化图像,根据灰度化图像的灰度规律对灰度化图像进行分段线性拉伸并得到灰度化拉伸图像,对灰度化拉伸图像进行滤波处理并得到预处理图像。In order to solve the above technical problems, the technical solution adopted in the present invention is: an infrared detection method for insulator defects includes the steps of S1 image preprocessing, S2 insulator segmentation and S3 insulator fault detection. The insulator aerial image is grayscaled to obtain a grayscale image, and the grayscale image is segmented linearly stretched according to the grayscale law of the grayscale image to obtain a grayscale stretched image. The stretched image is filtered and the preprocessed image is obtained.
进一步的技术方案在于:所述步骤S2绝缘子分割,对预处理图像进行绝缘子串区域定位,从候选区域中提取绝缘子图像。A further technical solution is: in the step S2, insulator segmentation is performed, insulator string region positioning is performed on the preprocessed image, and an insulator image is extracted from the candidate region.
进一步的技术方案在于:所述步骤S2绝缘子分割包括S201绝缘子识别与定位和S202绝缘子图像分割的步骤,在所述步骤S201绝缘子识别与定位中,根据预处理图像的灰度方差进行图像分类并得到分类图像,分类图像包括简单背景图像和复杂背景图像,当灰度方差>50为简单背景图像,当灰度方差≤50为复杂背景图像,采用像素点稀疏算法对简单背景图像进行处理或者将复杂背景图像转换至HSI颜色空间,然后进行图像滤波和图像腐蚀,利用图像运算得到骨架化图像。A further technical solution is that: the step S2 insulator segmentation includes the steps of S201 insulator identification and positioning and S202 insulator image segmentation, and in the step S201 insulator identification and positioning, according to the grayscale variance of the preprocessed image The image is classified and obtained. Classified images, classified images include simple background images and complex background images. When the grayscale variance is greater than 50, it is a simple background image, and when the grayscale variance is less than or equal to 50, it is a complex background image. The pixel point sparse algorithm is used to process the simple background image or the complex background image. The background image is converted to HSI color space, and then image filtering and image erosion are performed, and the skeletonized image is obtained by image operation.
进一步的技术方案在于:在所述步骤S201绝缘子识别与定位中,得到骨架化图像之后,采用模糊计票的Hough变换算法检测并获得骨架化图像中的直线,根据设定的绝缘子串的直线长度筛选所有直线并获得绝缘子中轴线的候选直线,通过限定检测长度排除干扰并确定绝缘子主轴待选区域。A further technical solution is: in the step S201 insulator identification and positioning, after the skeletonized image is obtained, the Hough transform algorithm of fuzzy counting is used to detect and obtain the straight line in the skeletonized image, according to the set straight line length of the insulator string. Screen all straight lines and obtain candidate straight lines for the central axis of the insulator, eliminate interference by limiting the detection length, and determine the candidate area for the main axis of the insulator.
进一步的技术方案在于:在所述步骤S201绝缘子识别与定位中,在确定绝缘子主轴待选区域之后,在候选直线斜率垂直方向,采用广义Hough变换算法检测并获得圆盘状的曲线即圆盘型分布的点,对每一待选区域邻域内检测并获得圆盘状的曲线的数量即圆盘数量,当邻域内的圆盘数量超过设定阈值,则判定该处为绝缘子串并实现绝缘子串的精细定位。A further technical solution is: in the step S201 insulator identification and positioning, after determining the to-be-selected area of the insulator main axis, in the vertical direction of the slope of the candidate straight line, a generalized Hough transform algorithm is used to detect and obtain a disc-shaped curve, that is, a disc-shaped curve. Distributed points, detect and obtain the number of disk-shaped curves in the neighborhood of each candidate area, that is, the number of disks. When the number of disks in the neighborhood exceeds the set threshold, it is determined that the place is an insulator string and the insulator string is realized. fine positioning.
进一步的技术方案在于:在所述步骤S202绝缘子图像分割中,根据精细定位从预处理图像中提取并获得绝缘子预处理图像,对绝缘子预处理图像进行腐蚀运算、提取最大联通域和膨胀运算处理并获得绝缘子区域图像。A further technical solution is: in the step S202 insulator image segmentation, extracting and obtaining the insulator pre-processing image from the pre-processing image according to the fine positioning, performing corrosion operation on the insulator pre-processing image, extracting the maximum connected domain and dilation operation processing, and then processing the insulator pre-processing image. Obtain an image of the insulator region.
进一步的技术方案在于:在所述步骤S3绝缘子故障检测中,基于绝缘子区域图像,根据绝缘子中轴线方程进行绝缘子方向矫正,依据形态特征对绝缘子串进行分割,得到单个绝缘子图像。A further technical solution is: in the step S3 insulator fault detection, based on the insulator area image, the insulator direction is corrected according to the insulator central axis equation, and the insulator string is divided according to the morphological characteristics to obtain a single insulator image.
进一步的技术方案在于:在所述步骤S3绝缘子故障检测中,在得到单个绝缘子图像之后,通过分析计算相邻绝缘子横轴线间距的变化规律,进行绝缘子自爆故障检测。A further technical solution is: in the step S3 insulator fault detection, after a single insulator image is obtained, the insulator self-explosion fault detection is performed by analyzing and calculating the variation law of the horizontal axis spacing of adjacent insulators.
进一步的技术方案在于:在所述步骤S3绝缘子故障检测中,在得到单个绝缘子图像之后,通对计算图像灰度共生矩阵,得到单个绝缘子图像的纹理特征,判断绝缘子的覆尘污渍缺陷以及裂纹故障情况。A further technical solution is: in the step S3 insulator fault detection, after a single insulator image is obtained, the image grayscale co-occurrence matrix is calculated to obtain the texture features of the single insulator image, and the dust-covered stain defects and crack faults of the insulator are judged. Happening.
进一步的技术方案在于:在所述步骤S3绝缘子故障检测中,在得到单个绝缘子图像之后,依据红外图像对温度敏感的特性,检测零值绝缘子故障。A further technical solution is: in the step S3 insulator fault detection, after a single insulator image is obtained, the zero-value insulator fault is detected according to the temperature-sensitive characteristic of the infrared image.
采用上述技术方案所产生的有益效果在于:The beneficial effects produced by the above technical solutions are:
第一,一种绝缘子缺陷红外检测方法包括S1图像预处理、S2绝缘子分割和S3绝缘子故障检测的步骤,所述步骤S1图像预处理,将采集到的绝缘子航拍图像进行灰度化处理并得到灰度化图像,根据灰度化图像的灰度规律对灰度化图像进行分段线性拉伸并得到灰度化拉伸图像,对灰度化拉伸图像进行滤波处理并得到预处理图像。该技术方案,其通过S1图像预处理、S2绝缘子分割和S3绝缘子故障检测的步骤等,实现了识别绝缘子缺陷。First, an infrared detection method for insulator defects includes the steps of S1 image preprocessing, S2 insulator segmentation, and S3 insulator fault detection. In the step S1 image preprocessing, the collected aerial images of insulators are subjected to grayscale processing to obtain grayscale images. According to the grayscale law of the grayscale image, piecewise linear stretch is performed on the grayscale image to obtain a grayscale stretched image, and the grayscale stretched image is filtered to obtain a preprocessed image. The technical solution realizes the identification of insulator defects through the steps of S1 image preprocessing, S2 insulator segmentation, and S3 insulator fault detection.
第二,所述步骤S2绝缘子分割,对预处理图像进行绝缘子串区域定位,从候选区域中提取绝缘子图像。该技术方案,运算效率较好,识别正确率较高。Second, in the step S2, insulator segmentation is performed, insulator string region positioning is performed on the preprocessed image, and an insulator image is extracted from the candidate region. The technical solution has better operation efficiency and higher recognition accuracy.
第三,所述步骤S2绝缘子分割包括S201绝缘子识别与定位和S202绝缘子图像分割的步骤,在所述步骤S201绝缘子识别与定位中,根据预处理图像的灰度方差进行图像分类并得到分类图像,分类图像包括简单背景图像和复杂背景图像,当灰度方差>50为简单背景图像,当灰度方差≤50为复杂背景图像,采用像素点稀疏算法对简单背景图像进行处理或者将复杂背景图像转换至HSI颜色空间,然后进行图像滤波和图像腐蚀,利用图像运算得到骨架化图像。该技术方案,运算效率较好,识别正确率较高。Third, the step S2 insulator segmentation includes the steps of S201 insulator identification and positioning and S202 insulator image segmentation. In the step S201 insulator identification and positioning, image classification is performed according to the grayscale variance of the preprocessed image and a classified image is obtained, The classified images include simple background images and complex background images. When the grayscale variance is greater than 50, it is a simple background image. When the grayscale variance is less than or equal to 50, it is a complex background image. The pixel sparse algorithm is used to process the simple background image or convert the complex background image. To the HSI color space, then image filtering and image erosion are performed, and the skeletonized image is obtained by image operation. The technical solution has better operation efficiency and higher recognition accuracy.
第四,在所述步骤S201绝缘子识别与定位中,得到骨架化图像之后,采用模糊计票的Hough变换算法检测并获得骨架化图像中的直线,根据设定的绝缘子串的直线长度筛选所有直线并获得绝缘子中轴线的候选直线,通过限定检测长度排除干扰并确定绝缘子主轴待选区域。该技术方案,运算效率较好,识别正确率较高。Fourth, in the step S201 insulator identification and positioning, after the skeletonized image is obtained, the Hough transform algorithm of fuzzy counting is used to detect and obtain the straight lines in the skeletonized image, and all straight lines are screened according to the set straight line length of the insulator string. And obtain the candidate straight line of the central axis of the insulator, eliminate the interference by limiting the detection length, and determine the candidate area of the main axis of the insulator. The technical solution has better operation efficiency and higher recognition accuracy.
第五,在所述步骤S201绝缘子识别与定位中,在确定绝缘子主轴待选区域之后,在候选直线斜率垂直方向,采用广义Hough变换算法检测并获得圆盘状的曲线即圆盘型分布的点,对每一待选区域邻域内检测并获得圆盘状的曲线的数量即圆盘数量,当邻域内的圆盘数量超过设定阈值,则判定该处为绝缘子串并实现绝缘子串的精细定位。该技术方案,运算效率较好,识别正确率较高。Fifth, in the step S201 insulator identification and positioning, after determining the area to be selected for the main axis of the insulator, in the vertical direction of the slope of the candidate straight line, the generalized Hough transform algorithm is used to detect and obtain a disc-shaped curve, that is, a disc-shaped distribution point. , detect and obtain the number of disc-shaped curves in the neighborhood of each candidate area, that is, the number of discs. When the number of discs in the neighborhood exceeds the set threshold, it is determined that the place is an insulator string and the fine positioning of the insulator string is realized. . The technical solution has better operation efficiency and higher recognition accuracy.
第六,在所述步骤S202绝缘子图像分割中,根据精细定位从预处理图像中提取并获得绝缘子预处理图像,对绝缘子预处理图像进行腐蚀运算、提取最大联通域和膨胀运算处理并获得绝缘子区域图像。该技术方案,运算效率较好,识别正确率较高。Sixth, in the step S202 insulator image segmentation, extract and obtain the insulator pre-processing image from the pre-processing image according to the fine positioning, perform erosion operation on the insulator pre-processing image, extract the maximum connected domain and dilate operation processing, and obtain the insulator area. image. The technical solution has better operation efficiency and higher recognition accuracy.
第七,在所述步骤S3绝缘子故障检测中,基于绝缘子区域图像,根据绝缘子中轴线方程进行绝缘子方向矫正,依据形态特征对绝缘子串进行分割,得到单个绝缘子图像。该技术方案,运算效率较好,识别正确率较高。Seventh, in the step S3 insulator fault detection, based on the insulator area image, the insulator direction is corrected according to the insulator central axis equation, and the insulator string is divided according to the morphological characteristics to obtain a single insulator image. The technical solution has better operation efficiency and higher recognition accuracy.
第八,在所述步骤S3绝缘子故障检测中,在得到单个绝缘子图像之后,通过分析计算相邻绝缘子横轴线间距的变化规律,进行绝缘子自爆故障检测。该技术方案,运算效率较好,识别正确率较高。Eighth, in the step S3 insulator fault detection, after a single insulator image is obtained, the insulator self-explosion fault detection is performed by analyzing and calculating the variation law of the spacing between the horizontal axes of adjacent insulators. The technical solution has better operation efficiency and higher recognition accuracy.
第九,在所述步骤S3绝缘子故障检测中,在得到单个绝缘子图像之后,通对计算图像灰度共生矩阵,得到单个绝缘子图像的纹理特征,判断绝缘子的覆尘污渍缺陷以及裂纹故障情况。该技术方案,运算效率较好,识别正确率较高。Ninth, in the step S3 insulator fault detection, after a single insulator image is obtained, the grayscale co-occurrence matrix of the image is calculated to obtain the texture features of the single insulator image, and the dust and stain defects and crack faults of the insulator are judged. The technical solution has better operation efficiency and higher recognition accuracy.
第十,在所述步骤S3绝缘子故障检测中,在得到单个绝缘子图像之后,依据红外图像对温度敏感的特性,检测零值绝缘子故障。该技术方案,运算效率较好,识别正确率较高。Tenth, in the step S3 insulator fault detection, after a single insulator image is obtained, the zero-value insulator fault is detected according to the temperature-sensitive characteristic of the infrared image. The technical solution has better operation efficiency and higher recognition accuracy.
详见具体实施方式部分描述。For details, please refer to the description in the detailed description.
附图说明Description of drawings
图1是本发明的流程图;Fig. 1 is the flow chart of the present invention;
图2是本发明中绝缘子分割算法的流程图;Fig. 2 is the flow chart of insulator segmentation algorithm in the present invention;
图3是本发明中精细定位算法的流程图;Fig. 3 is the flow chart of fine positioning algorithm in the present invention;
图4是本发明中稀疏算法的流程图。FIG. 4 is a flow chart of the sparse algorithm in the present invention.
具体实施方式Detailed ways
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。以下对至少一个示例性实施例的描述实际上仅仅是说明性的,决不作为对本申请及其应用或使用的任何限制。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all of the embodiments. The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the application, its application, or uses. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.
在下面的描述中阐述了很多具体细节以便于充分理解本申请,但是本申请还可以采用其他不同于在此描述的其它方式来实施,本领域技术人员可以在不违背本申请内涵的情况下做类似推广,因此本申请不受下面公开的具体实施例的限制。In the following description, many specific details are set forth to facilitate a full understanding of the present application, but the present application can also be implemented in other ways different from those described herein, and those skilled in the art can do so without departing from the connotation of the present application Similar promotion, therefore, the present application is not limited by the specific embodiments disclosed below.
如图1~图4所示,本发明公开了一种绝缘子缺陷红外检测方法包括如下步骤:As shown in FIG. 1 to FIG. 4 , the present invention discloses an infrared detection method for insulator defects, which includes the following steps:
S1图像预处理S1 image preprocessing
将采集到的绝缘子航拍图像进行灰度化处理并得到灰度化图像,根据灰度化图像的灰度规律对灰度化图像进行分段线性拉伸并得到灰度化拉伸图像,对灰度化拉伸图像进行滤波处理并得到预处理图像。The collected aerial images of insulators are subjected to grayscale processing to obtain a grayscale image. According to the grayscale law of the grayscale image, the grayscale image is segmented and linearly stretched to obtain a grayscale stretched image. The scaled stretched image is filtered and the preprocessed image is obtained.
S2绝缘子分割S2 insulator segmentation
对预处理图像进行绝缘子串区域定位,从候选区域中提取绝缘子图像。Perform insulator string area localization on the preprocessed image, and extract the insulator image from the candidate area.
S201绝缘子识别与定位S201 insulator identification and positioning
根据预处理图像的灰度方差进行图像分类并得到分类图像,分类图像包括简单背景图像和复杂背景图像,当灰度方差>50为简单背景图像,当灰度方差≤50为复杂背景图像,采用像素点稀疏算法对简单背景图像进行处理或者将复杂背景图像转换至HSI颜色空间,然后进行图像滤波和图像腐蚀,利用图像运算得到骨架化图像,采用模糊计票的Hough变换算法检测并获得骨架化图像中的直线,根据设定的绝缘子串的直线长度筛选所有直线并获得绝缘子中轴线的候选直线,通过限定检测长度排除干扰并确定绝缘子主轴待选区域,在候选直线斜率垂直方向,采用广义Hough变换算法检测并获得圆盘状的曲线即圆盘型分布的点,对每一待选区域邻域内检测并获得圆盘状的曲线的数量即圆盘数量,当邻域内的圆盘数量超过设定阈值,则判定该处为绝缘子串并实现绝缘子串的精细定位。Image classification is performed according to the grayscale variance of the preprocessed image to obtain the classified image. The classified images include simple background images and complex background images. When the grayscale variance >50, it is a simple background image, and when the grayscale variance is less than or equal to 50, it is a complex background image. The pixel point sparse algorithm processes simple background images or converts complex background images to HSI color space, then performs image filtering and image erosion, uses image operations to obtain skeletonized images, and uses Hough transform algorithm for fuzzy counting to detect and obtain skeletonized images. For the straight line in the image, screen all straight lines according to the set straight line length of the insulator string and obtain the candidate straight line of the central axis of the insulator. By limiting the detection length, the interference is eliminated and the candidate area of the main axis of the insulator is determined. In the vertical direction of the slope of the candidate straight line, the generalized Hough is adopted. The transformation algorithm detects and obtains the disc-shaped curve, that is, the points of the disc-shaped distribution. The number of disc-shaped curves detected and obtained in the neighborhood of each candidate area is the number of discs. When the number of discs in the neighborhood exceeds the set value. If the threshold is set, it is determined that this place is an insulator string and the fine positioning of the insulator string is realized.
S202绝缘子图像分割S202 insulator image segmentation
根据精细定位从预处理图像中提取并获得绝缘子预处理图像,对绝缘子预处理图像进行腐蚀运算、提取最大联通域和膨胀运算处理并获得绝缘子区域图像。The insulator preprocessing image is extracted and obtained from the preprocessing image according to the fine positioning, the insulator preprocessing image is corroded, the maximum connected domain is extracted and the dilation operation is processed, and the insulator region image is obtained.
S3绝缘子故障检测S3 insulator fault detection
基于绝缘子区域图像,根据绝缘子中轴线方程进行绝缘子方向矫正,依据形态特征对绝缘子串进行分割,得到单个绝缘子图像,通过分析计算相邻绝缘子横轴线间距的变化规律,进行绝缘子自爆故障检测;通对计算图像灰度共生矩阵,得到单个绝缘子图像的纹理特征,判断绝缘子的覆尘污渍缺陷以及裂纹故障情况;依据红外图像对温度敏感的特性,检测零值绝缘子故障。Based on the image of the insulator area, the direction of the insulator is corrected according to the equation of the central axis of the insulator, the insulator string is divided according to the morphological characteristics, and a single insulator image is obtained. The grayscale co-occurrence matrix of the image is calculated to obtain the texture characteristics of a single insulator image, and the dust and stain defects and crack faults of the insulator are judged. According to the temperature-sensitive characteristics of the infrared image, the fault of the zero-value insulator is detected.
本申请的技术特点:Technical features of this application:
本发明针对绝缘子缺陷红外识别的方法,具体包括了绝缘子航拍图像的预处理、绝缘子航拍图像的分割、基于航拍图像的绝缘子故障红外检测三个主要方面解决了相关技术问题。The invention aims at the infrared identification method of insulator defects, which specifically includes three main aspects: preprocessing of insulator aerial photography images, segmentation of insulator aerial photography images, and infrared detection of insulator faults based on aerial photography images, and solves the related technical problems.
一、绝缘子航拍图像的预处理:本专利首先通过对采集到的图像数据进行灰度化处理,减少运算数据量。再根据绝缘子数据的灰度规律对图像进行分段线性拉伸,突出目标绝缘子区域。最后对图像进行滤波处理,对图像数据在采集和传输的过程中可能出现的噪声进行降噪处理。1. Preprocessing of aerial photography images of insulators: This patent firstly reduces the amount of computational data by performing grayscale processing on the collected image data. Then, according to the grayscale law of the insulator data, the image is segmented and linearly stretched to highlight the target insulator area. Finally, the image is filtered, and the noise that may appear in the process of image data acquisition and transmission is denoised.
二、绝缘子航拍图像的分割:本专利结合绝缘子图像的特异性特征,引入图像的灰度方差来进行图像分类。对于灰度方差,简单背景图像数值较大,均大于 50,而复杂背景图像均小于 50。对于简单背景图像,通过一种像素点稀疏算法减少运算数据量;对于复杂背景图像,通过将图像转换至 HSI 颜色空间后运算,优化图像质量,再通过图像滤波和图像腐蚀,突出目标特征。针对复杂背景处理后图像质量问题,对霍夫变换计票方式进行改进。本专利提出一种候选区域内的搜寻算法,最终定位绝缘子串。最后在中轴区域内使用图像开运算与最大联通域提取混合算法,最终实现绝缘子区域的分割。2. Segmentation of aerial photography images of insulators: This patent combines the specific features of insulator images and introduces the grayscale variance of images to classify images. For grayscale variance, simple background images have larger values, all greater than 50, while complex background images are all less than 50. For simple background images, a pixel sparse algorithm is used to reduce the amount of computational data; for complex background images, the image quality is optimized by converting the image to HSI color space, and then image filtering and image erosion are used to highlight the target features. Aiming at the problem of image quality after complex background processing, the Hough transform vote counting method is improved. This patent proposes a search algorithm in the candidate area to finally locate the insulator string. Finally, the hybrid algorithm of image opening operation and maximum connected domain extraction is used in the central axis area, and finally the segmentation of the insulator area is realized.
三、基于航拍图像的绝缘子故障红外检测:首先对图像中的绝缘子中轴进行基于中轴线斜率的方向矫正。再通过绝缘子横轴的分布规律,将绝缘子串分割为单个独立的绝缘子。对于自爆故障,利用绝缘子横轴间距的单调性,对不规则处进行检出判定;对于绝缘子污渍故障,利用一种绝缘子灰度差分横向比较的算法,检测得到故障区域;对于绝缘子温度异常故障,利用红外图像的温度敏感转换为灰度变换的特征,设计识别算法检测异常。3. Infrared detection of insulator faults based on aerial images: First, the direction correction based on the slope of the central axis is performed on the central axis of the insulator in the image. Then, according to the distribution law of the horizontal axis of the insulator, the insulator string is divided into a single independent insulator. For the self-explosion fault, the monotonicity of the insulator horizontal axis spacing is used to detect and determine the irregularities; for the insulator stain fault, an algorithm for horizontal comparison of the insulator grayscale difference is used to detect the fault area; for the abnormal temperature of the insulator fault, Using the characteristics of temperature-sensitive conversion of infrared images into grayscale transformations, a recognition algorithm is designed to detect abnormalities.
本申请的技术贡献:Technical contributions of this application:
本发明提出一种绝缘子缺陷红外识别方法具体包括了绝缘子航拍图像的预处理、绝缘子航拍图像的分割、基于航拍图像的绝缘子故障红外检测三个主要方面。The invention provides an infrared identification method for insulator defects, which specifically includes three main aspects: preprocessing of insulator aerial images, segmentation of insulator aerial images, and infrared detection of insulator faults based on aerial images.
一、绝缘子航拍图像的预处理。由于无人机搭载相机拍摄时还是存在些许不稳定的情况,再加上天气、日照和风向的原因,获取的图像数据可能会存在一些质量上的瑕疵,包括有噪声干扰以及对比度不足等,为了后续步骤的精准,需对采集到的图像进行预处理。由于采集的图像为三维 RGB 图像,而在对绝缘子自爆、污渍以及异常温度故障检测时,图像色彩信息影响较小,为了减少数据量,故本专利对简单背景图像处理时,采用灰度图像。为了使绝缘子缺陷更加明显,本专利提出一种基于经验的线性变换来增强图像。对于有噪点的图像,要对图像进行去噪处理。1. Preprocessing of aerial images of insulators. Due to some instability when the drone is equipped with a camera, coupled with the weather, sunshine and wind direction, the obtained image data may have some quality defects, including noise interference and insufficient contrast. In order to The accuracy of the subsequent steps requires preprocessing of the collected images. Since the collected image is a three-dimensional RGB image, the color information of the image has little effect on the detection of insulator self-explosion, stains and abnormal temperature faults. In order to reduce the amount of data, this patent uses grayscale images when processing simple background images. In order to make the insulator defects more obvious, this patent proposes an experience-based linear transformation to enhance the image. For noisy images, denoise the image.
二、绝缘子航拍图像的分割。本专利结合绝缘子图像的特异性特征,引入图像的灰度方差来进行图像分类。对于灰度方差,简单背景图像数值较大,均大于 50,而复杂背景图像均小于 50。对于简单背景图像,通过一种像素点稀疏算法减少运算数据量;对于复杂背景图像,通过将图像转换至 HSI 颜色空间后运算,优化图像质量,再通过图像滤波和图像腐蚀,突出目标特征。针对复杂背景处理后图像质量问题,对霍夫变换计票方式进行改进。本专利提出一种候选区域内的搜寻算法,最终定位绝缘子串。最后在中轴区域内使用图像开运算与最大联通域提取混合算法,最终实现绝缘子区域的分割。2. Segmentation of aerial images of insulators. This patent combines the specific features of the insulator image and introduces the grayscale variance of the image for image classification. For grayscale variance, simple background images have larger values, all greater than 50, while complex background images are all less than 50. For simple background images, a pixel sparse algorithm is used to reduce the amount of computational data; for complex background images, the image quality is optimized by converting the image to HSI color space, and then image filtering and image erosion are used to highlight the target features. Aiming at the problem of image quality after complex background processing, the Hough transform vote counting method is improved. This patent proposes a search algorithm in the candidate area to finally locate the insulator string. Finally, the hybrid algorithm of image opening operation and maximum connected domain extraction is used in the central axis area, and finally the segmentation of the insulator area is realized.
三、基于航拍图像的绝缘子故障红外检测。本专利采用同时同位置拍摄的可见光以及红外图像,实现绝缘子故障的综合检测。首先对图像中的绝缘子中轴进行基于中轴线斜率的方向矫正。再通过绝缘子横轴的分布规律,将绝缘子串分割为单个独立的绝缘子。对于自爆故障,利用绝缘子横轴间距的单调性,对不规则处进行检出判定;对于绝缘子污渍故障,利用一种绝缘子灰度差分横向比较的算法,检测得到故障区域;对于绝缘子温度异常故障,利用红外图像的温度敏感转换为灰度变换的特征,设计识别算法检测异常。3. Infrared detection of insulator faults based on aerial images. This patent uses visible light and infrared images taken at the same location at the same time to realize comprehensive detection of insulator faults. Firstly, the direction correction based on the slope of the central axis is performed on the central axis of the insulator in the image. Then, according to the distribution law of the horizontal axis of the insulator, the insulator string is divided into a single independent insulator. For the self-explosion fault, the monotonicity of the insulator horizontal axis spacing is used to detect and determine the irregularities; for the insulator stain fault, an algorithm for horizontal comparison of the insulator grayscale difference is used to detect the fault area; for the abnormal temperature of the insulator fault, Using the characteristics of temperature-sensitive conversion of infrared images into grayscale transformations, a recognition algorithm is designed to detect abnormalities.
技术方案说明:Technical solution description:
如图1所示,是本专利研究路线流程图。本专利的研究对象是航拍绝缘子的可见光与红外图像,主要研究内容如下:As shown in Figure 1, it is the flow chart of the research route of this patent. The research object of this patent is the visible light and infrared images of aerial insulators. The main research contents are as follows:
1)航拍图像的预处理1) Preprocessing of aerial images
根据绝缘子航拍图像的构图特点,结合具体数据来源处背景特征,采用适合的图像预处理手段,通过将图像灰度化处理,减少不必要的信息量。通过灰度拉伸增强图像,使目标区域的特征更为明显。再进行图像增强后再滤波清除噪声干扰,为后续进一步处理奠定基础。According to the composition characteristics of aerial photography images of insulators, combined with the background characteristics of specific data sources, appropriate image preprocessing methods are adopted to reduce unnecessary information by graying the images. Enhance the image by grayscale stretching to make the features of the target area more obvious. After image enhancement, filtering is performed to remove noise interference, which lays the foundation for subsequent further processing.
2)绝缘子识别与定位2) Insulator identification and positioning
首先根据图像背景复杂度区将图像分成两类,针对不同背景情况采用针对性的提取算法。再对几种传统图像分割算法进行仿真,从中对比得到适用于文本研究数据的分割算法。再利用图像运算得到图像骨架,在采用模糊计票改进后的Hough 变换检测骨架化图像中直线,据此采集绝缘子中轴线,通过限定检测长度等条件排除干扰,确定出绝缘子主轴待选区域。再使用广义 Hough 变换检测曲线,对各待选区域邻域内检测类圆盘曲线数量,实现绝缘子串的精细定位。Firstly, the image is divided into two categories according to the background complexity area of the image, and the targeted extraction algorithm is adopted for different background situations. Then several traditional image segmentation algorithms are simulated, and a segmentation algorithm suitable for text research data is obtained by comparison. Then, the image skeleton is obtained by image operation, and the straight line in the skeletonized image is detected by the Hough transform improved by fuzzy vote counting, and the central axis of the insulator is collected accordingly. Then, the generalized Hough transform detection curve is used to detect the number of disk-like curves in the neighborhood of each candidate area, so as to realize the fine positioning of the insulator string.
3)绝缘子图像分割3) Insulator image segmentation
对识别得到的绝缘子串区域图像进行改进后的图像加运算,即先对二值化绝缘子串区域图像进行腐蚀运算,再提取处理后的图像最大联通域,最后再对图像进行膨胀运算处理,实现绝缘子串的分割。The improved image addition operation is performed on the identified insulator string region image, that is, the binarized insulator string region image is first subjected to erosion operation, and then the maximum connected domain of the processed image is extracted, and finally the image is expanded. Segmentation of insulator strings.
4)绝缘子缺陷检测4) Insulator defect detection
本专利采用同时相同空间下目标绝缘子可见光和红外两种图像,实现对其多种缺陷故障的检测。首先根据绝缘子中轴线方程进行绝缘子方向矫正,依据形态特征对绝缘子串进行分割,得到单个绝缘子的图像。通过分析计算相邻绝缘子横轴线间距的变化规律,来进行绝缘子自爆故障检测;通对计算图像灰度共生矩阵,得到单个绝缘子图像的纹理特征来判断绝缘子的覆尘污渍缺陷以及裂纹故障情况;最后依据红外图像对温度敏感的特性,来检测零值绝缘子故障。This patent adopts visible light and infrared images of the target insulator in the same space at the same time to realize the detection of various defects. Firstly, the direction of the insulator is corrected according to the equation of the central axis of the insulator, and the insulator string is divided according to the morphological characteristics to obtain the image of a single insulator. The self-explosion fault detection of insulators is carried out by analyzing and calculating the variation law of the horizontal axis spacing of adjacent insulators; by calculating the gray-scale co-occurrence matrix of the images, the texture features of a single insulator image are obtained to judge the dust-covered stain defects and crack faults of the insulators; finally Based on the temperature-sensitive characteristics of infrared images, zero-value insulator faults are detected.
如图2所示,绝缘子分割算法流程图。该方法先对绝缘子图像进行预分类,再对不同背景复杂情况的图像采用特异性算法进行绝缘子串区域定位,再从候选区域中提取绝缘子图像的方法。该方法能区分灰度相近的导线和杆塔与绝缘子串的几何形状差异,提高识别准确率,又不需要对整幅图像像素点进行分类,计算量较少,运行速度较快。绝缘子串在图像中有较为明显的几何特性。本专利结合其几何特征,根据上述特性,首先对数据图片进行骨架化,突出绝缘子中轴的线性特征,再对处理后的图像全局进行基于霍夫变换的直线检测,根据绝缘子图像的几何特性,选取其中长度在某一范围的直线作为绝缘子串中轴的候选直线。再对候选直线斜率垂直方向宽度一定像素值的领域内,基于广义霍夫变换检测圆盘型分布的点,如果邻域内圆盘数量多于一个设定的阈值,则判定该处为绝缘子串,最终实现绝缘子串的精细定位。As shown in Figure 2, the flow chart of the insulator segmentation algorithm. The method first pre-classifies the insulator images, then uses a specific algorithm to locate the insulator string region for images with different background complexities, and then extracts the insulator images from the candidate regions. The method can distinguish the geometrical difference of conductors, towers and insulator strings with similar gray levels, improve the recognition accuracy, and does not need to classify the pixels of the whole image, with less computation and faster running speed. The insulator strings have obvious geometric characteristics in the image. This patent combines its geometric characteristics and according to the above characteristics, firstly skeletonizes the data picture to highlight the linear characteristics of the insulator central axis, and then globally performs line detection based on Hough transform on the processed image. According to the geometric characteristics of the insulator image, A straight line whose length is within a certain range is selected as the candidate straight line for the central axis of the insulator string. Then, in the field with a certain pixel value in the vertical direction of the slope of the candidate line, the point of the disk-shaped distribution is detected based on the generalized Hough transform. If the number of disks in the neighborhood is more than a set threshold, it is determined that the place is an insulator string. Finally, the fine positioning of the insulator string is realized.
如图3所示,为精细定位算法流程图。As shown in Figure 3, it is the flow chart of the fine positioning algorithm.
Step1:建立候选区域库。根据绝缘子粗定位获取的候选中轴线的端点坐标,计算直线的长度ln,其中 n 为识别出的直线的总数量。将ln长度大于最短长度lmin的坐标对存入一个新的矩阵中作为候选矩阵。其中每一行的 4 列分别储存每条候选区域中轴线的起始横纵坐标以及中止横纵坐标,由于直线的起始和中止方向不影响最终结果所以不分前后顺序。Step1: Build a candidate region library. Calculate the length ln of the straight line according to the endpoint coordinates of the candidate central axis obtained by the rough positioning of the insulator, where n is the total number of identified straight lines. The coordinate pairs whose length ln is greater than the shortest length lmin are stored in a new matrix as a candidate matrix. The 4 columns of each row respectively store the starting horizontal and vertical coordinates and the stopping horizontal and vertical coordinates of the central axis of each candidate area. Since the starting and stopping directions of the straight line do not affect the final result, there is no sequence.
Step2:依次确定候选区域。设定搜索宽度 d。对数组中的候选直线依次进行如下操作:根据端点坐标计算出直线斜率 k。在两个端点处,分别找到距离端点 d/ 2长度,且处在过端点斜率为-1/ k 直线上的两个点,如没有整数点则依据长度向端点反方向取证,以此为四个顶点构建矩形区域,则为每条中轴线待检区域。Step2: Determine the candidate regions in turn. Set the search width d. Perform the following operations on the candidate lines in the array in sequence: Calculate the slope k of the line according to the coordinates of the endpoints. At the two endpoints, find the two points that are d/2 in length from the endpoint and on a straight line with a slope of -1/k passing through the endpoint. Each vertex constructs a rectangular area, which is the area to be inspected for each central axis.
Step3:判定待检区域。设定阈值 p。对待检区域依次进行基于广义 Hough 变换的圆盘状检测。对于实际检测出的圆盘数量如果超过阈值 p,则判定该区域为绝缘子串的区域,将坐标端点存入新的结果矩阵中;如果检测出的圆盘数量不足阈值 p,则判定为干扰区域进行下一个待检区域的检测。最终绝缘子串的区域就是结果矩阵中所存端点围成的区域。Step3: Determine the area to be inspected. Set the threshold p. Disk-shaped detection based on generalized Hough transform is performed on the regions to be detected in turn. If the number of discs actually detected exceeds the threshold p, the area is determined to be an insulator string area, and the coordinate endpoints are stored in a new result matrix; if the number of discs detected is less than the threshold p, it is determined to be an interference area Carry out the detection of the next area to be inspected. The area of the final insulator string is the area enclosed by the endpoints stored in the result matrix.
通过上述算法,我们可以从多条待选直线中,选择出具有特定几何外形特征的直线,这样的直线大概率是绝缘子的中轴线。Through the above algorithm, we can select a straight line with a specific geometric shape feature from a plurality of straight lines to be selected, and such a straight line has a high probability of being the central axis of the insulator.
如图4所示,为稀疏算法流程图。算法思路为对骨架化处理之后的二值图像,通过一种类似于滤波的方式,使用滑动的像素块在图像中移动,稀疏像素点,使数据的像素点数量减少,在不影响图像的整体轮廓形状的基础上,实现减少霍夫变换过程中的计算次数的效果,从而达到缩短运算时间,提高算法效率的目的。As shown in Figure 4, it is the flow chart of the sparse algorithm. The algorithm idea is to use a method similar to filtering for the binary image after skeletonization, using sliding pixel blocks to move in the image, sparse pixels, and reduce the number of data pixels without affecting the overall outline of the image. On the basis of the shape, the effect of reducing the number of calculations in the Hough transform process is achieved, so as to achieve the purpose of shortening the operation time and improving the efficiency of the algorithm.
本申请保密运行一段时间后,现场技术人员反馈的有益之处在于:After the application has been run confidentially for a period of time, the benefits of feedback from on-site technicians are:
针对航拍图像的特性,选用合适的预处理手段。包括将图像灰度化,以减少运算数据量;根绝图像中目标绝缘子和干扰因素的灰度特点,设定合适灰度阈值对图像进行分段线性拉伸,突出图像主体;并对图像生成和传输时产生的噪声干扰进行针对性滤波处理。在航拍图像绝缘子串定位研究中,根据图像背景复杂度对图像进行分类,对简单背景的绝缘子采用数据集稀疏算法,减少运行时间,提高算法效率;而对于复杂图像进行颜色模型转换,通过中值滤波和图像腐蚀等手段得到质量较高的图像骨架图,再对传统霍夫变换的计票模式进行改进,最终得到图像主轴区域。通过圆形检测算法配合候选主轴区域内的搜索算法,得到绝缘子串的精确定位。对识别到的绝缘子串进行了记住主轴方向的矫正,进而根据横轴分布将图像分割为单个绝缘子图像。根据主轴间距变化规律识别绝缘子自爆故障;根据灰度梯度规律识别污渍故障;根据灰度反映温度情况识别绝缘子温度异常故障。本专利提出一种不依赖大数据量且能适用于多种故障的故障检测方法,提高了输电线路巡检的智能化水平。According to the characteristics of aerial images, appropriate preprocessing methods are selected. Including graying the image to reduce the amount of computational data; eradicating the grayscale characteristics of target insulators and interference factors in the image, setting appropriate grayscale thresholds to stretch the image piecewise linearly to highlight the main body of the image; The noise interference generated during transmission is subjected to targeted filtering processing. In the research on the location of insulator strings in aerial images, the images are classified according to the complexity of the image background, and the data set sparse algorithm is used for the insulators with simple backgrounds, which reduces the running time and improves the algorithm efficiency. The image skeleton map with higher quality is obtained by means of filtering and image erosion, and then the traditional Hough transform vote counting mode is improved to finally obtain the main axis area of the image. Accurate positioning of the insulator string is obtained through the circular detection algorithm and the search algorithm in the candidate main shaft area. The identified insulator strings are corrected to remember the main axis direction, and then the image is divided into individual insulator images according to the horizontal axis distribution. Identify the self-explosion fault of the insulator according to the change rule of the main shaft spacing; identify the stain fault according to the grayscale gradient law; identify the abnormal temperature fault of the insulator according to the grayscale reflected temperature. This patent proposes a fault detection method that does not depend on a large amount of data and can be applied to a variety of faults, which improves the intelligence level of power transmission line inspection.
第一,一种绝缘子缺陷红外检测方法包括S1图像预处理、S2绝缘子分割和S3绝缘子故障检测的步骤,所述步骤S1图像预处理,将采集到的绝缘子航拍图像进行灰度化处理并得到灰度化图像,根据灰度化图像的灰度规律对灰度化图像进行分段线性拉伸并得到灰度化拉伸图像,对灰度化拉伸图像进行滤波处理并得到预处理图像,其通过S1图像预处理、S2绝缘子分割和S3绝缘子故障检测的步骤等,实现了识别绝缘子缺陷。First, an infrared detection method for insulator defects includes the steps of S1 image preprocessing, S2 insulator segmentation, and S3 insulator fault detection. In the step S1 image preprocessing, the collected aerial images of insulators are subjected to grayscale processing to obtain grayscale images. According to the grayscale law of the grayscale image, the grayscaled image is linearly stretched piecewise to obtain a grayscale stretched image, and the grayscale stretched image is filtered to obtain a preprocessed image. Through the steps of S1 image preprocessing, S2 insulator segmentation and S3 insulator fault detection, etc., the identification of insulator defects is realized.
第二,所述步骤S2绝缘子分割,对预处理图像进行绝缘子串区域定位,从候选区域中提取绝缘子图像,运算效率较好,识别正确率较高。Second, in the step S2, insulator segmentation is performed, insulator string region positioning is performed on the preprocessed image, and insulator images are extracted from the candidate regions, which has better computing efficiency and higher recognition accuracy.
第三,所述步骤S2绝缘子分割包括S201绝缘子识别与定位和S202绝缘子图像分割的步骤,在所述步骤S201绝缘子识别与定位中,根据预处理图像的灰度方差进行图像分类并得到分类图像,分类图像包括简单背景图像和复杂背景图像,当灰度方差>50为简单背景图像,当灰度方差≤50为复杂背景图像,采用像素点稀疏算法对简单背景图像进行处理或者将复杂背景图像转换至HSI颜色空间,然后进行图像滤波和图像腐蚀,利用图像运算得到骨架化图像,运算效率较好,识别正确率较高。Third, the step S2 insulator segmentation includes the steps of S201 insulator identification and positioning and S202 insulator image segmentation. In the step S201 insulator identification and positioning, image classification is performed according to the grayscale variance of the preprocessed image and a classified image is obtained, The classified images include simple background images and complex background images. When the grayscale variance is greater than 50, it is a simple background image. When the grayscale variance is less than or equal to 50, it is a complex background image. The pixel sparse algorithm is used to process the simple background image or convert the complex background image. To the HSI color space, then image filtering and image erosion are performed, and the skeletonized image is obtained by image operation. The operation efficiency is good, and the recognition accuracy rate is high.
第四,在所述步骤S201绝缘子识别与定位中,得到骨架化图像之后,采用模糊计票的Hough变换算法检测并获得骨架化图像中的直线,根据设定的绝缘子串的直线长度筛选所有直线并获得绝缘子中轴线的候选直线,通过限定检测长度排除干扰并确定绝缘子主轴待选区域,运算效率较好,识别正确率较高。Fourth, in the step S201 insulator identification and positioning, after the skeletonized image is obtained, the Hough transform algorithm of fuzzy counting is used to detect and obtain the straight lines in the skeletonized image, and all straight lines are screened according to the set straight line length of the insulator string. And the candidate straight line of the insulator central axis is obtained, the interference is eliminated by limiting the detection length and the candidate area of the insulator main shaft is determined, the calculation efficiency is good, and the recognition accuracy rate is high.
第五,在所述步骤S201绝缘子识别与定位中,在确定绝缘子主轴待选区域之后,在候选直线斜率垂直方向,采用广义Hough变换算法检测并获得圆盘状的曲线即圆盘型分布的点,对每一待选区域邻域内检测并获得圆盘状的曲线的数量即圆盘数量,当邻域内的圆盘数量超过设定阈值,则判定该处为绝缘子串并实现绝缘子串的精细定位,运算效率较好,识别正确率较高。Fifth, in the step S201 insulator identification and positioning, after determining the area to be selected for the main axis of the insulator, in the vertical direction of the slope of the candidate straight line, the generalized Hough transform algorithm is used to detect and obtain a disc-shaped curve, that is, a disc-shaped distribution point. , detect and obtain the number of disc-shaped curves in the neighborhood of each candidate area, that is, the number of discs. When the number of discs in the neighborhood exceeds the set threshold, it is determined that the place is an insulator string and the fine positioning of the insulator string is realized. , the operation efficiency is better, and the recognition accuracy rate is higher.
第六,在所述步骤S202绝缘子图像分割中,根据精细定位从预处理图像中提取并获得绝缘子预处理图像,对绝缘子预处理图像进行腐蚀运算、提取最大联通域和膨胀运算处理并获得绝缘子区域图像,运算效率较好,识别正确率较高。Sixth, in the step S202 insulator image segmentation, extract and obtain the insulator pre-processing image from the pre-processing image according to the fine positioning, perform erosion operation on the insulator pre-processing image, extract the maximum connected domain and dilate operation processing, and obtain the insulator area. The image has better computing efficiency and higher recognition accuracy.
第七,在所述步骤S3绝缘子故障检测中,基于绝缘子区域图像,根据绝缘子中轴线方程进行绝缘子方向矫正,依据形态特征对绝缘子串进行分割,得到单个绝缘子图像,运算效率较好,识别正确率较高。Seventh, in the step S3 insulator fault detection, based on the insulator area image, the insulator direction is corrected according to the insulator central axis equation, and the insulator string is segmented according to the morphological characteristics to obtain a single insulator image. higher.
第八,在所述步骤S3绝缘子故障检测中,在得到单个绝缘子图像之后,通过分析计算相邻绝缘子横轴线间距的变化规律,进行绝缘子自爆故障检测,运算效率较好,识别正确率较高。Eighth, in the step S3 insulator fault detection, after obtaining a single insulator image, by analyzing and calculating the variation law of the horizontal axis spacing of adjacent insulators, the self-explosion fault detection of the insulator is performed. The calculation efficiency is good, and the identification accuracy rate is high.
第九,在所述步骤S3绝缘子故障检测中,在得到单个绝缘子图像之后,通对计算图像灰度共生矩阵,得到单个绝缘子图像的纹理特征,判断绝缘子的覆尘污渍缺陷以及裂纹故障情况,运算效率较好,识别正确率较高。Ninth, in the step S3 insulator fault detection, after a single insulator image is obtained, the grayscale co-occurrence matrix of the image is calculated to obtain the texture features of the single insulator image, and the dust and stain defects and crack faults of the insulator are judged. The efficiency is better, and the recognition accuracy rate is higher.
第十,在所述步骤S3绝缘子故障检测中,在得到单个绝缘子图像之后,依据红外图像对温度敏感的特性,检测零值绝缘子故障,运算效率较好,识别正确率较高。Tenth, in the step S3 insulator fault detection, after a single insulator image is obtained, the zero-value insulator fault is detected according to the temperature-sensitive characteristic of the infrared image, the calculation efficiency is good, and the identification accuracy rate is high.
Claims (1)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010432395.8A CN111652857B (en) | 2020-05-20 | 2020-05-20 | A kind of infrared detection method of insulator defect |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010432395.8A CN111652857B (en) | 2020-05-20 | 2020-05-20 | A kind of infrared detection method of insulator defect |
Publications (2)
Publication Number | Publication Date |
---|---|
CN111652857A CN111652857A (en) | 2020-09-11 |
CN111652857B true CN111652857B (en) | 2022-05-13 |
Family
ID=72345878
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010432395.8A Active CN111652857B (en) | 2020-05-20 | 2020-05-20 | A kind of infrared detection method of insulator defect |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111652857B (en) |
Families Citing this family (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112432874B (en) * | 2020-11-12 | 2023-09-08 | 国网山东省电力公司电力科学研究院 | A tool and method for simulating internal heating of composite insulators |
CN113466291B (en) * | 2021-06-24 | 2023-05-02 | 华能秦煤瑞金发电有限责任公司 | Analysis method for detecting mass concrete cracks based on temperature field change |
CN113610774B (en) * | 2021-07-16 | 2024-01-09 | 广州大学 | Glass scratch defect detection method, system, device and storage medium |
CN113762276B (en) * | 2021-08-17 | 2024-07-09 | 湖南大学 | Electric power operation ladder angle detection method |
CN113763397B (en) * | 2021-09-03 | 2024-03-29 | 国网山东省电力公司电力科学研究院 | Composite insulator fault detection method and system |
CN114235815A (en) * | 2021-12-08 | 2022-03-25 | 国网福建省电力有限公司检修分公司 | Method for detecting surface defects of outdoor electrical equipment of converter station based on scene filtering |
CN114724042B (en) * | 2022-06-09 | 2022-09-02 | 国网江西省电力有限公司电力科学研究院 | A method for automatic detection of zero-value insulators in transmission lines |
CN116228778B (en) * | 2023-05-10 | 2023-09-08 | 国网山东省电力公司菏泽供电公司 | A detection method and system for insulator rupture based on multi-modal information fusion |
CN116994163B (en) * | 2023-08-16 | 2025-07-01 | 西安因诺航空科技有限公司 | Method for detecting edge cross intersection point of photovoltaic module based on infrared image |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106778734A (en) * | 2016-11-10 | 2017-05-31 | 华北电力大学(保定) | A kind of insulator based on rarefaction representation falls to go here and there defect inspection method |
CN109884468A (en) * | 2019-03-05 | 2019-06-14 | 河海大学 | A detection method of insulator self-explosion defect based on image pixel accumulation analysis |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102508110B (en) * | 2011-10-10 | 2014-07-09 | 上海大学 | Texture-based insulator fault diagnostic method |
CN105740844A (en) * | 2016-03-02 | 2016-07-06 | 成都翼比特自动化设备有限公司 | Insulator cracking fault detection method based on image identification technology |
CN108037133B (en) * | 2017-12-27 | 2021-01-26 | 武汉市智勤创亿信息技术股份有限公司 | Intelligent electric power equipment defect identification method and system based on unmanned aerial vehicle inspection image |
CN108986104B (en) * | 2018-06-04 | 2022-05-17 | 国网浙江省电力有限公司检修分公司 | Insulator image segmentation method based on distance transformation and watershed marking algorithm |
CN109472776B (en) * | 2018-10-16 | 2021-12-03 | 河海大学常州校区 | Depth significance-based insulator detection and self-explosion identification method |
CN110827278B (en) * | 2019-11-27 | 2023-01-20 | 云南电网有限责任公司电力科学研究院 | Transformer substation insulator defect online detection method and device |
-
2020
- 2020-05-20 CN CN202010432395.8A patent/CN111652857B/en active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106778734A (en) * | 2016-11-10 | 2017-05-31 | 华北电力大学(保定) | A kind of insulator based on rarefaction representation falls to go here and there defect inspection method |
CN109884468A (en) * | 2019-03-05 | 2019-06-14 | 河海大学 | A detection method of insulator self-explosion defect based on image pixel accumulation analysis |
Also Published As
Publication number | Publication date |
---|---|
CN111652857A (en) | 2020-09-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN111652857B (en) | A kind of infrared detection method of insulator defect | |
CN115345885B (en) | Appearance quality detection method for metal fitness equipment | |
CN110264448B (en) | A method of insulator fault detection based on machine vision | |
CN103488988B (en) | Method for extracting insulators in electrical equipment based on unmanned aerial vehicle line patrol visible light image | |
CN111310761B (en) | Detection method of catenary insulators based on reconstruction and classification convolutional self-encoding network | |
CN110288571B (en) | High-speed rail contact net insulator abnormity detection method based on image processing | |
CN113205063A (en) | Visual identification and positioning method for defects of power transmission conductor | |
CN115063430B (en) | Electric pipeline crack detection method based on image processing | |
CN110276747B (en) | A method for fault detection and fault rating of insulators based on image analysis | |
CN115601379B (en) | A precise surface crack detection technology based on digital image processing | |
CN109359604B (en) | Method for identifying instrument under shadow interference facing inspection robot | |
CN117315289A (en) | Aeroengine blade contour edge detection method based on image processing | |
CN113065484A (en) | Insulator contamination state assessment method based on ultraviolet spectrum | |
CN112085651B (en) | Automatic shock wave detection and tracking algorithm based on image self-adaptive threshold and feature extraction | |
CN118799706A (en) | Bearing defect detection method and system based on computer vision | |
CN108665464A (en) | A kind of foreign matter detecting method based on morphologic high tension electric tower and high-tension bus-bar | |
CN112595276A (en) | Power transmission line icing thickness detection method based on deep learning | |
CN116205907A (en) | Decorative plate defect detection method based on machine vision | |
CN117094916B (en) | Visual inspection method for municipal bridge support | |
CN116071299A (en) | A method and system for detecting insulator RTV spraying defects | |
CN114418968A (en) | Power transmission line small target defect detection method based on deep learning | |
CN115423740A (en) | Method for identifying size of internal defect area of EPR vehicle-mounted cable terminal | |
CN105528790A (en) | Transmission line small part identification method | |
CN111008967A (en) | A method for identifying defects in insulator RTV coating | |
CN108805855B (en) | A method for rapid identification of concrete cracks |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |