[go: up one dir, main page]

CN111652857B - A kind of infrared detection method of insulator defect - Google Patents

A kind of infrared detection method of insulator defect Download PDF

Info

Publication number
CN111652857B
CN111652857B CN202010432395.8A CN202010432395A CN111652857B CN 111652857 B CN111652857 B CN 111652857B CN 202010432395 A CN202010432395 A CN 202010432395A CN 111652857 B CN111652857 B CN 111652857B
Authority
CN
China
Prior art keywords
insulator
image
grayscale
images
segmentation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010432395.8A
Other languages
Chinese (zh)
Other versions
CN111652857A (en
Inventor
武建华
梁利辉
尹河
刘海峰
牛延腾
杨阳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
State Grid Corp of China SGCC
Maintenance Branch of State Grid Hebei Electric Power Co Ltd
Original Assignee
State Grid Corp of China SGCC
Maintenance Branch of State Grid Hebei Electric Power Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by State Grid Corp of China SGCC, Maintenance Branch of State Grid Hebei Electric Power Co Ltd filed Critical State Grid Corp of China SGCC
Priority to CN202010432395.8A priority Critical patent/CN111652857B/en
Publication of CN111652857A publication Critical patent/CN111652857A/en
Application granted granted Critical
Publication of CN111652857B publication Critical patent/CN111652857B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0004Industrial image inspection
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/8851Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/94Investigating contamination, e.g. dust
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/95Investigating the presence of flaws or contamination characterised by the material or shape of the object to be examined
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N25/00Investigating or analyzing materials by the use of thermal means
    • G01N25/72Investigating presence of flaws
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/70Denoising; Smoothing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/11Region-based segmentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/187Segmentation; Edge detection involving region growing; involving region merging; involving connected component labelling
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/26Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
    • G06V10/267Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion by performing operations on regions, e.g. growing, shrinking or watersheds
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/30Noise filtering
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/10Terrestrial scenes
    • G06V20/13Satellite images
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10048Infrared image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20024Filtering details
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20036Morphological image processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30108Industrial image inspection

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Biochemistry (AREA)
  • General Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Remote Sensing (AREA)
  • Astronomy & Astrophysics (AREA)
  • Quality & Reliability (AREA)
  • Signal Processing (AREA)
  • Radiation Pyrometers (AREA)
  • Image Processing (AREA)
  • Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
  • Image Analysis (AREA)

Abstract

The invention discloses an infrared detection method for insulator defects, and relates to the technical field of infrared identification of insulator defects; the method comprises the steps of S1 image preprocessing, S2 insulator segmentation and S3 insulator fault detection, wherein in the step S1 image preprocessing, acquired insulator aerial images are subjected to graying processing to obtain grayed images, the grayed images are subjected to piecewise linear stretching according to the gray rule of the grayed images to obtain grayed stretched images, and the grayed stretched images are subjected to filtering processing to obtain preprocessed images; the insulator defect identification is realized through the steps of S1 image preprocessing, S2 insulator segmentation, S3 insulator fault detection and the like.

Description

一种绝缘子缺陷红外检测方法A kind of infrared detection method of insulator defect

技术领域technical field

本发明涉及绝缘子缺陷红外识别技术领域,尤其涉及一种绝缘子缺陷红外检测方法。The invention relates to the technical field of infrared identification of insulator defects, in particular to an infrared detection method of insulator defects.

背景技术Background technique

随着智能电网建设的日益推进,对输电线路巡检智能化的要求越来越高,使用基于图像识别技术的巡检机器人和无人机逐步替代烦琐的人工巡检和昂贵的直升机巡检已成为必然的趋势。绝缘子是输电线路中最常见的部件,一旦发生故障,就会导致输电线与输电线之间或输电线与塔台之间发生接触,导致供电中断,严重时甚至会发生大范围停电的事故。由于长时间暴露在野外,常受到暴风、雨、雪等恶劣环境的侵蚀,绝缘子不可避免的会出现各种故障: 自爆、闪络放电、异物、掉串等问题。其中绝缘子片自爆问题是最常见且急需解决的一种缺陷,主要出现在玻璃绝缘子上。正确识别定位玻璃绝缘子,找到自爆缺陷并及时采取补救措施,从而利于输电线路的有效利用及其寿命的延长。传统的绝缘子自爆缺陷的检测方法需要大量的工作人员人工判读,耗时耗力,效率低下,成本高昂。With the increasing development of smart grid construction, the requirements for intelligent inspection of transmission lines are getting higher and higher. The use of inspection robots and drones based on image recognition technology to gradually replace cumbersome manual inspections and expensive helicopter inspections has been become an inevitable trend. Insulators are the most common components in transmission lines. Once a fault occurs, it will lead to contact between transmission lines and transmission lines or between transmission lines and towers, resulting in interruption of power supply, and even large-scale power outages in severe cases. Due to long-term exposure to the wild, it is often eroded by harsh environments such as storms, rain, and snow. Insulators will inevitably experience various failures: self-explosion, flashover discharge, foreign objects, and dropped strings. Among them, the self-explosion problem of insulator sheets is the most common and urgently needed defect, which mainly occurs on glass insulators. Correctly identify and locate glass insulators, find self-explosion defects and take remedial measures in time, so as to facilitate the effective use of transmission lines and prolong their life. The traditional detection method of insulator self-explosion defect requires a large number of workers to manually interpret, which is time-consuming, labor-intensive, inefficient and expensive.

传统的绝缘子自爆缺陷的检测方法需要大量的工作人员人工判读,耗时耗力,效率低下,成本高昂;在此背景下,无人机在电力巡检中得到了广泛的应用。目前,国内外关于绝缘子缺陷检测的相关研究有深度学习技术、计算机视觉技术、图像识别技术等方面;但是,这些绝缘子缺陷检测技术仍存在着许多问题,难以满足当前绝缘子缺陷的故障识别要求,一种合适的绝缘子缺陷红外识别方法是非常有必要的。The traditional detection method of insulator self-explosion defect requires a large number of workers to manually interpret, which is time-consuming, labor-intensive, inefficient and expensive. In this context, drones have been widely used in power inspection. At present, related researches on insulator defect detection at home and abroad include deep learning technology, computer vision technology, image recognition technology, etc. However, there are still many problems in these insulator defect detection technologies, and it is difficult to meet the current fault identification requirements of insulator defects. A suitable infrared identification method for insulator defects is very necessary.

现有技术问题及思考:Existing technical problems and thinking:

如何解决识别绝缘子缺陷的技术问题。How to solve the technical problem of identifying insulator defects.

发明内容SUMMARY OF THE INVENTION

本发明所要解决的技术问题是提供一种绝缘子缺陷红外检测方法,其通过S1图像预处理、S2绝缘子分割和S3绝缘子故障检测的步骤等,实现了识别绝缘子缺陷。The technical problem to be solved by the present invention is to provide an infrared detection method for insulator defects, which realizes the identification of insulator defects through the steps of S1 image preprocessing, S2 insulator segmentation, and S3 insulator fault detection.

为解决上述技术问题,本发明所采取的技术方案是:一种绝缘子缺陷红外检测方法包括S1图像预处理、S2绝缘子分割和S3绝缘子故障检测的步骤,所述步骤S1图像预处理,将采集到的绝缘子航拍图像进行灰度化处理并得到灰度化图像,根据灰度化图像的灰度规律对灰度化图像进行分段线性拉伸并得到灰度化拉伸图像,对灰度化拉伸图像进行滤波处理并得到预处理图像。In order to solve the above technical problems, the technical solution adopted in the present invention is: an infrared detection method for insulator defects includes the steps of S1 image preprocessing, S2 insulator segmentation and S3 insulator fault detection. The insulator aerial image is grayscaled to obtain a grayscale image, and the grayscale image is segmented linearly stretched according to the grayscale law of the grayscale image to obtain a grayscale stretched image. The stretched image is filtered and the preprocessed image is obtained.

进一步的技术方案在于:所述步骤S2绝缘子分割,对预处理图像进行绝缘子串区域定位,从候选区域中提取绝缘子图像。A further technical solution is: in the step S2, insulator segmentation is performed, insulator string region positioning is performed on the preprocessed image, and an insulator image is extracted from the candidate region.

进一步的技术方案在于:所述步骤S2绝缘子分割包括S201绝缘子识别与定位和S202绝缘子图像分割的步骤,在所述步骤S201绝缘子识别与定位中,根据预处理图像的灰度方差进行图像分类并得到分类图像,分类图像包括简单背景图像和复杂背景图像,当灰度方差>50为简单背景图像,当灰度方差≤50为复杂背景图像,采用像素点稀疏算法对简单背景图像进行处理或者将复杂背景图像转换至HSI颜色空间,然后进行图像滤波和图像腐蚀,利用图像运算得到骨架化图像。A further technical solution is that: the step S2 insulator segmentation includes the steps of S201 insulator identification and positioning and S202 insulator image segmentation, and in the step S201 insulator identification and positioning, according to the grayscale variance of the preprocessed image The image is classified and obtained. Classified images, classified images include simple background images and complex background images. When the grayscale variance is greater than 50, it is a simple background image, and when the grayscale variance is less than or equal to 50, it is a complex background image. The pixel point sparse algorithm is used to process the simple background image or the complex background image. The background image is converted to HSI color space, and then image filtering and image erosion are performed, and the skeletonized image is obtained by image operation.

进一步的技术方案在于:在所述步骤S201绝缘子识别与定位中,得到骨架化图像之后,采用模糊计票的Hough变换算法检测并获得骨架化图像中的直线,根据设定的绝缘子串的直线长度筛选所有直线并获得绝缘子中轴线的候选直线,通过限定检测长度排除干扰并确定绝缘子主轴待选区域。A further technical solution is: in the step S201 insulator identification and positioning, after the skeletonized image is obtained, the Hough transform algorithm of fuzzy counting is used to detect and obtain the straight line in the skeletonized image, according to the set straight line length of the insulator string. Screen all straight lines and obtain candidate straight lines for the central axis of the insulator, eliminate interference by limiting the detection length, and determine the candidate area for the main axis of the insulator.

进一步的技术方案在于:在所述步骤S201绝缘子识别与定位中,在确定绝缘子主轴待选区域之后,在候选直线斜率垂直方向,采用广义Hough变换算法检测并获得圆盘状的曲线即圆盘型分布的点,对每一待选区域邻域内检测并获得圆盘状的曲线的数量即圆盘数量,当邻域内的圆盘数量超过设定阈值,则判定该处为绝缘子串并实现绝缘子串的精细定位。A further technical solution is: in the step S201 insulator identification and positioning, after determining the to-be-selected area of the insulator main axis, in the vertical direction of the slope of the candidate straight line, a generalized Hough transform algorithm is used to detect and obtain a disc-shaped curve, that is, a disc-shaped curve. Distributed points, detect and obtain the number of disk-shaped curves in the neighborhood of each candidate area, that is, the number of disks. When the number of disks in the neighborhood exceeds the set threshold, it is determined that the place is an insulator string and the insulator string is realized. fine positioning.

进一步的技术方案在于:在所述步骤S202绝缘子图像分割中,根据精细定位从预处理图像中提取并获得绝缘子预处理图像,对绝缘子预处理图像进行腐蚀运算、提取最大联通域和膨胀运算处理并获得绝缘子区域图像。A further technical solution is: in the step S202 insulator image segmentation, extracting and obtaining the insulator pre-processing image from the pre-processing image according to the fine positioning, performing corrosion operation on the insulator pre-processing image, extracting the maximum connected domain and dilation operation processing, and then processing the insulator pre-processing image. Obtain an image of the insulator region.

进一步的技术方案在于:在所述步骤S3绝缘子故障检测中,基于绝缘子区域图像,根据绝缘子中轴线方程进行绝缘子方向矫正,依据形态特征对绝缘子串进行分割,得到单个绝缘子图像。A further technical solution is: in the step S3 insulator fault detection, based on the insulator area image, the insulator direction is corrected according to the insulator central axis equation, and the insulator string is divided according to the morphological characteristics to obtain a single insulator image.

进一步的技术方案在于:在所述步骤S3绝缘子故障检测中,在得到单个绝缘子图像之后,通过分析计算相邻绝缘子横轴线间距的变化规律,进行绝缘子自爆故障检测。A further technical solution is: in the step S3 insulator fault detection, after a single insulator image is obtained, the insulator self-explosion fault detection is performed by analyzing and calculating the variation law of the horizontal axis spacing of adjacent insulators.

进一步的技术方案在于:在所述步骤S3绝缘子故障检测中,在得到单个绝缘子图像之后,通对计算图像灰度共生矩阵,得到单个绝缘子图像的纹理特征,判断绝缘子的覆尘污渍缺陷以及裂纹故障情况。A further technical solution is: in the step S3 insulator fault detection, after a single insulator image is obtained, the image grayscale co-occurrence matrix is calculated to obtain the texture features of the single insulator image, and the dust-covered stain defects and crack faults of the insulator are judged. Happening.

进一步的技术方案在于:在所述步骤S3绝缘子故障检测中,在得到单个绝缘子图像之后,依据红外图像对温度敏感的特性,检测零值绝缘子故障。A further technical solution is: in the step S3 insulator fault detection, after a single insulator image is obtained, the zero-value insulator fault is detected according to the temperature-sensitive characteristic of the infrared image.

采用上述技术方案所产生的有益效果在于:The beneficial effects produced by the above technical solutions are:

第一,一种绝缘子缺陷红外检测方法包括S1图像预处理、S2绝缘子分割和S3绝缘子故障检测的步骤,所述步骤S1图像预处理,将采集到的绝缘子航拍图像进行灰度化处理并得到灰度化图像,根据灰度化图像的灰度规律对灰度化图像进行分段线性拉伸并得到灰度化拉伸图像,对灰度化拉伸图像进行滤波处理并得到预处理图像。该技术方案,其通过S1图像预处理、S2绝缘子分割和S3绝缘子故障检测的步骤等,实现了识别绝缘子缺陷。First, an infrared detection method for insulator defects includes the steps of S1 image preprocessing, S2 insulator segmentation, and S3 insulator fault detection. In the step S1 image preprocessing, the collected aerial images of insulators are subjected to grayscale processing to obtain grayscale images. According to the grayscale law of the grayscale image, piecewise linear stretch is performed on the grayscale image to obtain a grayscale stretched image, and the grayscale stretched image is filtered to obtain a preprocessed image. The technical solution realizes the identification of insulator defects through the steps of S1 image preprocessing, S2 insulator segmentation, and S3 insulator fault detection.

第二,所述步骤S2绝缘子分割,对预处理图像进行绝缘子串区域定位,从候选区域中提取绝缘子图像。该技术方案,运算效率较好,识别正确率较高。Second, in the step S2, insulator segmentation is performed, insulator string region positioning is performed on the preprocessed image, and an insulator image is extracted from the candidate region. The technical solution has better operation efficiency and higher recognition accuracy.

第三,所述步骤S2绝缘子分割包括S201绝缘子识别与定位和S202绝缘子图像分割的步骤,在所述步骤S201绝缘子识别与定位中,根据预处理图像的灰度方差进行图像分类并得到分类图像,分类图像包括简单背景图像和复杂背景图像,当灰度方差>50为简单背景图像,当灰度方差≤50为复杂背景图像,采用像素点稀疏算法对简单背景图像进行处理或者将复杂背景图像转换至HSI颜色空间,然后进行图像滤波和图像腐蚀,利用图像运算得到骨架化图像。该技术方案,运算效率较好,识别正确率较高。Third, the step S2 insulator segmentation includes the steps of S201 insulator identification and positioning and S202 insulator image segmentation. In the step S201 insulator identification and positioning, image classification is performed according to the grayscale variance of the preprocessed image and a classified image is obtained, The classified images include simple background images and complex background images. When the grayscale variance is greater than 50, it is a simple background image. When the grayscale variance is less than or equal to 50, it is a complex background image. The pixel sparse algorithm is used to process the simple background image or convert the complex background image. To the HSI color space, then image filtering and image erosion are performed, and the skeletonized image is obtained by image operation. The technical solution has better operation efficiency and higher recognition accuracy.

第四,在所述步骤S201绝缘子识别与定位中,得到骨架化图像之后,采用模糊计票的Hough变换算法检测并获得骨架化图像中的直线,根据设定的绝缘子串的直线长度筛选所有直线并获得绝缘子中轴线的候选直线,通过限定检测长度排除干扰并确定绝缘子主轴待选区域。该技术方案,运算效率较好,识别正确率较高。Fourth, in the step S201 insulator identification and positioning, after the skeletonized image is obtained, the Hough transform algorithm of fuzzy counting is used to detect and obtain the straight lines in the skeletonized image, and all straight lines are screened according to the set straight line length of the insulator string. And obtain the candidate straight line of the central axis of the insulator, eliminate the interference by limiting the detection length, and determine the candidate area of the main axis of the insulator. The technical solution has better operation efficiency and higher recognition accuracy.

第五,在所述步骤S201绝缘子识别与定位中,在确定绝缘子主轴待选区域之后,在候选直线斜率垂直方向,采用广义Hough变换算法检测并获得圆盘状的曲线即圆盘型分布的点,对每一待选区域邻域内检测并获得圆盘状的曲线的数量即圆盘数量,当邻域内的圆盘数量超过设定阈值,则判定该处为绝缘子串并实现绝缘子串的精细定位。该技术方案,运算效率较好,识别正确率较高。Fifth, in the step S201 insulator identification and positioning, after determining the area to be selected for the main axis of the insulator, in the vertical direction of the slope of the candidate straight line, the generalized Hough transform algorithm is used to detect and obtain a disc-shaped curve, that is, a disc-shaped distribution point. , detect and obtain the number of disc-shaped curves in the neighborhood of each candidate area, that is, the number of discs. When the number of discs in the neighborhood exceeds the set threshold, it is determined that the place is an insulator string and the fine positioning of the insulator string is realized. . The technical solution has better operation efficiency and higher recognition accuracy.

第六,在所述步骤S202绝缘子图像分割中,根据精细定位从预处理图像中提取并获得绝缘子预处理图像,对绝缘子预处理图像进行腐蚀运算、提取最大联通域和膨胀运算处理并获得绝缘子区域图像。该技术方案,运算效率较好,识别正确率较高。Sixth, in the step S202 insulator image segmentation, extract and obtain the insulator pre-processing image from the pre-processing image according to the fine positioning, perform erosion operation on the insulator pre-processing image, extract the maximum connected domain and dilate operation processing, and obtain the insulator area. image. The technical solution has better operation efficiency and higher recognition accuracy.

第七,在所述步骤S3绝缘子故障检测中,基于绝缘子区域图像,根据绝缘子中轴线方程进行绝缘子方向矫正,依据形态特征对绝缘子串进行分割,得到单个绝缘子图像。该技术方案,运算效率较好,识别正确率较高。Seventh, in the step S3 insulator fault detection, based on the insulator area image, the insulator direction is corrected according to the insulator central axis equation, and the insulator string is divided according to the morphological characteristics to obtain a single insulator image. The technical solution has better operation efficiency and higher recognition accuracy.

第八,在所述步骤S3绝缘子故障检测中,在得到单个绝缘子图像之后,通过分析计算相邻绝缘子横轴线间距的变化规律,进行绝缘子自爆故障检测。该技术方案,运算效率较好,识别正确率较高。Eighth, in the step S3 insulator fault detection, after a single insulator image is obtained, the insulator self-explosion fault detection is performed by analyzing and calculating the variation law of the spacing between the horizontal axes of adjacent insulators. The technical solution has better operation efficiency and higher recognition accuracy.

第九,在所述步骤S3绝缘子故障检测中,在得到单个绝缘子图像之后,通对计算图像灰度共生矩阵,得到单个绝缘子图像的纹理特征,判断绝缘子的覆尘污渍缺陷以及裂纹故障情况。该技术方案,运算效率较好,识别正确率较高。Ninth, in the step S3 insulator fault detection, after a single insulator image is obtained, the grayscale co-occurrence matrix of the image is calculated to obtain the texture features of the single insulator image, and the dust and stain defects and crack faults of the insulator are judged. The technical solution has better operation efficiency and higher recognition accuracy.

第十,在所述步骤S3绝缘子故障检测中,在得到单个绝缘子图像之后,依据红外图像对温度敏感的特性,检测零值绝缘子故障。该技术方案,运算效率较好,识别正确率较高。Tenth, in the step S3 insulator fault detection, after a single insulator image is obtained, the zero-value insulator fault is detected according to the temperature-sensitive characteristic of the infrared image. The technical solution has better operation efficiency and higher recognition accuracy.

详见具体实施方式部分描述。For details, please refer to the description in the detailed description.

附图说明Description of drawings

图1是本发明的流程图;Fig. 1 is the flow chart of the present invention;

图2是本发明中绝缘子分割算法的流程图;Fig. 2 is the flow chart of insulator segmentation algorithm in the present invention;

图3是本发明中精细定位算法的流程图;Fig. 3 is the flow chart of fine positioning algorithm in the present invention;

图4是本发明中稀疏算法的流程图。FIG. 4 is a flow chart of the sparse algorithm in the present invention.

具体实施方式Detailed ways

下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。以下对至少一个示例性实施例的描述实际上仅仅是说明性的,决不作为对本申请及其应用或使用的任何限制。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all of the embodiments. The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the application, its application, or uses. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

在下面的描述中阐述了很多具体细节以便于充分理解本申请,但是本申请还可以采用其他不同于在此描述的其它方式来实施,本领域技术人员可以在不违背本申请内涵的情况下做类似推广,因此本申请不受下面公开的具体实施例的限制。In the following description, many specific details are set forth to facilitate a full understanding of the present application, but the present application can also be implemented in other ways different from those described herein, and those skilled in the art can do so without departing from the connotation of the present application Similar promotion, therefore, the present application is not limited by the specific embodiments disclosed below.

如图1~图4所示,本发明公开了一种绝缘子缺陷红外检测方法包括如下步骤:As shown in FIG. 1 to FIG. 4 , the present invention discloses an infrared detection method for insulator defects, which includes the following steps:

S1图像预处理S1 image preprocessing

将采集到的绝缘子航拍图像进行灰度化处理并得到灰度化图像,根据灰度化图像的灰度规律对灰度化图像进行分段线性拉伸并得到灰度化拉伸图像,对灰度化拉伸图像进行滤波处理并得到预处理图像。The collected aerial images of insulators are subjected to grayscale processing to obtain a grayscale image. According to the grayscale law of the grayscale image, the grayscale image is segmented and linearly stretched to obtain a grayscale stretched image. The scaled stretched image is filtered and the preprocessed image is obtained.

S2绝缘子分割S2 insulator segmentation

对预处理图像进行绝缘子串区域定位,从候选区域中提取绝缘子图像。Perform insulator string area localization on the preprocessed image, and extract the insulator image from the candidate area.

S201绝缘子识别与定位S201 insulator identification and positioning

根据预处理图像的灰度方差进行图像分类并得到分类图像,分类图像包括简单背景图像和复杂背景图像,当灰度方差>50为简单背景图像,当灰度方差≤50为复杂背景图像,采用像素点稀疏算法对简单背景图像进行处理或者将复杂背景图像转换至HSI颜色空间,然后进行图像滤波和图像腐蚀,利用图像运算得到骨架化图像,采用模糊计票的Hough变换算法检测并获得骨架化图像中的直线,根据设定的绝缘子串的直线长度筛选所有直线并获得绝缘子中轴线的候选直线,通过限定检测长度排除干扰并确定绝缘子主轴待选区域,在候选直线斜率垂直方向,采用广义Hough变换算法检测并获得圆盘状的曲线即圆盘型分布的点,对每一待选区域邻域内检测并获得圆盘状的曲线的数量即圆盘数量,当邻域内的圆盘数量超过设定阈值,则判定该处为绝缘子串并实现绝缘子串的精细定位。Image classification is performed according to the grayscale variance of the preprocessed image to obtain the classified image. The classified images include simple background images and complex background images. When the grayscale variance >50, it is a simple background image, and when the grayscale variance is less than or equal to 50, it is a complex background image. The pixel point sparse algorithm processes simple background images or converts complex background images to HSI color space, then performs image filtering and image erosion, uses image operations to obtain skeletonized images, and uses Hough transform algorithm for fuzzy counting to detect and obtain skeletonized images. For the straight line in the image, screen all straight lines according to the set straight line length of the insulator string and obtain the candidate straight line of the central axis of the insulator. By limiting the detection length, the interference is eliminated and the candidate area of the main axis of the insulator is determined. In the vertical direction of the slope of the candidate straight line, the generalized Hough is adopted. The transformation algorithm detects and obtains the disc-shaped curve, that is, the points of the disc-shaped distribution. The number of disc-shaped curves detected and obtained in the neighborhood of each candidate area is the number of discs. When the number of discs in the neighborhood exceeds the set value. If the threshold is set, it is determined that this place is an insulator string and the fine positioning of the insulator string is realized.

S202绝缘子图像分割S202 insulator image segmentation

根据精细定位从预处理图像中提取并获得绝缘子预处理图像,对绝缘子预处理图像进行腐蚀运算、提取最大联通域和膨胀运算处理并获得绝缘子区域图像。The insulator preprocessing image is extracted and obtained from the preprocessing image according to the fine positioning, the insulator preprocessing image is corroded, the maximum connected domain is extracted and the dilation operation is processed, and the insulator region image is obtained.

S3绝缘子故障检测S3 insulator fault detection

基于绝缘子区域图像,根据绝缘子中轴线方程进行绝缘子方向矫正,依据形态特征对绝缘子串进行分割,得到单个绝缘子图像,通过分析计算相邻绝缘子横轴线间距的变化规律,进行绝缘子自爆故障检测;通对计算图像灰度共生矩阵,得到单个绝缘子图像的纹理特征,判断绝缘子的覆尘污渍缺陷以及裂纹故障情况;依据红外图像对温度敏感的特性,检测零值绝缘子故障。Based on the image of the insulator area, the direction of the insulator is corrected according to the equation of the central axis of the insulator, the insulator string is divided according to the morphological characteristics, and a single insulator image is obtained. The grayscale co-occurrence matrix of the image is calculated to obtain the texture characteristics of a single insulator image, and the dust and stain defects and crack faults of the insulator are judged. According to the temperature-sensitive characteristics of the infrared image, the fault of the zero-value insulator is detected.

本申请的技术特点:Technical features of this application:

本发明针对绝缘子缺陷红外识别的方法,具体包括了绝缘子航拍图像的预处理、绝缘子航拍图像的分割、基于航拍图像的绝缘子故障红外检测三个主要方面解决了相关技术问题。The invention aims at the infrared identification method of insulator defects, which specifically includes three main aspects: preprocessing of insulator aerial photography images, segmentation of insulator aerial photography images, and infrared detection of insulator faults based on aerial photography images, and solves the related technical problems.

一、绝缘子航拍图像的预处理:本专利首先通过对采集到的图像数据进行灰度化处理,减少运算数据量。再根据绝缘子数据的灰度规律对图像进行分段线性拉伸,突出目标绝缘子区域。最后对图像进行滤波处理,对图像数据在采集和传输的过程中可能出现的噪声进行降噪处理。1. Preprocessing of aerial photography images of insulators: This patent firstly reduces the amount of computational data by performing grayscale processing on the collected image data. Then, according to the grayscale law of the insulator data, the image is segmented and linearly stretched to highlight the target insulator area. Finally, the image is filtered, and the noise that may appear in the process of image data acquisition and transmission is denoised.

二、绝缘子航拍图像的分割:本专利结合绝缘子图像的特异性特征,引入图像的灰度方差来进行图像分类。对于灰度方差,简单背景图像数值较大,均大于 50,而复杂背景图像均小于 50。对于简单背景图像,通过一种像素点稀疏算法减少运算数据量;对于复杂背景图像,通过将图像转换至 HSI 颜色空间后运算,优化图像质量,再通过图像滤波和图像腐蚀,突出目标特征。针对复杂背景处理后图像质量问题,对霍夫变换计票方式进行改进。本专利提出一种候选区域内的搜寻算法,最终定位绝缘子串。最后在中轴区域内使用图像开运算与最大联通域提取混合算法,最终实现绝缘子区域的分割。2. Segmentation of aerial photography images of insulators: This patent combines the specific features of insulator images and introduces the grayscale variance of images to classify images. For grayscale variance, simple background images have larger values, all greater than 50, while complex background images are all less than 50. For simple background images, a pixel sparse algorithm is used to reduce the amount of computational data; for complex background images, the image quality is optimized by converting the image to HSI color space, and then image filtering and image erosion are used to highlight the target features. Aiming at the problem of image quality after complex background processing, the Hough transform vote counting method is improved. This patent proposes a search algorithm in the candidate area to finally locate the insulator string. Finally, the hybrid algorithm of image opening operation and maximum connected domain extraction is used in the central axis area, and finally the segmentation of the insulator area is realized.

三、基于航拍图像的绝缘子故障红外检测:首先对图像中的绝缘子中轴进行基于中轴线斜率的方向矫正。再通过绝缘子横轴的分布规律,将绝缘子串分割为单个独立的绝缘子。对于自爆故障,利用绝缘子横轴间距的单调性,对不规则处进行检出判定;对于绝缘子污渍故障,利用一种绝缘子灰度差分横向比较的算法,检测得到故障区域;对于绝缘子温度异常故障,利用红外图像的温度敏感转换为灰度变换的特征,设计识别算法检测异常。3. Infrared detection of insulator faults based on aerial images: First, the direction correction based on the slope of the central axis is performed on the central axis of the insulator in the image. Then, according to the distribution law of the horizontal axis of the insulator, the insulator string is divided into a single independent insulator. For the self-explosion fault, the monotonicity of the insulator horizontal axis spacing is used to detect and determine the irregularities; for the insulator stain fault, an algorithm for horizontal comparison of the insulator grayscale difference is used to detect the fault area; for the abnormal temperature of the insulator fault, Using the characteristics of temperature-sensitive conversion of infrared images into grayscale transformations, a recognition algorithm is designed to detect abnormalities.

本申请的技术贡献:Technical contributions of this application:

本发明提出一种绝缘子缺陷红外识别方法具体包括了绝缘子航拍图像的预处理、绝缘子航拍图像的分割、基于航拍图像的绝缘子故障红外检测三个主要方面。The invention provides an infrared identification method for insulator defects, which specifically includes three main aspects: preprocessing of insulator aerial images, segmentation of insulator aerial images, and infrared detection of insulator faults based on aerial images.

一、绝缘子航拍图像的预处理。由于无人机搭载相机拍摄时还是存在些许不稳定的情况,再加上天气、日照和风向的原因,获取的图像数据可能会存在一些质量上的瑕疵,包括有噪声干扰以及对比度不足等,为了后续步骤的精准,需对采集到的图像进行预处理。由于采集的图像为三维 RGB 图像,而在对绝缘子自爆、污渍以及异常温度故障检测时,图像色彩信息影响较小,为了减少数据量,故本专利对简单背景图像处理时,采用灰度图像。为了使绝缘子缺陷更加明显,本专利提出一种基于经验的线性变换来增强图像。对于有噪点的图像,要对图像进行去噪处理。1. Preprocessing of aerial images of insulators. Due to some instability when the drone is equipped with a camera, coupled with the weather, sunshine and wind direction, the obtained image data may have some quality defects, including noise interference and insufficient contrast. In order to The accuracy of the subsequent steps requires preprocessing of the collected images. Since the collected image is a three-dimensional RGB image, the color information of the image has little effect on the detection of insulator self-explosion, stains and abnormal temperature faults. In order to reduce the amount of data, this patent uses grayscale images when processing simple background images. In order to make the insulator defects more obvious, this patent proposes an experience-based linear transformation to enhance the image. For noisy images, denoise the image.

二、绝缘子航拍图像的分割。本专利结合绝缘子图像的特异性特征,引入图像的灰度方差来进行图像分类。对于灰度方差,简单背景图像数值较大,均大于 50,而复杂背景图像均小于 50。对于简单背景图像,通过一种像素点稀疏算法减少运算数据量;对于复杂背景图像,通过将图像转换至 HSI 颜色空间后运算,优化图像质量,再通过图像滤波和图像腐蚀,突出目标特征。针对复杂背景处理后图像质量问题,对霍夫变换计票方式进行改进。本专利提出一种候选区域内的搜寻算法,最终定位绝缘子串。最后在中轴区域内使用图像开运算与最大联通域提取混合算法,最终实现绝缘子区域的分割。2. Segmentation of aerial images of insulators. This patent combines the specific features of the insulator image and introduces the grayscale variance of the image for image classification. For grayscale variance, simple background images have larger values, all greater than 50, while complex background images are all less than 50. For simple background images, a pixel sparse algorithm is used to reduce the amount of computational data; for complex background images, the image quality is optimized by converting the image to HSI color space, and then image filtering and image erosion are used to highlight the target features. Aiming at the problem of image quality after complex background processing, the Hough transform vote counting method is improved. This patent proposes a search algorithm in the candidate area to finally locate the insulator string. Finally, the hybrid algorithm of image opening operation and maximum connected domain extraction is used in the central axis area, and finally the segmentation of the insulator area is realized.

三、基于航拍图像的绝缘子故障红外检测。本专利采用同时同位置拍摄的可见光以及红外图像,实现绝缘子故障的综合检测。首先对图像中的绝缘子中轴进行基于中轴线斜率的方向矫正。再通过绝缘子横轴的分布规律,将绝缘子串分割为单个独立的绝缘子。对于自爆故障,利用绝缘子横轴间距的单调性,对不规则处进行检出判定;对于绝缘子污渍故障,利用一种绝缘子灰度差分横向比较的算法,检测得到故障区域;对于绝缘子温度异常故障,利用红外图像的温度敏感转换为灰度变换的特征,设计识别算法检测异常。3. Infrared detection of insulator faults based on aerial images. This patent uses visible light and infrared images taken at the same location at the same time to realize comprehensive detection of insulator faults. Firstly, the direction correction based on the slope of the central axis is performed on the central axis of the insulator in the image. Then, according to the distribution law of the horizontal axis of the insulator, the insulator string is divided into a single independent insulator. For the self-explosion fault, the monotonicity of the insulator horizontal axis spacing is used to detect and determine the irregularities; for the insulator stain fault, an algorithm for horizontal comparison of the insulator grayscale difference is used to detect the fault area; for the abnormal temperature of the insulator fault, Using the characteristics of temperature-sensitive conversion of infrared images into grayscale transformations, a recognition algorithm is designed to detect abnormalities.

技术方案说明:Technical solution description:

如图1所示,是本专利研究路线流程图。本专利的研究对象是航拍绝缘子的可见光与红外图像,主要研究内容如下:As shown in Figure 1, it is the flow chart of the research route of this patent. The research object of this patent is the visible light and infrared images of aerial insulators. The main research contents are as follows:

1)航拍图像的预处理1) Preprocessing of aerial images

根据绝缘子航拍图像的构图特点,结合具体数据来源处背景特征,采用适合的图像预处理手段,通过将图像灰度化处理,减少不必要的信息量。通过灰度拉伸增强图像,使目标区域的特征更为明显。再进行图像增强后再滤波清除噪声干扰,为后续进一步处理奠定基础。According to the composition characteristics of aerial photography images of insulators, combined with the background characteristics of specific data sources, appropriate image preprocessing methods are adopted to reduce unnecessary information by graying the images. Enhance the image by grayscale stretching to make the features of the target area more obvious. After image enhancement, filtering is performed to remove noise interference, which lays the foundation for subsequent further processing.

2)绝缘子识别与定位2) Insulator identification and positioning

首先根据图像背景复杂度区将图像分成两类,针对不同背景情况采用针对性的提取算法。再对几种传统图像分割算法进行仿真,从中对比得到适用于文本研究数据的分割算法。再利用图像运算得到图像骨架,在采用模糊计票改进后的Hough 变换检测骨架化图像中直线,据此采集绝缘子中轴线,通过限定检测长度等条件排除干扰,确定出绝缘子主轴待选区域。再使用广义 Hough 变换检测曲线,对各待选区域邻域内检测类圆盘曲线数量,实现绝缘子串的精细定位。Firstly, the image is divided into two categories according to the background complexity area of the image, and the targeted extraction algorithm is adopted for different background situations. Then several traditional image segmentation algorithms are simulated, and a segmentation algorithm suitable for text research data is obtained by comparison. Then, the image skeleton is obtained by image operation, and the straight line in the skeletonized image is detected by the Hough transform improved by fuzzy vote counting, and the central axis of the insulator is collected accordingly. Then, the generalized Hough transform detection curve is used to detect the number of disk-like curves in the neighborhood of each candidate area, so as to realize the fine positioning of the insulator string.

3)绝缘子图像分割3) Insulator image segmentation

对识别得到的绝缘子串区域图像进行改进后的图像加运算,即先对二值化绝缘子串区域图像进行腐蚀运算,再提取处理后的图像最大联通域,最后再对图像进行膨胀运算处理,实现绝缘子串的分割。The improved image addition operation is performed on the identified insulator string region image, that is, the binarized insulator string region image is first subjected to erosion operation, and then the maximum connected domain of the processed image is extracted, and finally the image is expanded. Segmentation of insulator strings.

4)绝缘子缺陷检测4) Insulator defect detection

本专利采用同时相同空间下目标绝缘子可见光和红外两种图像,实现对其多种缺陷故障的检测。首先根据绝缘子中轴线方程进行绝缘子方向矫正,依据形态特征对绝缘子串进行分割,得到单个绝缘子的图像。通过分析计算相邻绝缘子横轴线间距的变化规律,来进行绝缘子自爆故障检测;通对计算图像灰度共生矩阵,得到单个绝缘子图像的纹理特征来判断绝缘子的覆尘污渍缺陷以及裂纹故障情况;最后依据红外图像对温度敏感的特性,来检测零值绝缘子故障。This patent adopts visible light and infrared images of the target insulator in the same space at the same time to realize the detection of various defects. Firstly, the direction of the insulator is corrected according to the equation of the central axis of the insulator, and the insulator string is divided according to the morphological characteristics to obtain the image of a single insulator. The self-explosion fault detection of insulators is carried out by analyzing and calculating the variation law of the horizontal axis spacing of adjacent insulators; by calculating the gray-scale co-occurrence matrix of the images, the texture features of a single insulator image are obtained to judge the dust-covered stain defects and crack faults of the insulators; finally Based on the temperature-sensitive characteristics of infrared images, zero-value insulator faults are detected.

如图2所示,绝缘子分割算法流程图。该方法先对绝缘子图像进行预分类,再对不同背景复杂情况的图像采用特异性算法进行绝缘子串区域定位,再从候选区域中提取绝缘子图像的方法。该方法能区分灰度相近的导线和杆塔与绝缘子串的几何形状差异,提高识别准确率,又不需要对整幅图像像素点进行分类,计算量较少,运行速度较快。绝缘子串在图像中有较为明显的几何特性。本专利结合其几何特征,根据上述特性,首先对数据图片进行骨架化,突出绝缘子中轴的线性特征,再对处理后的图像全局进行基于霍夫变换的直线检测,根据绝缘子图像的几何特性,选取其中长度在某一范围的直线作为绝缘子串中轴的候选直线。再对候选直线斜率垂直方向宽度一定像素值的领域内,基于广义霍夫变换检测圆盘型分布的点,如果邻域内圆盘数量多于一个设定的阈值,则判定该处为绝缘子串,最终实现绝缘子串的精细定位。As shown in Figure 2, the flow chart of the insulator segmentation algorithm. The method first pre-classifies the insulator images, then uses a specific algorithm to locate the insulator string region for images with different background complexities, and then extracts the insulator images from the candidate regions. The method can distinguish the geometrical difference of conductors, towers and insulator strings with similar gray levels, improve the recognition accuracy, and does not need to classify the pixels of the whole image, with less computation and faster running speed. The insulator strings have obvious geometric characteristics in the image. This patent combines its geometric characteristics and according to the above characteristics, firstly skeletonizes the data picture to highlight the linear characteristics of the insulator central axis, and then globally performs line detection based on Hough transform on the processed image. According to the geometric characteristics of the insulator image, A straight line whose length is within a certain range is selected as the candidate straight line for the central axis of the insulator string. Then, in the field with a certain pixel value in the vertical direction of the slope of the candidate line, the point of the disk-shaped distribution is detected based on the generalized Hough transform. If the number of disks in the neighborhood is more than a set threshold, it is determined that the place is an insulator string. Finally, the fine positioning of the insulator string is realized.

如图3所示,为精细定位算法流程图。As shown in Figure 3, it is the flow chart of the fine positioning algorithm.

Step1:建立候选区域库。根据绝缘子粗定位获取的候选中轴线的端点坐标,计算直线的长度ln,其中 n 为识别出的直线的总数量。将ln长度大于最短长度lmin的坐标对存入一个新的矩阵中作为候选矩阵。其中每一行的 4 列分别储存每条候选区域中轴线的起始横纵坐标以及中止横纵坐标,由于直线的起始和中止方向不影响最终结果所以不分前后顺序。Step1: Build a candidate region library. Calculate the length ln of the straight line according to the endpoint coordinates of the candidate central axis obtained by the rough positioning of the insulator, where n is the total number of identified straight lines. The coordinate pairs whose length ln is greater than the shortest length lmin are stored in a new matrix as a candidate matrix. The 4 columns of each row respectively store the starting horizontal and vertical coordinates and the stopping horizontal and vertical coordinates of the central axis of each candidate area. Since the starting and stopping directions of the straight line do not affect the final result, there is no sequence.

Step2:依次确定候选区域。设定搜索宽度 d。对数组中的候选直线依次进行如下操作:根据端点坐标计算出直线斜率 k。在两个端点处,分别找到距离端点 d/ 2长度,且处在过端点斜率为-1/ k 直线上的两个点,如没有整数点则依据长度向端点反方向取证,以此为四个顶点构建矩形区域,则为每条中轴线待检区域。Step2: Determine the candidate regions in turn. Set the search width d. Perform the following operations on the candidate lines in the array in sequence: Calculate the slope k of the line according to the coordinates of the endpoints. At the two endpoints, find the two points that are d/2 in length from the endpoint and on a straight line with a slope of -1/k passing through the endpoint. Each vertex constructs a rectangular area, which is the area to be inspected for each central axis.

Step3:判定待检区域。设定阈值 p。对待检区域依次进行基于广义 Hough 变换的圆盘状检测。对于实际检测出的圆盘数量如果超过阈值 p,则判定该区域为绝缘子串的区域,将坐标端点存入新的结果矩阵中;如果检测出的圆盘数量不足阈值 p,则判定为干扰区域进行下一个待检区域的检测。最终绝缘子串的区域就是结果矩阵中所存端点围成的区域。Step3: Determine the area to be inspected. Set the threshold p. Disk-shaped detection based on generalized Hough transform is performed on the regions to be detected in turn. If the number of discs actually detected exceeds the threshold p, the area is determined to be an insulator string area, and the coordinate endpoints are stored in a new result matrix; if the number of discs detected is less than the threshold p, it is determined to be an interference area Carry out the detection of the next area to be inspected. The area of the final insulator string is the area enclosed by the endpoints stored in the result matrix.

通过上述算法,我们可以从多条待选直线中,选择出具有特定几何外形特征的直线,这样的直线大概率是绝缘子的中轴线。Through the above algorithm, we can select a straight line with a specific geometric shape feature from a plurality of straight lines to be selected, and such a straight line has a high probability of being the central axis of the insulator.

如图4所示,为稀疏算法流程图。算法思路为对骨架化处理之后的二值图像,通过一种类似于滤波的方式,使用滑动的像素块在图像中移动,稀疏像素点,使数据的像素点数量减少,在不影响图像的整体轮廓形状的基础上,实现减少霍夫变换过程中的计算次数的效果,从而达到缩短运算时间,提高算法效率的目的。As shown in Figure 4, it is the flow chart of the sparse algorithm. The algorithm idea is to use a method similar to filtering for the binary image after skeletonization, using sliding pixel blocks to move in the image, sparse pixels, and reduce the number of data pixels without affecting the overall outline of the image. On the basis of the shape, the effect of reducing the number of calculations in the Hough transform process is achieved, so as to achieve the purpose of shortening the operation time and improving the efficiency of the algorithm.

本申请保密运行一段时间后,现场技术人员反馈的有益之处在于:After the application has been run confidentially for a period of time, the benefits of feedback from on-site technicians are:

针对航拍图像的特性,选用合适的预处理手段。包括将图像灰度化,以减少运算数据量;根绝图像中目标绝缘子和干扰因素的灰度特点,设定合适灰度阈值对图像进行分段线性拉伸,突出图像主体;并对图像生成和传输时产生的噪声干扰进行针对性滤波处理。在航拍图像绝缘子串定位研究中,根据图像背景复杂度对图像进行分类,对简单背景的绝缘子采用数据集稀疏算法,减少运行时间,提高算法效率;而对于复杂图像进行颜色模型转换,通过中值滤波和图像腐蚀等手段得到质量较高的图像骨架图,再对传统霍夫变换的计票模式进行改进,最终得到图像主轴区域。通过圆形检测算法配合候选主轴区域内的搜索算法,得到绝缘子串的精确定位。对识别到的绝缘子串进行了记住主轴方向的矫正,进而根据横轴分布将图像分割为单个绝缘子图像。根据主轴间距变化规律识别绝缘子自爆故障;根据灰度梯度规律识别污渍故障;根据灰度反映温度情况识别绝缘子温度异常故障。本专利提出一种不依赖大数据量且能适用于多种故障的故障检测方法,提高了输电线路巡检的智能化水平。According to the characteristics of aerial images, appropriate preprocessing methods are selected. Including graying the image to reduce the amount of computational data; eradicating the grayscale characteristics of target insulators and interference factors in the image, setting appropriate grayscale thresholds to stretch the image piecewise linearly to highlight the main body of the image; The noise interference generated during transmission is subjected to targeted filtering processing. In the research on the location of insulator strings in aerial images, the images are classified according to the complexity of the image background, and the data set sparse algorithm is used for the insulators with simple backgrounds, which reduces the running time and improves the algorithm efficiency. The image skeleton map with higher quality is obtained by means of filtering and image erosion, and then the traditional Hough transform vote counting mode is improved to finally obtain the main axis area of the image. Accurate positioning of the insulator string is obtained through the circular detection algorithm and the search algorithm in the candidate main shaft area. The identified insulator strings are corrected to remember the main axis direction, and then the image is divided into individual insulator images according to the horizontal axis distribution. Identify the self-explosion fault of the insulator according to the change rule of the main shaft spacing; identify the stain fault according to the grayscale gradient law; identify the abnormal temperature fault of the insulator according to the grayscale reflected temperature. This patent proposes a fault detection method that does not depend on a large amount of data and can be applied to a variety of faults, which improves the intelligence level of power transmission line inspection.

第一,一种绝缘子缺陷红外检测方法包括S1图像预处理、S2绝缘子分割和S3绝缘子故障检测的步骤,所述步骤S1图像预处理,将采集到的绝缘子航拍图像进行灰度化处理并得到灰度化图像,根据灰度化图像的灰度规律对灰度化图像进行分段线性拉伸并得到灰度化拉伸图像,对灰度化拉伸图像进行滤波处理并得到预处理图像,其通过S1图像预处理、S2绝缘子分割和S3绝缘子故障检测的步骤等,实现了识别绝缘子缺陷。First, an infrared detection method for insulator defects includes the steps of S1 image preprocessing, S2 insulator segmentation, and S3 insulator fault detection. In the step S1 image preprocessing, the collected aerial images of insulators are subjected to grayscale processing to obtain grayscale images. According to the grayscale law of the grayscale image, the grayscaled image is linearly stretched piecewise to obtain a grayscale stretched image, and the grayscale stretched image is filtered to obtain a preprocessed image. Through the steps of S1 image preprocessing, S2 insulator segmentation and S3 insulator fault detection, etc., the identification of insulator defects is realized.

第二,所述步骤S2绝缘子分割,对预处理图像进行绝缘子串区域定位,从候选区域中提取绝缘子图像,运算效率较好,识别正确率较高。Second, in the step S2, insulator segmentation is performed, insulator string region positioning is performed on the preprocessed image, and insulator images are extracted from the candidate regions, which has better computing efficiency and higher recognition accuracy.

第三,所述步骤S2绝缘子分割包括S201绝缘子识别与定位和S202绝缘子图像分割的步骤,在所述步骤S201绝缘子识别与定位中,根据预处理图像的灰度方差进行图像分类并得到分类图像,分类图像包括简单背景图像和复杂背景图像,当灰度方差>50为简单背景图像,当灰度方差≤50为复杂背景图像,采用像素点稀疏算法对简单背景图像进行处理或者将复杂背景图像转换至HSI颜色空间,然后进行图像滤波和图像腐蚀,利用图像运算得到骨架化图像,运算效率较好,识别正确率较高。Third, the step S2 insulator segmentation includes the steps of S201 insulator identification and positioning and S202 insulator image segmentation. In the step S201 insulator identification and positioning, image classification is performed according to the grayscale variance of the preprocessed image and a classified image is obtained, The classified images include simple background images and complex background images. When the grayscale variance is greater than 50, it is a simple background image. When the grayscale variance is less than or equal to 50, it is a complex background image. The pixel sparse algorithm is used to process the simple background image or convert the complex background image. To the HSI color space, then image filtering and image erosion are performed, and the skeletonized image is obtained by image operation. The operation efficiency is good, and the recognition accuracy rate is high.

第四,在所述步骤S201绝缘子识别与定位中,得到骨架化图像之后,采用模糊计票的Hough变换算法检测并获得骨架化图像中的直线,根据设定的绝缘子串的直线长度筛选所有直线并获得绝缘子中轴线的候选直线,通过限定检测长度排除干扰并确定绝缘子主轴待选区域,运算效率较好,识别正确率较高。Fourth, in the step S201 insulator identification and positioning, after the skeletonized image is obtained, the Hough transform algorithm of fuzzy counting is used to detect and obtain the straight lines in the skeletonized image, and all straight lines are screened according to the set straight line length of the insulator string. And the candidate straight line of the insulator central axis is obtained, the interference is eliminated by limiting the detection length and the candidate area of the insulator main shaft is determined, the calculation efficiency is good, and the recognition accuracy rate is high.

第五,在所述步骤S201绝缘子识别与定位中,在确定绝缘子主轴待选区域之后,在候选直线斜率垂直方向,采用广义Hough变换算法检测并获得圆盘状的曲线即圆盘型分布的点,对每一待选区域邻域内检测并获得圆盘状的曲线的数量即圆盘数量,当邻域内的圆盘数量超过设定阈值,则判定该处为绝缘子串并实现绝缘子串的精细定位,运算效率较好,识别正确率较高。Fifth, in the step S201 insulator identification and positioning, after determining the area to be selected for the main axis of the insulator, in the vertical direction of the slope of the candidate straight line, the generalized Hough transform algorithm is used to detect and obtain a disc-shaped curve, that is, a disc-shaped distribution point. , detect and obtain the number of disc-shaped curves in the neighborhood of each candidate area, that is, the number of discs. When the number of discs in the neighborhood exceeds the set threshold, it is determined that the place is an insulator string and the fine positioning of the insulator string is realized. , the operation efficiency is better, and the recognition accuracy rate is higher.

第六,在所述步骤S202绝缘子图像分割中,根据精细定位从预处理图像中提取并获得绝缘子预处理图像,对绝缘子预处理图像进行腐蚀运算、提取最大联通域和膨胀运算处理并获得绝缘子区域图像,运算效率较好,识别正确率较高。Sixth, in the step S202 insulator image segmentation, extract and obtain the insulator pre-processing image from the pre-processing image according to the fine positioning, perform erosion operation on the insulator pre-processing image, extract the maximum connected domain and dilate operation processing, and obtain the insulator area. The image has better computing efficiency and higher recognition accuracy.

第七,在所述步骤S3绝缘子故障检测中,基于绝缘子区域图像,根据绝缘子中轴线方程进行绝缘子方向矫正,依据形态特征对绝缘子串进行分割,得到单个绝缘子图像,运算效率较好,识别正确率较高。Seventh, in the step S3 insulator fault detection, based on the insulator area image, the insulator direction is corrected according to the insulator central axis equation, and the insulator string is segmented according to the morphological characteristics to obtain a single insulator image. higher.

第八,在所述步骤S3绝缘子故障检测中,在得到单个绝缘子图像之后,通过分析计算相邻绝缘子横轴线间距的变化规律,进行绝缘子自爆故障检测,运算效率较好,识别正确率较高。Eighth, in the step S3 insulator fault detection, after obtaining a single insulator image, by analyzing and calculating the variation law of the horizontal axis spacing of adjacent insulators, the self-explosion fault detection of the insulator is performed. The calculation efficiency is good, and the identification accuracy rate is high.

第九,在所述步骤S3绝缘子故障检测中,在得到单个绝缘子图像之后,通对计算图像灰度共生矩阵,得到单个绝缘子图像的纹理特征,判断绝缘子的覆尘污渍缺陷以及裂纹故障情况,运算效率较好,识别正确率较高。Ninth, in the step S3 insulator fault detection, after a single insulator image is obtained, the grayscale co-occurrence matrix of the image is calculated to obtain the texture features of the single insulator image, and the dust and stain defects and crack faults of the insulator are judged. The efficiency is better, and the recognition accuracy rate is higher.

第十,在所述步骤S3绝缘子故障检测中,在得到单个绝缘子图像之后,依据红外图像对温度敏感的特性,检测零值绝缘子故障,运算效率较好,识别正确率较高。Tenth, in the step S3 insulator fault detection, after a single insulator image is obtained, the zero-value insulator fault is detected according to the temperature-sensitive characteristic of the infrared image, the calculation efficiency is good, and the identification accuracy rate is high.

Claims (1)

1.一种绝缘子缺陷红外检测方法,其特征在于:包括S1图像预处理、S2绝缘子分割和S3绝缘子故障检测的步骤,所述步骤S1图像预处理,将采集到的绝缘子航拍图像进行灰度化处理并得到灰度化图像,根据灰度化图像的灰度规律对灰度化图像进行分段线性拉伸并得到灰度化拉伸图像,对灰度化拉伸图像进行滤波处理并得到预处理图像;1. an insulator defect infrared detection method, it is characterized in that: comprise the steps of S1 image preprocessing, S2 insulator segmentation and S3 insulator fault detection, described step S1 image preprocessing, the collected insulator aerial image is grayed out Process and obtain a grayscale image, perform piecewise linear stretch on the grayscale image according to the grayscale law of the grayscale image, and obtain a grayscale stretched image, filter the grayscale stretched image, and obtain a pre-scaled image. process images; 所述步骤S2绝缘子分割,对预处理图像进行绝缘子串区域定位,从候选区域中提取绝缘子图像;步骤S2绝缘子分割包括S201绝缘子识别与定位和S202绝缘子图像分割的步骤,In the step S2 insulator segmentation, the preprocessed image is located in the insulator string area, and the insulator image is extracted from the candidate area; the step S2 insulator segmentation includes the steps of S201 insulator identification and location and S202 insulator image segmentation, 在所述步骤S201绝缘子识别与定位中,根据预处理图像的灰度方差进行图像分类并得到分类图像,分类图像包括简单背景图像和复杂背景图像,当灰度方差>50为简单背景图像,当灰度方差≤50为复杂背景图像,采用像素点稀疏算法对简单背景图像进行处理或者将复杂背景图像转换至HSI颜色空间,然后进行图像滤波和图像腐蚀,利用图像运算得到骨架化图像;得到骨架化图像之后,采用模糊计票的Hough变换算法检测并获得骨架化图像中的直线,根据设定的绝缘子串的直线长度筛选所有直线并获得绝缘子中轴线的候选直线,通过限定检测长度排除干扰并确定绝缘子主轴待选区域;在确定绝缘子主轴待选区域之后,在候选直线斜率垂直方向,采用广义Hough变换算法检测并获得圆盘状的曲线即圆盘型分布的点,对每一待选区域邻域内检测并获得圆盘状的曲线的数量即圆盘数量,当邻域内的圆盘数量超过设定阈值,则判定该处为绝缘子串并实现绝缘子串的精细定位;In the step S201 insulator identification and positioning, image classification is performed according to the grayscale variance of the preprocessed image to obtain a classified image. The classified image includes a simple background image and a complex background image. When the grayscale variance > 50, it is a simple background image. If the grayscale variance is less than or equal to 50, it is a complex background image. The pixel point sparse algorithm is used to process the simple background image or convert the complex background image to the HSI color space, and then perform image filtering and image erosion, and use the image operation to obtain the skeletonized image; obtain the skeleton. After transforming the image, the Hough transform algorithm of fuzzy counting is used to detect and obtain the straight lines in the skeletonized image, screen all the straight lines according to the set straight line length of the insulator string, and obtain the candidate straight line of the central axis of the insulator, and eliminate the interference by limiting the detection length. Determine the candidate area for the main axis of the insulator; after determining the candidate area for the main axis of the insulator, in the vertical direction of the slope of the candidate straight line, use the generalized Hough transform algorithm to detect and obtain the disc-shaped curve, that is, the points of the disc-shaped distribution, for each candidate area The number of disc-shaped curves detected and obtained in the neighborhood is the number of discs. When the number of discs in the neighborhood exceeds the set threshold, it is determined that the place is an insulator string and the fine positioning of the insulator string is realized; 在所述步骤S202绝缘子图像分割中,根据精细定位从预处理图像中提取并获得绝缘子预处理图像,对绝缘子预处理图像进行腐蚀运算、提取最大联通域和膨胀运算处理并获得绝缘子区域图像;In the step S202 insulator image segmentation, extracting and obtaining the insulator preprocessing image from the preprocessing image according to the fine positioning, performing erosion operation on the insulator preprocessing image, extracting the maximum connected domain and dilation operation processing, and obtaining the insulator area image; 在所述步骤S3绝缘子故障检测中,基于绝缘子区域图像,根据绝缘子中轴线方程进行绝缘子方向矫正,依据形态特征对绝缘子串进行分割,得到单个绝缘子图像;在得到单个绝缘子图像之后,通过分析计算相邻绝缘子横轴线间距的变化规律,进行绝缘子自爆故障检测;或者在得到单个绝缘子图像之后,通对计算图像灰度共生矩阵,得到单个绝缘子图像的纹理特征,判断绝缘子的覆尘污渍缺陷以及裂纹故障情况;或者在得到单个绝缘子图像之后,依据红外图像对温度敏感的特性,检测零值绝缘子故障。In the step S3 insulator fault detection, based on the insulator area image, the insulator direction is corrected according to the insulator central axis equation, and the insulator string is divided according to the morphological characteristics to obtain a single insulator image; after the single insulator image is obtained, the phase is analyzed and calculated The variation law of the distance between the horizontal axes of adjacent insulators is used to detect the self-explosion fault of the insulator; or after obtaining the image of a single insulator, the grayscale co-occurrence matrix of the image is calculated to obtain the texture characteristics of the single insulator image, and the dust and stain defects and crack faults of the insulator are judged. situation; or after obtaining a single insulator image, according to the temperature-sensitive characteristic of the infrared image, the zero-value insulator fault is detected.
CN202010432395.8A 2020-05-20 2020-05-20 A kind of infrared detection method of insulator defect Active CN111652857B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010432395.8A CN111652857B (en) 2020-05-20 2020-05-20 A kind of infrared detection method of insulator defect

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010432395.8A CN111652857B (en) 2020-05-20 2020-05-20 A kind of infrared detection method of insulator defect

Publications (2)

Publication Number Publication Date
CN111652857A CN111652857A (en) 2020-09-11
CN111652857B true CN111652857B (en) 2022-05-13

Family

ID=72345878

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010432395.8A Active CN111652857B (en) 2020-05-20 2020-05-20 A kind of infrared detection method of insulator defect

Country Status (1)

Country Link
CN (1) CN111652857B (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112432874B (en) * 2020-11-12 2023-09-08 国网山东省电力公司电力科学研究院 A tool and method for simulating internal heating of composite insulators
CN113466291B (en) * 2021-06-24 2023-05-02 华能秦煤瑞金发电有限责任公司 Analysis method for detecting mass concrete cracks based on temperature field change
CN113610774B (en) * 2021-07-16 2024-01-09 广州大学 Glass scratch defect detection method, system, device and storage medium
CN113762276B (en) * 2021-08-17 2024-07-09 湖南大学 Electric power operation ladder angle detection method
CN113763397B (en) * 2021-09-03 2024-03-29 国网山东省电力公司电力科学研究院 Composite insulator fault detection method and system
CN114235815A (en) * 2021-12-08 2022-03-25 国网福建省电力有限公司检修分公司 Method for detecting surface defects of outdoor electrical equipment of converter station based on scene filtering
CN114724042B (en) * 2022-06-09 2022-09-02 国网江西省电力有限公司电力科学研究院 A method for automatic detection of zero-value insulators in transmission lines
CN116228778B (en) * 2023-05-10 2023-09-08 国网山东省电力公司菏泽供电公司 A detection method and system for insulator rupture based on multi-modal information fusion
CN116994163B (en) * 2023-08-16 2025-07-01 西安因诺航空科技有限公司 Method for detecting edge cross intersection point of photovoltaic module based on infrared image

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106778734A (en) * 2016-11-10 2017-05-31 华北电力大学(保定) A kind of insulator based on rarefaction representation falls to go here and there defect inspection method
CN109884468A (en) * 2019-03-05 2019-06-14 河海大学 A detection method of insulator self-explosion defect based on image pixel accumulation analysis

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102508110B (en) * 2011-10-10 2014-07-09 上海大学 Texture-based insulator fault diagnostic method
CN105740844A (en) * 2016-03-02 2016-07-06 成都翼比特自动化设备有限公司 Insulator cracking fault detection method based on image identification technology
CN108037133B (en) * 2017-12-27 2021-01-26 武汉市智勤创亿信息技术股份有限公司 Intelligent electric power equipment defect identification method and system based on unmanned aerial vehicle inspection image
CN108986104B (en) * 2018-06-04 2022-05-17 国网浙江省电力有限公司检修分公司 Insulator image segmentation method based on distance transformation and watershed marking algorithm
CN109472776B (en) * 2018-10-16 2021-12-03 河海大学常州校区 Depth significance-based insulator detection and self-explosion identification method
CN110827278B (en) * 2019-11-27 2023-01-20 云南电网有限责任公司电力科学研究院 Transformer substation insulator defect online detection method and device

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106778734A (en) * 2016-11-10 2017-05-31 华北电力大学(保定) A kind of insulator based on rarefaction representation falls to go here and there defect inspection method
CN109884468A (en) * 2019-03-05 2019-06-14 河海大学 A detection method of insulator self-explosion defect based on image pixel accumulation analysis

Also Published As

Publication number Publication date
CN111652857A (en) 2020-09-11

Similar Documents

Publication Publication Date Title
CN111652857B (en) A kind of infrared detection method of insulator defect
CN115345885B (en) Appearance quality detection method for metal fitness equipment
CN110264448B (en) A method of insulator fault detection based on machine vision
CN103488988B (en) Method for extracting insulators in electrical equipment based on unmanned aerial vehicle line patrol visible light image
CN111310761B (en) Detection method of catenary insulators based on reconstruction and classification convolutional self-encoding network
CN110288571B (en) High-speed rail contact net insulator abnormity detection method based on image processing
CN113205063A (en) Visual identification and positioning method for defects of power transmission conductor
CN115063430B (en) Electric pipeline crack detection method based on image processing
CN110276747B (en) A method for fault detection and fault rating of insulators based on image analysis
CN115601379B (en) A precise surface crack detection technology based on digital image processing
CN109359604B (en) Method for identifying instrument under shadow interference facing inspection robot
CN117315289A (en) Aeroengine blade contour edge detection method based on image processing
CN113065484A (en) Insulator contamination state assessment method based on ultraviolet spectrum
CN112085651B (en) Automatic shock wave detection and tracking algorithm based on image self-adaptive threshold and feature extraction
CN118799706A (en) Bearing defect detection method and system based on computer vision
CN108665464A (en) A kind of foreign matter detecting method based on morphologic high tension electric tower and high-tension bus-bar
CN112595276A (en) Power transmission line icing thickness detection method based on deep learning
CN116205907A (en) Decorative plate defect detection method based on machine vision
CN117094916B (en) Visual inspection method for municipal bridge support
CN116071299A (en) A method and system for detecting insulator RTV spraying defects
CN114418968A (en) Power transmission line small target defect detection method based on deep learning
CN115423740A (en) Method for identifying size of internal defect area of EPR vehicle-mounted cable terminal
CN105528790A (en) Transmission line small part identification method
CN111008967A (en) A method for identifying defects in insulator RTV coating
CN108805855B (en) A method for rapid identification of concrete cracks

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant