[go: up one dir, main page]

CN109523479A - Visual detection method for gap on surface of pier - Google Patents

Visual detection method for gap on surface of pier Download PDF

Info

Publication number
CN109523479A
CN109523479A CN201811334774.2A CN201811334774A CN109523479A CN 109523479 A CN109523479 A CN 109523479A CN 201811334774 A CN201811334774 A CN 201811334774A CN 109523479 A CN109523479 A CN 109523479A
Authority
CN
China
Prior art keywords
image
gap
area
pier
edge
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811334774.2A
Other languages
Chinese (zh)
Inventor
魏亚东
李川
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dongguan University of Technology
Original Assignee
Dongguan University of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dongguan University of Technology filed Critical Dongguan University of Technology
Priority to CN201811334774.2A priority Critical patent/CN109523479A/en
Publication of CN109523479A publication Critical patent/CN109523479A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/70Denoising; Smoothing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/11Region-based segmentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/13Edge detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/136Segmentation; Edge detection involving thresholding
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/155Segmentation; Edge detection involving morphological operators
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20048Transform domain processing
    • G06T2207/20064Wavelet transform [DWT]

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Quality & Reliability (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)

Abstract

The invention relates to a visual detection method for a gap on the surface of a pier, which obtains a color image of the surface of the pier through a linear array CCD camera; compressing and storing the color image in blocks, converting the color image into a gray image, and performing noise reduction treatment; performing image enhancement smoothing processing on the gray level image by using the linear characteristic of the bridge pier gap and adopting an image mask filtering algorithm; respectively calculating the interval and the intra-area distance of the area A and the area B by adopting an interval and intra-area distance method, enabling the ratio of the interval and the intra-area distance of the area A to the interval and the intra-area distance of the area B to be maximum by changing parameter values, taking a threshold result at the moment as a comprehensive segmentation threshold of a bridge pier gap image, and detecting the gap edge of the bridge pier image by adopting a wavelet transform gradient image segmentation algorithm; and finally, extracting the gap edge of the pier image by using a multi-scale morphological image edge detection method, and identifying the gap in the pier image by using a morphological watershed algorithm controlled by a marker, so that the efficient identification and detection of the pier gap can be realized.

Description

一种桥墩表面缝隙视觉检测方法A visual detection method on the surface gap on the pier surface

技术领域technical field

本发明涉及图像检测识别技术,特别涉及一种桥墩表面缝隙视觉检测方法。The invention relates to image detection and recognition technology, in particular to a visual detection method for gaps on the surface of bridge piers.

背景技术Background technique

随着社会的不断发展,现如今我国桥梁工程的建设也有了很大的发展,但是由于桥梁的设计、建设期间以及日后的养护过程中做的不到位,在加上自然环境的影响、桥墩服役的时间长短均使得桥墩结构逐步出现损伤;桥墩表面的结构缝隙就很明显的反应出桥墩的伤损程度,如果桥墩缝隙问题不能得到本质上的解决,这将给桥墩工程的安全带来很大的隐患。With the continuous development of society, the construction of bridge engineering in our country has also made great progress. However, due to the inadequacy of bridge design, construction period and future maintenance process, coupled with the influence of the natural environment and the service of bridge piers The length of time will cause damage to the pier structure gradually; the structural gaps on the surface of the pier will clearly reflect the damage of the pier. Hidden dangers.

在诸多桥墩病害中,桥墩缝隙是一种危及桥墩安全但却较难计测的一种破损状态;目前对此类病害的检测多停留在人工作业阶段,通常使用近距离的检测仪器将裂纹放大后对宽度进行检测,裂纹的长度则是靠不精确的测量或者估算得到,这种方法需要检测人员借助道路检测车或者搭架进行,因此工作强度大、检测费用高昂且对人员安全要求很高。Among many bridge pier diseases, bridge pier gap is a kind of damaged state that endangers the safety of bridge piers but is difficult to measure; at present, the detection of such diseases mostly stays in the manual operation stage, and the cracks are usually detected by close-range detection instruments. After zooming in, the width is detected, and the length of the crack is obtained by inaccurate measurement or estimation. This method requires inspection personnel to use a road inspection vehicle or a frame, so the work intensity is high, the inspection cost is high, and the safety requirements for personnel are high. high.

近些年来,随着科学技术的进步以及计算机数据处理能力、速度、容量等性能的提高和数字摄像技术的发展,数字图像处理技术已广泛用于办公自动化、工业机器人、地理数据处理以及医学等相关领域;在工业工程方面已成功应用于检测构件表面变形及损伤、叶片面积以及构件受复杂应力的研究;鉴于国内当前桥墩检测技术的不足以及数字图像技术的优势,开展基于图象处理技术的桥墩缝隙自动识别技术的应用实践,对保障桥墩运营安全、降低检测成本、推动我国交通事业的快速发展具有重要意义。In recent years, with the advancement of science and technology, the improvement of computer data processing capabilities, speed, capacity and other performances, and the development of digital camera technology, digital image processing technology has been widely used in office automation, industrial robots, geographic data processing, and medicine. Related fields; in industrial engineering, it has been successfully applied to the detection of surface deformation and damage of components, the area of blades and the research of complex stress on components; in view of the shortcomings of current domestic bridge pier detection technology and the advantages of digital image technology, the development of image processing technology based The application practice of bridge pier gap automatic identification technology is of great significance to ensure the safety of bridge pier operation, reduce the cost of detection, and promote the rapid development of my country's transportation industry.

发明内容SUMMARY OF THE INVENTION

本发明的目的是为了解决背景技术而提出的一种桥墩表面缝隙视觉检测方法,通过线阵CCD相机获取桥墩表面彩色图像;对彩色图像分块压缩存储,将彩色图像转化成灰度图像,并进行降噪处理;利用桥墩缝隙的线性特征,采用图像掩膜滤波算法对灰度图像进行图像增强平滑处理;采用区间、区内距离法分别计算区域A和区域B的区间、区内距离,通过改变参数值使得区域A和区域B的区间、区内距离比达到最大,此时的阈值结果作为桥墩缝隙图像的综合分割阈值,采用小波变换梯度图像分割算法对桥墩图像的缝隙边缘进行检测;最后使用多尺度形态学图像边缘检测法提取桥墩图像的缝隙边缘,运用标记符控制的形态学分水岭算法识别桥墩图像中的缝隙,能够实现对桥墩缝隙的高效识别检测,具有良好的应用前景。The purpose of the present invention is to propose a visual detection method for bridge pier surface gaps in order to solve the background technology, obtain the color image of the bridge pier surface through a linear array CCD camera; compress and store the color image in blocks, convert the color image into a grayscale image, and Carry out noise reduction processing; use the linear characteristics of the bridge pier gap, use the image mask filter algorithm to perform image enhancement and smoothing on the gray image; use the interval and intra-area distance method to calculate the interval and intra-area distance of area A and area B respectively, and pass Change the parameter value so that the distance ratio between the interval and the area of area A and area B reaches the maximum, and the threshold value at this time is used as the comprehensive segmentation threshold of the gap image of the pier, and the edge of the gap of the pier image is detected by using the wavelet transform gradient image segmentation algorithm; finally Using the multi-scale morphological image edge detection method to extract the gap edge of the bridge pier image, and using the marker-controlled morphological watershed algorithm to identify the gap in the bridge pier image can realize efficient recognition and detection of the bridge pier gap, and has a good application prospect.

由于各种因素的影响,例如图像采集,图像传输,图像各类变换等,常常影响了桥墩图像的质量,给桥墩缝隙识别带来困难;图像增强的首要目标是处理图像,使其比原始图像更适用于特定的应用;对桥墩缝隙图像来说,就是增强桥墩缝隙信息,降低纹理、阴影、光照不均匀等各类噪音。Due to the influence of various factors, such as image acquisition, image transmission, and various image transformations, etc., the quality of the image of the bridge pier is often affected, and it is difficult to identify the gap of the bridge pier; It is more suitable for specific applications; for bridge pier gap images, it is to enhance the information of bridge pier gaps and reduce various noises such as textures, shadows, and uneven illumination.

为了实现上述目的,本发明采用了如下技术方案:In order to achieve the above object, the present invention adopts the following technical solutions:

一种桥墩表面缝隙视觉检测方法,将线阵CCD相机与位移传感器固定于同一检测平台,检测平台移动过程中,位移传感器提供位移信号,线阵CCD相机根据该位移信号获取桥墩表面彩色图像;A visual detection method for the surface gap of bridge pier, in which a linear array CCD camera and a displacement sensor are fixed on the same detection platform, during the movement of the detection platform, the displacement sensor provides a displacement signal, and the linear array CCD camera obtains a color image of the bridge pier surface according to the displacement signal;

对彩色图像分块压缩存储,将彩色图像转化成灰度图像,并进行降噪处理;Compress and store the color image in blocks, convert the color image into a grayscale image, and perform noise reduction processing;

利用桥墩缝隙的线性特征,采用图像掩膜滤波算法对灰度图像进行图像增强平滑处理;Using the linear characteristics of the gap between the bridge pier, the image mask filter algorithm is used to enhance the image enhancement and smooth processing of the gray image;

采用区间、区内距离法分别计算区域A和区域B的区间、区内距离,通过改变参数值使得区域A和区域B的区间、区内距离比达到最大,此时的阈值结果作为桥墩缝隙图像的综合分割阈值;The interval and intra-area distance methods are used to calculate the interval and intra-area distances of area A and area B respectively, and the ratio of interval and intra-area distance between area A and area B is maximized by changing the parameter value, and the threshold result at this time is used as the pier gap image The comprehensive division threshold;

采用小波变换梯度图像分割算法对桥墩图像的缝隙边缘进行检测;Using the wavelet transform gradient image segmentation algorithm to detect the gap edge of the pier image;

使用多尺度形态学边缘检测算法根据结构元素的类型、结构元素的大小、膨胀操作的次数,对桥墩图像进行分割进而提取桥墩图像缝隙边缘。The multi-scale morphological edge detection algorithm is used to segment the pier image according to the type of structural element, the size of the structural element, and the number of expansion operations, and then extract the gap edge of the pier image.

在灰度图像中,一个区域内部相邻像素灰度值变化平缓,差值较小,统计方差小;相反,在区域的边缘,图像像素间的灰度值变化较大,因而统计方差就大;掩膜处理的目的就是对图像进行滤波操作的同时,尽可能的不要破坏区域边缘的细节,该方法应用于桥墩图像增强时,既可以去除图像中的噪音,又能较好地保护缝隙边缘的细节;对图像邻域的处理工作就是处理该邻域图像的像素值以及与该邻域有相似或者相同像素分布的子图像像素值。In a grayscale image, the grayscale values of adjacent pixels in a region change gently, the difference is small, and the statistical variance is small; on the contrary, at the edge of the region, the grayscale values between image pixels change greatly, so the statistical variance is large ; The purpose of mask processing is to filter the image while not destroying the details of the edge of the area as much as possible. When this method is applied to image enhancement of bridge pier, it can not only remove the noise in the image, but also better protect the edge of the gap details; the processing of the image neighborhood is to process the pixel values of the neighborhood image and the pixel values of the sub-images that have similar or the same pixel distribution as the neighborhood.

滤波处理的机制是在要处理的图像中逐点地移动事先定义的掩膜,滤波器在每一点(x,y)处的响应按照事先定义的公式来计算,一般其响应输出由掩膜模板系数与滤波掩模移动过区域相对应像素值的乘积累加求和给出。The mechanism of filtering processing is to move the pre-defined mask point by point in the image to be processed. The response of the filter at each point (x, y) is calculated according to the pre-defined formula. Generally, the response output is determined by the mask template The coefficient and filtering mask move the area of the relative pixel value of the pixel value.

可以把一幅数字图像中分成多个区域或者子图像,分区时尽量让相邻区域的变化大,而同一区域内部的变化较小,并且在同一区域内部,中间像素的变化要小于边缘像素的变化。A digital image can be divided into multiple areas or sub-images. When partitioning, try to make the changes in the adjacent areas large, while the changes in the same area are small, and in the same area, the change of the middle pixels is smaller than that of the edge pixels. Variety.

为了改善图像的质量,降低和去除图像中的噪音,可以只抽取图像的线形特征,在实现具体计算时,将掩膜中心点与图像中需要处理的像素点重合,并将掩膜中各元素值与掩膜覆盖图像区域对应的像素值相乘,掩膜中心点所在像素的灰度值用掩膜的输出响应来代替,也就是上一步计算的模板各元素乘积之和。In order to improve the quality of the image, reduce and remove the noise in the image, only the linear features of the image can be extracted. When implementing specific calculations, the center point of the mask is coincident with the pixel points that need to be processed in the image, and each element in the mask is The value is multiplied by the pixel value corresponding to the image area covered by the mask, and the gray value of the pixel where the mask center point is located is replaced by the output response of the mask, which is the sum of the products of the elements of the template calculated in the previous step.

如果用3×3掩模模板,按照上述的方法,图像中点(x,y)处的掩模线性滤波响应值R为:If a 3×3 mask template is used, according to the above method, the mask linear filter response value R at the point (x, y) in the image is:

R=w(-1,-1)f(x-1,y-1)+w(-1,0)f(x-1,y)+…+w(0,0)f(x,y)+w(1,0)f(x+1, y)+w(1,1)f(x+1,y+1)R = w (-1, -1) f (x-1, y-1)+w (-1, 0) f (x-1, y)+...+w (0,0) f (x, y )+w (1, 0) f (x+1, y)+w (1, 1) f (x+1, y+1)

在实现掩膜平滑滤波时,当掩膜在图像中移动时,滤波器中心点靠近图像轮廓,如果一个n×n大小的方形平滑掩膜,掩膜中心与图像边缘距离(n-2)/2 个像素时,图像边缘与至少一条掩膜边重合;掩膜继续向图像边缘移动时,掩膜的边就会处在图像边缘之外;因此,在移动掩膜时,尽量不要让掩膜中心点离图像边缘的距离大于(n-2)/2个像素。When implementing mask smoothing filtering, when the mask moves in the image, the center point of the filter is close to the image contour. If a square smooth mask of n×n size is used, the distance between the mask center and the edge of the image is (n-2)/2 pixels, the edge of the image coincides with at least one edge of the mask; when the mask continues to move to the edge of the image, the edge of the mask will be outside the edge of the image; therefore, when moving the mask, try not to let the center of the mask The point is more than (n-2)/2 pixels away from the edge of the image.

由于桥墩图像缝隙具有线性特征,并且具有方向性,根据这一特点,扩展上一节讨论的单模板,构造出8个方向的单掩膜;一般来说,图像中的一个像素点具有8邻域,也就是说一个像素点有8个方向,如图2所示。Since the pier image gap has linear characteristics and has directionality, according to this characteristic, the single template discussed in the previous section is extended to construct a single mask in 8 directions; generally speaking, a pixel in the image has 8 neighbors Domain, that is to say, a pixel has 8 directions, as shown in Figure 2.

在8个方向上,构造8个大小为3×3的模板,将8个模板依次处理同一个图像窗口,在图像窗口内,将其各像素的灰度值与模板对应位置的元素值依次相乘,然后累加求和,结果为Ci=0,1,...7。Construct 8 templates with a size of 3×3 in 8 directions, process the 8 templates in turn in the same image window, and in the image window, compare the gray value of each pixel with the element value of the corresponding position of the template in turn. Ride, then accumulate the sum, the result is C i = 0,1, ... 7.

图像窗口的中心像素输出值用下式表示:g(m,n)=max(Ci)。The output value of the central pixel of the image window is represented by the following formula: g(m, n)=max(C i ).

当图像窗口是5×5,中心位置(窗口中的空心圆点)为(j,k),在该窗口中可以确定9种不同的掩膜模板,如图3所示。When the image window is 5×5, and the center position (hollow dot in the window) is (j, k), 9 different mask templates can be determined in this window, as shown in Fig. 3 .

因此,在对图像进行掩膜滤波时,首先计算各个模板的均值及方差:Therefore, when performing mask filtering on an image, first calculate the mean and variance of each template:

式中:i表示各个掩膜模板的编号,i=1,2,…,9,q为对应掩膜模板中包含像素的个数,(m,n)为掩膜模板内像素相对于中心像素(j,k)的位移量。In the formula: i represents the serial number of each mask template, i=1, 2, ..., 9, q is the number of pixels contained in the corresponding mask template, (m, n) is the pixel in the mask template relative to the central pixel (J, K) displacement.

计算9个模板的方差,并进行比较,将具有最小方差的模板所对应的灰度均值作为掩膜平滑输出的新灰度值: Calculate the variance of the 9 templates and compare them, and use the gray mean value corresponding to the template with the smallest variance as the new gray value of the mask smooth output:

因此,作为本发明更进一步的限定,图像增强平滑处理具体为:Therefore, as a further limitation of the present invention, the image enhancement smoothing process is specifically:

首先,计算各个模板的均值Ei及方差ΩiFirst, calculate the mean E i and variance Ω i of each template:

式中:i表示各个掩膜板的编号,i=1,2,…,9,In the formula: i represents the number of each mask plate, i=1, 2,..., 9,

q为对应掩膜板中包含像素的个数,(m,n)为掩膜板内像素相对于中心像素(j,k)的位移量;q is the number of pixels contained in the corresponding mask, and (m, n) is the displacement of the pixel in the mask relative to the central pixel (j, k);

再计算9个模板的方差并进行比较,将具有最小方差的模板所对应的灰度均值作为掩膜平滑输出的新灰度值, Calculate the variance of 9 templates and compare it. The ash the average value of the ash with the smallest variance template is used as the new gray value of the smooth output of the mask.

由于图像有目标和背景组成,其中目标就是要识别的缝隙对象,这样需要根据像素值把图像分成两部分,从背景中分割出缝隙最常用的方法就是选择一个阈值,大于该阈值就是缝隙目标,其它构成背景。Since the image consists of a target and a background, and the target is the gap object to be identified, it is necessary to divide the image into two parts according to the pixel value. The most common method to segment the gap from the background is to select a threshold, which is greater than the threshold. Other composition backgrounds.

在确定阈值时,如果阈值定得过高,偶然出现的物体点就会被认为是背景;如果阈值过低,则会发生相反的情况;因此,在桥墩表面图像较为复杂时,直方图很难出现明显的峰值,往往连成一片,运用直方图选取最佳阈值变得困难;这时可以根据整幅图像的全局信息来确定阈值,运用最大区内、区间距离阈值准则提取桥墩图像中的缝隙能够取得较好的效果。When determining the threshold, if the threshold is set too high, occasional object points will be considered as the background; if the threshold is too low, the opposite will happen; therefore, when the image of the pier surface is complex, the histogram is difficult. There are obvious peaks, which are often connected together, and it becomes difficult to use the histogram to select the optimal threshold; at this time, the threshold can be determined according to the global information of the entire image, and the gaps in the pier image can be extracted by using the maximum area and interval distance threshold criteria Can achieve better results.

因此,作为本发明更进一步的限定,综合分割阈值通过以下方式求取:Therefore, as a further limitation of the present invention, the comprehensive segmentation threshold is obtained in the following manner:

将整幅路面破损图像分割成一系列的子图像;然后分别计算每个子图像的分割阈值,并求取全图的平均灰度、区域A和区域B的平均灰度;采用区间、区内距离法分布计算区域A和区域B的区间、区内距离,最后通过改变的值求得区域A和区域B的区间、区内距离比达到最大,作为破损图像的综合分割阈值: Segment the entire road damage image into a series of sub-images; then calculate the segmentation threshold of each sub-image separately, and calculate the average gray level of the whole image, the average gray level of area A and area B; use interval and intra-area distance method Distribution calculation area A and region B range and district distance, and finally change The value ratio of the area A and the region B of the area A and the area B is maximum.

其中,为区域A和区域B的区间距离;为区域A和区域B的区内距离。in, The distance between regional A and region B; The distance in the area A and region B.

在桥墩图像中,某个位置的缝隙和背景与另一个区域的缝隙和背景并不完全相同,存在一定得差异,这是由于图像采集设备和采集环境的影响,即有些区域的非缝隙区域灰度值偏低,有些区域的缝隙区域灰度值会偏高;此时,利用全局最大区间、区内距离法计算整幅图像的分割阈值,易造成将某些缝隙区域误判为非缝隙区域,也会常将某些非缝隙区域误判为缝隙区域;因此,采用全局最大类间、类内距离阈值分割算法计算分割阈值,不能很好的将破损区域从非破损区域中分割出来。In the pier image, the gap and background of a certain position are not exactly the same as those of another area, and there are some differences. This is due to the influence of the image acquisition equipment and the acquisition environment, that is, the non-gap area in some areas is gray If the intensity value is low, the gray value of the gap area in some areas will be high; at this time, using the global maximum interval and intra-area distance method to calculate the segmentation threshold of the entire image may easily cause some gap areas to be misjudged as non-gap areas , some non-seam regions are often misjudged as seam regions; therefore, using the global maximum inter-class and intra-class distance threshold segmentation algorithm to calculate the segmentation threshold cannot separate the damaged area from the non-damaged area.

而,采用区间、区内距离法分布计算区域A和区域B的区间、区内距离,最后通过改变的值求得区域A和区域B的区间、区内距离比达到最大,作为破损图像的综合分割阈值,能够实现在在背景区域,通过全局阈值的阈值加权,得到一个新的阈值,即综合分割阈值,则该综合分割阈值与原来的全局阈值相比要小;采用该新的分割阈值对路面破损图像进行分割,则基本上可以将该小块判定为目标像素。However, the interval and intra-area distance method is used to distribute and calculate the interval and intra-area distance between area A and area B, and finally by changing Calculate the value of the value of the area A and area B, and the distance ratio between the area and the area reaches the maximum. As the comprehensive segmentation threshold of the damaged image, it can be achieved in the background area and weighted by the threshold of the global threshold to obtain a new threshold, that is, the comprehensive segmentation threshold, the comprehensive segmentation threshold is smaller than the original global threshold; using the new segmentation threshold to segment the road surface damage image, the small block can basically be determined as the target pixel.

在图像缝隙的自动识别中,由于无法事先得知图像存在什么方向的噪音,因此很难选择重构的子图像,事实上,仅对平滑图像进行重构基本上能够达到消除随机噪音和增强缝隙图像的目的;但是,如果图像存在大量的水平和垂直方向的纹理,这时可以采用选择水平子图像和斜线子图像的重构策略。In the automatic recognition of image gaps, it is difficult to select reconstructed sub-images because it is impossible to know the direction of noise in the image in advance. In fact, only reconstructing smooth images can basically achieve the elimination of random noise and enhancement of gaps. The purpose of the image; however, if the image has a large amount of texture in the horizontal and vertical directions, a reconstruction strategy of selecting horizontal sub-images and oblique sub-images can be adopted at this time.

对于上述水平子图像和斜线子图像的重构需要通过小波变换来实现对图像重构的多分辨分析;因此,作为本发明更进一步的限定,小波变换梯度图像分割算法具体为:通过小波变换及其用于重构的逆变换,将梯度方向和模最大值保存在小波系数当中,分析和变换小波系数最大值,对噪音和特征对应的小波系数分别处理,实现图像的缝隙边缘的检测并噪音分离,即可实现对图像中缝隙的有效平滑、锐化处理。For the reconstruction of the above-mentioned horizontal sub-image and oblique line sub-image, it is necessary to realize multi-resolution analysis of image reconstruction by wavelet transform; therefore, as a further limitation of the present invention, the wavelet transform gradient image segmentation algorithm is specifically: by wavelet transform And its inverse transformation for reconstruction, the gradient direction and the maximum modulus are stored in the wavelet coefficients, the maximum value of the wavelet coefficients is analyzed and transformed, and the wavelet coefficients corresponding to the noise and features are processed separately to realize the detection of the edge of the image gap and Noise separation can achieve effective smoothing and sharpening of the gaps in the image.

图像缝隙边缘增强的目的是加强目标的特征信息,同时抑制噪音的影响;然而,带噪音的桥墩图像增强是所有增强算法都面临的难点,因为噪音与真实图像变化显著的边缘一样,在频域均对应于高频子带,当采用增强算法突显高频部分而提高边缘的对比度、改善图像质量的同时,将不可避免地放大噪音。The purpose of image gap edge enhancement is to enhance the feature information of the target while suppressing the influence of noise; however, the image enhancement of bridge piers with noise is a difficulty faced by all enhancement algorithms, because the noise is the same as the edge of the real image with significant changes, in the frequency domain Both correspond to high-frequency sub-bands. When the enhancement algorithm is used to highlight the high-frequency part to improve the contrast of the edge and improve the image quality, the noise will inevitably be amplified.

因此,可对噪音和特征对应的小波系数分别做不同的处理,根据在每个尺度2j上小波系数模最大值和梯度方向这两个分量的大小确定边缘的位置及属性;在降低噪音的同时,对缝隙边缘有增强的作用;具体做法是在每个尺度2j上对小波变换的两个分量W1和W2做变换,并对第j层分解得到的子图像Wj(x,y)进行自适应调整,做如下变换:Therefore, the wavelet coefficients corresponding to the noise and features can be treated differently, and the position and attribute of the edge can be determined according to the two components of the wavelet coefficient modulus maximum value and the gradient direction at each scale 2j; while reducing the noise , has an enhanced effect on the edge of the gap; the specific method is to transform the two components W 1 and W 2 of the wavelet transform on each scale 2j, and decompose the sub-image W j (x,y) obtained by the jth layer Adapt to adaptive adjustments, make the following changes:

其中,为阈值,为增益,是尺度j上的边缘。in, For the threshold, For gain, It is the edge on the scale J.

为了使算法具有很好的自适应调整能力,参数分别如下:In order to make the algorithm have a good adaptive adjustment ability, parameters They are as follows:

其中,W1和W2是梯度图像(x,y)小波变换的两个分量。in, W 1 and W 2 are the two components of the gradient image (x, y) wavelet transform.

因此,作为本发明更进一步的限定,对噪音和特征对应的小波系数分别处理具体为:Therefore, as a further limitation of the present invention, the wavelet coefficients corresponding to noise and features are respectively processed as follows:

对第j层分解得到的子图像Wj(x,y)进行自适应调整,做如下变化:Adaptively adjust the sub-image W j (x, y) obtained by decomposing the jth layer, and make the following changes:

其中,为阈值,为增益,是尺寸j上的边缘;in, For the threshold, For gain, It is the edge on the size J;

为了使算法具有很好的自适应调整能力,参数分别如下:In order to make the algorithm have a good adaptive adjustment ability, parameters They are as follows:

其中, W1和W2是梯度图像Wj(x,y)小波变换的两个分量。in, W 1 and W 2 are two components of the wavelet transform of the gradient image W j (x,y).

图5中a)、b)是本发明的上述算法进行边缘检测的结果,降噪后的图像,图5中a)、b)显著降低了图像的噪音。A) and b) in Fig. 5 are the results of edge detection performed by the above-mentioned algorithm of the present invention, and the image after noise reduction, a) and b) in Fig. 5 have significantly reduced the noise of the image.

由于桥墩文理、桥墩材料、拍照环境等各种因素的影响,桥墩图像背景噪音比较复杂,包含的噪音也较多,为了避免影响缝隙边缘检测的效果,应先对桥墩图像进行形态学滤波处理,形态学开放运算处理消除了桥墩图像中与结构元素相比尺寸较小的小灰度值细节,而保持整个桥墩图像的灰度值和较大的区域,这样有时候图像中的微细缝隙被当作了背景,不容易被识别。Due to the influence of various factors such as bridge pier texture, pier material, and photographing environment, the background noise of bridge pier images is relatively complex and contains a lot of noise. In order to avoid affecting the effect of gap edge detection, morphological filtering should be performed on bridge pier images first. The morphological opening operation process eliminates the small gray value details in the bridge pier image that are smaller in size compared with the structural elements, while maintaining the gray value and larger areas of the entire bridge pier image, so that sometimes the fine gaps in the image are taken as It is not easy to be recognized.

形态学的闭合运算能消除桥墩图像中与结构元素相比尺寸较小的大灰度值细节,而基本保持整个桥墩图像的灰度值和较大的图像区域;因此,形态学开运算和闭运算可用于桥墩图像的滤波处理。The morphological closing operation can eliminate the large gray value details of the small size compared with the structural elements in the pier image, and basically maintain the gray value and larger image area of the entire pier image; therefore, the morphological opening operation and closing operation The operation can be used for filtering of bridge pier images.

但是,在实际应用时,结构元素的确定要考虑待处理桥墩图像缝隙组成部分的形状特点及其大小,因为它不能处理有相同形状而大小不同的对象;所以,既要考虑处理对象的形状又要考虑其大小,本发明提出以不断增加结构元素尺度的交替顺序滤波处理,根据开闭运算的先后顺序分别定义为:However, in actual application, the determination of structural elements should consider the shape characteristics and size of the gap components of the pier image to be processed, because it cannot handle objects with the same shape but different sizes; To consider its size, the present invention proposes to continuously increase the scale of structural elements for alternating sequential filtering, which is defined as follows according to the sequence of opening and closing operations:

其中,B1、B2…Bi是不断增大尺寸的结构元素。Among them, B 1 , B 2 . . . B i are structural elements with increasing size.

图6中a)是原始桥墩图像,b)是对原图a)进行方形结构元素开闭滤波后的结果,c)是对图a)用不断增大尺度的结构元素交替滤波的结果,d) 是原图a)的中值滤波结果,从图6中各处理后的图像对比可以看出,开闭滤波对图像起到了一定得平滑作用,单与中值滤波相比,滤波效果比中值滤波稍差,中值滤波优于开闭滤波;图c)对原图像用不断增大尺度的结构元素对原图a)进行交替滤波,其效果要优于中值滤波,并更优于开闭滤波;因此,交替开闭滤波算法能够取得更好的平滑效果。In Figure 6, a) is the original pier image, b) is the result of open-close filtering of square structural elements on the original image a), c) is the result of alternate filtering of image a) with structural elements of increasing scale, d ) is the median filtering result of the original image a). From the comparison of the processed images in Figure 6, it can be seen that the opening and closing filtering has a certain smoothing effect on the image. Compared with the median filtering alone, the filtering effect is better than that of the median filtering The value filtering is slightly worse, and the median filtering is better than the opening and closing filtering; Figure c) alternately filters the original image a) with structural elements of increasing scale, and its effect is better than the median filtering, and even better than Open and closure filtering; therefore, alternating opening and closing filtering algorithms can achieve better smooth effects.

桥墩图像中,缝隙一般有较低的灰度值,显长条状结构,因此可以根据图像的灰度成分来检测具有最小灰度值的缝隙对象,因此可以运用改进的顶帽变换(原图像减去开运算后的图像称为顶帽变换)作为缝隙检测,检测已经过形态学滤波后的图像。In the pier image, the gaps generally have low gray value and show a long strip structure, so the gap object with the minimum gray value can be detected according to the gray value of the image, so the improved top-hat transformation (original image The image after subtracting the opening operation is called the top-hat transformation) as a gap detection to detect the image that has been morphologically filtered.

顶帽变换算法过程为,用结构元素对原始桥墩图像进行开运算再计算原始图像与该开运算的差其结果就是灰度桥墩图像顶帽变换。The process of the top hat change algorithm is to use the structural element to start the operation of the original bridge pier image Calculate the difference between the original image and the opening operation As a result, the gray bridge pier image top hat transformation.

由于桥墩图像中缝隙经常有很小的亮度,它们看起来就像是明亮背景中的暗色区域,因此,要抽取缝隙特征,必须先对图像求反,然后再利用进行顶帽变换。Since the gaps in bridge pier images often have very small brightness, they look like dark areas in a bright background. Therefore, to extract gap features, the image must be negated first, and then use Perform a top hat transformation.

相应地,为了避免对图像求反,可先用结构集nB对图像进行闭运算,然后减去原图像f(x),也可称为改进的底帽变换,表达式为:fnB(x)-f(x),其中,fnB(x)是结构元素nB对灰度图像f(x)的开运算,(n次);经过上述处理后输出的图像是一个灰度梯度图像,对图像的阈值操作可以将缝隙从桥墩图像中分割出来。Correspondingly, in order to avoid negating the image, the image can be closed with the structure set nB first, and then the original image f(x) can be subtracted, which can also be called the improved bottom hat transformation, and the expression is: f nB (x )-f(x), where f nB (x) is the opening operation of the structural element nB on the grayscale image f(x), (n times); the output image after the above processing is a grayscale gradient image, and the threshold operation on the image can separate the gap from the pier image.

因此,作为本发明更进一步的限定,多尺度形态学图像边缘检测法具体为:Therefore, as a further limitation of the present invention, the multi-scale morphology image edge detection method is specifically:

首先使用不断增大的结构元素对图像进行交替开闭滤波,平滑桥墩缝隙图像并去除噪音,然后对图像求反,再利用多尺度顶帽变化进行顶帽变换,使用多尺度形态学边缘检测器提取桥墩图像缝隙边缘,最后运用标记符控制的形态学分水岭算法提取桥墩图像中的缝隙对象,进行缝隙图像识别。Firstly, the image is alternately opened and closed by using the ever-increasing structural elements to smooth the pier gap image and remove the noise, then negate the image, and then use the multi-scale top-hat transformation to perform top-hat transformation, using a multi-scale morphology edge detector The edge of the gap in the pier image is extracted, and finally the morphological watershed algorithm controlled by the marker is used to extract the gap object in the pier image for gap image recognition.

本发明使用标记符控制的形态学分水岭算法提取桥墩图像中的缝隙,分水岭分割算法是把图像看成一副“地形图”,亮度比较强的地方像素值较大,亮度比较暗的地方像素值较小,通过寻找“汇水盆地”和“分水岭界线”对图像进行分割。The present invention uses the morphological watershed algorithm controlled by markers to extract the gaps in the pier image. The watershed segmentation algorithm regards the image as a "topographic map". Small, segment the image by finding "catchment basins" and "watershed boundaries".

直接应用分水岭分割算法的效果往往并不好,如果在图像中对前景对象和背景对象进行标注区别,再应用分水岭算法会取得较好的分割效果;基于标记控制的分水岭分割方法具体步骤如下:The effect of directly applying the watershed segmentation algorithm is often not good. If you mark the foreground object and the background object in the image, and then apply the watershed algorithm to achieve a better segmentation effect; the specific steps of the watershed segmentation method based on marker control are as follows:

计算分割函数,图像中较暗的区域是要分割的对象,也就是初步计算图像中局部最小区域的位置,它标记了分割对象的位置(本文实验中指的是缝隙);上述步骤表示了与我们分割问题不相关的细节,为消除这些细节,通过某个高度阀值T计算图像最小区域的集合,从而更好地标记局部最小区域的位置;使用分水岭距离变换计算外部标记,一般用分水岭脊线作为外部标记;得到内外标记符后,使用强制最小技术修改灰度级图像,以便局部最小区域仅出现在标记的位置;对修改了标记符的图像进行分水岭变换,分割出缝隙对象。Calculate the segmentation function, the darker area in the image is the object to be segmented, that is, the initial calculation of the position of the local minimum area in the image, which marks the position of the segmented object (referred to as the gap in this experiment); the above steps represent the same as our The irrelevant details of the segmentation problem, in order to eliminate these details, calculate the set of the minimum area of the image through a certain height threshold T, so as to better mark the position of the local minimum area; use the watershed distance transformation to calculate the external mark, generally use the watershed ridge As an external mark; after obtaining the internal and external markers, use the forced minimum technique to modify the grayscale image so that the local minimum area only appears at the marked position; perform watershed transformation on the image with the modified markers to segment out the gap objects.

图7中a)是形态学变换后的桥墩缝隙图像,图7中b)是对图7中a)进行分水岭变换的图像;可以看出,形态学分水岭变换在对桥墩图像的缝隙分割中有一定的作用,也有较好地分割效果。A) in Figure 7 is the image of the bridge pier gap after morphological transformation, and b) in Figure 7 is the image of a) in Figure 7 after watershed transformation; it can be seen that the morphological watershed transformation has an important role in the gap segmentation of the pier image It has a certain role and has a better division effect.

本发明的有益效果是:The beneficial effects of the present invention are:

1、本发明针对桥墩缝隙图像像素灰度值的分布特性,以及桥墩缝隙图像分割的需求,采用图像掩膜预处理算法,实现桥墩缝隙图像滤波,并与不同低通滤波和高通滤波方法对桥墩缝隙图像的滤波效果进行比较,在降低图像噪音、改善图像质量的基础上,有效地保护了图像缝隙边缘,为后续的缝隙的识别和分割提供了基础。1. The present invention aims at the distribution characteristics of the pixel gray value of the pier gap image, and the needs of the pier gap image segmentation, adopts the image mask preprocessing algorithm, realizes the pier gap image filtering, and compares the pier gap with different low-pass filtering and high-pass filtering methods. Comparing the filtering effect of the seam image, on the basis of reducing image noise and improving image quality, the edge of the image seam is effectively protected, which provides a basis for subsequent seam identification and segmentation.

2、本发明通过计算小波变换的梯度和模最大值,搜索图像上的小波的模最大值点,得到需要识别的裂缝信息,然后对噪音和特征对应的小波系数分别处理,在降低噪音的同时,对桥墩缝隙边缘有增强的作用。2. The present invention calculates the gradient and modulus maximum of wavelet transform, searches for the wavelet modulus maximum point on the image, obtains the crack information that needs to be identified, and then processes the wavelet coefficients corresponding to noise and features separately, while reducing noise It has an enhanced effect on the edge of the gap between the pier.

3、通过对常规的形态学算法进行改进,使用多尺度形态学边缘检测算法,根据结构元素的类型、结构元素的大小、膨胀操作的次数等对桥墩图像进行分割,能够取得较好的效果。3. By improving the conventional morphological algorithm and using the multi-scale morphological edge detection algorithm to segment the pier image according to the type of structural element, the size of the structural element, the number of expansion operations, etc., better results can be achieved.

附图说明Description of drawings

图1是本发明提出的桥墩表面缝隙视觉检测方法的示意图Fig. 1 is the schematic diagram of bridge pier surface gap visual inspection method proposed by the present invention

图2是本发明提出的桥墩表面缝隙视觉检测方法中模板方向定义图Fig. 2 is a template direction definition diagram in the bridge pier surface gap visual inspection method proposed by the present invention

图3是掩膜窗口及9种不同掩膜板示意图Figure 3 is a schematic diagram of the mask window and 9 different mask plates

图4是多种图像增强方法的对比图Figure 4 is a comparison chart of a variety of image enhancement methods

图5是采用小波变换梯度图像分割算法对桥墩图像的缝隙边缘进行处理的结果Figure 5 is the result of using a wavelet change gradient image segmentation algorithm to deal with the gap edge of the pier image

图6是对桥墩缝隙图像采用不同滤波方式的结果Figure 6 is the result of different filtering methods for the gap image of the bridge pier

图7中a)是形态学变换后的桥墩缝隙图像,b)是对a)进行分水岭变换的图像In Figure 7, a) is the image of the bridge pier gap after morphological transformation, and b) is the image of a) after watershed transformation

具体实施方式Detailed ways

下面结合具体实施例来对本发明进一步说明。The present invention will be further described below in conjunction with specific embodiments.

一种桥墩表面缝隙视觉检测方法,将线阵CCD相机与位移传感器固定于同一检测平台,检测平台移动过程中,位移传感器提供位移信号,线阵CCD相机根据该位移信号获取桥墩表面彩色图像;A visual detection method for the surface gap of bridge pier, in which a linear array CCD camera and a displacement sensor are fixed on the same detection platform, during the movement of the detection platform, the displacement sensor provides a displacement signal, and the linear array CCD camera obtains a color image of the bridge pier surface according to the displacement signal;

对彩色图像分块压缩存储,将彩色图像转化成灰度图像,并进行降噪处理;Compress and store the color image in blocks, convert the color image into a grayscale image, and perform noise reduction processing;

利用桥墩缝隙的线性特征,采用图像掩膜滤波算法对灰度图像进行图像增强平滑处理;Using the linear characteristics of the gaps in the bridge piers, the image mask filter algorithm is used to perform image enhancement and smoothing on the grayscale image;

采用区间、区内距离法分别计算区域A和区域B的区间、区内距离,通过改变参数值使得区域A和区域B的区间、区内距离比达到最大,此时的阈值结果作为桥墩缝隙图像的综合分割阈值;The interval and intra-area distance methods are used to calculate the interval and intra-area distances of area A and area B respectively, and the ratio of interval and intra-area distance between area A and area B is maximized by changing the parameter value, and the threshold result at this time is used as the pier gap image The comprehensive division threshold;

采用小波变换梯度图像分割算法对桥墩图像的缝隙边缘进行处理;Use the wavelet change gradient image segmentation algorithm to deal with the gap edge of the pier image;

使用多尺度形态学图像边缘检测法提取桥墩图像的缝隙边缘,最后运用标记符控制的形态学分水岭算法识别桥墩图像中的缝隙。The multi-scale morphological image edge detection method is used to extract the gap edge of the bridge pier image, and finally the marker-controlled morphological watershed algorithm is used to identify the gap in the bridge pier image.

其中,图像增强平滑处理具体为:Among them, the image enhanced smooth processing is specifically:

首先,计算各个模板的均值Ei及方差ΩiFirst, calculate the average value of each template e i and square difference ω i :

式中:i表示各个掩膜板的编号,i=1,2,…,9,In the formula: i represents the number of each mask plate, i=1, 2,..., 9,

q为对应掩膜板中包含像素的个数,(m,n)为掩膜板内像素相对于中心像素(j,k)的位移量;q is the number of pixels contained in the corresponding mask, and (m, n) is the displacement of the pixel in the mask relative to the central pixel (j, k);

再计算9个模板的方差并进行比较,将具有最小方差的模板所对应的灰度均值作为掩膜平滑输出的新灰度值, Calculate the variance of 9 templates and compare it. The ash the average value of the ash with the smallest variance template is used as the new gray value of the smooth output of the mask.

其中,综合分割阈值通过以下方式求取:Among them, the comprehensive segmentation threshold is obtained by the following method:

将整幅路面破损图像分割成一系列的子图像;然后分别计算每个子图像的分割阈值,并求取全图的平均灰度、区域A和区域B的平均灰度;采用区间、区内距离法分布计算区域A和区域B的区间、区内距离,最后通过改变的值求得区域A和区域B的区间、区内距离比达到最大,作为破损图像的综合分割阈值: Segment the entire road damage image into a series of sub-images; then calculate the segmentation threshold of each sub-image separately, and calculate the average gray level of the whole image, the average gray level of area A and area B; use interval and intra-area distance method Distribution calculation area A and region B range and district distance, and finally change The value ratio of the area A and the region B of the area A and the area B is maximum.

其中,为区域A和区域B的区间距离;为区域A和区域B的区内距离。in, The distance between regional A and region B; The distance in the area A and region B.

小波变换梯度图像分割算法具体为:通过小波变换及其用于重构的逆变换,将梯度方向和模最大值保存在小波系数当中,分析和变换小波系数最大值,对噪音和特征对应的小波系数分别处理,实现图像的缝隙边缘的检测并噪音分离。The wavelet transform gradient image segmentation algorithm is specifically: through the wavelet transform and its inverse transform for reconstruction, the gradient direction and the maximum value of the modulus are stored in the wavelet coefficients, the maximum value of the wavelet coefficients is analyzed and transformed, and the wavelet corresponding to the noise and features The coefficients are processed separately to realize the detection of image gap edges and noise separation.

对噪音和特征对应的小波系数分别处理具体为:The small wave coefficients corresponding to noise and characteristics are processed separately:

对第j层分解得到的子图像Wj(x,y)进行自适应调整,做如下变化:Adaptively adjust the sub-image W j (x, y) obtained by decomposing the jth layer, and make the following changes:

其中,为阈值,为增益,是尺寸j上的边缘;in, is the threshold, for gain, It is the edge on the size J;

为了使算法具有很好的自适应调整能力,参数分别如下:In order to make the algorithm have a good adaptive adjustment ability, parameters They are as follows:

其中,W1和W2是梯度图像Wj(x,y)小波变换的两个分量。in, W 1 and W 2 are two components of the wavelet transform of the gradient image W j (x,y).

其中,多尺度形态学图像边缘检测法具体为:首先使用不断增大的结构元素对图像进行交替开闭滤波,平滑桥墩缝隙图像并去除噪音,然后对图像求反,再利用多尺度顶帽变化进行顶帽变换,使用多尺度形态学边缘检测算法根据结构元素的类型、结构元素的大小、膨胀操作的次数,对桥墩图像进行分割进而提取桥墩图像缝隙边缘,最后运用标记符控制的形态学分水岭算法提取桥墩图像中的缝隙对象,进行缝隙图像识别。Among them, the multi-scale morphological image edge detection method is as follows: first, use the ever-increasing structural elements to perform alternate opening and closing filtering on the image, smooth the pier gap image and remove the noise, then negate the image, and then use the multi-scale top-hat change Perform top-hat transformation, use multi-scale morphological edge detection algorithm to segment the pier image according to the type of structural element, the size of the structural element, and the number of expansion operations, and then extract the gap edge of the pier image, and finally use the morphological watershed controlled by the marker The algorithm extracts the gap object in the bridge pier image, and the gap image recognition is performed.

本发明通过线阵CCD相机获取桥墩表面彩色图像;对彩色图像分块压缩存储,将彩色图像转化成灰度图像,并进行降噪处理;利用桥墩缝隙的线性特征,采用图像掩膜滤波算法对灰度图像进行图像增强平滑处理;采用区间、区内距离法分别计算区域A和区域B的区间、区内距离,通过改变参数值使得区域A和区域B的区间、区内距离比达到最大,此时的阈值结果作为桥墩缝隙图像的综合分割阈值,采用小波变换梯度图像分割算法对桥墩图像的缝隙边缘进行检测;最后使用多尺度形态学图像边缘检测法提取桥墩图像的缝隙边缘,运用标记符控制的形态学分水岭算法识别桥墩图像中的缝隙,能够实现对桥墩缝隙的高效识别检测,具有良好的应用前景。The invention obtains the color image of the bridge pier surface through a linear array CCD camera; compresses and stores the color image in blocks, converts the color image into a grayscale image, and performs noise reduction processing; utilizes the linear characteristics of the bridge pier gap, and adopts an image mask filter algorithm to The grayscale image is processed for image enhancement and smoothing; the interval and intra-area distances of area A and area B are calculated using the interval and intra-area distance methods, and the interval and intra-area distance ratios of area A and area B are maximized by changing parameter values. The threshold value at this time is used as the comprehensive segmentation threshold of the bridge pier gap image, and the wavelet transform gradient image segmentation algorithm is used to detect the gap edge of the bridge pier image; finally, the multi-scale morphology image edge detection method is used to extract the gap edge of the bridge pier image, and the marker The controlled morphological watershed algorithm identifies the gaps in the bridge pier image, which can realize the efficient identification and detection of bridge pier gaps, and has a good application prospect.

以上所述,仅为本发明较佳的具体实施方式,但本发明的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本发明揭露的技术范围内,根据本发明的技术方案及其发明构思加以等同替换或改变,都应涵盖在本发明的保护范围之内。The above description is only a preferred embodiment of the present invention, but the protection scope of the present invention is not limited to this. The equivalent replacement or change of the inventive concept thereof shall be included within the protection scope of the present invention.

Claims (6)

1. A visual detection method for a gap on the surface of a pier is characterized by comprising the following steps: fixing the linear array CCD camera and the displacement sensor on the same detection platform, wherein the displacement sensor provides displacement signals in the moving process of the detection platform, and the linear array CCD camera acquires a color image of the surface of the pier according to the displacement signals;
compressing and storing the color image in blocks, converting the color image into a gray image, and performing noise reduction treatment;
performing image enhancement smoothing processing on the gray level image by using the linear characteristic of the bridge pier gap and adopting an image mask filtering algorithm;
respectively calculating the interval and the intra-area distance of the area A and the area B by adopting an interval and intra-area distance method, enabling the ratio of the interval and the intra-area distance of the area A and the area B to be maximum by changing parameter values, and taking the threshold result at the moment as a comprehensive segmentation threshold of the bridge pier gap image;
processing the gap edge of the pier image by adopting a wavelet transform gradient image segmentation algorithm;
and extracting the gap edge of the pier image by using a multi-scale morphological image edge detection method, and finally identifying the gap in the pier image by using a morphological watershed algorithm controlled by a marker.
2. The visual detection method for the gap between the surfaces of the piers according to claim 1, characterized in that: the image enhancement smoothing processing specifically comprises:
first, the mean value E of each template is calculatediAnd variance Ωi
In the formula: i denotes the number of each mask, i is 1, 2, …, 9,
q is the number of pixels contained in the corresponding mask plate, and (m, n) is the displacement of the pixels in the mask plate relative to the central pixels (j, k);
then calculating the variances of the 9 templates and comparing, taking the gray average value corresponding to the template with the minimum variance as a new gray value of the mask smooth output,
3. the visual detection method for the gap between the surfaces of the piers according to claim 2, characterized in that: the comprehensive segmentation threshold is obtained by the following method:
dividing the whole pavement damage image into a series of sub-images; then respectively calculating the segmentation threshold of each sub-image, and solving the average gray scale of the whole image and the average gray scale of the area A and the area B; calculating the interval and intra-area distance of the area A and the area B by adopting the interval and intra-area distance method distribution, and finally changingThe maximum distance ratio between the section of the area a and the area B is obtained as a total segmentation threshold of the damaged image:
wherein,the interval distance between the area A and the area B;the intra-zone distance is the zone a and the zone B.
4. The visual detection method for the gap between the surfaces of the piers according to claim 3, characterized in that: the wavelet transformation gradient image segmentation algorithm specifically comprises the following steps: storing the gradient direction and the maximum modulus value in the wavelet coefficient through wavelet transformation and inverse transformation for reconstruction, analyzing and transforming the maximum wavelet coefficient, and respectively processing the wavelet coefficient corresponding to noise and characteristics to realize the detection of the slit edge of the image and the noise separation.
5. The visual detection method for the gap between the surfaces of the piers according to claim 4, characterized in that: the wavelet coefficients corresponding to the noise and the features are respectively processed specifically as follows:
sub-image W obtained by decomposing the j-th layerj(x, y) is adaptively adjusted, as follows:
wherein,is a threshold value, and is,in order to achieve the gain,is the edge on the dimension j;
in order to make the algorithm have good adaptive adjustment capability, parametersRespectively as follows:
wherein,W1and W2Is a gradient image WjTwo components of the (x, y) wavelet transform.
6. The visual detection method for the gap between the surfaces of the piers according to claim 5, characterized in that: the multi-scale morphological image edge detection method specifically comprises the following steps:
the method comprises the steps of firstly, conducting alternate opening and closing filtering on an image by using continuously-increased structural elements, smoothing a bridge pier gap image and removing noise, then performing image negation, then conducting top cap transformation by using multi-scale top cap change, segmenting the bridge pier image by using a multi-scale morphological edge detection algorithm according to the types of the structural elements, the sizes of the structural elements and the times of expansion operation, further extracting the gap edge of the bridge pier image, and finally extracting a gap object in the bridge pier image by using a morphological watershed algorithm controlled by a marker, and conducting gap image identification.
CN201811334774.2A 2018-11-10 2018-11-10 Visual detection method for gap on surface of pier Pending CN109523479A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811334774.2A CN109523479A (en) 2018-11-10 2018-11-10 Visual detection method for gap on surface of pier

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811334774.2A CN109523479A (en) 2018-11-10 2018-11-10 Visual detection method for gap on surface of pier

Publications (1)

Publication Number Publication Date
CN109523479A true CN109523479A (en) 2019-03-26

Family

ID=65773868

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811334774.2A Pending CN109523479A (en) 2018-11-10 2018-11-10 Visual detection method for gap on surface of pier

Country Status (1)

Country Link
CN (1) CN109523479A (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112033385A (en) * 2020-11-03 2020-12-04 湖南联智科技股份有限公司 Pier pose measuring method based on mass point cloud data
CN112233111A (en) * 2020-11-18 2021-01-15 安徽国钜工程机械科技有限公司 Tunnel gap detection method based on digital image processing
CN112508859A (en) * 2020-11-19 2021-03-16 聚融医疗科技(杭州)有限公司 Method and system for automatically measuring thickness of endometrium based on wavelet transformation
CN113702257A (en) * 2021-08-09 2021-11-26 西南石油大学 Conglomerate pore structure characterization method based on CT three-dimensional data volume
CN114881979A (en) * 2022-05-16 2022-08-09 浙江理工大学 Multi-scale Retinex road crack detection method based on fusion wavelet transform
CN115512306A (en) * 2022-11-15 2022-12-23 成都睿瞳科技有限责任公司 Method for early warning of violence events in elevator based on image processing
CN116597389A (en) * 2023-07-18 2023-08-15 山东省地质测绘院 Geological disaster monitoring and early warning method based on image processing
CN116630225A (en) * 2023-03-13 2023-08-22 中铁大桥局集团有限公司 Method and device for identifying underwater foundation damage of railway bridge and processing equipment
CN116630321A (en) * 2023-07-24 2023-08-22 铁正检测科技有限公司 Intelligent bridge health monitoring system based on artificial intelligence
CN116958182A (en) * 2023-09-20 2023-10-27 广东华宸建设工程质量检测有限公司 Quick concrete crack detection method based on image data

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101493932A (en) * 2009-03-05 2009-07-29 西安电子科技大学 Watershed texture imaging segmenting method based on morphology Haar small wave texture gradient extraction
CN107154040A (en) * 2017-05-08 2017-09-12 重庆邮电大学 A kind of tunnel-liner surface image crack detection method
EP3392612A1 (en) * 2015-12-14 2018-10-24 Nikon-Trimble Co., Ltd. Defect detection apparatus and program

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101493932A (en) * 2009-03-05 2009-07-29 西安电子科技大学 Watershed texture imaging segmenting method based on morphology Haar small wave texture gradient extraction
EP3392612A1 (en) * 2015-12-14 2018-10-24 Nikon-Trimble Co., Ltd. Defect detection apparatus and program
CN107154040A (en) * 2017-05-08 2017-09-12 重庆邮电大学 A kind of tunnel-liner surface image crack detection method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
孙波成: "基于数字图像处理的沥青路面裂缝识别技术研究", 《中国博士学位论文全文数据库 工程科技II辑》 *

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112033385A (en) * 2020-11-03 2020-12-04 湖南联智科技股份有限公司 Pier pose measuring method based on mass point cloud data
CN112033385B (en) * 2020-11-03 2021-02-02 湖南联智科技股份有限公司 Pier pose measuring method based on mass point cloud data
CN112233111A (en) * 2020-11-18 2021-01-15 安徽国钜工程机械科技有限公司 Tunnel gap detection method based on digital image processing
CN112508859A (en) * 2020-11-19 2021-03-16 聚融医疗科技(杭州)有限公司 Method and system for automatically measuring thickness of endometrium based on wavelet transformation
CN113702257A (en) * 2021-08-09 2021-11-26 西南石油大学 Conglomerate pore structure characterization method based on CT three-dimensional data volume
CN114881979A (en) * 2022-05-16 2022-08-09 浙江理工大学 Multi-scale Retinex road crack detection method based on fusion wavelet transform
CN114881979B (en) * 2022-05-16 2024-11-19 浙江理工大学 Road crack detection method based on multi-scale Retinex fused with wavelet transform
CN115512306A (en) * 2022-11-15 2022-12-23 成都睿瞳科技有限责任公司 Method for early warning of violence events in elevator based on image processing
CN116630225A (en) * 2023-03-13 2023-08-22 中铁大桥局集团有限公司 Method and device for identifying underwater foundation damage of railway bridge and processing equipment
CN116630225B (en) * 2023-03-13 2024-05-14 中铁大桥局集团有限公司 Method and device for identifying underwater foundation damage of railway bridge and processing equipment
CN116597389B (en) * 2023-07-18 2023-09-15 山东省地质测绘院 Geological disaster monitoring and early warning method based on image processing
CN116597389A (en) * 2023-07-18 2023-08-15 山东省地质测绘院 Geological disaster monitoring and early warning method based on image processing
CN116630321A (en) * 2023-07-24 2023-08-22 铁正检测科技有限公司 Intelligent bridge health monitoring system based on artificial intelligence
CN116630321B (en) * 2023-07-24 2023-10-03 铁正检测科技有限公司 Intelligent bridge health monitoring system based on artificial intelligence
CN116958182A (en) * 2023-09-20 2023-10-27 广东华宸建设工程质量检测有限公司 Quick concrete crack detection method based on image data
CN116958182B (en) * 2023-09-20 2023-12-08 广东华宸建设工程质量检测有限公司 Quick concrete crack detection method based on image data

Similar Documents

Publication Publication Date Title
CN109523479A (en) Visual detection method for gap on surface of pier
CN106651872B (en) Pavement crack identification method and system based on Prewitt operator
CN107230202B (en) Method and system for automatic identification of pavement disease images
Qingbo Pavement crack detection algorithm based on image processing analysis
CN106780486B (en) A method for image extraction of steel plate surface defects
CN111145161A (en) A method for digital image processing and recognition of pavement cracks
CN107045634B (en) Text positioning method based on maximum stable extremum region and stroke width
WO2016172827A1 (en) Stepwise-refinement pavement crack detection method
CN110766689A (en) Method and device for detecting article image defects based on convolutional neural network
CN101777181B (en) Ridgelet bi-frame system-based SAR image airfield runway extraction method
CN109410228A (en) Internal wave of ocean detection algorithm based on Method Based on Multi-Scale Mathematical Morphology Fusion Features
CN107392885A (en) A Method of Infrared Dim Small Target Detection Based on Visual Contrast Mechanism
CN108830857B (en) An Adaptive Binarization Segmentation Method for Chinese Inscriptions on Inscriptions
CN113344810B (en) Image enhancement method based on dynamic data distribution
CN107481233A (en) A kind of image-recognizing method being applied in FOD foreign bodies detection radars
CN107590496A (en) The association detection method of infrared small target under complex background
CN114549492A (en) Quality evaluation method based on multi-granularity image information content
Liu et al. Recognition of road cracks based on multi-scale Retinex fused with wavelet transform
CN110223344B (en) Infrared small target detection method based on morphology and visual attention mechanism
Du et al. Research on an efficient method of license plate location
CN111340692A (en) Infrared image dynamic range compression and contrast enhancement algorithm
Wu et al. Research on crack detection algorithm of asphalt pavement
CN107133965A (en) One kind is based on computer graphic image morphological image segmentation method
CN112163606A (en) Infrared small target detection method based on block contrast weighting
CN117765287A (en) Image target extraction method combining LWR and density clustering

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20190326