CN110363706A - A large-area bridge deck image stitching method - Google Patents
A large-area bridge deck image stitching method Download PDFInfo
- Publication number
- CN110363706A CN110363706A CN201910561334.9A CN201910561334A CN110363706A CN 110363706 A CN110363706 A CN 110363706A CN 201910561334 A CN201910561334 A CN 201910561334A CN 110363706 A CN110363706 A CN 110363706A
- Authority
- CN
- China
- Prior art keywords
- image
- bridge deck
- images
- adjacent
- threshold
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
- G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10004—Still image; Photographic image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Image Analysis (AREA)
- Image Processing (AREA)
Abstract
Description
技术领域technical field
本发明属于图像检测技术领域,具体涉及一种大面积桥面图像拼接方法。The invention belongs to the technical field of image detection, and in particular relates to a large-area bridge deck image stitching method.
背景技术Background technique
桥梁作为重要的交通枢纽,经过长期的日晒雨淋和负载作业,内部应力会沿着桥梁结构传递到一些薄弱部位,致使该位置结构表面易出现裂缝等病害特征。由于桥梁表面的病害特征致使外界空气和有害介质很容易渗透到混凝土内部经过化学反应产生碳酸盐,造成其中钢筋的碱度环境降低,表面的纯化膜遭受破坏后更易产生锈蚀,此外,混凝土碳化也会加剧收缩开裂,对混凝土桥梁的安全使用产生严重危害。因此为保证梁体结构的使用寿命和安全性能,需要对桥梁表面病害特征进行及时检测并治理。Bridges are important transportation hubs. After long-term sun, rain, and load operations, the internal stress will be transmitted to some weak parts along the bridge structure, resulting in cracks and other disease characteristics on the surface of the structure. Due to the disease characteristics of the bridge surface, the outside air and harmful media can easily penetrate into the concrete to generate carbonate through chemical reaction, resulting in the reduction of the alkalinity environment of the steel bar, and the rust is more likely to occur after the surface purification film is damaged. It will also aggravate shrinkage cracking and cause serious harm to the safe use of concrete bridges. Therefore, in order to ensure the service life and safety performance of the beam structure, it is necessary to detect and treat the disease characteristics of the bridge surface in time.
为了及时检测出桥面病害特征,并采取补救措施以消除安全隐患,通常采用人工巡检和手工标记的方式。然而桥底表面检测工作环境往往较为危险,这种检测方式机动性差、危险性大、效率低。而且桥面损伤由经验丰富的检验人员手工测量并用肉眼观察做记录,具有一定的主观性,检测精度较依赖于专家的经验知识,而经验在定量分析中缺乏客观性。In order to detect the characteristics of bridge deck diseases in time and take remedial measures to eliminate potential safety hazards, manual inspection and manual marking are usually adopted. However, the working environment of bridge bottom surface inspection is often dangerous. This inspection method has poor mobility, high risk and low efficiency. Moreover, the bridge deck damage is manually measured by experienced inspectors and recorded with the naked eye, which is subject to a certain degree of subjectivity. The detection accuracy is more dependent on the experience and knowledge of experts, and experience lacks objectivity in quantitative analysis.
随着计算机视觉检测技术的发展,逐渐出现将图像检测应用于桥梁检测工程实践中。但由于桥体空间较大,若采用远程拍摄取样,会受到摄像机分辨率的限制,致使无法得到满意的检测精度。因此需要对桥梁表面进行近距离的连续多组取样,并对采集到的样本图像进行大面积的图像拼接,而拼接效果会直接影响到桥面病害特征的检测精度。为了在满足宽视角、高分辨率的基础上,尽可能减少累计误差,提高桥面图像拼接精度,实现真实桥梁检测面信息的全局展现。With the development of computer vision detection technology, the application of image detection in bridge detection engineering practice has gradually emerged. However, due to the large space of the bridge body, if remote shooting sampling is used, it will be limited by the resolution of the camera, resulting in unsatisfactory detection accuracy. Therefore, it is necessary to sample the bridge surface in consecutive groups in a short distance, and perform large-area image stitching on the collected sample images, and the stitching effect will directly affect the detection accuracy of the bridge deck disease characteristics. In order to reduce the cumulative error as much as possible, improve the stitching accuracy of bridge deck images, and realize the global display of real bridge inspection surface information on the basis of satisfying wide viewing angle and high resolution.
发明内容SUMMARY OF THE INVENTION
本发明的目的在于提供一种大面积桥面图像拼接方法。The purpose of the present invention is to provide a large-area bridge deck image stitching method.
本发明的具体步骤如下:The concrete steps of the present invention are as follows:
步骤1、逐张采集被检测桥面的图像,得到桥面图像集合。之后,提取并统计桥面图像集合中各桥面图像的亮度分量信息,并分别对各桥面图像的亮度分量信息进行均衡化。然后通过傅里叶变换将各桥面图像变换到频域内,并采用相位相关算法中的归一化互功率谱的相位信息得到图像间的平移参数,完成对相邻图像间重叠区域的预估算。Step 1. Collect the images of the detected bridge deck one by one to obtain a set of bridge deck images. After that, the luminance component information of each bridge deck image in the bridge deck image set is extracted and counted, and the luminance component information of each bridge deck image is equalized respectively. Then, each bridge deck image is transformed into the frequency domain by Fourier transform, and the phase information of the normalized cross-power spectrum in the phase correlation algorithm is used to obtain the translation parameters between the images, and the pre-estimation of the overlapping area between adjacent images is completed. .
步骤2、图像配准Step 2. Image registration
首先,在各相邻图像间重叠区域内提取SIFT特征点。然后通过自适应对比度阈值法筛选SIFT特征点,得到由匹配点对组成的特征描述符。并采用RANSAC算法计算各相邻图像间的投影变换矩阵。First, SIFT feature points are extracted in the overlapping area between adjacent images. Then, the SIFT feature points are filtered by the adaptive contrast threshold method, and the feature descriptors composed of matching point pairs are obtained. And the RANSAC algorithm is used to calculate the projection transformation matrix between adjacent images.
自适应对比度阈值法具体如下:The adaptive contrast threshold method is as follows:
(1)设定特征点数量下限Nmin=200,上限Nmax=300,对比度阈值Tc=T0。T0为初始阈值,取值为0.02~0.04。(1) Set the lower limit of the number of feature points N min =200, the upper limit N max =300, and the contrast threshold T c =T 0 . T 0 is the initial threshold, which ranges from 0.02 to 0.04.
(2)进行特征点检测,并统计对比度高于Tc的特征点数量N。(2) Perform feature point detection, and count the number N of feature points whose contrast is higher than Tc .
(3)若Nmin≤N≤Nmax,则将对比度高于Tc的特征点纳入初始匹配点集,剔除对比度低于阈值Tc的特征点,并直接进入步骤(5)。否则,执行步骤(4)。(3) If N min ≤N≤N max , the feature points with contrast higher than T c are included in the initial matching point set, the feature points with contrast lower than the threshold T c are eliminated, and step (5) is directly entered. Otherwise, go to step (4).
(4)若N<Nmin,则将对比度阈值Tc减小为原数值的并执行步骤(3)。若N>Nmax,则将对比度阈值增大为原数值的2倍,并执行步骤(3)。(4) If N<N min , reduce the contrast threshold T c to the value of the original value and perform step (3). If N>N max , increase the contrast threshold to twice the original value, and execute step (3).
(5)通过最近邻比次近邻方法剔除初始匹配点集中的误特征点,并生成特征描述符。特征描述符内包含由成对的特征点组成的多个匹配点对,以及各匹配点对之间的距离和方向信息。(5) The erroneous feature points in the initial matching point set are eliminated by the nearest neighbor ratio and the next nearest neighbor method, and feature descriptors are generated. The feature descriptor contains multiple matching point pairs composed of paired feature points, and the distance and direction information between each matching point pair.
步骤3、图像融合Step 3. Image fusion
首先根据相邻图像间的投影变换矩阵,对相应桥面图像进行投影变换。然后采用渐入渐出融合算法对各相邻桥面图像的RGB三颜色通道分别进行加权平滑过渡,得到桥面拼接图像。Firstly, according to the projection transformation matrix between adjacent images, projective transformation is performed on the corresponding bridge deck images. Then, the RGB three-color channel of each adjacent bridge deck image is weighted and smoothly transitioned by the fade-in and fade-out fusion algorithm, and the bridge deck stitched image is obtained.
渐入渐出融合算法中,相邻图像重叠区域内各融合点像素值I(x,y)的渐入渐出加权公式如下:In the fade-in and fade-out fusion algorithm, the fade-in and fade-out weighting formula of each fusion point pixel value I(x, y) in the overlapping area of adjacent images is as follows:
其中,I1(x,y)、I2(x,y)分别为相邻的两张桥面图像在重叠区域内的对应融合点的像素值。d1、d2分别为相邻的两张桥面图像在对应融合点的渐变权重因子。和x1、x2分别为重叠区域两侧边界的横坐标。x为对应融合点的横坐标。t为两相邻图像重叠区域在对应融合点上的灰度差阈值。Among them, I 1 (x, y) and I 2 (x, y) are the pixel values of the corresponding fusion points of the two adjacent bridge deck images in the overlapping area, respectively. d 1 and d 2 are the gradient weight factors of the two adjacent bridge deck images at the corresponding fusion points, respectively. and x 1 and x 2 are the abscissas of the borders on both sides of the overlapping area, respectively. x is the abscissa of the corresponding fusion point. t is the grayscale difference threshold at the corresponding fusion point in the overlapping area of two adjacent images.
作为优选,步骤1中采集图像的方法具体如下:Preferably, the method for collecting images in step 1 is as follows:
(1)采用张正友平面标定法计算CCD相机的内参矩阵后,通过最小二乘法得到径向畸变系数。(1) After calculating the internal parameter matrix of the CCD camera by Zhang Zhengyou's plane calibration method, the radial distortion coefficient is obtained by the least square method.
(2)在桥梁检测平台上安置经过步骤1-1标定的CCD相机,根据预设的拍摄轨迹进行完整桥面的图像采集。预设的拍摄轨迹呈S形。(2) Install the CCD camera calibrated in step 1-1 on the bridge inspection platform, and collect images of the complete bridge deck according to the preset shooting trajectory. The preset shooting trajectory is S-shaped.
(3)根据步骤1-1得到的CCD相机内参矩阵和畸变系数对步骤1-2采集到的各桥面图像分别进行图像校准。(3) Perform image calibration on each bridge deck image collected in step 1-2 according to the internal parameter matrix and distortion coefficient of the CCD camera obtained in step 1-1.
作为优选,步骤2中,RANSAC算法求解投影变换矩阵的流程如下:Preferably, in step 2, the process of solving the projection transformation matrix by the RANSAC algorithm is as follows:
(1)用特征描述符内的各匹配点对构建初始样本集S。统计初始样本集S中各匹配点对间的欧式距离,并按从小到大排序。(1) Construct an initial sample set S with each matching point pair in the feature descriptor. Count the Euclidean distances between each matching point pair in the initial sample set S, and sort them from small to large.
(2)取步骤(1)所得序列的前85%的匹配点对构建新样本集S′。(2) Take the first 85% matching point pairs of the sequence obtained in step (1) to construct a new sample set S'.
(3)从新样本集S′中随机抽取4组匹配点对组成一个内点集合Si,并计算矩阵模型内点集合Si的Hi,进入步骤(4)。(3) Randomly select 4 sets of matching point pairs from the new sample set S' to form an interior point set S i , and calculate the H i of the interior point set S i of the matrix model, and enter step (4).
(4)新样本集S′内其余各匹配点对针对该矩阵模型Hi进行适应性检验。若存在检验误差小于误差阈值的匹配点,则将检验误差小于阈值的匹配点对加入内点集合Si,并执行步骤(5)。否则,舍弃该矩阵模型Hi,重新执行(3)。(4) The remaining matching point pairs in the new sample set S' are tested for adaptability of the matrix model Hi . If there is a matching point whose inspection error is smaller than the error threshold, the matching point pair whose inspection error is smaller than the threshold is added to the interior point set S i , and step (5) is executed. Otherwise, discard the matrix model H i and execute (3) again.
(5)若内点集合Si中元素个数大于规定阈值,则认为得到合理的参数模型,对更新后的内点集合Si重新计算矩阵模型Hi,并使用LM算法最小化代价函数。否则,舍弃该矩阵模型Hi,并重新执行步骤(3)。(5) If the number of elements in the interior point set Si is greater than the specified threshold, it is considered that a reasonable parameter model is obtained , and the matrix model H i is recalculated for the updated interior point set Si , and the LM algorithm is used to minimize the cost function. Otherwise, discard the matrix model H i and perform step (3) again.
(6)重复l次步骤(3)至(5),l为最大迭代次数。之后,对比l次迭代中得到的内点集合Si,以元素个数最大的内点集合Si作为最终的内点集,并取其计算的矩阵模型Hi作为相邻桥面图像间的投影变换矩阵。(6) Repeat steps (3) to (5) for l times, where l is the maximum number of iterations. Afterwards, compare the interior point set Si obtained in l iterations, take the interior point set Si with the largest number of elements as the final interior point set , and take the calculated matrix model H i as the difference between adjacent bridge deck images . Projection transformation matrix.
作为优选,步骤3中,投影变换的具体步骤如下:Preferably, in step 3, the specific steps of projection transformation are as follows:
(1)根据相邻图像间的投影变换矩阵的传递性,以每行的第一张桥面图像分别作为对应行的基准图像进行拼接。对各相邻桥面图像间的变换矩阵Hii-1进行传递变换,得到各桥面图像与基准图像之间的传递变换矩阵Hi1。再通过各变换矩阵Hi1将对应的桥面图像分别映射到基准平面坐标系内,以完成水平方向上各相邻图像间的图像拼接融合,形成多张宽视角的横向全景图像Imagei。(1) According to the transitivity of the projection transformation matrix between adjacent images, the first bridge deck image of each row is used as the reference image of the corresponding row for stitching. Perform transfer transformation on the transformation matrix H ii-1 between each adjacent bridge deck image to obtain the transfer transformation matrix H i1 between each bridge deck image and the reference image. Then, the corresponding bridge deck images are mapped into the reference plane coordinate system through each transformation matrix H i1 to complete the image splicing and fusion between adjacent images in the horizontal direction to form multiple horizontal panoramic images Image i with wide viewing angles.
(2)将步骤(1)中所得的第一张横向全景图像Image1作为基准全景图像进行拼接。对各横向全景图像间的变换矩阵Tjj-1进行传递变换,得到各横向全景图像Imagei与基准全景图像之间的传递变换矩阵Tj1。再通过各传递变换矩阵Tj1分别将对应的横向全景图像分别映射到基准平面坐标系内,以完成竖直方向上各相邻横向全景图像间的图像拼接融合,形成最终的桥面全景图像。(2) Stitching the first horizontal panoramic image Image 1 obtained in step (1) as a reference panoramic image. Perform transfer transformation on the transformation matrix T jj-1 between each horizontal panorama image to obtain a transfer transformation matrix T j1 between each horizontal panorama image Image i and the reference panorama image. Then, the corresponding horizontal panoramic images are respectively mapped into the reference plane coordinate system through each transfer transformation matrix T j1 to complete the image splicing and fusion between adjacent horizontal panoramic images in the vertical direction to form the final bridge deck panoramic image.
本发明具有的有益效果是:The beneficial effects that the present invention has are:
1、本发明通过图像采集与处理技术,代替人眼完成桥梁病害特征的自动化无损检测,对复杂地形环境下的桥面损伤检测技术的研究具有非常重要的现实意义。一方面增强了施工安全性,另一方面提高了作业机动性和灵活性。1. The present invention uses the image acquisition and processing technology to replace the human eye to complete the automatic nondestructive detection of bridge damage characteristics, which has very important practical significance for the research of bridge deck damage detection technology under complex terrain environment. On the one hand, the construction safety is enhanced, and on the other hand, the operation mobility and flexibility are improved.
2、本发明针对传统图像配准算法在运算量较大和精度不足的问题,为了更加完整且精准地提取桥面图像病害特征数据,提出了一种改进的多组相邻桥面图像配准算法,实现大面积桥面图像的保真拼接,提高了图像配准精度和效率,为后续桥梁病害特征图像检测奠定了工作基础,也为其他领域的图像拼接检测提供了一个技术参考。2. The present invention proposes an improved multi-group adjacent bridge deck image registration algorithm in order to extract the disease characteristic data of bridge deck images more completely and accurately, aiming at the problems of large computational load and insufficient precision of traditional image registration algorithms. , to achieve the fidelity stitching of large-area bridge deck images, improve the accuracy and efficiency of image registration, lay a foundation for the subsequent image detection of bridge disease characteristics, and also provide a technical reference for image stitching detection in other fields.
3、本发明针对桥梁表面特殊的检测环境,提出改进的渐入渐出图像融合算法,引入相邻桥面图像的灰度差阈值,可有效抑制桥面图像无关噪声的影响,最大程度地保留桥面病害的细节特征信息,在实现多组桥面图像保真融合的基础上,提高拼接图像的信噪比。3. Aiming at the special detection environment of the bridge surface, the present invention proposes an improved fade-in and fade-out image fusion algorithm, and introduces the grayscale difference threshold of the adjacent bridge deck images, which can effectively suppress the influence of irrelevant noise of the bridge deck images and preserve the maximum extent. The detailed feature information of the bridge deck disease can improve the signal-to-noise ratio of the stitched images on the basis of realizing the fidelity fusion of multiple groups of bridge deck images.
4、本发明提高了复杂背景下桥面图像拼接算法的抗干扰性和稳定性,具有较好的鲁棒性。保证后续病害特征数据提取的准确度和精度。4. The present invention improves the anti-interference and stability of the bridge deck image stitching algorithm under complex background, and has better robustness. Ensure the accuracy and precision of subsequent disease feature data extraction.
5、本发明根据桥梁表面图像采集工作环境,进行多组桥面图像拼接算法设计,并对其中关键计算进行了可靠性分析研究,具有较高的算法创新性与桥梁检测工程参考价值。5. According to the working environment of bridge surface image collection, the present invention designs multiple groups of bridge deck image stitching algorithms, and conducts reliability analysis and research on key calculations, which has high algorithm innovation and reference value for bridge inspection projects.
附图说明Description of drawings
图1为本发明中大面积桥面图像拼接流程图;Fig. 1 is the large-area bridge deck image stitching flow chart in the present invention;
图2为本发明中桥面图像采集轨迹示意图;2 is a schematic diagram of a bridge deck image acquisition track in the present invention;
图3为本发明中多幅桥梁图像拼接处理流程图;Fig. 3 is a flow chart of the stitching processing of multiple bridge images in the present invention;
图4为本发明中自适应对比度阈值计算流程图;Fig. 4 is the self-adaptive contrast threshold calculation flow chart in the present invention;
图5为本发明中逐行图像拼接策略示意图;5 is a schematic diagram of a line-by-line image stitching strategy in the present invention;
图6为本发明中逐列图像拼接策略示意图;6 is a schematic diagram of a column-by-column image stitching strategy in the present invention;
图7a、7b为本发明中相邻图像间加权融合示意图。7a and 7b are schematic diagrams of weighted fusion between adjacent images in the present invention.
具体实施方式Detailed ways
以下结合附图对本发明作进一步说明。The present invention will be further described below with reference to the accompanying drawings.
如图1所示,一种大面积桥面图像拼接方法,具体步骤如下:As shown in Figure 1, a large-area bridge deck image stitching method, the specific steps are as follows:
步骤1、拼接预处理Step 1. Splicing preprocessing
1-1.采用张正友平面标定法,使用CCD相机从不同角度对标定板进行图像采样,通过检测的标定板棋盘格角点坐标计算CCD相机的内参矩阵后,通过最小二乘法得到径向畸变系数。1-1. Using the Zhang Zhengyou plane calibration method, use the CCD camera to sample images of the calibration board from different angles, calculate the internal parameter matrix of the CCD camera through the detected calibration board checkerboard corner coordinates, and obtain the radial distortion coefficient through the least squares method. .
1-2.在桥梁检测平台上安置经过步骤1-1标定的CCD相机,根据预设的拍摄轨迹进行完整桥面的多组图像采集。预设的拍摄轨迹如图2所示,呈S形。1-2. Install the CCD camera calibrated in step 1-1 on the bridge inspection platform, and collect multiple sets of images of the complete bridge deck according to the preset shooting trajectory. The preset shooting track is shown in Figure 2, which is S-shaped.
1-3.根据步骤1-1得到的CCD相机内参矩阵和畸变系数对步骤1-2采集到的各桥面图像分别进行图像校准,以消除镜头畸变带来的失真影响。1-3. Perform image calibration on each bridge deck image collected in step 1-2 according to the internal parameter matrix and distortion coefficient of the CCD camera obtained in step 1-1, so as to eliminate the distortion effect caused by lens distortion.
1-4.图像预处理1-4. Image preprocessing
首先预估算全景图像的尺寸。该尺寸根据待拼接图像的分辨率和数量取值,拼接完成后去除无效区域;然后通过提取并统计所有待拼接的桥面图像的亮度分量信息,并分别对各桥面图像的亮度分量信息进行均衡化,以消除光照不均带来的亮度差别影响;最后通过傅里叶变换将各桥面图像变换到频域内,并采用相位相关算法中的归一化互功率谱的相位信息得到图像间的平移参数,以此完成对相邻图像间重叠区域的预估算。First pre-estimate the size of the panorama image. The size is valued according to the resolution and quantity of the images to be spliced, and the invalid area is removed after the splicing is completed; then, by extracting and counting the brightness component information of all the bridge deck images to be spliced, and separately performing the brightness component information of each bridge deck image. Equalization to eliminate the influence of brightness difference caused by uneven illumination; finally, each bridge deck image is transformed into the frequency domain through Fourier transform, and the phase information of the normalized cross-power spectrum in the phase correlation algorithm is used to obtain the image between the images. to complete the pre-estimation of the overlapping area between adjacent images.
相位相关算法是采用傅里叶变换先将待拼接图像变换到频域内,再通过归一化互功率谱计算两图像的平移参数,得到一个二维冲激函数:该二维冲激函数的峰值大小反映相邻桥面图像间的内容相关性,其值为1表示两图像完全相同,为0则表示完全不同。桥梁图像检测设备所采集到的相邻图像间存在透视变换和位置移动所带来的变化,虽然会使冲激函数的能量从单一峰值分散至众多小峰值,但其最大峰值位置对应的平移参数仍会保持相对稳定。因此,通过相位相关算法得到的平移量可粗略获取待拼接图像间的重叠区域,而且该算法对光照亮度变化不敏感,所检测的相关最大峰尖,具有较好的鲁棒性和稳定性。The phase correlation algorithm uses Fourier transform to first transform the image to be spliced into the frequency domain, and then calculates the translation parameters of the two images through the normalized cross-power spectrum to obtain a two-dimensional impulse function: the peak value of the two-dimensional impulse function. The size reflects the content correlation between adjacent bridge deck images. A value of 1 indicates that the two images are identical, and a value of 0 indicates that they are completely different. There are changes caused by perspective transformation and position movement between adjacent images collected by bridge image detection equipment. Although the energy of the impulse function will be dispersed from a single peak to many small peaks, the translation parameters corresponding to the maximum peak position will remain relatively stable. Therefore, the translation amount obtained by the phase correlation algorithm can roughly obtain the overlapping area between the images to be spliced, and the algorithm is insensitive to changes in illumination brightness, and the detected maximum correlation peak has good robustness and stability.
步骤2、图像配准Step 2. Image registration
首先,在各相邻图像间重叠区域内提取SIFT特征点,以减少大量不必要的特征点检测计算量,提高SIFT特征点的检测效率;然后通过自适应对比度阈值法,将检测得到的SIFT特征点数量控制在一个合理的范围内,以筛选出稳定的特征点集;并采用改进的RANSAC算法(随机抽样一致性算法)计算各相邻图像间的投影变换矩阵H。First, SIFT feature points are extracted in the overlapping area between adjacent images to reduce a large number of unnecessary feature point detection calculations and improve the detection efficiency of SIFT feature points; The number of points is controlled within a reasonable range to screen out stable feature point sets; and the improved RANSAC algorithm (random sampling consistency algorithm) is used to calculate the projection transformation matrix H between adjacent images.
自适应对比度阈值法具体如下:The adaptive contrast threshold method is as follows:
在确定两两相邻桥面图像间的重叠区域(Δx,Δy)后,仅针对该重叠区域进行SIFT特征点检测。由于其中对比度较低的特征点对桥面背景噪声较为敏感,故设定对比度阈值,筛选出稳定的特征点集,记为C。After determining the overlapping area (Δx, Δy) between two adjacent bridge deck images, SIFT feature point detection is performed only for the overlapping area. Since the feature points with low contrast are more sensitive to the background noise of the bridge deck, the contrast threshold is set to filter out a stable feature point set, which is denoted as C.
现有技术中,通过高斯差分泰勒展开式计算各SIFT特征点的对比度,并设置固定的对比度阈值来保留高于该对比度阈值的特征点作为稳定特征点。然而上述对比度阈值Tc为固定值,一般取值在0.02到0.04之间。但在不同混凝土桥梁的裂缝图像检测中,SIFT检测到的候选特征点集有很大差别,部分桥梁表面较为平整光洁,所采集的图像数字信号较为平滑,尺度空间因子σ较小,致使检测到的特征点较少,反而可能无法满足特征点匹配的数量需求,影响最终的拼接精度。(传统拼接算法中用到的对比度阈值步骤)。本发明设置一个变化的对比度阈值,来保证检测到的SIFT特征点数控制在一个合理的范围内。经多组实验验证表明,桥梁裂缝图像检测的特征点保持在200到300之间即可满足较好的拼接精度。In the prior art, the contrast of each SIFT feature point is calculated by Gaussian difference Taylor expansion, and a fixed contrast threshold is set to retain feature points higher than the contrast threshold as stable feature points. However, the above-mentioned contrast threshold T c is a fixed value, and generally ranges from 0.02 to 0.04. However, in the crack image detection of different concrete bridges, the candidate feature point sets detected by SIFT are quite different. Some bridge surfaces are relatively smooth and clean, the collected image digital signals are relatively smooth, and the scale space factor σ is small, resulting in the detection of There are fewer feature points, but it may not be able to meet the number of feature point matching requirements, which affects the final stitching accuracy. (Contrast thresholding step used in traditional stitching algorithms). The present invention sets a variable contrast threshold to ensure that the number of detected SIFT feature points is controlled within a reasonable range. Several sets of experimental verifications show that the feature points of bridge crack image detection can be kept between 200 and 300 to meet better stitching accuracy.
如图4所示,本发明中确定对比度阈值Tc的方法,具体如下:As shown in Figure 4, the method for determining the contrast threshold T c in the present invention is as follows:
(1)设定特征点数量下限Nmin=200,上限Nmax=300,对比度阈值Tc=T0;T0为初始阈值,取值为0.02~0.04。(1) Set the lower limit of the number of feature points N min =200, the upper limit N max =300, and the contrast threshold T c =T 0 ; T 0 is the initial threshold, which is 0.02 to 0.04.
(2)进行特征点检测,并统计对比度高于Tc的特征点数量N。(2) Perform feature point detection, and count the number N of feature points whose contrast is higher than Tc .
(3)若Nmin≤N≤Nmax,则将对比度高于Tc的特征点纳入初始匹配点集,剔除对比度低于阈值Tc的特征点,并直接进入步骤(5);否则,执行步骤(4)。(3) If N min ≤N≤N max , the feature points with contrast higher than T c are included in the initial matching point set, the feature points with contrast lower than the threshold T c are eliminated, and directly enter step (5); otherwise, execute Step (4).
(4)若N<Nmin,则将对比度阈值Tc减小为原数值的并执行步骤(3);若N>Nmax,则将对比度阈值增大为原数值的2倍,并执行步骤(3)。(4) If N<N min , reduce the contrast threshold T c to the value of the original value And execute step (3); if N>N max , increase the contrast threshold to twice the original value, and execute step (3).
(5)通过最近邻比次近邻方法剔除初始匹配点集中的误特征点,并生成特征描述符。特征描述符内包含由成对特征点组成的多个匹配点对,以及各匹配点对之间的距离和方向信息。(5) The erroneous feature points in the initial matching point set are eliminated by the nearest neighbor ratio and the next nearest neighbor method, and feature descriptors are generated. The feature descriptor contains multiple matching point pairs composed of paired feature points, and the distance and direction information between each matching point pair.
经相邻图像重叠区域间的特征点匹配后,筛选出足够的匹配点对,通过匹配点对求解桥梁裂缝序列图像间的变换矩阵,以此完成大范围的桥面图像拼接。为进一步提高图像配准效率和精度,对RANSAC算法进行改进。After the feature points between the overlapping areas of adjacent images are matched, enough matching point pairs are selected, and the transformation matrix between the bridge crack sequence images is solved through the matching point pairs, so as to complete the large-scale bridge deck image stitching. In order to further improve the efficiency and accuracy of image registration, the RANSAC algorithm is improved.
改进后的RANSAC算法求解投影变换矩阵H的流程如下:The process of the improved RANSAC algorithm to solve the projection transformation matrix H is as follows:
(1)用特征描述符内的各匹配点对构建初始样本集S。统计初始样本集S中各匹配点对间的欧式距离,并按从小到大排序;(1) Construct an initial sample set S with each matching point pair in the feature descriptor. Count the Euclidean distances between matching point pairs in the initial sample set S, and sort them from small to large;
(2)取步骤(1)所得序列的前85%的匹配点对构建新样本集S′;(2) taking the first 85% matching point pairs of the sequence obtained in step (1) to construct a new sample set S';
(3)从新样本集S′中随机抽取4组匹配点对组成一个内点集合Si,并计算矩阵模型内点集合Si的Hi,进入步骤(4);(3) randomly select 4 groups of matching point pairs from the new sample set S' to form an interior point set S i , and calculate the H i of the interior point set S i of the matrix model, and enter step (4);
(4)新样本集S′内其余各匹配点对针对该矩阵模型Hi进行适应性检验;若存在检验误差小于误差阈值的匹配点,则将检验误差小于阈值的匹配点对加入内点集合Si,并执行步骤(5);否则,舍弃该矩阵模型Hi,重新执行(3)。(4) The remaining matching point pairs in the new sample set S′ are tested for adaptability of the matrix model Hi ; if there are matching points whose test error is less than the error threshold, the matching point pairs whose test error is less than the threshold will be added to the interior point set S i , and execute step (5); otherwise, discard the matrix model H i and execute step (3) again.
(5)若内点集合Si中元素个数大于规定阈值,则认为得到合理的参数模型,对更新后的内点集合Si重新计算矩阵模型Hi,并使用LM算法最小化代价函数;否则,舍弃该矩阵模型Hi,并重新执行步骤(3)。(5) If the number of elements in the interior point set Si is greater than the specified threshold, it is considered that a reasonable parameter model is obtained , the matrix model H i is recalculated for the updated interior point set Si , and the LM algorithm is used to minimize the cost function; Otherwise, discard the matrix model H i and perform step (3) again.
(6)重复l次步骤(3)至(5),l为最大迭代次数。之后,对比l次迭代中得到的内点集合Si,以元素个数最大的内点集合Si作为最终的内点集,并取其计算的矩阵模型Hi作为相邻桥面图像间的投影变换矩阵H。(6) Repeat steps (3) to (5) for l times, where l is the maximum number of iterations. Afterwards, compare the interior point set Si obtained in l iterations, take the interior point set Si with the largest number of elements as the final interior point set , and take the calculated matrix model H i as the difference between adjacent bridge deck images . Projection transformation matrix H.
改进的RANSAC算法通过计算所有匹配点对间的欧氏距离并进行排序筛选,不仅减少了待匹配点对的样本集数据,提高了样本集中局内点所占比例,而且缩减了投影变换矩阵的迭代精炼次数,以提高桥面图像的匹配精度。根据图像特征点对之间的距离越小,其匹配相似度越高的特性,在此计算所有特征点对间的欧氏距离并按照从小到大的顺序排列进行筛选。通过多组桥面图像拼接测试结果统计表明,经重叠区域特征点对初匹配后,初始样本集S的成功匹配率可达85%以上,则取其序列的前85%的特征点对构建新样本集S′。经样本数据筛选,样本集S′包含足够的匹配点对,不仅提高了局内点在样本集中所占比例,而且极大地缩减了变换矩阵参数模型H的迭代次数。The improved RANSAC algorithm calculates the Euclidean distance between all matching point pairs and sorts them, which not only reduces the sample set data of the point pairs to be matched, but also increases the proportion of in-office points in the sample set, and reduces the iteration of the projection transformation matrix. The number of refinements to improve the matching accuracy of the bridge deck image. According to the characteristic that the smaller the distance between the image feature point pairs, the higher the matching similarity, the Euclidean distance between all feature point pairs is calculated here and sorted in ascending order for screening. According to the statistics of the stitching test results of multiple groups of bridge deck images, after the initial matching of the feature point pairs in the overlapping area, the successful matching rate of the initial sample set S can reach more than 85%, then the first 85% of the feature point pairs in the sequence are used to construct a new sample set S'. After sample data screening, the sample set S' contains enough matching point pairs, which not only increases the proportion of intra-office points in the sample set, but also greatly reduces the number of iterations of the transformation matrix parameter model H.
步骤3、图像融合Step 3. Image fusion
首先根据相邻图像间的投影变换矩阵,对相应桥面图像进行投影变换;然后采用渐入渐出融合算法对各相邻桥面图像的RGB三颜色通道分别进行加权平滑过渡,得到桥面拼接图像。Firstly, according to the projection transformation matrix between adjacent images, the corresponding bridge deck image is subjected to projective transformation; then the RGB three-color channels of each adjacent bridge deck image are weighted and smoothly transitioned by the fade-in and fade-out fusion algorithm to obtain the bridge deck mosaic. image.
投影变换的具体步骤如下:The specific steps of projection transformation are as follows:
(1)如图5所示,根据相邻图像间的投影变换矩阵的传递性,以每行的第一张桥面图像分别作为对应行的基准图像,依据图像行拼接策略,进行拼接。对各相邻桥面图像间的变换矩阵Hii-1进行传递变换,得到各桥面图像与基准图像之间的传递变换矩阵Hi1;再通过各变换矩阵Hi1将对应的桥面图像分别映射到基准平面坐标系内,以完成水平方向上各相邻图像间的图像拼接融合,形成多张宽视角的横向全景图像Imagei。(1) As shown in Figure 5, according to the transitivity of the projection transformation matrix between adjacent images, the first bridge deck image of each row is used as the reference image of the corresponding row, and the splicing is performed according to the image row splicing strategy. The transformation matrix H ii-1 between the adjacent bridge deck images is transferred and transformed to obtain the transfer transformation matrix H i1 between each bridge deck image and the reference image ; It is mapped into the reference plane coordinate system to complete the image splicing and fusion between adjacent images in the horizontal direction to form multiple horizontal panoramic images Image i with a wide viewing angle.
各传递矩阵变换公式如下:The transformation formula of each transfer matrix is as follows:
H21=H21 H 21 =H 21
H31=H32×H21 H 31 =H 32 ×H 21
Hn1=Hnn-1×Hn-1n-2×…×H21 H n1 =H nn-1 ×H n-1n-2 ×…×H 21
其中,Hii-1为同一行的第i-1张桥面图像与第i张桥面图像间的变换矩阵,其值在步骤2-2中计算得到;Hi1为同一行的第1张桥面图像与第i张桥面图像间的变换矩阵;n为同一行上的图像数量。Among them, H ii-1 is the transformation matrix between the i-1 th bridge deck image in the same row and the i th bridge deck image, and its value is calculated in step 2-2; H i1 is the first image in the same row The transformation matrix between the bridge deck image and the ith bridge deck image; n is the number of images on the same row.
(2)如图6所示,步骤(1)中所得的第一张横向全景图像Image1作为基准全景图像,依据图像列拼接策略,进行拼接。对各横向全景图像间的变换矩阵Tjj-1进行传递变换,,得到各横向全景图像Imagei与基准全景图像之间的传递变换矩阵Tj1;再通过各传递变换矩阵Tj1分别将对应的横向全景图像分别映射到基准平面坐标系内,以完成竖直方向上各相邻横向全景图像间的图像拼接融合,图像拼接融合中传递矩阵变换公式参照步骤(1)中的描述,形成最终的桥面全景图像。(2) As shown in FIG. 6 , the first horizontal panoramic image Image 1 obtained in step (1) is used as a reference panoramic image, and is stitched according to the image column stitching strategy. Transfer transformation is carried out to the transformation matrix T jj-1 between each horizontal panorama image, obtains the transfer transformation matrix T j1 between each horizontal panorama image Image i and the reference panoramic image ; The horizontal panoramic images are respectively mapped into the reference plane coordinate system to complete the image splicing and fusion between adjacent horizontal panoramic images in the vertical direction. In the image splicing and fusion, the transfer matrix transformation formula refers to the description in step (1) to form the final image. Panoramic image of bridge deck.
本实施例中渐入渐出融合算法经过改进,具体参见下述。In this embodiment, the fade-in and fade-out fusion algorithm is improved, and the details are as follows.
经图像配准后,为进一步消除桥面图像拼接缝对裂缝检测处理的干扰,通常对相邻桥面图像像素值进行加权平均,如图7b所示,其重叠区域内像素点到两边缝合线的距离作为融合权重判别依据。After image registration, in order to further eliminate the interference of bridge deck image stitching on crack detection processing, the pixel values of adjacent bridge deck images are usually weighted and averaged, as shown in Figure 7b, the pixels in the overlapping area are stitched to both sides. The distance of the line is used as the basis for judging the fusion weight.
但由于图像采集位置发生变化,桥梁表面反射光可能会造成重合区域内个别像素点灰度值存在跳变现象,为消除其对融合图像产生的影响,在传统渐入渐出加权融合计算中引入一个阈值t。计算重叠部分目标像素点在两幅原始图像对应的灰度差值,若该差值小于阈值,说明该像素点在原桥面图像中并未呈现明显差异,可直接取其加权平均值作为该点像素值;反之,说明待拼接图像在该像素点位置下存在明暗突变,应取其平滑前权重较大的像素值作为该点融合像素值。However, due to the change of the image acquisition position, the reflected light from the bridge surface may cause the gray value of individual pixels in the overlapping area to jump. a threshold t. Calculate the grayscale difference corresponding to the two original images of the overlapped target pixel. If the difference is less than the threshold, it means that the pixel does not show significant difference in the original bridge deck image, and its weighted average can be directly taken as the point. On the contrary, it means that the image to be spliced has a sudden change of light and dark at this pixel position, and the pixel value with a larger weight before smoothing should be taken as the fusion pixel value at this point.
渐入渐出融合算法中,相邻图像重叠区域内各融合像素值I(x,y)的渐入渐出加权公式如下:In the fade-in and fade-out fusion algorithm, the fade-in and fade-out weighting formula of each fusion pixel value I(x, y) in the overlapping area of adjacent images is as follows:
其中,I1(x,y)、I2(x,y)分别为相邻的两张桥面图像在重叠区域内的对应融合点的像素值,如图7a所示。d1、d2分别为相邻的两张桥面图像在对应融合点的渐变权重因子;如图7b所示,和x1、x2分别为重叠区域两侧边界的横坐标;x为对应融合点的横坐标;t为两相邻图像重叠区域在对应融合点上的灰度差阈值。Among them, I 1 (x, y) and I 2 (x, y) are the pixel values of the corresponding fusion points of the two adjacent bridge deck images in the overlapping area, as shown in Figure 7a. d 1 and d 2 are the gradient weight factors of the two adjacent bridge deck images at the corresponding fusion points respectively; as shown in Figure 7b, and x 1 and x 2 are the abscissas of the borders on both sides of the overlapping area, respectively; x is the abscissa of the corresponding fusion point; t is the grayscale difference threshold at the corresponding fusion point in the overlapping area of two adjacent images.
Claims (4)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910561334.9A CN110363706B (en) | 2019-06-26 | 2019-06-26 | Large-area bridge deck image splicing method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910561334.9A CN110363706B (en) | 2019-06-26 | 2019-06-26 | Large-area bridge deck image splicing method |
Publications (2)
Publication Number | Publication Date |
---|---|
CN110363706A true CN110363706A (en) | 2019-10-22 |
CN110363706B CN110363706B (en) | 2023-03-21 |
Family
ID=68216594
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910561334.9A Active CN110363706B (en) | 2019-06-26 | 2019-06-26 | Large-area bridge deck image splicing method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110363706B (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112734720A (en) * | 2021-01-08 | 2021-04-30 | 沈阳工业大学 | Ship hull laser cleaning in-place detection method and system based on visual identification |
CN115266282A (en) * | 2021-04-30 | 2022-11-01 | 武汉兰丁云医学检验实验室有限公司 | Pathological image automatic identification method based on combination of three methods of HE staining, ki67 and P16 |
CN116543267A (en) * | 2023-07-04 | 2023-08-04 | 宁德时代新能源科技股份有限公司 | Image set processing method, image segmentation device, image set processing apparatus, image segmentation device, and storage medium |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101916445A (en) * | 2010-08-25 | 2010-12-15 | 天津大学 | An Image Registration Method Based on Affine Parameter Estimation |
US20130216089A1 (en) * | 2010-04-22 | 2013-08-22 | The University Of North Carolina At Charlotte | Method and System for Remotely Inspecting Bridges and Other Structures |
CN104599249A (en) * | 2015-01-13 | 2015-05-06 | 重庆大学 | Cable rope bearing bridge deck vehicle load distribution real-time detection method |
CN106910208A (en) * | 2017-03-07 | 2017-06-30 | 中国海洋大学 | A kind of scene image joining method that there is moving target |
CN107424181A (en) * | 2017-04-12 | 2017-12-01 | 湖南源信光电科技股份有限公司 | A kind of improved image mosaic key frame rapid extracting method |
EP3319038A1 (en) * | 2015-06-30 | 2018-05-09 | Baidu Online Network Technology (Beijing) Co., Ltd. | Panoramic image generation method and apparatus for user terminal |
CN108921848A (en) * | 2018-09-29 | 2018-11-30 | 长安大学 | Bridge Defect Detecting device and detection image joining method based on more mesh cameras |
CN109754368A (en) * | 2019-01-23 | 2019-05-14 | 郑州工程技术学院 | A kind of crack joining method in bridge quality testing |
-
2019
- 2019-06-26 CN CN201910561334.9A patent/CN110363706B/en active Active
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130216089A1 (en) * | 2010-04-22 | 2013-08-22 | The University Of North Carolina At Charlotte | Method and System for Remotely Inspecting Bridges and Other Structures |
CN101916445A (en) * | 2010-08-25 | 2010-12-15 | 天津大学 | An Image Registration Method Based on Affine Parameter Estimation |
CN104599249A (en) * | 2015-01-13 | 2015-05-06 | 重庆大学 | Cable rope bearing bridge deck vehicle load distribution real-time detection method |
EP3319038A1 (en) * | 2015-06-30 | 2018-05-09 | Baidu Online Network Technology (Beijing) Co., Ltd. | Panoramic image generation method and apparatus for user terminal |
US20180365803A1 (en) * | 2015-06-30 | 2018-12-20 | Baidu Online Network Technology (Beijing) Co., Ltd | Panoramic image generation method and apparatus for user terminal |
CN106910208A (en) * | 2017-03-07 | 2017-06-30 | 中国海洋大学 | A kind of scene image joining method that there is moving target |
CN107424181A (en) * | 2017-04-12 | 2017-12-01 | 湖南源信光电科技股份有限公司 | A kind of improved image mosaic key frame rapid extracting method |
CN108921848A (en) * | 2018-09-29 | 2018-11-30 | 长安大学 | Bridge Defect Detecting device and detection image joining method based on more mesh cameras |
CN109754368A (en) * | 2019-01-23 | 2019-05-14 | 郑州工程技术学院 | A kind of crack joining method in bridge quality testing |
Non-Patent Citations (4)
Title |
---|
LARAQUI, A.1;BAATAOUI, A.1;SAAIDI, A.1;JARRAR, A.1;MASRAR, M.1;S: "Image mosaicing using voronoi diagram", 《MULTIMEDIA TOOLS & APPLICATIONS》 * |
宋佳乾等: "基于改进SIFT特征点匹配的图像拼接算法", 《计算机测量与控制》 * |
张静等: "基于SIFT特征和误匹配逐次去除的图像拼接", 《半导体光电》 * |
肖映彩等: "无人机航拍图像拼接的研究与实现", 《通信技术》 * |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112734720A (en) * | 2021-01-08 | 2021-04-30 | 沈阳工业大学 | Ship hull laser cleaning in-place detection method and system based on visual identification |
CN112734720B (en) * | 2021-01-08 | 2024-03-05 | 沈阳工业大学 | Ship hull laser cleaning in-situ detection method and system based on visual identification |
CN115266282A (en) * | 2021-04-30 | 2022-11-01 | 武汉兰丁云医学检验实验室有限公司 | Pathological image automatic identification method based on combination of three methods of HE staining, ki67 and P16 |
CN116543267A (en) * | 2023-07-04 | 2023-08-04 | 宁德时代新能源科技股份有限公司 | Image set processing method, image segmentation device, image set processing apparatus, image segmentation device, and storage medium |
CN116543267B (en) * | 2023-07-04 | 2023-10-13 | 宁德时代新能源科技股份有限公司 | Image set processing method, image segmentation device, image set processing apparatus, image segmentation device, and storage medium |
Also Published As
Publication number | Publication date |
---|---|
CN110363706B (en) | 2023-03-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110378879B (en) | Bridge crack detection method | |
Lei et al. | New crack detection method for bridge inspection using UAV incorporating image processing | |
CN108007355B (en) | Concrete crack detection method based on image distance transformation | |
Valença et al. | Damage assessment on concrete surfaces using multi-spectral image analysis | |
CN110363706B (en) | Large-area bridge deck image splicing method | |
CN101819024B (en) | Machine vision-based two-dimensional displacement detection method | |
CN107392929B (en) | An intelligent target detection and size measurement method based on human visual model | |
CN108305239B (en) | Bridge crack image repairing method based on generation type countermeasure network | |
CN104700395A (en) | Method and system for detecting appearance crack of structure | |
Yang et al. | A total sky cloud detection method using real clear sky background | |
CN109886939A (en) | Bridge crack detection method based on tensor voting | |
CN117291913B (en) | Apparent crack measuring method for hydraulic concrete structure | |
CN106056625A (en) | Airborne infrared moving target detection method based on geographical homologous point registration | |
CN113884011A (en) | Non-contact concrete surface crack measuring equipment and method | |
CN110334727B (en) | Intelligent matching detection method for tunnel cracks | |
CN111638218A (en) | Method for detecting surface defects of coating | |
CN112884795A (en) | Power transmission line inspection foreground and background segmentation method based on multi-feature significance fusion | |
CN116012310A (en) | Cross-sea bridge pier surface crack detection method based on linear residual error attention | |
CN107092905A (en) | A kind of instrument localization method to be identified of electric inspection process robot | |
CN113076959A (en) | Concrete structure surface microcrack feature extraction method based on convolutional neural network | |
Mojidra et al. | Vision-based fatigue crack detection using global motion compensation and video feature tracking | |
CN105681677B (en) | A kind of high-resolution optical remote sensing Satellite Camera optimal focal plane determines method | |
Xing et al. | A lightweight detection method of pavement potholes based on binocular stereo vision and deep learning | |
JP5218849B2 (en) | Defect inspection equipment | |
CN109359513B (en) | Anomaly detection method based on edge detection and color matching |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |