CN116175035A - Intelligent welding method for steel structure high-altitude welding robot based on deep learning - Google Patents
Intelligent welding method for steel structure high-altitude welding robot based on deep learning Download PDFInfo
- Publication number
- CN116175035A CN116175035A CN202310282342.6A CN202310282342A CN116175035A CN 116175035 A CN116175035 A CN 116175035A CN 202310282342 A CN202310282342 A CN 202310282342A CN 116175035 A CN116175035 A CN 116175035A
- Authority
- CN
- China
- Prior art keywords
- welding
- weld
- robot
- depth
- deep learning
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B23—MACHINE TOOLS; METAL-WORKING NOT OTHERWISE PROVIDED FOR
- B23K—SOLDERING OR UNSOLDERING; WELDING; CLADDING OR PLATING BY SOLDERING OR WELDING; CUTTING BY APPLYING HEAT LOCALLY, e.g. FLAME CUTTING; WORKING BY LASER BEAM
- B23K37/00—Auxiliary devices or processes, not specially adapted for a procedure covered by only one of the other main groups of this subclass
- B23K37/02—Carriages for supporting the welding or cutting element
- B23K37/0211—Carriages for supporting the welding or cutting element travelling on a guide member, e.g. rail, track
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B23—MACHINE TOOLS; METAL-WORKING NOT OTHERWISE PROVIDED FOR
- B23K—SOLDERING OR UNSOLDERING; WELDING; CLADDING OR PLATING BY SOLDERING OR WELDING; CUTTING BY APPLYING HEAT LOCALLY, e.g. FLAME CUTTING; WORKING BY LASER BEAM
- B23K37/00—Auxiliary devices or processes, not specially adapted for a procedure covered by only one of the other main groups of this subclass
- B23K37/02—Carriages for supporting the welding or cutting element
- B23K37/0252—Steering means
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J19/00—Accessories fitted to manipulators, e.g. for monitoring, for viewing; Safety devices combined with or specially adapted for use in connection with manipulators
- B25J19/02—Sensing devices
- B25J19/021—Optical sensing devices
- B25J19/023—Optical sensing devices including video camera means
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1602—Programme controls characterised by the control system, structure, architecture
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1656—Programme controls characterised by programming, planning systems for manipulators
- B25J9/1664—Programme controls characterised by programming, planning systems for manipulators characterised by motion, path, trajectory planning
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P70/00—Climate change mitigation technologies in the production process for final industrial or consumer products
- Y02P70/10—Greenhouse gas [GHG] capture, material saving, heat recovery or other energy efficient measures, e.g. motor control, characterised by manufacturing processes, e.g. for rolling metal or metal working
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Robotics (AREA)
- Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Multimedia (AREA)
- Automation & Control Theory (AREA)
- Manipulator (AREA)
- Laser Beam Processing (AREA)
Abstract
Description
技术领域technical field
本发明涉及焊接技术领域,具体涉及焊缝检测与机械臂运动规划技术,更具体地说,涉及一种基于深度学习的钢结构高空焊接机器人智能焊接方法。The invention relates to the field of welding technology, in particular to weld seam detection and mechanical arm motion planning technology, and more specifically, to an intelligent welding method for steel structure high-altitude welding robots based on deep learning.
背景技术Background technique
高空钢梁维护与焊接技术是现代工业生产中不可或缺的步骤,主要涉及到钢梁裂缝的检测与焊接。传统人力作业存在一定的危险性,且无法做到完全标准化操作;而工业领域使用的焊接机械臂主要采用固定设计模式,无法针对钢梁中不同种类的焊缝进行对应焊接工作,且工业机械臂体积较大,无法作业于需要不断更换焊接位置的钢梁上方,难以广泛应用于高空焊接作业。High-altitude steel beam maintenance and welding technology is an indispensable step in modern industrial production, mainly involving the detection and welding of steel beam cracks. There are certain dangers in traditional manual operations, and completely standardized operations cannot be achieved; while the welding manipulators used in the industrial field mainly adopt a fixed design mode, which cannot perform corresponding welding work for different types of welds in steel beams, and industrial manipulators It is large in size and cannot be used on steel beams that require constant replacement of welding positions, making it difficult to be widely used in high-altitude welding operations.
经检索,专利申请号:201610116804.7,发明创造名称为:一种激光识别焊缝8轴机器人空间曲线焊接系统及方法;该申请案中机器人使激光传感器处于易于扫描工件焊缝的位置和姿态,激光传感器扫描得到焊缝特征点,使用最小二乘法拟合得到焊缝边缘特征,经过几何计算后得到激光传感器坐标系下焊缝的中心点;再使焊缝从起点到终点依次经过激光传感器扫描区,得到整条焊缝的离散中心点,使用非均匀有理B样条曲线对离散中心点进行拟合,得到统一描述整条焊缝的参数方程,再得到整个焊接过程的焊接速度方程;依据速度和参数的递推关系,焊缝曲线进行离散化,得到一系列的插补点;根据焊接工艺要求的插补点焊接姿态,求解倾斜/旋转两轴变位机运动学逆解,得到插补点对应的倾斜轴转角θ7和旋转轴转角θ8;求解倾斜/旋转两轴变位机运动学正解得到插补点对应的焊枪末端位置和姿态;求解机器人运动学逆解得到机器人六个轴的转角θ1,θ2,θ3,θ4,θ5,θ6;倾斜/旋转两轴变位机和焊接机器人协调同步运动进行焊接;在焊接过程中,激光传感器扫描焊缝,进行实时焊缝跟踪,补偿由于焊接热变形等因素造成的焊缝位置偏差。但上述申请案是针对8轴机器人的焊接应用,其设计重点在于确定机器人八个轴的转角θ1,θ2,θ3,θ4,θ5,θ6,θ7和θ8,方案在实现上偏复杂,在工程应用中成本较高。After searching, the patent application number is: 201610116804.7, and the name of the invention is: an 8-axis robot space curve welding system and method for laser recognition of welds; in this application, the robot puts the laser sensor in a position and posture that is easy to scan the workpiece weld, and the laser The feature points of the weld seam are obtained by scanning the sensor, and the edge characteristics of the weld seam are obtained by fitting with the least square method. After geometric calculation, the center point of the weld seam in the coordinate system of the laser sensor is obtained; , to get the discrete center point of the whole weld, use the non-uniform rational B-spline curve to fit the discrete center point, get the parameter equation that uniformly describes the whole weld, and then get the welding speed equation of the whole welding process; according to the speed According to the recursive relationship with the parameters, the weld curve is discretized to obtain a series of interpolation points; according to the welding posture of the interpolation points required by the welding process, the inverse kinematics solution of the tilt/rotation two-axis positioner is solved to obtain the interpolation points Points correspond to the tilt axis angle θ7 and rotation axis angle θ8; solve the forward kinematics solution of the tilt/rotation two-axis positioner to obtain the end position and attitude of the welding torch corresponding to the interpolation point; solve the inverse solution of the robot kinematics to obtain the rotation angle of the robot's six axes θ1, θ2, θ3, θ4, θ5, θ6; the tilt/rotation two-axis positioner and the welding robot coordinate and synchronously move for welding; during the welding process, the laser sensor scans the weld seam and performs real-time weld seam tracking to compensate for welding heat Weld seam position deviation caused by deformation and other factors. However, the above application is aimed at the welding application of an 8-axis robot, and its design focuses on determining the rotation angles θ1, θ2, θ3, θ4, θ5, θ6, θ7, and θ8 of the eight axes of the robot. Medium cost is higher.
发明内容Contents of the invention
1.发明要解决的技术问题1. The technical problem to be solved by the invention
为了解决传统人工焊接方法,对钢梁裂纹进行焊接时需反复操作、焊接过程有误差,现有焊接技术无法对非标准钢梁裂纹进行自动检测与焊接的问题,本发明提供了一种基于深度学习的钢结构高空焊接机器人智能焊接方法。In order to solve the problem that the traditional manual welding method requires repeated operations and errors in the welding process when welding steel beam cracks, and the existing welding technology cannot automatically detect and weld non-standard steel beam cracks, the invention provides a depth-based Learn the intelligent welding method of steel structure high-altitude welding robot.
2.技术方案2. Technical solution
为达到上述目的,本发明提供的技术方案为:In order to achieve the above object, the technical scheme provided by the invention is:
本发明的一种基于深度学习的钢结构高空焊接机器人智能焊接方法,其步骤为:A kind of intelligent welding method of steel structure high-altitude welding robot based on deep learning of the present invention, its steps are:
S1、焊接机器人上搭载深度相机拍摄图像,将拍摄的图像发送至工业计算机进行识别处理;S1. The welding robot is equipped with a depth camera to capture images, and sends the captured images to an industrial computer for identification and processing;
S2、当检测到焊缝时,控制机器人向焊缝位置移动;S2. When the weld seam is detected, the robot is controlled to move to the weld seam position;
S3、对于采集的深度图像,根据xy像素坐标值计算像素点的距离z,根据空间中的距离与相机内参计算出对应的空间坐标[u,v,z],对空间点进行拟合,获得空间中一条有方向的线段,该线段即为焊缝位置;S3. For the collected depth image, calculate the distance z of the pixel point according to the xy pixel coordinate value, and calculate the corresponding space coordinate [u, v, z] according to the distance in space and the internal parameters of the camera, and fit the space point to obtain A line segment with direction in the space, this line segment is the welding seam position;
S4、根据计算出的线段空间位置,确定该线段在激光、底盘坐标系下的相对位置,根据激光扫描进行焊缝深度识别,将从焊接起始端A到焊接停止端B的焊缝深度映射到A到B的焊缝节点上去,并计算焊头位于该节点的停留时长,保证焊缝被准确焊接;S4. According to the calculated spatial position of the line segment, determine the relative position of the line segment in the laser and chassis coordinate system, identify the weld depth according to the laser scanning, and map the weld depth from the welding start end A to the welding stop end B to Go to the weld node from A to B, and calculate the stay time of the welding head at this node to ensure that the weld is welded accurately;
S5、当机器人识别到末端处于B点处后,停止焊接工作,同时关闭激光扫描,降低焊缝检测频率,继续进行下一阶段的焊接工作。S5. When the robot recognizes that the end is at point B, stop the welding work, turn off the laser scanning at the same time, reduce the frequency of welding seam detection, and continue the next stage of welding work.
更进一步地,步骤S1所述识别采用的检测方式为深度学习,检测网络为卷积神经网络。Furthermore, the detection method adopted for the identification in step S1 is deep learning, and the detection network is a convolutional neural network.
更进一步地,步骤S2中机器人移动的位置与距离信息由深度相机检测到的图片进行粗定位,确定焊缝在焊接机器人可焊接范围后,启动精定位对焊缝位置进行检测。Furthermore, in step S2, the position and distance information of the robot's movement is roughly positioned based on the pictures detected by the depth camera, and after the weld is determined to be within the weldable range of the welding robot, fine positioning is started to detect the position of the weld.
更进一步地,步骤S2中以每秒5帧的速度将相机获取到的深度图送入卷积神经网络,结果输出位(x,y,θ,w),设定连续30帧检测到的结果中xy位置标准差小于0.003时,检测到的焊缝位置是准确的。Furthermore, in step S2, the depth map acquired by the camera is sent to the convolutional neural network at a rate of 5 frames per second, and the result output is (x, y, θ, w), and the detected results of 30 consecutive frames are set When the standard deviation of xy position is less than 0.003, the detected weld position is accurate.
更进一步地,步骤S3对焊缝进行识别的过程如下:Furthermore, the process of identifying the weld seam in step S3 is as follows:
(1)对于采集的深度图像进行裁剪,获得目标区域,并对深度无穷大的像素点使用高通滤波进行修复;(1) Crop the collected depth image to obtain the target area, and use high-pass filtering to repair the pixels with infinite depth;
(2)将修复后的深度图设定为由1和0组成的图像,其中识别到的焊缝点设置为1,其他位置区域设置为0,对检测结果设定评价函数QT;(2) Set the repaired depth map as an image composed of 1 and 0, wherein the identified weld point is set to 1, and other position areas are set to 0, and the evaluation function Q T is set for the detection results;
(3)使用深度学习网络对焊缝进行识别检测,以步骤(2)中的评价函数QT为标准,使用快速排序法对所有检测结果进行排序,每组的值都按照[u,v,θ,w]排列,使用深度信息提取模块对检测到的焊缝位置序列进行深度值的检测,根据深度值求出像素对应的空间坐标[x,y,z];(3) Use the deep learning network to identify and detect the weld, and use the evaluation function Q T in step (2) as the standard, and use the quick sort method to sort all the detection results, and the values of each group are in accordance with [u, v, θ, w] arrangement, use the depth information extraction module to detect the depth value of the detected weld position sequence, and calculate the spatial coordinates [x, y, z] corresponding to the pixel according to the depth value;
(4)根据步骤(2)和步骤(3)获取一系列带有方向的坐标位置集合,将这些点连接起来并通过非线性最小二乘法对这些点与方向进行拟合,获得空间中一条带有方向的线段,即为焊缝的实时位置。(4) Obtain a series of coordinate position sets with directions according to step (2) and step (3), connect these points and fit these points and directions by nonlinear least squares method to obtain a belt in space The line segment with direction is the real-time position of the weld.
更进一步地,所述的评价函数QT包括角度评价函数ΦT和宽度评价函数WT,角度评价函数ΦT用来找到检测角度与实际角度相差最小的检测结果,宽度评价函数WT用来找到检测焊缝宽度与实际宽度相差最小的检测结果。Furthermore, the evaluation function Q T includes an angle evaluation function Φ T and a width evaluation function W T , the angle evaluation function Φ T is used to find the detection result with the smallest difference between the detected angle and the actual angle, and the width evaluation function W T is used to Find the detection result with the smallest difference between the detected weld width and the actual width.
更进一步地,将角度评价函数ΦT与宽度评价函数WT乘上对应权重α、β并相加得到评价函数QT,评价函数QT通过线性加权和法能够挑选出角度和焊缝宽度最准确的图像。Furthermore, the angle evaluation function Φ T and the width evaluation function W T are multiplied by the corresponding weights α and β and added to obtain the evaluation function Q T . accurate image.
更进一步地,步骤S4对对焊缝进行焊接的过程如下:Further, the process of welding the weld seam in step S4 is as follows:
1)将焊缝基于相机坐标系下的位置转换到基于焊接机器人坐标系下的坐标;1) Convert the position of the weld seam based on the camera coordinate system to the coordinates based on the welding robot coordinate system;
2)根据空间坐标计算点AB连接起来的线段l的向量以及线段l的各个节点l1,l2…ln,由AB向量计算基于机器人坐标系的节点方向θ;2) According to the spatial coordinates, calculate the vector of the line segment l connected by points AB and each node l 1 , l 2 ... l n of the line segment l, and calculate the node direction θ based on the robot coordinate system from the AB vector;
3)使用激光传感器指向起点A,从A至B扫描一遍,通过激光投射到焊缝深度,将焊缝深度信息发送给传感器,从而获取焊缝实际深度d1,d2…dn,映射到每一个焊缝节点l1,l2…ln上,焊接时间t根据焊点深度进行计算,计算方式为λdx,λ由焊接速度决定;3) Use the laser sensor to point to the starting point A, scan once from A to B, project the laser to the depth of the weld, and send the weld depth information to the sensor, so as to obtain the actual depth d 1 , d 2 …d n of the weld, and map it to For each weld joint l 1 , l 2 ...l n , the welding time t is calculated according to the depth of the welding spot, the calculation method is λd x , and λ is determined by the welding speed;
4)控制三轴机械臂运动至A点,以该点为起点沿方向θ开始移动,同时开启焊机进行焊接操作,焊头移动速度根据步骤3)节点由焊接时停留所需的时间控制;4) Control the movement of the three-axis mechanical arm to point A, start moving from this point along the direction θ, and start the welding machine at the same time for welding operation, the moving speed of the welding head is controlled by the time required for the node to stay during welding according to step 3);
5)当机器人识别到焊头所在位置至B点时,熄弧停止焊接。5) When the robot recognizes that the position of the welding head reaches point B, the arc is turned off to stop welding.
更进一步地,步骤4)焊头移动过程中,使用比例积分法对焊头速度进行控制。Furthermore, in step 4) during the moving process of the welding head, the proportional integral method is used to control the speed of the welding head.
更进一步地,高空焊接机器人包括机器人底盘、焊枪、机械臂、工业计算机、深度相机、激光传感器,深度相机和激光传感器固定在机器人底盘上方,与机械臂的焊枪夹持机构固定,机器人通过以太网进行通信,通过工业计算机处理并发送识别到的焊缝位置,机器人底盘每条履带下方固定钕铁硼强磁铁。Furthermore, the high-altitude welding robot includes a robot chassis, a welding gun, a robotic arm, an industrial computer, a depth camera, and a laser sensor. The depth camera and the laser sensor are fixed above the robot chassis and fixed with the welding gun clamping mechanism of the robotic arm. For communication, the industrial computer processes and sends the identified welding seam position, and a strong NdFeB magnet is fixed under each crawler track of the robot chassis.
3.有益效果3. Beneficial effect
采用本发明提供的技术方案,与已有的公知技术相比,具有如下显著效果:Compared with the existing known technology, the technical solution provided by the invention has the following remarkable effects:
本发明通过先定位、后测量、再焊接的方式对高空钢梁裂纹进行自动焊接。可以通过完全无人陪同的情况下全自动对焊缝进行识别与焊接,大量节约了人力与时间成本,同时减少人工操作所带来的误差。相比于现有机械臂自动焊接技术,不仅能够对任意焊缝进行焊接工作,同时可以向下兼容设计可编程焊接;同时本发明融合了激光与图像技术,使得焊接定位更为精确,焊接效果更好。The invention automatically welds the cracks of high-altitude steel beams by first positioning, then measuring, and then welding. The welding seam can be fully automatically identified and welded without being accompanied by anyone, which saves a lot of manpower and time costs, and reduces errors caused by manual operations. Compared with the existing robotic arm automatic welding technology, it can not only weld any welding seam, but also can be backward compatible with the design of programmable welding; at the same time, the invention combines laser and image technology to make the welding positioning more accurate and the welding effect better. better.
附图说明Description of drawings
图1为本发明焊接机器人整体结构示意图。Fig. 1 is a schematic diagram of the overall structure of the welding robot of the present invention.
图2为焊缝示意图。Figure 2 is a schematic diagram of the weld seam.
示意图中的标号说明:Explanation of the labels in the schematic diagram:
1、Z轴导轨;2、焊枪夹持机构;3、机器人底盘;4、Y轴导轨电机;5、X轴导轨电机;6、Z轴导轨电机;7、Z轴导轨平台;8、Y轴导轨平台;9、深度相机。1. Z-axis guide rail; 2. Welding torch clamping mechanism; 3. Robot chassis; 4. Y-axis guide rail motor; 5. X-axis guide rail motor; 6. Z-axis guide rail motor; 7. Z-axis guide rail platform; 8. Y-axis Rail platform; 9. Depth camera.
具体实施方式Detailed ways
为了使得本发明功能、特征和优点更加通俗易懂,下面结合说明书附图为本发明介绍具体的实施例说明,显然所描述的是本发明的一部分实施例,但不是全部的实施例。基于本发明中的实施例,本领域普通人员在没有做出创造性劳动前提下所获得的所有其他实施例,都应当属于本发明的保护范围。In order to make the functions, features and advantages of the present invention more comprehensible, the following describes specific embodiments of the present invention in conjunction with the accompanying drawings. Apparently, what is described is a part of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by ordinary persons in the art without making creative efforts shall belong to the protection scope of the present invention.
在下面的描述中阐述了很多具体细节以便于充分理解本发明,但是本发明还可以采用其他不同于在此描述的其它方式来实施,本领域技术人员可以在不违背本发明内涵的情况下做类似推广,因此本发明不受下面公开的具体实施例的限制。本发明所针对的三轴坐标方向是以机器人朝向为X正方向,以机器人运动平面为基准,以X轴方向逆时针旋转90°为Y轴正方向,与XY方向垂直向上的方向为Z轴正方向。In the following description, a lot of specific details are set forth in order to fully understand the present invention, but the present invention can also be implemented in other ways different from those described here, and those skilled in the art can do it without departing from the meaning of the present invention. By analogy, the present invention is therefore not limited to the specific examples disclosed below. The three-axis coordinate direction targeted by the present invention is the positive direction of the robot in the direction of the robot, and the robot motion plane as the reference, and the positive direction of the Y axis rotated 90° counterclockwise in the direction of the X axis is the positive direction of the Y axis, and the direction perpendicular to the XY direction is the Z axis. Positive direction.
参见图1,本发明搭建了一个全自动高空钢梁焊接机器人,包括机器人底盘3、焊枪、三自由度龙门式机械臂、工业计算机、深度相机、激光传感器。其中三自由度龙门式机械臂的Z轴导轨1与Z轴导轨电机6带动Z轴导轨平台7在Z轴方向上移动,焊枪夹持机构2设置在Z轴导轨平台7上,Y轴导轨与Y轴导轨电机4带动Y轴导轨平台8在Y轴方向上移动,Z轴导轨1设置在Y轴导轨平台8上,X轴导轨与X轴导轨电机5带动Z轴导轨1、焊枪夹持机构2与Y轴导轨在X轴方向上运动。电机均采用伺服电机对各个轴关节进行运动控制,实现焊枪能够在多方向上自由移动、整体焊接机构通过机器人底盘3带动,控制整体焊接机器人实现运动。深度相机9进行图像采集,将采集信息传递给机械臂。深度相机9与激光传感器固定在机器人底盘3上方,与机械臂的焊枪夹持机构2固定,深度相机9的深度测量精度为10mm,激光传感器的精度为0.01mm,机械臂焊接精度可以达到1mm。机器人通过TCP/IP以太网进行通信,通过其中的计算机来处理并发送识别到的焊缝位置,控制机械臂带动焊机进行焊接工作。焊接机器人可自动在钢梁上进行反复运动,焊接机器人底盘每条履带下方固定40mm*20mm*20mm的钕铁硼强磁铁,保证焊接机器人可以吸附在钢梁上。Referring to FIG. 1 , the present invention builds a fully automatic high-altitude steel beam welding robot, including a
本发明所涉及到的高空钢梁焊缝的检测与焊接方法包括焊缝识别、定位、路径识别、机械臂路径规划等步骤,整个识别与焊接过程为机器人全自动化运行。具体过程如下:The detection and welding method of high-altitude steel girder welds involved in the present invention includes steps such as weld identification, positioning, path identification, and robot arm path planning. The entire identification and welding process is fully automated by robots. The specific process is as follows:
以图2所示焊缝为例,设定焊缝一端为A点,另外一端为B点。焊接机器人上搭载的深度相机,保持开启状态,并且每0.5s将拍摄到的图像发送至计算机进行识别处理,图片大小为640*480,帧率为30fps。将每一帧图像保存出来作为检测输入端,使用从1开始的序列号保存图片。识别所采用的检测方式为深度学习,检测网络为卷积神经网络,该网络主要由卷积层、池化层、非线性激活层经过合成而来,使用预先训练好的模型进行检测时,可以达到99.5%的焊缝检测率。Taking the weld shown in Figure 2 as an example, set one end of the weld as point A and the other end as point B. The depth camera mounted on the welding robot is kept turned on, and the captured image is sent to the computer for recognition and processing every 0.5s. The image size is 640*480 and the frame rate is 30fps. Save each frame of image as the detection input, and use the serial number starting from 1 to save the picture. The detection method used for recognition is deep learning, and the detection network is a convolutional neural network, which is mainly composed of convolutional layers, pooling layers, and nonlinear activation layers. When using a pre-trained model for detection, it can Reach 99.5% weld detection rate.
当检测到焊缝时,控制机器人向焊缝位置移动,此时可以通过控制履带式底盘通过差速进行转速,当需要进行向左偏移时,控制左轮电机向前转动,右轮电机向后转动;当检测到焊缝在右侧时,需要控制机器人右前方移动,此时控制左轮电机向后转动,右轮电机向前转动;当检测焊缝处于机器人正前方时,则控制机器人左右电机同时向后转动即可。When the welding seam is detected, the robot is controlled to move to the welding seam position. At this time, the crawler chassis can be controlled to rotate through the differential speed. When it is necessary to shift to the left, the left wheel motor is controlled to rotate forward, and the right wheel motor is turned backward. Rotation; when the weld seam is detected to be on the right side, it is necessary to control the robot to move to the right front. At this time, the left wheel motor is controlled to rotate backward, and the right wheel motor is rotated forward; when the detected weld seam is in front of the robot, control the left and right motors of the robot Simultaneously turn backwards.
控制机器人移动到焊缝位置距离40cm处,此位置与距离信息可以由深度相机检测到的图片进行粗定位。确定焊缝在焊接机器人可焊接范围后,启动精定位对焊缝位置进行检测,此时需要稳定机器人底盘。以每秒5帧的速度将相机获取到的深度图送入抓取神经网络,结果输出(x,y,θ,w),如果连续30帧检测到的结果的xy位置标准差小于0.003时,认为检测到的焊缝位置是准确的。Control the robot to move to a distance of 40cm from the welding seam, and the position and distance information can be roughly positioned by the pictures detected by the depth camera. After confirming that the weld seam is within the weldable range of the welding robot, start fine positioning to detect the weld seam position. At this time, the robot chassis needs to be stabilized. Send the depth map acquired by the camera to the grasping neural network at a speed of 5 frames per second, and the result is output (x, y, θ, w). If the xy position standard deviation of the detected results for 30 consecutive frames is less than 0.003, The detected weld position is considered to be accurate.
根据小孔成像原理计算检测到的序列点值的具体空间位置,具体操作是根据xy像素坐标值计算该点的距离z,根据空间中的距离与相机内参计算出对应的空间坐标[u,v,z]。根据非线性优化方式对这些空间点进行拟合,结果为空间中一条有方向的线段,这条线段就可以视作焊缝位置。Calculate the specific spatial position of the detected sequence point value according to the principle of pinhole imaging. The specific operation is to calculate the distance z of the point according to the xy pixel coordinate value, and calculate the corresponding spatial coordinate [u, v according to the distance in space and the camera internal parameters. ,z]. Fit these space points according to the nonlinear optimization method, and the result is a directional line segment in space, which can be regarded as the weld position.
根据计算出的线段空间位置,同时根据已知的相机与激光、机器人底盘的坐标关系确定该线段在激光、底盘坐标系下的相对位置。选择检测到的靠近机器人的焊缝一端A作为焊接起始端,距离较远的一端B作为焊接停止端。根据激光扫描进行焊缝深度识别,将从A到B的焊缝深度映射到A到B的焊缝节点上去,根据公式λdx计算焊头位于该节点停留时长,保证焊缝均可被正确焊接起来。According to the calculated spatial position of the line segment, and at the same time, determine the relative position of the line segment in the laser and chassis coordinate system according to the known coordinate relationship between the camera, the laser and the robot chassis. Select the detected end A of the welding seam close to the robot as the welding start end, and the far end B as the welding stop end. Weld depth identification based on laser scanning, mapping the weld depth from A to B to the weld node from A to B, and calculating the length of stay of the welding head at this node according to the formula λd x to ensure that the weld can be welded correctly stand up.
当机械臂识别到末端处于B点处后,停止焊接工作,此时计算机通过控制焊头熄弧操作,同时将机械臂向Z轴升高5cm,并且将XY轴进行归位操作。同时关闭激光扫描,降低焊缝检测频率,继续进行下一阶段的焊接工作。When the mechanical arm recognizes that the end is at point B, the welding work is stopped. At this time, the computer controls the arc extinguishing operation of the welding head, and at the same time raises the mechanical arm to the Z axis by 5cm, and returns the XY axis to the original position. At the same time, laser scanning is turned off, the frequency of weld detection is reduced, and the welding work of the next stage is continued.
下文将结合实施例1对本发明进行焊缝识别的图像处理过程进行具体描述,并结合实施例2对本发明的焊接过程进行具体描述。The image processing process of the present invention for weld seam recognition will be described in detail below in conjunction with Embodiment 1, and the welding process of the present invention will be described in detail in conjunction with
实施例1Example 1
本实施例的进行焊缝识别图像处理过程如下:The process of image processing for weld seam recognition in this embodiment is as follows:
步骤1:使用深度相机进行图像采集,使用焊接机器人中的上位机对采集到的图片进行处理,将获取到每帧图像裁剪为300*300大小正方形目标区域。其中为保证获取到的稀疏图具有距离可测性,对深度无穷大的像素点使用高通滤波进行修复,将修复好的稠密图像进行保存。Step 1: Use the depth camera to collect images, use the host computer in the welding robot to process the collected images, and cut each frame of the image into a 300*300 square target area. Among them, in order to ensure that the obtained sparse image has distance measurability, high-pass filtering is used to repair the pixels with infinite depth, and the repaired dense image is saved.
步骤2:将修复后的深度图设定为由1和0组成的图像,其中将识别到的焊缝点设置为1,其他位置区域设置为0。对检测结果设定评价函数QT,将其分为角度评价函数ΦT、宽度评价函数WT,将角度评价函数ΦT与宽度评价函数WT乘上对应权重α、β并相加得到最终评价函数QT。角度评价函数ΦT用来找到检测角度与实际角度相差最小的检测结果,即评价在[-π/2,π/2]范围内,检测角度结果与实际角度的差值,使用网络学习分布与评价对应值,结果应该分布在[-π/2,π/2]上。宽度评价函数则是用来找到检测焊缝宽度与实际宽度相差最小的检测结果,同时将结果映射到0-1范围上去。最后评价函数为QT=αΦT+βWT,根据各个图像的评价函数得出最准确的焊缝宽度和角度。Step 2: Set the repaired depth map as an image composed of 1 and 0, where the identified weld points are set to 1, and other position areas are set to 0. Set the evaluation function Q T for the detection results, divide it into angle evaluation function Φ T and width evaluation function W T , multiply the angle evaluation function Φ T and width evaluation function W T by the corresponding weights α, β and add them to obtain the final Evaluation function Q T . The angle evaluation function Φ T is used to find the detection result with the smallest difference between the detection angle and the actual angle, that is, the evaluation is within the range of [-π/2,π/2], the difference between the detection angle result and the actual angle, using the network learning distribution and Evaluate the corresponding value, the result should be distributed on [-π/2,π/2]. The width evaluation function is used to find the detection result with the smallest difference between the detected weld width and the actual width, and at the same time map the result to the range of 0-1. The final evaluation function is Q T =αΦ T+ βW T , and the most accurate weld width and angle can be obtained according to the evaluation function of each image.
步骤3:使用深度学习网络对焊缝进行识别检测,从步骤2得出各个图像的焊缝宽度和角度与实际值的差值,以该差值为标准,使用快速排序方法对所有检测结果进行排序,每组的值都是按照[u,v,θ,w]排列的数据,分别代表焊缝位置在图像中的宽、高像素值,偏转角,焊缝宽度。Step 3: Use the deep learning network to identify and detect the weld seam, and obtain the difference between the width and angle of the weld seam of each image and the actual value from
使用计算机视觉库中的深度信息提取模块对检测到的焊缝位置序列进行深度值的检测,根据深度值求出像素对应的空间坐标[x,y,z],具体做法是将深度值z,添加到对应像素值[u,v]中,使用Eigen定义相机内参为一个二维数组K,具体参数为[[fx,0,cx],[0,fy,cy],[0,0,1]],根据小孔成像原理计算出x值为((u-cx)*z/fx),y值为((v-cy)*z/fy),z值就是计算出的深度值。Use the depth information extraction module in the computer vision library to detect the depth value of the detected weld position sequence, and calculate the spatial coordinates [x, y, z] corresponding to the pixel according to the depth value. The specific method is to convert the depth value z, Add to the corresponding pixel value [u, v], use Eigen to define the camera internal parameter as a two-dimensional array K, the specific parameters are [[f x ,0,c x ],[0,f y ,c y ],[0 ,0,1]], according to the principle of pinhole imaging, the x value is calculated ((uc x )*z/f x ), the y value is ((vc y )*z/f y ), and the z value is calculated depth value.
步骤4:根据步骤2和步骤3可以获取到一系列带有方向的坐标位置集合,并且每一点都存在一定的宽度,即相当于一个带有宽度的点。将这些点连接起来并通过Ceres库的非线性最小二乘法对这些点与方向进行拟合,结果为空间中一条带有方向的线段,线段上的每一点都有一定宽度对应实际焊缝宽度。这样就可以对获取的坐标位置集合中的任意坐标进行检测,检测的结果基本可以作为实际值进行输出,这样就可以获取到焊缝的实时位置。Step 4: According to
实施例2Example 2
本实施例利用焊接机器人对焊缝进行自动焊接的过程如下:In this embodiment, the process of using a welding robot to automatically weld the weld seam is as follows:
步骤1:选择检测到的焊缝线段中靠近机器人一端作为起点A,远离机器人一端作为终点B,将焊缝基于相机坐标系下的位置转换到基于焊接机器人坐标系下的坐标。测量相机与机器人基座的相对位置T1,焊缝位于相机坐标系下的相对位置为T2,根据刚体空间坐标转换关系得出焊缝基于机器人坐标系下的位置为T3=T1*T2,其中T3为一个4*4的转换矩阵,是由3*3的旋转矩阵与3*1的平移矩阵结合而来的。这样就实现了焊缝位置转换成基于机器人坐标系下的坐标。Step 1: Select the end of the detected weld line segment close to the robot as the starting point A, and the end far away from the robot as the end point B, and convert the position of the weld based on the camera coordinate system to the coordinates based on the welding robot coordinate system. Measure the relative position T 1 of the camera and the robot base, the relative position of the weld in the camera coordinate system is T 2 , and the position of the weld in the robot coordinate system is T 3 = T 1 * according to the transformation relationship of the rigid body space coordinates T 2 , wherein T 3 is a 4*4 transformation matrix, which is obtained by combining a 3*3 rotation matrix and a 3*1 translation matrix. In this way, the position of the welding seam is transformed into coordinates based on the robot coordinate system.
步骤2:设定步骤1中的起点为A,终点为B,根据其空间坐标计算点AB连接起来的线段l的向量,线段l的各个节点为l1,l2…ln,由AB向量计算基于机器人坐标系的节点方向θ=(r,p,y),将焊缝表示为以A为起点,B为终点,方向为θ的一条有向线段,当焊接到B点时即可熄弧操作停止焊接。Step 2: Set the starting point in step 1 as A and the end point as B, and calculate the vector of the line segment l connected by the points AB according to its space coordinates, each node of the line segment l is l 1 , l 2 ...l n , from the AB vector The calculation is based on the node direction θ=(r,p,y) of the robot coordinate system, and the weld is expressed as a directed line segment with A as the starting point, B as the end point, and the direction as θ. When welding to point B, it can be turned off. Arc operation stops welding.
步骤3:使用机械臂上的激光传感器指向步骤2计算好的起点A,从A至B扫描一遍,通过激光投射到焊缝深度,将焊缝深度信息发送给传感器,从而获取焊缝实际深度d1,d2…dn,映射到每一个焊缝节点l1,l2…ln上,焊接时间t需要根据焊点深度进行计算,计算方式为λdx,λ由焊接速度决定。Step 3: Use the laser sensor on the robotic arm to point to the starting point A calculated in
步骤4:控制三轴机械臂运动至距离A点高度8.5mm位置处,以该点为起点沿方向θ开始进行移动,同时开启焊机进行焊接操作,焊头移动速度根据步骤3节点由焊接时停留所需的时间控制;同时,为防止焊头不断的瞬时加减速损坏焊机,使用比例积分法对焊头速度进行控制以保证焊头以平滑的变速运动进行运动。Step 4: Control the movement of the three-axis mechanical arm to a position 8.5mm from point A, start moving from this point along the direction θ, and start the welding machine at the same time to perform welding operations. The moving speed of the welding head is determined according to the node in
步骤5:当机器人识别到焊头所在位置为距B点上方高度8.5mm处,熄弧停止焊接。升高焊头位置,同时将机械臂XY轴位置处移动到中心初始位置,完成焊接。Step 5: When the robot recognizes that the position of the welding head is at a height of 8.5mm above point B, the arc is turned off to stop welding. Raise the position of the welding head, and at the same time move the position of the XY axis of the robot arm to the initial position of the center to complete the welding.
步骤6:当机械臂焊接完成以后,重新进行焊缝识别与定位,以保证机器人可对剩余焊缝进行自动焊接。Step 6: After the welding of the robot arm is completed, the welding seam identification and positioning are performed again to ensure that the robot can automatically weld the remaining welding seams.
本发明可以在完全无人陪同的情况下全自动对焊缝进行识别与焊接,节约了人力与时间成本,同时减少人工操作所带来的误差。相比于现有机械臂自动焊接技术,本发明融合了激光与图像技术,使得焊接定位更为精确,焊接效果更好。The present invention can fully automatically identify and weld the welding seam without being accompanied by anyone, saving manpower and time costs, and simultaneously reducing errors caused by manual operations. Compared with the existing robotic arm automatic welding technology, the present invention combines laser and image technology to make welding positioning more accurate and welding effect better.
Claims (10)
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310282342.6A CN116175035B (en) | 2023-03-20 | 2023-03-20 | Intelligent welding method for steel structure high-altitude welding robot based on deep learning |
| PCT/CN2023/133211 WO2024193077A1 (en) | 2023-03-20 | 2023-11-22 | Deep-learning-based intelligent welding method for high-altitude steel structure welding robot |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310282342.6A CN116175035B (en) | 2023-03-20 | 2023-03-20 | Intelligent welding method for steel structure high-altitude welding robot based on deep learning |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116175035A true CN116175035A (en) | 2023-05-30 |
| CN116175035B CN116175035B (en) | 2023-08-04 |
Family
ID=86438552
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310282342.6A Active CN116175035B (en) | 2023-03-20 | 2023-03-20 | Intelligent welding method for steel structure high-altitude welding robot based on deep learning |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN116175035B (en) |
| WO (1) | WO2024193077A1 (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116587288A (en) * | 2023-07-04 | 2023-08-15 | 广州东焊智能装备有限公司 | A welding robot vision control system based on deep learning |
| CN117001233A (en) * | 2023-07-10 | 2023-11-07 | 湖北炬峰智能装备有限公司 | Welding method, device, medium and equipment |
| WO2024193077A1 (en) * | 2023-03-20 | 2024-09-26 | 中国十七冶集团有限公司 | Deep-learning-based intelligent welding method for high-altitude steel structure welding robot |
| CN119187868A (en) * | 2024-11-05 | 2024-12-27 | 卢米纳科技(深圳)有限公司 | Laser welding method and equipment |
| CN119444842A (en) * | 2024-10-31 | 2025-02-14 | 中国十七冶集团有限公司 | A method for positioning and driving a ladle car for converter installation based on multi-source data fusion |
| CN120839372A (en) * | 2025-09-23 | 2025-10-28 | 江苏钰程钛和新材料科技有限公司 | Steel pipe welding positioning and correction method based on laser ranging |
| CN121245860A (en) * | 2025-12-05 | 2026-01-02 | 东北大学 | Intelligent guiding welding system and method for welding seam based on deep learning |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN119397787A (en) * | 2024-10-25 | 2025-02-07 | 中国核工业二三建设有限公司 | A visual analysis method and device for automatic welding collision of pipelines based on BIM |
| CN119356271B (en) * | 2024-12-26 | 2025-03-14 | 太原大船科技股份有限公司 | Global digital quality monitoring and management system, method and medium |
| CN120107160B (en) * | 2025-01-21 | 2025-08-05 | 西南交通大学 | A high-precision identification method for inter-layer gaps in ballastless track |
| CN119681913B (en) * | 2025-02-26 | 2025-06-10 | 中国人民解放军总医院 | Unmanned mechanical arm motion path generation method and device based on B spline curve |
| CN120447541B (en) * | 2025-04-15 | 2025-12-09 | 东莞市安圣工业智能科技有限公司 | Intelligent robot control method for polishing and rust removal of steel body weld joints |
| CN120363205B (en) * | 2025-06-05 | 2026-01-16 | 佛山捷米奈管理咨询合伙企业(有限合伙) | Welding path planning method, computer program product and system for automobile welding production line |
| CN120516141B (en) * | 2025-06-21 | 2025-11-21 | 河北恒益诚舞台设备有限公司 | A portable intelligent welding robot for seat production |
| CN120438761B (en) * | 2025-07-11 | 2025-10-28 | 湖南华韧钢结构工程有限公司 | Intelligent control system based on steel column installation, calibration and welding all-in-one machine |
| CN120510220B (en) * | 2025-07-18 | 2025-09-30 | 浙江大学 | Adaptive B-spline curve fitting method for weld seams based on 3D dense random point sets |
| CN121235969A (en) * | 2025-11-28 | 2025-12-30 | 宝鸡市聚和机械制造有限公司 | Automatic generation method of robot welding track |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106425181A (en) * | 2016-10-24 | 2017-02-22 | 南京工业大学 | Curve weld joint welding technology based on line structured light |
| CN107020449A (en) * | 2017-04-26 | 2017-08-08 | 苏州睿牛机器人技术有限公司 | Weld seam tracking sensor and its welding seam tracking method |
| DE102019209100A1 (en) * | 2019-06-24 | 2020-12-24 | Robert Bosch Gmbh | Quality monitoring for a laser beam welding process |
| CN113070612A (en) * | 2021-04-01 | 2021-07-06 | 温州科技职业学院 | Welding robot for automatic automobile assembly line |
| CN113666028A (en) * | 2021-07-27 | 2021-11-19 | 南京航空航天大学 | Garbage can detecting and grabbing method based on fusion of laser radar and camera |
| CN113954085A (en) * | 2021-09-08 | 2022-01-21 | 重庆大学 | Intelligent positioning and control method of welding robot based on binocular vision and linear laser sensing data fusion |
| CN114140439A (en) * | 2021-12-03 | 2022-03-04 | 厦门大学 | Method and device for feature point recognition of laser welding seam based on deep learning |
| CN114266974A (en) * | 2021-12-23 | 2022-04-01 | 福州大学 | Automatic positioning welding method based on deep learning |
| CN115018813A (en) * | 2022-06-30 | 2022-09-06 | 哈尔滨工业大学(威海) | A method for autonomous identification and precise positioning of welding seam by robot |
| CN115213563A (en) * | 2022-09-20 | 2022-10-21 | 扬州耐施工程机械有限公司 | Laser intelligent welding method and system |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109226967B (en) * | 2018-07-25 | 2021-03-09 | 同高先进制造科技(太仓)有限公司 | Active laser vision steady weld joint tracking system for laser-arc hybrid welding |
| CN109175608B (en) * | 2018-09-30 | 2023-06-20 | 华南理工大学 | On-line measurement method of welding seam feature point position and automatic measurement system of welding seam track |
| CN110524580B (en) * | 2019-09-16 | 2023-06-02 | 西安中科光电精密工程有限公司 | A welding robot vision component and its measurement method |
| CN113920060A (en) * | 2021-09-09 | 2022-01-11 | 中国科学院自动化研究所 | Welding robot autonomous operation method, device, electronic device and storage medium |
| CN115041887A (en) * | 2022-04-24 | 2022-09-13 | 重庆创御智能装备有限公司 | Contour measuring and recognizing system for robot welding workpiece |
| CN116175035B (en) * | 2023-03-20 | 2023-08-04 | 中国十七冶集团有限公司 | Intelligent welding method for steel structure high-altitude welding robot based on deep learning |
-
2023
- 2023-03-20 CN CN202310282342.6A patent/CN116175035B/en active Active
- 2023-11-22 WO PCT/CN2023/133211 patent/WO2024193077A1/en not_active Ceased
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106425181A (en) * | 2016-10-24 | 2017-02-22 | 南京工业大学 | Curve weld joint welding technology based on line structured light |
| CN107020449A (en) * | 2017-04-26 | 2017-08-08 | 苏州睿牛机器人技术有限公司 | Weld seam tracking sensor and its welding seam tracking method |
| DE102019209100A1 (en) * | 2019-06-24 | 2020-12-24 | Robert Bosch Gmbh | Quality monitoring for a laser beam welding process |
| CN113070612A (en) * | 2021-04-01 | 2021-07-06 | 温州科技职业学院 | Welding robot for automatic automobile assembly line |
| CN113666028A (en) * | 2021-07-27 | 2021-11-19 | 南京航空航天大学 | Garbage can detecting and grabbing method based on fusion of laser radar and camera |
| CN113954085A (en) * | 2021-09-08 | 2022-01-21 | 重庆大学 | Intelligent positioning and control method of welding robot based on binocular vision and linear laser sensing data fusion |
| CN114140439A (en) * | 2021-12-03 | 2022-03-04 | 厦门大学 | Method and device for feature point recognition of laser welding seam based on deep learning |
| CN114266974A (en) * | 2021-12-23 | 2022-04-01 | 福州大学 | Automatic positioning welding method based on deep learning |
| CN115018813A (en) * | 2022-06-30 | 2022-09-06 | 哈尔滨工业大学(威海) | A method for autonomous identification and precise positioning of welding seam by robot |
| CN115213563A (en) * | 2022-09-20 | 2022-10-21 | 扬州耐施工程机械有限公司 | Laser intelligent welding method and system |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024193077A1 (en) * | 2023-03-20 | 2024-09-26 | 中国十七冶集团有限公司 | Deep-learning-based intelligent welding method for high-altitude steel structure welding robot |
| CN116587288A (en) * | 2023-07-04 | 2023-08-15 | 广州东焊智能装备有限公司 | A welding robot vision control system based on deep learning |
| CN116587288B (en) * | 2023-07-04 | 2025-12-12 | 广州东焊智能装备有限公司 | A Deep Learning-Based Vision Control System for Welding Robots |
| CN117001233A (en) * | 2023-07-10 | 2023-11-07 | 湖北炬峰智能装备有限公司 | Welding method, device, medium and equipment |
| CN119444842A (en) * | 2024-10-31 | 2025-02-14 | 中国十七冶集团有限公司 | A method for positioning and driving a ladle car for converter installation based on multi-source data fusion |
| CN119444842B (en) * | 2024-10-31 | 2025-08-15 | 中国十七冶集团有限公司 | Positioning driving method for converter installation ladle car with multi-source data fusion |
| CN119187868A (en) * | 2024-11-05 | 2024-12-27 | 卢米纳科技(深圳)有限公司 | Laser welding method and equipment |
| CN120839372A (en) * | 2025-09-23 | 2025-10-28 | 江苏钰程钛和新材料科技有限公司 | Steel pipe welding positioning and correction method based on laser ranging |
| CN121245860A (en) * | 2025-12-05 | 2026-01-02 | 东北大学 | Intelligent guiding welding system and method for welding seam based on deep learning |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116175035B (en) | 2023-08-04 |
| WO2024193077A1 (en) | 2024-09-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN116175035B (en) | Intelligent welding method for steel structure high-altitude welding robot based on deep learning | |
| CN112059363B (en) | Unmanned wall climbing welding robot based on vision measurement and welding method thereof | |
| Geng et al. | A novel seam extraction and path planning method for robotic welding of medium-thickness plate structural parts based on 3D vision | |
| CN112847353B (en) | Multi-segment welding seam track correction method based on offline programming software | |
| CN206263418U (en) | A kind of real-time seam tracking system of six degree of freedom welding robot line laser | |
| CN114378827B (en) | Dynamic target tracking and grabbing method based on overall control of mobile mechanical arm | |
| CN106392267B (en) | A kind of real-time welding seam tracking method of six degree of freedom welding robot line laser | |
| CN110102855A (en) | A kind of robot automtion welding system, device and method | |
| CN114474041A (en) | Welding automation intelligent guiding method and system based on cooperative robot | |
| CN113634964A (en) | Gantry type robot welding equipment and welding process for large-sized component | |
| CN112958959A (en) | Automatic welding and detection method based on three-dimensional vision | |
| CN105562973A (en) | Eight-axis robot space curve welding system and method for recognizing welding line by means of lasers | |
| CN110524582A (en) | A kind of flexibility welding robot workstation | |
| Liu et al. | Welding seam recognition and tracking for a novel mobile welding robot based on multi-layer sensing strategy | |
| Zhou et al. | Autonomous acquisition of seam coordinates for arc welding robot based on visual servoing | |
| CN117047237B (en) | Intelligent flexible welding system and method for special-shaped parts | |
| Geng et al. | A method of welding path planning of steel mesh based on point cloud for welding robot | |
| CN117885096B (en) | Method and device for controlling welding operation of robot tail end welding gun | |
| JP3191563B2 (en) | Automatic correction method for offline teaching data | |
| CN118357649B (en) | Automatic intelligent welding system of correction | |
| CN117300464A (en) | A system and method for intersecting line weld detection and trajectory optimization based on structured light camera | |
| Liu et al. | A novel robot welding path planning system for medium-thick plate based on 3D visual perception | |
| CN119681912B (en) | Multimodal perception system of collaborative robots based on digital control | |
| CN117300463A (en) | An integrated control method for welding manipulators in narrow underwater spaces | |
| CN113681133B (en) | Intelligent welding method of redundant degree of freedom robot with vision |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20230530 Assignee: Shanghai Jiading MCC Construction Co.,Ltd. Assignor: CHINA MCC17 GROUP Co.,Ltd. Contract record no.: X2023980053967 Denomination of invention: An Intelligent Welding Method for Steel Structure High Altitude Welding Robot Based on Deep Learning Granted publication date: 20230804 License type: Common License Record date: 20231229 Application publication date: 20230530 Assignee: Wuhu Jinjiang Ruijing Real Estate Co.,Ltd. Assignor: CHINA MCC17 GROUP Co.,Ltd. Contract record no.: X2023980053894 Denomination of invention: An Intelligent Welding Method for Steel Structure High Altitude Welding Robot Based on Deep Learning Granted publication date: 20230804 License type: Common License Record date: 20231229 |
|
| EE01 | Entry into force of recordation of patent licensing contract | ||
| OL01 | Intention to license declared | ||
| OL01 | Intention to license declared |