[go: up one dir, main page]

CN115723133B - A robot space weld automatic positioning and correction system based on virtual and real combination - Google Patents

A robot space weld automatic positioning and correction system based on virtual and real combination Download PDF

Info

Publication number
CN115723133B
CN115723133B CN202211465006.7A CN202211465006A CN115723133B CN 115723133 B CN115723133 B CN 115723133B CN 202211465006 A CN202211465006 A CN 202211465006A CN 115723133 B CN115723133 B CN 115723133B
Authority
CN
China
Prior art keywords
welding
track
weld
welding robot
space
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202211465006.7A
Other languages
Chinese (zh)
Other versions
CN115723133A (en
Inventor
李明富
朱凌枫
王飞鸿
谭雅斌
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xiangtan University
Original Assignee
Xiangtan University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xiangtan University filed Critical Xiangtan University
Priority to CN202211465006.7A priority Critical patent/CN115723133B/en
Publication of CN115723133A publication Critical patent/CN115723133A/en
Application granted granted Critical
Publication of CN115723133B publication Critical patent/CN115723133B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Manipulator (AREA)
  • Numerical Control (AREA)

Abstract

本发明属于智能制造技术领域,公开了一种基于虚拟模型和实际视觉相结合来控制机器人实现自动焊接的空间焊缝自动定位与纠偏系统,可以实现空间复杂焊缝的自动跟踪定位和焊接。系统包括虚拟环境、焊接机器人、空间焊缝光学跟踪和视觉识别模块、运动轨迹生成模块、自动定位与插值拟合模块、实时轨迹纠偏与控制模块;在虚拟环境中以相对位姿导入待焊接工件、工作台、焊接机器人及焊接工具的三维模型,用户基于虚拟环境,对其中的三维模型定义需要焊接的空间焊缝。运动轨迹生成模块基于用户定义的空间焊缝自动生成焊接机器人运动轨迹,焊接机器人末端空间焊缝光学跟踪和视觉识别模块获得实时焊缝信息,通过自动定位与插值拟合模块获得空间焊缝定位轨迹,实时轨迹纠偏与控制模块实时纠正焊接机器人运动轨迹。采用本发明能够在虚拟环境中导入不同模型生成二维焊缝或三维焊缝,适用于各种焊接工件和不同焊接环境,只需用户在虚拟环境中定义需要焊接的空间焊缝,焊接机器人便能沿着用户定义的焊缝开始焊接,并且自动定位焊缝轨迹和实时纠偏,拥有适用性广、操作简便、焊接精度高的优点。The present invention belongs to the field of intelligent manufacturing technology, and discloses a spatial weld automatic positioning and correction system based on a combination of virtual model and actual vision to control a robot to realize automatic welding, which can realize automatic tracking, positioning and welding of complex spatial welds. The system includes a virtual environment, a welding robot, a spatial weld optical tracking and visual recognition module, a motion trajectory generation module, an automatic positioning and interpolation fitting module, and a real-time trajectory correction and control module; a three-dimensional model of a workpiece to be welded, a workbench, a welding robot and a welding tool is imported in a relative posture in the virtual environment, and the user defines the spatial weld to be welded for the three-dimensional model based on the virtual environment. The motion trajectory generation module automatically generates the motion trajectory of the welding robot based on the spatial weld defined by the user, the spatial weld optical tracking and visual recognition module at the end of the welding robot obtains real-time weld information, the spatial weld positioning trajectory is obtained through the automatic positioning and interpolation fitting module, and the real-time trajectory correction and control module corrects the motion trajectory of the welding robot in real time. The present invention can import different models in a virtual environment to generate two-dimensional or three-dimensional welds, which is suitable for various welding workpieces and different welding environments. The user only needs to define the spatial weld to be welded in the virtual environment, and the welding robot can start welding along the user-defined weld, and automatically locate the weld trajectory and correct the deviation in real time. It has the advantages of wide applicability, simple operation and high welding precision.

Description

一种基于虚实结合的机器人空间焊缝自动定位与纠偏系统A robot space weld automatic positioning and correction system based on virtual and real combination

技术领域Technical Field

本发明属于智能制造技术和机器人自动焊接技术领域自动焊接,特别涉及一种基于虚实结合的机器人空间焊缝自动定位与纠偏系统。The present invention belongs to the field of intelligent manufacturing technology and robot automatic welding technology, and particularly relates to a robot space weld automatic positioning and deviation correction system based on virtual-real combination.

背景技术Background technique

在焊接工程领域,存在着各种类型的焊接工件和各种焊接环境,人工焊接的劳动强度大、效率低,且质量难以保证,传统的焊接机器人采用示教编程的控制方式工作,这种控制方式费时费力,效率不高,而且对操作人员的要求较高,且焊接精度完全依靠示教者经验。离线编程技术可较好地解决焊接机器人在示教编程方式中存在的问题,但在焊接过程中会产生焊接应力和焊接变形,导致工件变形,因此对于路径较长的复杂空间曲线焊缝,离线编程结果与实际焊缝轨迹存在一定偏差。采用纠偏技术实时纠正焊接机器人的运动轨迹可较好地解决离线编程方式中存在的问题,目前市面上的焊接机器人大多通过线结构扫描元件来实时纠偏,通过获取焊缝的深度信息,实时纠正焊接机器人运动轨迹,发送给焊接机器人,将焊接机器人的末端执行器运动到焊接起始点,自动完成焊接工作,大多只适用于平面焊缝,且焊缝识别的准确率与识别精度直接影响焊接的精度。因此设计一种适用于各种焊接工件、各种焊接环境,尤其是三维复杂焊缝的的空间焊缝自动定位与纠偏系统很有必要。In the field of welding engineering, there are various types of welding workpieces and various welding environments. Manual welding has high labor intensity, low efficiency, and difficult to ensure quality. Traditional welding robots work in a teaching programming control mode, which is time-consuming and labor-intensive, inefficient, and has high requirements for operators. The welding accuracy depends entirely on the experience of the instructor. Offline programming technology can better solve the problems existing in the teaching programming mode of welding robots, but welding stress and welding deformation will be generated during the welding process, resulting in deformation of the workpiece. Therefore, for complex spatial curve welds with long paths, there is a certain deviation between the offline programming results and the actual weld trajectory. Using correction technology to correct the motion trajectory of the welding robot in real time can better solve the problems existing in the offline programming mode. At present, most welding robots on the market use line structure scanning elements for real-time correction. By obtaining the depth information of the weld, the motion trajectory of the welding robot is corrected in real time and sent to the welding robot. The end effector of the welding robot moves to the welding starting point to automatically complete the welding work. Most of them are only suitable for plane welds, and the accuracy and accuracy of weld recognition directly affect the welding accuracy. Therefore, it is necessary to design a spatial weld automatic positioning and correction system suitable for various welding workpieces, various welding environments, especially three-dimensional complex welds.

发明内容Summary of the invention

针对现有的焊接机器人自动焊接技术的欠缺,本发明的目的是提供一种基于虚实结合的机器人空间焊缝自动定位与纠偏系统,能够在虚拟环境中导入不同模型生成二维焊缝或三维焊缝,适用于各种焊接工件和不同焊接环境,只需用户在虚拟环境中定义需要焊接的空间焊缝,焊接机器人便能沿着用户定义的焊缝开始焊接,并且自动定位焊缝轨迹和实时纠偏,拥有适用性广、操作简便、焊接精度高的优点。In view of the shortcomings of the existing welding robot automatic welding technology, the purpose of the present invention is to provide a robot spatial weld automatic positioning and correction system based on the combination of virtual and real, which can import different models in a virtual environment to generate two-dimensional welds or three-dimensional welds, and is suitable for various welding workpieces and different welding environments. The user only needs to define the spatial weld to be welded in the virtual environment, and the welding robot can start welding along the user-defined weld, and automatically locate the weld trajectory and correct the deviation in real time. It has the advantages of wide applicability, easy operation and high welding precision.

本发明的目的是通过如下途径实现的:一种基于虚实结合的机器人空间焊缝自动定位与纠偏系统,包括虚拟环境、焊接机器人、空间焊缝跟踪和识别模块、运动轨迹生成模块、自动定位与插值拟合模块、实时轨迹纠偏与控制模块;The object of the present invention is achieved through the following approaches: a robot space weld automatic positioning and correction system based on virtual and real combination, including a virtual environment, a welding robot, a space weld tracking and identification module, a motion trajectory generation module, an automatic positioning and interpolation fitting module, and a real-time trajectory correction and control module;

其中所述虚拟环境用于导入待焊接工件、工作台、焊接机器人及焊接工具的三维模型,并对这些三维模型的运动状态进行仿真和显示;用户基于虚拟环境,对其中的三维模型进行管理和交互,执行焊缝轨迹定义、空间焊缝轨迹生成和焊接过程仿真操作;The virtual environment is used to import three-dimensional models of workpieces to be welded, workbenches, welding robots and welding tools, and simulate and display the motion states of these three-dimensional models; based on the virtual environment, users manage and interact with the three-dimensional models therein, and perform weld trajectory definition, spatial weld trajectory generation and welding process simulation operations;

其中所述焊缝轨迹定义是指用户在虚拟环境中的待焊接工件模型上通过选取点位、画线、选面方式来定义焊缝轨迹;The weld trajectory definition refers to the user defining the weld trajectory by selecting points, drawing lines, and selecting surfaces on the workpiece model to be welded in the virtual environment;

其中所述空间焊缝轨迹生成是指基于用户定义的焊缝轨迹,通过几何学计算、拟合生成连贯的空间焊缝轨迹;The spatial weld trajectory generation refers to generating a coherent spatial weld trajectory through geometric calculation and fitting based on the weld trajectory defined by the user;

其中所述空间焊缝包括二维焊缝和三维焊缝;The spatial welds include two-dimensional welds and three-dimensional welds;

其中所述空间焊缝跟踪和识别模块包括但不限于结构光、平面视觉、3D视觉、激光跟踪和红外跟踪,用于实时获取焊缝信息;The spatial weld tracking and identification module includes but is not limited to structured light, planar vision, 3D vision, laser tracking and infrared tracking, which is used to obtain weld information in real time;

其中所述运动轨迹生成模块,是指基于用户在虚拟环境中所定义的焊缝轨迹,或基于人工智能分析定义的焊缝轨迹,输入扫描提前量、焊接机器人的运动步距、末端工具偏移量而自动生成焊接机器人运动轨迹的模块;The motion trajectory generation module refers to a module that automatically generates the motion trajectory of the welding robot based on the weld trajectory defined by the user in the virtual environment or the weld trajectory defined based on artificial intelligence analysis, and inputs the scanning advance amount, the motion step distance of the welding robot, and the end tool offset;

其中所述末端工具偏移量是指焊接机器人末端焊接工具位置与用户选定焊缝轨迹之间的距离,其值由用户根据不同的焊接工艺、焊接工具的类型和功率来定义;The end tool offset refers to the distance between the end welding tool position of the welding robot and the weld trajectory selected by the user, and its value is defined by the user according to different welding processes, welding tool types and powers;

其中所述扫描提前量是指空间焊缝跟踪和识别模块所携带的传感器相对于焊接工具,在运动方向上的位置提前量,其值根据传感器的视野范围定义;The scanning advance amount refers to the position advance amount of the sensor carried by the spatial weld tracking and identification module relative to the welding tool in the moving direction, and its value is defined according to the field of view of the sensor;

其中所述自动定位与插值拟合模块,基于空间焊缝跟踪和识别模块获得的实时焊缝信息,定位焊缝轨迹,并通过插值拟合生成焊缝轨迹;The automatic positioning and interpolation fitting module locates the weld trajectory based on the real-time weld information obtained by the spatial weld tracking and identification module, and generates the weld trajectory through interpolation fitting;

其中所述实时轨迹纠偏与控制模块,基于空间焊缝跟踪和识别模块获得的实时焊缝信息,判断运动轨迹生成模块所生成的焊接机器人运动轨迹是否满足焊接工艺要求:若满足要求,则按照生成的运动轨迹执行焊接任务;若不满足,则对运动轨迹进行实时纠正;The real-time trajectory correction and control module determines whether the motion trajectory of the welding robot generated by the motion trajectory generation module meets the welding process requirements based on the real-time weld information obtained by the spatial weld tracking and recognition module: if the requirements are met, the welding task is performed according to the generated motion trajectory; if not, the motion trajectory is corrected in real time;

该系统执行自动焊接任务时,包括以下步骤:When the system performs automatic welding tasks, the following steps are included:

步骤1、控制焊接机器人,使得焊接机器人末端靠近待焊接工件,并控制焊接机器人末端空间焊缝跟踪和识别模块采集待焊接工件图像信息,计算出待焊接工件与焊接机器人相对位姿;Step 1: Control the welding robot so that the end of the welding robot is close to the workpiece to be welded, and control the spatial weld tracking and recognition module at the end of the welding robot to collect image information of the workpiece to be welded, and calculate the relative posture of the workpiece to be welded and the welding robot;

步骤2、将待焊接工件模型与焊接机器人模型以相对位姿导入到虚拟环境,定义一个与空间焊缝跟踪和识别模块参数一致的虚拟空间焊缝跟踪和识别模块;Step 2: Import the workpiece model to be welded and the welding robot model into the virtual environment in relative posture, and define a virtual space weld tracking and recognition module with parameters consistent with the space weld tracking and recognition module;

步骤3、用户在虚拟环境中的待焊接工件上选取需要焊接的焊缝轨迹,定义末端工具偏移量、焊接机器人的运动步距、扫描提前量,并由运动轨迹生成模块生成焊接机器人运动轨迹;Step 3: The user selects the weld trajectory to be welded on the workpiece to be welded in the virtual environment, defines the end tool offset, the motion step of the welding robot, and the scanning advance, and the motion trajectory generation module generates the welding robot motion trajectory;

步骤4、在虚拟环境中对机器人运动轨迹进行仿真,进行运动干涉、避碰和奇异点检测;若仿真过程中发生碰撞、干涉或运动奇异,则重新执行步骤3,直到仿真检测的结果满足要求;若仿真检测的结果满足要求,则导出焊接机器人运动轨迹;Step 4: simulate the robot motion trajectory in a virtual environment, and perform motion interference, collision avoidance, and singular point detection; if collision, interference, or motion singularity occurs during the simulation, re-execute step 3 until the simulation test result meets the requirements; if the simulation test result meets the requirements, derive the welding robot motion trajectory;

步骤5、判断空间焊缝跟踪和识别模块中传感器的类别,若为面阵式视觉识别元件,则继续执行,若为线结构扫描元件,则跳至步骤7a;Step 5: Determine the type of sensor in the spatial weld tracking and recognition module. If it is a planar array visual recognition element, continue to execute; if it is a line structure scanning element, jump to step 7a;

步骤6a、控制虚拟环境中的虚拟焊接机器人,按照步骤4中满足仿真检测要求的焊接机器人运动轨迹进行运动;在运动过程中,利用安装在虚拟焊接机器人末端的虚拟空间焊缝跟踪和识别模块,实时采集虚拟环境中待焊接工件模型的虚拟图像信息;Step 6a, controlling the virtual welding robot in the virtual environment to move according to the welding robot motion trajectory that meets the simulation detection requirements in step 4; during the movement, using the virtual space weld tracking and recognition module installed at the end of the virtual welding robot to collect virtual image information of the workpiece model to be welded in the virtual environment in real time;

其中所述实时采集虚拟环境中待焊接工件模型的虚拟图像信息,是指在虚拟焊接机器人以运动步距为单位移动时,虚拟空间焊缝跟踪和识别模块以所携带传感器的采样频率采集虚拟图像信息。The real-time acquisition of virtual image information of the workpiece model to be welded in the virtual environment means that when the virtual welding robot moves in units of motion steps, the virtual space weld tracking and recognition module acquires virtual image information at the sampling frequency of the carried sensor.

步骤6b、按照步骤4导出的焊接机器人运动轨迹,控制实际焊接机器人从运动轨迹的起始点、以步骤3定义好的运动步距开始运动;Step 6b, according to the motion trajectory of the welding robot derived in step 4, control the actual welding robot to start moving from the starting point of the motion trajectory and with the motion step defined in step 3;

步骤6c、在实际焊接机器人运动的同时,利用焊接机器人末端空间焊缝跟踪和识别模块,实时采集待焊接工件真实图像信息;Step 6c: While the actual welding robot is moving, the space weld tracking and recognition module at the end of the welding robot is used to collect real image information of the workpiece to be welded in real time;

步骤6d、以步骤6a所采集虚拟图像信息为模板图像,将步骤6c所采集真实图像信息与模板图像进行实时匹配;Step 6d, using the virtual image information collected in step 6a as a template image, matching the real image information collected in step 6c with the template image in real time;

步骤6e、将实时匹配结果输入到自动定位与插值拟合模块,对步骤3中用户选取的焊缝轨迹进行实时识别定位,并控制焊接机器人以步骤3定义好的运动步距连续运动;Step 6e: input the real-time matching result into the automatic positioning and interpolation fitting module, perform real-time identification and positioning of the weld trajectory selected by the user in step 3, and control the welding robot to move continuously with the movement step defined in step 3;

其中所述对步骤3中用户选取的焊缝轨迹进行实时识别定位,是指焊接机器人按照用户选取的焊缝轨迹所生成的焊接机器人运动轨迹运动时,通过面阵式识别元件实时匹配得到当前视野范围内的空间焊缝轨迹,将上一视野范围内的空间焊缝轨迹和当前视野范围内的空间焊缝轨迹以及用户选取的焊缝轨迹通过插值拟合计算得到连贯的空间焊缝轨迹。The real-time identification and positioning of the weld trajectory selected by the user in step 3 means that when the welding robot moves according to the welding robot motion trajectory generated by the weld trajectory selected by the user, the spatial weld trajectory within the current field of view is obtained by real-time matching through the array recognition element, and the spatial weld trajectory within the previous field of view, the spatial weld trajectory within the current field of view, and the weld trajectory selected by the user are calculated through interpolation fitting to obtain a coherent spatial weld trajectory.

步骤6f、重复步骤6b到6e,直到完成当前焊缝的跟踪任务,获得当前焊缝的定位轨迹;Step 6f, repeating steps 6b to 6e until the tracking task of the current weld is completed and the positioning track of the current weld is obtained;

步骤6g、重复执行步骤6a到6f,每次执行过程完成一个焊缝跟踪任务,直到完成了步骤3中用户所选取的所有焊缝轨迹的跟踪,获得了相应焊缝轨迹的定位轨迹,则跳至步骤8;Step 6g, repeating steps 6a to 6f, completing one weld tracking task each time, until all weld trajectories selected by the user in step 3 are tracked, and the positioning trajectory of the corresponding weld trajectories is obtained, then jumping to step 8;

步骤7a、控制焊接机器人,按照步骤4所导出的运动轨迹、以步骤3所定义的运动步距进行运动;在焊接机器人运动的同时,安装在其末端的空间焊缝跟踪和识别模块所携带的线结构扫描元件,实时采集待焊接工件的空间焊缝几何信息;Step 7a, controlling the welding robot to move according to the motion trajectory derived in step 4 and the motion step defined in step 3; while the welding robot is moving, the line structure scanning element carried by the spatial weld tracking and recognition module installed at the end of the welding robot collects the spatial weld geometry information of the workpiece to be welded in real time;

步骤7b、将采集到的空间焊缝几何信息输入到自动定位与插值拟合模块,对步骤3中用户选取的焊缝轨迹进行实时识别定位,并控制焊接机器人以步骤3定义好的运动步距连续运动,直到完成当前焊缝的跟踪任务,获得当前焊缝轨迹的定位轨迹;Step 7b, input the collected spatial weld geometry information into the automatic positioning and interpolation fitting module, perform real-time identification and positioning of the weld trajectory selected by the user in step 3, and control the welding robot to move continuously with the movement step defined in step 3 until the current weld tracking task is completed, and obtain the positioning trajectory of the current weld trajectory;

其中所述对步骤3中用户选取的焊缝轨迹进行实时识别定位,是指焊接机器人按照用户选取的焊缝轨迹所生成的焊接机器人运动轨迹运动时,通过线结构扫描式元件扫描得到空间焊缝几何信息,将得到的空间焊缝几何信息和用户选取的焊缝轨迹通过插值拟合计算得到连贯的空间焊缝轨迹。The real-time identification and positioning of the weld trajectory selected by the user in step 3 refers to that when the welding robot moves according to the welding robot motion trajectory generated by the weld trajectory selected by the user, the spatial weld geometry information is obtained by scanning with a line structure scanning element, and the obtained spatial weld geometry information and the weld trajectory selected by the user are calculated by interpolation fitting to obtain a coherent spatial weld trajectory.

步骤7c、重复执行步骤7a和7b,直到完成了步骤3中用户所选取的所有焊缝轨迹的跟踪,获得了相应焊缝轨迹的定位轨迹,转入下一步;Step 7c, repeating steps 7a and 7b until all weld seam tracks selected by the user in step 3 are tracked, and the positioning tracks of the corresponding weld seam tracks are obtained, and then proceeding to the next step;

步骤8、输入步骤6g或步骤7c所获得的定位轨迹到运动轨迹生成模块生成焊接机器人运动轨迹,控制焊接机器人按照该轨迹进行运动,并执行焊接任务,在运动和焊接过程中,基于空间焊缝跟踪和识别模块获得空间焊缝轨迹并输入到实时轨迹纠偏与控制模块进行实时矫正,以消除由热变形带来的轨迹偏差。Step 8. Input the positioning trajectory obtained in step 6g or step 7c into the motion trajectory generation module to generate the motion trajectory of the welding robot, control the welding robot to move according to the trajectory, and perform the welding task. During the movement and welding process, the spatial weld trajectory is obtained based on the spatial weld tracking and recognition module and input into the real-time trajectory correction and control module for real-time correction to eliminate the trajectory deviation caused by thermal deformation.

其中所述基于空间焊缝跟踪和识别模块识别空间焊缝轨迹并输入到实时轨迹纠偏与控制模块进行实时矫正,其具体方法和步骤为:The spatial weld tracking and identification module identifies the spatial weld trajectory and inputs it into the real-time trajectory correction and control module for real-time correction, and its specific method and steps are as follows:

若所携带传感器为面阵式视觉元件,则通过空间焊缝跟踪和识别模块识别得到当前视野范围内实际空间焊缝轨迹,计算其与当前视野范围内定位轨迹的最大偏离值,判断偏离值大小是否影响焊接质量;If the sensor carried is a planar array vision element, the actual spatial weld trajectory within the current field of view is identified by the spatial weld tracking and recognition module, and its maximum deviation from the positioning trajectory within the current field of view is calculated to determine whether the deviation affects the welding quality;

若影响焊接质量,则将当前视野范围内定位轨迹的起点作为插值拟合起始点,以当前视野范围内实际空间焊缝轨迹的终点的三维坐标作为终点,进行插值拟合计算得到纠正后的空间焊缝轨迹,并输入到运动轨迹生成模块得到纠正后的焊接机器人运动轨迹,更新焊接机器人运动轨迹;If it affects the welding quality, the starting point of the positioning trajectory within the current field of view is used as the starting point of the interpolation fitting, and the three-dimensional coordinates of the end point of the actual spatial weld trajectory within the current field of view are used as the end point. The interpolation fitting calculation is performed to obtain the corrected spatial weld trajectory, and the corrected welding robot motion trajectory is input into the motion trajectory generation module to obtain the corrected welding robot motion trajectory, and the welding robot motion trajectory is updated;

若未影响焊接质量,则按照原定位轨迹运动;If the welding quality is not affected, move according to the original positioning trajectory;

若所携带传感器为线结构扫描式元件,通过空间焊缝跟踪和识别模块识别得到当前扫描视野下实际空间焊缝几何信息,计算其与定位轨迹在当前扫描视野下的空间焊缝几何信息的最大的偏离值,判断偏离值大小是否影响焊接质量;If the carried sensor is a linear structure scanning element, the actual spatial weld geometry information under the current scanning field of view is obtained through the spatial weld tracking and recognition module, and the maximum deviation value between the spatial weld geometry information under the current scanning field of view and the positioning trajectory is calculated to determine whether the deviation value affects the welding quality;

若影响焊接质量,则将当前焊接机器人末端焊接工具所对应定位轨迹的三维坐标作为插值拟合起始点,以识别得到的当前扫描视野下实际空间焊缝几何信息的三维坐标作为终点,进行插值拟合计算得到纠正后的空间焊缝轨迹,并输入到运动轨迹生成模块得到纠正后的焊接机器人运动轨迹,更新焊接机器人运动轨迹。If it affects the welding quality, the three-dimensional coordinates of the positioning trajectory corresponding to the welding tool at the end of the current welding robot are used as the starting point of the interpolation fitting, and the three-dimensional coordinates of the actual spatial weld geometry information under the current scanning field of view are identified as the end point. The interpolation fitting calculation is performed to obtain the corrected spatial weld trajectory, and the corrected welding robot motion trajectory is input into the motion trajectory generation module to update the welding robot motion trajectory.

若未影响焊接质量,则按照原定位轨迹运动。If the welding quality is not affected, move according to the original positioning trajectory.

结合上述的所有技术方案,本发明的优点在于:采用本发明能够在虚拟环境中导入不同模型生成二维焊缝或三维焊缝,适用于各种焊接工件和不同焊接环境,只需用户在虚拟环境中定义要焊接的空间焊缝,焊接机器人便能沿着用户定义的焊缝开始焊接,并且自动识别焊缝轨迹和实时纠偏,拥有适用性广、操作简便、焊接精度高的优点。Combining all the above technical solutions, the advantages of the present invention are: the present invention can import different models in a virtual environment to generate two-dimensional welds or three-dimensional welds, which is suitable for various welding workpieces and different welding environments. The user only needs to define the spatial weld to be welded in the virtual environment, and the welding robot can start welding along the user-defined weld, and automatically identify the weld trajectory and correct it in real time. It has the advantages of wide applicability, simple operation and high welding precision.

具体实施方式Detailed ways

为了使本发明的目的、技术方案和优点更加清楚明了,下面对本发明进行进一步详细说明。但是应该理解,此处所描述的具体实施例仅仅用于解释本发明,并不用于限制本发明的范围。In order to make the purpose, technical solution and advantages of the present invention more clear, the present invention is further described in detail below. However, it should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the scope of the present invention.

除非另有定义,本文所使用的所有技术用语与属于本发明的技术领域的技术人员通常理解的含义相同,本文在本发明的说明书中所使用的属于只是为了描述具体的实施例的目的,不是旨在限制于本发明。Unless otherwise defined, all technical terms used herein have the same meaning as commonly understood by technicians in the technical field to which the present invention belongs. The terms used in the specification of the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention.

本发明实施例提供的基于虚实结合的机器人空间焊缝自动定位与纠偏系统,包括虚拟环境、焊接机器人、空间焊缝跟踪和识别模块、运动轨迹生成模块、自动定位与插值拟合模块、实时轨迹纠偏与控制模块;The robot space weld automatic positioning and correction system based on virtual-real combination provided in the embodiment of the present invention comprises a virtual environment, a welding robot, a space weld tracking and identification module, a motion trajectory generation module, an automatic positioning and interpolation fitting module, and a real-time trajectory correction and control module;

其中所述虚拟环境用于导入待焊接工件、工作台、焊接机器人及焊接工具的三维模型,并对这些三维模型的运动状态进行仿真和显示;用户基于虚拟环境,对其中的三维模型进行管理和交互,执行焊缝轨迹定义、空间焊缝轨迹生成和焊接过程仿真操作;The virtual environment is used to import three-dimensional models of workpieces to be welded, workbenches, welding robots and welding tools, and simulate and display the motion states of these three-dimensional models; based on the virtual environment, users manage and interact with the three-dimensional models therein, and perform weld trajectory definition, spatial weld trajectory generation and welding process simulation operations;

其中所述焊缝轨迹定义是指用户在虚拟环境中的待焊接工件模型上通过选取点位、画线、选面方式来定义焊缝轨迹;The weld trajectory definition refers to the user defining the weld trajectory by selecting points, drawing lines, and selecting surfaces on the workpiece model to be welded in the virtual environment;

其中所述空间焊缝轨迹生成是指基于用户定义的焊缝轨迹,通过几何学计算、拟合生成连贯的空间焊缝轨迹;The spatial weld trajectory generation refers to generating a coherent spatial weld trajectory through geometric calculation and fitting based on the weld trajectory defined by the user;

其中所述空间焊缝包括二维焊缝和三维焊缝;The spatial welds include two-dimensional welds and three-dimensional welds;

其中所述空间焊缝跟踪和识别模块包括但不限于结构光、平面视觉、3D视觉、激光跟踪和红外跟踪,用于实时获取焊缝信息;The spatial weld tracking and identification module includes but is not limited to structured light, planar vision, 3D vision, laser tracking and infrared tracking, which is used to obtain weld information in real time;

其中所述运动轨迹生成模块,是指基于用户在虚拟环境中所定义的焊缝轨迹,或基于人工智能分析定义的焊缝轨迹,输入扫描提前量、焊接机器人的运动步距、末端工具偏移量而自动生成焊接机器人运动轨迹的模块;The motion trajectory generation module refers to a module that automatically generates the motion trajectory of the welding robot based on the weld trajectory defined by the user in the virtual environment or the weld trajectory defined based on artificial intelligence analysis, and inputs the scanning advance amount, the motion step distance of the welding robot, and the end tool offset;

其中所述末端工具偏移量是指焊接机器人末端焊接工具位置与用户选定焊缝轨迹之间的距离,其值由用户根据不同的焊接工艺、焊接工具的类型和功率来定义;The end tool offset refers to the distance between the end welding tool position of the welding robot and the weld trajectory selected by the user, and its value is defined by the user according to different welding processes, welding tool types and powers;

其中所述扫描提前量是指空间焊缝跟踪和识别模块所携带的传感器相对于焊接工具,在运动方向上的位置提前量,其值根据传感器的视野范围定义;The scanning advance amount refers to the position advance amount of the sensor carried by the spatial weld tracking and identification module relative to the welding tool in the moving direction, and its value is defined according to the field of view of the sensor;

其中所述自动定位与插值拟合模块,基于空间焊缝跟踪和识别模块获得的实时焊缝信息,定位焊缝轨迹,并通过插值拟合生成焊缝轨迹;The automatic positioning and interpolation fitting module locates the weld trajectory based on the real-time weld information obtained by the spatial weld tracking and identification module, and generates the weld trajectory through interpolation fitting;

其中所述实时轨迹纠偏与控制模块,基于空间焊缝跟踪和识别模块获得的实时焊缝信息,判断运动轨迹生成模块所生成的焊接机器人运动轨迹是否满足焊接工艺要求:若满足要求,则按照生成的运动轨迹执行焊接任务;若不满足,则对运动轨迹进行实时纠正;The real-time trajectory correction and control module determines whether the motion trajectory of the welding robot generated by the motion trajectory generation module meets the welding process requirements based on the real-time weld information obtained by the spatial weld tracking and recognition module: if the requirements are met, the welding task is performed according to the generated motion trajectory; if not, the motion trajectory is corrected in real time;

该系统执行自动焊接任务时,包括以下步骤:When the system performs automatic welding tasks, the following steps are included:

步骤1、控制焊接机器人,使得焊接机器人末端靠近待焊接工件,并控制焊接机器人末端空间焊缝跟踪和识别模块采集待焊接工件图像信息,计算出待焊接工件与焊接机器人相对位姿;Step 1: Control the welding robot so that the end of the welding robot is close to the workpiece to be welded, and control the spatial weld tracking and recognition module at the end of the welding robot to collect image information of the workpiece to be welded, and calculate the relative posture of the workpiece to be welded and the welding robot;

步骤2、将待焊接工件模型与焊接机器人模型以相对位姿导入到虚拟环境,定义一个与空间焊缝跟踪和识别模块参数一致的虚拟空间焊缝跟踪和识别模块;Step 2: Import the workpiece model to be welded and the welding robot model into the virtual environment in relative posture, and define a virtual space weld tracking and recognition module with parameters consistent with the space weld tracking and recognition module;

步骤3、用户在虚拟环境中的待焊接工件上选取需要焊接的焊缝轨迹,定义末端工具偏移量、焊接机器人的运动步距、扫描提前量,并由运动轨迹生成模块生成焊接机器人运动轨迹;Step 3: The user selects the weld trajectory to be welded on the workpiece to be welded in the virtual environment, defines the end tool offset, the motion step of the welding robot, and the scanning advance, and the motion trajectory generation module generates the welding robot motion trajectory;

步骤4、在虚拟环境中对机器人运动轨迹进行仿真,进行运动干涉、避碰和奇异点检测;若仿真过程中发生碰撞、干涉或运动奇异,则重新执行步骤3,直到仿真检测的结果满足要求;若仿真检测的结果满足要求,则导出焊接机器人运动轨迹;Step 4: simulate the robot motion trajectory in a virtual environment, and perform motion interference, collision avoidance, and singular point detection; if collision, interference, or motion singularity occurs during the simulation, re-execute step 3 until the simulation test result meets the requirements; if the simulation test result meets the requirements, derive the welding robot motion trajectory;

步骤5、判断空间焊缝跟踪和识别模块中传感器的类别,若为面阵式视觉识别元件,则继续执行,若为线结构扫描元件,则跳至步骤7a;Step 5: Determine the type of sensor in the spatial weld tracking and recognition module. If it is a planar array visual recognition element, continue to execute; if it is a line structure scanning element, jump to step 7a;

步骤6a、控制虚拟环境中的虚拟焊接机器人,按照步骤4中满足仿真检测要求的焊接机器人运动轨迹进行运动;在运动过程中,利用安装在虚拟焊接机器人末端的虚拟空间焊缝跟踪和识别模块,实时采集虚拟环境中待焊接工件模型的虚拟图像信息;Step 6a, controlling the virtual welding robot in the virtual environment to move according to the welding robot motion trajectory that meets the simulation detection requirements in step 4; during the movement, using the virtual space weld tracking and recognition module installed at the end of the virtual welding robot to collect virtual image information of the workpiece model to be welded in the virtual environment in real time;

其中所述实时采集虚拟环境中待焊接工件模型的虚拟图像信息,是指在虚拟焊接机器人以运动步距为单位移动时,虚拟空间焊缝跟踪和识别模块以所携带传感器的采样频率采集虚拟图像信息。The real-time acquisition of virtual image information of the workpiece model to be welded in the virtual environment means that when the virtual welding robot moves in units of motion steps, the virtual space weld tracking and recognition module acquires virtual image information at the sampling frequency of the carried sensor.

步骤6b、按照步骤4导出的焊接机器人运动轨迹,控制实际焊接机器人从运动轨迹的起始点、以步骤3定义好的运动步距开始运动;Step 6b, according to the motion trajectory of the welding robot derived in step 4, control the actual welding robot to start moving from the starting point of the motion trajectory and with the motion step defined in step 3;

步骤6c、在实际焊接机器人运动的同时,利用焊接机器人末端空间焊缝跟踪和识别模块,实时采集待焊接工件真实图像信息;Step 6c: While the actual welding robot is moving, the space weld tracking and recognition module at the end of the welding robot is used to collect real image information of the workpiece to be welded in real time;

步骤6d、以步骤6a所采集虚拟图像信息为模板图像,将步骤6c所采集真实图像信息与模板图像进行实时匹配;Step 6d, using the virtual image information collected in step 6a as a template image, matching the real image information collected in step 6c with the template image in real time;

步骤6e、将实时匹配结果输入到自动定位与插值拟合模块,对步骤3中用户选取的焊缝轨迹进行实时识别定位,并控制焊接机器人以步骤3定义好的运动步距连续运动;Step 6e: input the real-time matching result into the automatic positioning and interpolation fitting module, perform real-time identification and positioning of the weld trajectory selected by the user in step 3, and control the welding robot to move continuously with the movement step defined in step 3;

其中所述对步骤3中用户选取的焊缝轨迹进行实时识别定位,是指焊接机器人按照用户选取的焊缝轨迹所生成的焊接机器人运动轨迹运动时,通过面阵式识别元件实时匹配得到当前视野范围内的空间焊缝轨迹,将上一视野范围内的空间焊缝轨迹和当前视野范围内的空间焊缝轨迹以及用户选取的焊缝轨迹通过插值拟合计算得到连贯的空间焊缝轨迹。The real-time identification and positioning of the weld trajectory selected by the user in step 3 means that when the welding robot moves according to the welding robot motion trajectory generated by the weld trajectory selected by the user, the spatial weld trajectory within the current field of view is obtained by real-time matching through the array recognition element, and the spatial weld trajectory within the previous field of view, the spatial weld trajectory within the current field of view, and the weld trajectory selected by the user are calculated through interpolation fitting to obtain a coherent spatial weld trajectory.

步骤6f、重复步骤6b到6e,直到完成当前焊缝的跟踪任务,获得当前焊缝的定位轨迹;Step 6f, repeating steps 6b to 6e until the tracking task of the current weld is completed and the positioning track of the current weld is obtained;

步骤6g、重复执行步骤6a到6f,每次执行过程完成一个焊缝跟踪任务,直到完成了步骤3中用户所选取的所有焊缝轨迹的跟踪,获得了相应焊缝轨迹的定位轨迹,则跳至步骤8;Step 6g, repeating steps 6a to 6f, completing one weld tracking task each time, until all weld trajectories selected by the user in step 3 are tracked, and the positioning trajectory of the corresponding weld trajectories is obtained, then jumping to step 8;

步骤7a、控制焊接机器人,按照步骤4所导出的运动轨迹、以步骤3所定义的运动步距进行运动;在焊接机器人运动的同时,安装在其末端的空间焊缝跟踪和识别模块所携带的线结构扫描元件,实时采集待焊接工件的空间焊缝几何信息;Step 7a, controlling the welding robot to move according to the motion trajectory derived in step 4 and the motion step defined in step 3; while the welding robot is moving, the line structure scanning element carried by the spatial weld tracking and recognition module installed at the end of the welding robot collects the spatial weld geometry information of the workpiece to be welded in real time;

步骤7b、将采集到的空间焊缝几何信息输入到自动定位与插值拟合模块,对步骤3中用户选取的焊缝轨迹进行实时识别定位,并控制焊接机器人以步骤3定义好的运动步距连续运动,直到完成当前焊缝的跟踪任务,获得当前焊缝轨迹的定位轨迹;Step 7b, input the collected spatial weld geometry information into the automatic positioning and interpolation fitting module, perform real-time identification and positioning of the weld trajectory selected by the user in step 3, and control the welding robot to move continuously with the movement step defined in step 3 until the current weld tracking task is completed, and obtain the positioning trajectory of the current weld trajectory;

其中所述对步骤3中用户选取的焊缝轨迹进行实时识别定位,是指焊接机器人按照用户选取的焊缝轨迹所生成的焊接机器人运动轨迹运动时,通过线结构扫描式元件扫描得到空间焊缝几何信息,将得到的空间焊缝几何信息和用户选取的焊缝轨迹通过插值拟合计算得到连贯的空间焊缝轨迹。The real-time identification and positioning of the weld trajectory selected by the user in step 3 refers to that when the welding robot moves according to the welding robot motion trajectory generated by the weld trajectory selected by the user, the spatial weld geometry information is obtained by scanning with a line structure scanning element, and the obtained spatial weld geometry information and the weld trajectory selected by the user are calculated by interpolation fitting to obtain a coherent spatial weld trajectory.

步骤7c、重复执行步骤7a和7b,直到完成了步骤3中用户所选取的所有焊缝轨迹的跟踪,获得了相应焊缝轨迹的定位轨迹,转入下一步;Step 7c, repeating steps 7a and 7b until all weld seam tracks selected by the user in step 3 are tracked, and the positioning tracks of the corresponding weld seam tracks are obtained, and then proceeding to the next step;

步骤8、输入步骤6g或步骤7c所获得的定位轨迹到运动轨迹生成模块生成焊接机器人运动轨迹,控制焊接机器人按照该轨迹进行运动,并执行焊接任务,在运动和焊接过程中,基于空间焊缝跟踪和识别模块获得空间焊缝轨迹并输入到实时轨迹纠偏与控制模块进行实时矫正,以消除由热变形带来的轨迹偏差。Step 8. Input the positioning trajectory obtained in step 6g or step 7c into the motion trajectory generation module to generate the motion trajectory of the welding robot, control the welding robot to move according to the trajectory, and perform the welding task. During the movement and welding process, the spatial weld trajectory is obtained based on the spatial weld tracking and recognition module and input into the real-time trajectory correction and control module for real-time correction to eliminate the trajectory deviation caused by thermal deformation.

其中所述基于空间焊缝跟踪和识别模块识别空间焊缝轨迹并输入到实时轨迹纠偏与控制模块进行实时矫正,其具体方法和步骤为:The spatial weld tracking and identification module identifies the spatial weld trajectory and inputs it into the real-time trajectory correction and control module for real-time correction, and its specific method and steps are as follows:

若所携带传感器为面阵式视觉元件,则通过空间焊缝跟踪和识别模块识别得到当前视野范围内实际空间焊缝轨迹,计算其与当前视野范围内定位轨迹的最大偏离值,判断偏离值大小是否影响焊接质量;If the sensor carried is a planar array vision element, the actual spatial weld trajectory within the current field of view is identified by the spatial weld tracking and recognition module, and its maximum deviation from the positioning trajectory within the current field of view is calculated to determine whether the deviation affects the welding quality;

若影响焊接质量,则将当前视野范围内定位轨迹的起点作为插值拟合起始点,以当前视野范围内实际空间焊缝轨迹的终点的三维坐标作为终点,进行插值拟合计算得到纠正后的空间焊缝轨迹,并输入到运动轨迹生成模块得到纠正后的焊接机器人运动轨迹,更新焊接机器人运动轨迹;If it affects the welding quality, the starting point of the positioning trajectory within the current field of view is used as the starting point of the interpolation fitting, and the three-dimensional coordinates of the end point of the actual spatial weld trajectory within the current field of view are used as the end point. The interpolation fitting calculation is performed to obtain the corrected spatial weld trajectory, and the corrected welding robot motion trajectory is input into the motion trajectory generation module to obtain the corrected welding robot motion trajectory, and the welding robot motion trajectory is updated;

若未影响焊接质量,则按照原定位轨迹运动;If the welding quality is not affected, move according to the original positioning trajectory;

若所携带传感器为线结构扫描式元件,通过空间焊缝跟踪和识别模块识别得到当前扫描视野下实际空间焊缝几何信息,计算其与定位轨迹在当前扫描视野下的空间焊缝几何信息的最大的偏离值,判断偏离值大小是否影响焊接质量;If the carried sensor is a linear structure scanning element, the actual spatial weld geometry information under the current scanning field of view is obtained through the spatial weld tracking and recognition module, and the maximum deviation value between the spatial weld geometry information under the current scanning field of view and the positioning trajectory is calculated to determine whether the deviation value affects the welding quality;

若影响焊接质量,则将当前焊接机器人末端焊接工具所对应定位轨迹的三维坐标作为插值拟合起始点,以识别得到的当前扫描视野下实际空间焊缝几何信息的三维坐标作为终点,进行插值拟合计算得到纠正后的空间焊缝轨迹,并输入到运动轨迹生成模块得到纠正后的焊接机器人运动轨迹,更新焊接机器人运动轨迹。If it affects the welding quality, the three-dimensional coordinates of the positioning trajectory corresponding to the welding tool at the end of the current welding robot are used as the starting point of the interpolation fitting, and the three-dimensional coordinates of the actual spatial weld geometry information under the current scanning field of view are identified as the end point. The interpolation fitting calculation is performed to obtain the corrected spatial weld trajectory, and the corrected welding robot motion trajectory is input into the motion trajectory generation module to update the welding robot motion trajectory.

若未影响焊接质量,则按照原定位轨迹运动。If the welding quality is not affected, move according to the original positioning trajectory.

以上的仅是本发明的实施例,方案中公知的具体结构和/或特性等常识在此未作过多描述。应当指出,对于本领域的技术人员来说,在不脱离本发明结构的前提下,还可以作出若干变形和改进,这些也应该视为本发明的保护范围,这些都不会影响本发明实施的效果和专利的实用性。本申请要求的保护范围应当以其权利要求的内容为准,说明书中的具体实施方式等记载可以用于解释权利要求的内容。The above are only embodiments of the present invention, and the common knowledge such as the known specific structure and/or characteristics in the scheme is not described in detail here. It should be pointed out that for those skilled in the art, several modifications and improvements can be made without departing from the structure of the present invention, which should also be regarded as the protection scope of the present invention, and these will not affect the effect of the implementation of the present invention and the practicality of the patent. The scope of protection required by this application shall be based on the content of its claims, and the specific implementation methods and other records in the specification can be used to interpret the content of the claims.

Claims (5)

1. Automatic positioning and correcting system of robot space welding seam based on virtual-real combination, its characterized in that:
The system comprises a virtual environment, a welding robot, a space weld joint tracking and identifying module, a motion track generating module, an automatic positioning and interpolation fitting module and a real-time track rectifying and controlling module;
The virtual environment is used for importing three-dimensional models of a workpiece to be welded, a workbench, a welding robot and a welding tool, and simulating and displaying the motion states of the three-dimensional models; the user manages and interacts the three-dimensional model based on the virtual environment, and performs weld path definition, space weld path generation and welding process simulation operation;
The weld track definition means that a user defines a weld track on a workpiece model to be welded in a virtual environment in a point position selection, line drawing and surface selection mode;
The space weld joint track generation is to generate a coherent space weld joint track through geometric calculation and fitting based on a weld joint track defined by a user;
Wherein the spatial welds include two-dimensional welds and three-dimensional welds;
the space weld joint tracking and identifying module comprises, but is not limited to, structured light, plane vision, 3D vision, laser tracking and infrared tracking, and is used for acquiring weld joint information in real time;
the motion trail generation module is used for automatically generating a motion trail of the welding robot based on a welding seam trail defined by a user in a virtual environment or based on a welding seam trail defined by artificial intelligent analysis, and inputting a scanning advance, a motion step of the welding robot and a terminal tool offset;
wherein the end tool offset is the distance between the end welding tool position of the welding robot and the welding line track selected by the user, and the value of the end tool offset is defined by the user according to different welding processes, types and powers of the welding tools;
The scanning lead is the position lead of a sensor carried by the space weld joint tracking and identifying module relative to the welding tool in the moving direction, and the value of the scanning lead is defined according to the visual field range of the sensor;
The automatic positioning and interpolation fitting module is used for positioning the weld track based on the real-time weld information obtained by the space weld tracking and identifying module and generating the weld track through interpolation fitting;
The real-time track deviation rectifying and controlling module judges whether the welding robot motion track generated by the motion track generating module meets the welding process requirements based on the real-time weld information obtained by the space weld tracking and identifying module: if the requirements are met, executing a welding task according to the generated motion trail; if not, correcting the motion trail in real time;
When the system executes the automatic welding task, the method comprises the following steps:
step 1, controlling a welding robot to enable the tail end of the welding robot to be close to a workpiece to be welded, controlling a space weld joint tracking and identifying module of the tail end of the welding robot to acquire image information of the workpiece to be welded, and calculating the relative pose of the workpiece to be welded and the welding robot;
Step 2, importing a workpiece model to be welded and a welding robot model into a virtual environment in a relative pose, and defining a virtual space weld tracking and identifying module consistent with the parameters of the space weld tracking and identifying module;
Step 3, selecting a welding seam track to be welded on a workpiece to be welded in a virtual environment by a user, defining an end tool offset, a movement step length and a scanning advance of a welding robot, and generating a welding robot movement track by a movement track generation module;
Step 4, simulating a motion trail of the robot in a virtual environment, and performing motion interference, collision avoidance and singular point detection; if collision, interference or singular movement occurs in the simulation process, the step 3 is re-executed until the simulation detection result meets the requirement; if the simulation detection result meets the requirement, deriving a welding robot motion track;
Step 5, judging the type of the sensor in the space weld joint tracking and identifying module, if the sensor is a planar array type visual identifying element, continuing to execute, and if the sensor is a line structure scanning element, jumping to the step 7a;
step 6a, controlling a virtual welding robot in a virtual environment, and moving according to the movement track of the welding robot meeting the simulation detection requirement in the step 4; in the motion process, virtual image information of a workpiece model to be welded in a virtual environment is acquired in real time by utilizing a virtual space weld joint tracking and identifying module arranged at the tail end of a virtual welding robot;
Step 6b, controlling the actual welding robot to start moving from the starting point of the motion track according to the motion track of the welding robot derived in the step 4, and starting moving at the motion step distance defined in the step 3;
Step 6c, acquiring real image information of a workpiece to be welded in real time by utilizing a welding robot tail end space weld joint tracking and identifying module while the actual welding robot moves;
Step 6d, real-time matching is carried out on the real image information acquired in the step 6c and the template image by taking the virtual image information acquired in the step 6a as the template image;
Step 6e, inputting a real-time matching result into an automatic positioning and interpolation fitting module, performing real-time identification positioning on the welding seam track selected by the user in the step 3, and controlling the welding robot to continuously move at the defined movement step distance in the step 3;
Step 6f, repeating the steps 6b to 6e until the tracking task of the current welding line is completed, and obtaining the positioning track of the current welding line;
Step 6g, repeatedly executing the steps 6a to 6f, completing a weld tracking task in each execution process until the tracking of all the weld trajectories selected by the user in the step 3 is completed, obtaining the positioning trajectories of the corresponding weld trajectories, and jumping to the step 8;
Step 7a, controlling the welding robot to move according to the motion trail derived in the step 4 and the motion step distance defined in the step 3; the method comprises the steps that when a welding robot moves, a line structure scanning element carried by a space weld joint tracking and identifying module arranged at the tail end of the welding robot acquires space weld joint geometric information of a workpiece to be welded in real time;
Step 7b, inputting the acquired geometric information of the space weld joint into an automatic positioning and interpolation fitting module, identifying and positioning the weld joint track selected by the user in the step 3 in real time, and controlling the welding robot to continuously move at the well defined movement step distance in the step 3 until the tracking task of the current weld joint is completed, so as to obtain the positioning track of the current weld joint track;
Step 7c, repeatedly executing the steps 7a and 7b until the tracking of all the weld trajectories selected by the user in the step 3 is completed, obtaining the positioning trajectories of the corresponding weld trajectories, and turning to the next step;
and 8, inputting the positioning track obtained in the step 6g or the step 7c to a motion track generation module to generate a motion track of the welding robot, controlling the welding robot to move according to the track, and executing a welding task, wherein in the moving and welding processes, the space weld track is obtained based on a space weld tracking and identifying module and is input to a real-time track deviation rectifying and controlling module to carry out real-time rectification so as to eliminate track deviation caused by thermal deformation.
2. The automatic positioning and correcting system for the space weld joint of the robot based on virtual-real combination according to claim 1, wherein the automatic positioning and correcting system is characterized in that: the step 6a of collecting virtual image information of the workpiece model to be welded in real time refers to that when the virtual welding robot moves by taking the motion step as a unit, the virtual space weld joint tracking and identifying module collects the virtual image information at the sampling frequency of the carried sensor.
3. The automatic positioning and correcting system for the space weld joint of the robot based on virtual-real combination according to claim 1, wherein the automatic positioning and correcting system is characterized in that: in the step 6e, the real-time identification and positioning are performed on the welding seam track selected by the user in the step 3, that is, when the welding robot moves according to the welding robot motion track generated by the welding seam track selected by the user, the space welding seam track in the current visual field range is obtained through real-time matching of the area array type identification element, and the space welding seam track in the previous visual field range, the space welding seam track in the current visual field range and the welding seam track selected by the user are obtained through interpolation fitting calculation.
4. The automatic positioning and correcting system for the space weld joint of the robot based on virtual-real combination according to claim 1, wherein the automatic positioning and correcting system is characterized in that: in the step 7b, the real-time identification and positioning of the welding seam track selected by the user in the step 3 means that when the welding robot moves according to the welding robot motion track generated by the welding seam track selected by the user, the line structure scanning element scans to obtain the space welding seam geometric information, and the obtained space welding seam geometric information and the welding seam track selected by the user are subjected to interpolation fitting calculation to obtain a coherent space welding seam track.
5. The automatic positioning and correcting system for the space weld joint of the robot based on virtual-real combination according to claim 1, wherein the automatic positioning and correcting system is characterized in that: in the step 8, the space weld seam track is identified based on the space weld seam tracking and identifying module and is input into the real-time track deviation rectifying and controlling module for real-time rectification, and the specific method and the steps are as follows:
if the carried sensor is a planar array type visual element, the actual space weld joint track in the current visual field range is obtained through recognition of the space weld joint tracking and recognition module, the maximum deviation value of the actual space weld joint track and the positioning track in the current visual field range is calculated, and whether the welding quality is influenced is judged;
If the welding quality is affected, taking a starting point of a positioning track in the current visual field as an interpolation fitting starting point, taking a three-dimensional coordinate of an end point of an actual space welding seam track in the current visual field as the end point, carrying out interpolation fitting calculation to obtain a corrected space welding seam track, inputting the corrected space welding seam track into a motion track generation module to obtain a corrected welding robot motion track, and updating the welding robot motion track;
If the welding quality is not affected, moving according to the original positioning track;
If the carried sensor is a linear structure scanning element, the actual space weld geometrical information under the current scanning visual field is obtained through the recognition of the space weld tracking and recognition module, the maximum deviation value of the actual space weld geometrical information and the space weld geometrical information of the positioning track under the current scanning visual field is calculated, and whether the deviation value affects the welding quality is judged;
If the welding quality is affected, taking the three-dimensional coordinates of the positioning track corresponding to the welding tool at the tail end of the current welding robot as an interpolation fitting starting point, taking the three-dimensional coordinates of the actual space welding seam geometric information under the current scanning visual field as an end point, carrying out interpolation fitting calculation to obtain a corrected space welding seam track, inputting the corrected space welding seam track into a motion track generation module to obtain a corrected welding robot motion track, and updating the welding robot motion track;
if the welding quality is not affected, the welding device moves according to the original positioning track.
CN202211465006.7A 2022-11-22 2022-11-22 A robot space weld automatic positioning and correction system based on virtual and real combination Active CN115723133B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211465006.7A CN115723133B (en) 2022-11-22 2022-11-22 A robot space weld automatic positioning and correction system based on virtual and real combination

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211465006.7A CN115723133B (en) 2022-11-22 2022-11-22 A robot space weld automatic positioning and correction system based on virtual and real combination

Publications (2)

Publication Number Publication Date
CN115723133A CN115723133A (en) 2023-03-03
CN115723133B true CN115723133B (en) 2024-08-06

Family

ID=85297221

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211465006.7A Active CN115723133B (en) 2022-11-22 2022-11-22 A robot space weld automatic positioning and correction system based on virtual and real combination

Country Status (1)

Country Link
CN (1) CN115723133B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117348577B (en) * 2023-12-05 2024-03-12 青岛宇方机器人工业股份有限公司 Production process simulation detection method, device, equipment and medium
CN118357649B (en) * 2024-05-07 2025-01-07 新昌县杰创控股有限公司 Automatic intelligent welding system of correction

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102059435A (en) * 2010-12-14 2011-05-18 东南大学 Longitudinal seam welding special machine with linear structure light type vision sensor and control method thereof
CN104384765A (en) * 2014-10-14 2015-03-04 江苏湃锐自动化科技有限公司 Automatic welding method based on three-dimensional model and machine vision and welding device based on three-dimensional model and machine vision

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH02210506A (en) * 1987-12-31 1990-08-21 Westinghouse Electric Corp <We> Robot control method and system
KR100794714B1 (en) * 2004-08-03 2008-01-15 현대중공업 주식회사 Continuous welding line following control system of robot and its control method
US10442025B2 (en) * 2014-10-22 2019-10-15 Illinois Tool Works Inc. Virtual reality controlled mobile robot
CN111745267A (en) * 2020-08-14 2020-10-09 湘潭大学 A real-time tracking system and method for groove weld based on laser displacement sensor
CN112518072B (en) * 2020-11-23 2022-03-01 南京工程学院 Spatial intersecting curve weld joint structure modeling method based on line structure light vision

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102059435A (en) * 2010-12-14 2011-05-18 东南大学 Longitudinal seam welding special machine with linear structure light type vision sensor and control method thereof
CN104384765A (en) * 2014-10-14 2015-03-04 江苏湃锐自动化科技有限公司 Automatic welding method based on three-dimensional model and machine vision and welding device based on three-dimensional model and machine vision

Also Published As

Publication number Publication date
CN115723133A (en) 2023-03-03

Similar Documents

Publication Publication Date Title
CN115723133B (en) A robot space weld automatic positioning and correction system based on virtual and real combination
CN111745267A (en) A real-time tracking system and method for groove weld based on laser displacement sensor
CN106994684A (en) The method of control machine people&#39;s instrument
CN114161048B (en) 3D vision-based parameterized welding method and device for tower legs of iron tower
CN113119122B (en) Hybrid off-line programming method of robot welding system
Hou et al. A teaching-free welding method based on laser visual sensing system in robotic GMAW
CN113634964A (en) Gantry type robot welding equipment and welding process for large-sized component
CN104325268A (en) Industrial robot three-dimensional space independent assembly method based on intelligent learning
Fang et al. Robot path and end-effector orientation planning using augmented reality
CN104827474B (en) Intelligent programming method and auxiliary device for learning human virtual teaching robot
Fang et al. Orientation planning of robot end-effector using augmented reality
Ma et al. A fast and robust seam tracking method for spatial circular weld based on laser visual sensor
Efimov et al. Improving the efficiency of automated precision robotics-enabled positioning and welding
Li et al. Structured light-based visual servoing for robotic pipe welding pose optimization
CN116160174B (en) Binocular vision-based weld joint identification and tracking control method
CN114536346A (en) Mechanical arm accurate path planning method based on man-machine cooperation and visual detection
CN111687515A (en) Intelligent welding guide system for large steel structure
CN117381788A (en) High-precision positioning and intelligent operation guiding method for composite robot
CN117436255A (en) Virtual-real-fusion robot welding process evaluation method and system
CN115179302B (en) Control method for locating, planning and correcting welding robot in nuclear environment
Wu et al. Research on welding guidance system of intelligent perception for steel weldment
CN114800524B (en) A system and method for active collision avoidance of a human-computer interaction collaborative robot
CN118357649B (en) Automatic intelligent welding system of correction
Penttilä et al. Virtual reality enabled manufacturing of challenging workpieces
González-Galván et al. An optimal path-generation algorithm for manufacturing of arbitrarily curved surfaces using uncalibrated vision

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant