[go: up one dir, main page]

CN113334380A - Robot vision calibration method, control system and device based on binocular vision - Google Patents

Robot vision calibration method, control system and device based on binocular vision Download PDF

Info

Publication number
CN113334380A
CN113334380A CN202110600899.0A CN202110600899A CN113334380A CN 113334380 A CN113334380 A CN 113334380A CN 202110600899 A CN202110600899 A CN 202110600899A CN 113334380 A CN113334380 A CN 113334380A
Authority
CN
China
Prior art keywords
calibration
robot
center
ball
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN202110600899.0A
Other languages
Chinese (zh)
Inventor
陈佳泉
王振滔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Quzhou University
Original Assignee
Quzhou University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Quzhou University filed Critical Quzhou University
Priority to CN202110600899.0A priority Critical patent/CN113334380A/en
Publication of CN113334380A publication Critical patent/CN113334380A/en
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • B25J9/1694Programme controls characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
    • B25J9/1697Vision controlled systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Robotics (AREA)
  • Mechanical Engineering (AREA)
  • Manipulator (AREA)
  • Image Analysis (AREA)

Abstract

本发明涉及机器人标定技术领域,提供一种基于双目视觉的机器人视觉标定方法、控制系统及装置,所述方法包括步骤:S1,在机器人工具末端使用夹具夹起标定球;S2,在相机摄像头中心预先设置一个中心点,利用相机拍摄标定球的图像,对拍摄的图像进行预处理,得到标定球的环境信息;S3,获取标定球的位置信息,识别计算出标定球的球心,计算出其位置坐标值;S4,将标定球球心坐标值与设置点进行比对,将差值反馈至控制器;S5,控制器发出控制指令,移动机器人的工具末端标定球的位置,直至标定球球心与设置点重合,使用示教器记录坐标点,完成标定。本发明拥有速度快,准确度高,避免碰撞等特点,大大提高了效率,增加了流水线单位时间产出值。

Figure 202110600899

The invention relates to the technical field of robot calibration, and provides a robot vision calibration method, control system and device based on binocular vision. The method includes the steps of: S1, using a fixture to clamp the calibration ball at the end of the robot tool; S2, at the camera head A center point is preset in the center, the image of the calibration sphere is captured by the camera, and the captured image is preprocessed to obtain the environmental information of the calibration sphere; S3, the position information of the calibration sphere is obtained, the center of the calibration sphere is identified and calculated, and the Its position coordinate value; S4, compare the center coordinate value of the calibration ball with the set point, and feed the difference back to the controller; S5, the controller sends a control command to move the tool end of the robot to calibrate the position of the ball until the calibration ball The center of the sphere coincides with the set point. Use the teach pendant to record the coordinate points to complete the calibration. The invention has the characteristics of high speed, high accuracy, collision avoidance and the like, which greatly improves the efficiency and increases the output value per unit time of the assembly line.

Figure 202110600899

Description

Robot vision calibration method, control system and device based on binocular vision
Technical Field
The invention relates to the technical field of robot calibration, in particular to a robot vision calibration method, a control system and a device based on binocular vision.
Background
Calibration is a necessary step before the robot works, and needs to be calibrated again after different tools are clamped, and the calibration speed and the calibration accuracy directly influence the working efficiency and the accuracy of the robot. The calibration process of the robot is improved, and the production efficiency of the robot in China is improved.
At present, three main calibration methods in China are provided, namely a method using a reference object as a reference outside, a method using multiple points for calibration and a method using a precise measuring instrument for measurement, and the methods have the following problems of large error, low efficiency, high labor cost and the like. The traditional calibration method mostly uses a four-point method, needs an operator to perform manual calibration, and needs calibration from four directions. However, with the development of industrial chain intelligence, the disadvantages of the conventional calibration method are gradually revealed. The traditional calibration method needs manual calibration by staff, has large labor consumption and high production cost, and simultaneously, because the error of the calibration requirement is less than 1mm and human eyes have visual error, the requirement is difficult to achieve. In the calibration process, sometimes the device is touched due to some operation errors, so that the device is easily damaged. Meanwhile, the traditional calibration cannot record data, repeated calibration is needed in each use, and the efficiency is low.
Disclosure of Invention
In view of the above, the present invention is directed to a method, a control system and a device for calibrating robot vision based on binocular vision, the robot vision calibration method based on binocular vision can combine a vision system, image processing and a robot technology, adopts a robot to match the binocular vision system, the calibration is carried out by the serial communication mode and the Hough image processing, thus solving the problems of large labor consumption, large visual error, fussy repeated calibration, tool damage risk and the like of the traditional four-point calibration, compared with the traditional demonstrator calibration, the method for calibrating by using vision has the characteristics of high speed, high accuracy, no need of setting a reference point, avoidance of collision and the like, therefore, the efficiency is greatly improved, the time cost is reduced, the unit time output value of the assembly line is increased, and further great economic benefits can be brought to manufacturing enterprises.
In order to achieve the purpose, the technical scheme of the invention is realized as follows:
a robot vision calibration system based on binocular vision comprises the following steps:
s1, clamping the calibration ball at the tail end of the robot tool by using a clamp;
s2, presetting a central point at the center of the camera, shooting the image of the calibration ball by using the camera, and preprocessing the shot image to obtain the environmental information of the calibration ball;
s3, obtaining the position information of the calibration ball through the binocular vision technology, identifying and calculating the center of the calibration ball, and calculating the position coordinate value according to the center of the calibration ball;
s4, comparing the coordinate value of the calibration sphere center with the set point, and feeding back the difference to the controller;
and S5, the controller sends out a control instruction, the camera and the robot are communicated and interacted in a serial port communication mode, the position of the calibration ball at the tail end of the tool of the robot is moved until the center of the calibration ball coincides with the set point, and the coordinate point is recorded by using the demonstrator to finish calibration.
Further, in step S2, two cameras vertically installed in the robot arm motion space are used to capture an image of the calibration ball, and the captured image is preprocessed after the image is captured, so as to obtain the environmental information of the calibration ball.
Further, in step S2, the captured image is subjected to the gradation processing and the binarization processing.
Further, the step S3 further includes the following sub-steps:
s31, identifying and positioning the calibration ball at the tail end of the robot tool after image preprocessing, and acquiring the position information of the calibration ball;
s32, performing edge detection on the circle in the image by using Hough transform;
s33, coordinate transformation is carried out, the equation of the circle in the plane coordinate system is transformed into a parameter equation, namely, the xy coordinate system is transformed into an ab coordinate system, and the equation of the circle can be expressed as a formula (1);
(x-a)2+(y-b)2=r2 (1)
the three degrees of freedom are coordinates a and b of the circle center and a radius r respectively, which are a three-dimensional space, and r is taken as a preset value;
s34, each circle in the x and y coordinate system has countless points corresponding to the edge of the circle, and the circles in the a and b coordinate system correspond to a plurality of circles, which is obviously represented that the circles corresponding to the countless points on the edge of the circle in the x and y coordinate system in the a and b coordinate system intersect at one point, and the coordinate of the intersection point is the circle center (a, b);
s35, finding a plurality of circles with relatively large radius by finding a large number of critical circles, finding the common circle center of the critical circles, namely, the center of the sphere of the calibration ball at the tail end of the robot tool is calculated, and the position coordinate value of the robot tool is calculated according to the center of the sphere.
A robot vision calibration control system based on binocular vision comprises a communication system and a vision system;
the communication system comprises serial port communication, wherein a Robot Studio is used for compiling a RAPID program, and the RAPID program is used for enabling an upper computer and a lower computer to communicate and interact in a serial port communication mode, changing the position of a calibration ball at the tail end of a tool of the Robot, controlling the tail end of the tool of the Robot to clamp the calibration ball by using a clamp, acquiring the current position and sending position data;
the vision system comprises two cameras vertically installed in a motion space of a robot mechanical arm, a central point is preset in the center of a camera of the camera, the camera is used for shooting an image of the calibration ball, the shot image is preprocessed, the position information of the calibration ball is obtained through a binocular vision technology, the position relation between the center of the calibration ball and the set point is calculated, the robot is controlled to enable the center of the calibration ball to move to the position point to be coincident with the set point, a demonstrator is used for recording a coordinate point, and calibration is completed.
Further, the vision system also comprises an image processing module, wherein the image processing module comprises an image graying processing module and an image binarization processing module.
Further, the vision system identifies the calibration sphere based on the hough transform and calculates the coordinates of the sphere center.
A robot vision calibration device based on binocular vision comprises a camera, a controller, a serial port communication interface, a robot and a binocular vision system;
the camera is used for shooting a calibration ball image and capturing target data, and sending the calibration ball image and the target data to the controller;
the controller is used for receiving the calibration ball image and the target data and transmitting the calibration ball image and the target data to the robot through the serial port communication interface;
the serial port communication interface is used for controlling the robot to move through a program instruction by the controller so as to complete a calibration task;
the robot is used for receiving data sent by the serial port communication interface, completing different actions by analyzing the serial port data and feeding back path data to the controller;
the binocular vision system is used for preprocessing an image of the calibration ball, acquiring position information of the calibration ball, identifying and calculating the center of the calibration ball, calculating a position coordinate value of the calibration ball according to the center of the calibration ball, feeding back a difference value of the position coordinate value and a given coordinate value to the controller, guiding the calibration ball to move towards a set point at a certain direction, angle and speed until the center of the calibration ball coincides with the set point, and recording a coordinate point by using the demonstrator to finish calibration.
Further, the visual calibration device further comprises an image processing system, and the image processing system is used for carrying out graying processing and binarization processing on the calibration ball image.
Further, the cameras include two, and the two cameras are installed perpendicular to each other in a motion space of a robot arm of the robot.
Compared with the prior art, the binocular vision-based robot vision calibration method, the control system and the device have the following advantages that:
1. the calibration is carried out by combining a visual system and an image processing technology, and the method is a pioneering technology in the calibration industry.
2. An intelligent calibration scheme is explored, and a binocular vision system is used for automatic calibration, so that the participation degree of staff is reduced.
3. An image processing technology is mastered, and the defect of low human eye calibration precision of the traditional calibration method is overcome.
4. The storage function of the controller is utilized, different tool model data are stored, tools can be directly calibrated when being replaced at each time, the complex process of traditional calibration repeated calibration is avoided, and the burden of staff is reduced.
5. Compared with the traditional calibration system, the intelligent calibration system greatly reduces the risk of tool damage caused by staff misoperation.
6. An efficient and accurate calibration system is established, a new intelligent calibration way is developed, the calibration efficiency is improved for enterprises, and the calibration cost is reduced.
7. The point marking is taken as an entry point, and the digital and intelligent development of the marking technology in the manufacturing industry is promoted.
Additional features and advantages of the invention will be set forth in the detailed description which follows.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate an embodiment of the invention and, together with the description, serve to explain the invention and not to limit the invention. In the drawings:
FIG. 1 is a schematic structural diagram of an embodiment of a binocular vision-based robot vision calibration method according to the present invention;
FIG. 2 is a schematic view of a dual camera mounting configuration of the present invention;
FIG. 3 is a schematic structural diagram of an embodiment of a vision system in the binocular vision based robot vision calibration control system of the present invention;
FIG. 4 is a schematic diagram of a configuration of an embodiment of image processing for a vision system according to the present invention;
FIG. 5 is a schematic structural diagram of the binocular vision-based robot vision calibration device of the present invention;
FIG. 6 is a schematic diagram of the visual calibration process of the present invention.
Detailed Description
The following detailed description of embodiments of the invention refers to the accompanying drawings. It should be understood that the detailed description and specific examples, while indicating the present invention, are given by way of illustration and explanation only, not limitation.
According to an aspect of the present invention, there is provided a binocular vision-based robot vision calibration method, as shown in fig. 1, the method including the steps of:
s1, clamping the calibration ball at the tail end of the robot tool by using a clamp;
s2, presetting a central point at the center of the camera, shooting the image of the calibration ball by using the camera, and preprocessing the shot image to obtain the environmental information of the calibration ball;
s3, obtaining the position information of the calibration ball through the binocular vision technology, identifying and calculating the center of the calibration ball, and calculating the position coordinate value according to the center of the calibration ball;
s4, comparing the coordinate value of the calibration sphere center with the set point, and feeding back the difference to the controller;
and S5, the controller sends out a control instruction, the camera and the robot are communicated and interacted in a serial port communication mode, the position of the calibration ball at the tail end of the tool of the robot is moved until the center of the calibration ball coincides with the set point, and the coordinate point is recorded by using the demonstrator to finish calibration.
In the embodiment of the invention, the robot vision calibration method based on binocular vision combines a vision system, image processing and a robot technology, adopts a robot to match the binocular vision system, performs communication interaction in a serial port communication mode, and performs calibration by means of Hough image processing, thereby solving the problems of large manpower consumption, large vision error, tedious repeated calibration, tool damage risk and the like in the traditional four-point calibration method.
The robot vision calibration method based on binocular vision is suitable for TCP calibration of any type of robot, and is particularly suitable for TCP calibration of an ABB robot. The ABB robot IRB120 is the smallest one of 6-axis industrial robots, the specification load is only 3kg, but the robot can complete the functions completed by basically all models of robots, and the robot uses a RAPID programming language, wherein RAPID is a simpler programming language, and different functions such as controlling the movement, input/output, communication and simulation of the robot can be completed according to different instructions. TCP is short for a Tool center Point (Tool center Point), the calibration of TCP is the determination of the position of the Tool center Point, and the Tool center Point is provided, so that the teaching is convenient in practical application. When the calibration worker teaches by using the tool coordinate, the calibration worker can move according to the defined coordinate direction, and can easily and accurately find the position point to be moved, so that the teaching difficulty is greatly reduced.
In order to acquire more comprehensive image information of the calibration ball at the end of the robot tool, in step S2, two cameras vertically installed in the motion space of the robot arm are used to capture an image of the calibration ball, and the captured image is preprocessed after the image is acquired, so as to obtain environment information of the calibration ball.
In order to facilitate subsequent calibration, in step S2, the captured image is subjected to a graying process and a binarization process. Firstly, preprocessing an image, converting a color image acquired by a camera into a gray image by a system, namely graying the image, wherein the gray image can still clearly reflect the contour and the feature texture of the whole color image on the basis of well reserving the contour and the feature texture in the color image; the grayscale image is then smoothed to eliminate or suppress noise in the image. Specifically, the graying processing is as follows: the process of converting a color image into an off-white image through special processing is called filtering and graying. This gray color is transformed from white, and by different values, the gray color also differs in degree. The binarization processing comprises the following steps: it is a process of calculating the threshold values of the gray data values of the pixel groups and nodes on the digital image. The resulting image is binarized, so called an image consisting of 0 and 1, i.e. black and white. Therefore, each shot element square is composed of 1 and 0, so that the computer can quickly identify the boundary, the boundary composed of various shapes such as a circle, a square and the like can be obtained through the boundary, and the required target point can be obtained through automatic adjustment of an algorithm.
In order to more quickly and conveniently identify and calculate the center of sphere of the calibration ball, the step S3 further includes the following sub-steps:
s31, identifying and positioning the calibration ball at the tail end of the robot tool after image preprocessing, and acquiring the position information of the calibration ball;
s32, performing edge detection on the circle in the image by using Hough transform;
s33, coordinate transformation is carried out, the equation of the circle in the plane coordinate system is transformed into a parameter equation, namely, the xy coordinate system is transformed into an ab coordinate system, and the equation of the circle can be expressed as a formula (1);
(x-a)2+(y-b)2=r2 (1)
the three degrees of freedom are coordinates a and b of the circle center and a radius r respectively, which are a three-dimensional space, and r is taken as a preset value;
s34, each circle in the x and y coordinate system has countless points corresponding to the edge of the circle, and the circles in the a and b coordinate system correspond to a plurality of circles, which is obviously represented that the circles corresponding to the countless points on the edge of the circle in the x and y coordinate system in the a and b coordinate system intersect at one point, and the coordinate of the intersection point is the circle center (a, b);
s35, finding a plurality of circles with relatively large radius by finding a large number of critical circles, finding the common circle center of the critical circles, namely, the center of the sphere of the calibration ball at the tail end of the robot tool is calculated, and the position coordinate value of the robot tool is calculated according to the center of the sphere.
In the above, firstly, the calibration ball of the target object is identified, and there are many methods for identifying the circle. The general equation of a circle can be expressed as formula (1), and there are three degrees of freedom, namely coordinates a and b of the center of the circle and a radius r, which is a three-dimensional space. Finally, a large number of critical circles are found, the common circle center of the critical circles is found, the obtained circle data are compared with preset coordinates, a difference value is found out, data are sent to a serial port, the position of a calibration ball is moved, and the calibration ball is drawn close to a set point.
According to another aspect of the present invention, there is provided a binocular vision based robot vision calibration control system, as shown in fig. 2 to 4, the control system includes a communication system and a vision system;
the communication system comprises serial port communication, wherein a Robot Studio is used for compiling a RAPID program, and the RAPID program is used for enabling an upper computer and a lower computer to communicate and interact in a serial port communication mode, changing the position of a calibration ball at the tail end of a tool of the Robot, controlling the tail end of the tool of the Robot to clamp the calibration ball by using a clamp, acquiring the current position and sending position data;
the vision system comprises two cameras vertically installed in a motion space of a robot mechanical arm, a central point is preset in the center of a camera of the camera, the camera is used for shooting an image of the calibration ball, the shot image is preprocessed, the position information of the calibration ball is obtained through a binocular vision technology, the position relation between the center of the calibration ball and the set point is calculated, the robot is controlled to enable the center of the calibration ball to move to the position point to be coincident with the set point, a demonstrator is used for recording a coordinate point, and calibration is completed.
In the embodiment of the invention, the communication system can enable the upper computer and the lower computer to communicate and interact in a serial port communication mode, so that the robot is controlled to drive the calibration ball to move; and acquiring an image of the calibration ball through the vision system, positioning the calibration ball, acquiring the position of the calibration ball, comparing the position with a set point, and guiding the calibration ball to move towards the set point at a certain direction, angle and speed until the calibration ball coincides with the set point to finish calibration. Therefore, dynamic data of the center of the calibration ball can be collected and displayed more conveniently and timely, and the position of the calibration ball is controlled, so that the camera can be used for controlling the moving center of the calibration ball only by knowing the position of the calibration ball in real time. The control system needs to give information such as the position of a calibration point in advance, and then completes the calibration process according to a taught motion mode by combining the data collected by the camera and serial port communication. The control system collects calibration ball information through the vision system so as to control the robot, has the characteristics of high accuracy, good real-time performance and the like compared with the traditional method, and can better adapt to environmental changes.
In order to more rapidly carry out positioning control on the calibration ball, the vision system further comprises an image processing module, and the image processing module comprises an image graying processing module and an image binarization processing module.
In order to calculate the sphere center of the calibration sphere more accurately and quickly, the vision system identifies the calibration sphere and calculates the coordinates of the sphere center of the calibration sphere based on Hough transform.
According to another aspect of the present invention, there is provided a robot vision calibration apparatus based on binocular vision, as shown in fig. 5, the robot vision calibration apparatus includes a camera, a controller, a serial communication interface, a robot, and a binocular vision system;
the camera is used for shooting a calibration ball image and capturing target data, and sending the calibration ball image and the target data to the controller;
the controller is used for receiving the calibration ball image and the target data and transmitting the calibration ball image and the target data to the robot through the serial port communication interface;
the serial port communication interface is used for controlling the robot to move through a program instruction by the controller so as to complete a calibration task;
the robot is used for receiving data sent by the serial port communication interface, completing different actions by analyzing the serial port data and feeding back path data to the controller;
the binocular vision system is used for preprocessing an image of the calibration ball, acquiring position information of the calibration ball, identifying and calculating the center of the calibration ball, calculating a position coordinate value of the calibration ball according to the center of the calibration ball, feeding back a difference value of the position coordinate value and a given coordinate value to the controller, guiding the calibration ball to move towards a set point at a certain direction, angle and speed until the center of the calibration ball coincides with the set point, and recording a coordinate point by using the demonstrator to finish calibration.
In the embodiment of the invention, the image of the calibration ball is collected by a camera, the image is preprocessed to obtain the position information of the calibration ball, the center of the calibration ball is identified and calculated, the position coordinate value of the calibration ball is calculated according to the center of the calibration ball, the difference value between the position coordinate value and a given coordinate is fed back to a controller, the controller controls a Robot Studio to write a RAPID program, the RAPID program is transmitted to the Robot through a serial communication interface, the Robot is controlled to move, the calibration ball is guided to move towards a set point in a certain direction, angle and speed until the center of the calibration ball coincides with the set point, a demonstrator is used for recording a coordinate point, and calibration is completed. Compared with the traditional demonstrator calibration, the method for calibrating by using the vision has the characteristics of high speed, high accuracy, no need of setting a reference point, avoidance of collision and the like, thereby greatly improving the efficiency, reducing the time cost, increasing the unit time output value of the production line and further bringing great economic benefit to manufacturing enterprises.
In the above, the controller is a PC, and is used for the upper computer to control the Robot Studio software to write RAPID program, and the Robot becomes flexible through the program, and can also be used as a display device, so that each action of the Robot and real-time data of the Robot can be seen in the PC.
In order to be able to acquire more comprehensive images, the cameras comprise two, and the two cameras are vertically arranged in the motion space of the mechanical arm of the robot.
Further, the visual calibration device further comprises an image processing system, and the image processing system is used for carrying out graying processing and binarization processing on the calibration ball image.
To facilitate understanding of the calibration process, the camera calibration process is utilized as described in detail below: a calibration ball is fixed at the tail end of a tool of the robot to be used as a reference object, so that the robot is convenient to identify and automatically regulate and control; peripheral equipment installation: two cameras forming an included angle of 90 degrees are installed in a motion space of the mechanical arm to construct a three-dimensional space; the whole calibration process is mainly divided into a right camera calibration part and a rear camera calibration part. In the calibration process, firstly, a camera is used to obtain image information in real time, and as shown in fig. 6 (a), it can be seen that the calibration ball is located in the fourth quadrant. And then the robot is controlled to move towards the positive direction x, and the robot moves to the center of the vertical line of the Z axis of the screen in a stepping mode by 1mm each time. After judging whether the center of the cross line is reached, if the center is reached, the direction of the Z axis is calibrated, as shown in (c) to (d) in fig. 6, the robot is moved to the positive direction of the Z axis by using the same method until the center point is reached, and the calibration of the right camera is finished; and the program opens the rear camera to start calibration, and completes calibration of the Y axis by the same method. The calibration process of the rear camera is as shown in fig. 6 (e) to (g), and the current position point is recorded after the calibration is completed.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.

Claims (10)

1.一种基于双目视觉的机器人视觉标定方法,其特征在于,基于双目视觉的机器人视觉标定方法包括以下步骤:1. a robot vision calibration method based on binocular vision, is characterized in that, the robot vision calibration method based on binocular vision comprises the following steps: S1,在机器人工具末端使用夹具夹起标定球;S1, use a clamp to clamp the calibration ball at the end of the robot tool; S2,在相机摄像头中心预先设置一个中心点,利用相机拍摄标定球的图像,对拍摄的图像进行预处理,得到标定球的环境信息;S2, preset a center point in the center of the camera, use the camera to capture an image of the calibration sphere, and preprocess the captured image to obtain the environmental information of the calibration sphere; S3,通过双目视觉技术获取标定球的位置信息,识别计算出标定球的球心,根据球心计算出其位置坐标值;S3, obtain the position information of the calibration ball through binocular vision technology, identify and calculate the center of the calibration ball, and calculate its position coordinate value according to the center of the ball; S4,将标定球球心坐标值与设置点进行比对,将差值反馈至控制器;S4, compare the coordinate value of the calibration ball center with the set point, and feed the difference back to the controller; S5,控制器发出控制指令,通过串口通信方式使相机和机器人通信进行交互,移动机器人的工具末端标定球的位置,直至标定球球心与设置点重合,使用示教器记录坐标点,完成标定。S5, the controller sends out a control command, communicates the camera and the robot through serial communication, moves the tool end of the robot to calibrate the position of the ball, until the center of the calibration ball coincides with the set point, and uses the teach pendant to record the coordinate points to complete the calibration . 2.根据权利要求1所述的基于双目视觉的机器人视觉标定系统方法,其特征在于,所述步骤S2中,利用两个垂直安装在机器人机械臂运动空间中的相机拍摄标定球的图像,采集图像后对拍摄的图像进行预处理,得到标定球的环境信息。2. the robot vision calibration system method based on binocular vision according to claim 1, is characterized in that, in described step S2, utilizes two cameras that are vertically installed in the robot arm movement space to photograph the image of the calibration ball, After the image is collected, the captured image is preprocessed to obtain the environmental information of the calibration sphere. 3.根据权利要求2所述的基于双目视觉的机器人视觉标定方法,其特征在于,所述步骤S2中,对拍摄的图像进行灰度化处理和进行二值化处理。3 . The robot vision calibration method based on binocular vision according to claim 2 , wherein, in the step S2 , grayscale processing and binarization processing are performed on the captured image. 4 . 4.根据权利要求1所述的基于双目视觉的机器人视觉标定方法,其特征在于,所述步骤S3还包括以下子步骤:4. the robot vision calibration method based on binocular vision according to claim 1, is characterized in that, described step S3 also comprises following substep: S31,经过图像预处理后经过图像预处理后对机器人工具末端标定球进行识别定位,获取标定球的位置信息;S31, after image preprocessing, identify and locate the calibration ball at the end of the robot tool after image preprocessing, and obtain position information of the calibration ball; S32,使用霍夫变换对图像中的圆进行边缘检测;S32, use Hough transform to perform edge detection on the circle in the image; S33,进行坐标变换,将圆形在平面坐标系中的方程变换成参数方程,即由xy坐标系转换到ab坐标系,圆的方程表示为公式(1);S33, perform coordinate transformation, and transform the equation of the circle in the plane coordinate system into a parametric equation, that is, from the xy coordinate system to the ab coordinate system, and the equation of the circle is expressed as formula (1); (x-a)2+(y-b)2=r2 (1)(xa) 2 +(yb) 2 =r 2 (1) 其中,三个自由度分别是圆心的坐标(a,b)和半径r,把r当成一个预先设定;Among them, the three degrees of freedom are the coordinates (a, b) of the center of the circle and the radius r, and r is regarded as a preset; S34,x、y坐标系中一个圆的边所对应的有N个点,在a、b坐标中就会对应N个圆,明显表现为x、y坐标中圆的边上的N个点在a、b坐标系中所对应的圆都会交于一点,这个交点的坐标就是圆心(a,b);S34, there are N points corresponding to the edge of a circle in the x, y coordinate system, and N circles corresponding to the a and b coordinates, which is obviously manifested as the N points on the edge of the circle in the x, y coordinates. The corresponding circles in the a and b coordinate systems will all intersect at a point, and the coordinates of this intersection point are the center of the circle (a, b); S35,通过找取多个临界圆,找到他们共同的圆心,即为计算机器人工具末端标定球球心,根据球心计算出其位置坐标值。S35, by finding a plurality of critical circles and finding their common center, that is, calculating the center of the calibration ball at the end of the robot tool, and calculating its position coordinate value according to the center of the ball. 5.一种基于双目视觉的机器人视觉标定控制系统,其特征在于,包括通信系统和视觉系统;5. A robot vision calibration control system based on binocular vision, characterized in that, comprising a communication system and a vision system; 所述通信系统包括串口通信,使用Robot Studio编写RAPID程序,用于通过串口通信方式使上位机和下位机通信进行交互,改变机器人的工具末端标定球的位置,并控制机器人的工具末端使用夹具夹起标定球、获取当前位置、发送位置数据;The communication system includes serial communication, and Robot Studio is used to write a RAPID program, which is used to communicate between the upper computer and the lower computer through serial communication, change the position of the calibration ball at the end of the robot's tool, and control the end of the robot's tool to use a clamp clip. Start calibrating the ball, get the current position, and send the position data; 所述视觉系统包括两个垂直安装在机器人机械臂运动空间中的相机,在相机摄像头中心预先设置一个中心点,利用相机拍摄标定球的图像,对拍摄的图像进行预处理,通过双目视觉技术获取标定球的位置信息,计算标定球球心与设置点的位置关系,控制机器人使标定球球心移动至设置点与之重合,使用示教器记录坐标点,完成标定。The vision system includes two cameras vertically installed in the motion space of the robot arm, a center point is preset in the center of the camera, and the camera is used to capture the image of the calibration sphere, and the captured image is preprocessed. Obtain the position information of the calibration ball, calculate the positional relationship between the center of the calibration ball and the set point, control the robot to move the center of the calibration ball to coincide with the set point, use the teach pendant to record the coordinate points, and complete the calibration. 6.根据权利要求5所述的基于双目视觉的机器人视觉标定系统,其特征在于,所述所述视觉系统还包括图像处理模块,所述图像处理模块包括图像灰度化处理模块和图像二值化处理模块。6. The robot vision calibration system based on binocular vision according to claim 5, wherein the vision system further comprises an image processing module, and the image processing module comprises an image grayscale processing module and an image two Value processing module. 7.根据权利要求5所述的基于双目视觉的机器人视觉标定系统,其特征在于,所述视觉系统基于霍夫变换来识别标定球并计算出其球心坐标。7 . The robot vision calibration system based on binocular vision according to claim 5 , wherein the vision system recognizes the calibration sphere based on Hough transform and calculates the coordinates of the center of the sphere. 8 . 8.一种基于双目视觉的机器人视觉标定装置,其特征在于,所述视觉标定装置包括相机、控制器、串口通信接口、机器人、双目视觉系统;8. A robot vision calibration device based on binocular vision, wherein the vision calibration device comprises a camera, a controller, a serial communication interface, a robot, and a binocular vision system; 所述相机用于拍摄标定球图像和抓取目标数据,并将标定球图像和目标数据发送至所述控制器;The camera is used for photographing a calibration sphere image and grabbing target data, and sending the calibration sphere image and target data to the controller; 所述控制器用于接收标定球图像和目标数据,并通过所述串口通信接口传输至所述机器人;The controller is used to receive the calibration sphere image and target data, and transmit them to the robot through the serial communication interface; 所述串口通信接口用于控制器通过程序指令控制机器人移动,以完成标定任务;The serial communication interface is used for the controller to control the movement of the robot through program instructions to complete the calibration task; 所述机器人用于接收串口通信接口的发送的数据,经过解析串口数据完成不同的动作,并将路径数据反馈至控制器;The robot is used to receive the data sent by the serial port communication interface, complete different actions by parsing the serial port data, and feed back the path data to the controller; 所述双目视觉系统用于对标定球图像进行预处理,获取标定球的位置信息,识别计算出标定球的球心,根据球心计算出其位置坐标值,与给定坐标的差值,反馈至控制器,并引导标定球向设置点以一定的方向、角度和速度移动,直至标定球球心与设置点重合,使用示教器记录坐标点,完成标定。The binocular vision system is used to preprocess the calibration sphere image, obtain the position information of the calibration sphere, identify and calculate the sphere center of the calibration sphere, calculate its position coordinate value according to the sphere center, and calculate the difference value from the given coordinate, Feedback to the controller, and guide the calibration ball to move to the set point in a certain direction, angle and speed until the center of the calibration ball coincides with the set point, and use the teach pendant to record the coordinate points to complete the calibration. 9.根据权利要求8所述的基于双目视觉的机器人视觉标定装置,其特征在于,所述视觉标定装置还包括图像处理系统,所述所述图像处理系统用于对标定球图像进行灰度化处理和进行二值化处理。9 . The robot vision calibration device based on binocular vision according to claim 8 , wherein the visual calibration device further comprises an image processing system, and the image processing system is used to perform grayscale on the calibration sphere image. 10 . processing and binarization. 10.根据权利要求8所述的基于双目视觉的机器人视觉标定装置,其特征在于,所述相机包括两个,两个所述相机互相垂直地安装在所述机器人的机械臂的运动空间中。10 . The robot vision calibration device based on binocular vision according to claim 8 , wherein the camera comprises two, and the two cameras are installed in the motion space of the robotic arm of the robot perpendicular to each other. 11 . .
CN202110600899.0A 2021-05-31 2021-05-31 Robot vision calibration method, control system and device based on binocular vision Withdrawn CN113334380A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110600899.0A CN113334380A (en) 2021-05-31 2021-05-31 Robot vision calibration method, control system and device based on binocular vision

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110600899.0A CN113334380A (en) 2021-05-31 2021-05-31 Robot vision calibration method, control system and device based on binocular vision

Publications (1)

Publication Number Publication Date
CN113334380A true CN113334380A (en) 2021-09-03

Family

ID=77472802

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110600899.0A Withdrawn CN113334380A (en) 2021-05-31 2021-05-31 Robot vision calibration method, control system and device based on binocular vision

Country Status (1)

Country Link
CN (1) CN113334380A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114347027A (en) * 2022-01-08 2022-04-15 天晟智享(常州)机器人科技有限公司 Pose calibration method of 3D camera relative to mechanical arm
CN114536340A (en) * 2022-03-11 2022-05-27 南通西塔自动化科技有限公司 Automatic grabbing method and system for iron roughneck based on machine vision assistance
CN117598782A (en) * 2023-09-28 2024-02-27 杭州盛星医疗科技有限公司 Surgical navigation method, device, equipment and medium for percutaneous puncture surgery

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114347027A (en) * 2022-01-08 2022-04-15 天晟智享(常州)机器人科技有限公司 Pose calibration method of 3D camera relative to mechanical arm
CN114536340A (en) * 2022-03-11 2022-05-27 南通西塔自动化科技有限公司 Automatic grabbing method and system for iron roughneck based on machine vision assistance
CN117598782A (en) * 2023-09-28 2024-02-27 杭州盛星医疗科技有限公司 Surgical navigation method, device, equipment and medium for percutaneous puncture surgery
CN117598782B (en) * 2023-09-28 2024-06-04 苏州盛星医疗器械有限公司 Surgical navigation method, device, equipment and medium for percutaneous puncture surgery

Similar Documents

Publication Publication Date Title
CN110509300B (en) Steel hoop processing and feeding control system and control method based on three-dimensional visual guidance
JP4021413B2 (en) Measuring device
CN113334380A (en) Robot vision calibration method, control system and device based on binocular vision
CN110202573B (en) Full-automatic hand-eye calibration and working plane calibration method and device
CN111823223B (en) Robot arm grabbing control system and method based on intelligent stereoscopic vision
CN108827154A (en) A kind of robot is without teaching grasping means, device and computer readable storage medium
CN113379849A (en) Robot autonomous recognition intelligent grabbing method and system based on depth camera
JP7191309B2 (en) Automatic Guidance, Positioning and Real-time Correction Method for Laser Projection Marking Using Camera
CN112958960B (en) Robot hand-eye calibration device based on optical target
CN113146172A (en) Multi-vision-based detection and assembly system and method
CN113500593B (en) Method for grabbing designated part of shaft workpiece for feeding
CN110722558B (en) Origin correction method and device for robot, controller and storage medium
CN111645111A (en) Intelligent manufacturing system and method based on industrial robot
US12128571B2 (en) 3D computer-vision system with variable spatial resolution
Hsu et al. Development of a faster classification system for metal parts using machine vision under different lighting environments
CN114800574B (en) A robot automated welding system and method based on dual three-dimensional cameras
CN109859280A (en) Camera calibration system and method
CN114643578A (en) Calibration device and method for improving robot vision guide precision
CN115629066A (en) A method and device for automatic wiring based on visual guidance
CN111993420A (en) Fixed binocular vision 3D guide piece feeding system
CN113838147B (en) Blade assembly visual guiding method and system based on depth camera
CN210589323U (en) Steel hoop processing feeding control system based on three-dimensional visual guidance
CN110421565B (en) Robot global positioning and measuring system and method for practical training
CN111563935B (en) Visual positioning method for honeycomb holes of honeycomb sectional material
CN211028657U (en) Intelligent welding robot system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WW01 Invention patent application withdrawn after publication

Application publication date: 20210903

WW01 Invention patent application withdrawn after publication