CN101957176B - High-precision automobile door detection method based on robot combined with camera calibration - Google Patents
High-precision automobile door detection method based on robot combined with camera calibration Download PDFInfo
- Publication number
- CN101957176B CN101957176B CN2010102867427A CN201010286742A CN101957176B CN 101957176 B CN101957176 B CN 101957176B CN 2010102867427 A CN2010102867427 A CN 2010102867427A CN 201010286742 A CN201010286742 A CN 201010286742A CN 101957176 B CN101957176 B CN 101957176B
- Authority
- CN
- China
- Prior art keywords
- car door
- camera
- standard car
- measured
- dimensional space
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Length Measuring Devices By Optical Means (AREA)
Abstract
本发明公开了基于机器人结合相机定标的高精度汽车车门的检测方法，它包括：(1)将标准车门定位在一个固定位置，在标准车门和被测车门的边缘设定多个被测点并在标准车门附近设定多个标记点，标定标记点的坐标；(2)机器人移动到被测点的附近，记下此时的机器人的坐标，第一相机拍摄附近多个标记点的图像；确定第一相机的坐标，计算出第二相机的坐标坐标系与工件坐标系的关系；(3)第二相机对第一被测点进行拍摄，求解第一被测点的三维空间坐标；(4)重复完成标准车门被测点的三维空间坐标的测定；(5)将被测车门固定在标准车门的位置，测出被测车门边缘上多个被测点的在工件坐标系中的坐标。采用本方法将测量精度提高到0.1mm。
The invention discloses a high-precision automobile door detection method based on robot combined with camera calibration, which includes: (1) positioning the standard car door at a fixed position, and setting a plurality of measured points on the edge of the standard car door and the tested car door And set a plurality of marking points near the standard car door, and demarcate the coordinates of the marking points; (2) the robot moves to the vicinity of the measured point, write down the coordinates of the robot at this time, and the first camera shoots images of multiple marking points nearby ; Determine the coordinates of the first camera, calculate the relationship between the coordinate coordinate system of the second camera and the workpiece coordinate system; (3) the second camera shoots the first measured point, and solve the three-dimensional space coordinates of the first measured point; (4) repeatedly finish the mensuration of the three-dimensional coordinates of the measured point of the standard car door; (5) the measured car door is fixed on the position of the standard car door, and measure the position of a plurality of measured points on the edge of the tested car door in the workpiece coordinate system coordinate. The measurement accuracy is improved to 0.1mm by this method.
Description
Technical field
The present invention relates to a kind of detection method of automobile cubing, the invention particularly relates to a kind of detection method of the high precision arrangements for automotive doors based on the calibration of robot combining camera.
Background technology
Auto parts must detect it before the entrucking after punching press or injection moulding are come out, and carry out by means of cubing and detect Chang Bixu.Cubing (Checking Fixture) is just causing the great attention of more and more enterprises as the important auxiliary products of die industry.Production from self needs and its higher added value, many mould enterprises with it as an important developing direction.The correlation technique of cubing as a kind of new technology, is also just introduced by increasing mould enterprise.
The automobile cubing is by detection architecture location structure, clamping structure, supporting construction, base, and other slave parts constitute.Existing design is according to concrete part, according to inspection requirements, one by one, design corresponding structure progressively, and then is assembled together, and finally realizes the exploitation of cubing.This is a complicacy and loaded down with trivial details process, and each design all will start anew, and is difficult to reuse previous design achievement; Can not directly bring utilization to expert's mature experience; Cause duplication of labour amount big, design loaded down with trivial details, to the exploitation designer require problems such as height.
At present, machine vision metrology has obtained development apace, makes vision sensor make the exploitation of cubing that great development arranged to the measurement of putting on the part through robot movement, has improved the flexibility of cubing design.Present detection method that adopts usually based on this technology moves through the computer-controlled robot then and measures each measured point for camera is contained on robot end's the flange, directly obtains the D coordinates value of measured point through coordinate transform.Yet, commercial now most of industrial robots, its positional precision is directly measured for robot and bring bigger error than the low one magnitude of its repeatable accuracy.
Summary of the invention
The objective of the invention is to overcome the deficiency of prior art; Provide a kind of and need not locate workpiece; Eliminate the positioning error that the location workpiece brings, improved the detection method of the high precision arrangements for automotive doors of calibrating based on the robot combining camera of flexibility and the automaticity of cubing simultaneously.
The detection method of the high precision arrangements for automotive doors based on the calibration of robot combining camera of the present invention, it may further comprise the steps:
(1) the standard car door is positioned at a fixed position; Set a plurality of measured points at the edge of standard car door and tested car door and near the standard car door, set a plurality of gauge points, set up the stereoscopic vision measuring system and demarcate the three dimensional space coordinate of the inside and outside parameter of first and second cameras and described a plurality of gauge points;
(2) computer-controlled robot move to the measured point near, write down the three dimensional space coordinate of robot of this moment, near the image of a plurality of gauge points first camera is taken; Through the three dimensional space coordinate of definite first camera of three dimensional space coordinate conversion,, calculate the coordinates system of second camera and the relation of workpiece coordinate system then through first camera and the second camera external position parameter;
(3) computer starting second camera is taken first measured point, by the three dimensional space coordinate of stereo vision sensor three-dimensional measurement model solution first measured point in workpiece coordinate system;
(4) repeat the mensuration that all three dimensional space coordinate of standard car door measured point in workpiece coordinate system are accomplished in described step (2)-(3);
(5) the standard car door is changed; Tested car door is fixed on the position of standard car door, measures the three dimensional space coordinate in workpiece coordinate system of a plurality of measured points on the tested vehicle door edge according to step (2)-(4) with the same trajectories of the mensuration of a plurality of gauge points of accomplishing standard car door mobile robot successively then;
(6) measurement data to a plurality of measured points at the edge of standard car door and tested car door compares, to judge the whether accords with production requirement of tested car door.
Adopt the beneficial effect of the inventive method to be: through around part, pasting a series of gauge points; (sensor coordinate system is exactly a coordinate system of oneself definition for camera measurement markers point location camera through the robot end and sensor (sensor is by camera and laser constitution) coordinate system; Calculate for ease; General sensor coordinate system and first camera coordinates system overlap); Control computer starts the measured point on the another one camera shooting part then; And then calculate the measured point the coordinate of workpiece coordinate system (can sensor coordinate system is unified to workpiece coordinate system) through coordinate transform like this completion eliminated the error that robot causes, can measuring accuracy be brought up to 0.1mm through experiment showed, the method.Employing has improved the flexibility of cubing greatly based on the robotic vision measuring system, and through a camera Calibration, another one camera photographic images improves measuring accuracy and automaticity.
Description of drawings
Fig. 1 is the mensuration fundamental diagram that adopts the detection method examination criteria car door of the high precision arrangements for automotive doors based on robot combining camera calibration of the present invention;
Fig. 2 adopts the detection method of the high precision arrangements for automotive doors based on robot combining camera calibration of the present invention to detect the mensuration fundamental diagram of tested car door.
Embodiment
Below in conjunction with concrete embodiment, and, the present invention is done further explanation with reference to accompanying drawing:
Detection method based on the high precision arrangements for automotive doors of robot combining camera calibration; At first the standard car door is positioned at a fixed position; Set a plurality of measured points (like A, B) at the edge of standard car door and tested car door and near the standard car door, set a plurality of gauge points that (method confirmed of standard car door and tested car door measured point can be to paste a gauge point in the same position of standard car door and tested car door earlier; Every then separated 3cm CW is pasted a series of measured points in vehicle door edge); (the stereoscopic vision measuring system is set up and can be edited referring to Zhang Guangjun: " photoelectricity test technology " to set up the stereoscopic vision measuring system; China Measuring Press, 2008,304-307) and demarcate the inner parameter of first and second cameras and the three dimensional space coordinate of external parameter and described a plurality of gauge points; The inside calibrating parameters of first and second cameras comprises that (effective focal length f, the Δ x that comprehensively distorts, Δ y, image planes center (Cx, Cy)) and external parameter comprise (translation and rotation matrix have reflected that the three-dimensional world coordinate is tied to the transformational relation of camera coordinate system).The standard car door can adopt " 3-2-1 " positioning principle to fix.Mensuration of at first carrying out the standard car door as shown in Figure 1: the computer-controlled robot move to the measured point near; Write down the three dimensional space coordinate of the robot of this moment; First camera is taken the image of the many gauge points (these gauge points had been demarcated well with three coordinate machine or transit etc., and their coordinates under world coordinate system are known) before experiment; Confirm the three dimensional space coordinate of first camera through the three dimensional space coordinate conversion; Then through first camera and the second camera external position parameter; (being connected between first camera and second camera is rigidly connected to calculate the coordinates system of second camera and the relation of workpiece coordinate system (workpiece coordinate system is a near coordinate system that oneself defines the workpiece); Transformational relation between the camera coordinates system of first camera and the camera coordinates system of second camera can be demarcated in advance; Workpiece coordinate system is the coordinate system that is based upon on the workpiece, and the relation between workpiece coordinate system and the world coordinate system can be advanced rower calmly in experiment, has known the three dimensional space coordinate of first camera above; Just can be transformed into the three dimensional space coordinate of first camera under the world coordinate system through the good relation of prior demarcation; Then the three-dimensional coordinate under the world coordinate system is being transformed under the workpiece coordinate system, like this, just can calculating the relation between first camera and the workpiece coordinate system); Computer starting second camera is taken first measured point, by the three dimensional space coordinate of stereo vision sensor three-dimensional measurement model solution first measured point in workpiece coordinate system; Repeat above-mentioned steps and accomplish the mensuration of all three dimensional space coordinate of standard car door measured point in workpiece coordinate system.The three dimensional space coordinate of first camera confirms that method can be according to the projection model and the calibrating parameters of video camera; Respectively to the image calibration that distorts; The three dimensional space coordinate that goes out camera 1 by stereo vision sensor three-dimensional measurement model solution again (is edited referring to Zhang Guangjun: " photoelectricity test technology "; China Measuring Press, 2008,304-307).Mensuration of carrying out tested car door as shown in Figure 2 then: the standard car door is changed; Tested car door is fixed on the position of standard car door; With the mensuration of a plurality of gauge points of accomplishing the standard car door, measure the coordinate of a plurality of measured points in workpiece coordinate system on the tested vehicle door edge then with same trajectories mobile robot successively and according to the assay method of standard car door.Measurement data to a plurality of measured points at the edge of standard car door and tested car door compares at last, to judge the whether accords with production requirement of tested car door.
(1) the standard car door is positioned at a fixed position; Set a plurality of measured points at the edge of standard car door and tested car door and near the standard car door, set a plurality of gauge points, set up the stereoscopic vision measuring system and demarcate the three dimensional space coordinate of the inside and outside parameter of first and second cameras and described a plurality of gauge points;
(2) computer-controlled robot move to the measured point near, write down the three dimensional space coordinate of robot of this moment, near the image of a plurality of gauge points first camera is taken; Through the three dimensional space coordinate of definite first camera of three dimensional space coordinate conversion,, calculate the coordinates system of second camera and the relation of workpiece coordinate system then through first camera and the second camera external position parameter;
(3) computer starting second camera is taken first measured point, by the three dimensional space coordinate of stereo vision sensor three-dimensional measurement model solution first measured point in workpiece coordinate system;
(4) repeat the mensuration that all three dimensional space coordinate of standard car door measured point in workpiece coordinate system are accomplished in described step (2)-(3);
(5) the standard car door is changed; Tested car door is fixed on the position of standard car door, measures the three dimensional space coordinate in workpiece coordinate system of a plurality of measured points on the tested vehicle door edge according to step (2)-(4) with the same trajectories of the mensuration of a plurality of gauge points of accomplishing standard car door mobile robot successively then;
The three-dimensional coordinate of standard car door measured point is (x
A, y
A, z
A); The three-dimensional coordinate of tested car door be (x '
A, y '
A, z '
A); The coordinate of more tested car door and standard car door measured point, coordinate figure does not just meet production requirement with original coordinate figure is different.
Claims (1)
1. based on the detection method of the high precision arrangements for automotive doors of robot combining camera calibration, it is characterized in that it may further comprise the steps:
(1) the standard car door is positioned at a fixed position; Set a plurality of measured points at the edge of standard car door and tested car door and near the standard car door, set a plurality of gauge points, set up the stereoscopic vision measuring system and demarcate the three dimensional space coordinate of the inside and outside parameter of first and second cameras and described a plurality of gauge points; The method that standard car door and tested car door measured point are confirmed is to paste a gauge point in the same position of standard car door and tested car door earlier, and every then separated 3cm CW is pasted a series of measured points in vehicle door edge;
(2) computer-controlled robot move to the measured point near, write down the three dimensional space coordinate of robot of this moment, near the image of a plurality of gauge points first camera is taken; Through the three dimensional space coordinate of definite first camera of three dimensional space coordinate conversion,, calculate the relation of the coordinate system and the workpiece coordinate system of second camera then through first camera and the second camera external position parameter;
(3) computer starting second camera is taken first measured point, by the three dimensional space coordinate of stereo vision sensor three-dimensional measurement model solution first measured point in workpiece coordinate system;
(4) repeat the mensuration that all three dimensional space coordinate of standard car door measured point in workpiece coordinate system are accomplished in described step (2)-(3);
(5) the standard car door is changed; Tested car door is fixed on the position of standard car door, measures the three dimensional space coordinate in workpiece coordinate system of a plurality of measured points on the tested vehicle door edge according to step (2)-(4) with the same trajectories of the mensuration of a plurality of gauge points of accomplishing standard car door mobile robot successively then;
(6) measurement data to a plurality of measured points at the edge of standard car door and tested car door compares, to judge the whether accords with production requirement of tested car door.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010102867427A CN101957176B (en) | 2010-09-19 | 2010-09-19 | High-precision automobile door detection method based on robot combined with camera calibration |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010102867427A CN101957176B (en) | 2010-09-19 | 2010-09-19 | High-precision automobile door detection method based on robot combined with camera calibration |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101957176A CN101957176A (en) | 2011-01-26 |
| CN101957176B true CN101957176B (en) | 2012-05-02 |
Family
ID=43484649
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2010102867427A Expired - Fee Related CN101957176B (en) | 2010-09-19 | 2010-09-19 | High-precision automobile door detection method based on robot combined with camera calibration |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101957176B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10380764B2 (en) | 2013-12-18 | 2019-08-13 | Cognex Corporation | System and method for performing vision system planar hand-eye calibration from straight line features |
Families Citing this family (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9081026B2 (en) * | 2012-03-05 | 2015-07-14 | Nissan Motor Co., Ltd. | Opening/closing body inspection apparatus and opening/closing body inspection method |
| KR101416383B1 (en) | 2012-11-16 | 2014-07-16 | 현대자동차 주식회사 | Door inspection system for vehicle |
| DE102016205519A1 (en) * | 2016-04-04 | 2017-10-05 | Bayerische Motoren Werke Aktiengesellschaft | Mobile measuring system for the three-dimensional optical measurement of vehicles and vehicle parts |
| EP4283563A3 (en) * | 2016-06-27 | 2024-05-29 | Mobileye Vision Technologies Ltd. | Controlling host vehicle based on detected parked vehicle characteristics |
| CN106949863A (en) * | 2017-03-13 | 2017-07-14 | 重庆大学 | White body is main to spell fixture switching system repetitive positioning accuracy detection method |
| CN107803855A (en) * | 2017-12-13 | 2018-03-16 | 大连四达高技术发展有限公司 | A robot automatic positioning mechanism |
| CN108195354A (en) * | 2017-12-21 | 2018-06-22 | 长沙长泰机器人有限公司 | A kind of vehicle positioning method and vehicle positioning system based on robot |
| CN108278973B (en) * | 2018-04-28 | 2025-01-10 | 青岛海之晨工业装备有限公司 | Mobile phone case size detection device |
| CN109530984A (en) * | 2018-11-19 | 2019-03-29 | 施努卡(苏州)智能装备有限公司 | Vision positioning welding and assembling method |
| CN109883326A (en) * | 2019-03-29 | 2019-06-14 | 湖南省鹰眼在线电子科技有限公司 | A kind of videographic measurment formula automobile three-dimensional four-wheel aligner method, system and medium |
| CN109945782B (en) * | 2019-04-02 | 2020-12-08 | 易思维（杭州）科技有限公司 | Method for detecting key position of super-long body-in-white |
| CN110332885A (en) * | 2019-06-03 | 2019-10-15 | 桂林能创信息科技有限公司 | A kind of robot grating is taken pictures the automated execution method of scanning system detection data |
| CN110500967A (en) * | 2019-07-08 | 2019-11-26 | 广西工业职业技术学院 | A method for industrial robot-guided three-dimensional line scanning measurement |
| CN113246135B (en) * | 2021-06-03 | 2021-10-12 | 季华实验室 | Robot hand-eye calibration method and device, electronic equipment and storage medium |
| CN114543673B (en) * | 2022-02-14 | 2023-12-08 | 湖北工业大学 | A visual measurement platform for aircraft landing gear and its measurement method |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6028672A (en) * | 1996-09-30 | 2000-02-22 | Zheng J. Geng | High speed three dimensional imaging method |
| CN1878318A (en) * | 2006-05-17 | 2006-12-13 | 浙江大学 | Three-dimensional small-sized scene rebuilding method based on dual-camera and its device |
| CN101334276A (en) * | 2007-06-27 | 2008-12-31 | 中国科学院自动化研究所 | A visual measurement method and device |
| CN101566465A (en) * | 2009-05-18 | 2009-10-28 | 西安交通大学 | Method for measuring object deformation in real time |
-
2010
- 2010-09-19 CN CN2010102867427A patent/CN101957176B/en not_active Expired - Fee Related
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6028672A (en) * | 1996-09-30 | 2000-02-22 | Zheng J. Geng | High speed three dimensional imaging method |
| CN1878318A (en) * | 2006-05-17 | 2006-12-13 | 浙江大学 | Three-dimensional small-sized scene rebuilding method based on dual-camera and its device |
| CN101334276A (en) * | 2007-06-27 | 2008-12-31 | 中国科学院自动化研究所 | A visual measurement method and device |
| CN101566465A (en) * | 2009-05-18 | 2009-10-28 | 西安交通大学 | Method for measuring object deformation in real time |
Non-Patent Citations (1)
| Title |
|---|
| 郑俊.立体视觉坐标测量技术在车身生产线中的应用.《汽车科技》.2004,(第6期),30-33. * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10380764B2 (en) | 2013-12-18 | 2019-08-13 | Cognex Corporation | System and method for performing vision system planar hand-eye calibration from straight line features |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101957176A (en) | 2011-01-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101957176B (en) | High-precision automobile door detection method based on robot combined with camera calibration | |
| CN101949687A (en) | Detection method of automobile door based on vision measurement | |
| Yin et al. | Development and calibration of an integrated 3D scanning system for high-accuracy large-scale metrology | |
| CN102135417B (en) | A fully automatic 3D feature extraction method | |
| US8520067B2 (en) | Method for calibrating a measuring system | |
| US8019147B2 (en) | Three-dimensional data registration method for vision measurement in flow style based on double-sided target | |
| FI127555B (en) | Machine vision system with coordinate correction | |
| CN101968343B (en) | Method for detecting automobile door based on robot monocular vision measurement | |
| CN102607502A (en) | Automatic detection device and method for size of automobile rear axle assembly | |
| CN104463833A (en) | Method and system for calibrating camera parameters of one-dimensional area array camera set | |
| CN109249612B (en) | Airplane control rod clamping tool design method based on three-dimensional printing | |
| WO2023097491A1 (en) | Machine vision inspection method, and inspection apparatus and inspection system therefor | |
| JP2023129329A (en) | Method for calibrating portable reference sensor system, portable reference sensor system, and use of portable reference sensor system | |
| CN103994726A (en) | Method for detecting fitting clearance between sheet metal part and mould | |
| CN101561831A (en) | Spare part outside measurement computing system and method | |
| US9426425B2 (en) | Method for measuring large components | |
| CN110044266B (en) | Photogrammetry system based on speckle projection | |
| Rejc et al. | Dimensional measurements of a gray-iron object using a robot and a laser displacement sensor | |
| US11953310B2 (en) | Method for measuring gap and flush of vehicle parts and measuring tunnel | |
| CN108592789A (en) | A kind of steel construction factory pre-assembly method based on BIM and machine vision technique | |
| CN108592838B (en) | Calibration method and device of tool coordinate system and computer storage medium | |
| CN109373901B (en) | Method for calculating center position of hole on plane | |
| CN114777607B (en) | A method for detecting coaxiality error of a rotary body | |
| CN106524910A (en) | Execution mechanism visual calibration method | |
| CN100538255C (en) | Method and system for measuring on-machine for micro-dimension of element |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20120502 Termination date: 20210919 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |