CN111780724A - Vision tool alignment device and method - Google Patents
Vision tool alignment device and method Download PDFInfo
- Publication number
- CN111780724A CN111780724A CN202010834952.9A CN202010834952A CN111780724A CN 111780724 A CN111780724 A CN 111780724A CN 202010834952 A CN202010834952 A CN 202010834952A CN 111780724 A CN111780724 A CN 111780724A
- Authority
- CN
- China
- Prior art keywords
- light source
- reflecting mirror
- reflector
- camera
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C11/00—Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
- G01C11/02—Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C11/00—Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
- G01C11/04—Interpretation of pictures
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
Description
技术领域technical field
本发明涉及自动化对位领域,特别涉及一种视觉工具对位装置及方法。The invention relates to the field of automatic alignment, in particular to a visual tool alignment device and method.
背景技术Background technique
随着科技的日益发展,各行业对工具对位的需求量越来越大,要求也越来越高。在产品的制造、加工、测试等生产过程中,对位的应用愈加广泛,尤其是精密点胶领域的针头对位,由于对精度和速度的要求越来越高,现有的方法已经难于满足需要。With the increasing development of science and technology, the demand for tool alignment in various industries is increasing, and the requirements are getting higher and higher. In the production process of product manufacturing, processing, testing, etc., the application of alignment is more and more extensive, especially the needle alignment in the field of precision dispensing. Due to the increasing requirements for accuracy and speed, the existing methods have been difficult to meet. need.
现有的自动工具对位方法主要分为接触式工具对位方法和非接触式工具对位方法,存在以下缺点:接触式对位方法,如在需对位工具(如点胶针头)配置压力传感器,需对位工具在接触过程中会发生工具的形变误差及磨损或损坏,实际生产线中应用已逐渐减少;非接触式工具对位主要有利用光纤激光工具对位方法、利用摄像头CCD相机工具对位方法,而利用光纤激光工具对位方法由于很难通过一次或几次调整得到正确的位置,存在操作不方便、对位精度低、无法实现快速对位、成本高、耗时长、效率低等问题。The existing automatic tool alignment methods are mainly divided into contact tool alignment methods and non-contact tool alignment methods, which have the following disadvantages: contact alignment methods, such as configuring pressure on the required alignment tools (such as dispensing needles) The sensor, the tool needs to be aligned during the contact process, and the tool deformation error and wear or damage will occur, and the application in the actual production line has gradually decreased; the non-contact tool alignment mainly uses the fiber laser tool alignment method, the camera CCD camera tool Alignment method, and the use of fiber laser tool alignment method is difficult to obtain the correct position through one or several adjustments, which is inconvenient to operate, low in alignment accuracy, unable to achieve rapid alignment, high cost, long time consuming, and low efficiency. And other issues.
发明内容SUMMARY OF THE INVENTION
有鉴于此,本发明实施例提供的一种视觉工具对位装置及方法,可以快速得到需对位工具的位置,实现快速自动对位,极大的提高了对位的精度和可靠性,提高了工具对位的定位精度和工作效率,操作简便快捷。In view of this, a visual tool alignment device and method provided by the embodiment of the present invention can quickly obtain the position of the tool to be aligned, realize fast automatic alignment, greatly improve the accuracy and reliability of alignment, and improve the accuracy and reliability of alignment. The positioning accuracy and work efficiency of tool alignment are improved, and the operation is simple and quick.
本发明解决上述技术问题所采用的技术方案如下:The technical scheme adopted by the present invention to solve the above-mentioned technical problems is as follows:
根据本发明实施例的一个方面,提供的一种视觉工具对位装置,包括壳体、第一光源、第二光源、第一反射镜组、第二反射镜组、半透/半反射镜和相机、处理模块;其中:According to an aspect of the embodiments of the present invention, a visual tool alignment device is provided, comprising a casing, a first light source, a second light source, a first reflector group, a second reflector group, a semi-transparent/half-reflector, and camera, processing module; of which:
所述第一光源和所述第二光源设置在所述壳体内部,所述第一光源和所述第二光源发出的光线相互垂直;The first light source and the second light source are arranged inside the casing, and the light emitted by the first light source and the second light source are perpendicular to each other;
所述第一反射镜组与所述第二反射镜组分别安装在所述壳体相互垂直的两相邻侧边;The first reflector group and the second reflector group are respectively installed on two adjacent sides of the casing that are perpendicular to each other;
所述第一光源、所述第一反射镜组、半透/半反射镜和相机依次组成第一光路,所述第一光源发出的光线,经第一光路进入相机,在相机上留下第一投影图像;The first light source, the first reflecting mirror group, the semi-transparent/half-reflecting mirror and the camera sequentially form a first optical path, and the light emitted by the first light source enters the camera through the first optical path, leaving a first light path on the camera. a projected image;
所述第二光源、所述第二反射镜组、半透/半反射镜和相机依次组成第二光路,所述第二光源发出的光线,经第二光路进入相机,在相机上留下第二投影图像;The second light source, the second reflecting mirror group, the semi-transparent/half-reflecting mirror and the camera sequentially form a second optical path. The light emitted by the second light source enters the camera through the second optical path and leaves a second optical path on the camera. Two projected images;
所述处理模块,根据所述第一投影图像和所述第二投影图像分别计算得到第一图像坐标u和第二图像坐标v,以及根据所述第一图像坐标u和所述第二图像坐标v,计算得到视觉工具对位的xy坐标。The processing module calculates the first image coordinate u and the second image coordinate v according to the first projection image and the second projection image respectively, and obtains the first image coordinate u and the second image coordinate according to the first image coordinate u and the second image coordinate. v, calculate the xy coordinates of the visual tool alignment.
在一个可能的设计中,所述第一光源点亮时,所述第二光源关闭,此时,由第一光路产生第一投影图像;所述第二光源点亮时,所述第一光源关闭,此时,由第二光路产生第二投影图像。In a possible design, when the first light source is turned on, the second light source is turned off, and at this time, the first projection image is generated by the first light path; when the second light source is turned on, the first light source Off, at this time, the second projection image is generated by the second optical path.
在一个可能的设计中,所述第一反射镜组包括第一反射镜和第二反射镜,所述第一反射镜和第二反射镜的反射面相对设置,使经第一光源发出的光线,经第一反射镜反射后弯转90度到达第二反射镜,再经第二反射镜后弯转90度反射后到达半透/半反射镜。In a possible design, the first reflector group includes a first reflector and a second reflector, and the reflecting surfaces of the first reflector and the second reflector are disposed opposite to each other, so that the light emitted by the first light source , after being reflected by the first mirror, it turns 90 degrees to reach the second mirror, and then turns 90 degrees after being reflected by the second mirror to reach the semi-transparent/semi-reflective mirror.
在一个可能的设计中,所述第一反射镜和第二反射镜为呈45度三角锥形体状,使经第一光源发出的光线,经第一反射镜反射后弯转90度到达第二反射镜,再经第二反射镜后弯转90度反射后到达半透/半反射镜。In a possible design, the first reflector and the second reflector are in the shape of a 45-degree triangular cone, so that the light emitted by the first light source is reflected by the first reflector and then bent by 90 degrees to reach the second reflector. The reflector is then turned 90 degrees by the second reflector to reach the semi-transparent/half-reflector.
在一个可能的设计中,所述第二反射镜组包括第三反射镜和第四反射镜,所述第三反射镜和第四反射镜的反射面相对设置,使经第二光源发出的光线,经第三反射镜反射后弯转90度到达第四反射镜,再经第四反射镜后弯转90度反射后到达半透/半反射镜。In a possible design, the second reflector group includes a third reflector and a fourth reflector, and the reflecting surfaces of the third reflector and the fourth reflector are disposed opposite to each other, so that the light emitted by the second light source , after being reflected by the third mirror, it turns 90 degrees to reach the fourth mirror, and then turns 90 degrees after being reflected by the fourth mirror to reach the semi-transparent/semi-reflective mirror.
在一个可能的设计中,所述第三反射镜和第四反射镜为呈45度三角锥形体状,使经第二光源发出的光线,经第三反射镜反射后弯转90度到达第四反射镜,再经第四反射镜后弯转90度反射后到达半透/半反射镜。In a possible design, the third reflector and the fourth reflector are in the shape of a 45-degree triangular cone, so that the light emitted by the second light source is reflected by the third reflector and then bent by 90 degrees to reach the fourth reflector. The reflector is then turned 90 degrees by the fourth reflector to reach the semi-transparent/half-reflector.
在一个可能的设计中,所述相机为线性图像传感器。In one possible design, the camera is a linear image sensor.
在一个可能的设计中,所述线性图像传感器由复数个图像传感器按线性排列组成,两排线性图像传感器成垂直角度分别设置在壳体底板的侧立面。In a possible design, the linear image sensor is composed of a plurality of image sensors arranged in a linear manner, and two rows of linear image sensors are respectively arranged on the side elevation of the housing bottom plate at a vertical angle.
在一个可能的设计中,所述第一光源和/或第二光源发出的光线刚好覆盖住所述线性图像传感器。In a possible design, the light emitted by the first light source and/or the second light source just covers the linear image sensor.
根据本发明实施例的另一个方面,提供的一种视觉工具对位方法,应用于本发明任一实施例所述的视觉工具对位装置,所述方法包括:According to another aspect of the embodiments of the present invention, a visual tool alignment method is provided, which is applied to the visual tool alignment device according to any embodiment of the present invention, and the method includes:
使第一光源发出的光线,经第一光路进入相机,在相机上留下第一投影图像;其中,所述第一光路由第一光源、第一反射镜组、半透/半反射镜和相机依次组成;The light emitted by the first light source enters the camera through the first light path, and leaves a first projection image on the camera; wherein, the first light path is the first light source, the first reflecting mirror group, the semi-transparent/half-reflecting mirror and the The cameras are composed in sequence;
使第二光源发出的光线,经第二光路进入相机,在相机上留下第二投影图像;其中,所述第二光路由第二光源、第二反射镜组、半透/半反射镜和相机依次组成;The light emitted by the second light source enters the camera through the second light path, and leaves a second projection image on the camera; wherein the second light path is the second light source, the second reflector group, the semi-transparent/half-reflector and the The cameras are composed in sequence;
根据所述第一投影图像和所述第二投影图像分别计算得到第一图像坐标u和第二图像坐标v;Calculate the first image coordinate u and the second image coordinate v according to the first projection image and the second projection image, respectively;
根据所述第一图像坐标u和所述第二图像坐标v,计算得到视觉工具对位的xy坐标。According to the first image coordinate u and the second image coordinate v, the xy coordinates of the alignment of the visual tool are calculated.
与相关技术相比,本发明实施例提供的一种视觉工具对位装置及方法,包括壳体、第一光源、第二光源、第一反射镜组、第二反射镜组、半透/半反射镜和相机、处理模块;其中:所述第一光源和所述第二光源设置在所述壳体内部,所述第一光源和所述第二光源发出的光线相互垂直;所述第一反射镜组与所述第二反射镜组分别安装在所述壳体相互垂直的两相邻侧边;所述第一光源、所述第一反射镜组、半透/半反射镜和相机依次组成第一光路,所述第一光源发出的光线,经第一光路进入相机,在相机上留下第一投影图像;所述第二光源、所述第二反射镜组、半透/半反射镜和相机依次组成第二光路,所述第二光源发出的光线,经第二光路进入相机,在相机上留下第二投影图像;所述处理模块,根据所述第一投影图像和所述第二投影图像分别计算得到第一图像坐标u和第二图像坐标v,以及根据所述第一图像坐标u和所述第二图像坐标v,计算得到视觉工具对位的xy坐标。通过本发明实施例,通过利用光路设计和半透/半反射镜组成的光路结构,并结合相机视觉定位工具,可以快速得到需对位工具(如点胶针头)的位置,实现快速自动对位,极大的提高了对位的精度和可靠性,同时也间接的提高了工具对位的定位精度和工作效率,操作简便快捷;并且,通过利用所述光路设计和半透/半反射镜的应用,省去了一个相机,大幅降低了工具对位的成本,成本可控,减少了人工确认的操作,使视觉工具对位装置更加自动化,间接提高了机器的工作效率,对位速度也得到了提高,不会损坏需对位工具,防止意外事故和避免不必要的损失。可以解决在工具对位时,利用现有的工具对位时存在需对位工具易磨损、操作不方便、对位精度低、无法实现快速对位、成本高、耗时长、效率低等问题。Compared with the related art, an embodiment of the present invention provides a visual tool alignment device and method, including a housing, a first light source, a second light source, a first mirror group, a second mirror group, a semi-transparent/semi-transparent A reflector, a camera, and a processing module; wherein: the first light source and the second light source are arranged inside the casing, and the light emitted by the first light source and the second light source are perpendicular to each other; the first light source and the second light source are perpendicular to each other; The reflector group and the second reflector group are respectively installed on two adjacent sides of the casing that are perpendicular to each other; the first light source, the first reflector group, the semi-transparent/half-reflector and the camera are in sequence A first optical path is formed, the light emitted by the first light source enters the camera through the first optical path, and leaves a first projected image on the camera; the second light source, the second mirror group, semi-transmission/semi-reflection The mirror and the camera sequentially form a second optical path, the light emitted by the second light source enters the camera through the second optical path, and leaves a second projected image on the camera; the processing module, according to the first projected image and the From the second projection image, the first image coordinate u and the second image coordinate v are calculated respectively, and the xy coordinate of the visual tool alignment is calculated according to the first image coordinate u and the second image coordinate v. Through the embodiments of the present invention, by using the optical path design and the optical path structure composed of the semi-transparent/semi-reflecting mirror, combined with the camera visual positioning tool, the position of the required alignment tool (such as the dispensing needle) can be quickly obtained, and the fast automatic alignment can be realized. , which greatly improves the accuracy and reliability of alignment, and also indirectly improves the positioning accuracy and work efficiency of tool alignment, and the operation is simple and quick; Application, saves a camera, greatly reduces the cost of tool alignment, the cost is controllable, reduces the operation of manual confirmation, makes the visual tool alignment device more automatic, indirectly improves the work efficiency of the machine, and the alignment speed is also improved. In order to improve, it will not damage the alignment tools, prevent accidents and avoid unnecessary losses. It can solve the problems of easy wear of the required alignment tool, inconvenient operation, low alignment accuracy, inability to achieve rapid alignment, high cost, long time consumption, low efficiency and the like when using existing tools for alignment during tool alignment.
附图说明Description of drawings
图1为本发明实施例提供的一种视觉工具对位装置的结构示意图;1 is a schematic structural diagram of a visual tool alignment device according to an embodiment of the present invention;
图2为本发明实施例提供的一种视觉工具对位装置在确定坐标<U,V>的示意图;2 is a schematic diagram of a visual tool alignment device in determining coordinates <U, V> provided by an embodiment of the present invention;
图3为本发明实施例提供的一种视觉工具对位装置及方法的流程示意图。FIG. 3 is a schematic flowchart of a visual tool alignment device and method according to an embodiment of the present invention.
本发明目的的实现、功能特点及优点将结合实施例,参照附图做进一步说明。The realization, functional characteristics and advantages of the present invention will be further described with reference to the accompanying drawings in conjunction with the embodiments.
具体实施方式Detailed ways
为了使本发明所要解决的技术问题、技术方案及有益效果更加清楚、明白,以下结合附图和实施例,对本发明进行进一步详细说明。应当理解,此处所描述的具体实施例仅仅以解释本发明,并不用于限定本发明。In order to make the technical problems, technical solutions and beneficial effects to be solved by the present invention clearer and more comprehensible, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only for explaining the present invention, but not for limiting the present invention.
在后续的描述中,使用用于表示元件的诸如“模块”、“部件”或“单元”的后缀仅为了有利于本发明的说明,其本身没有特定的意义。因此,“模块”、“部件”或“单元”可以混合地使用。In the following description, suffixes such as 'module', 'component' or 'unit' used to represent elements are used only to facilitate the description of the present invention and have no specific meaning per se. Thus, "module", "component" or "unit" may be used interchangeably.
需要说明的是,本发明的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。It should be noted that the terms "first", "second" and the like in the description and claims of the present invention and the above drawings are used to distinguish similar objects, and are not necessarily used to describe a specific sequence or sequence.
在一个实施例中,如图1和图2所示,本发明提供一种视觉工具对位装置,所述装置包括壳体80、第一光源10、第二光源20、第一反射镜组30、第二反射镜组40、半透/半反射镜50和相机60、处理模块70;其中:In one embodiment, as shown in FIG. 1 and FIG. 2 , the present invention provides a visual tool alignment device, the device includes a
所述第一光源10和所述第二光源20设置在所述壳体80内部,所述第一光源10和所述第二光源20发出的光线相互垂直;The
所述第一反射镜组30与所述第二反射镜组40分别安装在所述壳体80相互垂直的两相邻侧边;The
所述第一光源10、所述第一反射镜组30、半透/半反射镜50和相机60依次组成第一光路1,所述第一光源10发出的光线,经第一光路1进入相机60,在相机60上留下第一投影图像;The
所述第二光源20、所述第二反射镜组40、半透/半反射镜50和相机60依次组成第二光路2,所述第二光源20发出的光线,经第二光路2进入相机60,在相机60上留下第二投影图像;The
所述处理模块70,根据所述第一投影图像和所述第二投影图像分别计算得到第一图像坐标u和第二图像坐标v,以及根据所述第一图像坐标u和所述第二图像坐标v,计算得到视觉工具对位的xy坐标。The
在本实施例中,通过利用光路设计和半透/半反射镜组成的光路结构,并结合相机视觉定位工具,可以快速得到需对位工具(如点胶针头)的位置,实现快速自动对位,极大的提高了对位的精度和可靠性,同时也间接的提高了工具对位的定位精度和工作效率,操作简便快捷;并且,通过利用所述光路设计和半透/半反射镜的应用,省去了一个相机,大幅降低了工具对位的成本,成本可控,减少了人工确认的操作,使视觉工具对位装置更加自动化,间接提高了机器的工作效率,对位速度也得到了提高,不会损坏需对位工具,防止意外事故和避免不必要的损失。可以解决在工具对位时,利用现有的工具对位时存在需对位工具易磨损、操作不方便、对位精度低、无法实现快速对位、成本高、耗时长、效率低等问题。In this embodiment, by using the optical path design and the optical path structure composed of the semi-transparent/semi-reflecting mirror, combined with the camera visual positioning tool, the position of the required alignment tool (such as the dispensing needle) can be quickly obtained, and the fast automatic alignment can be realized , which greatly improves the accuracy and reliability of alignment, and also indirectly improves the positioning accuracy and work efficiency of tool alignment, and the operation is simple and quick; Application, saves a camera, greatly reduces the cost of tool alignment, the cost is controllable, reduces the operation of manual confirmation, makes the visual tool alignment device more automatic, indirectly improves the work efficiency of the machine, and the alignment speed is also improved. In order to improve, it will not damage the alignment tools, prevent accidents and avoid unnecessary losses. It can solve the problems of easy wear of the required alignment tool, inconvenient operation, low alignment accuracy, inability to achieve rapid alignment, high cost, long time consumption, low efficiency and the like when using existing tools for alignment during tool alignment.
在一个实施例中,所述第一反射镜组30包括第一反射镜33和第二反射镜34,所述第一反射镜33和第二反射镜34的反射面相对设置,所述第一光源10、所述第一反射镜33、所述第二反射镜34、半透/半反射镜50和相机60依次组成第一光路1,可使所述第一光源10发出的光线,经第一光路1进入相机60,在相机60上留下第一投影图像,即:可使经第一光源10发出的光线,经第一反射镜33反射后弯转90度到达第二反射镜34,再经第二反射镜34后弯转90度反射后到达半透/半反射镜50,再经半透/半反射镜50反射后进入相机60,在相机60上留下第一投影图像。In one embodiment, the first reflecting
优选地,所述第一反射镜33和第二反射镜34为呈45度三角锥形体状,可使经第一光源1发出的光线,经第一反射镜33反射后弯转90度到达第二反射镜34,再经第二反射镜34后弯转90度反射后到达半透/半反射镜7。Preferably, the first reflecting
所述第二反射镜组40包括第三反射镜45和第四反射镜46,所述第三反射镜45和第四反射镜46的反射面相对设置,所述第二光源20、所述第三反射镜45、所述第四反射镜46、半透/半反射镜50和相机60依次组成第二光路2,可使所述第二光源20发出的光线,经第二光路2进入相机60,在相机60上留下第二投影图像,即:可使经第二光源20发出的光线,经第三反射镜45反射后弯转90度到达第四反射镜46,再经第四反射镜46后弯转90度反射后到达半透/半反射镜50,再经半透/半反射镜50反射后进入相机60,在相机60上留下第二投影图像。The second reflector group 40 includes a
优选地,所述第三反射镜45和第四反射镜46为呈45度三角锥形体状,可使经第二光源20发出的光线,经第三反射镜45反射后弯转90度到达第四反射镜46,再经反射镜46后弯转90度反射后到达半透/半反射镜50。Preferably, the
进一步地,所述第一光源10点亮时,所述第二光源20关闭,此时,由第一光路1产生第一投影图像,形成工具的第一图像坐标u;所述第二光源20点亮时,所述第一光源10关闭,此时,由第二光路2产生第二投影图像,形成工具的第二图像坐标v。Further, when the
在本实施例中,通过利用多个反射镜组成反射镜组的光路设计和半透/半反射镜组成的光路结构,省去了一个相机,大幅降低了工具对位的成本,减少了人工确认的操作,使视觉工具对位装置更加自动化,间接提高了机器的工作效率,对位速度也得到了提高,不会损坏需对位工具,防止意外事故和避免不必要的损失。In this embodiment, by using the optical path design of a mirror group composed of multiple mirrors and the optical path structure composed of semi-transparent/half-reflective mirrors, a camera is omitted, the cost of tool alignment is greatly reduced, and manual confirmation is reduced. The operation of the machine makes the visual tool alignment device more automatic, which indirectly improves the working efficiency of the machine, and the alignment speed is also improved. It will not damage the alignment tools, prevent accidents and avoid unnecessary losses.
在一个实施例中,所述相机60为线性图像传感器。In one embodiment, the
优选地,所述线性图像传感器由复数个图像传感器按线性排列组成,两排线性图像传感器成垂直角度分别设置在底板的侧立面。Preferably, the linear image sensor is composed of a plurality of image sensors arranged linearly, and the two rows of linear image sensors are respectively arranged on the side elevation of the base plate at a vertical angle.
优选地,所述第一光源10和/或第二光源20通过利用灯光罩或遮光板或升降板等具有功能的工具,使得所述第一光源10和/或第二光源20发出的光线刚好覆盖住所述线性图像传感器,并且不会对其他方位造成影响。Preferably, the
在一个实施例中,如图2所示,所述处理模块70,根据所述第一投影图像和所述第二投影图像分别计算得到第一图像坐标u和第二图像坐标v;包括:In one embodiment, as shown in FIG. 2 , the
由于工具在光路中遮挡光线,形成图像竖直方向的条状阴影。图像中每个像素在横坐标为i,纵坐标为j的情况下,灰度值为,图像宽度为m,高度为n,则有:As the tool blocks light in the light path, a vertical stripe of shadows in the image is formed. When the abscissa is i and the ordinate is j, the gray value of each pixel in the image, the image width is m, and the height is n, there are:
对于第一光路1的第一投影图像,取Max(x)为第一图像坐标u;对于第二光路2的第二投影图像,取Max(x)为第二图像坐标v。For the first projection image of the first optical path 1, take Max(x) as the first image coordinate u; for the second projected image of the second optical path 2, take Max(x) as the second image coordinate v.
上述两张投影图片中任一投影图片,按纵坐标投影得到:Any projection picture in the above two projection pictures, according to the ordinate projection, can be obtained:
把每次测量工具的动作定义为,按先后顺序,分别拍上述第一光路1和第二光路2的两张投影图像(即第一投影图像和第二投影图像),获得第一图像坐标u和第二图像坐标v,构建坐标系<u,v>为测量的像素坐标系。The action of each measuring tool is defined as, in order, the two projection images (ie the first projection image and the second projection image) of the first optical path 1 and the second optical path 2 are taken respectively, and the first image coordinate u is obtained. and the second image coordinate v, the constructed coordinate system <u, v> is the pixel coordinate system of the measurement.
在一个实施例中,所述处理模块70,根据所述第一图像坐标u和所述第二图像坐标v,计算得到视觉工具对位的xy坐标;包括:In one embodiment, the
令x,y是需对位工具(如点胶针头)移动的马达坐标,实际测量时,需要把坐标(u,v)转换为坐标(x,y),即令:<x,y>=f(u,v),其中,f(u,v)为函数。Let x, y be the motor coordinates to be moved by the alignment tool (such as the dispensing needle). In actual measurement, the coordinates (u, v) need to be converted into coordinates (x, y), that is, <x, y> = f (u,v), where f(u,v) is a function.
特别地,根据上述图1和图2的几何结构,可以用影射变换将坐标(u,v)转换为坐标(x,y)。详细过程如下:In particular, coordinates (u, v) can be transformed into coordinates (x, y) using a mapping transformation according to the geometry of Figures 1 and 2 above. The detailed process is as follows:
给定:given:
其中,Pa是参数矩阵,pa,pb是标定动作完成的已知量,w是缩放参数。Hab是转换矩阵。Among them, Pa is the parameter matrix, pa, pb are the known quantities for the completion of the calibration action, and w is the scaling parameter. Hab is the transformation matrix.
则:but:
p′b=Habpa p' b = H a b p a
其中:in:
为了得出上述公式中的h11-h33,令马达驱动工具移动到指定的4个位置,也就是标定过程,如图2所示,同时获得对应的4组<x,y>和<u,v>,即:In order to obtain h 11 -h 33 in the above formula, the motor-driven tool is moved to the specified 4 positions, that is, the calibration process, as shown in Figure 2, and the corresponding 4 groups of <x, y> and <u are obtained at the same time , v>, that is:
<x1,y1,w>T=H<u1,v1,1><x 1 , y 1 , w> T =H<u 1 , v 1 , 1>
<x2,y2,w>T=H<u2,v2,1><x 2 , y 2 , w> T =H<u 2 , v 2 , 1>
<x3,y3,w>T=H<u3,v1,1><x 3 , y 3 , w> T =H<u 3 , v 1 , 1>
<x4,y4,w>T=H<u4,v1,1><x 4 , y 4 , w> T =H<u 4 , v 1 , 1>
其中,xi,yi是四次标定动作后记录下来的马达坐标;ui,vi是标定计算出的像素坐标,i=1,2,3,4。Among them, xi, yi are the motor coordinates recorded after four calibration actions; ui, vi are the pixel coordinates calculated by calibration, i=1, 2, 3, 4.
特别地,令h33=1,因此可由4个等式列出8个齐次方程组,可求得8个参数。In particular, let h33=1, so 8 homogeneous equations can be listed from 4 equations, and 8 parameters can be obtained.
最后的坐标(u,v)转换为坐标(x,y)的公式,如下:The formula for converting the final coordinates (u, v) to coordinates (x, y) is as follows:
pb=Habpa p b = H a b p a
其中:in:
在本实施例中,通过处理模块根据所述第一投影图像和所述第二投影图像分别计算得到第一图像坐标u和第二图像坐标v,以及根据所述第一图像坐标u和所述第二图像坐标v,计算得到视觉工具对位的xy坐标。可以快速得到需对位工具的位置,实现快速自动对位,极大的提高了对位的精度和可靠性,同时也间接的提高了工具对位的定位精度和工作效率,操作简便快捷。In this embodiment, the first image coordinate u and the second image coordinate v are respectively calculated and obtained by the processing module according to the first projection image and the second projection image, and the first image coordinate u and the second image coordinate v are calculated according to the first image coordinate u and the The second image coordinate v is calculated to obtain the xy coordinate of the alignment of the visual tool. The position of the tool to be aligned can be quickly obtained, and the automatic alignment can be realized quickly, which greatly improves the accuracy and reliability of the alignment, and also indirectly improves the positioning accuracy and work efficiency of the tool alignment, and the operation is simple and fast.
在一个实施例中,如图3所示,本发明提供一种视觉工具对位方法,所述方法包括:In one embodiment, as shown in FIG. 3 , the present invention provides a visual tool alignment method, the method comprising:
S1、使第一光源发出的光线,经第一光路进入相机,在相机上留下第一投影图像;其中,所述第一光路由第一光源、第一反射镜组、半透/半反射镜和相机依次组成;S1. Make the light emitted by the first light source enter the camera through the first optical path, and leave a first projected image on the camera; wherein, the first optical path is the first light source, the first reflecting mirror group, the semi-transmission/semi-reflection The mirror and the camera are composed in turn;
S2、使第二光源发出的光线,经第二光路进入相机,在相机上留下第二投影图像;其中,所述第二光路由第二光源、第二反射镜组、半透/半反射镜和相机依次组成;S2. Make the light emitted by the second light source enter the camera through the second light path, and leave a second projection image on the camera; wherein the second light path is the second light source, the second mirror group, the semi-transmission/semi-reflection The mirror and the camera are composed in turn;
S3、根据所述第一投影图像和所述第二投影图像分别计算得到第一图像坐标u和第二图像坐标v;S3, calculate the first image coordinate u and the second image coordinate v according to the first projection image and the second projection image respectively;
S4、根据所述第一图像坐标u和所述第二图像坐标v,计算得到视觉工具对位的xy坐标。S4. According to the coordinate u of the first image and the coordinate v of the second image, calculate and obtain the xy coordinate of the alignment of the visual tool.
在本实施例中,通过利用光路设计和半透/半反射镜组成的光路结构,并结合相机视觉定位工具,可以快速得到需对位工具(如点胶针头)的位置,实现快速自动对位,极大的提高了对位的精度和可靠性,同时也间接的提高了工具对位的定位精度和工作效率,操作简便快捷;并且,通过利用所述光路设计和半透/半反射镜的应用,省去了一个相机,大幅降低了工具对位的成本,成本可控,减少了人工确认的操作,使视觉工具对位装置更加自动化,间接提高了机器的工作效率,对位速度也得到了提高,不会损坏需对位工具,防止意外事故和避免不必要的损失。可以解决在工具对位时,利用现有的工具对位时存在需对位工具易磨损、操作不方便、对位精度低、无法实现快速对位、成本高、耗时长、效率低等问题。In this embodiment, by using the optical path design and the optical path structure composed of the semi-transparent/semi-reflecting mirror, combined with the camera visual positioning tool, the position of the required alignment tool (such as the dispensing needle) can be quickly obtained, and the fast automatic alignment can be realized , which greatly improves the accuracy and reliability of alignment, and also indirectly improves the positioning accuracy and work efficiency of tool alignment, and the operation is simple and quick; Application, saves a camera, greatly reduces the cost of tool alignment, the cost is controllable, reduces the operation of manual confirmation, makes the visual tool alignment device more automatic, indirectly improves the work efficiency of the machine, and the alignment speed is also improved. In order to improve, it will not damage the alignment tools, prevent accidents and avoid unnecessary losses. It can solve the problems of easy wear of the required alignment tool, inconvenient operation, low alignment accuracy, inability to achieve rapid alignment, high cost, long time consumption, low efficiency and the like when using existing tools for alignment during tool alignment.
在一个实施例中,所述第一光源点亮时,所述第二光源关闭,此时,由第一光路产生第一投影图像,形成工具的第一图像坐标u;所述第二光源点亮时,所述第一光源关闭,此时,由第二光路产生第二投影图像,形成工具的第二图像坐标v。In one embodiment, when the first light source is turned on, the second light source is turned off, and at this time, a first projection image is generated by the first light path to form the first image coordinate u of the tool; the second light source points When it is on, the first light source is turned off, and at this time, a second projection image is generated by the second optical path to form the second image coordinate v of the tool.
在一个实施例中,所述步骤S3中,所述根据所述第一投影图像和所述第二投影图像分别计算得到第一图像坐标u和第二图像坐标v;包括:In one embodiment, in the step S3, the first image coordinate u and the second image coordinate v are obtained by calculating according to the first projection image and the second projection image, respectively; including:
由于工具在光路中遮挡光线,形成图像竖直方向的条状阴影。图像中每个像素在横坐标为i,纵坐标为j的情况下,灰度值为,图像宽度为m,高度为n,则有:As the tool blocks light in the light path, a vertical stripe of shadows in the image is formed. When the abscissa is i and the ordinate is j, the gray value of each pixel in the image, the image width is m, and the height is n, there are:
对于第一光路1的第一投影图像,取Max(x)为第一图像坐标u;对于第二光路2的第二投影图像,取Max(x)为第二图像坐标v。For the first projection image of the first optical path 1, take Max(x) as the first image coordinate u; for the second projected image of the second optical path 2, take Max(x) as the second image coordinate v.
上述两张投影图片中任一投影图片,按纵坐标投影得到:Any projection picture in the above two projection pictures, according to the ordinate projection, can be obtained:
把每次测量工具的动作定义为,按先后顺序,分别拍上述第一光路1和第二光路2的两张投影图像(即第一投影图像和第二投影图像),获得第一图像坐标u和第二图像坐标v,构建坐标系<u,v>为测量的像素坐标系。The action of each measuring tool is defined as, in order, the two projection images (ie the first projection image and the second projection image) of the first optical path 1 and the second optical path 2 are taken respectively, and the first image coordinate u is obtained. and the second image coordinate v, the constructed coordinate system <u, v> is the pixel coordinate system of the measurement.
在一个实施例中,所述步骤S4中,所述根据所述第一图像坐标u和所述第二图像坐标v,计算得到视觉工具对位的xy坐标;包括:In one embodiment, in the step S4, calculating the xy coordinates of the visual tool alignment according to the first image coordinate u and the second image coordinate v; including:
令x,y是需对位工具(如点胶针头)移动的马达坐标,实际测量时,需要把坐标(u,v)转换为坐标(x,y),即令:<x,y>=f(u,v),其中,f(u,v)为函数。Let x, y be the motor coordinates to be moved by the alignment tool (such as the dispensing needle). In actual measurement, the coordinates (u, v) need to be converted into coordinates (x, y), that is, <x, y> = f (u,v), where f(u,v) is a function.
特别地,根据上述图1和图2的几何结构,可以用影射变换将坐标(u,v)转换为坐标(x,y)。详细过程如下:In particular, coordinates (u, v) can be transformed into coordinates (x, y) using a mapping transformation according to the geometry of Figures 1 and 2 above. The detailed process is as follows:
给定:given:
其中,Pa是参数矩阵,pa,pb是标定动作完成的已知量,w是缩放参数。Hab是转换矩阵。Among them, Pa is the parameter matrix, pa, pb are the known quantities for the completion of the calibration action, and w is the scaling parameter. Hab is the transformation matrix.
则:but:
p′b=Habpa p' b = H a b p a
其中:in:
为了得出上述公式中的h11-h33,令马达驱动工具移动到指定的4个位置,也就是标定过程,如图2所示,同时获得对应的4组<x,y>和<u,v>,即:In order to obtain h 11 -h 33 in the above formula, the motor-driven tool is moved to the specified 4 positions, that is, the calibration process, as shown in Figure 2, and the corresponding 4 groups of <x, y> and <u are obtained at the same time , v>, that is:
<x1,y1,w>T=H<u1,v1,1><x 1 , y 1 , w> T =H<u 1 , v 1 , 1>
<x2,y2,w>T=H<u2,v2,1><x 2 , y 2 , w> T =H<u 2 , v 2 , 1>
<x3,y3,w>T=H<u3,v1,1><x 3 , y 3 , w> T =H<u 3 , v 1 , 1>
<x4,y4,w>T=H<u4,v1,1><x 4 , y 4 , w> T =H<u 4 , v 1 , 1>
其中,xi,yi是四次标定动作后记录下来的马达坐标;ui,vi是标定计算出的像素坐标,i=1,2,3,4。Among them, xi, yi are the motor coordinates recorded after four calibration actions; ui, vi are the pixel coordinates calculated by calibration, i=1, 2, 3, 4.
特别地,令h33=1,因此可由4个等式列出8个齐次方程组,可求得8个参数。In particular, let h33=1, so 8 homogeneous equations can be listed from 4 equations, and 8 parameters can be obtained.
最后的坐标(u,v)转换为坐标(x,y)的公式,如下:The formula for converting the final coordinates (u, v) to coordinates (x, y) is as follows:
p′b=Habpa p' b = H a b p a
其中:in:
在本实施例中,通过根据所述第一投影图像和所述第二投影图像分别计算得到第一图像坐标u和第二图像坐标v,以及根据所述第一图像坐标u和所述第二图像坐标v,计算得到视觉工具对位的xy坐标。可以快速得到需对位工具的位置,实现快速自动对位,极大的提高了对位的精度和可靠性,同时也间接的提高了工具对位的定位精度和工作效率,操作简便快捷。In this embodiment, the first image coordinate u and the second image coordinate v are obtained by calculating respectively according to the first projection image and the second projection image, and the first image coordinate u and the second image coordinate The image coordinate v is calculated to obtain the xy coordinate of the visual tool alignment. The position of the tool to be aligned can be quickly obtained, and the automatic alignment can be realized quickly, which greatly improves the accuracy and reliability of the alignment, and also indirectly improves the positioning accuracy and work efficiency of the tool alignment, and the operation is simple and fast.
需要说明的是,上述方法实施例与装置实施例属于同一构思,其具体实现过程详见装置实施例,且装置实施例中的技术特征在方法实施例中均对应适用,这里不再赘述。It should be noted that the above method embodiments and apparatus embodiments belong to the same concept, and the specific implementation process is detailed in the apparatus embodiments, and the technical features in the apparatus embodiments are correspondingly applicable in the method embodiments, which will not be repeated here.
需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。It should be noted that, herein, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion, such that a process, method, article or device comprising a series of elements includes not only those elements, It also includes other elements not expressly listed or inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element.
上述本发明实施例序号仅仅为了描述,不代表实施例的优劣。The above-mentioned serial numbers of the embodiments of the present invention are only for description, and do not represent the advantages or disadvantages of the embodiments.
上面结合附图对本发明的实施例进行了描述,但是本发明并不局限于上述的具体实施方式,上述的具体实施方式仅仅是示意性的,而不是限制性的,本领域的普通技术人员在本发明的启示下,在不脱离本发明宗旨和权利要求所保护的范围情况下,还可做出很多形式,这些均属于本发明的保护之内。The embodiments of the present invention have been described above in conjunction with the accompanying drawings, but the present invention is not limited to the above-mentioned specific embodiments, which are merely illustrative rather than restrictive. Under the inspiration of the present invention, without departing from the scope of protection of the present invention and the claims, many forms can be made, which all belong to the protection of the present invention.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010834952.9A CN111780724A (en) | 2020-08-19 | 2020-08-19 | Vision tool alignment device and method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010834952.9A CN111780724A (en) | 2020-08-19 | 2020-08-19 | Vision tool alignment device and method |
Publications (1)
Publication Number | Publication Date |
---|---|
CN111780724A true CN111780724A (en) | 2020-10-16 |
Family
ID=72762633
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010834952.9A Pending CN111780724A (en) | 2020-08-19 | 2020-08-19 | Vision tool alignment device and method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111780724A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116519032A (en) * | 2023-04-28 | 2023-08-01 | 广东顺德西安交通大学研究院 | Visual inspection equipment of double mirror reflection |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5917604A (en) * | 1996-03-15 | 1999-06-29 | U.S. Philips Corporation | Alignment device and lithographic apparatus provided with such a device |
CN1237786A (en) * | 1998-06-01 | 1999-12-08 | 摩托罗拉公司 | Method and apparatus for visually inspecting object |
US6417922B1 (en) * | 1997-12-29 | 2002-07-09 | Asml Netherlands B.V. | Alignment device and lithographic apparatus comprising such a device |
US6842248B1 (en) * | 2000-11-28 | 2005-01-11 | Nikon Corporation | System and method for calibrating mirrors of a stage assembly |
CN206514852U (en) * | 2017-01-22 | 2017-09-22 | 苏州一光仪器有限公司 | A kind of light path system of total powerstation |
CN107664833A (en) * | 2016-07-29 | 2018-02-06 | 上海微电子装备(集团)股份有限公司 | A kind of NI Vision Builder for Automated Inspection and alignment device for substrate alignment |
CN208635719U (en) * | 2018-07-31 | 2019-03-22 | 易视智瞳科技(深圳)有限公司 | A kind of tool alignment device |
CN212300340U (en) * | 2020-08-19 | 2021-01-05 | 易视智瞳科技(深圳)有限公司 | Vision tool aligning device |
-
2020
- 2020-08-19 CN CN202010834952.9A patent/CN111780724A/en active Pending
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5917604A (en) * | 1996-03-15 | 1999-06-29 | U.S. Philips Corporation | Alignment device and lithographic apparatus provided with such a device |
US6417922B1 (en) * | 1997-12-29 | 2002-07-09 | Asml Netherlands B.V. | Alignment device and lithographic apparatus comprising such a device |
CN1237786A (en) * | 1998-06-01 | 1999-12-08 | 摩托罗拉公司 | Method and apparatus for visually inspecting object |
US6842248B1 (en) * | 2000-11-28 | 2005-01-11 | Nikon Corporation | System and method for calibrating mirrors of a stage assembly |
CN107664833A (en) * | 2016-07-29 | 2018-02-06 | 上海微电子装备(集团)股份有限公司 | A kind of NI Vision Builder for Automated Inspection and alignment device for substrate alignment |
CN206514852U (en) * | 2017-01-22 | 2017-09-22 | 苏州一光仪器有限公司 | A kind of light path system of total powerstation |
CN208635719U (en) * | 2018-07-31 | 2019-03-22 | 易视智瞳科技(深圳)有限公司 | A kind of tool alignment device |
CN212300340U (en) * | 2020-08-19 | 2021-01-05 | 易视智瞳科技(深圳)有限公司 | Vision tool aligning device |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116519032A (en) * | 2023-04-28 | 2023-08-01 | 广东顺德西安交通大学研究院 | Visual inspection equipment of double mirror reflection |
CN116519032B (en) * | 2023-04-28 | 2024-02-20 | 广东顺德西安交通大学研究院 | Visual inspection equipment of double mirror reflection |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN107014312B (en) | A kind of integral calibrating method of mirror-vibrating line laser structured light three-dimension measuring system | |
CN111536902A (en) | Galvanometer scanning system calibration method based on double checkerboards | |
Song et al. | Use of LCD panel for calibrating structured-light-based range sensing system | |
CN110645911B (en) | A device and method for obtaining a complete 3D profile of an outer surface by rotational scanning | |
CN107607059A (en) | A kind of one-touch 3D profile measurements equipment and its survey calculation method | |
SG173068A1 (en) | Methods for examining a bonding structure of a substrate and bonding structure inspection devices | |
CN107289876A (en) | Multi-shaft interlocked vision, laser combined type non-contact measurement device for measuring and measuring method | |
CN103868472A (en) | Planar structured light three dimension measuring device and method for high-reflectivity part | |
CN104913734B (en) | A kind of mirror-vibrating line laser structured light apparatus for measuring three-dimensional profile and method | |
CN112082477A (en) | Universal tool microscope three-dimensional measuring device and method based on structured light | |
Zou et al. | High-accuracy calibration of line-structured light vision sensors using a plane mirror | |
CN101750027B (en) | Three-dimensional shape detection device | |
CN112066910A (en) | Monocular three-dimensional measurement system based on plane mirror automatic rotating platform | |
CN113155084A (en) | Binocular vision distance measuring device and method based on laser cross standard line assistance | |
CN201425470Y (en) | Regular polygon measured object on-line data measuring system based on machine vision | |
CN108229393A (en) | A kind of the high-precision identifying system and method for automobile tire mark | |
CN111780724A (en) | Vision tool alignment device and method | |
Ren et al. | Accurate three-dimensional shape and deformation measurement at microscale using digital image correlation | |
CN212300340U (en) | Vision tool aligning device | |
CN211234321U (en) | Coaxial alignment detection optical system | |
CN109764817A (en) | Non-contact lens center thickness measurement system and method | |
CN115046498B (en) | Calibration method for monocular rotating structure light three-dimensional measurement system | |
CN110428471B (en) | Accurate self-positioning method for optical free-form surface sub-aperture deflection measurement | |
CN108592789A (en) | A kind of steel construction factory pre-assembly method based on BIM and machine vision technique | |
CN213932396U (en) | A three-dimensional dimension measuring instrument |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |