CN110231289B - A multi-light source automatic lighting device and image synthesis method thereof - Google Patents
A multi-light source automatic lighting device and image synthesis method thereof Download PDFInfo
- Publication number
- CN110231289B CN110231289B CN201910520680.2A CN201910520680A CN110231289B CN 110231289 B CN110231289 B CN 110231289B CN 201910520680 A CN201910520680 A CN 201910520680A CN 110231289 B CN110231289 B CN 110231289B
- Authority
- CN
- China
- Prior art keywords
- light source
- workpiece
- tested
- image
- bracket
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000001308 synthesis method Methods 0.000 title claims abstract description 12
- 238000001514 detection method Methods 0.000 claims abstract description 26
- 239000002131 composite material Substances 0.000 claims abstract description 14
- 239000011159 matrix material Substances 0.000 claims description 24
- 238000005286 illumination Methods 0.000 claims description 19
- 230000007306 turnover Effects 0.000 claims description 3
- 238000005259 measurement Methods 0.000 claims 1
- 230000007547 defect Effects 0.000 description 17
- 238000012545 processing Methods 0.000 description 4
- 230000001788 irregular Effects 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 238000000429 assembly Methods 0.000 description 1
- 230000000712 assembly Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000000034 method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000005086 pumping Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/01—Arrangements or apparatus for facilitating the optical investigation
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/89—Investigating the presence of flaws or contamination in moving material, e.g. running paper or textiles
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/95—Investigating the presence of flaws or contamination characterised by the material or shape of the object to be examined
- G01N21/956—Inspecting patterns on the surface of objects
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02B—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO BUILDINGS, e.g. HOUSING, HOUSE APPLIANCES OR RELATED END-USER APPLICATIONS
- Y02B20/00—Energy efficient lighting technologies, e.g. halogen lamps or gas discharge lamps
- Y02B20/40—Control techniques providing energy savings, e.g. smart controller or presence detection
Landscapes
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- General Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- Immunology (AREA)
- Pathology (AREA)
- Engineering & Computer Science (AREA)
- Textile Engineering (AREA)
- Constituent Portions Of Griding Lathes, Driving, Sensing And Control (AREA)
- Finish Polishing, Edge Sharpening, And Grinding By Specific Grinding Devices (AREA)
Abstract
本发明公开了一种多光源自动打光装置及其图像合成方法,所述打光装置包括:打光支架,所述打光支架包括第一环形支架、第二环形支架和第三环形支架,还至少包括第一可控光源、第二可控光源和第三可控光源;呈物台,所述呈物台于所述打光支架底部形成的待测区域;阵列相机组件,包括设于所述打光支架顶部的明域相机和暗域相机;光源控制器,用于控制所述第一可控光源、第二可控光源和第三可控光源的照明角度和照明范围;机器视觉检测模块,用于根据所述明域相机和暗域相机在不同照明环境下获取的待测工件的图像,生成合成图像。所述图像合成方法,应用于上述打光装置。本发明具有较高的检测效率和可靠性。
The invention discloses a multi-light source automatic lighting device and an image synthesis method thereof. The lighting device comprises: a lighting bracket, and the lighting bracket comprises a first annular bracket, a second annular bracket and a third annular bracket; It also includes at least a first controllable light source, a second controllable light source and a third controllable light source; an object stage, which is an area to be measured formed at the bottom of the lighting bracket; an array camera assembly, including a A bright field camera and a dark field camera on the top of the lighting bracket; a light source controller for controlling the lighting angle and lighting range of the first controllable light source, the second controllable light source and the third controllable light source; machine vision The detection module is configured to generate a composite image according to the images of the workpiece to be tested obtained by the bright field camera and the dark field camera in different lighting environments. The image synthesis method is applied to the above-mentioned lighting device. The invention has higher detection efficiency and reliability.
Description
技术领域technical field
本发明涉及自动化检测装置领域,尤其涉及一种多光源自动打光装置及其图像合成方法。The invention relates to the field of automatic detection devices, in particular to a multi-light source automatic lighting device and an image synthesis method thereof.
背景技术Background technique
现有的零件表面缺陷检测通常依靠人工完成,其检测速度慢、主观因素影响大,可靠性低、影响产品的加工质量。于是出现了基于图像识别技术的缺陷检测方法,而上述检测方法较大程度上依赖于打光装置及相应的成像系统,如何提供可靠的打光装置、提供合理的图像合成方法成为业内亟待解决的问题。The existing surface defect detection of parts is usually done manually, which has slow detection speed, great influence of subjective factors, low reliability, and affects the processing quality of products. Therefore, a defect detection method based on image recognition technology has emerged, and the above detection method is largely dependent on the lighting device and the corresponding imaging system. How to provide a reliable lighting device and a reasonable image synthesis method has become an urgent problem to be solved in the industry. question.
发明内容SUMMARY OF THE INVENTION
为克服现有的零件表面缺陷检测速度慢、可靠性低的问题,本发明实施例一方面提供了一种多光源自动打光装置,包括:In order to overcome the problems of slow detection speed and low reliability of existing parts surface defects, an embodiment of the present invention provides, on the one hand, a multi-light source automatic lighting device, including:
打光支架,所述打光支架包括位于不同高度位置的至少第一环形支架、第二环形支架和第三环形支架,还至少包括设于所述第一环形支架上的第一可控光源、设于所述第二环形支架上的第二可控光源和设于所述第三环形支架上的第三可控光源;A lighting bracket, the lighting bracket includes at least a first annular bracket, a second annular bracket and a third annular bracket located at different heights, and at least a first controllable light source arranged on the first annular bracket, a second controllable light source arranged on the second annular support and a third controllable light source arranged on the third annular support;
呈物台,所述呈物台于所述打光支架底部形成的待测区域;an object table, the object table is the area to be measured formed at the bottom of the lighting bracket;
阵列相机组件,包括设于所述打光支架顶部的明域相机和暗域相机;an array camera assembly, including a bright field camera and a dark field camera arranged on the top of the lighting bracket;
光源控制器,用于控制所述第一可控光源、第二可控光源和第三可控光源的照明角度和照明范围;a light source controller for controlling the illumination angle and illumination range of the first controllable light source, the second controllable light source and the third controllable light source;
机器视觉检测模块,用于根据所述明域相机和暗域相机在不同照明环境下获取的待测工件的图像,生成合成图像。The machine vision detection module is used for generating a composite image according to the images of the workpiece to be tested obtained by the bright field camera and the dark field camera under different lighting environments.
进一步,上述所述明域相机和暗域相机的数量为各两个,所述明域相机和暗域相机设于所述待测区域上方,且所述明域相机和暗域相机在圆周方向上间隔分布。Further, the number of the above-mentioned bright-field cameras and dark-field cameras is two each, the bright-field cameras and the dark-field cameras are arranged above the area to be measured, and the bright-field cameras and the dark-field cameras are in the circumferential direction. upper interval distribution.
进一步,上述所述打光支架包括外支架和内支架,所述第一环形支架、第二环形支架和第三环形支架形成于所述内支架上;所述外支架于所述呈物台上形成用于支撑所述内支架的支撑框架、于所述内支架上方形成梁状框架,所述明域相机和暗域相机可活动的设置在所述梁状框架上。Further, the above-mentioned lighting bracket includes an outer bracket and an inner bracket, and the first annular bracket, the second annular bracket and the third annular bracket are formed on the inner bracket; the outer bracket is on the object stage. A support frame for supporting the inner frame is formed, a beam-shaped frame is formed above the inner frame, and the bright-field camera and the dark-field camera are movably arranged on the beam-shaped frame.
进一步,上述所述内支架的形状为半球形,所述内支架于所述明域相机和暗域相机下方形成图像采集缺口。Further, the shape of the above-mentioned inner bracket is hemispherical, and the inner bracket forms an image capturing gap below the bright field camera and the dark field camera.
进一步,上述所述打光装置还包括设于所述明域相机和暗域相机上的距离传感器,所述距离传感器用于检测各所述明域相机和暗域相机与所述待测工件的相对距离;Further, the above-mentioned lighting device also includes a distance sensor arranged on the light field camera and the dark field camera, and the distance sensor is used to detect the distance between each of the light field camera and the dark field camera and the workpiece to be measured. relative distance;
所述呈物台包括设于所述待测区域周围的夹持组件、位于所述夹持组件下方用于承托所述待测工件的托盘、以及设于所述托盘下方的角度调整机构,所述角度调整机构包括伸缩杆、与伸缩杆连接的万向球以及设于所述万向球和托盘之间的吸盘,所述吸盘可脱离的与所述托盘连接;The object presentation table includes a clamping component arranged around the area to be measured, a tray positioned below the clamping component for supporting the workpiece to be measured, and an angle adjustment mechanism arranged below the tray, The angle adjustment mechanism includes a telescopic rod, a universal ball connected with the telescopic rod, and a suction cup arranged between the universal ball and the tray, and the suction cup is detachably connected to the tray;
所述机器视觉检测模块还用于调整所述伸缩杆的高度、以及所述万向球的角度,以使所述待测工件与各所述明域相机和暗域相机的相对距离在预设距离范围内。The machine vision detection module is also used to adjust the height of the telescopic rod and the angle of the universal ball, so that the relative distance between the workpiece to be tested and each of the light field cameras and the dark field cameras is preset. within the distance.
进一步,上述所述托盘为透明托盘,所述呈物台上还设有伸缩枢轴,所述托盘侧壁上设置有与所述伸缩枢轴对应的枢孔;Further, the above-mentioned tray is a transparent tray, a telescopic pivot is further provided on the object stage, and a pivot hole corresponding to the telescopic pivot is provided on the side wall of the tray;
所述机器视觉检测模块还用于控制所述伸缩枢轴翻转所述托盘,以翻转所述待测工件。The machine vision detection module is also used to control the telescopic pivot to turn over the tray, so as to turn the workpiece to be tested.
本发明实施例另一方面提供了一种图像合成方法,应用于上述任一项所述的多光源自动打光装置,包括:Another aspect of the embodiments of the present invention provides an image synthesis method, which is applied to the multi-light source automatic lighting device described in any of the above, including:
控制第一可控光源在第一环形支架上呈常亮线光源状态;Controlling the first controllable light source on the first annular support to be in the state of a normally bright line light source;
控制第二可控光源在第二环形支架的多个预设角度依次照射待测工件;Controlling the second controllable light source to sequentially illuminate the workpiece to be tested at multiple preset angles of the second annular support;
控制第三可控光源在第三环形支架的多个预设角度依次照射待测工件;Controlling the third controllable light source to sequentially illuminate the workpiece to be tested at multiple preset angles of the third annular support;
当第二可控光源或第三可控光源在不同预设角度照射待测工件时,控制阵列相机组件获取所述待测工件图像,生成待测工件图像亮度矩阵;When the second controllable light source or the third controllable light source illuminates the workpiece to be tested at different preset angles, the array camera assembly is controlled to obtain an image of the workpiece to be tested, and an image brightness matrix of the workpiece to be tested is generated;
根据所述待测工件图像亮度矩阵和所述待测工件图像,生成合成图像。A composite image is generated according to the image brightness matrix of the workpiece to be tested and the image of the workpiece to be tested.
进一步,上述所述当第二可控光源或第三可控光源在不同预设角度照射待测工件时,控制阵列相机组件获取所述待测工件图像,得到待测工件图像亮度矩阵的步骤,包括:Further, when the second controllable light source or the third controllable light source illuminates the workpiece to be tested at different preset angles, the above-mentioned step of controlling the array camera assembly to obtain the image of the workpiece to be tested to obtain the image brightness matrix of the workpiece to be tested, include:
当第二可控光源在不同预设角度照射待测工件、且第三可控光源熄灭时,控制控制阵列相机组件获取待测工件的图像,生成第一待测工件图像组;When the second controllable light source illuminates the workpiece to be tested at different preset angles and the third controllable light source is extinguished, the control array camera assembly is controlled to obtain an image of the workpiece to be tested, and a first image group of the workpiece to be tested is generated;
当第三可控光源在不同预设角度照射待测工件、且第二可控光源熄灭时,控制控制阵列相机组件获取待测工件的图像,生成第二待测工件图像组;When the third controllable light source illuminates the workpiece to be tested at different preset angles and the second controllable light source is extinguished, the control array camera assembly is controlled to obtain an image of the workpiece to be tested, and a second image group of the workpiece to be tested is generated;
根据所述第一待测工件图像组和第二待测工件图像组,生成待测工件图像亮度矩阵。According to the first image group of the workpiece to be tested and the second image group of the workpiece to be tested, an image brightness matrix of the workpiece to be tested is generated.
进一步,定义上述所述待测工件图像亮度矩阵为In为第n幅图像的亮度矩阵,所述根据所述待测工件图像矩阵,生成合成图像的步骤,包括:Further, define the above-mentioned workpiece image brightness matrix to be measured as I n is the brightness matrix of the nth image, and the step of generating a composite image according to the described workpiece image matrix to be tested, includes:
根据公式确定G值,其中为已知的光源照射角度矩阵,Ln T为第n幅图像对应的光源入射角度;According to the formula Determine the G value, where is the known light source illumination angle matrix, L n T is the light source incident angle corresponding to the nth image;
根据公式其中kd=||G||,生成合成图像。According to the formula where k d =||G||, generates a composite image.
本发明实施例通过提供打光支架,并在打光支架上由高至低设置至少第一环形支架、第二环形支架和第三环形支架,通过提供光源控制器控制设于各环形支架上的可控光源对呈物台上的待测工件进行打光,使得打光充分均匀,相对固定的第一环形支架、第二环形支架和第三环形支架使得照射角度相对固定,避免了误差的产生,同时,本发明利用缺陷目标对于不同光源方向和角度的反射特性,通过调整环形支架上可控光源的闪光规则,配合阵列相机组件获取的序列图像进行图像处理,实现对细微缺陷的检测。In the embodiment of the present invention, a lighting bracket is provided, and at least a first annular bracket, a second annular bracket and a third annular bracket are arranged on the lighting bracket from high to low, and a light source controller is provided to control the lights provided on each annular bracket. The controllable light source illuminates the workpiece to be tested on the stage, so that the illumination is sufficiently uniform, and the relatively fixed first annular bracket, second annular bracket and third annular bracket make the irradiation angle relatively fixed, avoiding the generation of errors At the same time, the invention utilizes the reflection characteristics of the defect target for different light source directions and angles, adjusts the flashing rules of the controllable light source on the ring support, and performs image processing in conjunction with the sequence images obtained by the array camera assembly, so as to realize the detection of subtle defects.
附图说明Description of drawings
为了更清楚地说明本发明实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to illustrate the technical solutions in the embodiments of the present invention more clearly, the following briefly introduces the accompanying drawings used in the description of the embodiments. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained from these drawings without creative effort.
图1是本发明第一实施例的多光源自动打光装置的立体图;1 is a perspective view of a multi-light source automatic lighting device according to a first embodiment of the present invention;
图2是图1移除呈物台后的立体图;Fig. 2 is the perspective view of Fig. 1 after removing the stage;
图3是图2的侧面视图;Fig. 3 is the side view of Fig. 2;
图4是本发明第一实施例的内支架和阵列相机组件的立体图;4 is a perspective view of the inner support and the array camera assembly according to the first embodiment of the present invention;
图5是本发明第二实施例的托盘和角度调整机构的立体图。5 is a perspective view of a tray and an angle adjustment mechanism according to a second embodiment of the present invention.
具体实施方式Detailed ways
为了使本发明所解决的技术问题、技术方案及有益效果更加清楚明白,以下结合附图及实施例,对本发明进行进一步详细说明。应当理解,此处所描述的具体实施例仅仅用以解释本发明,并不用于限定本发明。In order to make the technical problems, technical solutions and beneficial effects solved by the present invention clearer, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention, but not to limit the present invention.
当本发明实施例提及“第一”、“第二”(若存在)等序数词时,除非根据上下文其确实表达顺序之意,应当理解为仅仅是起区分之用。When ordinal numbers such as "first" and "second" (if any) are mentioned in the embodiments of the present invention, unless they really express the meaning of order according to the context, it should be understood that they are only used for distinction.
在本发明的描述中,需要说明的是,除非另有明确的规定和限定,术语“安装”、“相连”、“连接”(若存在)应做广义理解,例如,可以是固定连接,也可以是可拆卸连接,或一体地连接;可以是机械连接,也可以是电连接;可以是直接相连,也可以通过中间媒介间接相连,可以是两个元件内部的连通。对于本领域的普通技术人员而言,可以具体情况理解上述术语在本发明中的具体含义。In the description of the present invention, it should be noted that, unless otherwise expressly specified and limited, the terms "installed", "connected" and "connected" (if any) should be understood in a broad sense, for example, it may be a fixed connection, or It can be a detachable connection or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, and it can be the internal communication between the two components. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood in specific situations.
第一实施例:First embodiment:
请参照图1至图4所示,本发明实施例公开了一种多光源自动打光装置,包括:Referring to FIGS. 1 to 4 , an embodiment of the present invention discloses a multi-light source automatic lighting device, including:
打光支架1,所述打光支架包括位于不同高度位置的至少第一环形支架11、第二环形支架12和第三环形支架13,还至少包括设于所述第一环形支架11上的第一可控光源14、设于所述第二环形支架12上的第二可控光源15和设于所述第三环形支架13上的第三可控光源16;Lighting bracket 1, the lighting bracket includes at least a first
呈物台2,所述呈物台2于所述打光支架1底部形成的待测区域21;The object table 2 is shown as the area to be measured 21 formed by the object table 2 at the bottom of the lighting bracket 1;
阵列相机组件3,包括设于所述打光支架顶部的明域相机31和暗域相机32;The array camera assembly 3 includes a
光源控制器,用于控制所述第一可控光源14、第二可控光源15和第三可控光源16的照明角度和照明范围;a light source controller for controlling the illumination angle and illumination range of the first
机器视觉检测模块,用于根据所述明域相机31和暗域相机32在不同照明环境下获取的待测工件的图像,生成合成图像。The machine vision detection module is configured to generate a composite image according to the images of the workpiece to be tested obtained by the
在本实施例中,呈物台2包括传送装置,待测工件可以通过传送装置传送至呈物台的待测区域21内,待测区域21位于阵列相机组件3的主轴上,明域相机31用于检测产品表面的吸收光线类型的缺陷,或用于检测反射性质与待测工件存在明显差异的缺陷;暗域相机32用于检测产品表面的散射光线类型的缺陷,或用于检测反射光线方向与待测工件光滑表面明显不同的缺陷。通过明域相机31和暗域相机32的配合,使得本实施例的合成图像更利于后端的缺陷检测。In this embodiment, the
作为一种优选实施方案,上述所述明域相机31和暗域相机32的数量为各两个,所述明域相机31和暗域相机32设于所述待测区域21上方,且所述明域相机31和暗域相机32在圆周方向上间隔分布。As a preferred embodiment, the number of the above-mentioned
同时,所述第一可控光源14、第二可控光源15和第三可控光源16各包括圆周上均匀分布的八个固定光源。光源控制器通过控制固定光源的组合照明方式,可控制光源的照明角度和照明范围。Meanwhile, the first controllable
上述所述打光支架包括外支架4和内支架5,所述第一环形支架11、第二环形支架12和第三环形支架13形成于所述内支架5上;所述外支架4于所述呈物台2上形成用于支撑所述内支架5的支撑框架41、于所述内支架5上方形成梁状框架42,所述明域相机31和暗域相机32可活动的设置在所述梁状框架32上。内支架4可用于调整光源的整体位置,外支架5可用于调整阵列相机组件的位置,使得本发明实施力度自动打装置相对灵活。The above-mentioned lighting bracket includes an outer bracket 4 and an
作为一种示例而非限定,上述所述内支架5的形状为半球形,所述内支架5于所述明域相机31和暗域相机32下方形成图像采集缺口51。需要说明的是,上述内支架5的形状还可以是多棱柱状或多棱台状。As an example and not limitation, the shape of the
本发明实施例通过提供打光支架,并在打光支架上由高至低设置至少第一环形支架、第二环形支架和第三环形支架,通过提供光源控制器控制设于各环形支架上的可控光源对呈物台上的待测工件进行打光,使得打光充分均匀,相对固定的第一环形支架、第二环形支架和第三环形支架使得照射角度相对固定,避免了误差的产生,同时,本发明利用缺陷目标对于不同光源方向和角度的反射特性,通过调整环形支架上可控光源的闪光规则,配合阵列相机组件获取的序列图像进行图像处理,实现对细微缺陷的检测。In the embodiment of the present invention, a lighting bracket is provided, and at least a first annular bracket, a second annular bracket and a third annular bracket are arranged on the lighting bracket from high to low, and a light source controller is provided to control the lights provided on each annular bracket. The controllable light source illuminates the workpiece to be tested on the stage, so that the illumination is sufficiently uniform, and the relatively fixed first annular bracket, second annular bracket and third annular bracket make the irradiation angle relatively fixed, avoiding the generation of errors At the same time, the invention utilizes the reflection characteristics of the defect target for different light source directions and angles, adjusts the flashing rules of the controllable light source on the ring support, and performs image processing in conjunction with the sequence images obtained by the array camera assembly, so as to realize the detection of subtle defects.
第二实施例:Second embodiment:
与上述第一实施例不同的是,在本实施例中,第一环形支架上的第一可控光源为环形线光源,包括环形排布的多个发光体;所述第二可控光源通过滑块设置在第二环形支架上,并可在第二环形支架的滑槽内滑动;第三可控光源通过滑块设置在第三环形支架上,并可在第三环形支架的滑槽内滑动。光源控制器可控制第二可控光源和第三可控光源对应滑块在滑槽内的位置,以控制第二可控光源和第三可控光源的照射角度。Different from the above-mentioned first embodiment, in this embodiment, the first controllable light source on the first annular support is a ring-shaped line light source, including a plurality of luminous bodies arranged in a ring; the second controllable light source passes through the The slider is arranged on the second annular bracket and can slide in the chute of the second annular bracket; the third controllable light source is arranged on the third annular bracket through the slider and can slide in the slot of the third annular bracket slide. The light source controller can control the position of the second controllable light source and the third controllable light source corresponding to the slider in the chute, so as to control the irradiation angle of the second controllable light source and the third controllable light source.
同时,上述所述打光装置还包括设于所述明域相机和暗域相机上的距离传感器,所述距离传感器用于检测各所述明域相机和暗域相机与所述待测工件的相对距离;At the same time, the above-mentioned lighting device further includes a distance sensor arranged on the light field camera and the dark field camera, and the distance sensor is used to detect the distance between each of the light field camera and the dark field camera and the workpiece to be tested. relative distance;
请参照图5所示,所述呈物台包括设于所述待测区域周围的夹持组件6、位于所述夹持组件6下方用于承托所述待测工件的托盘7、以及设于所述托盘7下方的角度调整机构8,所述角度调整机构8包括伸缩杆81、与伸缩杆81连接的万向球82以及设于所述万向球82和托盘7之间的吸盘83,所述吸盘83可脱离的与所述托盘7连接;Referring to FIG. 5 , the object presentation table includes a clamping component 6 disposed around the area to be measured, a tray 7 located below the clamping component 6 for supporting the workpiece to be measured, and a device The
所述机器视觉检测模块还用于调整所述伸缩杆81的高度、以及所述万向球82的角度,以使所述待测工件与各所述明域相机和暗域相机的相对距离在预设距离范围内。The machine vision detection module is also used to adjust the height of the
作为一种具体实现方案,上述伸缩杆81可以是气缸杆,所述万向球82和吸盘83的结合处设有用于为吸盘83抽放空气的气泵接口84。上述距离传感器可以是红外传感器或超声波传感器,示例性的,当所述明域相机和暗域相机的数量均为第一实施例中的两个时,四个距离传感器用于获取待测工件上四个对应点到对应相机的距离,以得到待测工件与阵列相机组件的平均距离,以及待测工件表面的倾斜角度。当平均距离超出预设距离范围内时,机器视觉检测模块调整伸缩杆81的高度,以使待测工件位于阵列相机组件的预对焦范围内;当倾斜角度超出预设角度范围内时,机器视觉检测模块调整伸缩杆81上的万向球82的角度,以使工件表面正对阵列相机组件,以利于各可控光源对表面倾斜或不规则的待测工件打光,以及阵列相机组件获取清晰的待测工件正面图像。As a specific implementation solution, the above-mentioned
作为一种改进而非限定,上述所述托盘7为透明托盘,所述呈物台上还设有伸缩枢轴,所述托盘侧壁上设置有与所述伸缩枢轴对应的枢孔71;As an improvement but not a limitation, the above-mentioned tray 7 is a transparent tray, a telescopic pivot is further provided on the object stage, and a
所述机器视觉检测模块还用于控制所述伸缩枢轴翻转所述托盘7,以翻转所述待测工件。The machine vision detection module is also used to control the telescopic pivot to turn over the tray 7 to turn the workpiece to be tested.
当伸缩枢轴伸出时,伸缩枢轴插入托盘7侧壁的对应的枢孔71内,此时机器视觉检测模块控制所述伸缩枢轴翻转所述托盘,以使待测工件的背面正对阵列相机组件,由于待测工件的背面为放置面,通常放置面为平面,仅需对待测工件翻转即可对待测工件的背面表面进行打光和图像获取,简单方便。在本实施例中,角度调整机构8和伸缩枢轴择一的与托盘7连接,当伸缩枢轴缩回时,可通过角度调整机构与托盘连接并支撑托盘。When the telescopic pivot is extended, the telescopic pivot is inserted into the
由于在对待测工件进行打光和图像获取前,通常需要采用视觉标准件对阵列相机组件进行调校和对焦工作(以下称为预调校),使得各明域相机和暗域相机基本对焦在待测工件上,本实施例通过提供角度调整机构,使得自动打光装置可以自动识别待测工件的厚薄以及表面的平整情况,通过调整伸缩杆的高度,以使待测工件位于阵列相机组件的预对焦范围内,通过调整伸缩杆上的万向球的角度,以使工件表面大致正对阵列相机组件,以利于各可控光源为表面倾斜或不规则的待测工件打光,以及阵列相机组件获取清晰的待测工件正面图像,避免在面对不同待测工件时反复预调校导致效率低下的问题。同时,本实施例通过提供伸缩枢轴,并在托盘侧壁开设枢孔,使得机器视觉检测模块可以控制所述伸缩枢轴翻转所述托盘,以对待测工件的背面表面进行缺陷检测,避免了人工的介入,全自动化的设计操作简便,省时省力。Because before lighting and image acquisition of the workpiece to be tested, it is usually necessary to use visual standard parts to adjust and focus the array camera components (hereinafter referred to as pre-adjustment), so that the light field cameras and dark field cameras are basically focused at On the workpiece to be tested, in this embodiment, an angle adjustment mechanism is provided, so that the automatic lighting device can automatically identify the thickness of the workpiece to be tested and the smoothness of the surface, and the height of the telescopic rod is adjusted so that the workpiece to be tested is located at the position of the array camera assembly. Within the pre-focusing range, adjust the angle of the universal ball on the telescopic rod so that the surface of the workpiece is roughly facing the array camera assembly, so that each controllable light source can illuminate the workpiece to be tested with an inclined or irregular surface, and the array camera The component obtains a clear frontal image of the workpiece to be tested, avoiding the problem of inefficiency caused by repeated pre-adjustment in the face of different workpieces to be tested. At the same time, in this embodiment, by providing a telescopic pivot and opening a pivot hole on the side wall of the tray, the machine vision detection module can control the telescopic pivot to turn the tray over to perform defect detection on the back surface of the workpiece to be tested, avoiding the need for Manual intervention and fully automated design are easy to operate, saving time and effort.
第三实施例:Third embodiment:
本发明实施例提供了一种图像合成方法,应用于上述任一实施例所述的多光源自动打光装置,包括:An embodiment of the present invention provides an image synthesis method, which is applied to the multi-light source automatic lighting device described in any of the above embodiments, including:
控制第一可控光源在第一环形支架上呈常亮线光源状态;Controlling the first controllable light source on the first annular support to be in the state of a normally bright line light source;
控制第二可控光源在第二环形支架的多个预设角度依次照射待测工件;Controlling the second controllable light source to sequentially illuminate the workpiece to be tested at multiple preset angles of the second annular support;
控制第三可控光源在第三环形支架的多个预设角度依次照射待测工件;Controlling the third controllable light source to sequentially illuminate the workpiece to be tested at multiple preset angles of the third annular support;
当第二可控光源或第三可控光源在不同预设角度照射待测工件时,控制阵列相机组件获取所述待测工件图像,生成待测工件图像亮度矩阵;When the second controllable light source or the third controllable light source illuminates the workpiece to be tested at different preset angles, the array camera assembly is controlled to obtain an image of the workpiece to be tested, and an image brightness matrix of the workpiece to be tested is generated;
根据所述待测工件图像亮度矩阵和所述待测工件图像,生成合成图像。A composite image is generated according to the image brightness matrix of the workpiece to be tested and the image of the workpiece to be tested.
在本实施例中,在控制第一可控光源在第一环形支架上呈常亮线光源状态的步骤之前,还包括预调校的步骤:In this embodiment, before the step of controlling the first controllable light source to be in the state of a constant-bright line light source on the first annular support, it also includes the step of pre-adjustment:
用视觉标准件对阵列相机组件进行调校和对焦工作,使得各明域相机和暗域相机对焦在待测工件表面;Use the visual standard to adjust and focus the array camera components, so that each bright field camera and dark field camera focus on the surface of the workpiece to be tested;
通过光源控制器的预设闪光规则,使各第一可控光源、第二可控光源和第三可控光源依次在一定亮度范围内进行闪动;Through the preset flashing rules of the light source controller, each of the first controllable light source, the second controllable light source and the third controllable light source is sequentially flashed within a certain brightness range;
获取并应用阵列相机组件符合清晰度标准的闪光规则。Obtain and apply flash rules for array camera assemblies that meet sharpness standards.
作为一种具体打光方案,上述所述当第二可控光源或第三可控光源在不同预设角度照射待测工件时,控制阵列相机组件获取所述待测工件图像,得到待测工件图像亮度矩阵的步骤,包括:As a specific lighting scheme, when the second controllable light source or the third controllable light source illuminates the workpiece to be tested at different preset angles, the array camera assembly is controlled to obtain the image of the workpiece to be tested, and the workpiece to be tested is obtained. The steps of the image brightness matrix, including:
当第二可控光源在不同预设角度照射待测工件、且第三可控光源熄灭时,控制控制阵列相机组件获取待测工件的图像,生成第一待测工件图像组;When the second controllable light source illuminates the workpiece to be tested at different preset angles and the third controllable light source is extinguished, the control array camera assembly is controlled to obtain an image of the workpiece to be tested, and a first image group of the workpiece to be tested is generated;
当第三可控光源在不同预设角度照射待测工件、且第二可控光源熄灭时,控制控制阵列相机组件获取待测工件的图像,生成第二待测工件图像组;When the third controllable light source illuminates the workpiece to be tested at different preset angles and the second controllable light source is extinguished, the control array camera assembly is controlled to obtain an image of the workpiece to be tested, and a second image group of the workpiece to be tested is generated;
根据所述第一待测工件图像组和第二待测工件图像组,生成待测工件图像亮度矩阵。According to the first image group of the workpiece to be tested and the second image group of the workpiece to be tested, an image brightness matrix of the workpiece to be tested is generated.
作为一种示例,相对于上述第一实施例中第一可控光源、第二可控光源和第三可控光源各包括圆周上均匀分布的八个固定光源的方案,各相机获取16幅不同光源照射角度的图像。阵列相机组件共可获取4*16共64幅图像,其中,各预设角度的光源照射下均可获得2张明域照片和2张暗域照片。保障了图像合成方法的可靠性。As an example, compared to the solution in the first embodiment in which each of the first controllable light source, the second controllable light source and the third controllable light source includes eight fixed light sources evenly distributed on the circumference, each camera acquires 16 different Image of the angle of illumination of the light source. The array camera assembly can obtain a total of 64 images of 4*16, of which 2 bright field photos and 2 dark field photos can be obtained under the illumination of the light source at each preset angle. The reliability of the image synthesis method is guaranteed.
为了进一步降低光照不均、假缺陷对高质量图像采集的干扰,本实施例定义上述所述待测工件图像亮度矩阵为In为第n幅图像的亮度矩阵,所述根据所述待测工件图像矩阵,生成合成图像的步骤,包括:In order to further reduce the interference of uneven illumination and false defects on high-quality image acquisition, this embodiment defines the image brightness matrix of the workpiece to be tested as: I n is the brightness matrix of the nth image, and the step of generating a composite image according to the described workpiece image matrix to be tested, includes:
根据公式确定G值,其中为已知的光源照射角度矩阵,Ln T为第n幅图像对应的光源入射角度;According to the formula Determine the G value, where is the known light source illumination angle matrix, L n T is the light source incident angle corresponding to the nth image;
根据公式其中kd=||G||,生成合成图像。According to the formula where k d =||G||, generates a composite image.
通过上述合成方法,可进一步降低光照不均、假缺陷对高质量图像采集的干扰,获得高可靠性的合成图像。Through the above synthesis method, the interference of uneven illumination and false defects on high-quality image acquisition can be further reduced, and a highly reliable synthesized image can be obtained.
本发明实施例通过提供打光支架,并在打光支架上由高至低设置至少第一环形支架、第二环形支架和第三环形支架,通过提供光源控制器控制设于各环形支架上的可控光源对呈物台上的待测工件进行打光,使得打光充分均匀,相对固定的第一环形支架、第二环形支架和第三环形支架使得照射角度相对固定,避免了误差的产生,同时,本发明利用缺陷目标对于不同光源方向和角度的反射特性,通过调整环形支架上可控光源的闪光规则,配合阵列相机组件获取的序列图像进行图像处理,实现对细微缺陷的检测。In the embodiment of the present invention, a lighting bracket is provided, and at least a first annular bracket, a second annular bracket and a third annular bracket are arranged on the lighting bracket from high to low, and a light source controller is provided to control the lights provided on each annular bracket. The controllable light source illuminates the workpiece to be tested on the stage, so that the illumination is sufficiently uniform, and the relatively fixed first annular bracket, second annular bracket and third annular bracket make the irradiation angle relatively fixed, avoiding the generation of errors At the same time, the invention utilizes the reflection characteristics of the defect target for different light source directions and angles, adjusts the flashing rules of the controllable light source on the ring support, and performs image processing in conjunction with the sequence images obtained by the array camera assembly, so as to realize the detection of subtle defects.
以上仅为本发明的较佳实施例而已,并不用以限制本发明。凡在本发明的精神和原则之内所作的任何修改、等同替换和改进等,均应包含在本发明的保护范围之内。The above are only preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, equivalent replacements and improvements made within the spirit and principle of the present invention shall be included within the protection scope of the present invention.
Claims (7)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910131654 | 2019-02-22 | ||
CN2019101316540 | 2019-02-22 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN110231289A CN110231289A (en) | 2019-09-13 |
CN110231289B true CN110231289B (en) | 2022-05-31 |
Family
ID=67859977
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910520680.2A Active CN110231289B (en) | 2019-02-22 | 2019-06-17 | A multi-light source automatic lighting device and image synthesis method thereof |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110231289B (en) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111521609B (en) * | 2020-05-06 | 2023-07-18 | 宁波九纵智能科技有限公司 | System and method for simultaneously controlling image acquisition device and lighting device |
CN112326662A (en) * | 2020-09-15 | 2021-02-05 | 沈阳和研科技有限公司 | An image acquisition device based on an industrial camera |
CN112200113B (en) * | 2020-10-21 | 2022-08-16 | 天津中科智能识别产业技术研究院有限公司 | Self-adaptive light source device |
CN117929391A (en) * | 2024-02-29 | 2024-04-26 | 东莞市沃德普自动化科技有限公司 | Programmable phase shift control illumination method and light source |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103344563A (en) * | 2013-06-07 | 2013-10-09 | 上海大学 | Vision light source detection apparatus for self-adaptive dimming color-adjusting machine and method |
CN105269403A (en) * | 2015-11-27 | 2016-01-27 | 广东工业大学 | Detecting system and detecting method |
CN105953138A (en) * | 2015-12-31 | 2016-09-21 | 广东工业大学 | Machine vision light source device with light spot shape controllable and implementing method thereof |
CN107153069A (en) * | 2017-06-30 | 2017-09-12 | 苏州优纳科技有限公司 | A kind of device checked for FPC open defects |
CN109089013A (en) * | 2018-09-21 | 2018-12-25 | 中兴新通讯有限公司 | A kind of multiple light courcess detection image acquisition methods and Machine Vision Inspecting System |
-
2019
- 2019-06-17 CN CN201910520680.2A patent/CN110231289B/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103344563A (en) * | 2013-06-07 | 2013-10-09 | 上海大学 | Vision light source detection apparatus for self-adaptive dimming color-adjusting machine and method |
CN105269403A (en) * | 2015-11-27 | 2016-01-27 | 广东工业大学 | Detecting system and detecting method |
CN105953138A (en) * | 2015-12-31 | 2016-09-21 | 广东工业大学 | Machine vision light source device with light spot shape controllable and implementing method thereof |
CN107153069A (en) * | 2017-06-30 | 2017-09-12 | 苏州优纳科技有限公司 | A kind of device checked for FPC open defects |
CN109089013A (en) * | 2018-09-21 | 2018-12-25 | 中兴新通讯有限公司 | A kind of multiple light courcess detection image acquisition methods and Machine Vision Inspecting System |
Also Published As
Publication number | Publication date |
---|---|
CN110231289A (en) | 2019-09-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110231289B (en) | A multi-light source automatic lighting device and image synthesis method thereof | |
CN108760765B (en) | Side-view camera shooting-based surface damage defect detection device and method | |
CN103528954B (en) | A magnetic tile detection light source and camera adjustment device | |
TWI773032B (en) | An arched illumination device, an imaging system with the same and a method for imaging | |
CN205844213U (en) | A kind of curved surface automatic defect detecting device | |
WO2021129283A1 (en) | Illuminating apparatus used for automated optical inspection device, and imaging system | |
JP2015528591A (en) | Device, system and method for quickly and fully measuring a lens barrel drive device | |
KR20160121716A (en) | Surface inspection apparatus based on hybrid illumination | |
CN110749604A (en) | A machine vision-based defect detection device for highly reflective surfaces in metal barrels | |
CN209265169U (en) | A kind of multi-angle camera-shooting device | |
CN114280068A (en) | Columnar product detection system | |
JPH05160233A (en) | Inspecting method for bonding wire | |
JP2016065783A (en) | Inspection device | |
JPH05160231A (en) | Bonding wire inspecting apparatus | |
CN115541498A (en) | Image acquisition device | |
CN110599450A (en) | LED light source position correction method and system | |
CN114674834A (en) | Curved surface screen defect detection equipment | |
CN109470704A (en) | A kind of automobile brake support defects of vision detection system and its detection method | |
CN219799258U (en) | A chip defect detection system | |
CN201522265U (en) | A visual inspection system for VCM magnetic steel | |
CN219675799U (en) | A commutator hook-type visual inspection device based on optical-mechanical hybrid | |
CN208420725U (en) | A kind of automobile brake support defects of vision detection system | |
CN211014053U (en) | High-precision automatic object surface flaw image capturing device | |
CN208444207U (en) | An intelligent lighting detection system | |
TWM589791U (en) | High-precision automatic object surface defect image capturing device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |