CN106546597A - Weld quality prediction system and method - Google Patents
Weld quality prediction system and method Download PDFInfo
- Publication number
- CN106546597A CN106546597A CN201510606902.4A CN201510606902A CN106546597A CN 106546597 A CN106546597 A CN 106546597A CN 201510606902 A CN201510606902 A CN 201510606902A CN 106546597 A CN106546597 A CN 106546597A
- Authority
- CN
- China
- Prior art keywords
- image
- welded joint
- solder
- stage
- joint
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 24
- 238000003466 welding Methods 0.000 claims abstract description 72
- 238000003384 imaging method Methods 0.000 claims abstract description 44
- 229910000679 solder Inorganic materials 0.000 claims description 56
- 238000007689 inspection Methods 0.000 claims description 27
- 238000001514 detection method Methods 0.000 claims description 14
- 238000005476 soldering Methods 0.000 claims description 11
- 238000009826 distribution Methods 0.000 claims description 8
- 238000009877 rendering Methods 0.000 abstract 2
- 238000004458 analytical method Methods 0.000 description 6
- 230000007547 defect Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000001788 irregular Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- XEEYBQQBJWHFJM-UHFFFAOYSA-N Iron Chemical compound [Fe] XEEYBQQBJWHFJM-UHFFFAOYSA-N 0.000 description 2
- 230000001066 destructive effect Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 239000000758 substrate Substances 0.000 description 2
- 230000004927 fusion Effects 0.000 description 1
- 229910052742 iron Inorganic materials 0.000 description 1
- 238000002844 melting Methods 0.000 description 1
- 230000008018 melting Effects 0.000 description 1
- 238000009659 non-destructive testing Methods 0.000 description 1
- 231100000241 scar Toxicity 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 239000011800 void material Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
- G01B11/245—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures using a plurality of fixed, simultaneously operating transducers
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/95—Investigating the presence of flaws or contamination characterised by the material or shape of the object to be examined
- G01N21/956—Inspecting patterns on the surface of objects
- G01N21/95684—Patterns showing highly reflecting parts, e.g. metallic elements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
- G06T7/0006—Industrial image inspection using a design-rule based approach
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/95—Investigating the presence of flaws or contamination characterised by the material or shape of the object to be examined
- G01N21/956—Inspecting patterns on the surface of objects
- G01N2021/95638—Inspecting patterns on the surface of objects for PCB's
- G01N2021/95646—Soldering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10024—Color image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10028—Range image; Depth image; 3D point clouds
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
- G06T2207/30141—Printed circuit board [PCB]
Landscapes
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Immunology (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- General Health & Medical Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Pathology (AREA)
- Health & Medical Sciences (AREA)
- Quality & Reliability (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Theoretical Computer Science (AREA)
- Length Measuring Devices By Optical Means (AREA)
- Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
Abstract
Description
技术领域technical field
本发明的实施例一般地涉及产品检测领域,并且更具体地,涉及用于可靠地和准确地检测产品的焊接接头的质量的系统和方法。Embodiments of the present invention relate generally to the field of product inspection, and more particularly, to systems and methods for reliably and accurately inspecting the quality of welded joints of products.
背景技术Background technique
焊接工艺是在制造诸如电路板之类的电子产品时常用的工艺,可以用于进行电路引线或引脚的焊接,其焊接质量直接关系到产品的质量。实际生产中会出现焊接不良问题,包括虚焊、假焊、空焊、焊接不牢等,可能导致电路不能正常工作,因此需要对焊接质量进行检测。由于焊料流动,焊接接头或焊垫可能具有不规则的形状,这对焊接质量的检测是一个挑战。The welding process is a commonly used process in the manufacture of electronic products such as circuit boards. It can be used for welding circuit leads or pins. The welding quality is directly related to the quality of the product. Poor welding problems will occur in actual production, including virtual welding, false welding, empty welding, weak welding, etc., which may cause the circuit to not work normally, so it is necessary to inspect the welding quality. Due to solder flow, solder joints or pads may have irregular shapes, which is a challenge for solder quality inspection.
现有焊接检测技术主要包括破坏性检测和非破坏性或无损检测。无损检测技术包括人工目视检测、超声波检测、自动光学检测等,可以进行外观检验,包括尺寸检验、几何形状检测、外表伤痕检测等。在自动光学检测技术中,通过对产品上的焊点或焊接接头进行成像,通过分析图像实现焊接质量的检测。目前,自动光学检测主要采用传统的二维(2D)相机对焊点或焊接接头进行成像,仅能够获得X-Y平面信息,对于不规则或空间轮廓复杂的焊点形状,从2D图像中不能准确地确定哪个因素是引起图像中的特征的主要因素。例如,2D成像检测技术不能确定2D图像中的黑斑是由焊接轮廓中的凸起还是凹陷引起的。Existing welding inspection technologies mainly include destructive inspection and non-destructive or nondestructive inspection. Non-destructive testing techniques include manual visual testing, ultrasonic testing, automatic optical testing, etc., and can perform appearance inspections, including dimensional inspections, geometric shape inspections, and surface scar inspections. In the automatic optical inspection technology, by imaging the solder joints or solder joints on the product, the inspection of the welding quality is realized by analyzing the image. At present, automatic optical inspection mainly uses traditional two-dimensional (2D) cameras to image solder joints or solder joints, which can only obtain X-Y plane information. For solder joint shapes with irregular or complex spatial contours, it cannot be accurately determined from 2D images. Determine which factor is responsible for the features in the image. For example, 2D imaging inspection techniques cannot determine whether dark spots in a 2D image are caused by bumps or depressions in the weld profile.
发明内容Contents of the invention
有鉴于此,本发明提供了一种焊接质量检测系统和方法,其能够相对可靠地和准确地检测产品的焊点或焊接接头的质量。In view of this, the present invention provides a welding quality detection system and method, which can relatively reliably and accurately detect the quality of solder joints or joints of products.
本发明的一个方面提供了一种焊接质量检测系统,包括:工作台;载物台,用于在其上放置具有待检测的焊接接头的样品,该载物台被支撑在工作台上并能够相对于工作台移动;2D成像装置,用于对放置在载物台上的样品的焊接接头进行成像以获得2D图像;3D成像装置,用于对放置在载物台上的样品的焊接接头进行成像以获得3D图像;和处理装置,用于接收2D图像和3D图像并对它们进行处理以判定焊接接头的焊接质量。One aspect of the present invention provides a welding quality detection system, comprising: a workbench; Relative to the table movement; 2D imaging device, used to image the welded joint of the sample placed on the stage to obtain a 2D image; 3D imaging device, used to image the welded joint of the sample placed on the stage imaging to obtain a 3D image; and processing means for receiving the 2D image and the 3D image and processing them to determine the welding quality of the welded joint.
较佳地,处理装置可以被配置成分析3D图像以获得焊接接头的高度信息,并基于高度信息确定焊接接头中的凸起或凹陷。Preferably, the processing means may be configured to analyze the 3D image to obtain height information of the welded joint, and to determine protrusions or depressions in the welded joint based on the height information.
较佳地,处理装置可以被配置成分析2D图像和/或3D图像以获得焊接接头的宽度信息。Preferably, the processing means may be configured to analyze the 2D image and/or the 3D image to obtain width information of the welded joint.
较佳地,该焊接质量检测系统还可以包括显示装置,其用于显示2D图像和3D图像和/或用于显示指示焊接接头的焊接质量的判定结果。Preferably, the welding quality detection system may further include a display device for displaying 2D images and 3D images and/or for displaying a judgment result indicating the welding quality of the welded joint.
较佳地,该焊接质量检测系统还可以包括:固定在工作台上的滑轨;和支撑载物台的支架,该支架被构造成在控制装置的控制下由驱动装置驱动以沿着滑轨相对于工作台移动,以将载物台分别定位在适于由2D成像装置和3D成像装置对载物台上的样品的焊接接头进行成像的位置。Preferably, the welding quality detection system may also include: a slide rail fixed on the workbench; and a bracket supporting the object table, the bracket is configured to be driven by the driving device to move along the slide rail under the control of the control device. moving relative to the worktable to respectively position the stage at positions suitable for imaging welded joints of samples on the stage by the 2D imaging device and the 3D imaging device.
在本发明的另一个方面中,提供了一种采用上述焊接质量检测系统检测焊接接头的方法,包括下述步骤:In another aspect of the present invention, a method for detecting welded joints using the above-mentioned welding quality inspection system is provided, including the following steps:
将具有待检测的焊接接头的样品放置在载物台上;placing the sample with the welded joint to be inspected on the stage;
移动载物台至第一检测位置,以由2D成像装置对放置在载物台上的样品的焊接接头进行成像以获得2D图像;moving the stage to the first detection position, so that the welding joint of the sample placed on the stage is imaged by a 2D imaging device to obtain a 2D image;
移动载物台至第二检测位置,以由3D成像装置对放置在载物台上的样品的焊接接头进行成像以获得3D图像;以及moving the stage to a second detection position, so that the welding joint of the sample placed on the stage is imaged by a 3D imaging device to obtain a 3D image; and
接收2D图像和3D图像并对它们进行处理以判定焊接接头的焊接质量。2D and 3D images are received and processed to determine the weld quality of the welded joint.
较佳地,对所述图像进行处理以判定焊接接头的焊接质量的步骤可以包括分析3D图像以获得焊接接头的高度信息,并基于高度信息确定焊接接头中的凸起或凹陷。Preferably, the step of processing the image to determine the welding quality of the welded joint may include analyzing the 3D image to obtain height information of the welded joint, and determining protrusions or depressions in the welded joint based on the height information.
焊接接头可以是通过由焊料将导线焊接在样品的焊垫上而形成的,并且较佳地,分析3D图像以获得焊接接头的高度信息的步骤可以包括:在焊接接头的高度方向上将3D图像的平行于高度方向的垂直横截面划分成多个垂直子区域;确定焊料在每个垂直子区域内的部分的边缘的子高度;以及根据焊料在各个垂直子区域内的子高度获得焊料在该垂直横截面内的高度分布信息。The solder joint may be formed by soldering the wire on the pad of the sample with solder, and preferably, the step of analyzing the 3D image to obtain the height information of the solder joint may include: A vertical cross-section parallel to the height direction is divided into a plurality of vertical sub-regions; determining the sub-height of the edge of the part of the solder in each vertical sub-region; Height distribution information within the cross section.
较佳地,对所述图像进行处理以判定焊接接头的焊接质量的步骤可以包括分析2D图像和/或3D图像以获得焊接接头的宽度信息。Preferably, the step of processing the image to determine the welding quality of the welded joint may include analyzing the 2D image and/or the 3D image to obtain width information of the welded joint.
较佳地,分析2D图像和/或3D图像以获得焊接接头的宽度信息的步骤可以包括:在焊接接头的长度方向上将3D图像的平行于所述长度方向的一水平横截面或将2D图像划分成多个水平子区域;确定焊料在每个水平子区域内的部分的子宽度;以及根据焊料在各个水平子区域内的子宽度获得焊料沿所述长度方向的宽度分布信息。Preferably, the step of analyzing the 2D image and/or the 3D image to obtain the width information of the welded joint may include: taking a horizontal cross-section of the 3D image parallel to the lengthwise direction in the length direction of the welded joint or taking the 2D image dividing into a plurality of horizontal sub-regions; determining the sub-width of the part of the solder in each horizontal sub-region; and obtaining width distribution information of the solder along the length direction according to the sub-width of the solder in each horizontal sub-region.
较佳地,上述方法还可以包括在显示装置上显示焊接接头的2D图像和3D图像、宽度/高度分布信息、和/或指示焊接接头的焊接质量的判定结果。Preferably, the above method may further include displaying the 2D image and 3D image of the welded joint, width/height distribution information, and/or a determination result indicating the welding quality of the welded joint on a display device.
附图说明Description of drawings
根据结合附图的以下详细描述,本发明的多个实施例的上述和其他方面、特征以及优点将更清楚,在附图中:The above and other aspects, features and advantages of various embodiments of the present invention will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which:
图1是示出具有待检测的焊接区域的示例性产品的平面图;FIG. 1 is a plan view showing an exemplary product with a weld area to be inspected;
图2是示意性地示出根据本发明的一个示例性实施例的焊接质量检测系统的布置的透视图;2 is a perspective view schematically showing the arrangement of a welding quality inspection system according to an exemplary embodiment of the present invention;
图3是根据本发明的实施例的焊接质量检测系统获得的焊接区域的三维(3D)照片;Fig. 3 is a three-dimensional (3D) photo of the welding area obtained by the welding quality inspection system according to an embodiment of the present invention;
图4是示意性地示出根据本发明的一个示例性实施例的焊接质量检测方法的流程图;Fig. 4 is a flowchart schematically showing a welding quality detection method according to an exemplary embodiment of the present invention;
图5是示出根据本发明的一个示例性实施例的水平分析图像的方法的示意图;5 is a schematic diagram illustrating a method for horizontally analyzing an image according to an exemplary embodiment of the present invention;
图6是示出根据本发明的一个示例性实施例的垂直分析图像的方法的示意图;以及6 is a schematic diagram illustrating a method of vertically analyzing an image according to an exemplary embodiment of the present invention; and
图7是示出根据图5和6中示出的方法获得的焊接接头的轮廓的示意图。FIG. 7 is a schematic diagram showing the profile of a welded joint obtained according to the method shown in FIGS. 5 and 6 .
具体实施方式detailed description
下面将结合附图,对本发明的实施例进行详细的描述。在本说明书中,相同或相似的部件由相同或类似的附图标号指示。下述参照附图对本发明的各实施方式的说明旨在阐述本发明的总体构思,而不应当理解为对本发明的一种限制。Embodiments of the present invention will be described in detail below with reference to the accompanying drawings. In this specification, the same or similar components are denoted by the same or similar reference numerals. The following descriptions of various embodiments of the present invention with reference to the accompanying drawings are intended to illustrate the general concept of the present invention, but should not be construed as a limitation of the present invention.
此外,在下面的详细描述中,为便于说明,阐述了许多具体的细节以提供对本发明的实施例的全面理解。然而明显地,一个或多个实施例在没有这些具体细节的情况下也可以被实施。在其它情况下,公知的结构和装置以图示的方式体现以简化附图。Furthermore, in the following detailed description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the embodiments of the invention. It may be evident, however, that one or more embodiments may be practiced without these specific details. In other instances, well-known structures and devices are shown in diagrammatic form to simplify the drawings.
图1示出了具有待检测的焊接区域A的样品10的一个示例。样品10可以是具有焊接接头的各种电子产品,包括电路板、PCB板等,本文对此不做限定。如图所示,样品10包括基板11和形成在基板11上的导电迹线12,并且在焊接区域A内,可以采用合适的焊料通过多种焊接方式,包括激光焊接、烙铁钎焊、热熔焊接等,将导线或引脚13焊接在与迹线12连接的焊垫上。FIG. 1 shows an example of a sample 10 with a weld area A to be inspected. The sample 10 can be various electronic products with solder joints, including circuit boards, PCB boards, etc., which is not limited herein. As shown, the sample 10 includes a substrate 11 and conductive traces 12 formed on the substrate 11, and in the soldering area A, a suitable solder can be used by various soldering methods, including laser welding, soldering iron soldering, hot melting Soldering etc., solder the wire or pin 13 on the pad connected to the trace 12.
为了对焊接区域A进行检测,本发明的实施例提供了一种焊接质量检测系统100,如图1所示,其主要包括工作台110、载物台120、2D成像装置130、3D成像装置140和处理装置(未示出)。具有待检测的焊接接头的样品,如上所述的样品10,可以被放置在载物台120上,载物台120被支撑在工作台110上并能够相对于工作台120移动,从而在移动到合适的位置后,由2D成像装置130和3D成像装置140对载物台120上的样品的焊接接头进行成像。In order to detect the welding area A, an embodiment of the present invention provides a welding quality detection system 100, as shown in FIG. and processing means (not shown). A sample having a welded joint to be inspected, sample 10 as described above, may be placed on stage 120, which is supported on table 110 and movable relative to table 120 so that when moving to After a proper position, the welding joint of the sample on the stage 120 is imaged by the 2D imaging device 130 and the 3D imaging device 140 .
与仅采用2D成像装置的常规检测技术不同,根据本发明的实施例,在焊接质量检测系统100中同时结合了2D成像装置130和3D成像装置140二者,其中2D成像装置130用于对放置在载物台120的样品的焊接接头进行成像以获得2D图像,而3D成像装置140用于对放置在载物台120上的样品的焊接接头进行成像以获得3D图像。处理装置与2D成像装置130和3D成像装置140通信以从它们接收所获得的2D图像和3D图像,并进行图像处理和分析以判定焊接接头的焊接质量。Different from the conventional inspection technology that only uses 2D imaging device, according to the embodiment of the present invention, both 2D imaging device 130 and 3D imaging device 140 are combined in welding quality inspection system 100, wherein 2D imaging device 130 is used to The welding joint of the sample on the stage 120 is imaged to obtain a 2D image, and the 3D imaging device 140 is used to image the welding joint of the sample placed on the stage 120 to obtain a 3D image. The processing device communicates with the 2D imaging device 130 and the 3D imaging device 140 to receive the obtained 2D images and 3D images therefrom, and perform image processing and analysis to determine the welding quality of the welded joint.
在本发明中,对2D成像装置130和3D成像装置140的形式和布置不做限制,可以采用任何能够提供合适的2D图像和3D图像的相机或成像装置。在一个示例中,2D成像装置130和/或3D成像装置140可以相对于工作台110固定;可替换地,2D成像装置130和/或3D成像装置140可以被布置成能够相对于工作台110垂直移动,以便于焊接接头的对焦,或者也可以被布置成能够相对于工作台110在水平方向上移动,以便于检测具有不同尺寸、规格、焊接接头数量的产品,或检测具有不同尺寸或直径的焊接导线或引脚等。In the present invention, there is no limitation on the form and arrangement of the 2D imaging device 130 and the 3D imaging device 140 , and any camera or imaging device that can provide suitable 2D images and 3D images can be used. In one example, the 2D imaging device 130 and/or the 3D imaging device 140 may be fixed relative to the table 110; alternatively, the 2D imaging device 130 and/or the 3D imaging device 140 may be arranged to be vertical relative to the table 110 Move to facilitate the focus of the welding joints, or can also be arranged to be able to move in the horizontal direction relative to the worktable 110, so as to detect products with different sizes, specifications, and number of welding joints, or to detect products with different sizes or diameters Solder wires or pins etc.
图3示出了根据本发明的实施例的焊接质量检测系统获得的焊接接头的3D照片,从中可以看出,在焊接接头14上存在凸起15。显然,在2D图像中,却不能确定地判断这样的凸起或凹陷的存在。可以理解,诸如凸起或凹陷之类的不规则特征的存在表明焊接接头存在焊接缺陷,例如,凸起可能意味着其它位置处的焊料不足或存在空隙,而凹陷可能意味着该处的焊料不足或流向焊接区域之外,导致虚焊、假焊、空焊、焊接不牢等不良现场。FIG. 3 shows a 3D photo of a welded joint obtained by the welding quality inspection system according to an embodiment of the present invention, from which it can be seen that there is a protrusion 15 on the welded joint 14 . Obviously, in a 2D image, the existence of such protrusions or depressions cannot be determined with certainty. It is understood that the presence of irregular features such as bumps or depressions indicates a soldering defect in the solder joint, for example a bump may indicate insufficient solder or a void elsewhere, while a depression may indicate insufficient solder there Or flow out of the welding area, resulting in bad sites such as false welding, false welding, empty welding, and weak welding.
而在本发明中,由3D成像装置140对放置在载物台120上的样品的焊接接头14进行成像以获得它的3D图像或数据,其中包含焊接接头的各个位置处的高度信息。在一个示例中,由处理装置分析所获得的3D图像以从中提取焊接接头的高度信息,从而基于所提取的高度信息能够确定或判断焊接接头中是否存在诸如凸起或凹陷之类的缺陷。例如,当焊接接头的某个位置处的高度超过一阈值时,则表明该位置处的焊料过多或存在凸起,导致其它位置焊料不足或未被焊接;而在焊接接头的某个位置处的高度低于另一阈值时,则表明该位置处的焊料不足而可能导致空焊、焊接不牢或焊料流至不希望的区域等问题。In the present invention, the 3D imaging device 140 images the welding joint 14 of the sample placed on the stage 120 to obtain its 3D image or data, which includes height information at various positions of the welding joint. In one example, the obtained 3D image is analyzed by the processing device to extract height information of the welded joint therefrom, so that it can be determined or determined whether there is a defect such as a protrusion or a depression in the welded joint based on the extracted height information. For example, when the height at a certain position of the solder joint exceeds a threshold value, it indicates that there is too much solder at this position or there is a protrusion, resulting in insufficient or unsoldered solder at other positions; Below another threshold, it indicates that there is not enough solder at that location, which can lead to problems such as empty soldering, poor soldering, or solder flow to undesired areas.
在另一个示例中,还可以由处理装置被配置成分析所获得的2D图像和/或3D图像以提取焊接接头的宽度或跨度信息。可以理解,过宽的焊接接头可能导致焊接不牢、虚焊、空焊或焊接至不期望的位置等问题,而过窄的焊接接头也可能导致焊接不牢、虚焊等问题。此外,2D图像和3D图像的结合或融合还可以用于准确地确定焊接接头上的缺陷的位置。In another example, the processing device may also be configured to analyze the obtained 2D image and/or 3D image to extract width or span information of the welded joint. It can be understood that a weld joint that is too wide may cause problems such as weak welds, empty welds, empty welds, or welded to undesired positions, and a weld joint that is too narrow may also cause problems such as weak welds and false welds. In addition, the combination or fusion of 2D and 3D images can also be used to accurately determine the location of defects on the welded joint.
如图1所示,本发明的实施例提供的焊接质量检测系统还可以包括显示装置150,如显示器,其可以与2D成像装置130和/或3D成像装置140通信,用于显示焊接接头的2D图像和3D图像、用于焊接接头的的高度和/或宽度信息等、和/或用于显示指示焊接接头的焊接质量的判定结果。As shown in Figure 1, the welding quality detection system provided by the embodiment of the present invention may also include a display device 150, such as a display, which may communicate with a 2D imaging device 130 and/or a 3D imaging device 140 for displaying the 2D image of a welded joint. images and 3D images, height and/or width information for welded joints, etc., and/or used to display judgment results indicating welding quality of welded joints.
在图1中图示的示例中,焊接质量检测系统100还包括滑轨160和支架170,滑轨160可以固定在工作台110上,支架170支撑载物台120并能够在控制装置(未示出)的控制下由驱动装置(未示出)驱动以沿着滑轨160相对于工作台110移动,从而将载物台120分别移动并定位在适于由2D成像装置130和3D成像装置140对载物台120上的样品的焊接接头14进行成像的位置。可以理解,在本发明的实施例中,处理装置和控制装置可以是单独的设备,或者二者也可以集成在一起,如结合在处理器中。示例性地,处理装置、控制装置和显示装置可以集成在计算机中,它们彼此通信,以实现焊接接头的成像控制、图像处理、分析、显示等操作。此外,驱动装置可以采取液压缸或马达的形式,本文对此不做限定。In the example illustrated in FIG. 1 , the welding quality inspection system 100 also includes a slide rail 160 and a bracket 170, the slide rail 160 can be fixed on the workbench 110, and the bracket 170 supports the stage 120 and can be controlled by a control device (not shown). out) is driven by a driving device (not shown) to move relative to the worktable 110 along the slide rail 160, so that the object stage 120 is respectively moved and positioned in a position suitable for being used by the 2D imaging device 130 and the 3D imaging device 140. The location to image the welded joint 14 of the sample on the stage 120 . It can be understood that, in the embodiment of the present invention, the processing device and the control device may be separate devices, or both may also be integrated together, such as being combined in a processor. Exemplarily, the processing device, the control device and the display device may be integrated in a computer, and they communicate with each other to realize operations such as imaging control, image processing, analysis, and display of the welded joint. In addition, the driving device may be in the form of a hydraulic cylinder or a motor, which is not limited herein.
图4示意性地示出根据本发明的一个示例性实施例的焊接质量检测方法的流程,其可以上述实施例中所述的焊接质量检测系统检测焊接接头的质量。该方法主要包括下述步骤:Fig. 4 schematically shows the flow of a welding quality inspection method according to an exemplary embodiment of the present invention, which can inspect the quality of a welded joint with the welding quality inspection system described in the above embodiments. The method mainly includes the following steps:
在步骤S101中,将具有待检测的焊接接头的样品放置在载物台上;In step S101, the sample with the welded joint to be tested is placed on the stage;
在步骤S102中,将载物台移动至第一检测位置,以由2D成像装置对放置在载物台的样品的焊接接头进行成像以获得2D图像;In step S102, the stage is moved to a first detection position, so that the welding joint of the sample placed on the stage is imaged by a 2D imaging device to obtain a 2D image;
在步骤S103中,将载物台移动至第二检测位置,以由3D成像装置对放置在载物台的样品的焊接接头进行成像以获得3D图像;以及In step S103, the stage is moved to a second detection position, so that the welding joint of the sample placed on the stage is imaged by a 3D imaging device to obtain a 3D image; and
在步骤S104中,由处理装置接收2D图像和3D图像并对它们进行处理和分析以判定焊接接头的焊接质量。In step S104, the 2D image and the 3D image are received by the processing device and processed and analyzed to determine the welding quality of the welded joint.
在一个示例中,步骤S104可以包括由处理装置处理并分析2D图像和/或3D图像以提取焊接接头的宽度信息。图5示出了根据本发明的一个示例性实施例的用于获取宽度信息的水平分析方法。如图所示,可以在焊接接头14的长度方向上将所获得的2D图像20或3D图像的平行于所述长度方向的一水平横截面划分成多个水平子区域20-1、20-2……20-n,随后例如通过确定焊料16在每个水平子区域内的部分的边缘的坐标,可以确定焊料16在每个水平子区域内的部分的子宽度(图中由W指示焊料在导线13一侧的宽度),由此可以根据焊料16在各个水平子区域内的子宽度获得焊料沿所述长度方向的宽度分布信息。各个水平子区域可以具有相同或不同的形状和间隔,其数量可以根据焊接接头的结构、处理装置的处理能力等因素适当地选择。In one example, step S104 may include processing and analyzing the 2D image and/or the 3D image by the processing device to extract width information of the welded joint. Fig. 5 shows a horizontal analysis method for obtaining width information according to an exemplary embodiment of the present invention. As shown, a horizontal cross-section of the obtained 2D image 20 or 3D image parallel to the longitudinal direction of the welded joint 14 can be divided into a plurality of horizontal sub-regions 20-1, 20-2 ... 20-n, then for example by determining the coordinates of the edge of the part of the solder 16 in each horizontal sub-region, the sub-width of the part of the solder 16 in each horizontal sub-region can be determined (indicated by W in the figure that the solder is in Width on one side of the conductive wire 13), thus the width distribution information of the solder along the length direction can be obtained according to the sub-width of the solder 16 in each horizontal sub-region. Each horizontal sub-region may have the same or different shapes and intervals, and the number thereof may be appropriately selected according to factors such as the structure of the welded joint and the processing capacity of the processing device.
在另一个示例中,步骤S104可以包括由处理装置分析和处理所获得的3D图像以提取焊接接头的高度信息,并基于高度信息确定焊接接头中的凸起或凹陷。示例性地,可以采用图6所示的垂直分析方法获取焊接接头的高度信息和/或宽度信息。如图所示,可以在焊接接头14的高度方向上将所获得3D图像30的平行于该高度方向的垂直横截面划分成多个垂直子区域30-1,30-2……30-m,随后例如通过确定焊料16在每个水平子区域内的部分的边缘的坐标,可以确定焊料16在每个垂直子区域内的部分的边缘的子高度h,和/或确定焊料16在每个垂直子区域内的部分的子宽度(图中由W指示焊料在导线13一侧的宽度),由此可以根据焊料在各个垂直子区域内的子高度获得焊料在该垂直横截面内的高度分布信息和/或宽度分布信息。同样,各个垂直子区域可以具有相同或不同的形状和间隔,其数量可以根据焊接接头的结构、处理装置的处理能力等因素适当地选择。此外,可以在焊接接头的长度方向将所获得的3D图像分成多个垂直横截面,再针对每一个垂直横截面提取焊接接头的高度信息和/或宽度信息。In another example, step S104 may include analyzing and processing the obtained 3D image by the processing device to extract height information of the welded joint, and determining protrusions or depressions in the welded joint based on the height information. Exemplarily, the vertical analysis method shown in FIG. 6 may be used to acquire height information and/or width information of the welded joint. As shown in the figure, the vertical cross-section of the obtained 3D image 30 parallel to the height direction of the welded joint 14 can be divided into a plurality of vertical sub-regions 30-1, 30-2 ... 30-m, The sub-height h of the edge of the portion of solder 16 in each vertical sub-area can then be determined, for example by determining the coordinates of the edge of the portion of solder 16 in each horizontal sub-area, and/or determine the position of solder 16 in each vertical sub-area. The sub-width of the part in the sub-region (the width of the solder on the wire 13 side is indicated by W in the figure), thus the height distribution information of the solder in the vertical cross-section can be obtained according to the sub-height of the solder in each vertical sub-region and/or width distribution information. Likewise, each vertical sub-region may have the same or different shapes and intervals, and the number thereof may be appropriately selected according to factors such as the structure of the welded joint and the processing capacity of the processing device. In addition, the obtained 3D image may be divided into multiple vertical cross-sections along the length direction of the welded joint, and height information and/or width information of the welded joint may be extracted for each vertical cross-section.
可以理解,在其它实施例中,上述水平分析方法和垂直分析方法可以结合,以便更加准确地提取焊接接头的高度信息和/或宽度信息。例如,可以首先将所获得图像划分成多个水平子区域,再结合3D图像针对每个水平子区域进行垂直划分;可替换地,可以首先将所获得的3D图像划分成多个垂直子区域,再结合针对每个垂直子区域进行水平划分,从而使得高度信息和/或宽度信息的提取更加精细。It can be understood that, in other embodiments, the above-mentioned horizontal analysis method and vertical analysis method may be combined so as to more accurately extract the height information and/or width information of the welded joint. For example, the obtained image may be first divided into multiple horizontal sub-regions, and then vertically divided for each horizontal sub-region in combination with the 3D image; alternatively, the obtained 3D image may be firstly divided into multiple vertical sub-regions, Combined with horizontal division for each vertical sub-region, the height information and/or width information can be extracted more finely.
此外,还可以根据所获得的焊接接头的高度和宽度信息,可以分析焊接接头上的各个位置处的焊料的角度、倾斜度或轮廓是否满足焊接质量标准。In addition, according to the obtained height and width information of the solder joint, it is possible to analyze whether the angle, inclination or profile of the solder at various positions on the solder joint meets the solder quality standard.
尽管已经示出和描述了本发明的实施例,但对于本领域的普通技术人员而言,可以理解在不脱离本发明的原理和精神的情况下可以对这些实施例进行变化,本发明的保护范围由所附权利要求及其等同物限定。此外应注意,除非另外指明,本文中使用的措词“包括”、“包含”、“具有”不排除其它元件或步骤,措词“一”或“一个”不排除多个。另外,权利要求的任何元件标号不应理解为限制本发明的保护范围。Although the embodiments of the present invention have been shown and described, it will be understood by those skilled in the art that changes can be made to these embodiments without departing from the principle and spirit of the present invention. The scope is defined by the claims appended hereto and their equivalents. It should also be noted that the words "comprises", "comprises" and "having" used herein do not exclude other elements or steps, and the words "a" or "an" do not exclude a plurality, unless otherwise specified. In addition, any element numbers in the claims should not be construed as limiting the protection scope of the present invention.
Claims (11)
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510606902.4A CN106546597A (en) | 2015-09-22 | 2015-09-22 | Weld quality prediction system and method |
TW105130372A TW201721134A (en) | 2015-09-22 | 2016-09-20 | System and method for detecting soldering quality |
PCT/EP2016/072592 WO2017050924A1 (en) | 2015-09-22 | 2016-09-22 | System and method for detecting soldering quality |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510606902.4A CN106546597A (en) | 2015-09-22 | 2015-09-22 | Weld quality prediction system and method |
Publications (1)
Publication Number | Publication Date |
---|---|
CN106546597A true CN106546597A (en) | 2017-03-29 |
Family
ID=57103979
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201510606902.4A Pending CN106546597A (en) | 2015-09-22 | 2015-09-22 | Weld quality prediction system and method |
Country Status (3)
Country | Link |
---|---|
CN (1) | CN106546597A (en) |
TW (1) | TW201721134A (en) |
WO (1) | WO2017050924A1 (en) |
Cited By (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107764822A (en) * | 2016-08-23 | 2018-03-06 | 泰科电子(上海)有限公司 | Welding quality test platform |
CN108387578A (en) * | 2018-02-07 | 2018-08-10 | 昆山纬亚电子科技有限公司 | A kind of pcb board quality detection device |
CN109752392A (en) * | 2018-12-24 | 2019-05-14 | 苏州江奥光电科技有限公司 | A kind of pcb board defect type detection system and method |
CN110624839A (en) * | 2019-09-26 | 2019-12-31 | 东莞盛翔精密金属有限公司 | Welding inspection machine |
CN111366084A (en) * | 2020-04-28 | 2020-07-03 | 上海工程技术大学 | Part size detection platform based on information fusion, detection method and fusion method |
CN112611758A (en) * | 2020-12-28 | 2021-04-06 | 上海感图网络科技有限公司 | Intelligent heat exchanger defect detection equipment and use method thereof |
CN112730439A (en) * | 2020-12-29 | 2021-04-30 | 珠海迪沃航空工程有限公司 | Intelligent detection system and detection method for defects of turbine blades of aircraft engine |
CN113720852A (en) * | 2021-08-16 | 2021-11-30 | 中国飞机强度研究所 | Multi-camera image acquisition monitoring device |
CN113857157A (en) * | 2021-10-08 | 2021-12-31 | 苏州苏映视图像软件科技有限公司 | 3D posture-changing laser guiding system |
CN113866171A (en) * | 2021-12-02 | 2021-12-31 | 武汉飞恩微电子有限公司 | Circuit board dispensing detection method and device and computer readable storage medium |
CN115219503A (en) * | 2022-01-29 | 2022-10-21 | 天津宏华焊研机器人科技有限公司 | Device for assisting in judging internal quality of welding seam |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111965198B (en) * | 2020-09-03 | 2025-03-04 | 苏州市小驰机器人有限公司 | Solder spot detection device and detection method |
CN112730432A (en) * | 2020-12-24 | 2021-04-30 | 苏州赛众自动化科技有限公司 | Laser welding defect detection equipment and detection method for lithium battery of mobile phone |
TWI784629B (en) * | 2021-07-21 | 2022-11-21 | 閎康科技股份有限公司 | Welding quality inspection method and welding quality inspection equipment |
CN117705813B (en) * | 2024-02-05 | 2024-06-21 | 宁德时代新能源科技股份有限公司 | Welding quality detection system and method |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6291816B1 (en) * | 1999-06-08 | 2001-09-18 | Robotic Vision Systems, Inc. | System and method for measuring object features with coordinated two and three dimensional imaging |
US20020140949A1 (en) * | 2001-03-30 | 2002-10-03 | Nec Corporation | Method of inspecting semiconductor integrated circuit which can quickly measure a cubic body |
CN101124453A (en) * | 2004-10-06 | 2008-02-13 | 精益视觉科技有限公司 | System for 2-D and 3-D vision inspection |
WO2008124392A1 (en) * | 2007-04-03 | 2008-10-16 | David Fishbaine | 2d/3d inspection method and system |
CN102650576A (en) * | 2012-05-18 | 2012-08-29 | 中国农业大学 | Sample position automatic adjusting device in product quality detecting system |
US20130039563A1 (en) * | 2010-02-02 | 2013-02-14 | Koh Young Technology Inc. | Method of generating inspection program |
CN103398660A (en) * | 2013-08-05 | 2013-11-20 | 河北工业大学 | Structured light visual sensor parameter calibration method for acquiring height information of welded joint |
CN104014905A (en) * | 2014-06-06 | 2014-09-03 | 哈尔滨工业大学 | Observation device and method of three-dimensional shape of molten pool in GTAW welding process |
-
2015
- 2015-09-22 CN CN201510606902.4A patent/CN106546597A/en active Pending
-
2016
- 2016-09-20 TW TW105130372A patent/TW201721134A/en unknown
- 2016-09-22 WO PCT/EP2016/072592 patent/WO2017050924A1/en active Application Filing
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6291816B1 (en) * | 1999-06-08 | 2001-09-18 | Robotic Vision Systems, Inc. | System and method for measuring object features with coordinated two and three dimensional imaging |
US20020140949A1 (en) * | 2001-03-30 | 2002-10-03 | Nec Corporation | Method of inspecting semiconductor integrated circuit which can quickly measure a cubic body |
CN101124453A (en) * | 2004-10-06 | 2008-02-13 | 精益视觉科技有限公司 | System for 2-D and 3-D vision inspection |
WO2008124392A1 (en) * | 2007-04-03 | 2008-10-16 | David Fishbaine | 2d/3d inspection method and system |
US20130039563A1 (en) * | 2010-02-02 | 2013-02-14 | Koh Young Technology Inc. | Method of generating inspection program |
CN102650576A (en) * | 2012-05-18 | 2012-08-29 | 中国农业大学 | Sample position automatic adjusting device in product quality detecting system |
CN103398660A (en) * | 2013-08-05 | 2013-11-20 | 河北工业大学 | Structured light visual sensor parameter calibration method for acquiring height information of welded joint |
CN104014905A (en) * | 2014-06-06 | 2014-09-03 | 哈尔滨工业大学 | Observation device and method of three-dimensional shape of molten pool in GTAW welding process |
Non-Patent Citations (2)
Title |
---|
徐德 等: "《机器人视觉测量与控制》", 29 February 2008, 国防工业出版社 * |
陈国强 等: "《工程测试技术与信号处理》", 30 September 2013, 北京:中国电力出版社 * |
Cited By (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107764822B (en) * | 2016-08-23 | 2020-09-04 | 泰科电子(上海)有限公司 | Welding quality inspection platform |
CN107764822A (en) * | 2016-08-23 | 2018-03-06 | 泰科电子(上海)有限公司 | Welding quality test platform |
CN108387578A (en) * | 2018-02-07 | 2018-08-10 | 昆山纬亚电子科技有限公司 | A kind of pcb board quality detection device |
CN109752392B (en) * | 2018-12-24 | 2021-08-03 | 苏州江奥光电科技有限公司 | PCB defect type detection system and method |
CN109752392A (en) * | 2018-12-24 | 2019-05-14 | 苏州江奥光电科技有限公司 | A kind of pcb board defect type detection system and method |
CN110624839A (en) * | 2019-09-26 | 2019-12-31 | 东莞盛翔精密金属有限公司 | Welding inspection machine |
CN111366084A (en) * | 2020-04-28 | 2020-07-03 | 上海工程技术大学 | Part size detection platform based on information fusion, detection method and fusion method |
CN112611758A (en) * | 2020-12-28 | 2021-04-06 | 上海感图网络科技有限公司 | Intelligent heat exchanger defect detection equipment and use method thereof |
CN112730439A (en) * | 2020-12-29 | 2021-04-30 | 珠海迪沃航空工程有限公司 | Intelligent detection system and detection method for defects of turbine blades of aircraft engine |
CN113720852A (en) * | 2021-08-16 | 2021-11-30 | 中国飞机强度研究所 | Multi-camera image acquisition monitoring device |
CN113857157A (en) * | 2021-10-08 | 2021-12-31 | 苏州苏映视图像软件科技有限公司 | 3D posture-changing laser guiding system |
CN113866171A (en) * | 2021-12-02 | 2021-12-31 | 武汉飞恩微电子有限公司 | Circuit board dispensing detection method and device and computer readable storage medium |
CN115219503A (en) * | 2022-01-29 | 2022-10-21 | 天津宏华焊研机器人科技有限公司 | Device for assisting in judging internal quality of welding seam |
Also Published As
Publication number | Publication date |
---|---|
WO2017050924A1 (en) | 2017-03-30 |
TW201721134A (en) | 2017-06-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106546597A (en) | Weld quality prediction system and method | |
CN105222704B (en) | Device and method for weld measurement | |
JP4103921B2 (en) | Method of setting inspection reference data for fillet inspection, and substrate visual inspection apparatus using this method | |
US20110222655A1 (en) | X-ray inspection apparatus, x-ray inspection method, x-ray inspection program, and x-ray inspection system | |
JPS62173731A (en) | Inspection device for surface of article to be inspected | |
TWI483325B (en) | A stitch check device, a probe device and a stitch check method, and a memory medium | |
JP6277754B2 (en) | Quality control system and internal inspection device | |
US8860456B2 (en) | Non-destructive tilt data measurement to detect defective bumps | |
JP4610590B2 (en) | X-ray inspection apparatus, X-ray inspection method, and X-ray inspection program | |
KR20180095972A (en) | High-speed automated optical inspection apparatus supporting double scan approach | |
JP5949480B2 (en) | X-ray inspection apparatus and X-ray inspection method | |
JP2017078624A (en) | Sample bondability inspection method and inspection apparatus | |
CN106841399A (en) | A kind of bar ultrasound automatic detection flat-bottom hole reference block and preparation method | |
CN114599969A (en) | Processing system, processing method, program, and storage medium | |
JP2006170684A (en) | Inspection method and inspection device for press failure | |
JP5622338B2 (en) | Method for discriminating and checking foreign matter and scratch marks in semiconductor device manufacturing process | |
CN117740831B (en) | Semiconductor chip welding quality analysis system based on infrared vision | |
JP6387620B2 (en) | Quality control system | |
JP4580266B2 (en) | X-ray inspection apparatus, X-ray inspection method, and X-ray inspection program | |
US11543362B2 (en) | Method for measuring the heights of wire interconnections | |
JP2009128325A (en) | Defect inspection method, and device therefor | |
JP2008041758A (en) | Flux transfer state inspection method and apparatus | |
JPH07117388B2 (en) | Appearance inspection method | |
JP7395950B2 (en) | Visual inspection equipment and visual inspection method | |
CN209182254U (en) | Optical Inspection Equipment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170329 |
|
RJ01 | Rejection of invention patent application after publication |