CN117259976A - Laser welding penetration on-line detection method - Google Patents
Laser welding penetration on-line detection method Download PDFInfo
- Publication number
- CN117259976A CN117259976A CN202311289818.5A CN202311289818A CN117259976A CN 117259976 A CN117259976 A CN 117259976A CN 202311289818 A CN202311289818 A CN 202311289818A CN 117259976 A CN117259976 A CN 117259976A
- Authority
- CN
- China
- Prior art keywords
- penetration
- data
- model
- signal
- mesoscopic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B23—MACHINE TOOLS; METAL-WORKING NOT OTHERWISE PROVIDED FOR
- B23K—SOLDERING OR UNSOLDERING; WELDING; CLADDING OR PLATING BY SOLDERING OR WELDING; CUTTING BY APPLYING HEAT LOCALLY, e.g. FLAME CUTTING; WORKING BY LASER BEAM
- B23K26/00—Working by laser beam, e.g. welding, cutting or boring
- B23K26/20—Bonding
- B23K26/21—Bonding by welding
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B23—MACHINE TOOLS; METAL-WORKING NOT OTHERWISE PROVIDED FOR
- B23K—SOLDERING OR UNSOLDERING; WELDING; CLADDING OR PLATING BY SOLDERING OR WELDING; CUTTING BY APPLYING HEAT LOCALLY, e.g. FLAME CUTTING; WORKING BY LASER BEAM
- B23K26/00—Working by laser beam, e.g. welding, cutting or boring
- B23K26/70—Auxiliary operations or equipment
- B23K26/702—Auxiliary equipment
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02E—REDUCTION OF GREENHOUSE GAS [GHG] EMISSIONS, RELATED TO ENERGY GENERATION, TRANSMISSION OR DISTRIBUTION
- Y02E30/00—Energy generation of nuclear origin
- Y02E30/30—Nuclear fission reactors
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Plasma & Fusion (AREA)
- Mechanical Engineering (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
Description
技术领域Technical field
本发明涉及焊接在线检测及智能控制技术领域,是一种激光焊接熔深在线检测方法。The invention relates to the technical field of welding online detection and intelligent control, and is an online detection method for laser welding penetration.
背景技术Background technique
激光及激光复合能场焊接是智能制造领域中的主流技术之一。但是激光焊接过程中匙孔将喷射出大量的烟尘、飞溅、焊接羽辉等诸多物质,对激光的能量输入产生较大的干扰,所以激光及激光复合能场焊接在工程应用中往往存在熔深质量控制不稳定的情况而严重制约了该项技术的发展。所以,可靠熔深在线检测及质量闭环控制是激光焊接智能制造领域的重要问题之一。然而,与焊缝熔深状态最直接相关的特征区域是位于激光匙孔底部的金属蒸汽反冲压力区,其核心区域的直径仅为0.05~0.4mm属于介观尺度范畴,并且完全被大量喷射物质和周围高辐射信号所掩盖,具有较强的隐蔽性。并且熔深介观信号的提取位置和检测分辨率对检测结果也存在较大影响。此外,匙孔中的介观信号变化也极为复杂,没有明显的规律性,辐值变化剧烈且干扰性较强。而现有检测方法,由于受宏观采样手段的局限,无法将具有熔深特征的介观尺度信号与匙孔内壁辐射信号等其它干扰信号有效分离,导致检测数据中有效信号占比过低,熔深信息提取难度加大,同时,由于现有数据分析方法难以有效处理复杂且剧烈波动的介观信号,导致焊接熔深特征提取困难,在线检测可靠性难以保证。Laser and laser composite energy field welding are one of the mainstream technologies in the field of intelligent manufacturing. However, during the laser welding process, the keyhole will eject a large amount of smoke, spatter, welding plume and other substances, which will greatly interfere with the energy input of the laser. Therefore, laser and laser composite energy field welding often have deep penetration in engineering applications. Unstable quality control has seriously restricted the development of this technology. Therefore, reliable online penetration detection and quality closed-loop control are one of the important issues in the field of laser welding intelligent manufacturing. However, the characteristic area most directly related to the weld penetration state is the metal vapor recoil pressure area at the bottom of the laser keyhole. The diameter of its core area is only 0.05~0.4mm, which belongs to the mesoscopic scale category, and is completely sprayed in large quantities. Covered by materials and surrounding high radiation signals, it has strong concealment. Moreover, the extraction position and detection resolution of the penetration mesoscopic signal also have a great impact on the detection results. In addition, the mesoscopic signal changes in the keyhole are also extremely complex, with no obvious regularity, and the radiation changes violently and is highly disruptive. However, existing detection methods, due to limitations of macroscopic sampling methods, cannot effectively separate mesoscopic scale signals with melt depth characteristics from other interference signals such as keyhole inner wall radiation signals, resulting in a too low proportion of effective signals in the detection data and melting. It is more difficult to extract deep information. At the same time, because existing data analysis methods are difficult to effectively process complex and violently fluctuating mesoscopic signals, it is difficult to extract welding penetration features and the reliability of online detection is difficult to guarantee.
这些因素都对现有检测技术带来了极大的影响,存在的主要技术问题呈现为:1、现有检测方法受宏观采样手段局限无法有效获取介观特征信息,2、现有信号识别方法受匙孔内信号强烈波动的干扰较大,检测可靠性难以保证。These factors have had a great impact on existing detection technology. The main technical problems are as follows: 1. Existing detection methods are limited by macro sampling methods and cannot effectively obtain mesoscopic feature information. 2. Existing signal recognition methods It is greatly interfered by the strong fluctuation of the signal in the keyhole, and the detection reliability is difficult to guarantee.
发明内容Contents of the invention
本发明为克服现有技术的不足,本发明基于匙孔介观特征机器识别的激光焊接熔深在线检测,提出一种利用阵列传感手段采集匙孔内部特征区域的热激发态介观检测信号,并通过机器学习方式建立神经网络模型,最后调用已训练好的识别模型在线分析信号特征、提取焊接熔深质量信息的人工智能在线检测方法。In order to overcome the shortcomings of the existing technology, the present invention uses online detection of laser welding penetration based on machine identification of keyhole mesoscopic features, and proposes a method of using array sensing means to collect thermally excited state mesoscopic detection signals of the characteristic area inside the keyhole. , and establish a neural network model through machine learning, and finally call the trained recognition model to analyze signal characteristics online and extract welding penetration quality information through artificial intelligence online detection method.
需要说明的是,在本文中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。It should be noted that in this article, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that these entities or operations are mutually exclusive. any such actual relationship or sequence exists between them. Furthermore, the terms "comprises," "comprises," or any other variation thereof are intended to cover a non-exclusive inclusion such that a process, method, article, or apparatus that includes a list of elements includes not only those elements, but also those not expressly listed other elements, or elements inherent to the process, method, article or equipment.
本发明提供了一种激光焊接熔深在线检测方法,本发明提供了以下技术方案:The invention provides an online detection method for laser welding penetration. The invention provides the following technical solutions:
一种熔深检测装置,所述装置包括:外壳、基板、传感器、窄带滤光片和三维微调机构;A penetration detection device, which includes: a housing, a substrate, a sensor, a narrow-band filter and a three-dimensional fine-tuning mechanism;
基板与激光焊接头连接起到固定整个装置的作用,基板上有安装孔可分别固定装置外壳、三维微调机构以及窄带滤光片承载架,三维微调机构与传感器连接可调节传感器感应芯片三维空间位置,窄带滤光片位于光学聚焦镜头组与阵列传感器感应面之间的光路上,滤光后的光学实像可投射在阵列传感器感应面上。The connection between the base plate and the laser welding joint plays a role in fixing the entire device. There are mounting holes on the base plate that can respectively fix the device shell, the three-dimensional fine-tuning mechanism and the narrow-band filter carrier. The three-dimensional fine-tuning mechanism is connected to the sensor to adjust the three-dimensional position of the sensor sensing chip. , the narrow-band filter is located on the optical path between the optical focusing lens group and the sensing surface of the array sensor, and the filtered optical real image can be projected on the sensing surface of the array sensor.
一种激光焊接熔深在线检测方法,所述方法基于熔深检测装置,所述方法包括以下步骤:An online detection method for laser welding penetration, the method is based on a penetration detection device, and the method includes the following steps:
步骤1:选取匙孔内熔深特征区域的热激发态介观信号作为检测对象,获取介观检测信号;Step 1: Select the thermally excited state mesoscopic signal in the penetration depth characteristic area in the keyhole as the detection object to obtain the mesoscopic detection signal;
步骤2:对介观检测信号进行预处理,得到计算机可识别类型数据;Step 2: Preprocess the mesoscopic detection signal to obtain computer-recognizable type data;
步骤3:根据预处理后的数据,进行标定后分成训练集、测试集及验证集;Step 3: Based on the preprocessed data, perform calibration and divide it into training set, test set and verification set;
步骤4:建立神经网络模型,通过训练集数据训练模型的权重参数,然后再通过验证集调整模型超参数,直至结果收敛;Step 4: Establish a neural network model, train the weight parameters of the model through the training set data, and then adjust the model hyperparameters through the verification set until the results converge;
步骤5:通过测试集检验模型的可靠性;Step 5: Check the reliability of the model through the test set;
步骤6:调用已训练好的识别模型在线分析信号特征、提取焊接稳定性信息。Step 6: Call the trained recognition model to analyze signal features online and extract welding stability information.
优选地,选取匙孔内熔深特征区域的热激发态介观信号作为检测对象,利用光学聚焦成像及光谱透射原理将匙孔底部清晰的热激发态信号实像投射至阵列传感器的感应面上获得介观检测信号,获取分析用的样本数据集,并与实际焊缝熔深情况进行关联存储,通过机器学习方法训练识别模型,最后调用已训练好的模型在线识别介观信号特征,获取当前熔深状态信息。Preferably, the thermally excited state mesoscopic signal in the penetration depth characteristic area in the keyhole is selected as the detection object, and the clear thermally excited state signal real image at the bottom of the keyhole is projected onto the sensing surface of the array sensor using the principles of optical focusing imaging and spectral transmission to obtain the result. The mesoscopic detection signal is used to obtain the sample data set for analysis, and is stored in association with the actual weld penetration. The recognition model is trained through machine learning methods, and finally the trained model is called to identify the mesoscopic signal characteristics online and the current weld penetration is obtained. Deep status information.
优选地,所述匙孔底部热激发态信号,是激光光束进入母材后,通过剧烈的能量输入使匙孔底部金属迅速熔化、蒸发,并伴随高密度能量激发而产生的一种近红外信号。Preferably, the thermal excited state signal at the bottom of the keyhole is a near-infrared signal generated by the rapid melting and evaporation of the metal at the bottom of the keyhole through intense energy input after the laser beam enters the base material, and is accompanied by high-density energy excitation. .
优选地,介观检测信号的采集方法为:Preferably, the mesoscopic detection signal collection method is:
S1、通过一个至少具有0.6-1.5m拍摄工作距离和10mm拍摄景深的高倍光学聚焦镜头组,从激光焊接头的同轴光路内提取到匙孔底部特征区域的清晰实像,足够的大的景深可以在焦距不发生改变的同时拍摄到波动状态下特征区域的清晰实像;S1. Through a high-power optical focusing lens group with at least a shooting working distance of 0.6-1.5m and a shooting depth of 10mm, extract a clear real image of the characteristic area at the bottom of the keyhole from the coaxial optical path of the laser welding joint. A sufficiently large depth of field can Capture clear real images of characteristic areas in a fluctuating state without changing the focal length;
S2、在近红外谱段下,通过窄带滤光的办法将匙孔上方的焊接电弧、羽辉、激光束及其它大量焊接辐射信号有效屏蔽,使特征区域内的热激发态信号可以有效分离出来,从而大幅减少检测信号中的无效信号的占比;S2. In the near-infrared spectrum, the welding arc, plume, laser beam and other large amounts of welding radiation signals above the keyhole are effectively shielded through narrow-band filtering, so that the thermally excited state signals in the characteristic area can be effectively separated. , thereby greatly reducing the proportion of invalid signals in the detection signal;
S3、将热激发态信号实像投射至一个传感覆盖面积大、检测精度高的阵列传感器的感应面上,阵列传感器的感应区域应≥待测特征区域,且分辨精度≤10μm,由此获得待测特征区域中不同位置的介观信号。S3. Project the real image of the thermally excited state signal onto the sensing surface of an array sensor with a large sensing coverage area and high detection accuracy. The sensing area of the array sensor should be ≥ the characteristic area to be measured, and the resolution accuracy is ≤ 10 μm, thus obtaining the to-be-determined Mesoscopic signals at different locations in the characteristic area are measured.
优选地,所述熔深状态识别模型获取具体为,Preferably, the acquisition of the penetration state recognition model is specifically:
将一段时间内的数据进行叠加后再均化处理,从而获得这一个时间段内的趋势性特征数据,再分析下一帧数据时,须先从叠加数据中剔除最前面一帧数据并将当前一帧数据加入其中后,在保持所分析的总帧数不变情况下再进行叠加、均化处理,由此方法获得准稳态信号的变化数据集;The data within a period of time are superimposed and then averaged to obtain the trend characteristic data within this time period. When analyzing the next frame of data, the first frame of data must be removed from the superimposed data and the current After one frame of data is added to it, it is superimposed and averaged while keeping the total number of frames analyzed unchanged. This method obtains the change data set of the quasi-steady-state signal;
再将处理后的数据集与实际的焊接熔深特征进行标定后,再分成训练集、测试集及验证集;After the processed data set is calibrated with the actual welding penetration characteristics, it is divided into a training set, a test set and a verification set;
通过训练集数据训练模型的权重参数,直至结果收敛,然后再通过验证集调整模型超参数,最后通过测试集检验模型的可靠性,获得熔深最优模型。The weight parameters of the model are trained through the training set data until the results converge, and then the model hyperparameters are adjusted through the validation set. Finally, the reliability of the model is tested through the test set to obtain the optimal penetration model.
优选地,将在线采集到的单路/或多路/或全部介观检测信号数据,先通过所述的信号预处理并转换成计算机可识别类型数据,然后调用已经训练好的识别模型进行运算,得出当前激光焊接的熔深数值,给出在线诊断结果或为焊接闭环控制系统提供关键工艺参数的调控依据,如焊接激光器功率、焊接速度、离焦量。Preferably, the single channel/or multiple channels/or all mesoscopic detection signal data collected online are first preprocessed and converted into computer-recognizable type data through the signal preprocessing, and then the trained recognition model is called for calculation. , obtain the current penetration value of laser welding, provide online diagnosis results, or provide a basis for regulating key process parameters for the welding closed-loop control system, such as welding laser power, welding speed, and defocus amount.
一种激光焊接熔深在线检测系统,所述系统包括:A laser welding penetration online detection system, the system includes:
数据采集模块,所述数据采集模块选取匙孔内熔深特征区域的热激发态介观信号作为检测对象,获取介观检测信号;A data acquisition module. The data acquisition module selects the thermally excited state mesoscopic signal of the penetration characteristic area in the keyhole as the detection object to obtain the mesoscopic detection signal;
预处理模块,所述预处理模块对介观检测信号进行预处理,得到计算机可识别类型数据;A preprocessing module, which preprocesses the mesoscopic detection signal to obtain computer-recognizable type data;
标定模块,所述标定模块根据预处理后的数据,进行标定后分成训练集、测试集及验证集;A calibration module, which performs calibration based on the preprocessed data and then divides it into a training set, a test set and a verification set;
模型建立模块,所述模型建立模块建立神经网络模型,建立神经网络模型,通过训练集数据训练模型的权重参数,直至结果收敛,然后再通过验证集调整模型超参数,通过测试集检验模型的可靠性;A model building module. The model building module establishes a neural network model, builds a neural network model, trains the weight parameters of the model through the training set data until the results converge, and then adjusts the model hyperparameters through the verification set, and tests the reliability of the model through the test set. sex;
在线检测模块,所述在线检测模块调用已训练好的模型,进行实时分析熔深状态,提取焊接稳定性信息。Online detection module, the online detection module calls the trained model to analyze the penetration status in real time and extract welding stability information.
一种计算机可读存储介质,其上存储有计算机程序,该程序被处理器执行,以用于实现一种激光焊接熔深在线检测方法。A computer-readable storage medium has a computer program stored thereon, and the program is executed by a processor to implement an online detection method of laser welding penetration.
一种计算机设备,包括存储器和处理器,所述存储器存储有计算机程序,所述处理器执行所述计算机程序时实现一种激光焊接熔深在线检测方法。A computer device includes a memory and a processor. The memory stores a computer program. When the processor executes the computer program, it implements an online laser welding penetration detection method.
本发明具有以下有益效果:The invention has the following beneficial effects:
本发明采用匙孔底部特征区域的热激发态信号作为检测信号,首先该信号的产生位置与激光/激光复合能场焊接的熔深有较大的关联性,所以可作为一种直接检测信号,能够避免采用间接检测信号检测时受环境湿度、温度、气体流场等干扰因素的影响。同时,该信号的近红外谱段增强特性也支持对焊接电弧、羽辉等其它有害信号的在该谱段下的有效屏蔽作用,提高检测信号中的有效信号比例,降低信号分析难度。The present invention uses the thermal excited state signal in the characteristic area at the bottom of the keyhole as the detection signal. First, the generation position of the signal has a great correlation with the penetration depth of laser/laser composite energy field welding, so it can be used as a direct detection signal. It can avoid being affected by interference factors such as environmental humidity, temperature, and gas flow fields when using indirect detection signals. At the same time, the signal's near-infrared spectrum band enhancement characteristics also support the effective shielding of other harmful signals such as welding arcs and plumes in this spectrum band, increasing the proportion of effective signals in the detection signal and reducing the difficulty of signal analysis.
本发明提出将热激发态信号实像投射于阵列传感芯片进而获取介观信号的方法,能够实现对匙孔底部特征区域的全覆盖识别。由于激光焊接过程中激光匙孔一直处于波动状态中,介观尺度的熔深特征区域位置也会随之摆动,所以对匙孔底部特征区域的全覆盖识别就非常必要了,本发明的一个特点就是可以自适应跟踪识别熔深特征区域,可以准确定位熔深关键区域的检测信号,同时利用阵列传器的高分辨特性可以对目标介观区域进行高分辨率识别,有效屏蔽掉绝大多数干扰信号,提高检测可靠性。The present invention proposes a method of projecting a real image of a thermally excited state signal onto an array sensor chip to obtain a mesoscopic signal, which can achieve full coverage identification of the characteristic area at the bottom of the keyhole. Since the laser keyhole is always in a fluctuating state during the laser welding process, the position of the penetration characteristic area at the mesoscopic scale will also swing accordingly. Therefore, it is very necessary to fully cover the characteristic area at the bottom of the keyhole. This is a feature of the present invention. That is, it can adaptively track and identify the penetration characteristic area, and can accurately locate the detection signal in the key penetration area. At the same time, the high-resolution characteristics of the array sensor can be used to perform high-resolution identification of the target mesoscopic area, effectively shielding most of the interference. signal to improve detection reliability.
本发明采用机器学习方法分析介观检测信号,通过大量的数据分析规避信号个例、捕捉信号规律性特征,因此能够准确识别匙孔底部介观特征信号的趋势性特征,并有效规避掉焊接信号复杂、波动性大、干扰信号多等方面带来的数据分析问题。The present invention uses machine learning methods to analyze mesoscopic detection signals, and through a large amount of data analysis to avoid signal cases and capture signal regular characteristics, it can accurately identify the trend characteristics of mesoscopic characteristic signals at the bottom of the keyhole, and effectively avoid welding signals. Data analysis problems caused by complexity, high volatility, and many interference signals.
本发明采用将一段时间内的数据进行叠加后再均化处理的信号预处理方法,可以准确获得这一个时间段内的趋势性特征数据,进而有效忽略掉匙孔深度快速波动对熔深检测产生的干扰,并能对焊接熔深的运行趋势做出有效判断。The present invention adopts a signal preprocessing method that superimposes data within a period of time and then performs homogenization processing, so that the trend characteristic data within this period of time can be accurately obtained, thereby effectively ignoring the impact of rapid fluctuations in keyhole depth on penetration detection. interference, and can make effective judgments on the operating trend of welding penetration.
附图说明Description of the drawings
为了更清楚地说明本发明具体实施方式或现有技术中的技术方案,下面将对具体实施方式或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图是本发明的一些实施方式,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly explain the specific embodiments of the present invention or the technical solutions in the prior art, the accompanying drawings that need to be used in the description of the specific embodiments or the prior art will be briefly introduced below. Obviously, the drawings in the following description The drawings illustrate some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without exerting any creative effort.
图1为检测装置装配示意图;1、熔深检测装置外壳;2、基板;3、阵列或图像传感器;4、窄带滤光片;5、三维微调机构Figure 1 is a schematic diagram of the assembly of the detection device; 1. Housing of the penetration detection device; 2. Substrate; 3. Array or image sensor; 4. Narrowband filter; 5. Three-dimensional fine-tuning mechanism
图2为本发明方法流程图;Figure 2 is a flow chart of the method of the present invention;
图3为人工智能检测方法流程图。Figure 3 is a flow chart of the artificial intelligence detection method.
具体实施方式Detailed ways
下面将结合附图对本发明的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solution of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of the present invention.
在本发明的描述中,需要说明的是,术语“中心”、“上”、“下”、“左”、“右”、“竖直”、“水平”、“内”、“外”等指示的方位或位置关系为基于附图所示的方位或位置关系,仅是为了便于描述本发明和简化描述,而不是指示或暗示所指的装置或元件必须具有特定的方位、以特定的方位构造和操作,因此不能理解为对本发明的限制。此外,术语“第一”、“第二”、“第三”仅用于描述目的,而不能理解为指示或暗示相对重要性。In the description of the present invention, it should be noted that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc. The indicated orientation or positional relationship is based on the orientation or positional relationship shown in the drawings. It is only for the convenience of describing the present invention and simplifying the description. It does not indicate or imply that the device or element referred to must have a specific orientation or a specific orientation. construction and operation, and therefore should not be construed as limitations of the invention. Furthermore, the terms “first”, “second” and “third” are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.
在本发明的描述中,需要说明的是,除非另有明确的规定和限定,术语“安装”、“相连”、“连接”应做广义理解,例如,可以是固定连接,也可以是可拆卸连接,或一体地连接;可以是机械连接,也可以是电连接;可以是直接相连,也可以通过中间媒介间接相连,可以是两个元件内部的连通。对于本领域的普通技术人员而言,可以具体情况理解上述术语在本发明中的具体含义。In the description of the present invention, it should be noted that, unless otherwise clearly stated and limited, the terms "installation", "connection" and "connection" should be understood in a broad sense. For example, it can be a fixed connection or a detachable connection. Connection, or integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium; it can be an internal connection between two components. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood on a case-by-case basis.
具体实施例一:Specific embodiment one:
根据图1至图3所示,本发明为解决上述技术问题采取的具体优化技术方案是:本发明涉及一种激光焊接熔深在线检测方法。As shown in Figures 1 to 3, the specific optimization technical solution adopted by the present invention to solve the above technical problems is: the present invention relates to an online detection method of laser welding penetration.
一种熔深检测装置,所述装置包括:外壳、基板、传感器、窄带滤光片和三维微调机构;A penetration detection device, which includes: a housing, a substrate, a sensor, a narrow-band filter and a three-dimensional fine-tuning mechanism;
基板与激光焊接头连接起到固定整个装置的作用,基板上有安装孔可分别固定装置外壳、三维微调机构以及窄带滤光片承载架,三维微调机构与传感器连接可调节传感器感应芯片三维空间位置,窄带滤光片位于光学聚焦镜头组与阵列传感器感应面之间的光路上,滤光后的光学实像可投射在阵列传感器感应面上。The connection between the base plate and the laser welding joint plays a role in fixing the entire device. There are mounting holes on the base plate that can respectively fix the device shell, the three-dimensional fine-tuning mechanism and the narrow-band filter carrier. The three-dimensional fine-tuning mechanism is connected to the sensor to adjust the three-dimensional position of the sensor sensing chip. , the narrow-band filter is located on the optical path between the optical focusing lens group and the sensing surface of the array sensor, and the filtered optical real image can be projected on the sensing surface of the array sensor.
一种激光焊接熔深在线检测方法,所述方法基熔深检测装置,所述方法包括以下步骤:An online detection method for laser welding penetration, the method is based on a penetration detection device, and the method includes the following steps:
步骤1:选取匙孔内熔深特征区域的热激发态介观信号作为检测对象,获取介观检测信号;Step 1: Select the thermally excited state mesoscopic signal in the penetration depth characteristic area in the keyhole as the detection object to obtain the mesoscopic detection signal;
步骤2:对介观检测信号进行预处理,得到计算机可识别类型数据;Step 2: Preprocess the mesoscopic detection signal to obtain computer-recognizable type data;
步骤3:根据预处理后的数据,进行标定后分成训练集、测试集及验证集;Step 3: Based on the preprocessed data, perform calibration and divide it into training set, test set and verification set;
步骤4:建立神经网络模型,通过训练集数据训练模型的权重参数,直至结果收敛,然后再通过验证集调整模型超参数;Step 4: Establish a neural network model, train the weight parameters of the model through the training set data until the results converge, and then adjust the model hyperparameters through the validation set;
步骤5:通过测试集检验模型的可靠性;Step 5: Check the reliability of the model through the test set;
步骤6:调用已训练好的识别模型在线分析信号特征、提取焊接稳定性信息。Step 6: Call the trained recognition model to analyze signal features online and extract welding stability information.
具体实施例二:Specific embodiment two:
本申请实施例二与实施例一的区别仅在于:The only difference between Embodiment 2 of this application and Embodiment 1 is:
当选取匙孔内熔深特征区域的热激发态介观信号作为检测对象具体为:When selecting the thermally excited state mesoscopic signal in the penetration characteristic area within the keyhole as the detection object, the specific steps are:
基于匙孔介观特征机器识别的激光焊接熔深在线检测方法,其特征是:提出一种利用阵列传感手段采集匙孔内部特征区域的热激发态介观检测信号,并通过机器学习方式建立神经网络模型,最后调用已训练好的识别模型在线分析信号特征、提取焊接熔深质量信息的人工智能在线检测方法。具体步骤如下:An online detection method of laser welding penetration based on machine recognition of keyhole mesoscopic features is characterized by: proposing a method of using array sensing means to collect thermally excited state mesoscopic detection signals of the keyhole internal characteristic area, and establishing a method through machine learning. Neural network model, and finally the artificial intelligence online detection method that calls the trained recognition model to analyze signal characteristics online and extract welding penetration quality information. Specific steps are as follows:
首先,选取匙孔内熔深特征区域的热激发态介观信号作为检测对象,其次,利用光学聚焦成像及光谱透射原理将匙孔底部清晰的热激发态信号实像投射至阵列传感器的感应面上获得介观检测信号,然后,采用机器学习方法建立的模型识别介观信号特征,获取当前熔深状态信息。First, the thermally excited state mesoscopic signal in the characteristic area of penetration depth in the keyhole is selected as the detection object. Secondly, the clear thermally excited state signal real image at the bottom of the keyhole is projected onto the sensing surface of the array sensor using the principle of optical focusing imaging and spectral transmission. The mesoscopic detection signal is obtained, and then the model established by the machine learning method is used to identify the characteristics of the mesoscopic signal and obtain the current penetration status information.
所述匙孔底部热激发态信号,是激光光束进入母材后,通过剧烈的能量输入使匙孔底部金属迅速熔化、蒸发,并伴随高密度能量激发而产生的一种近红外信号,由于匙孔是在金属蒸发的反冲压力下形成的,而热激发态信号刚好产生于形成匙孔的主要反冲压力区,所以信号的强弱可有效反映反冲压力区的压力情况,而且其趋势性变化可与匙孔深度具有较好的一致性,进而能够反映焊缝实际熔深的变化情况。The thermally excited state signal at the bottom of the keyhole is a near-infrared signal generated by the rapid melting and evaporation of the metal at the bottom of the keyhole through intense energy input after the laser beam enters the base material, and is accompanied by high-density energy excitation. The hole is formed under the recoil pressure of metal evaporation, and the thermal excited state signal happens to be generated in the main recoil pressure area where the keyhole is formed, so the strength of the signal can effectively reflect the pressure situation in the recoil pressure area, and its trend The sexual changes can have good consistency with the keyhole depth, which can reflect the changes in the actual penetration depth of the weld.
介观检测信号的采集方法为,首先通过一个至少具有0.6-1.5m拍摄工作距离和10mm拍摄景深的高倍光学聚焦镜头组,从激光焊接头的同轴光路内提取到匙孔底部特征区域的清晰实像,足够的大的景深可以在焦距不发生改变的同时拍摄到波动状态下特征区域的清晰实像,其次,在近红外谱段下,通过窄带滤光的办法将匙孔上方的焊接羽辉、激光束及其它大量焊接辐射信号有效屏蔽,使特征区域内的热激发态信号可以有效分离出来,从而大幅减少检测信号中的无效信号的占比,然后,将热激发态信号实像投射至一个传感覆盖面积大、检测精度高的阵列传感器的感应面上,阵列传感器的感应区域应≥待测特征区域,且分辨精度≤10μm,由此获得待测特征区域中不同位置的介观信号,该方法不但可以获得待测区域内的全位置的热激发信号,准确分析出熔深关键特征信号的所处位置,更能通过直接提取关键位置的介观信号,来进一步提高检测数据中的有效信号占比,降低信号分析的数据量,为下一步检测信号分析提供数据保障。The mesoscopic detection signal collection method is to first extract clear images of the characteristic area at the bottom of the keyhole from the coaxial optical path of the laser welding joint through a high-power optical focusing lens group with at least a shooting working distance of 0.6-1.5m and a shooting depth of 10mm. Real image, a large enough depth of field can capture a clear real image of the characteristic area in a fluctuating state without changing the focal length. Secondly, under the near-infrared spectrum, the welding plume above the keyhole and the welding plume above the keyhole are filtered through narrow-band filtering. The laser beam and other large amounts of welding radiation signals are effectively shielded, so that the thermally excited state signals in the characteristic area can be effectively separated, thereby greatly reducing the proportion of invalid signals in the detection signal. Then, the real image of the thermally excited state signals is projected onto a transmitter On the sensing surface of an array sensor with large sensing coverage area and high detection accuracy, the sensing area of the array sensor should be ≥ the characteristic area to be measured, and the resolution accuracy should be ≤ 10 μm, so that mesoscopic signals at different positions in the characteristic area to be measured can be obtained. This method can not only obtain thermal excitation signals at all locations in the area to be measured, and accurately analyze the location of the key characteristic signals of the penetration depth, but can also further improve the effective signals in the detection data by directly extracting mesoscopic signals at key locations. Proportion, reduce the amount of data for signal analysis, and provide data guarantee for the next step of detection signal analysis.
所述熔深状态识别模型的建立方法是基于熔深信号波动特征提出的,由于熔深信号在焊接过程中随着匙孔深度变化一直处于快速的上下波动状态,而在各个较小时间段内信号波动的分布趋势与焊接熔深直接相关,所以熔深信号是一种具有趋势性特征的准稳态信号。它有别于瞬态信号识别时需要对每个瞬时特征都需要精确识别,准稳态信号分析时需要忽略掉瞬态特征,而对信号的运行趋势做出有效判断。所以在熔深状态识别模型训练时,首先,在对熔深信号预处理时,需要先将一段时间内的数据进行叠加后再均化处理,从而获得这一个时间段内的趋势性特征数据,然后再分析下一帧数据时,须在叠加数据中先剔除最前面一帧数据并将当前一帧数据加入其中后,在保持所分析的总帧数不变情况下再进行叠加、均化处理,由此方法获得准稳态信号的变化数据集。其次,再将处理后的数据集与实际的焊接熔深特征进行标定后,再分成训练集、测试集及验证集。再次,利用计算机构建一个回归类任务的神经网络模型,通过训练集里的数据训练所述熔深状态识别模型直至结果收敛,通过验证集调整模型超参数,通过测试集检验模型的可靠性,调用已训练好的识别模型在线分析信号特征、提取焊接稳定性信息。The establishment method of the penetration state identification model is proposed based on the fluctuation characteristics of the penetration signal. Since the penetration signal has been in a rapid up and down state as the keyhole depth changes during the welding process, and in each small time period The distribution trend of signal fluctuations is directly related to the welding penetration, so the penetration signal is a quasi-steady signal with trend characteristics. It is different from the need to accurately identify each instantaneous feature when identifying transient signals. When analyzing quasi-steady-state signals, it is necessary to ignore the transient features and make effective judgments on the operating trend of the signal. Therefore, when training the penetration state recognition model, first of all, when preprocessing the penetration signal, the data within a period of time need to be superimposed and then averaged, so as to obtain the trend characteristic data within this period of time. Then when analyzing the next frame of data, the first frame of data must be removed from the superimposed data and the current frame of data must be added to it. Then, the superposition and averaging processing must be performed while keeping the total number of frames analyzed unchanged. , this method obtains the change data set of quasi-steady-state signals. Secondly, after calibrating the processed data set with the actual welding penetration characteristics, it is divided into a training set, a test set and a verification set. Thirdly, use a computer to build a neural network model for a regression task, train the penetration state recognition model through the data in the training set until the results converge, adjust the model hyperparameters through the verification set, test the reliability of the model through the test set, and call The trained recognition model analyzes signal features online and extracts welding stability information.
所述熔深特征实时检测方法是将在线采集到的单路/或多路/或全部介观检测信号数据,先通过所述的信号预处理并转换成计算机可识别类型数据,然后调用已经训练好的识别模型进行运算,得出当前激光焊接的熔深数值,给出在线诊断结果或为焊接闭环控制系统提供关键工艺参数的调控依据,如焊接激光器功率、焊接速度、离焦量等。The real-time detection method of penetration characteristics is to first convert the single channel/or multiple channels/or all mesoscopic detection signal data collected online into computer-recognizable type data through the signal preprocessing, and then call the trained A good recognition model is used to perform calculations to obtain the current penetration value of laser welding, and provide online diagnosis results or provide a basis for regulating key process parameters for the welding closed-loop control system, such as welding laser power, welding speed, defocus, etc.
所述熔深状态识别模型的建立方法,是将所述阵列传感器或图像传感器采集到的分析样本数据经一定的数据处理后转换成计算机可识别类型数据,再将所述分析样本与实际的焊接熔深特征进行标定后分成训练集、测试集及验证集,然后利用计算机构建神经网络模型,通过训练集里的数据训练所述熔深识别模型直至结果收敛,通过验证集调整模型超参数,通过测试集检验模型的可靠性,调用已训练好的识别模型在线分析信号特征、提取焊接稳定性信息。The method for establishing the penetration state recognition model is to convert the analysis sample data collected by the array sensor or image sensor into computer-recognizable type data after certain data processing, and then compare the analysis sample with the actual welding The penetration characteristics are calibrated and divided into a training set, a test set and a verification set. Then a computer is used to build a neural network model, and the penetration recognition model is trained using the data in the training set until the results converge. The model hyperparameters are adjusted through the verification set. The test set tests the reliability of the model, calls the trained recognition model to analyze signal features online, and extracts welding stability information.
本发明采用匙孔底部特征区域的热激发态信号作为检测信号,首先该信号的产生位置与激光/激光复合能场焊接的熔深有较大的关联性,所以可作为一种直接检测信号,能够避免采用间接检测信号检测时受环境湿度、温度、气体流场等干扰因素的影响。同时,该信号的近红外谱段增强特性也支持对焊接电弧、羽辉等其它有害信号的在该谱段下的有效屏蔽作用,提高检测信号中的有效信号比例,降低信号分析难度。The present invention uses the thermal excited state signal in the characteristic area at the bottom of the keyhole as the detection signal. First, the generation position of the signal has a great correlation with the penetration depth of laser/laser composite energy field welding, so it can be used as a direct detection signal. It can avoid being affected by interference factors such as environmental humidity, temperature, and gas flow fields when using indirect detection signals. At the same time, the signal's near-infrared spectrum band enhancement characteristics also support the effective shielding of other harmful signals such as welding arcs and plumes in this spectrum band, increasing the proportion of effective signals in the detection signal and reducing the difficulty of signal analysis.
本发明提出将热激发态信号实像投射于阵列传感芯片进而获取介观信号的方法,能够实现对匙孔底部特征区域的全覆盖识别。由于激光焊接过程中激光匙孔一直处于波动状态中,介观尺度的熔深特征区域位置也会随之摆动,所以对匙孔底部特征区域的全覆盖识别就非常必要了,本发明的一个特点就是可以自适应跟踪识别熔深特征区域,可以准确定位熔深关键区域的检测信号,同时利用阵列传器的高分辨特性可以对目标介观区域进行高分辨率识别,有效屏蔽掉绝大多数干扰信号,提高检测可靠性。The present invention proposes a method of projecting a real image of a thermally excited state signal onto an array sensor chip to obtain a mesoscopic signal, which can achieve full coverage identification of the characteristic area at the bottom of the keyhole. Since the laser keyhole is always in a fluctuating state during the laser welding process, the position of the penetration characteristic area at the mesoscopic scale will also swing accordingly. Therefore, it is very necessary to fully cover the characteristic area at the bottom of the keyhole. This is a feature of the present invention. That is, it can adaptively track and identify the penetration characteristic area, and can accurately locate the detection signal in the key penetration area. At the same time, the high-resolution characteristics of the array sensor can be used to perform high-resolution identification of the target mesoscopic area, effectively shielding most of the interference. signal to improve detection reliability.
本发明采用机器学习方法分析介观检测信号,通过大量的数据分析规避信号个例、捕捉信号规律性特征,因此能够准确识别匙孔底部介观特征信号的趋势性特征,并有效规避掉焊接信号复杂、波动性大、干扰信号多等方面带来的数据分析问题。The present invention uses machine learning methods to analyze mesoscopic detection signals, and through a large amount of data analysis to avoid signal cases and capture signal regular characteristics, it can accurately identify the trend characteristics of mesoscopic characteristic signals at the bottom of the keyhole, and effectively avoid welding signals. Data analysis problems caused by complexity, high volatility, and many interference signals.
本发明采用将一段时间内的数据进行叠加后再均化处理的信号预处理方法,可以准确获得这一个时间段内的趋势性特征数据,进而有效忽略掉匙孔深度快速波动对熔深检测产生的干扰,并能对焊接熔深的运行趋势做出有效判断。The present invention adopts a signal preprocessing method that superimposes data within a period of time and then performs homogenization processing, so that the trend characteristic data within this period of time can be accurately obtained, thereby effectively ignoring the impact of rapid fluctuations in keyhole depth on penetration detection. interference, and can make effective judgments on the operating trend of welding penetration.
具体实施例三:Specific embodiment three:
本申请实施例三与实施例二的区别仅在于:The only difference between Embodiment 3 and Embodiment 2 of this application is:
本发明提供一种激光焊接熔深在线检测系统,所述系统包括:The invention provides an online detection system for laser welding penetration. The system includes:
数据采集模块,所述数据采集模块选取匙孔内熔深特征区域的热激发态介观信号作为检测对象,获取介观检测信号;A data acquisition module. The data acquisition module selects the thermally excited state mesoscopic signal of the penetration characteristic area in the keyhole as the detection object to obtain the mesoscopic detection signal;
预处理模块,所述预处理模块对介观检测信号进行预处理,得到计算机可识别类型数据;A preprocessing module, which preprocesses the mesoscopic detection signal to obtain computer-recognizable type data;
标定模块,所述标定模块根据预处理后的数据,进行标定后分成训练集、测试集及验证集;A calibration module, which performs calibration based on the preprocessed data and then divides it into a training set, a test set and a verification set;
模型建立模块,所述模型建立模块建立神经网络模型,建立神经网络模型,通过训练集数据训练模型的权重参数,直至结果收敛,然后再通过验证集调整模型超参数,通过测试集检验模型的可靠性;A model building module. The model building module establishes a neural network model, builds a neural network model, trains the weight parameters of the model through the training set data until the results converge, and then adjusts the model hyperparameters through the verification set, and tests the reliability of the model through the test set. sex;
在线检测模块,所述在线检测模块调用已训练好的模型,进行实时分析熔深状态,提取焊接稳定性信息。Online detection module, the online detection module calls the trained model to analyze the penetration status in real time and extract welding stability information.
具体实施例四:Specific embodiment four:
本申请实施例四与实施例三的区别仅在于:The only difference between Embodiment 4 and Embodiment 3 of this application is:
本发明提供一种计算机可读存储介质,其上存储有计算机程序,该程序被处理器执行,以用于实现一种激光焊接熔深在线检测方法。The invention provides a computer-readable storage medium on which a computer program is stored, and the program is executed by a processor to implement an online detection method of laser welding penetration.
步骤具体为:The specific steps are:
首先,选取匙孔内熔深特征区域的热激发态介观信号作为检测对象,其次,利用光学聚焦成像及光谱透射原理将匙孔底部清晰的热激发态信号实像投射至阵列传感器的感应面上获得介观检测信号,然后,采用机器学习方法建立的模型识别介观信号特征,获取当前熔深状态信息。First, the thermally excited state mesoscopic signal in the characteristic area of penetration depth in the keyhole is selected as the detection object. Secondly, the clear thermally excited state signal real image at the bottom of the keyhole is projected onto the sensing surface of the array sensor using the principle of optical focusing imaging and spectral transmission. The mesoscopic detection signal is obtained, and then the model established by the machine learning method is used to identify the characteristics of the mesoscopic signal and obtain the current penetration status information.
所述匙孔底部热激发态信号,是激光光束进入母材后,通过剧烈的能量输入使匙孔底部金属迅速熔化、蒸发,并伴随高密度能量激发而产生的一种近红外信号,由于匙孔是在金属蒸发的反冲压力下形成的,而热激发态信号刚好产生于形成匙孔的主要反冲压力区,所以信号的强弱可有效反映反冲压力区的压力情况,而且其趋势性变化可与匙孔深度具有较好的一致性,进而能够反映焊缝实际熔深的变化情况。The thermally excited state signal at the bottom of the keyhole is a near-infrared signal generated by the rapid melting and evaporation of the metal at the bottom of the keyhole through intense energy input after the laser beam enters the base material, and is accompanied by high-density energy excitation. The hole is formed under the recoil pressure of metal evaporation, and the thermal excited state signal happens to be generated in the main recoil pressure area where the keyhole is formed, so the strength of the signal can effectively reflect the pressure situation in the recoil pressure area, and its trend The sexual changes can have good consistency with the keyhole depth, which can reflect the changes in the actual penetration depth of the weld.
介观检测信号的采集方法为,首先通过一个至少具有0.6-1.5m拍摄工作距离和10mm拍摄景深的高倍光学聚焦镜头组,从激光焊接头的同轴光路内提取到匙孔底部特征区域的清晰实像,足够的大的景深可以在焦距不发生改变的同时拍摄到波动状态下特征区域的清晰实像,其次,在近红外谱段下,通过窄带滤光的办法将匙孔上方的焊接羽辉、激光束及其它大量焊接辐射信号有效屏蔽,使特征区域内的热激发态信号可以有效分离出来,从而大幅减少检测信号中的无效信号的占比,然后,将热激发态信号实像投射至一个传感覆盖面积大、检测精度高的阵列传感器的感应面上,阵列传感器的感应区域应≥待测特征区域,且分辨精度≤10μm,由此获得待测特征区域中不同位置的介观信号,该方法不但可以获得待测区域内的全位置的热激发信号,准确分析出熔深关键特征信号的所处位置,更能通过直接提取关键位置的介观信号,来进一步提高检测数据中的有效信号占比,降低信号分析的数据量,为下一步检测信号分析提供数据保障。The mesoscopic detection signal collection method is to first extract clear images of the characteristic area at the bottom of the keyhole from the coaxial optical path of the laser welding joint through a high-power optical focusing lens group with at least a shooting working distance of 0.6-1.5m and a shooting depth of 10mm. Real image, a large enough depth of field can capture a clear real image of the characteristic area in a fluctuating state without changing the focal length. Secondly, under the near-infrared spectrum, the welding plume above the keyhole and the welding plume above the keyhole are filtered through narrow-band filtering. The laser beam and other large amounts of welding radiation signals are effectively shielded, so that the thermally excited state signals in the characteristic area can be effectively separated, thereby greatly reducing the proportion of invalid signals in the detection signal. Then, the real image of the thermally excited state signals is projected onto a transmitter On the sensing surface of an array sensor with large sensing coverage area and high detection accuracy, the sensing area of the array sensor should be ≥ the characteristic area to be measured, and the resolution accuracy should be ≤ 10 μm, so that mesoscopic signals at different positions in the characteristic area to be measured can be obtained. This method can not only obtain thermal excitation signals at all locations in the area to be measured, and accurately analyze the location of the key characteristic signals of the penetration depth, but can also further improve the effective signals in the detection data by directly extracting mesoscopic signals at key locations. Proportion, reduce the amount of data for signal analysis, and provide data guarantee for the next step of detection signal analysis.
所述熔深状态识别模型的建立方法是基于熔深信号波动特征提出的,由于熔深信号在焊接过程中随着匙孔深度变化一直处于快速的上下波动状态,而在各个较小时间段内信号波动的分布趋势与焊接熔深直接相关,所以熔深信号是一种具有趋势性特征的准稳态信号。它有别于瞬态信号识别时需要对每个瞬时特征都需要精确识别,准稳态信号分析时需要忽略掉瞬态特征,而对信号的运行趋势做出有效判断。所以在熔深状态识别模型训练时,首先,在对熔深信号预处理时,需要先将一段时间内的数据进行叠加后再均化处理,从而获得这一个时间段内的趋势性特征数据,然后再分析下一帧数据时,须在叠加数据中先剔除最前面一帧数据并将当前一帧数据加入其中后,在保持所分析的总帧数不变情况下再进行叠加、均化处理,由此方法获得准稳态信号的变化数据集。其次,再将处理后的数据集与实际的焊接熔深特征进行标定后,再分成训练集、测试集及验证集。再次,利用计算机构建一个回归类任务的神经网络模型,通过训练集里的数据训练所述熔深状态识别模型直至结果收敛,通过验证集调整模型超参数,通过测试集检验模型的可靠性,调用已训练好的识别模型在线分析信号特征、提取焊接稳定性信息。The establishment method of the penetration state identification model is proposed based on the fluctuation characteristics of the penetration signal. Since the penetration signal has been in a rapid up and down state as the keyhole depth changes during the welding process, and in each small time period The distribution trend of signal fluctuations is directly related to the welding penetration, so the penetration signal is a quasi-steady signal with trend characteristics. It is different from the need to accurately identify each instantaneous feature when identifying transient signals. When analyzing quasi-steady-state signals, it is necessary to ignore the transient features and make effective judgments on the operating trend of the signal. Therefore, when training the penetration state recognition model, first of all, when preprocessing the penetration signal, the data within a period of time need to be superimposed and then averaged, so as to obtain the trend characteristic data within this period of time. Then when analyzing the next frame of data, the first frame of data must be removed from the superimposed data and the current frame of data must be added to it. Then, the superposition and averaging processing must be performed while keeping the total number of frames analyzed unchanged. , this method obtains the change data set of quasi-steady-state signals. Secondly, after calibrating the processed data set with the actual welding penetration characteristics, it is divided into a training set, a test set and a verification set. Thirdly, use a computer to build a neural network model for a regression task, train the penetration state recognition model through the data in the training set until the results converge, adjust the model hyperparameters through the verification set, test the reliability of the model through the test set, and call The trained recognition model analyzes signal features online and extracts welding stability information.
所述熔深特征实时检测方法是将在线采集到的单路/或多路/或全部介观检测信号数据,先通过所述的信号预处理并转换成计算机可识别类型数据,然后调用已经训练好的识别模型进行运算,得出当前激光焊接的熔深数值,给出在线诊断结果或为焊接闭环控制系统提供关键工艺参数的调控依据,如焊接激光器功率、焊接速度、离焦量等。The real-time detection method of penetration characteristics is to first convert the single channel/or multiple channels/or all mesoscopic detection signal data collected online into computer-recognizable type data through the signal preprocessing, and then call the trained A good recognition model is used to perform calculations to obtain the current penetration value of laser welding, and provide online diagnosis results or provide a basis for regulating key process parameters for the welding closed-loop control system, such as welding laser power, welding speed, defocus, etc.
所述熔深状态识别模型的建立方法,是将所述阵列传感器或图像传感器采集到的分析样本数据经一定的数据处理后转换成计算机可识别类型数据,再将所述分析样本与实际的焊接熔深特征进行标定后分成训练集、测试集及验证集,然后利用计算机构建神经网络模型,通过训练集里的数据训练所述熔深识别模型直至结果收敛,通过验证集调整模型超参数,通过测试集检验模型的可靠性,调用已训练好的识别模型在线分析信号特征、提取焊接稳定性信息。The method for establishing the penetration state recognition model is to convert the analysis sample data collected by the array sensor or image sensor into computer-recognizable type data after certain data processing, and then compare the analysis sample with the actual welding The penetration characteristics are calibrated and divided into a training set, a test set and a verification set. Then a computer is used to build a neural network model, and the penetration recognition model is trained using the data in the training set until the results converge. The model hyperparameters are adjusted through the verification set. The test set tests the reliability of the model, calls the trained recognition model to analyze signal features online, and extracts welding stability information.
具体实施例五:Specific embodiment five:
本申请实施例五与实施例四的区别仅在于:The only difference between Embodiment 5 and Embodiment 4 of this application is:
本发明提供一种计算机设备,包括存储器和处理器,所述存储器存储有计算机程序,所述处理器执行所述计算机程序时实现一种激光焊接熔深在线检测方法。The invention provides a computer device, which includes a memory and a processor. The memory stores a computer program. When the processor executes the computer program, it implements an online laser welding penetration detection method.
步骤具体为:The specific steps are:
首先,选取匙孔内熔深特征区域的热激发态介观信号作为检测对象,其次,利用光学聚焦成像及光谱透射原理将匙孔底部清晰的热激发态信号实像投射至阵列传感器的感应面上获得介观检测信号,然后,采用机器学习方法建立的模型识别介观信号特征,获取当前熔深状态信息。First, the thermally excited state mesoscopic signal in the characteristic area of penetration depth in the keyhole is selected as the detection object. Secondly, the clear thermally excited state signal real image at the bottom of the keyhole is projected onto the sensing surface of the array sensor using the principle of optical focusing imaging and spectral transmission. The mesoscopic detection signal is obtained, and then the model established by the machine learning method is used to identify the characteristics of the mesoscopic signal and obtain the current penetration status information.
所述匙孔底部热激发态信号,是激光光束进入母材后,通过剧烈的能量输入使匙孔底部金属迅速熔化、蒸发,并伴随高密度能量激发而产生的一种近红外信号,由于匙孔是在金属蒸发的反冲压力下形成的,而热激发态信号刚好产生于形成匙孔的主要反冲压力区,所以信号的强弱可有效反映反冲压力区的压力情况,而且其趋势性变化可与匙孔深度具有较好的一致性,进而能够反映焊缝实际熔深的变化情况。The thermally excited state signal at the bottom of the keyhole is a near-infrared signal generated by the rapid melting and evaporation of the metal at the bottom of the keyhole through intense energy input after the laser beam enters the base material, and is accompanied by high-density energy excitation. The hole is formed under the recoil pressure of metal evaporation, and the thermal excited state signal happens to be generated in the main recoil pressure area where the keyhole is formed, so the strength of the signal can effectively reflect the pressure situation in the recoil pressure area, and its trend The sexual changes can have good consistency with the keyhole depth, which can reflect the changes in the actual penetration depth of the weld.
介观检测信号的采集方法为,首先通过一个至少具有0.6-1.5m拍摄工作距离和10mm拍摄景深的高倍光学聚焦镜头组,从激光焊接头的同轴光路内提取到匙孔底部特征区域的清晰实像,足够的大的景深可以在焦距不发生改变的同时拍摄到波动状态下特征区域的清晰实像,其次,在近红外谱段下,通过窄带滤光的办法将匙孔上方的焊接羽辉、激光束及其它大量焊接辐射信号有效屏蔽,使特征区域内的热激发态信号可以有效分离出来,从而大幅减少检测信号中的无效信号的占比,然后,将热激发态信号实像投射至一个传感覆盖面积大、检测精度高的阵列传感器的感应面上,阵列传感器的感应区域应≥待测特征区域,且分辨精度≤10μm,由此获得待测特征区域中不同位置的介观信号,该方法不但可以获得待测区域内的全位置的热激发信号,准确分析出熔深关键特征信号的所处位置,更能通过直接提取关键位置的介观信号,来进一步提高检测数据中的有效信号占比,降低信号分析的数据量,为下一步检测信号分析提供数据保障。The mesoscopic detection signal collection method is to first extract clear images of the characteristic area at the bottom of the keyhole from the coaxial optical path of the laser welding joint through a high-power optical focusing lens group with at least a shooting working distance of 0.6-1.5m and a shooting depth of 10mm. Real image, a large enough depth of field can capture a clear real image of the characteristic area in a fluctuating state without changing the focal length. Secondly, under the near-infrared spectrum, the welding plume above the keyhole and the welding plume above the keyhole are filtered through narrow-band filtering. The laser beam and other large amounts of welding radiation signals are effectively shielded, so that the thermally excited state signals in the characteristic area can be effectively separated, thereby greatly reducing the proportion of invalid signals in the detection signal. Then, the real image of the thermally excited state signals is projected onto a transmitter On the sensing surface of an array sensor with large sensing coverage area and high detection accuracy, the sensing area of the array sensor should be ≥ the characteristic area to be measured, and the resolution accuracy should be ≤ 10 μm, so that mesoscopic signals at different positions in the characteristic area to be measured can be obtained. This method can not only obtain thermal excitation signals at all locations in the area to be measured, and accurately analyze the location of the key characteristic signals of the penetration depth, but can also further improve the effective signals in the detection data by directly extracting mesoscopic signals at key locations. Proportion, reduce the amount of data for signal analysis, and provide data guarantee for the next step of detection signal analysis.
所述熔深状态识别模型的建立方法是基于熔深信号波动特征提出的,由于熔深信号在焊接过程中随着匙孔深度变化一直处于快速的上下波动状态,而在各个较小时间段内信号波动的分布趋势与焊接熔深直接相关,所以熔深信号是一种具有趋势性特征的准稳态信号。它有别于瞬态信号识别时需要对每个瞬时特征都需要精确识别,准稳态信号分析时需要忽略掉瞬态特征,而对信号的运行趋势做出有效判断。所以在熔深状态识别模型训练时,首先,在对熔深信号预处理时,需要先将一段时间内的数据进行叠加后再均化处理,从而获得这一个时间段内的趋势性特征数据,然后再分析下一帧数据时,须在叠加数据中先剔除最前面一帧数据并将当前一帧数据加入其中后,在保持所分析的总帧数不变情况下再进行叠加、均化处理,由此方法获得准稳态信号的变化数据集。其次,再将处理后的数据集与实际的焊接熔深特征进行标定后,再分成训练集、测试集及验证集。再次,利用计算机构建一个回归类任务的神经网络模型,通过训练集里的数据训练所述熔深状态识别模型直至结果收敛,通过验证集调整模型超参数,通过测试集检验模型的可靠性,调用已训练好的识别模型在线分析信号特征、提取焊接稳定性信息。The establishment method of the penetration state identification model is proposed based on the fluctuation characteristics of the penetration signal. Since the penetration signal has been in a rapid up and down state as the keyhole depth changes during the welding process, and in each small time period The distribution trend of signal fluctuations is directly related to the welding penetration, so the penetration signal is a quasi-steady signal with trend characteristics. It is different from the need to accurately identify each instantaneous feature when identifying transient signals. When analyzing quasi-steady-state signals, it is necessary to ignore the transient features and make effective judgments on the operating trend of the signal. Therefore, when training the penetration state recognition model, first of all, when preprocessing the penetration signal, the data within a period of time need to be superimposed and then averaged, so as to obtain the trend characteristic data within this period of time. Then when analyzing the next frame of data, the first frame of data must be removed from the superimposed data and the current frame of data must be added to it. Then, the superposition and averaging processing must be performed while keeping the total number of frames analyzed unchanged. , this method obtains the change data set of quasi-steady-state signals. Secondly, after calibrating the processed data set with the actual welding penetration characteristics, it is divided into a training set, a test set and a verification set. Thirdly, use a computer to build a neural network model for a regression task, train the penetration state recognition model through the data in the training set until the results converge, adjust the model hyperparameters through the verification set, test the reliability of the model through the test set, and call The trained recognition model analyzes signal features online and extracts welding stability information.
所述熔深特征实时检测方法是将在线采集到的单路/或多路/或全部介观检测信号数据,先通过所述的信号预处理并转换成计算机可识别类型数据,然后调用已经训练好的识别模型进行运算,得出当前激光焊接的熔深数值,给出在线诊断结果或为焊接闭环控制系统提供关键工艺参数的调控依据,如焊接激光器功率、焊接速度、离焦量等。The real-time detection method of penetration characteristics is to first convert the single channel/or multiple channels/or all mesoscopic detection signal data collected online into computer-recognizable type data through the signal preprocessing, and then call the trained A good recognition model is used to perform calculations to obtain the current penetration value of laser welding, and provide online diagnosis results or provide a basis for regulating key process parameters for the welding closed-loop control system, such as welding laser power, welding speed, defocus, etc.
所述熔深状态识别模型的建立方法,是将所述阵列传感器或图像传感器采集到的分析样本数据经一定的数据处理后转换成计算机可识别类型数据,再将所述分析样本与实际的焊接熔深特征进行标定后分成训练集、测试集及验证集,然后利用计算机构建神经网络模型,通过训练集里的数据训练所述熔深识别模型直至结果收敛,通过验证集调整模型超参数,通过测试集检验模型的可靠性,调用已训练好的识别模型在线分析信号特征、提取焊接稳定性信息。The method for establishing the penetration state recognition model is to convert the analysis sample data collected by the array sensor or image sensor into computer-recognizable type data after certain data processing, and then compare the analysis sample with the actual welding The penetration characteristics are calibrated and divided into a training set, a test set and a verification set. Then a computer is used to build a neural network model, and the penetration recognition model is trained using the data in the training set until the results converge. The model hyperparameters are adjusted through the verification set. The test set tests the reliability of the model, calls the trained recognition model to analyze signal features online, and extracts welding stability information.
在本说明书的描述中,参考术语“一个实施例”、“一些实施例”、“示例”、“具体示例”、或“一些示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本发明的至少一个实施例或示例中。在本说明书中,对上述术语的示意性表述不必须针对的是相同的实施例或示例。而且,描述的具体特征、结构、材料或者特点可以在任一个或N个实施例或示例中以合适的方式结合。此外,在不相互矛盾的情况下,本领域的技术人员可以将本说明书中描述的不同实施例或示例以及不同实施例或示例的特征进行结合和组合。此外,术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括至少一个该特征。在本发明的描述中,“N个”的含义是至少两个,例如两个,三个等,除非另有明确具体的限定。流程图中或在此以其他方式描述的任何过程或方法描述可以被理解为,表示包括一个或更N个用于实现定制逻辑功能或过程的步骤的可执行指令的代码的模块、片段或部分,并且本发明的优选实施方式的范围包括另外的实现,其中可以不按所示出或讨论的顺序,包括根据所涉及的功能按基本同时的方式或按相反的顺序,来执行功能,这应被本发明的实施例所属技术领域的技术人员所理解。在流程图中表示或在此以其他方式描述的逻辑和/或步骤,例如,可以被认为是用于实现逻辑功能的可执行指令的定序列表,可以具体实现在任何计算机可读介质中,以供指令执行系统、装置或设备(如基于计算机的系统、包括处理器的系统或其他可以从指令执行系统、装置或设备取指令并执行指令的系统)使用,或结合这些指令执行系统、装置或设备而使用。就本说明书而言,"计算机可读介质"可以是任何可以包含、存储、通信、传播或传输程序以供指令执行系统、装置或设备或结合这些指令执行系统、装置或设备而使用的装置。计算机可读介质的更具体的示例(非穷尽性列表)包括以下:具有一个或N个布线的电连接部(电子装置),便携式计算机盘盒(磁装置),随机存取存储器(RAM),只读存储器(ROM),可擦除可编辑只读存储器(EPROM或闪速存储器),光纤装置,以及便携式光盘只读存储器(CDROM)。另外,计算机可读介质甚至可以是可在其上打印所述程序的纸或其他合适的介质,因为可以例如通过对纸或其他介质进行光学扫描,接着进行编辑、解译或必要时以其他合适方式进行处理来以电子方式获得所述程序,然后将其存储在计算机存储器中。应当理解,本发明的各部分可以用硬件、软件、固件或它们的组合来实现。在上述实施方式中,N个步骤或方法可以用存储在存储器中且由合适的指令执行系统执行的软件或固件来实现。如,如果用硬件来实现和在另一实施方式中一样,可用本领域公知的下列技术中的任一项或他们的组合来实现:具有用于对数据信号实现逻辑功能的逻辑门电路的离散逻辑电路,具有合适的组合逻辑门电路的专用集成电路,可编程门阵列(PGA),现场可编程门阵列(FPGA)等。In the description of this specification, reference to the terms "one embodiment," "some embodiments," "an example," "specific examples," or "some examples" or the like means that specific features are described in connection with the embodiment or example. , structures, materials or features are included in at least one embodiment or example of the invention. In this specification, the schematic expressions of the above terms are not necessarily directed to the same embodiment or example. Furthermore, the specific features, structures, materials or characteristics described may be combined in any suitable manner in any one or N embodiments or examples. Furthermore, those skilled in the art may combine and combine different embodiments or examples and features of different embodiments or examples described in this specification unless they are inconsistent with each other. In addition, the terms “first” and “second” are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the quantity of indicated technical features. Therefore, features defined as "first" and "second" may explicitly or implicitly include at least one of these features. In the description of the present invention, "N" means at least two, such as two, three, etc., unless otherwise clearly and specifically limited. Any process or method descriptions in flowcharts or otherwise described herein may be understood to represent modules, segments, or portions of code that include one or more executable instructions for implementing customized logical functions or steps of the process. , and the scope of the preferred embodiments of the invention includes additional implementations in which functions may be performed out of the order shown or discussed, including in a substantially simultaneous manner or in the reverse order, depending on the functionality involved, which shall It should be understood by those skilled in the art to which embodiments of the present invention belong. The logic and/or steps represented in the flowcharts or otherwise described herein, for example, may be considered a sequenced list of executable instructions for implementing the logical functions, and may be embodied in any computer-readable medium, For use by, or in combination with, instruction execution systems, devices or devices (such as computer-based systems, systems including processors or other systems that can fetch instructions from and execute instructions from the instruction execution system, device or device) or equipment. For the purposes of this specification, a "computer-readable medium" may be any device that can contain, store, communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. More specific examples (non-exhaustive list) of computer readable media include the following: electrical connections with one or N wires (electronic device), portable computer disk cartridge (magnetic device), random access memory (RAM), Read-only memory (ROM), erasable and programmable read-only memory (EPROM or flash memory), fiber optic devices, and portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium may even be paper or other suitable medium on which the program may be printed, as the paper or other medium may be optically scanned, for example, and subsequently edited, interpreted, or otherwise suitable as necessary. process to obtain the program electronically and then store it in computer memory. It should be understood that various parts of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the N steps or methods may be implemented using software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if it is implemented in hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: discrete logic gate circuits with logic functions for implementing data signals. Logic circuits, application specific integrated circuits with suitable combinational logic gates, programmable gate arrays (PGA), field programmable gate arrays (FPGA), etc.
以上所述仅是一种激光焊接熔深在线检测方法的优选实施方式,一种激光焊接熔深在线检测方法的保护范围并不仅局限于上述实施例,凡属于该思路下的技术方案均属于本发明的保护范围。应当指出,对于本领域的技术人员来说,在不脱离本发明原理前提下的若干改进和变化,这些改进和变化也应视为本发明的保护范围。The above is only a preferred implementation mode of a laser welding penetration online detection method. The protection scope of a laser welding penetration online detection method is not limited to the above embodiments. All technical solutions that fall under this idea belong to this invention. protection scope of the invention. It should be pointed out that for those skilled in the art, several improvements and changes can be made without departing from the principles of the present invention, and these improvements and changes should also be regarded as the protection scope of the present invention.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202311289818.5A CN117259976B (en) | 2023-10-08 | 2023-10-08 | A method for online detection of laser welding penetration |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202311289818.5A CN117259976B (en) | 2023-10-08 | 2023-10-08 | A method for online detection of laser welding penetration |
Publications (2)
Publication Number | Publication Date |
---|---|
CN117259976A true CN117259976A (en) | 2023-12-22 |
CN117259976B CN117259976B (en) | 2025-03-25 |
Family
ID=89210217
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202311289818.5A Active CN117259976B (en) | 2023-10-08 | 2023-10-08 | A method for online detection of laser welding penetration |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN117259976B (en) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110567925A (en) * | 2019-09-10 | 2019-12-13 | 哈尔滨焊接研究院有限公司 | Laser welding online adaptive penetration detection device and detection method |
CN111461398A (en) * | 2020-02-27 | 2020-07-28 | 季华实验室 | Welding process parameter optimization method, device and readable storage medium |
WO2021207318A1 (en) * | 2020-04-08 | 2021-10-14 | BWXT Advanced Technologies LLC | In-situ inspection method based on digital data model of weld |
US20220258286A1 (en) * | 2021-02-18 | 2022-08-18 | Precitec Gmbh & Co. Kg | Method and laser machining system for analyzing a weld seam formed by a laser welding process |
CN115906674A (en) * | 2023-02-03 | 2023-04-04 | 肇庆学院 | Narrow gap welding penetration prediction method based on recurrent neural network |
CN116329740A (en) * | 2023-05-29 | 2023-06-27 | 深圳市矽赫科技有限公司 | Method and device for in-situ monitoring and process control of laser fusion welding |
-
2023
- 2023-10-08 CN CN202311289818.5A patent/CN117259976B/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110567925A (en) * | 2019-09-10 | 2019-12-13 | 哈尔滨焊接研究院有限公司 | Laser welding online adaptive penetration detection device and detection method |
CN111461398A (en) * | 2020-02-27 | 2020-07-28 | 季华实验室 | Welding process parameter optimization method, device and readable storage medium |
WO2021207318A1 (en) * | 2020-04-08 | 2021-10-14 | BWXT Advanced Technologies LLC | In-situ inspection method based on digital data model of weld |
US20220258286A1 (en) * | 2021-02-18 | 2022-08-18 | Precitec Gmbh & Co. Kg | Method and laser machining system for analyzing a weld seam formed by a laser welding process |
CN115906674A (en) * | 2023-02-03 | 2023-04-04 | 肇庆学院 | Narrow gap welding penetration prediction method based on recurrent neural network |
CN116329740A (en) * | 2023-05-29 | 2023-06-27 | 深圳市矽赫科技有限公司 | Method and device for in-situ monitoring and process control of laser fusion welding |
Non-Patent Citations (3)
Title |
---|
孙谦,黄瑞生等: "激光焊接熔透特征信号同轴增效提取方法研究", 光谱学与光谱学分析, vol. 40, no. 3, 31 March 2020 (2020-03-31), pages 680 - 683 * |
耿昌松, 林泳, 王旭友, 杨永波, 徐清: "YAG激光焊接参数的人工神经网络模型", 焊接学报, no. 06, 30 December 2001 (2001-12-30), pages 38 - 40 * |
高向东;李竹曼;游德勇;张南峰;: "激光焊匙孔特征的近红外与X射线传感分析", 光学精密工程, no. 10, 15 October 2016 (2016-10-15), pages 2401 - 2405 * |
Also Published As
Publication number | Publication date |
---|---|
CN117259976B (en) | 2025-03-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7012689B2 (en) | Flow cytometer with active automated optical alignment system | |
CN100526854C (en) | Beta-ray soot concentration direct-reading monitor and method for determining effective sample | |
CN102262076B (en) | Laser-Induced Breakdown Spectroscopy Element Concentration Measurement Method Based on Line Combination | |
CN108778606A (en) | Fire check identification in laser welding | |
US8164022B2 (en) | Optical sensor for quality monitoring of a welding process | |
CN111289496B (en) | A detection method and device for long-distance zoom laser-induced breakdown spectroscopy | |
CN110441329B (en) | A method, device and equipment for laser welding defect recognition based on deep learning | |
CN103537797B (en) | Laser lap welding gap detection method and system based on plasma image | |
CN1709631A (en) | A multi-signal fusion monitor for high-energy beam welding process | |
CN109426225A (en) | A kind of method of quality control of tobacco cutting production | |
CN110567925A (en) | Laser welding online adaptive penetration detection device and detection method | |
CN109507187A (en) | A method and device for diagnosing defects in laser additive manufacturing | |
CN115008006B (en) | Laser welding detection evaluation system and method | |
CN101391344A (en) | A real-time monitoring method for laser welding process stability | |
CN106623493A (en) | Detection method for continuous punching of steel band | |
CN116038112A (en) | A laser tracking system and method for fillet welding of large curved panels | |
JP4621602B2 (en) | Lithium leak detector | |
CN105987807A (en) | Defective point detection system and method for vertical cavity surface emitting laser array | |
CN117259976A (en) | Laser welding penetration on-line detection method | |
CN107085233B (en) | Local radiation flow measurement system based on precise pinhole | |
WO2021238095A1 (en) | Alloy analysis system and re-testing method thereof | |
Xu et al. | An Envelope Algorithm for Single Nanoparticle Collision Electrochemistry | |
CN119126173B (en) | Beidou positioning terminal for electric power | |
CN117520738B (en) | Laser welding forming stability on-line detection method based on array sensing and artificial intelligent recognition | |
CN117517243B (en) | Laser welding penetration on-line detection method based on mesoscopic signal array identification |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |