WO2019103772A1 - Detection and root cause analysis of welding defects - Google Patents
Detection and root cause analysis of welding defects Download PDFInfo
- Publication number
- WO2019103772A1 WO2019103772A1 PCT/US2018/047022 US2018047022W WO2019103772A1 WO 2019103772 A1 WO2019103772 A1 WO 2019103772A1 US 2018047022 W US2018047022 W US 2018047022W WO 2019103772 A1 WO2019103772 A1 WO 2019103772A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- weld
- analysis
- defects
- welding
- physical
- Prior art date
Links
- 230000007547 defect Effects 0.000 title claims abstract description 89
- 238000003466 welding Methods 0.000 title claims abstract description 77
- 238000004458 analytical method Methods 0.000 title claims abstract description 66
- 238000001514 detection method Methods 0.000 title description 21
- 238000000034 method Methods 0.000 claims abstract description 65
- 230000009471 action Effects 0.000 claims abstract description 19
- 230000008569 process Effects 0.000 claims description 33
- 230000001364 causal effect Effects 0.000 claims description 13
- 238000013528 artificial neural network Methods 0.000 claims description 12
- 230000015654 memory Effects 0.000 claims description 8
- 238000002604 ultrasonography Methods 0.000 claims description 8
- 238000004088 simulation Methods 0.000 description 18
- 238000012545 processing Methods 0.000 description 12
- 238000002474 experimental method Methods 0.000 description 8
- 238000013459 approach Methods 0.000 description 6
- 230000008901 benefit Effects 0.000 description 5
- 238000013527 convolutional neural network Methods 0.000 description 5
- 238000012937 correction Methods 0.000 description 5
- 239000002184 metal Substances 0.000 description 5
- 238000003860 storage Methods 0.000 description 5
- 238000013135 deep learning Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 238000004519 manufacturing process Methods 0.000 description 4
- 230000004044 response Effects 0.000 description 4
- 238000012549 training Methods 0.000 description 4
- 238000011960 computer-aided design Methods 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 238000010801 machine learning Methods 0.000 description 3
- 230000007246 mechanism Effects 0.000 description 3
- 230000002093 peripheral effect Effects 0.000 description 3
- 238000013439 planning Methods 0.000 description 3
- 238000012360 testing method Methods 0.000 description 3
- 230000006399 behavior Effects 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 238000013480 data collection Methods 0.000 description 2
- 230000002950 deficient Effects 0.000 description 2
- 230000008030 elimination Effects 0.000 description 2
- 238000003379 elimination reaction Methods 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 239000000155 melt Substances 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000010223 real-time analysis Methods 0.000 description 2
- 230000009897 systematic effect Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000000712 assembly Effects 0.000 description 1
- 238000000429 assembly Methods 0.000 description 1
- 150000001768 cations Chemical class 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000001816 cooling Methods 0.000 description 1
- 238000002790 cross-validation Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000009658 destructive testing Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 239000012636 effector Substances 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000004907 flux Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000010438 heat treatment Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000009916 joint effect Effects 0.000 description 1
- 238000003754 machining Methods 0.000 description 1
- 238000002844 melting Methods 0.000 description 1
- 230000008018 melting Effects 0.000 description 1
- 230000035515 penetration Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 238000010587 phase diagram Methods 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 238000000513 principal component analysis Methods 0.000 description 1
- 230000035755 proliferation Effects 0.000 description 1
- 230000000306 recurrent effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 238000007711 solidification Methods 0.000 description 1
- 230000008023 solidification Effects 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012706 support-vector machine Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 238000010200 validation analysis Methods 0.000 description 1
- 238000005493 welding type Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N29/00—Investigating or analysing materials by the use of ultrasonic, sonic or infrasonic waves; Visualisation of the interior of objects by transmitting ultrasonic or sonic waves through the object
- G01N29/44—Processing the detected response signal, e.g. electronic circuits specially adapted therefor
- G01N29/4472—Mathematical theories or simulation
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B23—MACHINE TOOLS; METAL-WORKING NOT OTHERWISE PROVIDED FOR
- B23K—SOLDERING OR UNSOLDERING; WELDING; CLADDING OR PLATING BY SOLDERING OR WELDING; CUTTING BY APPLYING HEAT LOCALLY, e.g. FLAME CUTTING; WORKING BY LASER BEAM
- B23K31/00—Processes relevant to this subclass, specially adapted for particular articles or purposes, but not covered by only one of the preceding main groups
- B23K31/006—Processes relevant to this subclass, specially adapted for particular articles or purposes, but not covered by only one of the preceding main groups relating to using of neural networks
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B23—MACHINE TOOLS; METAL-WORKING NOT OTHERWISE PROVIDED FOR
- B23K—SOLDERING OR UNSOLDERING; WELDING; CLADDING OR PLATING BY SOLDERING OR WELDING; CUTTING BY APPLYING HEAT LOCALLY, e.g. FLAME CUTTING; WORKING BY LASER BEAM
- B23K31/00—Processes relevant to this subclass, specially adapted for particular articles or purposes, but not covered by only one of the preceding main groups
- B23K31/12—Processes relevant to this subclass, specially adapted for particular articles or purposes, but not covered by only one of the preceding main groups relating to investigating the properties, e.g. the weldability, of materials
- B23K31/125—Weld quality monitoring
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N29/00—Investigating or analysing materials by the use of ultrasonic, sonic or infrasonic waves; Visualisation of the interior of objects by transmitting ultrasonic or sonic waves through the object
- G01N29/44—Processing the detected response signal, e.g. electronic circuits specially adapted therefor
- G01N29/4481—Neural networks
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N2291/00—Indexing codes associated with group G01N29/00
- G01N2291/26—Scanned objects
- G01N2291/267—Welds
Definitions
- the present disclosure is directed, in general, systems and methods for machine detection of physical defects in part welds.
- Automated robotic welding devices can produce welding defects when faulty sensors, programs or parameters are used, and if those defects are not detected, they may be repeated many times. Improved systems are desirable.
- a method includes simulating a welding operation by a weld analysis system.
- the method includes analyzing a physical weld corresponding to the simulated welding operation.
- the method includes detecting and predicting welding defects based on the simulated welding operation and the analysis of the physical weld.
- the method includes performing a root cause analysis, based on the detected and predicted welding defects, to identify at least one root cause of the welding defects.
- the method includes producing a corrective action based on the identified at least one root cause to remove the welding defects from subsequent physical welds.
- the method can further include performing physical welding operations according to the corrective action.
- the simulated welding operation uses one or more of a robotic path, part parameters, weld parameters, and part movements.
- the analysis of the physical weld includes one or more of analyzing camera images, analyzing ultrasound images, analyzing sensor inputs, and analyzing weld parameters.
- detecting and predicting welding defects is performed by building one or more deep neural networks from results of the simulated welding operation and results of the physical weld analysis.
- the root cause analysis includes building causal graphical models using predicted defects based on the simulated welding operation and unpredicted, detected defects from the physical weld analysis.
- the corrective action includes corrected motion paths for robotic welders.
- Figure 1 illustrates a block diagram of processes performed by a weld analysis system as disclosed herein in accordance with disclosed embodiments
- Figure 2 illustrates a process for using controlled experiments to identify faults in a real-time analysis network in accordance with disclosed embodiments
- Figure 3 illustrates a flowchart of a process in accordance with disclosed embodiments.
- Figure 4 illustrates a block diagram of a data processing system in which an embodiment can be implemented.
- Disclosed embodiments incorporate machine-learning-based process for automatic low-cost detection and correction of the welding defects using root-cause analysis, without requiring human intervention. Based on the root causes identified, corrective action is performed and the robot can be used again for re-welding the defective areas.
- Disclosed embodiments include processes for robot weld simulation and weld defect data collection, processes for deep-learning for weld defect detection, processes for causal inference for root cause analysis, and processes for corrective path generation for spot welding robots.
- Disclosed embodiments improved the performance of robotic devices resulting in faster turn arounds for industrial spot welding.
- Disclosed embodiment can analyze defect data to ensure high weld quality using techniques from perception and sensing.
- disclosed processes can be applied to other manufacturing processes including machining defect detection and correction.
- Robotic spot welders can rapidly produce a large number of welds.
- ultrasonic and destructive testing of assemblies must be periodically conducted. Such manual product sampling tests are time-consuming and the results reflect only the quality achieved in that particular process.
- Adaptive control systems can be used to monitor current, voltage, resistance, etc. during automated welding and compare their values in real-time against predetermined process response curves to assure the required quality has been produced.
- these advanced methods suffer from the fact that they rely on predetermined values and responses of the relevant variables. The quality and reliability clearly depends on the stored“master curves” or other predetermined data.
- Some defect detection mechanisms focus on the detection of multiple types of welding defects.
- Research on the defect correction has been largely based on the robotic path planning and re-welding of defective locations.
- the challenge with such an approach is that the root causes of the defects are not detected and corrected. This can lead to an increase in the defects and repetition of defects.
- Figure 1 illustrates a block diagram 100 of processes performed by a weld analysis system as disclosed herein in accordance with disclosed embodiments.
- a system collects data from simulation experiments 102 and controlled experiments 112 for the training of the defect detection and root cause analysis models.
- Simulation experiments 102 can include such elements as robotic path 104, part parameters 106, weld parameters 108, and part movement 110.
- Simulation experiments can be carried out using computer-aided design (CAD), computer-aided manufacturing (CAM), or computer-aided engineering (CAE) simulation software, such as the NX® CAD/CAM/CAE software products by Siemens Product Lifecycle Management Software Inc. (Plano, Texas).
- CAD computer-aided design
- CAM computer-aided manufacturing
- CAE computer-aided engineering
- Controlled experiments 112 are performed by analysis of physical welds, both real-time (as welds are being created) and offline.
- the controlled experiments can include such elements as camera/ultrasound images 114 of the welds and sensor readings 116 of the welds, including weld parameters.
- Defect prediction and detection 118 can include, in this example, a deep neural network to predict defects 120, which can also predict defect types, and in particular can receive feature data and other output from simulation experiments 102. Defect prediction and detection 118 can also include, in this example, a deep neural network to detect defects at runtime 122, which can receive images and other output from controlled experiments 112.
- Defect prediction and detection 118 can produce output including both predicted defects and unpredicted defects, for example those that were detected by the deep neural network to detect defects at runtime 122 from the controlled experiments 112. The output of defect prediction and detection 118 can be sent to root cause analysis 124.
- Root cause analysis 124 analyzes the output of defect prediction and detection 118 to determine root causes of the welding defects. This can be accomplished, for example, using causal graphical models 126 to evaluate the root causes. Root cause analysis 124 can also provide feedback, such as the determined root causes or other data, back to the deep neural network to predict defects 120, so that the neural networks can be refined using deep-learning techniques.
- Root cause analysis 124 can send the determined root causes for the system to determine the appropriate corrective action 128.
- the system can do so, for example, using path planning simulations for corrective actions 130.
- the deep-models for the defect prediction (which can include auto-encoders and/or feed-forward networks), defect detection (which can include convolutional neural networks), and root-cause analysis (which can include probabilistic graphical models) can be trained on simulated data.
- the root-causes generated can be used for obtaining the corrective action. Corrective action can taken through simulation of the robotic path on the basis of the root causes found.
- the unit testing of the modules can be performed using nested cross-validation approaches on the data collected.
- FIG. 2 illustrates a process 200 for using controlled experiments to identify faults in a real-time analysis network in accordance with disclosed embodiments.
- camera/ultrasound images 214 of the welds are sent to convolutional neural networks (CNN) 220.
- Sensor readings 216 of the welds, including weld parameters, are sent to autoencoder/recurrent neural networks (RNN) 222.
- the outputs of CNN 220 and autoencoder/RNN 222 are combined into fully connected layers 226. Fully connected layers 226 can then be analyzed using the deep neural networks to detect existence and type of defects 228.
- Processes for robot weld simulation and weld defect data collection can use finite element analysis methods to simulate the welding process to understand the physics and obtain data for the root cause analysis of defects.
- Disclosed embodiments model the complex interactions between electrical, thermal and mechanical phenomena as a multi-physics problem in three-dimensional space and solve them in a fully-coupled manner. The metallurgical effects are then considered after the finite element analysis process. The goal is to find some relationship between the heating and cooling rates and final structures of spot welds, based on some phase diagrams that are previously prepared.
- VV — (V— g ⁇ ) on 3W, where c e is a temperature dependent electric conductivity, V is the electrical potential, and g is the prescribed electrical potential on the boundary.
- V ⁇ ⁇ 7 + pf - a where / is the body force, and a is the acceleration vector.
- the system can used equations given above iteratively or in a fully-coupled algorithm to provide temperature history predictions for the weld region.
- this thermal simulation is used directly to predict the diameter and penetration depth of the melt region.
- a more detailed simulation approach directly couples the electro-thermal-mechanical solution to the phase change of the metal (melting and solidification), the dynamics of the melt region, and the formation of metal microstructure during resolidification.
- Disclosed embodiments use the simulation tools to develop and validate detailed numerical simulations of weld formation.
- the geometries and microstructures predicted with this model provide a rich additional source of data for the development of weld defect detection algorithms in the associated project tasks.
- the system can include a fully instrumented experimental testbed, built around a servo-controlled spot welding gun, and collect such data as welding current, voltage, resistance, electrode pressure, and temperature.
- the system can collect and analyze all relevant process responses, such as the simulation of process variations and disturbances for physical model validation and training of the learning algorithms. Metallurgical, mechanical and other joint properties will be assessed through customary methods.
- the system can use deep-learning algorithms for weld defect detection.
- the challenges for weld defect detection include diverse data types, lack of accurate labels for historic data at customer site, and real-time defect prediction and customization at the customer-site through online learning.
- Disclosed embodiments can use machine learning techniques such as fuzzy classification and clustering, support vector machines, k nearest neighbors, principal component analysis, and artificial neural networks. Not all defects may use the same set of features. Disclosed embodiments can implement a semi-supervised deep-learning approach which can leverage the unlabeled data.
- Simulation data for factors such as robot path, part parameters, weld parameters and part movement can be used by the system in a semi-supervised learning process using autoencoders (context or variational) to predict future defects and defect type.
- the defects predicted can be processed by the root cause module to pre-emptively stop the defect from occurring.
- the data from camera, ultrasound, temperature profile, and process parameters can be collected and sent to convolutional neural networks as illustrated in Figure 2 for predicting the run-time defects.
- the defects predicted at this stage is also sent to the root cause analysis tool to determine the root causes.
- the run-time defects are also fed back into the initial prediction as training data for improving the prediction network. Once the root causes are identified, are used for corrective action.
- the unlabeled data at the customer site can be used in a semi- supervised fashion for additional learning.
- the unlabeled data used for training can be fed into the network until a stable defect prediction is produced.
- the system can use causal inference algorithms for root-cause analysis. Ignorance or misidentifi cation of the defect’s root causes can lead to a repetition and proliferation of defects.
- Current root-cause analysis techniques for welding-defects use statistical techniques which focus on single root causes. In an industrial welding setup, the defects may occur due to the interaction between multiple causes, as opposed to a single root cause.
- Counterfactual analysis inference models have been successfully used, for example, in the fields of genetics, medicine, and social science. The major benefits for these models includes their ability to distinguish factors that truly cause the defect from the factors that only correlate with it (the correlation might be, for example, due to common causes, also known as confounders).
- causal inference methods introduce additional assumptions that allow them to look directly for causal relationships in data.
- the system can create a causal graph that identifies causal relationships between the variables of interest.
- An instantiated causal graph enables the system to find the set of nodes (variables) that constitute the root causes of the defects.
- the system can predict“what would happen if’ possibilities by changing the values of the predicted root-cause variables.
- Disclosed embodiments generate corrective paths for the spot welding robot, and can use a closed loop control algorithm for the robot welding.
- a welding path is usually generated based on the part geometry and location of the welding spots to avoid collision with any obstacles.
- the end effector of the robot welding arm is then supposed to move from one spot to another following the path.
- the real part geometry may deviate from the model that is used to calculate the welding path.
- the system can generate a corrected path that compensates for such differences.
- the system can use a close loop control algorithm to monitor the actual welding location and compared it with the predicted location on the pre-calculated tool path. The difference is then recorded and analyzed to calibrate the welding path, so that the error between the actual location and predicted location is minimized. This calibration process is done in real time, so as the welding proceeds and more data is collected, the more accurate the calibrated path becomes.
- Disclosed embodiments improve on other systems in a number of ways, including improving weld time, cost per unit, and the quality of weld.
- Figure 3 illustrates a flowchart of a process in accordance with disclosed embodiments that may be performed, for example, by a system as disclosed herein (referred to below as the“weld analysis system”).
- the weld analysis system simulates a welding operation (302).
- the simulation can use one or more of a robotic path, part parameters, weld parameters, and part movements.
- the weld analysis system analyzes a physical weld corresponding to the simulated welding operation (304).
- the analysis can include one or more of analyzing camera images, ultrasound images, sensor inputs from any of the various sensors described herein, and weld parameters.
- the weld analysis system detects and predicts welding defects based on the simulated welding operation and the analysis of the physical weld (306). This can be performed by building one or more deep neural networks from the results of the simulated welding operation, such as features and other outputs, and the results of the physical weld analysis, such as the camera images, ultrasound images, sensor inputs from any of the various sensors described herein, weld parameters, or any other outputs.
- the weld analysis system performs a root cause analysis, based on the detected and predicted welding defects, to identify at least one root cause of the welding defects (308). This can include building causal graphical models to evaluate the root cause, and can be performed using predicted defects based on the simulated welding operation and unpredicted, detected defects from the physical weld analysis. Further, the results of the root cause analysis can be fee back to the defect prediction and detection process, in particular to further train the deep neural network(s).
- the weld analysis system produces a corrective action based on the identified root cause(s) to remove the welding defects from subsequent physical welds (310).
- the corrective action can include, for example, corrected motion paths for robotic welders, defining corrected welding parameters, or others. Producing the corrective action can include performing path planning simulations to identify and test corrective actions.
- the weld analysis system can thereafter perform physical welding operations according to the corrective action(s) (312).
- FIG. 4 illustrates a block diagram of a data processing system in which an embodiment can be implemented, for example as part of a weld analysis system particularly configured by software or otherwise to perform the processes as described herein, and in particular as each one of a plurality of interconnected and communicating systems as described herein.
- the data processing system depicted includes a processor 402 connected to a level two cache/bridge 404, which is connected in turn to a local system bus 406.
- Local system bus 406 may be, for example, a peripheral component interconnect (PCI) architecture bus.
- PCI peripheral component interconnect
- main memory 408 Also connected to local system bus in the depicted example are a main memory 408 and a graphics adapter 410.
- the graphics adapter 410 may be connected to display 411.
- Peripherals such as local area network (LAN) / Wide Area Network / Wireless (e.g . WiFi) adapter 412, may also be connected to local system bus 406.
- Expansion bus interface 414 connects local system bus 406 to input/output (I/O) bus 416.
- I/O bus 416 is connected to keyboard/mouse adapter 418, disk controller 420, and I/O adapter 422.
- Disk controller 420 can be connected to a storage 426, which can be any suitable machine usable or machine readable storage medium, including but not limited to nonvolatile, hard-coded type mediums such as read only memories (ROMs) or erasable, electrically programmable read only memories (EEPROMs), magnetic tape storage, and user-recordable type mediums such as floppy disks, hard disk drives and compact disk read only memories (CD-ROMs) or digital versatile disks (DVDs), and other known optical, electrical, or magnetic storage devices.
- ROMs read only memories
- EEPROMs electrically programmable read only memories
- CD-ROMs compact disk read only memories
- DVDs digital versatile disks
- audio adapter 424 Also connected to I/O bus 416 in the example shown is audio adapter 424, to which speakers (not shown) may be connected for playing sounds.
- Keyboard/mouse adapter 418 provides a connection for a pointing device (not shown), such as a mouse, trackball, trackpointer, touchscreen, etc.
- I/O adapter 422 can be connected to communicate with or control welding equipment 428, which can include welding robots, imagers, cameras, temperature sensors, ultrasound equipment, voltage sensors, current sensors, resistance sensors
- a data processing system in accordance with an embodiment of the present disclosure includes an operating system employing a graphical user interface.
- the operating system permits multiple display windows to be presented in the graphical user interface simultaneously, with each display window providing an interface to a different application or to a different instance of the same application.
- a cursor in the graphical user interface may be manipulated by a user through the pointing device. The position of the cursor may be changed and/or an event, such as clicking a mouse button, generated to actuate a desired response.
- One of various commercial operating systems such as a version of Microsoft WindowsTM, a product of Microsoft Corporation located in Redmond, Wash may be employed if suitably modified.
- the operating system is modified or created in accordance with the present disclosure as described.
- LAN/ WAN/Wireless adapter 412 can be connected to a network 430 (not a part of data processing system 400), which can be any public or private data processing system network or combination of networks, as known to those of skill in the art, including the Internet.
- Data processing system 400 can communicate over network 430 with server system 440, which is also not part of data processing system 400, but can be implemented, for example, as a separate data processing system 400.
- machine usable/readable or computer usable/readable mediums include: nonvolatile, hard-coded type mediums such as read only memories (ROMs) or erasable, electrically programmable read only memories (EEPROMs), and user-recordable type mediums such as floppy disks, hard disk drives and compact disk read only memories (CD-ROMs) or digital versatile disks (DVDs).
- ROMs read only memories
- EEPROMs electrically programmable read only memories
- user-recordable type mediums such as floppy disks, hard disk drives and compact disk read only memories (CD-ROMs) or digital versatile disks (DVDs).
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Immunology (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- Evolutionary Computation (AREA)
- Artificial Intelligence (AREA)
- Signal Processing (AREA)
- Pathology (AREA)
- Mechanical Engineering (AREA)
- Mathematical Analysis (AREA)
- Mathematical Optimization (AREA)
- Mathematical Physics (AREA)
- Pure & Applied Mathematics (AREA)
- Quality & Reliability (AREA)
- Algebra (AREA)
- Investigating Or Analyzing Materials By The Use Of Ultrasonic Waves (AREA)
Abstract
Methods for weld analysis and corresponding systems and computer-readable mediums. A method (300) includes simulating (302) a welding operation (102) by the weld analysis system (400). The method includes analyzing (304) a physical weld (112) corresponding to the simulated welding operation. The method includes detecting and predicting (306) welding defects based on the simulated welding operation and the analysis of the physical weld. The method includes performing a root cause analysis (124, 308), based on the detected and predicted welding defects, to identify at least one root cause of the welding defects. The method includes producing a corrective action (128, 310) based on the identified at least one root cause to remove the welding defects from subsequent physical welds.
Description
DETECTION AND ROOT CAUSE ANALYSIS OF WELDING DEFECTS
CROSS-REFERENCE TO OTHER APPLICATION
[0001] This application claims the benefit of the filing data of United States Provisional Patent Application 62/589,589, filed November 22, 2017, which is hereby incorporated by reference.
TECHNICAL FIELD
[0002] The present disclosure is directed, in general, systems and methods for machine detection of physical defects in part welds.
BACKGROUND OF THE DISCLOSURE
[0003] Automated robotic welding devices can produce welding defects when faulty sensors, programs or parameters are used, and if those defects are not detected, they may be repeated many times. Improved systems are desirable.
SUMMARY OF THE DISCLOSURE
[0004] Various disclosed embodiments include methods for weld analysis and corresponding systems and computer-readable mediums. A method includes simulating a welding operation by a weld analysis system. The method includes analyzing a physical weld corresponding to the simulated welding operation. The method includes detecting and predicting welding defects based on the simulated welding operation and the analysis of the physical weld. The method includes performing a root cause analysis, based on the detected and predicted welding defects, to identify at least one root cause of the welding defects. The method includes producing a corrective action based on the identified at least one root cause to remove the welding defects from subsequent physical welds. In some cases, the method can further include performing physical welding operations according to the corrective action.
[0005] In some embodiments, the simulated welding operation uses one or more of a robotic path, part parameters, weld parameters, and part movements. In some embodiments, the analysis of the physical weld includes one or more of analyzing camera images, analyzing ultrasound images, analyzing sensor inputs, and analyzing weld parameters. In some embodiments, detecting and predicting welding defects is performed by building one or more deep neural networks from results of the simulated welding operation and results of the physical weld analysis. In some embodiments, the root cause analysis includes building causal graphical models using predicted defects based on the simulated welding operation and unpredicted, detected defects from the physical weld analysis. In some embodiments, the corrective action includes corrected motion paths for robotic welders.
[0006] The foregoing has outlined rather broadly the features and technical advantages of the present disclosure so that those skilled in the art may better understand the detailed description that follows. Additional features and advantages of the disclosure will be described hereinafter that form the subject of the claims. Those skilled in the art will appreciate that they may readily use the conception and the specific embodiment disclosed as a basis for modifying or designing other structures for carrying out the same
purposes of the present disclosure. Those skilled in the art will also realize that such equivalent constructions do not depart from the spirit and scope of the disclosure in its broadest form.
[0007] Before undertaking the DETAILED DESCRIPTION below, it may be advantageous to set forth definitions of certain words or phrases used throughout this patent document: the terms“include” and“comprise,” as well as derivatives thereof, mean inclusion without limitation; the term“or” is inclusive, meaning and/or; the phrases “associated with” and“associated therewith,” as well as derivatives thereof, may mean to include, be included within, interconnect with, contain, be contained within, connect to or with, couple to or with, be communicable with, cooperate with, interleave, juxtapose, be proximate to, be bound to or with, have, have a property of, or the like; and the term “controller” means any device, system or part thereof that controls at least one operation, whether such a device is implemented in hardware, firmware, software or some combination of at least two of the same. It should be noted that the functionality associated with any particular controller may be centralized or distributed, whether locally or remotely. Definitions for certain words and phrases are provided throughout this patent document, and those of ordinary skill in the art will understand that such definitions apply in many, if not most, instances to prior as well as future uses of such defined words and phrases. While some terms may include a wide variety of embodiments, the appended claims may expressly limit these terms to specific embodiments.
BRIEF DESCRIPTION OF THE DRAWINGS
[0008] For a more complete understanding of the present disclosure, and the advantages thereof, reference is now made to the following descriptions taken in conjunction with the accompanying drawings, wherein like numbers designate like objects, and in which:
[0009] Figure 1 illustrates a block diagram of processes performed by a weld analysis system as disclosed herein in accordance with disclosed embodiments;
[0010] Figure 2 illustrates a process for using controlled experiments to identify faults in a real-time analysis network in accordance with disclosed embodiments;
[0011] Figure 3 illustrates a flowchart of a process in accordance with disclosed embodiments; and
[0012] Figure 4 illustrates a block diagram of a data processing system in which an embodiment can be implemented.
DETAILED DESCRIPTION
[0013] The Figures discussed below, and the various embodiments used to describe the principles of the present disclosure in this patent document are by way of illustration only and should not be construed in any way to limit the scope of the disclosure. Those skilled in the art will understand that the principles of the present disclosure may be implemented in any suitably arranged device. The numerous innovative teachings of the present application will be described with reference to exemplary non-limiting embodiments.
[0014] Spot welding is widely used in the automotive industry to assemble vehicle body parts and can be almost completely automated using robots, and similar techniques are made used in other industries. One major challenge for automated robotic welding devices is the detection, correction, and prevention of welding defects. Unless the cause of the defects is known, the robot will continue the weld process using the same parameters, which often results in an increase in the defects and the repetition of defects. In an industrial welding system, each type of defect occurs due to the interaction between a diverse set of factors, which makes the root-cause analysis a challenge. Fault analysis often requires the systematic elimination of factors to arrive at the true cause. This process is both time-taking and resource-intensive because current practices require manual, human intervention for defect identification, root-cause analysis, and defect correction. This makes the quality and cost of welding for large automotive companies suboptimal.
[0015] Disclosed embodiments incorporate machine-learning-based process for automatic low-cost detection and correction of the welding defects using root-cause analysis, without requiring human intervention. Based on the root causes identified, corrective action is performed and the robot can be used again for re-welding the defective areas.
[0016] Disclosed embodiments include processes for robot weld simulation and weld defect data collection, processes for deep-learning for weld defect detection, processes
for causal inference for root cause analysis, and processes for corrective path generation for spot welding robots.
[0017] Disclosed embodiments improved the performance of robotic devices resulting in faster turn arounds for industrial spot welding. Disclosed embodiment can analyze defect data to ensure high weld quality using techniques from perception and sensing. In addition, disclosed processes can be applied to other manufacturing processes including machining defect detection and correction.
[0018] Robotic spot welders can rapidly produce a large number of welds. However, to ensure quality, ultrasonic and destructive testing of assemblies must be periodically conducted. Such manual product sampling tests are time-consuming and the results reflect only the quality achieved in that particular process.
[0019] Adaptive control systems can be used to monitor current, voltage, resistance, etc. during automated welding and compare their values in real-time against predetermined process response curves to assure the required quality has been produced. However, even these advanced methods suffer from the fact that they rely on predetermined values and responses of the relevant variables. The quality and reliability clearly depends on the stored“master curves” or other predetermined data.
[0020] Some defect detection mechanisms, including machine learning-based approaches, focus on the detection of multiple types of welding defects. Research on the defect correction has been largely based on the robotic path planning and re-welding of defective locations. The challenge with such an approach is that the root causes of the defects are not detected and corrected. This can lead to an increase in the defects and repetition of defects.
[0021] Current root-cause analysis techniques for welding defects use statistical techniques which focus on single root causes. Such an approach often requires the systematic elimination of factors to arrive at the true cause, and often requires a human to detect defects and takes corrective action to compensate for the defects created during robotic arm welding. This is time and resource intensive.
[0022] Disclosed processes are particularly applicable to the automotive industry, power and gas, and large-scale manufacturing segments which require fast weld times for a large number of parts.
[0023] Figure 1 illustrates a block diagram 100 of processes performed by a weld analysis system as disclosed herein in accordance with disclosed embodiments.
[0024] As illustrated in Fig. 1, a system collects data from simulation experiments 102 and controlled experiments 112 for the training of the defect detection and root cause analysis models. Simulation experiments 102 can include such elements as robotic path 104, part parameters 106, weld parameters 108, and part movement 110. Simulation experiments can be carried out using computer-aided design (CAD), computer-aided manufacturing (CAM), or computer-aided engineering (CAE) simulation software, such as the NX® CAD/CAM/CAE software products by Siemens Product Lifecycle Management Software Inc. (Plano, Texas).
[0025] Controlled experiments 112 are performed by analysis of physical welds, both real-time (as welds are being created) and offline. The controlled experiments can include such elements as camera/ultrasound images 114 of the welds and sensor readings 116 of the welds, including weld parameters.
[0026] The results of both simulation experiments 102 and controlled experiments 112 are then used for defect prediction and detection 118. Defect prediction and detection 118 can include, in this example, a deep neural network to predict defects 120, which can also predict defect types, and in particular can receive feature data and other output from simulation experiments 102. Defect prediction and detection 118 can also include, in this example, a deep neural network to detect defects at runtime 122, which can receive images and other output from controlled experiments 112.
[0027] Defect prediction and detection 118 can produce output including both predicted defects and unpredicted defects, for example those that were detected by the deep neural network to detect defects at runtime 122 from the controlled experiments 112. The output of defect prediction and detection 118 can be sent to root cause analysis 124.
[0028] Root cause analysis 124 analyzes the output of defect prediction and detection 118 to determine root causes of the welding defects. This can be accomplished, for example, using causal graphical models 126 to evaluate the root causes. Root cause analysis 124 can also provide feedback, such as the determined root causes or other data, back to the deep neural network to predict defects 120, so that the neural networks can be refined using deep-learning techniques.
[0029] Root cause analysis 124 can send the determined root causes for the system to determine the appropriate corrective action 128. The system can do so, for example, using path planning simulations for corrective actions 130.
[0030] In a process as illustrated in Fig. 1, the deep-models for the defect prediction (which can include auto-encoders and/or feed-forward networks), defect detection (which can include convolutional neural networks), and root-cause analysis (which can include probabilistic graphical models) can be trained on simulated data. The root-causes generated can be used for obtaining the corrective action. Corrective action can taken through simulation of the robotic path on the basis of the root causes found. The unit testing of the modules can be performed using nested cross-validation approaches on the data collected.
[0031] Figure 2 illustrates a process 200 for using controlled experiments to identify faults in a real-time analysis network in accordance with disclosed embodiments. In this figure, camera/ultrasound images 214 of the welds are sent to convolutional neural networks (CNN) 220. Sensor readings 216 of the welds, including weld parameters, are sent to autoencoder/recurrent neural networks (RNN) 222. The outputs of CNN 220 and autoencoder/RNN 222 are combined into fully connected layers 226. Fully connected layers 226 can then be analyzed using the deep neural networks to detect existence and type of defects 228.
[0032] Processes for robot weld simulation and weld defect data collection, in accordance with disclosed embodiments, can use finite element analysis methods to simulate the welding process to understand the physics and obtain data for the root cause analysis of defects.
[0033] Disclosed embodiments model the complex interactions between electrical, thermal and mechanical phenomena as a multi-physics problem in three-dimensional space and solve them in a fully-coupled manner. The metallurgical effects are then considered after the finite element analysis process. The goal is to find some relationship between the heating and cooling rates and final structures of spot welds, based on some phase diagrams that are previously prepared.
[0034] Various embodiment can apply general mathematical equations that govern the electrical, thermal, and mechanical physics of the welds and welding processes. Electrical problems can be assumed to be governed by Quasi-Laplace equation with boundary condition v (ce VV) = 0 in W,
ce VV = — (V— g±) on 3W, where ce is a temperature dependent electric conductivity, V is the electrical potential, and g is the prescribed electrical potential on the boundary.
[0035] Thermal problems can be described by the heat transfer equation and boundary condition as pcpT = V (kVT) + ce V2(V) in W,
k VT = —k0(T— g2) + h on 3W,
T = T0 at t = 0, where p is the density, cP is the specific heat per unit volume, T is the temperature and T its time derivative k is the heat conductivity, k0 is the heat conductivity in the normal direction on the boundary, g2 and h are the prescribed temperature and heat flux respectively on the boundary, and T0 is the initial temperature.
For mechanical analysis, the governing equation is described in incremental form to relate the stress, strain and thermal expansion
As = ΰDe + CAT
where \s and De are stress and strain increment respectively, matrix D is the elastic- plastic matrix, C is a thermal coefficient vector, and AT is the temperature differences.
[0036] The stress equilibrium equation is
V · <7 + pf - a where / is the body force, and a is the acceleration vector.
[0037] During the welding process of metal parts, usually multiple welds are needed to fully join the parts together with required strength. The robot arm follows a path that passes through all spots and welds one by one. Not only do the weld locations and tool path affect the welding quality at each weld, they also affect the overall structural behavior of the whole metal part. Therefore, in addition to simulating the multi-physics phenomena at a single weld, the system can also analyze an overall structural behavior of the whole metal part with multiple welds using a CWELD spot weld model.
[0038] The system can used equations given above iteratively or in a fully-coupled algorithm to provide temperature history predictions for the weld region. Typically, this thermal simulation is used directly to predict the diameter and penetration depth of the melt region. In order to accurately predict the propensity for defects, a more detailed simulation approach directly couples the electro-thermal-mechanical solution to the phase change of the metal (melting and solidification), the dynamics of the melt region, and the formation of metal microstructure during resolidification. Disclosed embodiments use the simulation tools to develop and validate detailed numerical simulations of weld formation. The geometries and microstructures predicted with this model provide a rich additional source of data for the development of weld defect detection algorithms in the associated project tasks.
[0039] The system can include a fully instrumented experimental testbed, built around a servo-controlled spot welding gun, and collect such data as welding current, voltage, resistance, electrode pressure, and temperature. The system can collect and analyze all relevant process responses, such as the simulation of process variations and disturbances
for physical model validation and training of the learning algorithms. Metallurgical, mechanical and other joint properties will be assessed through customary methods.
[0040] As described above, the system can use deep-learning algorithms for weld defect detection. The challenges for weld defect detection include diverse data types, lack of accurate labels for historic data at customer site, and real-time defect prediction and customization at the customer-site through online learning.
[0041] Disclosed embodiments can use machine learning techniques such as fuzzy classification and clustering, support vector machines, k nearest neighbors, principal component analysis, and artificial neural networks. Not all defects may use the same set of features. Disclosed embodiments can implement a semi-supervised deep-learning approach which can leverage the unlabeled data.
[0042] Simulation data for factors such as robot path, part parameters, weld parameters and part movement can be used by the system in a semi-supervised learning process using autoencoders (context or variational) to predict future defects and defect type. The defects predicted can be processed by the root cause module to pre-emptively stop the defect from occurring. Then at real-time, the data from camera, ultrasound, temperature profile, and process parameters can be collected and sent to convolutional neural networks as illustrated in Figure 2 for predicting the run-time defects. The defects predicted at this stage is also sent to the root cause analysis tool to determine the root causes. The run-time defects are also fed back into the initial prediction as training data for improving the prediction network. Once the root causes are identified, are used for corrective action. The unlabeled data at the customer site can be used in a semi- supervised fashion for additional learning. The unlabeled data used for training can be fed into the network until a stable defect prediction is produced.
[0043] The system can use causal inference algorithms for root-cause analysis. Ignorance or misidentifi cation of the defect’s root causes can lead to a repetition and proliferation of defects. Current root-cause analysis techniques for welding-defects use statistical techniques which focus on single root causes. In an industrial welding setup, the defects may occur due to the interaction between multiple causes, as opposed to a
single root cause. Counterfactual analysis inference models have been successfully used, for example, in the fields of genetics, medicine, and social science. The major benefits for these models includes their ability to distinguish factors that truly cause the defect from the factors that only correlate with it (the correlation might be, for example, due to common causes, also known as confounders).
[0044] In order to distinguish the causation from the correlation, disclosed embodiment can use causal graphical models and counterfactual reasoning. As opposed to purely statistical methods, which are based on probabilistic dependence between variables, causal inference methods introduce additional assumptions that allow them to look directly for causal relationships in data.
[0045] Using the data available through the simulations discussed above and causal graphical model learning algorithms, the system can create a causal graph that identifies causal relationships between the variables of interest. An instantiated causal graph enables the system to find the set of nodes (variables) that constitute the root causes of the defects. Using counterfactual reasoning, the system can predict“what would happen if’ possibilities by changing the values of the predicted root-cause variables.
[0046] Disclosed embodiments generate corrective paths for the spot welding robot, and can use a closed loop control algorithm for the robot welding. A welding path is usually generated based on the part geometry and location of the welding spots to avoid collision with any obstacles. The end effector of the robot welding arm is then supposed to move from one spot to another following the path. However, in practice, due to manufacturing tolerances the real part geometry may deviate from the model that is used to calculate the welding path. The system can generate a corrected path that compensates for such differences.
[0047] The system can use a close loop control algorithm to monitor the actual welding location and compared it with the predicted location on the pre-calculated tool path. The difference is then recorded and analyzed to calibrate the welding path, so that the error between the actual location and predicted location is minimized. This calibration process
is done in real time, so as the welding proceeds and more data is collected, the more accurate the calibrated path becomes.
[0048] Disclosed embodiments improve on other systems in a number of ways, including improving weld time, cost per unit, and the quality of weld.
[0049] Figure 3 illustrates a flowchart of a process in accordance with disclosed embodiments that may be performed, for example, by a system as disclosed herein (referred to below as the“weld analysis system”).
[0050] The weld analysis system simulates a welding operation (302). The simulation can use one or more of a robotic path, part parameters, weld parameters, and part movements.
[0051] The weld analysis system analyzes a physical weld corresponding to the simulated welding operation (304). The analysis can include one or more of analyzing camera images, ultrasound images, sensor inputs from any of the various sensors described herein, and weld parameters.
[0052] The weld analysis system detects and predicts welding defects based on the simulated welding operation and the analysis of the physical weld (306). This can be performed by building one or more deep neural networks from the results of the simulated welding operation, such as features and other outputs, and the results of the physical weld analysis, such as the camera images, ultrasound images, sensor inputs from any of the various sensors described herein, weld parameters, or any other outputs.
[0053] The weld analysis system performs a root cause analysis, based on the detected and predicted welding defects, to identify at least one root cause of the welding defects (308). This can include building causal graphical models to evaluate the root cause, and can be performed using predicted defects based on the simulated welding operation and unpredicted, detected defects from the physical weld analysis. Further, the results of the root cause analysis can be fee back to the defect prediction and detection process, in particular to further train the deep neural network(s).
[0054] The weld analysis system produces a corrective action based on the identified root cause(s) to remove the welding defects from subsequent physical welds (310). The corrective action can include, for example, corrected motion paths for robotic welders, defining corrected welding parameters, or others. Producing the corrective action can include performing path planning simulations to identify and test corrective actions.
[0055] The weld analysis system can thereafter perform physical welding operations according to the corrective action(s) (312).
[0056] Figure 4 illustrates a block diagram of a data processing system in which an embodiment can be implemented, for example as part of a weld analysis system particularly configured by software or otherwise to perform the processes as described herein, and in particular as each one of a plurality of interconnected and communicating systems as described herein. The data processing system depicted includes a processor 402 connected to a level two cache/bridge 404, which is connected in turn to a local system bus 406. Local system bus 406 may be, for example, a peripheral component interconnect (PCI) architecture bus. Also connected to local system bus in the depicted example are a main memory 408 and a graphics adapter 410. The graphics adapter 410 may be connected to display 411.
[0057] Other peripherals, such as local area network (LAN) / Wide Area Network / Wireless ( e.g . WiFi) adapter 412, may also be connected to local system bus 406. Expansion bus interface 414 connects local system bus 406 to input/output (I/O) bus 416. I/O bus 416 is connected to keyboard/mouse adapter 418, disk controller 420, and I/O adapter 422. Disk controller 420 can be connected to a storage 426, which can be any suitable machine usable or machine readable storage medium, including but not limited to nonvolatile, hard-coded type mediums such as read only memories (ROMs) or erasable, electrically programmable read only memories (EEPROMs), magnetic tape storage, and user-recordable type mediums such as floppy disks, hard disk drives and compact disk read only memories (CD-ROMs) or digital versatile disks (DVDs), and other known optical, electrical, or magnetic storage devices.
[0058] Also connected to I/O bus 416 in the example shown is audio adapter 424, to which speakers (not shown) may be connected for playing sounds. Keyboard/mouse adapter 418 provides a connection for a pointing device (not shown), such as a mouse, trackball, trackpointer, touchscreen, etc. I/O adapter 422 can be connected to communicate with or control welding equipment 428, which can include welding robots, imagers, cameras, temperature sensors, ultrasound equipment, voltage sensors, current sensors, resistance sensors
[0059] Those of ordinary skill in the art will appreciate that the hardware depicted in Figure 4 may vary for particular implementations. For example, other peripheral devices, such as an optical disk drive and the like, also may be used in addition or in place of the hardware depicted. The depicted example is provided for the purpose of explanation only and is not meant to imply architectural limitations with respect to the present disclosure.
[0060] A data processing system in accordance with an embodiment of the present disclosure includes an operating system employing a graphical user interface. The operating system permits multiple display windows to be presented in the graphical user interface simultaneously, with each display window providing an interface to a different application or to a different instance of the same application. A cursor in the graphical user interface may be manipulated by a user through the pointing device. The position of the cursor may be changed and/or an event, such as clicking a mouse button, generated to actuate a desired response.
[0061] One of various commercial operating systems, such as a version of Microsoft Windows™, a product of Microsoft Corporation located in Redmond, Wash may be employed if suitably modified. The operating system is modified or created in accordance with the present disclosure as described.
[0062] LAN/ WAN/Wireless adapter 412 can be connected to a network 430 (not a part of data processing system 400), which can be any public or private data processing system network or combination of networks, as known to those of skill in the art, including the Internet. Data processing system 400 can communicate over network 430
with server system 440, which is also not part of data processing system 400, but can be implemented, for example, as a separate data processing system 400.
[0063] Of course, those of skill in the art will recognize that, unless specifically indicated or required by the sequence of operations, certain steps in the processes described above may be omitted, performed concurrently or sequentially, or performed in a different order.
[0064] Those skilled in the art will recognize that, for simplicity and clarity, the full structure and operation of all data processing systems suitable for use with the present disclosure is not being depicted or described herein. Instead, only so much of a data processing system as is unique to the present disclosure or necessary for an understanding of the present disclosure is depicted and described. The remainder of the construction and operation of data processing system 100 may conform to any of the various current implementations and practices known in the art.
[0065] It is important to note that while the disclosure includes a description in the context of a fully functional system, those skilled in the art will appreciate that at least portions of the mechanism of the present disclosure are capable of being distributed in the form of instructions contained within a machine-usable, computer-usable, or computer- readable medium in any of a variety of forms, and that the present disclosure applies equally regardless of the particular type of instruction or signal bearing medium or storage medium utilized to actually carry out the distribution. Examples of machine usable/readable or computer usable/readable mediums include: nonvolatile, hard-coded type mediums such as read only memories (ROMs) or erasable, electrically programmable read only memories (EEPROMs), and user-recordable type mediums such as floppy disks, hard disk drives and compact disk read only memories (CD-ROMs) or digital versatile disks (DVDs).
[0066] Although an exemplary embodiment of the present disclosure has been described in detail, those skilled in the art will understand that various changes, substitutions, variations, and improvements disclosed herein may be made without departing from the spirit and scope of the disclosure in its broadest form.
[0067] None of the description in the present application should be read as implying that any particular element, step, or function is an essential element which must be included in the claim scope: the scope of patented subject matter is defined only by the allowed claims. Moreover, none of these claims are intended to invoke 35 USC §112(f) unless the exact words "means for" are followed by a participle. The use of terms such as (but not limited to) “mechanism,” “module,” “device,” “unit,” “component,” “element,” “member,” “apparatus,” “machine,” “system,” “processor,” or“controller,” within a claim is understood and intended to refer to structures known to those skilled in the relevant art, as further modified or enhanced by the features of the claims themselves, and is not intended to invoke 35 U.S.C. §112(f).
Claims
1. A method (300) performed by a weld analysis system (400), comprising:
simulating (302) a welding operation (102) by the weld analysis system (400); analyzing (304) a physical weld (112) corresponding to the simulated welding operation, by the weld analysis system (400);
detecting and predicting (306) welding defects, by the weld analysis system (400), based on the simulated welding operation and the analysis of the physical weld;
performing a root cause analysis (124, 308), by the weld analysis system (400) and based on the detected and predicted welding defects, to identify at least one root cause of the welding defects; and
producing a corrective action (128, 310), by the weld analysis system (400), based on the identified at least one root cause to remove the welding defects from subsequent physical welds.
2. The method of claim 1, further comprising performing physical welding operations (312) according to the corrective action.
3. The method of any of claims 1-2, wherein the simulated welding operation (102) uses one or more of a robotic path, part parameters, weld parameters, and part movements.
4. The method of any of claims 1-3, wherein the analysis of the physical weld includes one or more of analyzing camera images (114), analyzing ultrasound images (114), analyzing sensor inputs (116), and analyzing weld parameters (116).
5. The method of any of claims 1-4, wherein detecting and predicting welding defects is performed by building one or more deep neural networks (120, 122) from results of the simulated welding operation and results of the physical weld analysis.
6. The method of any of claims 1-5, wherein the root cause analysis includes building causal graphical models (126) using predicted defects based on the simulated welding operation and unpredicted, detected defects from the physical weld analysis.
7. The method of any of claims 1-6, wherein the corrective action includes corrected motion paths for robotic welders.
8. A weld analysis system (400) comprising:
a processor (402); and
an accessible memory (408), the weld analysis system particularly configured to perform a process as in any of claims 1-7.
9. A non-transitory computer-readable medium (408, 426) storing executable instructions that, when executed, cause one or more weld analysis systems (400) to perform a process as in any of claims 1-7.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201762589589P | 2017-11-22 | 2017-11-22 | |
US62/589,589 | 2017-11-22 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2019103772A1 true WO2019103772A1 (en) | 2019-05-31 |
Family
ID=63579764
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2018/047022 WO2019103772A1 (en) | 2017-11-22 | 2018-08-20 | Detection and root cause analysis of welding defects |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2019103772A1 (en) |
Cited By (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112733406A (en) * | 2021-01-20 | 2021-04-30 | 昆山六丰机械工业有限公司 | Method for establishing friction stir welding structure defect prediction model by using finite element method |
EP3843006A1 (en) * | 2019-12-23 | 2021-06-30 | Fronius International GmbH | Device and system for classifying a weld seam |
FR3109325A1 (en) * | 2020-04-20 | 2021-10-22 | L'Air Liquide, Société Anonyme pour l'Etude et l'Exploitation des Procédés Georges Claude | Method and device for determining the performance of a welding process |
WO2021250986A1 (en) * | 2020-06-10 | 2021-12-16 | 日立造船株式会社 | Inspection device, inspection method, and inspection program |
CN114202224A (en) * | 2021-12-16 | 2022-03-18 | 蕴硕物联技术(上海)有限公司 | Method, apparatus, medium, and program product for detecting weld quality in a production environment |
CN114861498A (en) * | 2022-05-18 | 2022-08-05 | 上海交通大学 | On-line detection method of resistance spot welding quality based on multi-sensor timing signal mechanism model |
WO2022221142A1 (en) * | 2021-04-12 | 2022-10-20 | Newfrey Llc | Computer modeling for detection of discontinuities and remedial actions in joining systems |
WO2023015030A1 (en) * | 2021-08-06 | 2023-02-09 | Tessonics Corp. | Comprehensive real-time characterization of ultrasonic signatures from nondestructive evaluation of resistance spot welding process using artificial intelligence |
EP4155852A1 (en) * | 2021-09-22 | 2023-03-29 | Audi AG | Processor circuit and method for monitoring a joining process of workpieces in a joining machine and joining machine |
EP4070911A4 (en) * | 2019-12-06 | 2023-05-31 | Panasonic Intellectual Property Management Co., Ltd. | Repair welding device and repair welding method |
CN116228776A (en) * | 2023-05-10 | 2023-06-06 | 威海职业学院(威海市技术学院) | Method and system for identifying welding defects of electromechanical equipment |
DE102022200371A1 (en) | 2022-01-14 | 2023-07-20 | Robert Bosch Gesellschaft mit beschränkter Haftung | Process and diagnostic system for diagnosing faults in weld seams |
CN117983962A (en) * | 2024-04-03 | 2024-05-07 | 成都环龙智能机器人有限公司 | Working method of full-flow automatic welding intelligent workstation |
CN118501266A (en) * | 2024-05-10 | 2024-08-16 | 东南大学 | Underwater pier rapid detection method and system based on sonar camera and deep learning |
CN118635636A (en) * | 2024-06-06 | 2024-09-13 | 江苏辛艾络科技研发有限公司 | A servo drive system and method for spot welding robot with automatic path adjustment |
CN119457628A (en) * | 2025-01-07 | 2025-02-18 | 深圳中宝新材科技有限公司 | Gold bonding wire welding method and system based on artificial intelligence optimization |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120091185A1 (en) * | 2010-10-18 | 2012-04-19 | Georgia Tech Research Corporation | In-process weld geometry methods & systems |
US20170032281A1 (en) * | 2015-07-29 | 2017-02-02 | Illinois Tool Works Inc. | System and Method to Facilitate Welding Software as a Service |
-
2018
- 2018-08-20 WO PCT/US2018/047022 patent/WO2019103772A1/en active Application Filing
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120091185A1 (en) * | 2010-10-18 | 2012-04-19 | Georgia Tech Research Corporation | In-process weld geometry methods & systems |
US20170032281A1 (en) * | 2015-07-29 | 2017-02-02 | Illinois Tool Works Inc. | System and Method to Facilitate Welding Software as a Service |
Non-Patent Citations (2)
Title |
---|
"COMPUTER-GRAPHICAL SIMULATION OF ROBOTIC WELDING", NTIS TECH NOTES, US DEPARTMENT OF COMMERCE. SPRINGFIELD, VA, US, 1 July 1988 (1988-07-01), pages 588, XP000030170, ISSN: 0889-8464 * |
KARTHIKEYAN M ET AL: "Root cause analysis and reliability improvement methods for orbital TIG welding process for propulsion feed system of satellites", INTERNATIONAL JOURNAL OF SYSTEM ASSURANCE ENGINEERING AND MANAGEMENT, SPRINGER INDIA, INDIA, vol. 8, no. 2, 31 January 2017 (2017-01-31), pages 910 - 924, XP036364246, ISSN: 0975-6809, [retrieved on 20170131], DOI: 10.1007/S13198-016-0549-5 * |
Cited By (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP4070911A4 (en) * | 2019-12-06 | 2023-05-31 | Panasonic Intellectual Property Management Co., Ltd. | Repair welding device and repair welding method |
EP3843006A1 (en) * | 2019-12-23 | 2021-06-30 | Fronius International GmbH | Device and system for classifying a weld seam |
WO2021130238A1 (en) * | 2019-12-23 | 2021-07-01 | Fronius International Gmbh | Method and system for classifying a weld seam |
FR3109325A1 (en) * | 2020-04-20 | 2021-10-22 | L'Air Liquide, Société Anonyme pour l'Etude et l'Exploitation des Procédés Georges Claude | Method and device for determining the performance of a welding process |
WO2021213817A1 (en) | 2020-04-20 | 2021-10-28 | L'air Liquide Societe Anonyme Pour L'etude Et L'exploitation Des Procedes Georges Claude | Method, device and computer program for determining the performance of a welding method via digital processing of an image of the welded workpiece |
CN115397595A (en) * | 2020-04-20 | 2022-11-25 | 乔治洛德方法研究和开发液化空气有限公司 | Method, device and computer program for determining the performance of a welding method via digital processing of images of welding workpieces |
JP2021196205A (en) * | 2020-06-10 | 2021-12-27 | 日立造船株式会社 | Inspection device, inspection method, and inspection program |
JP7385529B2 (en) | 2020-06-10 | 2023-11-22 | 日立造船株式会社 | Inspection equipment, inspection methods, and inspection programs |
WO2021250986A1 (en) * | 2020-06-10 | 2021-12-16 | 日立造船株式会社 | Inspection device, inspection method, and inspection program |
CN112733406B (en) * | 2021-01-20 | 2024-11-15 | 昆山六丰机械工业有限公司 | Establishment of a prediction model for friction stir welding structure defects using finite element method |
CN112733406A (en) * | 2021-01-20 | 2021-04-30 | 昆山六丰机械工业有限公司 | Method for establishing friction stir welding structure defect prediction model by using finite element method |
US12118475B2 (en) | 2021-04-12 | 2024-10-15 | Newfrey Llc | Computer modeling for detection of discontinuities and remedial actions in fastening systems |
WO2022221142A1 (en) * | 2021-04-12 | 2022-10-20 | Newfrey Llc | Computer modeling for detection of discontinuities and remedial actions in joining systems |
WO2023015030A1 (en) * | 2021-08-06 | 2023-02-09 | Tessonics Corp. | Comprehensive real-time characterization of ultrasonic signatures from nondestructive evaluation of resistance spot welding process using artificial intelligence |
EP4155852A1 (en) * | 2021-09-22 | 2023-03-29 | Audi AG | Processor circuit and method for monitoring a joining process of workpieces in a joining machine and joining machine |
CN114202224A (en) * | 2021-12-16 | 2022-03-18 | 蕴硕物联技术(上海)有限公司 | Method, apparatus, medium, and program product for detecting weld quality in a production environment |
DE102022200371A1 (en) | 2022-01-14 | 2023-07-20 | Robert Bosch Gesellschaft mit beschränkter Haftung | Process and diagnostic system for diagnosing faults in weld seams |
CN114861498B (en) * | 2022-05-18 | 2022-11-18 | 上海交通大学 | Resistance spot welding quality on-line detection method fused with multi-sensing time sequence signal mechanism model |
CN114861498A (en) * | 2022-05-18 | 2022-08-05 | 上海交通大学 | On-line detection method of resistance spot welding quality based on multi-sensor timing signal mechanism model |
CN116228776A (en) * | 2023-05-10 | 2023-06-06 | 威海职业学院(威海市技术学院) | Method and system for identifying welding defects of electromechanical equipment |
CN117983962A (en) * | 2024-04-03 | 2024-05-07 | 成都环龙智能机器人有限公司 | Working method of full-flow automatic welding intelligent workstation |
CN117983962B (en) * | 2024-04-03 | 2024-07-02 | 成都环龙智能机器人有限公司 | Working method of full-flow automatic welding intelligent workstation |
CN118501266A (en) * | 2024-05-10 | 2024-08-16 | 东南大学 | Underwater pier rapid detection method and system based on sonar camera and deep learning |
CN118635636A (en) * | 2024-06-06 | 2024-09-13 | 江苏辛艾络科技研发有限公司 | A servo drive system and method for spot welding robot with automatic path adjustment |
CN119457628A (en) * | 2025-01-07 | 2025-02-18 | 深圳中宝新材科技有限公司 | Gold bonding wire welding method and system based on artificial intelligence optimization |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2019103772A1 (en) | Detection and root cause analysis of welding defects | |
EP4086029A1 (en) | Using analytics and algorithms to predict weld quality | |
Olleak et al. | Calibration and validation framework for selective laser melting process based on multi-fidelity models and limited experiment data | |
De Filippis et al. | ANN modelling to optimize manufacturing process | |
Kim et al. | A digital twin implementation architecture for wire+ arc additive manufacturing based on ISO 23247 | |
Qiao et al. | Advancing measurement science to assess monitoring, diagnostics, and prognostics for manufacturing robotics | |
CN117236054A (en) | A digital twin-based automotive welding fixture assembly method, system and medium | |
Thombansen et al. | Model-based self-optimization for manufacturing systems | |
Selvakumar et al. | Machining fixture layout optimisation using genetic algorithm and artificial neural network | |
Xie et al. | Part-by-part dimensional error compensation in compliant sheet metal assembly processes | |
Ramasubramanian et al. | Automatic simulation-based design and validation of robotic gripper fingers | |
Bondoc et al. | Live digital twin: Developing a sensor network to monitor the health of belt conveyor system | |
Carlson et al. | Non-nominal path planning for robust robotic assembly | |
Bondoc et al. | Employing LIVE digital twin in prognostic and health management: Identifying location of the sensors | |
Ayankoso et al. | A hybrid digital twin scheme for the condition monitoring of industrial collaborative robots | |
Simion et al. | Cloud/VPN-Based Remote Control of a Modular Production System Assisted by a Mobile Cyber–Physical Robotic System—Digital Twin Approach | |
Torkamani et al. | Systematical collision avoidance reliability analysis and characterization of reliable system operation for autonomous navigation using the dynamic window approach | |
Wang et al. | Applicable and generalizable machine learning for intelligent welding in automotive manufacturing | |
Tomasic et al. | Mixed-effect models for the analysis and optimization of sheet-metal assembly processes | |
Vieira et al. | Reliable redundancy resolution strategies for kinematically redundant parallel manipulators | |
JP2017148893A (en) | How to estimate processing time | |
Heddy et al. | Linear temporal logic (LTL) based monitoring of smart manufacturing systems | |
Zhang et al. | Research on status monitoring and positioning compensation system for digital twin of parallel robots | |
CN115885222A (en) | Machine controller and method for configuring and using a machine controller | |
Christiand et al. | Digital twin of micro-milling process for micro-tool wear |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 18769553 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 18769553 Country of ref document: EP Kind code of ref document: A1 |