Disclosure of Invention
The invention mainly aims to provide a method, a device, equipment and a storage medium for detecting a resin coating product, and aims to solve the technical problem of low coating efficiency caused by misplacing of the resin coating product in the prior art.
In order to achieve the above object, the present invention provides a resin-coated product inspection method applied to a resin-coated product inspection system including an image recognition module and a processing module connected in this order, the image recognition module being installed in a loading area of a resin-coated line body, the method being applied to the processing module, the method comprising the steps of:
acquiring image information of a current product in a loading area acquired by the image identification module;
Acquiring a characteristic area of the current product;
determining detection information by determining detection information based on the characteristic region and the image information;
And finishing the detection of the current product based on the detection information.
Optionally, the acquiring the characteristic area of the current product includes:
obtaining the product type of the current product;
inquiring product program code information, product color code information and product positioning point information corresponding to the product type from a preset characteristic area table based on the product type;
And taking the product program code information, the product color code information and the product positioning point information as characteristic areas of the current product.
Optionally, the determining detection information based on the characteristic region and the image information includes:
obtaining product positioning point information based on the characteristic region;
calculating the current product occupation area in a unit area in the image information based on the positioning point information;
and comparing the current product occupation area with a preset area threshold value to obtain detection information of the current product occupation area.
Optionally, the detecting the current product based on the detection information includes:
When the current product occupation area detection information is that the current product occupation area is larger than or equal to the preset area threshold value, confirming that the current product meets the area detection requirement;
and generating abnormal early warning information of the current product when the current product occupation area detection information is that the current product occupation area is smaller than the preset area threshold value.
Optionally, the determining detection information based on the characteristic region and the image information includes:
obtaining product program code information and product color code information based on the characteristic region;
obtaining the color of the current product according to the image information;
obtaining a preset product color based on the product program code information and the product color code information;
and comparing the current product color with the preset product color to obtain detection information of the current product color.
Optionally, the detecting the current product based on the detection information includes:
when the current product color detection information is that the current product color is consistent with the preset product color, confirming that the current product meets the color detection requirement;
and generating color misplacement early warning information when the current product color detection information is that the current product color is inconsistent with the preset product color.
Optionally, the acquiring the image information of the current product of the loading area acquired by the image recognition module includes:
Reading the RFID tag card to obtain current product information;
obtaining a current product model through the current product information;
Selecting a corresponding outline size value in the image recognition module according to the current product model;
And controlling the image recognition module to shoot the current product in the loading area based on the outline size value to obtain the image information of the current product in the loading area.
In addition, in order to achieve the above object, the present invention also provides a resin-coated product detection apparatus comprising:
The acquisition module is used for acquiring the image information of the current product in the loading area acquired by the image identification module;
the acquisition module is also used for acquiring the characteristic area of the current product;
A determining module for determining detection information by based on the characteristic region and the image information;
and the detection module is used for completing the detection of the current product based on the detection information.
In addition, in order to achieve the above object, the present invention also proposes a resin coated product inspection apparatus including a memory, a processor, and a resin coated product inspection program stored on the memory and operable on the processor, the resin coated product inspection program being configured to implement the steps of the resin coated product inspection method as described above.
In addition, in order to achieve the above object, the present invention also proposes a storage medium having stored thereon a resin coated product detection program which, when executed by a processor, implements the steps of the resin coated product detection method as described above.
The method is applied to a resin coating product detection system, the system comprises an image recognition module and a processing module which are sequentially connected, the image recognition module is installed in a loading area of a resin coating line body, the method is applied to the processing module, the method comprises the steps of obtaining image information of a current product in the loading area, collected by the image recognition module, of obtaining a characteristic area of the current product, determining detection information based on the characteristic area and the image information, and finishing detection of the current product based on the detection information, so that whether the product has a problem or not can be detected quickly and accurately, and the resin coating efficiency is improved.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
Referring to fig. 1, fig. 1 is a schematic structural diagram of a resin-coated product inspection apparatus in a hardware operating environment according to an embodiment of the present invention.
As shown in fig. 1, the resin coated product inspection apparatus may include a processor 1001 such as a central processing unit (Central Processing Unit, CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Wherein the communication bus 1002 is used to enable connected communication between these components. The user interface 1003 may include a Display, an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may further include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a Wireless interface (e.g., a Wireless-Fidelity (Wi-Fi) interface). The Memory 1005 may be a high-speed random access Memory (Random Access Memory, RAM) or a stable nonvolatile Memory (NVM), such as a disk Memory. The memory 1005 may also optionally be a storage device separate from the processor 1001 described above.
It will be appreciated by those skilled in the art that the structure shown in fig. 1 does not constitute a limitation of the resin coated product inspection apparatus, and may include more or fewer components than shown, or certain components may be combined, or a different arrangement of components.
As shown in fig. 1, an operating system, a network communication module, a user interface module, and a resin-coated product detection program may be included in the memory 1005 as one type of storage medium.
In the resin coated product inspection apparatus shown in fig. 1, the network interface 1004 is mainly used for data communication with a network server, the user interface 1003 is mainly used for data interaction with a user, and the processor 1001 and the memory 1005 in the resin coated product inspection apparatus of the present invention may be provided in the resin coated product inspection apparatus, which invokes the resin coated product inspection program stored in the memory 1005 through the processor 1001 and executes the resin coated product inspection method provided in the embodiment of the present invention.
An embodiment of the invention provides a method for detecting a resin coated product, referring to fig. 2, fig. 2 is a schematic flow chart of a first embodiment of the method for detecting a resin coated product according to the invention.
In this embodiment, the method for detecting a resin-coated product is applied to a resin-coated product detection system, the system includes an image recognition module and a processing module that are sequentially connected, the image recognition module is mounted on a loading area of a resin-coated line body, and the method is applied to the processing module.
It should be noted that, the line body for detecting the resin coating product has the characteristics of multiple products, complex workpiece combination form and the like, and has a certain probability that the error part is caused to be inconsistent with the track of the robot and collide with the track of the robot, so the embodiment provides the resin coating product detection system, which comprises an image recognition module and a processing module, wherein the image recognition module is added to grasp the characteristic outline of the product to recognize the product, compare the product with the standard product information, and the processing module is used for solving the unique problem of the coating line, and adopts a method of selecting key points in the modeling and connecting signals through a PLC (programmable logic controller) to implement the method, so that the system is more consistent with the operation logic of the coating line.
The image recognition module is installed in the upper part area of the resin coating line body, and the image recognition module comprises 2 camera assemblies which are symmetrically arranged and shoot images of the left side and the right side of a product in the upper part area, so that a complete product actual image is obtained, and the camera assemblies can be 3D cameras, such as a 3D light field camera, a 3D structured light camera, 2D cameras, such as a 2D line scan camera and the like, and can be 2D+3D combined cameras, and the embodiment is not limited to this.
The processing module can be a PLC (Programmable Logic Controller ), and is connected with the image recognition module, and can process the image information obtained by the image recognition module, so that the color, shape, area and other information of the product can be recognized, and a specific detection result can be obtained. Through combining PLC and visual detection's function, carry out the detection of full aspect to the product, improve and detect the accuracy.
The method for detecting the resin-coated product comprises the following steps:
And S10, acquiring image information of the current product in the loading area acquired by the image identification module.
The main execution body of the embodiment may be a processing module, and the detection of the resin-coated product may be implemented by the processing module, or may be another module or device that may implement the same or similar functions, which is not limited in this embodiment, and the processing module is taken as an example in this embodiment.
In a specific implementation, the image recognition module is located in the loading area, so that image information of a current product in the loading area is shot.
The image recognition module is used for acquiring images of products, wherein the images are different in size corresponding to different product models, and the image recognition module needs to adapt to size shooting of different products, so that a complete product image is obtained, and therefore, the step of acquiring the image information of the current product in the loading area acquired by the image recognition module comprises the following steps:
Reading the RFID tag card to obtain current product information;
obtaining a current product model through the current product information;
Selecting a corresponding outline size value in the image recognition module according to the current product model;
And controlling the image recognition module to shoot the current product in the loading area based on the outline size value to obtain the image information of the current product in the loading area.
It should be understood that the RFID tag card stores information of each product, so that the readable/writable trolley RFID tag card obtains product information (along the robot profile path) to obtain current product information.
The product information stored in the RFID tag card is standard product information, including product model and product color.
In a specific implementation, the current product model can be obtained through the current product information, and the sizes of products corresponding to different product models are different, so that the photographable outline size value can be determined through the current product model, and the corresponding outline size value is called in the image recognition module.
It can be understood that the image recognition module can be controlled to shoot the current product in the loading area through the outline size value, so that the complete information of the current product can be acquired, and the image information of the current product can be obtained. The camera can recognize the area ratio of the material color and the blank area, thereby detecting the product.
The image information of the current product may include one or more of size information, shape information, area information, and color information of the current product.
Step S20, acquiring a characteristic area of the current product;
it should be noted that the characteristic area of the current product may be determined according to the types of different products, and the characteristic areas of the different types of products are not the same.
The characteristic region may include a product anchor point location, product signal information, etc., and may also include other data, as the embodiment is not limited in this regard.
And step S30, determining detection information based on the characteristic region and the image information.
In implementations, specific detection information for a product may be determined from a characteristic region of the current product and image information.
For example, the detection information of the occupied area of the product may be determined by calculating the location of the anchor point in the feature area with the data in the image information, and the detection information of the color feature of the product may be determined by comparing the color information of the product signal in the feature area with the color information in the image information.
The detection information may include color detection information of the product, area detection information of the product, size detection information of the product, and the like, which is not limited in this embodiment.
And step S40, finishing the detection of the current product based on the detection information.
In a specific implementation, the detection information can be used for determining whether the current product meets the resin coating requirement, so that further processing can be performed.
As shown in fig. 3, fig. 3 is a schematic overall flow chart of the present embodiment, after a material rack loaded with a detected product is in place, an RFID tag may be read by a code reader to obtain a workpiece model, and the model is sent to a vision industrial personal computer (image recognition module), after the vision industrial personal computer receives the workpiece model, the detected outline size value is adjusted, so as to collect the current product, and obtain the image information of the current product, a processing module detects according to the image information, so as to determine whether the size of a positioning point is NG, whether the color is NG, if the size is NG, a size NG signal is sent to a PLC of a production line, so as to indicate that the material or the jig is deformed, if the color is NG, a color NG signal is sent to the PLC of the production line, a color error alarm is performed, so that the PLC of the production line is stopped, a manual confirmation is performed, if the size and the color are not abnormal, an OK signal is sent to the PLC of the production line, and the PLC of the production line is controlled to release the current product.
The method is applied to a resin coating product detection system, the system comprises an image recognition module and a processing module which are sequentially connected, the image recognition module is installed in a loading area of a resin coating line body, the method is applied to the processing module, the method comprises the steps of obtaining image information of a current product in the loading area, collected by the image recognition module, of obtaining a characteristic area of the current product, determining detection information based on the characteristic area and the image information, and finishing detection of the current product based on the detection information, so that whether the product has a problem or not can be detected quickly and accurately, and the resin coating efficiency is improved.
Referring to fig. 4, fig. 4 is a flowchart illustrating a second embodiment of the method for inspecting a resin-coated product according to the present invention.
Based on the first embodiment, the step S20 of the method for detecting a resin coated product according to the present embodiment includes:
step S201, obtaining the product type of the current product.
It should be noted that, the product type of the current product may be obtained through the product information, for example, the product type is a type such as H56 front-guard, H56 back-guard, H97 front-back guard, H97 back-guard, etc.
And S202, inquiring product program code information, product color code information and product positioning point information corresponding to the product type from a preset characteristic area table based on the product type.
As shown in table 1, table 1 is a preset characteristic area table, which includes product model and positioning point information corresponding to product types, and further includes information that the product meets the requirements.
TABLE 1
In a specific implementation, product program code information, product color code information and product positioning point information corresponding to the product type can be queried from a preset characteristic area table through the product type.
For example, if the product type is H56 front-end, the product program code information corresponding to the H56 front-end is 20, and specific product color code information can be determined, and the product anchor point information is 6 anchor points.
And step S203, taking the product program code information, the product color code information and the product positioning point information as characteristic areas of the current product.
It should be noted that the product program code information, the product color code information, and the product anchor point information may be used as the characteristic area of the current product.
According to the embodiment, the product type of the current product is obtained, the product program code information, the product color code information and the product positioning point information corresponding to the product type are inquired from the preset characteristic area table based on the product type, the product program code information, the product color code information and the product positioning point information are used as characteristic areas of the current product, the corresponding product characteristic areas can be rapidly determined according to the product type, and therefore detected product information can be rapidly positioned, and the detection effect is improved.
Referring to fig. 5, fig. 5 is a flowchart illustrating a third embodiment of a method for inspecting a resin-coated product according to the present invention.
Based on the first embodiment, the step S30 of the method for detecting a resin coated product according to the present embodiment includes:
And step S301, obtaining product positioning point information based on the characteristic region.
It should be noted that, product positioning point information can be obtained through the characteristic area, specifically, corresponding data can be queried in the characteristic area through the product type, so that product positioning point information can be obtained.
And step S302, calculating the current product occupation area in the unit area in the image information based on the positioning point information.
In a specific implementation, the current product occupation area in a unit area can be calculated in the image information according to the positioning point information, specifically, the product occupation area in the unit area in the image information is read through each point, and the calculation method is that the consistent area proportion in the unit area is divided by the total measurement area in the square frame by 100%.
When the product type is H56, and the product locating point information is 6 locating points, the measuring point comprises two large faces, two color matching faces and two corner areas. When the product type is H56 and the product locating point information is 6 locating points, the measuring point comprises two large faces, two color matching faces and two corner areas. When the product type is H97 front and back, and the product positioning point information is 10 positioning points, the measuring point comprises four large faces, four color matching faces and two corner areas.
And step S303, comparing the current product occupation area with a preset area threshold value to obtain detection information of the current product occupation area.
In a specific implementation, the preset area threshold may be set to 0.8, and may also be other area thresholds, which is not limited in this embodiment, and this embodiment is illustrated by taking 0.8 as an example.
And comparing the occupied area of the current product with a preset area threshold value, so that whether the current product meets the coating requirement or not can be determined.
Optionally, the step of completing detection of the current product based on the detection information comprises the steps of confirming that the current product meets the area detection requirement when the current product occupation area detection information is that the current product occupation area is larger than or equal to the preset area threshold value, and generating current product abnormality early warning information when the current product occupation area detection information is that the current product occupation area is smaller than the preset area threshold value.
It should be noted that if the current product area detection information is that the current product area is greater than or equal to the preset area threshold, it is proved that the current product meets the area detection requirement, and the rest items of the current product can be detected.
If the current product occupation area detection information is that the current product occupation area is smaller than the preset area threshold value, the current product is proved to be not in accordance with the set area detection requirement or the size of the current product is proved to be not in accordance with the set requirement, abnormal early warning information of the current product, namely area NG information or size NG information, can be generated and sent to a PLC of a production line, so that the PLC of the production line can control the line to stop, and the PLC can perform manual confirmation to determine specific defect information. And when all the set points meet the preset consistency, the set points can be released, and otherwise, interception is performed.
The embodiment obtains product positioning point information based on the characteristic region, calculates the current product occupation area in a unit area in the image information based on the positioning point information, compares the current product occupation area with a preset area threshold value to obtain detection information of the current product occupation area, and can quickly determine whether the current product meets the size or area requirement according to the product positioning point information, so that the error of a coating line or the deformation of a product jig can be comprehensively detected.
Referring to fig. 6, fig. 6 is a flowchart illustrating a fourth embodiment of a method for inspecting a resin-coated product according to the present invention.
Based on the first embodiment, the step S30 of the method for detecting a resin coated product according to the present embodiment includes:
And step S301', obtaining product program code information and product color code information based on the characteristic area.
The product program code information and the product color code information can be obtained through the characteristic region. Specifically, the corresponding product program code and product color code information in the characteristic area of the product can be obtained through the product type, for example, if the product type is H97 and then the product is kept, the product program code information is the program code 12, and the specific product color code can be obtained.
And step S302', the current product color is obtained according to the image information.
In a specific implementation, the color of the current product can be obtained through the collected image information of the current product, and the color of the current product is the color displayed by the current product under detection.
And step S303', obtaining a preset product color based on the product program code information and the product color code information.
It should be noted that, the preset product color can be obtained through the product program code information and the product color code information, and the preset product color is the color required to be presented by the current product or the standard color of the current product.
And step S304', comparing the current product color with the preset product color to obtain detection information of the current product color.
In a specific implementation, the current product color can be compared with a preset product color, so that whether the current product color meets the requirement or not can be determined. The detection information of the current product color can be that the current product color is consistent with the preset product color, or can be that the current product color is inconsistent with the preset product color.
Optionally, when the detection information is the current product color detection, the step of completing the current product detection based on the detection information comprises confirming that the current product meets the color detection requirement when the current product color detection information is that the current product color is consistent with the preset product color, and generating color misplacement early warning information when the current product color detection information is that the current product color is inconsistent with the preset product color.
It should be understood that the current product color is compared with the preset product color, so that current product color detection information is obtained, when the current product color detection information is that the current product color is consistent with the preset product color, the current product color is indicated to meet the set color requirement, if the color and the area detection of the product are both met, an OK signal is sent to the PLC of the production line, the PLC of the production line controls the current product to be released, and the detection of the next product is continued. If the current product color detection information indicates that the current product color is inconsistent with the preset product color, the current product color is not consistent with the set color requirement, and a color NG signal is sent to the PLC of the production line, so that the PLC of the production line is controlled to stop the line, abnormal conditions are further checked manually, an alarm on color mistakes is realized, and the abnormal color is ensured to be incapable of being reversely sprayed.
The embodiment obtains product program code information and product color code information based on the characteristic region, obtains the current product color according to the image information, obtains the preset product color based on the product program code information and the product color code information, compares the current product color with the preset product color to obtain detection information of the current product color, and determines whether the current product meets color requirements according to the product program code information and the product color code information in the characteristic region, so that color different color back spraying of a coating line is accurately detected.
Referring to fig. 7, fig. 7 is a block diagram showing the structure of a first embodiment of a resin coated product inspection apparatus according to the present invention.
As shown in fig. 7, a resin-coated product inspection apparatus according to an embodiment of the present invention includes:
The acquiring module 10 is configured to acquire image information of a current product in the loading area acquired by the image identifying module.
The obtaining module 10 is further configured to obtain a characteristic area of the current product.
A determining module 20 for determining detection information by based on the characteristic region and the image information.
And the detection module 30 is used for completing the detection of the current product based on the detection information.
According to the embodiment, whether the product has a problem or not can be detected rapidly and accurately by acquiring the image information of the current product in the loading area acquired by the image recognition module, acquiring the characteristic area of the current product, determining detection information based on the characteristic area and the image information, and detecting whether the product has the problem or not based on the detection information.
In an embodiment, the obtaining module 10 is further configured to obtain a product type of the current product, query product program code information, product color code information and product anchor point information corresponding to the product type from a preset characteristic area table based on the product type, and take the product program code information, the product color code information and the product anchor point information as characteristic areas of the current product.
In an embodiment, the determining module 20 is further configured to obtain product positioning point information based on the characteristic region, calculate a current product occupation area in a unit area based on the positioning point information in the image information, and compare the current product occupation area with a preset area threshold value to obtain detection information of the current product occupation area.
In an embodiment, the determining module 20 is further configured to confirm that the current product meets an area detection requirement when the current product area detection information is that the current product area is greater than or equal to the preset area threshold, and generate current product abnormality pre-warning information when the current product area detection information is that the current product area is less than the preset area threshold.
In an embodiment, the determining module 20 is further configured to obtain product program code information and product color code information based on the characteristic region, obtain a current product color according to the image information, obtain a preset product color based on the product program code information and the product color code information, and compare the current product color with the preset product color to obtain detection information of the current product color.
In an embodiment, the determining module 20 is further configured to confirm that the current product meets a color detection requirement when the current product color detection information is that the current product color is consistent with the preset product color, and generate color misplacement warning information when the current product color detection information is that the current product color is inconsistent with the preset product color.
In an embodiment, the obtaining module 10 is further configured to read an RFID tag card to obtain current product information, obtain a current product model according to the current product information, select a corresponding outline size value in the image recognition module according to the current product model, and control the image recognition module to shoot the current product in the loading area based on the outline size value to obtain image information of the current product in the loading area.
In addition, the embodiment of the present invention also proposes a storage medium having stored thereon a resin-coated product detection program which, when executed by a processor, implements the steps of the resin-coated product detection method as described above.
Because the storage medium adopts all the technical schemes of all the embodiments, the storage medium has at least all the beneficial effects brought by the technical schemes of the embodiments, and the description is omitted here.
It should be understood that the foregoing is illustrative only and is not limiting, and that in specific applications, those skilled in the art may set the invention as desired, and the invention is not limited thereto.
It should be noted that the above-described working procedure is merely illustrative, and does not limit the scope of the present invention, and in practical application, a person skilled in the art may select part or all of them according to actual needs to achieve the purpose of the embodiment, which is not limited herein.
In addition, technical details not described in detail in this embodiment may be referred to the method for detecting a resin coated product provided in any embodiment of the present invention, and will not be described herein.
Furthermore, it should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. Read Only Memory)/RAM, magnetic disk, optical disk) and including several instructions for causing a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the method according to the embodiments of the present invention.
The foregoing description is only of the preferred embodiments of the present invention, and is not intended to limit the scope of the invention, but rather is intended to cover any equivalents of the structures or equivalent processes disclosed herein or in the alternative, which may be employed directly or indirectly in other related arts.