On-line measuring device and detection method based on multimodal registration
Technical field
The invention belongs to a kind of on-line measuring device and detection method, and in particular to a kind of based on the online of multimodal registration
Detection means and detection method.
Background technology
During modern industrial and agricultural production, online measuring technique is in production, quality restriction and quality control etc.
Field is widely used, and is increasingly becoming one of basic technology of modern industry.In such applications, by various
Some feature of product component carries out registering identification, the defects of to realize product, cut, spot and shape, the inspection of installation site
Survey, and then eliminate or reduce defect ware.Comparatively, this is a kind of traditional image matching method, it is necessary to detecting target
The information such as gradation of image carry out more strict processing, and by a series of optimization processing of vision algorithms, can be only achieved satisfaction
Accuracy of identification requirement.
But inevitably, there is phenomena such as various tension fluctuations, noise jamming in most production line, actually obtain
The problems such as more or less stretcher strain that different situations all be present of the detection target image got, background complexity.With online
The complication of application scenario and the continuous improvement to testing requirements are detected, is difficult to description detection scene by single characteristic information
In full detail, and traditional on-line detecting system carries out detection identification using single characteristics of image pattern, specific
Under the conditions of light source etc., a characteristic information of detection target can only be obtained every time, and is often used as detection identification after final process
This feature information of matching does not simultaneously meet expected requirement.
Meanwhile the uncertainty at scene is detected to the operational efficiency of on-line detecting system, hardware cost, algorithm complex band
Many difficulties are carried out, among being in the occasion of change due to conditions such as detection target location, light sources, many times using single
Feature carry out recognition detection target, be extremely difficult to preferable effect.
At many scenes for needing on-line checking, many times need to detect multiple features of product, such as produce
The surface condition of engineering goods, internal structure damage, installation site etc. are detected on line, now matched somebody with somebody using single pattern
Its efficiency of quasi- method and the degree of accuracy are obviously difficult to meet to require, are the on-line checking for quickly and accurately realizing detection target,
It is necessary to design a kind of simple, reliable, low cost technical solution.
The content of the invention
The present invention proposes that the purpose is to provide one kind to be based on multimode in order to overcome shortcoming present in prior art
The on-line measuring device and detection method of formula registration.
The technical scheme is that:
A kind of on-line measuring device based on multimodal registration, the detection means includes mechanically supported platform, intelligence is shone
Bright assembly, pattern registration unit, manual intervention unit, interaction data communication bus and CPU;Pattern registration unit
It is installed on successively from top to bottom with intelligent lighting assembly above mechanically supported platform;It is single that manual intervention unit is installed on pattern registration
The right side of member, pattern registration unit are made up of multiple pattern registration subelements, each pattern registration subelement and manual intervention list
Member is connected with CPU respectively by interaction data communication bus.
The pattern registration subelement by camera lens, sensor, drive circuit, STM32 processor groups into;Drive circuit is by believing
Number acquisition module and high-speed pulse module composition, STM32 processors produce signal acquisition module and high-speed pulse module work institute
The time sequential pulse needed, high-speed pulse module produce the high speed time series pulse signals needed for working sensor, and signal acquisition module is adopted
Collect the signal of sensor, and signal is transmitted into the processing of STM32 processors.
The intelligent lighting assembly is made up of multiple lighting sources and light source communication module, and each lighting source is with detection mesh
The target direction of motion is installed successively, and each lighting source subelement registering with each pattern is corresponded and set, each illumination
Light source is formed by lamp body, multiple light emitting sources, optics auxiliary accessories and multiple drive control modules, and lamp body is oppositely arranged by two
Arc composition, light emitting source is distributed in lamp body inner periphery, and optics auxiliary accessories are installed on below lamp body, each light emitting source with it is each
Individual drive control module is connected one to one, and each drive control module is connected with light source communication module, light source communication module
It is connected with CPU.
The CPU is by FPGA, DSP, SDRAM and data memory cell group into FPGA connection interaction datas
Communication bus, connected between FPGA and DSP, DSP connects with data storage cell, and DSP connects with SDRAM.
A kind of online test method based on multimodal registration, comprises the following steps:
(ⅰ)Initialization
According to the testing requirements of detection target, sample is detected using artificial collect, suitable registration pattern is primarily determined that and matches somebody with somebody
Quasi-regular;
(ⅱ)Quasi-regular is matched somebody with somebody in optimization
Set comprehensive expert to match somebody with somebody quasi-regular, with reference to field working conditions, determine each pattern registration in pattern registration unit successively
Subelement is matched somebody with somebody quasi-regular and optimized, in the data storage cell with quasi-regular input CPU after optimization;
(ⅲ)Pattern registration unit configures
According to step(ⅱ)In rule and detection target specific testing requirements, to each pattern in pattern registration unit
Registering subelement is configured, and includes the selection of sensor and camera lens;
(ⅳ)Lighting source configures
With reference to step(ⅲ)The selection of middle respective sensor and camera lens, from suitable illumination sources, pass through central processing list
Member is controlled to each lighting source in intelligent lighting assembly, according to pattern registration subelement corresponding to each lighting source,
Configure suitable light level scheme;
(ⅴ)Start registration procedure
CPU being issued to each pattern registration subelement with quasi-regular by interaction data communication bus
The pattern registration subelement, when detection target is successively by i-th of pattern registration subelement, i-th i pattern registration subelement
During the subelements such as 2 ... n-th pattern registration subelement, associative mode registration subelement brings into operation;
(ⅵ)Registration result judges
Registration result is delivered to CPU, centre by each pattern registration subelement respectively in pattern registration unit
Reason unit carries out integrating calculation process to each registration result;
(ⅶ)Change Expert Rules
If inconsistent with the expected detection target of setting, comprehensive expert is directly changed by manual intervention and matches somebody with somebody quasi-regular,
Restart step(ⅰ)Perform detection, until testing result meets expection;
(ⅷ)Terminate
If being consistent with the expected detection target of setting, this detection terminates.
The beneficial effects of the invention are as follows:
The present invention realizes multiple pattern registration units in a detecting system, can realize simultaneously to detection target
Multiple characteristic informations carry out registering analysis;The final output result of detecting system carries out comprehensive analysis through all registration unit results
Drawn after processing, at the same in detection process manual intervention unit real-time participation, have modified because field working conditions complicated band come inspection
Dendrometry is imitated or mistake, is advantageous to the intelligent perfect of Expert Rules;On-line checking based on multimodal registration realizes multiple spies
The classification of reference breath, collect and integrate, help to realize the sample classification statistics of detection sample, realize efficient, accurately online
Detection identification, improve the automated production level of the entire production line;The result of multiple characteristic information registrations is combined, is effectively realized
The compression of multicharacteristic information, reduce redundancy feature information, mitigate the pressure of hardware system processing feature information, improve and be
System accuracy of detection;The result for combining multimodal registration information provides effectively for the analysis and decision that production line automation controls
Support.
Brief description of the drawings
Fig. 1 is the structural representation of the on-line measuring device of the invention based on multimodal registration;
Fig. 2 is the structural representation of pattern registration unit in the present invention;
Fig. 3 is the structural representation of pattern registration subelement in the present invention;
Fig. 4 is the structural representation of the lighting source of intelligent lighting assembly in the present invention;
Fig. 5 is the structural representation of CPU in the present invention;
Fig. 6 is the flow chart of the online test method of the invention based on multimodal registration.
Wherein:
1 mechanically supported platform 2 detects target
The pattern registration unit of 3 intelligent lighting assembly 4
The interaction data communication bus of 5 manual intervention unit 6
The pattern registration subelement of 7 CPU 8
The drive circuit of 9 STM32 processors 10
The camera lens of 11 sensor 12
The high-speed pulse module of 13 signal acquisition module 14
The lamp body of 15 optics auxiliary accessories 16
The drive control module of 17 light emitting source 18
The FPGA of 19 light source communication module 20
The data storage cells of 21 DSP 22
23 SDRAM。
Embodiment
With reference to Figure of description and embodiment to on-line measuring device of the present invention based on multimodal registration and detection
Method is described in detail:
As shown in figure 1, a kind of on-line measuring device based on multimodal registration, including mechanically supported platform 1, intelligent lighting
Assembly 3, pattern registration unit 4, manual intervention unit 5, interaction data communication bus 6 and CPU 7;Pattern registration is single
Member 4 and intelligent lighting assembly 3 are installed on the top of mechanically supported platform 1 successively from top to bottom;Manual intervention unit 5 is installed on pattern
The right side of registration unit 4, pattern registration unit 4 are made up of multiple pattern registration subelements 8, each He of pattern registration subelement 8
Manual intervention unit 5 is connected with CPU 7 respectively by interaction data communication bus 6.
As shown in Figure 2,3, the pattern registration subelement 8 is by camera lens 12, sensor 11, drive circuit 10, STM32 processing
Device 9 forms;Drive circuit 10 realizes the driving and control to sensor 11, and it is by signal acquisition module 13 and high-speed pulse mould
Block 14 forms, and produces signal acquisition module 13 by STM32 processors 9 and high-speed pulse module 14 works required time sequential pulse.
High-speed pulse module 14 is responsible for producing the high speed time series pulse signals that sensor 11 works required, and signal acquisition module 13 is mainly born
The collection of the signal of sensor 11 is blamed, the signal collected is ultimately delivered to STM32 processors 9 and handled.According to detection target
2 difference, the sensor 11 in each pattern registration subelement 8 can select Visible-light CCD, infrared CCD etc. different types of
Sensor, and the pattern registration subelement 8 that can configure repetition as needed repeats the purpose of detection with realization.Each pattern is matched somebody with somebody
Camera lens 12, drive circuit 10 in quasi- subelement 8 is different and specific all in accordance with the sensor 11 in the pattern registration subelement 8
Designed with alignment request.STM32 processors 9 be responsible for the execution of the registration action of pattern registration subelement 8 and with CPU 7
Real-time, interactive is carried out, STM32F103 Series MCU of the STM32 processors 9 from ST companies in the present embodiment.
The manual intervention unit 5 is made up of input equipments such as keyboard or touch-screens, to directly input intervention rule, its
Last right side of pattern registration subelement 8 of pattern registration unit 4 is installed on, when all pattern registration subelements 8 fail
Export effective detection result or testing result is undesirable, intervened by manual intervention unit 5 according to actual conditions, there is provided be artificial
Court verdict.Manual intervention unit 5 formed with quasi-regular can be with real-time update to Expert Rules among.
As shown in figure 4, the intelligent lighting assembly 3 is made up of multiple lighting sources and light source communication module 19, Ge Gezhao
Mingguang City source is with the direction of motion for detecting target 2(As shown by the arrows in Figure 1)Install successively, and each lighting source and each pattern
Registering subelement 8, which corresponds, to be set, and each lighting source is by lamp body 16, multiple light emitting sources 17, the and of optics auxiliary accessories 15
Multiple drive control modules 18 are formed, and lamp body 16 is made up of two arcs being oppositely arranged, and light emitting source 17 is distributed in lamp body 16
Inner periphery, optics auxiliary accessories 15 are installed on the lower section of lamp body 16, a pair of each light emitting source 17 and each drive control module 18 1
It should connect, each drive control module 18 is connected with light source communication module 19, light source communication module 19 and CPU 7
Connection.Each lighting source in intelligent lighting assembly 3 is all in accordance with each pattern registration subelement 8 in pattern registration unit 4
It is not all that the subelement provides different lighting sources, each lighting source can provide different illumination sides as needed
To, irradiating angle, light source colour and different light source light spectrums.As detection chip surface print character when, light source can be controlled
It is illuminated with low angle, so as to prominent character.In each lighting source drive control module 18 with light source communication module 19
Connect to receive light source configuration order.Lamp body 16 can need to be designed as vaulted or annular structure according to detection, light
Source 17 can select the light sources such as LED, infrared Halogen lamp LED, and drive control module 18 mainly realizes the driving and control of light source, rationally
The lighting quality that detecting system in the present invention can be effectively improved from optics auxiliary accessories 15, according to field working conditions and reality
The requirement optics auxiliary accessories 15 of detection can typically select optical element, the drive control modules 18 such as polarizer or diffusing panel negative
The drive control of light source is blamed, and CPU 6 can be realized to some independent lighting source by light source communication module 19
Real-time control.
As shown in figure 5, the CPU 7 is responsible for the coordination and control of whole detecting system, it passes through interaction number
Connected according to the subelement 8 registering with each pattern of pattern registration unit 4 of communication bus 6 and manual intervention unit 5, realize registration fortune
With the real-time, interactive of each registering sub-unit of data during row, it is realized single to each registering son by the connection with intelligent lighting assembly 3
The configuration of lighting source corresponding to member.CPU 6 is mainly by on-site programmable gate array FPGA(Field
Programmable Gate Array)20th, digital signal processor DSP (Digital Signal Processor) 21, same
Walk dynamic RAM SDRAM (Synchronous Dynamic Random Access Memory) 23 and data storage list
Member 22 forms.Wherein coprocessors of the FPGA 20 as DSP signal processors, mainly complete light source control, driving and pre- place
The logic function of reason, bus management and some low orders, and DSP is mainly responsible for completing regular sample learning, result of decision processing
Deng high-order Processing Algorithm.SDRAM 23 and data storage cell 22 are respectively used to storage during 6 high speed operation of CPU
With reading, intelligence learning and the real-time update of such as Expert Rules.This platform architecture, system operating efficiency is improved, lifted
The overall performance of system.
As shown in fig. 6, a kind of online test method based on multimodal registration, comprises the following steps:
(ⅰ)Initialization
According to the testing requirements of detection target 2, sample is detected using artificial collect, suitable registration pattern is primarily determined that and matches somebody with somebody
Quasi-regular(S1);
(ⅱ)Quasi-regular is matched somebody with somebody in optimization
Set comprehensive expert to match somebody with somebody quasi-regular, with reference to field working conditions, determine each pattern registration in pattern registration unit 4 successively
Subelement 8 is matched somebody with somebody quasi-regular and optimized, the data storage cell 22 with quasi-regular input CPU 7 after optimization
In(S2);
(ⅲ)Pattern registration unit configures
According to step(ⅱ)In rule and detection target 2 specific testing requirements, to each mould in pattern registration unit 4
Formula registration subelement 8 is configured, and includes the selection of sensor 11 and camera lens 12(S3);
(ⅳ)Lighting source configures
With reference to step(ⅲ)The selection of middle respective sensor 11 and camera lens 12, from suitable illumination sources, passes through centre
Reason unit 7 is controlled to each lighting source in intelligent lighting assembly 3, according to pattern registration corresponding to each lighting source
Unit 8, configure suitable light level scheme(S4);
(ⅴ)Start registration procedure
Being issued each pattern registration subelement 8 with quasi-regular by interaction data communication bus 6 of CPU 7
To the pattern registration subelement 8, when detection target 2 is single by i-th of pattern registration subelement, i-th i pattern registration successively
During the subelements such as n-th pattern registration subelement of member 2 ..., associative mode registration subelement 8 brings into operation S5;
(ⅵ)Registration result judges
Registration result is delivered to CPU 7 by each pattern registration subelement 8 respectively in pattern registration unit 4, in
Central Processing Unit 7 carries out integrating calculation process to each registration result(S6);
(ⅶ)Change Expert Rules
If inconsistent with the expected detection target of setting, comprehensive expert's registration is directly changed by manual intervention unit 5
Rule(S7), restart step(ⅰ)Perform detection, until testing result meets expection;
(ⅷ)Terminate
If being consistent with the expected detection target of setting, this detection terminates(S8).
Main advantages of the present invention have:
(i) multiple pattern registration units are realized in a detecting system, can be realized simultaneously to the more of detection target
Individual characteristic information carries out registering analysis.
(ii) the final output result of detecting system is drawn after all registration unit results carry out comprehensive analysis processing, together
When detection process in manual intervention unit real-time participation, have modified because field working conditions complicated band come detection failure or mistake,
Be advantageous to the intelligent perfect of Expert Rules.
(iii) the on-line checking based on multimodal registration realizes the classification of multiple characteristic informations, collects and integrate, and contributes to
The sample classification statistics of detection sample is realized, realizes that efficiently, accurately on-line checking identifies, improves the automation of the entire production line
The level of production.
(iv) the result of multiple characteristic information registrations is combined, the compression of multicharacteristic information is effectively realized, reduces redundancy
Characteristic information, mitigate the pressure of hardware system processing feature information, improve system detectio precision.
(v) the result for combining multimodal registration information provides effectively for the analysis and decision that production line automation controls
Support.