CN111238641A - Multispectral imaging device and method for color wheel light splitting and imaging based on white light illumination - Google Patents
Multispectral imaging device and method for color wheel light splitting and imaging based on white light illumination Download PDFInfo
- Publication number
- CN111238641A CN111238641A CN201911144162.1A CN201911144162A CN111238641A CN 111238641 A CN111238641 A CN 111238641A CN 201911144162 A CN201911144162 A CN 201911144162A CN 111238641 A CN111238641 A CN 111238641A
- Authority
- CN
- China
- Prior art keywords
- color wheel
- image
- receiving end
- light
- motor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/12—Generating the spectrum; Monochromators
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
- G01N21/25—Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
- G01N21/31—Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
- G01N2021/1793—Remote sensing
Landscapes
- Physics & Mathematics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- General Health & Medical Sciences (AREA)
- Immunology (AREA)
- Pathology (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
- Spectrometry And Color Measurement (AREA)
Abstract
The invention discloses a multispectral imaging device and a multispectral imaging method for realizing multispectral imaging for identification based on color wheel light splitting and imaging of white light illumination. The multispectral imaging device comprises an infusion bag, a camera, a PC controller, a first motor, a receiving end color wheel, a second motor, a light source end color wheel, a white light source, an industrial personal computer and a conveyor belt; the multispectral imaging method comprises the steps of collecting a special spectral image through hardware equipment; and identifying the special spectral feature image through a software algorithm. The multispectral imaging device and the multispectral imaging method based on the color wheel light splitting and imaging of the white light illumination can irradiate a target object through multispectral combination to form spectral feature images with different shades, and identify and process the target according to different spectral features; the brightness enhancement or the brightness reduction of the numbers, the letters, the Chinese characters and the icons on the infusion bag can be identified; the background brightness of the transmission belt of the infusion bag can be enhanced or weakened.
Description
Technical Field
The invention relates to the field of spectral imaging, in particular to a multispectral imaging device and a multispectral imaging method for color wheel light splitting and imaging based on white light illumination.
Background
It is well known that: the remote sensing image utilizes the multispectral characteristic, and plays an important role in many fields due to the characteristics of large information quantity, wide coverage range and the like. In the military field, the system can carry out omnibearing detection and monitoring on the target, and is convenient to collect the information of each party; in the civil field, the method is widely applied to navigation, disaster detection and prediction, resource survey and the like. However, due to limitations of the sensor imaging mechanism, commonly used remote sensing satellites are not capable of providing multispectral images with both high spatial and spectral resolution. To compensate for this deficiency, most satellites today typically have two different types of sensors simultaneously, each acquiring a full-color image with high spatial resolution and a multispectral image with high spectral resolution. Then, the digital signal processing technology is utilized to extract the space detail information of the full-color image so as to sharpen the multispectral image, and the multispectral image with ideal high resolution can be obtained. Currently, algorithms for sharpening multispectral images with full-color images are mainly divided into two main categories: component substitution and multiresolution analysis. The former replaces the spatial information of the multispectral image with that of the panchromatic image by spatial transformation, and the latter inserts the high-frequency component of the panchromatic image into the multispectral image by spatial filtering. However, these mainstream sharpening methods have the defects of contradiction and high cost in the fields of reducing color distortion of output images, improving spatial resolution and arithmetic operation efficiency of fused images and industrial application, and are limited in the field of industrial production and difficult to be widely applied.
At present, most of image processing basically uses general illumination, but the application occasions are limited, because different materials have different absorption degrees to light source frequency spectrums, the obtained image contrast is different, all application scenes cannot be met, and the stable and reliable image processing system needs to be improved from a multi-spectrum angle.
Therefore, the multispectral imaging technology based on color wheel light splitting and imaging of white light illumination irradiates a target object through a white light source, light with different wavelengths is obtained through the optical filter on the color wheel to irradiate the target object, the absorption degrees of the target object to the spectrum are different, the reflected spectrum has difference through the imaging brightness of the optical filter of the color wheel at the receiving end, and the identification of the image is realized by selecting the image with specific brightness. In addition, under the environment with different ambient brightness, the absorption degree of the target object to the same spectrum is also different, so that the influence of image contrast caused by the change of ambient brightness can be reduced by multispectral. Low cost, high resolution and high efficiency applications in industrial applications have unique advantages. Can play an important role in the fields of food, medicine and other industries, in particular to the aspects of identification, measurement and sorting of soft infusion bag products.
Disclosure of Invention
The technical problem to be solved by the invention is to provide a multi-spectral imaging device which can irradiate a target object through multi-spectral combination to form spectral feature images with different shades, and identify and process the target according to different spectral features; the brightness enhancement or the brightness reduction of the numbers, the letters, the Chinese characters and the icons on the infusion bag can be identified; the background brightness of the transmission belt of the infusion bag can be enhanced or weakened; the multispectral imaging device and the multispectral imaging method can obtain combined spectra through the filters on the color wheels at the transmitting and receiving ends to enhance or weaken the brightness of substances, and then image the substances for identification based on color wheel light splitting and imaging of white light illumination.
The technical scheme adopted by the invention for solving the technical problems is as follows: a multispectral imaging device based on color wheel beam splitting and imaging of white light illumination comprises a PC controller, an industrial personal computer and a conveyor belt with ground color; the conveying belt is provided with an object to be detected;
a light source end color wheel and a receiving end color wheel are arranged above the infusion bag; the receiving end color wheel is provided with a first motor for driving the receiving end color wheel to rotate;
a second motor for driving the light source end color wheel to rotate is arranged on the light source end color wheel; a camera is arranged above the receiving end color wheel; a white light source is arranged above the light source end color wheel;
the incident angle of the light source end color wheel on the infusion bag is theta, and an included angle is formed between the infusion bag and the receiving end color wheel;
the camera is connected with the PC controller; the PC controller controls the camera, acquires images and identifies the optical frequency spectrum and common characteristics of the infusion bag;
the white light source is connected with an industrial personal computer; the industrial personal computer regulates and controls the white light source 8 to generate white light with certain illuminance and divergence angle;
and the light source end color wheel and the receiving end color wheel are both provided with band-pass filters which are uniformly distributed along the circumference.
The invention also discloses a multispectral imaging method for color wheel light splitting and imaging based on white light illumination, which comprises the following steps:
s1, collecting the spectrum characteristic image through the multispectral imaging device for color wheel light splitting and imaging based on white light illumination according to claim 1;
obtaining:
the spectrum T transmitted by the filter at the transmitting end has M types: t1, T2, T3 … … TM.
The spectrum R transmitted by the filter at the receiving end has N types: t1, T2, T3 … … TN.
The spectral images after the transmitting end and the receiving end are matched form an M multiplied by N rectangular array, and the images have C e (M x N) spectral characteristics;
s2, through the existing optical coating technology, the light wave with the specified central wavelength and bandwidth can be filtered, the transmittance of the light wave with the specified wavelength is controlled through the specified optical filter, and the irradiation of the specified wavelength on the target object is realized;
s3, according to the Grassmann color mixing law, the method is used for additive color mixing of colored light, namely light rays with different wavelengths are superposed, and light and shade change is carried out on colors with specified wavelengths through superposition of the light rays with different wavelengths, so that objects with the specified colors are filtered and screened;
blue light (460nm) + yellow light (580nm) as white light
Red light (660nm) + cyan light (480nm) as white light
According to the planck formula:
spectral radiance L at different temperaturesbλThe distribution curve of the sum wavelength lambda is shown in the following graph, and the radiance L of different wavelengths at the same temperature can be seenbλIdentifying the substance according to the characteristic that the radiation brightness of different wavelengths is different;
s4, controlling the rotation of the receiving end color wheel, the rotation angle of the light source end color wheel and the angular speed through the first motor and the second motor to control the switching and the switching speed of different optical filters, and forming images with different spectral characteristics on the infusion bag 1 by matching with the shooting of the camera and the transmission speed of the conveyor belt; the images are used to screen for spectral features of particular substances.
Specifically, in step S4, the infusion bag 1 is imaged with different spectral characteristics by:
TM and TN are respectively the period of controlling the motor by the transmitting end and the period of controlling the motor to rotate for one circle by the receiving end; emitting time and rotation switching time of M filters at the emission end of t1/t2 … … t2M respectively; t1/t2 … … t2N receives the irradiation time and the rotation switching time of the N filters respectively;
the irradiation and the reception of the bag body are adjusted by controlling the rotation of the motors of the transmitting end and the receiving end, so that the image in the camera presents a light and shade alternating state; and controlling the time sequence of the motor of the transmitting end and the motor of the receiving end to obtain the matching of the color wheel of the transmitting end and the color wheel of the receiving end to obtain the image with the combined spectral characteristics. The synchronous and asynchronous functions of the motors of the transmitting end and the receiving end can be adjusted to obtain a special spectrum image with fixed periodic frequency;
the irradiation and the reception of the bag body are adjusted by controlling the rotation of the motors of the transmitting end and the receiving end, so that the image in the camera presents a light and shade alternating state; controlling the time sequence of the motor of the transmitting end and the motor of the receiving end to obtain the matching of the color wheel of the transmitting end and the color wheel of the receiving end to obtain an image with combined spectral characteristics; obtaining a special spectrum image with fixed periodic frequency by adjusting the synchronous and asynchronous functions of motors at a transmitting end and a receiving end;
further, in step S4, the special spectral feature image is identified by a software algorithm.
Preferably, identifying the special spectral feature image by adopting an OSTU segmentation method; the method specifically comprises the following steps: firstly, converting an image into a gray scale image; the number of pixels in the image, of which the gray value A is smaller than the threshold T, is H0, and the number of pixels of which the gray value A is larger than the threshold T is H1; recording the average gray value of H0 as H0 and the average gray value of H1 as H1 in the image with the image size of X X Y and the threshold value of T;
the probability that the pixel gray value is less than T is:
r0＝h0/(X*Y)；
the probability that the pixel gray value is greater than T is:
r1＝h1/(X*Y)；
h0+h1＝X*Y；
r0+r1＝1；
the average gray is multiplied by the probability and then added:
e＝r0*h0+r1*h1；
the between-class variance is:
d＝r0(h0-e)^2+r1(h1-e)^2；
d＝r0*r1(h0-h1)^2。
preferably, the specific spectral feature image is identified by using an erosion algorithm, a gray scale morphology of mathematical morphology, a dilation algorithm, or a dilation algorithm of gray scale morphology.
The invention has the beneficial effects that: compared with the prior art, the multispectral imaging device and the multispectral imaging method based on the color wheel light splitting and imaging of the white light illumination have the following advantages and beneficial effects:
1. the multispectral imaging technology based on color wheel light splitting and imaging of white light illumination can irradiate a target object through multispectral combination to form spectral feature images with different brightness and darkness, and the target can be identified and processed according to different spectral features;
2. the device can realize the identification of the brightness enhancement or the attenuation of the letters, the numbers, the symbols and the characters of the infusion package;
3. the brightness of the background of the transmission belt of the infusion bag can be enhanced or weakened;
4. bright and dark enhancement or reduction imaging of a substance through multispectral scanning can be used for identification;
5. the multispectral imaging device and the multispectral imaging method based on color wheel light splitting and imaging of white light illumination can be applied to the field of material identification;
6. the multispectral imaging device and the multispectral imaging method based on the color wheel light splitting and imaging of the white light illumination can realize the expansion of the application field of image identification.
Drawings
Fig. 1 is a schematic structural diagram of a multispectral imaging device based on color wheel splitting and imaging of white light illumination according to an embodiment of the present invention;
FIG. 2 is a schematic view of a color wheel according to an embodiment of the present invention;
FIG. 3 is a spectral plot of filters of different bandwidths in an embodiment of the present invention;
FIG. 4 shows the spectral radiance L at different temperatures in an embodiment of the present inventionbλAnd a wavelength λ profile;
FIG. 5 is a timing diagram illustrating motor control at the transmitting end and the receiving end according to an embodiment of the present invention;
FIG. 6 is a flow chart of a binary morphological erosion algorithm in accordance with an embodiment of the present invention;
FIG. 7 is a flow chart of a binary morphological dilation algorithm in an embodiment of the present invention;
FIG. 8 is a flowchart of a gray scale morphological erosion algorithm in an embodiment of the invention;
FIG. 9 is a flow chart of a gray scale morphological dilation algorithm in an embodiment of the present invention;
the following are marked in the figure: 1-infusion bag, 2-camera, 3-PC controller, 4-first motor, 5-receiving end color wheel, 6-second motor, 7-light source end color wheel, 8-white light source, 9-industrial personal computer, 10-conveyor belt, 11-first band-pass filter, 12-second band-pass filter, 13-third band-pass filter, 14-fourth band-pass filter, 15-fifth band-pass filter, 16-sixth band-pass filter, 17-seventh band-pass filter, 18-eighth band-pass filter, and 19-ninth band-pass filter.
Detailed Description
The invention is further illustrated with reference to the following figures and examples.
As shown in fig. 1, the multispectral imaging device for color wheel spectroscopy and imaging based on white light illumination of the present invention includes a PC controller 3, an industrial personal computer 9, and a conveyor belt 10 with ground color; the conveying belt 10 is provided with an infusion bag 1,
a light source end color wheel 7 and a receiving end color wheel 5 are arranged above the infusion bag 1; the receiving end color wheel 5 is provided with a first motor 4 for driving the receiving end color wheel 5 to rotate;
the light source end color wheel 7 is provided with a second motor 6 for driving the light source end color wheel 7 to rotate; a camera 2 is arranged above the receiving end color wheel 5; a white light source 8 is arranged above the light source end color wheel 7;
the incident angle of the light source end color wheel 7 on the infusion bag 1 is theta, and an included angle is formed between the infusion bag 1 and the receiving end color wheel 5;
the camera 2 is connected with a PC controller 3; the PC controller 3 controls the camera 2, acquires images and identifies the optical frequency spectrum characteristic of the infusion bag 1;
the white light source 8 is connected with an industrial personal computer 9; the industrial personal computer 9 regulates and controls the white light source 8 to generate white light with certain illuminance and divergence angle;
and the light source end color wheel 7 and the receiving end color wheel 5 are both provided with band-pass filters which are uniformly distributed along the circumference. Specifically, the number of bandpass filters is not limited to 9, and depends on the bandwidth and spectral width.
Specifically, the surface of the infusion bag 1 is provided with colored letters, numbers, Chinese characters and colored icons. Placed on a green conveyor belt 10; the camera 2 is placed in front of the color wheel 5 of the received end; the PC controller 3 is connected with the camera 2, and the PC controller 3 controls the camera 2 to collect images and identify the optical frequency spectrum characteristic of the identified object 1; the first motor 4 controls the rotating speed and the rotating angle of the color wheel 5 at the receiving end to provide modulation power for receiving the light rays with specific spectral characteristics; the color wheel 5 at the receiving end makes the light pass through the filter generating the specific spectrum under the control of the first motor 4, and selects the specific spectrum characteristic picture; the second motor 6 controls the rotation and the rotation angle of the color wheel 7 at the transmitting end, and provides stable and controllable modulation power for transmitting the light with the specific spectral characteristics; the light source end color wheel 7 enables light rays to pass through a filter generating a specific spectrum through the control of the second motor 6, and a specific spectrum characteristic picture is selected; the white light source 8 generates white light with certain illuminance and divergence angle to provide illumination for the identified bag body of the infusion bag; the industrial personal computer 9 regulates and controls the white light source 8 to generate white light with certain illuminance and divergence angle; the ground color of the conveyor belt 10 may be green. The quantity of the light sources and the quantity of the corresponding light source industrial personal computers are fixed, and the light emitting angles of the light sources are adjustable;
in fig. 2, 11, 12, 13, 14, 15, 16, 17, 18, and 19 are bandpass filters transmitting different central wavelengths, and are respectively a first bandpass filter, a second bandpass filter, a third bandpass filter, a fourth bandpass filter, a fifth bandpass filter, a sixth bandpass filter, a seventh bandpass filter, an eighth bandpass filter, and a ninth bandpass filter; after the white light passes through the optical filter, the spectrum with different wavelengths is transmitted; the rotating speed and the rotating angle of the color wheel can be adjusted by a high-precision motor, and the number and the types of the optical filters are not limited to the number and the types shown in the color wheel in fig. 2, so that the emitted light and the received light have specific spectral characteristics.
The multispectral imaging technology based on the color wheel light splitting and imaging of the white light illumination can form a multispectral combination through the color wheel at the transmitting end and the color wheel at the receiving end to irradiate a target object, provide a combination of various spectral characteristics and realize the application of the multispectral characteristics in the field of image recognition.
The invention also discloses a multispectral imaging method for color wheel light splitting and imaging based on white light illumination, which comprises the following steps:
s1, collecting the spectrum characteristic image through the multispectral imaging device for color wheel light splitting and imaging based on white light illumination according to claim 1;
obtaining:
the spectrum T transmitted by the filter at the transmitting end has M types: t1, T2, T3 … … TM.
The spectrum R transmitted by the filter at the receiving end has N types: t1, T2, T3 … … TN.
The spectral image set after the matching of the transmitting end and the receiving end forms an M multiplied by N rectangular array, and the spectrum image set has C e (M x N) spectral characteristics;
s2, through the existing optical coating technology, the light wave with the specified central wavelength and bandwidth can be filtered, the transmittance of the light wave with the specified wavelength is controlled through the specified optical filter, and the irradiation of the specified wavelength on the target object is realized;
s3, according to the Grassmann color mixing law, the method is used for additive color mixing of colored light, namely light rays with different wavelengths are superposed, and light and shade change is carried out on colors with specified wavelengths through superposition of the light rays with different wavelengths, so that objects with the specified colors are filtered and screened;
blue light (460nm) + yellow light (580nm) as white light
Red light (660nm) + cyan light (480nm) as white light
According to the planck formula:
spectral radiance L at different temperaturesbλThe distribution curve of the sum wavelength lambda is shown in the following graph, and the radiance L of different wavelengths at the same temperature can be seenbλIdentifying the substance according to the characteristic that the radiation brightness of different wavelengths is different;
and S4, controlling the rotation angles and the angular speeds of the receiving end color wheel 5 and the light source end color wheel 7 through the first motor 4 and the second motor 6 to control the switching and the switching speeds of different filters, and forming images with different spectral characteristics on the infusion bag 1 by matching with the shooting of the camera 2 and the conveying speed of the conveyor belt 10.
Specifically, in step S4, the infusion bag 1 is imaged with different spectral characteristics by:
TMand TNRespectively controlling the motor period for the transmitting end and the motor rotation period for the receiving end; t is t1/t2……t2mEmitting time and rotation switching time of M filters at an emitting end; t is t1/t2……t2nRespectively receiving the irradiation time and the rotation switching time of N optical filters at a receiving end;
the irradiation and the reception of the bag body are adjusted by controlling the rotation of the motors of the transmitting end and the receiving end, so that the image in the camera presents a light and shade alternating state; and controlling the time sequence of the motor of the transmitting end and the motor of the receiving end to obtain the matching of the color wheel of the transmitting end and the color wheel of the receiving end to obtain the image with the combined spectral characteristics. The synchronous and asynchronous functions of the motors of the transmitting end and the receiving end can be adjusted to obtain a special spectrum image with fixed periodic frequency,
the irradiation and the reception of the bag body are adjusted by controlling the rotation of the motors of the transmitting end and the receiving end, so that the image in the camera presents a light and shade alternating state; controlling the time sequence of the motor of the transmitting end and the motor of the receiving end to obtain the matching of the color wheel of the transmitting end and the color wheel of the receiving end to obtain an image with combined spectral characteristics; obtaining a special spectrum image with fixed periodic frequency by adjusting the synchronous and asynchronous functions of motors at a transmitting end and a receiving end; the images are used to screen for spectral features of particular substances.
Further, in step S4, the special spectral feature image is identified by a software algorithm. Preferably, identifying the special spectral feature image by adopting an OSTU segmentation method; the method specifically comprises the following steps: firstly, converting an image into a gray scale image; the number of pixels in the image, of which the gray value A is smaller than the threshold T, is H0, and the number of pixels of which the gray value A is larger than the threshold T is H1; recording the average gray value of H0 as H0 and the average gray value of H1 as H1 in the image with the image size of X X Y and the threshold value of T;
the probability that the pixel gray value is less than T is:
r0＝h0/(X*Y)；
the probability that the pixel gray value is greater than T is:
r1＝h1/(X*Y)；
h0+h1＝X*Y；
r0+r1＝1；
the average gray is multiplied by the probability and then added:
e＝r0*h0+r1*h1；
the between-class variance is:
d＝r0(h0-e)^2+r1(h1-e)^2；
d＝r0*r1(h0-h1)^2。
preferably, the specific spectral feature image is identified by using an erosion algorithm, a gray scale morphology of mathematical morphology, a dilation algorithm, or a dilation algorithm of gray scale morphology.
Examples
1. Hardware facilities realize special spectral feature image acquisition:
the white light source 8 is controlled by the light source industrial personal computer 9 to emit white light with certain brightness and divergence angle. The white light source 8 is coaxial with the color wheel 7 and is located at a distance from the color wheel so that the light passes completely through the filter windows in the color wheel. The light passes through the emission end color wheel control motor 6 to control the color wheel 7 to generate a spectrum with a specific wavelength, and the type of the spectrum is determined according to the number M of the filters on the color wheel 7. The angles of the white light source 8 and the color wheel 7 can be adjusted together to generate incident light with a certain angle theta, and emergent light with specific spectrum illuminates the transfusion bag body 1 and the color conveyor belt 10 in cooperation with ambient light. The receiving end motor 4 controls the receiving end color wheel 5 to enable the receiving end spectrum to be matched with the transmitting end spectrum, the obtained combined spectrum enters the camera 2, and the camera PC controller controls the camera 2 to shoot and store images. The number of the receiving end spectrum is determined according to the number N of the filters on the receiving end color wheel 5.
The spectrum T transmitted by the filter at the transmitting end has M types: t1, T2, T3 … … TM.
The spectrum R transmitted by the filter at the receiving end has N types: t1, T2, T3 … … TN.
The spectral images after the matching of the transmitting end and the receiving end form an M multiplied by N rectangular array, the images have C e (M x N) spectral characteristics, and the images can be regulated and controlled through synchronous or asynchronous movement by the transmitting end color wheel motor 6 and the receiving end color wheel motor 4.
The optical film coating technology can filter the light waves with the appointed central wavelength and bandwidth, so that the appointed optical filter can control the transmissivity of the light waves with the appointed wavelength and realize the irradiation of the appointed wavelength on a target object. The spectral diagram of the transmission of the filter is shown in fig. 3 for different bandwidths of the spectral diagram of the filter.
According to the Grassmann color mixing law, the method is suitable for color light additive color mixing, namely light rays with different wavelengths are superposed, and light and shade change is carried out on colors with specified wavelengths through light superposition with different wavelengths, so that objects with specified colors are filtered and screened progressively.
Blue light (460nm) + yellow light (580nm) as white light
Red light (660nm) + cyan light (480nm) as white light
According to the planck formula:
spectral radiance L at different temperaturesbλAnd the wavelength lambda distribution curve are shown in the following graph, it can be seen that the radiance Lb lambda of different wavelengths is different at the same temperature, and the substance is identified according to the characteristic that the radiance of different wavelengths is different.
The spectral radiance L at different temperatures as shown in FIG. 4bλAnd a wavelength λ profile;
the motor 4 and the motor 6 control the rotating angles and the angular speeds of the color wheel 5 and the color wheel 8 to control the switching and the switching speeds of different filters, and images with different spectral characteristics are formed on the infusion bag 1 by matching with the shooting of the camera 2 and the conveying speed of the conveying belt 10.
The motor rotation frequency is as shown in the timing chart of motor control of the transmitting end and the receiving end in fig. 5;
TMand TNRespectively controlling the motor period for the transmitting end and the motor rotation period for the receiving end; emitting time and rotation switching time of M filters at the emission end of t1/t2 … … t2M respectively; t1/t2 … … t2N receives the irradiation time and the rotation switching time of the N filters respectively.
The irradiation and the receiving of the bag body are adjusted by controlling the rotation of the motors of the transmitting end and the receiving end, so that the image in the camera shows a light and shade alternative state. By controlling the time sequence of the motor of the transmitting terminal and the receiving terminal, the color wheel of the transmitting terminal and the receiving terminal can be matched to obtain an image with combined spectral characteristics. The synchronous and asynchronous functions of the motors of the transmitting end and the receiving end can be adjusted to obtain a special spectral image with fixed periodic frequency, and the special spectral image can be used for screening images of spectral characteristics of specific substances.
2. Identifying the special spectral feature image by a software algorithm:
based on an OSTU segmentation method, binary morphology and gray-scale morphology in mathematical morphology and other special algorithms, the identification function of numbers, letters, Chinese characters, images and foreign matters on the infusion bag image with multispectral characteristics is realized.
OSTU segmentation method:
the image is first converted to a grayscale image. The number of pixels in the image, of which the gray value A is smaller than the threshold T, is H0, and the number of pixels of which the gray value A is larger than the threshold T is H1; recording the average gray value of H0 as H0 and the average gray value of H1 as H1 in the image with the image size of X X Y and the threshold value of T;
the probability that the pixel gray value is less than T is:
r0＝h0/(X*Y)；
the probability that the pixel gray value is greater than T is:
r1＝h1/(X*Y)；
h0+h1＝X*Y；
r0+r1＝1；
the average gray is multiplied by the probability and then added:
e＝r0*h0+r1*h1；
the between-class variance is:
d＝r0(h0-e)^2+r1(h1-e)^2；
d＝r0*r1(h0-h1)^2
binary morphology of mathematical morphology
And (3) corrosion algorithm:
the method is simply understood as reducing the range of a target area, and the image boundary is contracted from the visual perception of the image; in practice, it is often used to eliminate noise or unwanted objects. The expression is as follows:
the expression is expressed as corroding the set A by the set B, namely, enabling B to move in A by a starting point and convolving with an overlapping area of A, and if the values at the position B and the position A are the same, outputting a result of 1, otherwise, outputting a result of 0. A flow chart of the binary morphological erosion algorithm is shown in fig. 6.
And (3) expansion algorithm:
simply comprehending that the range of a target area is enlarged, and the image boundary is expanded from the visual perception of the image; in practical application, the method is mainly used for filling the holes in the target area and eliminating small particle noise. The expression is as follows:
the above expression is expressed as using the set B to expand the set A, i.e. let B move in A with a starting point, and make convolution with the overlapping area of A, if the intersection of the values at the position B and the position A is not null, the output result is 1, otherwise, the output result is 0. A flow chart of the binary morphological dilation algorithm is shown in fig. 7.
Grayscale morphology of mathematical morphology
The image element is marked as A, the structural element is marked as B, and the area of the structural element covering the image is marked as C.
Etching of gray scale morphology:
simply understood as the operation of convolution, a small rectangle C formed by subtracting the structural element B from A is used, the minimum value in C is taken, and the minimum value is assigned to the origin corresponding to B. As shown in fig. 8, a flow chart of a gray scale morphological erosion algorithm.
Dilation algorithm for gray morphology:
simply understood as the operation of convolution, a small rectangle C formed by adding A and the structural element B is used, the maximum value in C is taken, and the original point corresponding to B is assigned. The gray scale morphological dilation algorithm flow chart shown in fig. 9.
The imaging areas with different light and shade can be identified by hardware facilities such as a light source, a color wheel, a filter, a motor, a camera, a processor and the like in cooperation with a corresponding image imaging method and a series of software algorithms, and finally, automatic identification, detection and calculation of the target object are realized.
Claims (6)
1. A multispectral imaging device for color wheel light splitting and imaging based on white light illumination is characterized in that: the device comprises a PC controller (3), an industrial personal computer (9) and a conveyor belt (10) with ground color; the conveying belt (10) is provided with an infusion bag (1),
a light source end color wheel (7) and a receiving end color wheel (5) are arranged above the infusion bag (1); the receiving end color wheel (5) is provided with a first motor (4) for driving the receiving end color wheel (5) to rotate;
the light source end color wheel (7) is provided with a second motor (6) for driving the light source end color wheel (7) to rotate; a camera (2) is arranged above the receiving end color wheel (5); a white light source (8) is arranged above the light source end color wheel (7);
the incident angle of the light source end color wheel (7) on the infusion bag (1) is theta, and an included angle is formed between the infusion bag (1) and the receiving end color wheel (5);
the camera (2) is connected with the PC controller (3); the PC controller (3) controls the camera (2), acquires images and identifies the optical frequency spectrum and common characteristics of the infusion bag (1);
the white light source (8) is connected with an industrial personal computer (9); the industrial personal computer (9) regulates and controls the white light source 8 to generate white light with certain illuminance and divergence angle;
and the light source end color wheel (7) and the receiving end color wheel (5) are both provided with band-pass filters which are uniformly distributed along the circumference.
2. A multispectral imaging method for color wheel light splitting and imaging based on white light illumination is characterized by comprising the following steps:
s1, collecting the spectrum characteristic image through the multispectral imaging device for color wheel light splitting and imaging based on white light illumination according to claim 1;
obtaining:
the spectrum T transmitted by the filter at the transmitting end has M types: t1, T2, T3 … … TM.
The spectrum R transmitted by the filter at the receiving end has N types: t1, T2, T3 … … TN.
The spectral image set after the matching of the transmitting end and the receiving end forms an M multiplied by N rectangular array, and the spectrum image set has C e (M x N) spectral characteristics;
s2, through the existing optical coating technology, the light wave with the specified central wavelength and bandwidth can be filtered, the transmittance of the light wave with the specified wavelength is controlled through the specified optical filter, and the irradiation of the specified wavelength on the target object is realized;
s3, according to the Grassmann color mixing law, the method is used for additive color mixing of colored light, namely light rays with different wavelengths are superposed, and light and shade change is carried out on colors with specified wavelengths through superposition of the light rays with different wavelengths, so that objects with the specified colors are filtered and screened;
blue light (460nm) + yellow light (580nm) as white light
Red light (660nm) + cyan light (480nm) as white light
According to the planck formula:
spectral radiance L at different temperaturesbλThe distribution curve of the sum wavelength lambda is shown in the following graph, and the radiance L of different wavelengths at the same temperature can be seenbλIdentifying the substance according to the characteristic that the radiation brightness of different wavelengths is different;
s4, controlling the rotation angles and the angular speeds of the receiving end color wheel (5) and the light source end color wheel (7) through the first motor (4) and the second motor (6) to control the switching and the switching speeds of different optical filters, and forming images with different spectral characteristics on the infusion bag (1) by matching with the shooting of the camera (2) and the transmission speed of the conveyor belt (10); the images are used to screen for spectral features of particular substances.
3. The method according to claim 2, wherein the method comprises: in step S4, imaging the infusion bag 1 with different spectral characteristics is achieved by:
TMand TNRespectively controlling the motor period for the transmitting end and the motor rotation period for the receiving end; t is t1/t2……t2mEmitting M filters irradiate the respective irradiation time and rotation switching time; t is t1/t2……t2nRespectively receiving the irradiation time and the rotation switching time of N optical filters at a receiving end;
the irradiation and the reception of the bag body are adjusted by controlling the rotation of the motors of the transmitting end and the receiving end, so that the image in the camera presents a light and shade alternating state; and controlling the time sequence of the motor of the transmitting end and the motor of the receiving end to obtain the matching of the color wheel of the transmitting end and the color wheel of the receiving end to obtain the image with the combined spectral characteristics. The synchronous and asynchronous functions of the motors of the transmitting end and the receiving end can be adjusted to obtain a special spectrum image with fixed periodic frequency,
the irradiation and the reception of the bag body are adjusted by controlling the rotation of the motors of the transmitting end and the receiving end, so that the image in the camera presents a light and shade alternating state; controlling the time sequence of the motor of the transmitting end and the motor of the receiving end to obtain the matching of the color wheel of the transmitting end and the color wheel of the receiving end to obtain an image with combined spectral characteristics; the special spectrum image with fixed periodic frequency is obtained by adjusting the synchronous and asynchronous functions of the motors of the transmitting end and the receiving end.
4. The method according to claim 2, wherein the method comprises: the special spectral feature image is identified by a software algorithm in step S4.
5. The method according to claim 4, wherein the method comprises: identifying the special spectral feature image by adopting an OSTU segmentation method; the method specifically comprises the following steps: firstly, converting an image into a gray scale image; the number of pixels in the image, of which the gray value A is smaller than the threshold T, is H0, and the number of pixels of which the gray value A is larger than the threshold T is H1; recording the average gray value of H0 as H0 and the average gray value of H1 as H1 in the image with the image size of X X Y and the threshold value of T;
the probability that the pixel gray value is less than T is:
r0＝h0/(X*Y)；
the probability that the pixel gray value is greater than T is:
r1＝h1/(X*Y)；
h0+h1＝X*Y；
r0+r1＝1；
the average gray is multiplied by the probability and then added:
e＝r0*h0+r1*h1；
the between-class variance is:
d＝r0(h0-e)^2+r1(h1-e)^2；
d＝r0*r1(h0-h1)^2。
6. the method according to claim 4, wherein the method comprises: and identifying the special spectral feature image by adopting a corrosion algorithm, a gray scale morphology of mathematical morphology, an expansion algorithm or an expansion algorithm of the gray scale morphology.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911144162.1A CN111238641A (en) | 2019-11-20 | 2019-11-20 | Multispectral imaging device and method for color wheel light splitting and imaging based on white light illumination |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911144162.1A CN111238641A (en) | 2019-11-20 | 2019-11-20 | Multispectral imaging device and method for color wheel light splitting and imaging based on white light illumination |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111238641A true CN111238641A (en) | 2020-06-05 |
Family
ID=70864004
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911144162.1A Pending CN111238641A (en) | 2019-11-20 | 2019-11-20 | Multispectral imaging device and method for color wheel light splitting and imaging based on white light illumination |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111238641A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112461833A (en) * | 2020-11-23 | 2021-03-09 | 广东弓叶科技有限公司 | Multispectral image acquisition method and system based on intermittent optical filter wheel mechanism |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW200602629A (en) * | 2004-07-13 | 2006-01-16 | Yokogawa Electric Corp | Light source device for inspection |
| CN1896722A (en) * | 2005-10-21 | 2007-01-17 | 中国科学院长春光学精密机械与物理研究所 | Continuouslly-scanning fluorescent imaging file tester |
| CN101324468A (en) * | 2007-06-15 | 2008-12-17 | 杭州远方光电信息有限公司 | Low stray light rapid spectrometer and measurement method thereof |
| CN102105780A (en) * | 2008-07-24 | 2011-06-22 | 麻省理工学院 | Systems and methods for imaging using absorption |
| CN204064457U (en) * | 2014-07-10 | 2014-12-31 | 青岛市光电工程技术研究院 | A kind of bandwidth optical spectrum imaging device able to programme |
| CN106448525A (en) * | 2016-12-23 | 2017-02-22 | 南京巨鲨显示科技有限公司 | System and method for measuring color uniformity of medical display |
| CN107368617A (en) * | 2016-05-13 | 2017-11-21 | 南京理工大学 | Air-ground detection infrared imaging system operating distance computational methods based on Lowtran7 air softwares |
| CN110067950A (en) * | 2019-05-18 | 2019-07-30 | 哈尔滨理工大学 | A kind of full-spectrum LED light mixing system |
-
2019
- 2019-11-20 CN CN201911144162.1A patent/CN111238641A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW200602629A (en) * | 2004-07-13 | 2006-01-16 | Yokogawa Electric Corp | Light source device for inspection |
| CN1896722A (en) * | 2005-10-21 | 2007-01-17 | 中国科学院长春光学精密机械与物理研究所 | Continuouslly-scanning fluorescent imaging file tester |
| CN101324468A (en) * | 2007-06-15 | 2008-12-17 | 杭州远方光电信息有限公司 | Low stray light rapid spectrometer and measurement method thereof |
| CN102105780A (en) * | 2008-07-24 | 2011-06-22 | 麻省理工学院 | Systems and methods for imaging using absorption |
| CN204064457U (en) * | 2014-07-10 | 2014-12-31 | 青岛市光电工程技术研究院 | A kind of bandwidth optical spectrum imaging device able to programme |
| CN107368617A (en) * | 2016-05-13 | 2017-11-21 | 南京理工大学 | Air-ground detection infrared imaging system operating distance computational methods based on Lowtran7 air softwares |
| CN106448525A (en) * | 2016-12-23 | 2017-02-22 | 南京巨鲨显示科技有限公司 | System and method for measuring color uniformity of medical display |
| CN110067950A (en) * | 2019-05-18 | 2019-07-30 | 哈尔滨理工大学 | A kind of full-spectrum LED light mixing system |
Non-Patent Citations (2)
| Title |
|---|
| 刘武辉: "《电脑图文设计》", 31 August 2006 * |
| 慕军营: "基于激光扫描信息的视觉标定方法研究", 《中国优秀硕士论文全文数据库》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112461833A (en) * | 2020-11-23 | 2021-03-09 | 广东弓叶科技有限公司 | Multispectral image acquisition method and system based on intermittent optical filter wheel mechanism |
| CN112461833B (en) * | 2020-11-23 | 2024-04-19 | 广东弓叶科技有限公司 | Multispectral image acquisition method and multispectral image acquisition system based on intermittent optical filter wheel mechanism |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8520074B2 (en) | Determining a total number of people in an IR image obtained via an IR imaging system | |
| US8587657B2 (en) | Determining a number of objects in an IR image | |
| CN106952246A (en) | Visible-infrared image enhancement color fusion method based on visual attention characteristics | |
| KR20050067389A (en) | Image fusion system and method | |
| CN116630148B (en) | Spectral image processing method and device, electronic equipment and storage medium | |
| CN111238641A (en) | Multispectral imaging device and method for color wheel light splitting and imaging based on white light illumination | |
| Liao et al. | Banana disease detection by fusion of close range hyperspectral image and high-resolution RGB image | |
| Rahman et al. | Multisensor fusion and enhancement using the Retinex image enhancement algorithm | |
| EP2374106A1 (en) | Method and device for imaging a target | |
| Zheng | An overview of night vision colorization techniques using multispectral images: From color fusion to color mapping | |
| US20190141262A1 (en) | Systems and methods for detecting light sources | |
| Zheng | A channel-based color fusion technique using multispectral images for night vision enhancement | |
| CS et al. | Improvised Aerial Object Detection approach for YOLOv3 Using Weighted Luminance | |
| Hickman | The development of a multi-band handheld fusion camera | |
| Zhang et al. | Comparison of fusion methods for the infrared and color visible images | |
| EP3430472B1 (en) | Method of producing video images that are independent of the background lighting | |
| KR101795728B1 (en) | Measuring and Processing System for Infrared Image | |
| Karaca et al. | Ground-based panoramic stereo hyperspectral imaging system with multiband stereo matching | |
| CN111027527A (en) | Image feature identification method based on optical frequency features | |
| Yan et al. | Effect of the restoration of saturated signals in hyperspectral image analysis and color reproduction | |
| Cavanillas | The role of color and false color in object recognition with degraded and non-degraded images | |
| Abdellatif | Effect of color pre-processing on color-based object detection | |
| Tate et al. | Artificial illumination identification from an unmanned aerial vehicle | |
| Kotov et al. | Hyperspectral image fusion based on bilateral filtering | |
| Majumder et al. | Hd snapshot diffractive spectral imaging and inferencing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200605 |
|
| RJ01 | Rejection of invention patent application after publication |