[go: up one dir, main page]

CN109342378B - Colony growth state detection device and method based on multi-modal imaging technology - Google Patents

Colony growth state detection device and method based on multi-modal imaging technology Download PDF

Info

Publication number
CN109342378B
CN109342378B CN201811047968.4A CN201811047968A CN109342378B CN 109342378 B CN109342378 B CN 109342378B CN 201811047968 A CN201811047968 A CN 201811047968A CN 109342378 B CN109342378 B CN 109342378B
Authority
CN
China
Prior art keywords
colony
image
growth state
types
imaging
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201811047968.4A
Other languages
Chinese (zh)
Other versions
CN109342378A (en
Inventor
李晨曦
蒋景英
陈文亮
余辉
杜培培
徐可欣
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tianjin University
Original Assignee
Tianjin University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tianjin University filed Critical Tianjin University
Priority to CN201811047968.4A priority Critical patent/CN109342378B/en
Publication of CN109342378A publication Critical patent/CN109342378A/en
Application granted granted Critical
Publication of CN109342378B publication Critical patent/CN109342378B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N21/6486Measuring fluorescence of biological material, e.g. DNA, RNA, cells
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/41Refractivity; Phase-affecting properties, e.g. optical path length
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/47Scattering, i.e. diffuse reflection

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Immunology (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Biochemistry (AREA)
  • General Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Pathology (AREA)
  • Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Measuring Or Testing Involving Enzymes Or Micro-Organisms (AREA)
  • Apparatus Associated With Microorganisms And Enzymes (AREA)
  • Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)

Abstract

本发明公开了一种基于多模态成像技术的菌落生长状态检测装置与方法,该装置包括:一白光光源、一相干激光光源与一荧光激发光源,作为三类光源在菌落样品斜上方分别进行照射供样品图像采集;一彩色相机、一高速相机与一冷却相机,作为三类相机,在菌落样品上方分别对三类光源各自照射下的菌落样品图像进行采集;一成像系统,包括成像镜头、分光片、滤光片与中继目镜,设置在菌落样品与相机之间,实现三类光源分别照射下的菌落样品图像与三类相机对应成像,且成像参数一致;外加一计算机,接收三路成像信号,完成图像融合处理。采用多模态光学成像与信息融合方法消除了培养基背景影响,提高了菌落计数精度,实现了菌落生长状态的全方面检测与判别。

Figure 201811047968

The invention discloses a colony growth state detection device and method based on multi-modal imaging technology. The device comprises: a white light source, a coherent laser light source and a fluorescent excitation light source, which are used as three types of light sources to be obliquely above the colony sample. Irradiate for sample image acquisition; a color camera, a high-speed camera and a cooling camera, as three types of cameras, collect images of the colony samples under the illumination of the three types of light sources above the colony sample respectively; an imaging system, including imaging lenses, The beam splitter, the filter and the relay eyepiece are set between the colony sample and the camera to realize the corresponding imaging of the colony sample images under the three types of light sources and the three types of cameras, and the imaging parameters are consistent; an additional computer is added to receive three channels Image signal, complete image fusion processing. The multimodal optical imaging and information fusion method eliminates the influence of the medium background, improves the colony counting accuracy, and realizes the comprehensive detection and discrimination of the colony growth state.

Figure 201811047968

Description

Colony growth state detection device and method based on multi-modal imaging technology
Technical Field
The invention relates to the field of optical detection, in particular to a colony growth state detection device and method based on a multi-mode imaging technology.
Background
In the field of food and drug safety, microorganisms are the main reasons for food spoilage, microbial toxins (pathogenic bacteria and parasites) and infectious disease epidemics (hepatitis viruses), and food-borne diseases caused by the microorganisms are the first problems of food safety in China. In the food hygiene management of China, the microbial indicators are divided into total bacterial count (total bacterial count), coliform group, mold, yeast and pathogenic bacteria. The bacterial colony is mainly used as a mark for judging the degree of the food polluted by microorganisms, on one hand, the number of the bacterial colony can be observed as the mark for the degree of the food polluted, and the relevant regulations are also carried out in the national standard GB 4789.2-2010 food safety national standard food microbiology test bacterial colony total number determination; on the other hand, the dynamic of bacteria propagation in food can be observed to provide a basis for hygienic evaluation of the test sample. The over-standard colony count or the over-fast bacterial reproduction can indicate that the sanitation condition of the product can not meet the basic sanitation requirement to a certain extent, the nutrient content of the food can be damaged, the food spoilage is accelerated, and the food loses the edible value. Consumers eat food with serious overproof microorganisms, are easy to suffer from intestinal diseases such as dysentery and the like, possibly cause symptoms such as vomit, diarrhea and the like, and harm the health and safety of human bodies.
Colony counting is the most basic and important work of the conventional detection of microorganisms, and is mainly carried out by adopting a culture medium manual counting mode at present, but in the processes of colony culture and manual counting, the following factors bring errors to accurate quantification.
The spreading growth and pollution directly hinder the counting or inhibit the growth of bacteria in the specimen, and influence the accuracy of the counting result. The colony growth is uneven due to different evenness of the cultured bacterium blocks, and the colony chain growth can be caused to a certain extent due to different dispersity, so that the counting difficulty is caused. Counting errors are caused by particulate impurities in the sample, and solid particles in the sample are very similar to the shape and the colony in size and are difficult to distinguish in shape, so that the counting errors are caused. Colonies grow too slowly, resulting in long culture count times required.
At present, in the fields of food and drug safety detection and the like, the monitoring of colony counting and growth states is developed from manual operation, semi-manual operation to automation, intellectualization and the like. The on-line detection method is required to have the advantages of high resolution, rapid dynamic property, multi-mode property and the like, so that the intellectualization and informatization of the colony detection technology are realized.
Disclosure of Invention
Because the bacterial colony variety that needs to detect is many, and the growth process difference is great, in order to improve detection efficiency and precision, need a detection method that can obtain multiple parameter simultaneously. Aiming at the problems, the invention provides a device and a method for detecting the growth state of the bacterial colony based on a multi-mode imaging technology, which adopt an optical detection technology to achieve the effects of high precision, no damage, high speed and the like in the detection process.
For living colonies, the shape of the colony part can be changed in the growth process, the growth state of the living colonies can be acquired by collecting image characteristics, and the living colonies are counted by using an image processing algorithm. In the growth process of the bacterial colony, the scattering structure and the refractive index of the bacterial colony can be changed to a certain extent, after the coherent laser is incident, light with different directions and scattering angles forms a speckle interference phenomenon in space, when the scattering structure and the refractive index are changed, fluctuation of frequency and intensity of speckle images can be caused to be averaged, and the growth process of the bacterial colony can be quantitatively analyzed through certain processing. Various proteins are generated in the colony growth process, fluorescence is generated under the irradiation of light with certain wavelength and intensity, and in the growth process, the fluorescence intensity changes along with the quantity of the proteins with fluorescence effect generated in the protein, so the colony growth state can be obtained by counting the change of the fluorescence intensity.
The invention provides a colony growth state detection device and method based on a multi-modal imaging technology, and the technical scheme is as follows:
the colony growth state detection device based on the multi-modal imaging technology comprises:
a white light source, a coherent laser source and a fluorescence excitation light source which are used as three types of light sources to respectively irradiate above the colony sample in an inclined manner for sample image acquisition;
a color camera, a high-speed camera and a cooling camera which are used as three types of cameras and respectively collect the colony sample images irradiated by the three types of light sources above the colony sample;
the imaging system comprises an imaging lens, a beam splitter, an optical filter and a relay eyepiece, is arranged between the colony sample and the camera, realizes the corresponding imaging of the colony sample image irradiated by the three light sources and the three cameras respectively, and has consistent imaging parameters;
and a computer is additionally arranged to receive the three types of imaging signals to complete image fusion processing.
Furthermore, the white light source, the imaging lens and the color camera form a digital image acquisition device for acquiring a white light image in the bacterial colony growth process in real time.
Furthermore, the coherent laser light source, the imaging lens and the high-speed camera form a laser coherent speckle imaging device for collecting laser speckle images.
Furthermore, the fluorescence excitation light source, the imaging lens, the optical filter and the cooling camera form a fluorescence intensity imaging device for collecting fluorescence images.
The invention also provides a colony growth state detection method based on the multi-modal imaging technology, which comprises the following steps:
the method comprises the following steps: selecting different kinds of common industrial bacterial colonies for culture;
step two: collecting and recording a white light image, a dynamic speckle image and a fluorescence image in the colony culture process by using a colony growth state detection device;
step three: the white light image, the dynamic speckle image and the fluorescence image enter a computer for image fusion processing through an image acquisition device programming digital signal;
step four: comparing the image signal subjected to image fusion processing with the judgment result of a professional, storing the image signal as a training set, and establishing a topological relation between the measurement parameters and the colony growth state;
step five: and (4) bringing the online measurement result into a training set to judge the growth state of the bacterial colony.
Further, the acquisition and processing of the white light image comprises:
denoising the image, and processing the original image by using a Gaussian template to improve the signal-to-noise ratio of the image;
colony features are extracted by adopting an expansion corrosion algorithm, the growth trend and length of hyphae in a single colony are obtained in different growth periods, and the ratio of the number of hypha pixels to the total area is calculated to obtain the colony density;
analyzing pixel points one by one based on the obtained hypha growth characteristic image to obtain the ratio of the number of the link pixel points to the total number of the pixel points to obtain the hypha growth connectivity;
comparing colony white light image characteristics at different times, wherein the image characteristics comprise shape characteristics and color characteristics, and calculating colony characteristic variability according to pixel-by-pixel intensity.
Further, the dynamic speckle image processing includes:
on the basis of obtaining colony scattering characteristics, calculating the dynamic speckle power spectrum of the measured speckle image by adopting a model-based parameter spectrum estimation method, and obtaining colony growth activity parameters, wherein the colony scattering characteristics comprise colony morphology, refractive index, scattering structure, scattering intensity and angle distribution.
Further, the fluorescence image processing includes:
metabolism produces different proteins among the bacterial colony growth process, adopts monochromatic light excitation, produces fluorescence signal, judges the bacterial colony kind according to fluorescence signal wavelength, obtains bacterial colony growth activity according to fluorescence intensity measurement, carries out correlation analysis to fluorescence signal intensity and obtains the biggest time point of bacterial colony metabolic activity, judges bacterial colony growth state.
Furthermore, the three images are fused by a multi-mode information fusion method for different state parameters in the colony growth process of the white light image, the dynamic speckle image and the fluorescence image reaction, and the colony growth state is comprehensively and quantitatively evaluated.
The invention adopts a multi-modal optical imaging method to monitor the growth state of the colony culture, can effectively eliminate the background influence of the culture medium and improve the counting precision of the colony;
by adopting a multi-mode measurement method, not only can the colony technology be realized, but also the growth activity of the colony can be detected according to dynamic speckles;
the method can detect specific protein produced in the growth process of the bacterial colony by adopting a fluorescence detection method, simultaneously judges the type of the bacterial colony according to the characteristic fluorescence of the protein, and obtains the growth state of the bacterial colony according to the fluorescence related signal of the bacterial colony;
the multi-modal information fusion method can be used for comprehensively detecting and distinguishing the growth state of the bacterial colony.
Drawings
FIG. 1 is a schematic diagram of a colony growth state detection device based on a multi-modal imaging technology according to an embodiment of the invention;
FIG. 2 is a flow chart of an algorithm for calculating a dynamic speckle power spectrum in an embodiment of the present invention;
FIG. 3 is a flowchart of a method for detecting the growth status of colonies based on a multi-modal imaging technique according to an embodiment of the present invention.
Detailed Description
In order that the objects, technical solutions and advantages of the present invention will become more apparent, the present invention will be further described in detail with reference to the accompanying drawings in conjunction with the following specific embodiments.
The embodiment of the invention provides a colony growth state detection device based on a multi-modal imaging technology, wherein, referring to fig. 1, the device comprises:
a white light source 1, a coherent laser light source 2 and a fluorescence excitation light source 3 which are used as three types of light sources to respectively irradiate above the colony sample in an inclined manner for sample image acquisition;
a color camera, a high-speed camera and a cooling camera as three cameras, wherein the images of the colony samples under the respective irradiation of the three light sources are respectively collected above the colony samples;
the imaging system comprises an imaging lens, a beam splitter, an optical filter and a relay eyepiece, is arranged between the colony sample and the camera, realizes the corresponding imaging of the colony sample image under the respective irradiation of the three light sources and the three cameras, and has consistent imaging parameters;
and a computer is additionally arranged to receive the three types of imaging signals to complete image fusion processing.
Further, the white light source, the imaging lens and the color camera form a digital image acquisition device for acquiring a white light image in the growth process of the bacterial colony in real time;
in this embodiment, the digital image acquisition device: the device mainly comprises a white light source 1, an imaging lens and a color camera, and can acquire a color image in the growth process of a bacterial colony in real time.
Furthermore, a coherent laser light source, an imaging lens and a high-speed camera form a laser coherent speckle imaging device for collecting laser speckle images;
in this embodiment, the laser coherent speckle imaging apparatus: the system mainly comprises a coherent laser light source 2, an imaging lens and a high-speed camera, and mainly has the function of realizing the acquisition of laser coherent speckle images.
Furthermore, the fluorescence excitation light source, the imaging lens, the optical filter and the cooling camera form a fluorescence intensity imaging device for collecting fluorescence images;
in this embodiment, the fluorescence intensity imaging device: the device mainly comprises a fluorescence excitation light source 3, an imaging lens, a filter wheel and a high-sensitivity cooling camera, and has the main function of realizing fluorescence excitation signal acquisition.
The embodiment of the present invention further provides a method for detecting a growth state of a bacterial colony based on a multi-modal imaging technology, please refer to fig. 3, which includes:
the method comprises the following steps: selecting different kinds of common industrial bacterial colonies for culture;
step two: collecting and recording a white light image, a dynamic speckle image and a fluorescence image in the colony culture process by using a colony growth state detection device;
step three: the white light image, the dynamic speckle image and the fluorescence image enter a computer for image fusion processing through an image acquisition device programming digital signal;
step four: comparing the image signal subjected to image fusion processing with the judgment result of a professional, storing the image signal as a training set, and establishing a topological relation between the measurement parameters and the colony growth state;
step five: and (4) bringing the online measurement result into a training set to judge the growth state of the bacterial colony.
Further, the acquisition and processing of the white light image comprises:
denoising the image, and processing the original image by using a Gaussian template to improve the signal-to-noise ratio of the image;
colony features are extracted by adopting an expansion corrosion algorithm, the growth trend and length of hyphae in a single colony are obtained in different growth periods, and the ratio of the number of hypha pixels to the total area is calculated to obtain the colony density;
analyzing pixel points one by one based on the obtained hypha growth characteristic image to obtain the ratio of the number of the link pixel points to the total number of the pixel points to obtain the hypha growth connectivity;
comparing colony white light image characteristics at different times, wherein the image characteristics comprise shape characteristics and color characteristics, and calculating colony characteristic variability according to pixel-by-pixel intensity.
In this embodiment, the color image processing method for the growth state of the colony includes:
and for the colony color image processing, processing the collected white light image according to the growth characteristics of different strains, extracting image characteristics including shape characteristics and color characteristics, calculating colony area and connectivity, and comparing shape variation within a period of time.
A digital image processing mode is adopted for extracting leaf vein density characteristics, firstly, denoising is carried out on a picture, a Gaussian template is used for processing an original image, and the signal to noise ratio of the image is improved; then, extracting colony shape characteristics by adopting an expansion corrosion algorithm, then respectively obtaining the growth trend and length of hyphae in a single colony for different growth periods, and calculating the ratio of the number of hypha pixel points to the total area to obtain colony density; the calculation of hypha growth connectivity is based on the hypha growth characteristic image that obtains, and pixel point carries out the analysis one by one, obtains linking the ratio between pixel point quantity and the total pixel point quantity, obtains hypha growth connectivity, compares colony white light image characteristic in a period of time respectively, according to pixel intensity one by one, calculates the variability of colony characteristic.
Further, the dynamic speckle image processing includes:
on the basis of obtaining colony scattering characteristics, calculating the dynamic speckle power spectrum of the measured speckle image by adopting a model-based parameter spectrum estimation method, and obtaining colony growth activity parameters, wherein the colony scattering characteristics comprise colony morphology, refractive index, scattering structure, scattering intensity and angle distribution.
In this embodiment, the method for processing a dynamic speckle image of a colony growth state includes:
the measured speckle images are analyzed by a dynamic speckle processing method based on parameter estimation, so that dynamic speckle signals can be obtained, and the growth state of the colony is quantitatively analyzed based on the dynamic speckle signals. The dynamic speckle signals are caused by the scattering structure and the refractive index change in the colony growth process, and the intensity fluctuation and the frequency change of the coherent speckle signals in space and time reflect the colony growth activity. The change frequency and intensity of the laser speckle signal can be measured by using the acquired speckle image in relation to the distribution power spectral density function. The dynamic speckle image obtained by the apparatus of fig. 1 in the present invention can be expressed in a matrix form, and can be expressed in consideration of noise during measurement
Y=HC+n,
Where Y is the measurement signal, H is the dynamic scattering function, C is the volume fraction representing different flow rates, n represents the noise present in the measurement, and the signal and noise are independent of each other.
The dynamic scattering function is mainly related to colony morphology, refractive index and scattering structure size, and the Mie scattering method can be adopted to extract the scattering structure according to the hypha geometric shape displayed by a colony white light image and acquire information such as scattering intensity and angle distribution. On the basis of obtaining colony scattering characteristics, the invention utilizes mathematical methods such as optimization and the like to process laser coherent speckle signals in a recursive iteration mode to obtain power spectrum estimation of dynamic speckle signals, and the principle is as follows:
the covariance matrix of noise and interference for k frequencies is first expressed as:
Figure BDA0001793061790000071
the covariance matrix of the signal samples is represented as:
Figure BDA0001793061790000072
in the case where the measured values and the dynamic scattering function are known, the estimate for x can be given by a weighted least squares criterion:
Figure BDA0001793061790000073
please refer to fig. 2 for the algorithm flow.
Further, the fluorescence image processing includes:
metabolism produces different proteins among the bacterial colony growth process, adopts monochromatic light excitation, produces fluorescence signal, judges the bacterial colony kind according to fluorescence signal wavelength, obtains bacterial colony growth activity according to fluorescence intensity measurement, carries out correlation analysis to fluorescence signal intensity and obtains the biggest time point of bacterial colony metabolic activity, judges bacterial colony growth state.
In this embodiment, the fluorescence image processing method of the colony growth state includes:
in the invention, monochromatic light with a certain wavelength (ultraviolet band) is adopted to irradiate a colony sample, and a narrow-band filter is adopted in image acquisition to remove the influence of exciting light on an acquired fluorescence image. The fluorescence wavelength characteristic that different bacterial colonies produced is different, and the fluorescence signal intensity that the bacterial colony growth process produced is relevant rather than producing protein concentration, and when bacterial colony metabolic activity changed, fluorescence signal intensity also can produce certain fluctuation, and bacterial colony fluorescence signal intensity can be expressed as x (n) in the assumption period, utilizes correlation analysis can obtain the maximum time point of bacterial colony metabolic activity to judge the bacterial colony growth state, the autocorrelation analysis formula can be expressed as:
Figure BDA0001793061790000081
according to the calculated fluorescence intensity autocorrelation function, the time point at which the colony growth state is most active can be judged according to the maximum value of the autocorrelation function.
Furthermore, the three images are fused by a multi-mode information fusion method for different state parameters in the colony growth process of the white light image, the dynamic speckle image and the fluorescence image reaction, and the colony growth state is comprehensively and quantitatively evaluated.
In this embodiment, the image fusion and state monitoring method includes:
the invention utilizes the multi-mode optical imaging system and the corresponding processing method to obtain the white light image, the dynamic speckle image and the fluorescence image which can reflect different state parameters in the colony growth process. In the invention, a multi-mode information fusion method is further adopted to fuse images measured by various different methods, so that the colony growth state can be comprehensively and quantitatively evaluated.
In the embodiment, different types of common industrial bacterial colonies are selected for culture, bacterial colony images in different periods are obtained by using the multi-mode imaging device and method, after information fusion processing is carried out, the bacterial colony images are compared with judgment results of professionals and stored as a training set, and a topological relation between a measurement parameter and the bacterial colony growth state is established; and then, substituting the online measurement result into the established classification fitting model, thereby realizing the judgment of the growth state of the bacterial colony.
The above-mentioned embodiments are intended to illustrate the objects, technical solutions and advantages of the present invention in further detail, and it should be understood that the above-mentioned embodiments are only exemplary embodiments of the present invention and are not intended to limit the present invention, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (9)

1.一种基于多模态成像技术的菌落生长状态检测装置,其特征在于,包括:1. a colony growth state detection device based on multimodal imaging technology, is characterized in that, comprises: 一白光光源、一相干激光光源与一荧光激发光源,作为三类光源在菌落样品斜上方分别进行照射供样品图像采集;A white light source, a coherent laser light source, and a fluorescent excitation light source, as three types of light sources, are respectively irradiated obliquely above the colony sample for sample image acquisition; 一彩色相机、一高速相机与一冷却相机,作为三类相机,在菌落样品上方分别对所述三类光源各自照射下的菌落样品图像进行采集;A color camera, a high-speed camera, and a cooling camera, as three types of cameras, respectively collect images of the colony samples under the illumination of the three types of light sources above the colony samples; 一成像系统,包括成像镜头、分光片、滤光片与中继目镜,设置在所述菌落样品与所述相机之间,实现所述三类光源分别照射下的菌落样品图像与所述三类相机对应成像,且成像参数一致;An imaging system, including an imaging lens, a beam splitter, a filter and a relay eyepiece, arranged between the colony sample and the camera, to realize the image of the colony sample irradiated by the three types of light sources and the three types of light sources respectively. The camera corresponds to imaging, and the imaging parameters are consistent; 外加一计算机,接收三类成像信号,完成图像融合处理;Add a computer to receive three types of imaging signals and complete image fusion processing; 其中,所述菌落生长状态检测装置用于采集并记录不同种类的工业菌落培养过程中的白光图像、动态散斑图像与荧光图像,以及实现所述三类图像经过图像采集装置编程数字信号进入计算机进行图像融合处理的过程,以便于实现将所述图像融合处理后的图像信号与专业人士判断结果进行比对,保存为训练集合,建立测量参数与菌落生长状态之间的拓扑关系,以及对在线测量结果带入所述训练集合,实现对菌落生长状态的判定。Wherein, the colony growth state detection device is used to collect and record white light images, dynamic speckle images and fluorescent images of different types of industrial colony cultivation processes, and realize that the three types of images are programmed into the computer through the digital signals of the image acquisition device. The process of image fusion processing, in order to compare the image signal after the image fusion processing with the judgment results of professionals, save it as a training set, establish the topological relationship between the measurement parameters and the growth state of the colony, and compare the online The measurement results are brought into the training set to realize the determination of the colony growth state. 2.根据权利要求1所述的基于多模态成像技术的菌落生长状态检测装置,其特征在于,所述白光光源、成像镜头与彩色相机构成数字图像采集装置,用来实时采集菌落生长过程中的白光图像。2. The colony growth state detection device based on multimodal imaging technology according to claim 1, wherein the white light source, the imaging lens and the color camera constitute a digital image acquisition device, which is used for real-time acquisition of the colony growth process. white light image. 3.根据权利要求1所述的基于多模态成像技术的菌落生长状态检测装置,其特征在于,所述相干激光光源、成像镜头与高速相机构成激光相干散斑成像装置,用来采集激光散斑图像。3 . The colony growth state detection device based on multimodal imaging technology according to claim 1 , wherein the coherent laser light source, the imaging lens and the high-speed camera constitute a laser coherent speckle imaging device, which is used to collect laser speckle. 4 . spot image. 4.根据权利要求1所述的基于多模态成像技术的菌落生长状态检测装置,其特征在于,所述荧光激发光源、成像镜头、滤光片与冷却相机构成荧光强度成像装置,用来采集荧光图像。4 . The colony growth state detection device based on multimodal imaging technology according to claim 1 , wherein the fluorescence excitation light source, imaging lens, optical filter and cooling camera constitute a fluorescence intensity imaging device, which is used for collecting Fluorescence image. 5.一种基于多模态成像技术的菌落生长状态检测方法,其特征在于,包括:5. A method for detecting a colony growth state based on multimodal imaging technology, characterized in that, comprising: 步骤一:选择不同种类的常见工业菌落进行培养;Step 1: Select different types of common industrial colonies for cultivation; 步骤二:利用权利要求1至4所述的菌落生长状态检测装置,采集并记录菌落培养过程中的白光图像、动态散斑图像与荧光图像;Step 2: using the colony growth state detection device according to claims 1 to 4 to collect and record white light images, dynamic speckle images and fluorescent images during the colony cultivation process; 步骤三:所述三类图像经过图像采集装置编程数字信号进入计算机进行图像融合处理;Step 3: The three types of images enter the computer through the digital signal programmed by the image acquisition device for image fusion processing; 步骤四:将所述图像融合处理后的图像信号与专业人士判断结果进行比对,保存为训练集合,建立测量参数与菌落生长状态之间的拓扑关系;Step 4: Compare the image signal after the image fusion processing with the professional judgment result, save it as a training set, and establish a topological relationship between the measurement parameter and the colony growth state; 步骤五:对在线测量结果带入所述训练集合,实现对菌落生长状态的判定。Step 5: Bring the online measurement results into the training set to realize the determination of the colony growth state. 6.根据权利要求5所述的基于多模态成像技术的菌落生长状态检测方法,其特征在于,所述白光图像的采集与处理包括:6. The method for detecting colony growth state based on multimodal imaging technology according to claim 5, wherein the collection and processing of the white light image comprises: 对图片进行去噪声处理,利用高斯模板处理原始图像,提高图像信噪比;De-noise the image, and use the Gaussian template to process the original image to improve the signal-to-noise ratio of the image; 采用膨胀腐蚀算法进行菌落特征提取,对不同生长时期得到单菌落中菌丝生长走向及长度,计算菌丝像素点数与总面积之比,得到菌落密度;The expansion corrosion algorithm was used to extract the characteristics of the colony, and the growth direction and length of the mycelium in a single colony were obtained at different growth periods, and the ratio of the number of mycelium pixels to the total area was calculated to obtain the colony density; 基于得到的菌丝生长特征图像,逐个像素点进行分析,得到链接像素点数量与总像素点数量之间比值,得到菌丝生长连接度;Based on the obtained mycelial growth characteristic image, analyze pixel by pixel to obtain the ratio between the number of linked pixels and the total number of pixels, and obtain the connection degree of mycelial growth; 比较不同时间下的菌落白光图像特征,所述图像特征包括形状特征和颜色特征,根据逐个像素强度,计算菌落特征变异性。Compare the colony white light image characteristics at different times, the image characteristics include shape characteristics and color characteristics, and calculate the colony characteristic variability according to the pixel-by-pixel intensity. 7.根据权利要求5所述的基于多模态成像技术的菌落生长状态检测方法,其特征在于,所述动态散斑图像处理包括:7. The method for detecting colony growth state based on multimodal imaging technology according to claim 5, wherein the dynamic speckle image processing comprises: 在获取菌落散射特性的基础上,采用基于模型参数谱估计方法计算测量到的散斑图像的动态散斑功率谱,获得菌落生长活性参数,其中,所述菌落散射特性包括菌落形态、折射率、散射结构、散射强度及角度分布。On the basis of obtaining the colony scattering characteristics, the dynamic speckle power spectrum of the measured speckle image is calculated by using the model parameter spectrum estimation method, and the colony growth activity parameters are obtained, wherein the colony scattering characteristics include colony morphology, refractive index, Scattering structure, scattering intensity and angular distribution. 8.根据权利要求5所述的基于多模态成像技术的菌落生长状态检测方法,其特征在于,所述荧光图像处理包括:8. The method for detecting colony growth state based on multimodal imaging technology according to claim 5, wherein the fluorescence image processing comprises: 菌落生长过程中代谢产生不同蛋白质,采用单色光激发,产生荧光信号,根据荧光信号波长判断菌落种类,根据荧光强度测量得到菌落生长活性,对荧光信号强度进行相关分析得到菌落代谢活性最大时间点,判断菌落生长状态。During the colony growth process, different proteins are metabolized to produce different proteins, which are excited by monochromatic light to generate a fluorescent signal. The type of colony is determined according to the wavelength of the fluorescent signal, and the growth activity of the colony is obtained by measuring the fluorescence intensity. , to determine the growth status of the colony. 9.根据权利要求5至8中任一所述的基于多模态成像技术的菌落生长状态检测方法,其特征在于,对所述白光图像、动态散斑图像以及荧光图像反应的菌落生长过程中不同状态参数,进一步采用多模态信息融合方法,将所述三种图像进行融合,综合定量评价菌落生长状态。9. The method for detecting colony growth state based on multimodal imaging technology according to any one of claims 5 to 8, characterized in that, in the colony growth process that responds to the white light image, the dynamic speckle image and the fluorescence image For different state parameters, a multi-modal information fusion method is further adopted to fuse the three images to comprehensively and quantitatively evaluate the colony growth state.
CN201811047968.4A 2018-09-07 2018-09-07 Colony growth state detection device and method based on multi-modal imaging technology Expired - Fee Related CN109342378B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811047968.4A CN109342378B (en) 2018-09-07 2018-09-07 Colony growth state detection device and method based on multi-modal imaging technology

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811047968.4A CN109342378B (en) 2018-09-07 2018-09-07 Colony growth state detection device and method based on multi-modal imaging technology

Publications (2)

Publication Number Publication Date
CN109342378A CN109342378A (en) 2019-02-15
CN109342378B true CN109342378B (en) 2021-01-01

Family

ID=65304992

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811047968.4A Expired - Fee Related CN109342378B (en) 2018-09-07 2018-09-07 Colony growth state detection device and method based on multi-modal imaging technology

Country Status (1)

Country Link
CN (1) CN109342378B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110141208A (en) * 2019-04-12 2019-08-20 上海健康医学院 A blood flow imaging system and method combining dynamic and static images
CN111122526A (en) * 2019-12-18 2020-05-08 中国科学院南海海洋研究所 Water algae detection method based on laser-induced fluorescence and fluid dynamic photomicrography
CN112611701B (en) * 2020-12-10 2023-02-28 天津大学 Circulating tumor cell detection device based on dynamic coherent optical imaging technology

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103842769A (en) * 2011-08-02 2014-06-04 加利福尼亚大学董事会 Rapid, Massively Parallel Single-Cell Drug Response Measurements by Live-Cell Interferometry
CN204116228U (en) * 2014-09-09 2015-01-21 青岛佳明测控科技股份有限公司 The online fluorescence detection device of microorganism
CN106580294A (en) * 2016-12-30 2017-04-26 上海交通大学 Physiological signal remote monitoring system based on multimodal imaging technique and application thereof

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009117033A2 (en) * 2007-12-19 2009-09-24 Singulex, Inc. Scanning analyzer for single molecule detection and methods of use

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103842769A (en) * 2011-08-02 2014-06-04 加利福尼亚大学董事会 Rapid, Massively Parallel Single-Cell Drug Response Measurements by Live-Cell Interferometry
CN204116228U (en) * 2014-09-09 2015-01-21 青岛佳明测控科技股份有限公司 The online fluorescence detection device of microorganism
CN106580294A (en) * 2016-12-30 2017-04-26 上海交通大学 Physiological signal remote monitoring system based on multimodal imaging technique and application thereof

Also Published As

Publication number Publication date
CN109342378A (en) 2019-02-15

Similar Documents

Publication Publication Date Title
US9477875B2 (en) Cell monitoring device, cell monitoring method and program thereof
CN102288606B (en) Pollen viability measuring method based on machine vision
CN109342378B (en) Colony growth state detection device and method based on multi-modal imaging technology
CN106442525B (en) Online detection method for walnut internal shriveling defect
CN101634551A (en) Method and system for detecting surface roughness
CN114062231A (en) Analysis device
CN101158651A (en) A device and method for detecting the internal and external quality of apples based on laser image analysis
CN104949998A (en) Online visual inspection device and method for surface dirt of group origin eggs
CN204287031U (en) A kind of online the cannot-harm-detection device of fish freshness based on high light spectrum image-forming technology
CN101750272A (en) Blood cell image recognition counting method
US20040253660A1 (en) Automated microbiological testing apparatus and method
CN104256882A (en) Method for measuring proportion of reconstituted tobacco in cut tobacco on basis of computer vision
CN110082298A (en) A kind of wheat breed head blight comprehensive resistance identification method based on high spectrum image
CN105466921A (en) Simultaneous detection method of many samples
CN113450317A (en) Immunofluorescence image detection method for gynecological clinical microbial infection
CN115345876B (en) Bolt thread defect detection method based on ultrasonic image
Sanborn et al. In situ biological particle analyzer based on digital inline holography
CN104297136B (en) A kind of method based on high spectrum image to pseudomonas aeruginosa growth prediction
CN102788796B (en) Nutrient diagnosis device and nutrient diagnosis method for nitrogen of crops based on multi-information integration of high spectral images and fluorescent images
JP4477173B2 (en) Microorganism measuring method and apparatus
CN201051074Y (en) Multispectral meat freshness artificial intelligence measurement system
Hassan et al. Automated Cell Counting using Image Processing.
CN106023150A (en) Real-time objective quality evaluation method for digital hologram noise interference
CN116165280A (en) Method and system for monitoring internal defects of laser cladding process in real time
Huang et al. IDENTIFICATION AND ENUMERATION OF SALMONELLA ON SAMPLE SLIDES OF POULTRY CARCASSWASHWATER USING IMAGE ANALYSIS WITH FLUORESCENT MICROSCOPY

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20210101

Termination date: 20210907

CF01 Termination of patent right due to non-payment of annual fee