CN103792235A - Diffuse transmission spectrum and image information fusion method for detecting internal quality of honeydew melons on line and device - Google Patents
Diffuse transmission spectrum and image information fusion method for detecting internal quality of honeydew melons on line and device Download PDFInfo
- Publication number
- CN103792235A CN103792235A CN201410011464.2A CN201410011464A CN103792235A CN 103792235 A CN103792235 A CN 103792235A CN 201410011464 A CN201410011464 A CN 201410011464A CN 103792235 A CN103792235 A CN 103792235A
- Authority
- CN
- China
- Prior art keywords
- honeydew melon
- honeydew
- melon
- image acquisition
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Investigating Or Analysing Materials By Optical Means (AREA)
- Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
Abstract
本发明涉及一种漫透射光谱与图像信息融合的蜜瓜内部品质在线检测方法及装置,包括建立蜜瓜内部品质无损检测的模型和蜜瓜样品内部品质进行在线检测的步骤,装置包括输送装置、信号控制单元、漫透射光谱采集装置、蜜瓜图像采集装置、蜜瓜内部品质检测软件系统,所述的输送装置上设置有盛放蜜瓜的拖环,每一拖环均依次穿过蜜瓜图像采集装置的图像采集室和漫透射光谱采集装置的光谱采集室;图像采集室内的激光传感器和两个工业相机、以及光谱采集室内的激光传感器、近红外光谱仪均通过信号控制单元与安装有蜜瓜内部品质检测软件系统的计算机相连接。可有效检测蜜瓜内部品质,克服了无法通过图像信息精确检测蜜瓜内部品质指标的不足。
The invention relates to a method and device for online detection of the internal quality of honeydew melons based on fusion of diffuse transmission spectrum and image information. Signal control unit, diffuse transmission spectrum acquisition device, honeydew melon image acquisition device, honeydew melon internal quality detection software system, the conveying device is provided with tow rings for holding honeydew melons, and each tow ring passes through the honeydew melons in turn The image acquisition room of the image acquisition device and the spectrum acquisition room of the diffuse transmission spectrum acquisition device; the laser sensor and two industrial cameras in the image acquisition room, as well as the laser sensor and the near-infrared spectrometer in the spectrum acquisition room communicate with the honeycomb device through the signal control unit. It is connected with the computer of the internal quality inspection software system of melon. It can effectively detect the internal quality of the honeydew melon, and overcomes the deficiency that the internal quality index of the honeydew melon cannot be accurately detected through image information.
Description
the
技术领域 technical field
本发明涉及蜜瓜内部品质在线无损检测方法及装置,尤其涉及采用漫透射光谱与图像信息融合的蜜瓜内部品质在线检测方法与装置。 The invention relates to an online non-destructive detection method and device for the internal quality of honeydew melons, in particular to an online detection method and device for the internal quality of honeydew melons using diffuse transmission spectrum and image information fusion. the
the
背景技术 Background technique
蜜瓜是西北地区重要的经济作物,长期以来,蜜瓜销售过程中成熟度和品质划分只是采用传统的人工法或破坏性抽样检测,耗时费力,主观因素影响大,检测和分级粗放,造成良莠混杂,降低了该果品的市场竞争力和销售价格。解决蜜瓜存在的上述问题不能单纯依靠培育新品种、改善种植和储运条件,而是更要注重在商品化过程中的品质检测和分级处理技术。 Honeydew melon is an important economic crop in Northwest China. For a long time, the maturity and quality classification of honeydew melons in the sales process has only been done by traditional manual methods or destructive sampling inspections. Good and bad are mixed, which reduces the market competitiveness and sales price of the fruit. To solve the above-mentioned problems of honeydew melons, we cannot simply rely on cultivating new varieties, improving planting and storage and transportation conditions, but more attention should be paid to quality testing and grading processing technologies in the process of commercialization. the
品质分级是蜜瓜商品化处理的重要环节,决定蜜瓜品质的主要指标是其内部品质指标(糖度、硬度),但在采用漫透射光谱技术在对其进行内部品质检测时,光谱信息中不仅包含其内部品质信息,也包含其外部特征信息,如形状、大小信息,而蜜瓜形状、大小的差异对漫透射光谱存在明显影响,进而影响品质检测精度。目前,还没有可靠的从漫透射光谱中消除这些影响的方法。因此,如在对蜜瓜的漫透射光谱分析时,知道其形状、大小信息,进而在建立检测模型时,考虑形状、大小对光谱的影响,定可提高检测精度。图像对水果的外观特征快速无损检测具有独特优势,不仅可检测蜜瓜的形状、大小,而且可检测其外观颜色特征,而颜色特征又与蜜瓜的内部品质具有一定的相关性。因此,如将光谱信息与图像信息融合,借助多传感器信息融合取长补短、比单一传感器更优越的性能进行蜜瓜内部品质的检测,不仅可解决蜜瓜形状、大小差异对检测精度的影响问题,也可利用蜜瓜的外观颜色特征与其内部品质具有相关性的特点提高检测精度,同时也克服了图像无法深入蜜瓜内部进行品质指标精确检测的不足。因此,开展基于蜜瓜漫透射光谱与图像信息融合的内部品质检测方法与装置研究具有重要意义。 Quality grading is an important link in the commercialization of honeydew melons. The main indicators that determine the quality of honeydew melons are its internal quality indicators (sugar content, hardness). It contains its internal quality information, as well as its external feature information, such as shape and size information, and the difference in shape and size of honeydew melon has a significant impact on the diffuse transmission spectrum, which in turn affects the quality detection accuracy. Currently, there is no reliable way to remove these effects from diffuse transmission spectra. Therefore, if we know the shape and size information of honeydew melon when analyzing its diffuse transmission spectrum, and then consider the influence of shape and size on the spectrum when establishing a detection model, the detection accuracy will definitely be improved. The image has a unique advantage in the rapid and non-destructive detection of the appearance characteristics of the fruit. It can not only detect the shape and size of the honeydew melon, but also detect its appearance color characteristics, and the color characteristics have a certain correlation with the internal quality of the honeydew melon. Therefore, if the spectral information and image information are fused, the internal quality of honeydew melons can be detected with the help of multi-sensor information fusion, which has better performance than a single sensor. The feature that the appearance and color characteristics of honeydew melon are correlated with its internal quality can be used to improve the detection accuracy, and at the same time, it also overcomes the deficiency that the image cannot go deep into the inside of honeydew melon for accurate detection of quality indicators. Therefore, it is of great significance to carry out the research on the internal quality detection method and device based on the fusion of honeydew melon diffuse transmission spectrum and image information. the
the
发明内容 Contents of the invention
为克服现有技术的缺陷,本发明提供一种漫透射光谱与图像信息融合的蜜瓜内部品质在线检测方法及其装置,本发明的技术方案是:一种漫透射光谱与图像信息融合的蜜瓜内部品质在线检测方法,包括建立蜜瓜内部品质无损检测模型和蜜瓜样品内部品质进行在线检测的步骤,具体如下: In order to overcome the defects of the prior art, the present invention provides an on-line detection method and device for the internal quality of honeydew melons by fusion of diffuse transmission spectrum and image information. The online detection method for the internal quality of melons includes the steps of establishing a non-destructive detection model for the internal quality of honeydew melons and performing online detection of the internal quality of honeydew melon samples, specifically as follows:
(1) 建立蜜瓜内部品质无损检测的模型: (1) Establish a model for non-destructive testing of the internal quality of honeydew melon:
a、对批量蜜瓜样品进行在线漫透射光谱以及蜜瓜正面与侧面的图像采集; a. Carry out online diffuse transmission spectroscopy and image acquisition of the front and side of honeydew melons for batches of honeydew melon samples;
b、对采集的样品光谱进行校正预处理; b. Calibrate and preprocess the collected sample spectra;
c、提取品质指标糖度、硬度敏感光谱信息,建立特征波段的模型; c. Extract quality index sugar content and hardness sensitive spectral information, and establish a model of characteristic bands;
d、对采集到的蜜瓜图像进行预处理,提取品质指标糖度、硬度敏感颜色特征子集; d. Preprocessing the collected honeydew melon images, extracting quality index sugar content and hardness-sensitive color feature subsets;
e、计算蜜瓜体积; e. Calculate the volume of honeydew melon;
f、计算蜜瓜的果形指数; f, calculate the fruit shape index of honeydew melon;
g、将颜色特征子集、体积、果形指数作为图像特征变量与光谱信息进行融合,建立蜜瓜内部品质的在线检测模型。 g. The color feature subset, volume, and fruit shape index are fused as image feature variables and spectral information to establish an online detection model for the internal quality of honeydew melons.
(2)建立好蜜瓜内部品质在线检测模型后,对未知蜜瓜样品内部品质进行在线检测: (2) After establishing the online detection model of the internal quality of honeydew melon, conduct online detection of the internal quality of unknown honeydew melon samples:
a、将蜜瓜水平放置在输送装置的拖环上,匀速平稳向前运动; a. Place the honeydew melon horizontally on the drag ring of the conveying device, and move forward at a constant speed;
b、当蜜瓜到达漫透射光谱采集室时,采集室内置的激光传感器输出一个蜜瓜到达反馈信号到信号控制单元,由信号控制单元发出命令触发近红外光谱仪,近红外光谱仪开始采集被测蜜瓜的光谱信息,蜜瓜通过后,激光传感器输出一个蜜瓜离开反馈信号到信号控制单元,由信号控制单元发出命令停止近红外光谱仪工作; b. When the melon reaches the diffuse transmission spectrum collection room, the built-in laser sensor in the collection room outputs a melon arrival feedback signal to the signal control unit, and the signal control unit sends a command to trigger the near-infrared spectrometer, and the near-infrared spectrometer starts to collect the measured honey For the spectral information of the melon, after the honeydew melon passes, the laser sensor outputs a feedback signal of the honeydew melon leaving to the signal control unit, and the signal control unit issues a command to stop the near-infrared spectrometer from working;
c、当蜜瓜到达蜜瓜图像采集室时,图像采集室内的激光传感器输出一个蜜瓜到达反馈信号到信号控制单元,由信号控制单元发出命令触发两部工业相机,两部工业相机分别采集被测蜜瓜的正面图像信息与侧面图像信息,蜜瓜通过后,图像采集室内的激光传感器输出一个蜜瓜离开反馈信号到信号控制单元,由信号控制单元发出命令停止工业相机工作; c. When the honeydew melon arrives at the honeydew melon image acquisition room, the laser sensor in the image acquisition room outputs a honeydew melon arrival feedback signal to the signal control unit, and the signal control unit sends a command to trigger two industrial cameras, and the two industrial cameras respectively capture the Measure the front image information and side image information of the honeydew melon. After the honeydew melon passes, the laser sensor in the image acquisition room outputs a feedback signal of the honeydew melon leaving to the signal control unit, and the signal control unit issues an order to stop the industrial camera from working;
d、将采集到的光谱与图像信息输入到步骤(1)中所建立的蜜瓜内部品质在线检测模型中,得到被测蜜瓜的内部品质,进而判断蜜瓜等级; d. Input the collected spectrum and image information into the online detection model of the internal quality of honeydew melon established in step (1), obtain the internal quality of the measured honeydew melon, and then judge the grade of honeydew melon;
一种漫透射光谱与图像信息融合的蜜瓜内部品质在线检测方法的装置,包括输送装置、信号控制单元、漫透射光谱采集装置、蜜瓜图像采集装置和计算机,所述的输送装置的传送带设置有盛放蜜瓜的拖环,每一拖环均依次穿过蜜瓜图像采集装置的图像采集室和漫透射光谱采集装置的光谱采集室;图像采集室内的激光传感器和两个工业相机、光谱采集室内的激光传感器、近红外光谱仪均通过信号控制单元与安装有蜜瓜内部品质检测软件系统的计算机相连接。 A device for the online detection method of the internal quality of honeydew melon based on the fusion of diffuse transmission spectrum and image information, including a conveying device, a signal control unit, a diffuse transmission spectrum acquisition device, a honeydew melon image acquisition device and a computer, and the conveyor belt of the conveying device is set There are drag rings holding honeydew melons, and each drag ring passes through the image acquisition room of the honeydew melon image acquisition device and the spectrum acquisition room of the diffuse transmission spectrum acquisition device in turn; the laser sensor in the image acquisition room and two industrial cameras, spectrum The laser sensor and near-infrared spectrometer in the collection room are all connected to the computer installed with the internal quality detection software system of honeydew melon through the signal control unit.
所述的输送装置(19)包括支撑连接架(26)以及安装在支撑连接架(26)上的第一皮带支撑辊(27)、第二皮带支撑辊(28)、第一驱动链轮(29)、驱动链条(30)、第二驱动链轮(31)、调速电机(32)和传送带(5),第二驱动链轮(31)安装在调速电机(32)上,第一驱动链轮(29)安装在第一皮带支撑辊(27)上,所述的第一驱动链轮(29)和第二驱动链轮(31)通过驱动链条(30)进行传动连接,传送带(5)绕在支撑连接架上的第一皮带支承辊27和第二皮带支承辊(28)的外围,数个拖环均匀的固定在传送带(5)上。 The conveying device (19) includes a support connection frame (26) and a first belt support roller (27), a second belt support roller (28), a first drive sprocket ( 29), the driving chain (30), the second driving sprocket (31), the speed regulating motor (32) and the conveyor belt (5), the second driving sprocket (31) is installed on the speed regulating motor (32), the first The drive sprocket (29) is installed on the first belt support roller (27), and the first drive sprocket (29) and the second drive sprocket (31) are connected by drive chain (30), and the conveyor belt ( 5) Wrap around the periphery of the first belt support roller 27 and the second belt support roller (28) on the supporting link frame, and several drag rings are evenly fixed on the conveyor belt (5). the
所述的漫透射光谱采装置包括光谱采集室(18)、圆弧状光源固定架(8)、卤素灯光源(10)、光谱采集室内的激光传感器(7)、光纤探头(15)、近红外光谱仪(21),其中卤素灯光源(10) 、光谱采集室内的激光传感器(7)、圆弧状光源固定架(8)位于光谱采集室(18)内部,卤素灯光源(10)均匀分布在圆弧状光源固定架(8)上,两个圆弧状光源固定架(8)相对设置,拖环从两个圆弧状光源固定架(8)中间穿过;在光谱采集室(18)的上部设置有通风口,在通风口的上部安装有风扇(9),光纤探头(15)位于拖环的底部,通过光纤与近红外光谱仪(21)连接。 The diffuse transmission spectrum acquisition device includes a spectrum acquisition room (18), an arc-shaped light source fixing frame (8), a halogen light source (10), a laser sensor (7) in the spectrum acquisition room, an optical fiber probe (15), a near Infrared spectrometer (21), wherein the halogen light source (10), the laser sensor (7) in the spectrum collection room, and the arc-shaped light source fixing frame (8) are located inside the spectrum collection room (18), and the halogen light source (10) is evenly distributed On the arc-shaped light source fixing frame (8), two arc-shaped light source fixing frames (8) are arranged oppositely, and the drag ring passes through the middle of the two arc-shaped light source fixing frames (8); in the spectrum collection room (18 ) is provided with a vent on the top of the vent, a fan (9) is installed on the top of the vent, the optical fiber probe (15) is located at the bottom of the drag ring, and is connected to the near-infrared spectrometer (21) through an optical fiber. the
所述的蜜瓜图像采集装置包括蜜瓜图像采集室(11)、第一工业相机(1)、第二工业相机(4)、LED光源(3)、图像采集室内的激光传感器(2),其中第一工业相机(1)、第二工业相机(4)、图像采集室内的激光传感器(2)和LED光源(3)位于蜜瓜图像采集室(11)内部,两个图像采集室内的激光传感器(2)相对设置,LED光源(3)分别设置在蜜瓜图像采集室的四角;第一工业相机(1)和第二工业相机(4)分别采集被测蜜瓜的正面图像信息与侧面图像信息。 The honeydew image acquisition device includes a honeydew image acquisition room (11), a first industrial camera (1), a second industrial camera (4), an LED light source (3), a laser sensor (2) in the image acquisition room, Among them, the first industrial camera (1), the second industrial camera (4), the laser sensor (2) and the LED light source (3) in the image acquisition room are located inside the honeydew image acquisition room (11), and the laser sensors in the two image acquisition rooms The sensors (2) are arranged oppositely, and the LED light sources (3) are respectively arranged at the four corners of the honeydew melon image collection room; the first industrial camera (1) and the second industrial camera (4) collect the frontal image information and the side image information of the measured honeydew melon respectively. image information. the
所述的传送带(5)为两条,相互之间平行设置,中间形成空隙;两条传送带均通过第一皮带支承辊和第二皮带支承辊安装在支撑连接架上,拖环的两端分别固定安装在两条传送带上。 There are two conveyor belts (5), which are arranged parallel to each other, forming a gap in the middle; the two conveyor belts are installed on the support connecting frame through the first belt support roller and the second belt support roller, and the two ends of the drag ring are respectively Fixed installation on two conveyor belts. the
the
本发明的优点是:上述方案提供了一种基于漫透射光谱和图像信息融合的蜜瓜内部品质在线检测及分级方法与装置,该方法将蜜瓜光谱信息与图像信息进行融合,可有效检测蜜瓜内部品质,同时也克服了无法通过图像信息精确检测蜜瓜内部品质指标的不足。 The advantages of the present invention are: the above scheme provides a method and device for on-line detection and grading of the internal quality of honeydew melons based on the fusion of diffuse transmission spectrum and image information. The internal quality of the honeydew melon can be improved, and at the same time, the deficiency that the internal quality index of the honeydew melon cannot be accurately detected through the image information is overcome.
the
附图说明 Description of drawings
图1是本发明建立模型的方法流程示意图; Fig. 1 is the schematic flow chart of the method for modeling of the present invention;
图2是本发明的模型建立后进行水果在线品质检测方法流程示意图; Fig. 2 is a schematic flow chart of the fruit online quality detection method after the model of the present invention is established;
图3是本发明装置的示意图; Fig. 3 is the schematic diagram of device of the present invention;
图4是图3中输送装置的示意图; Fig. 4 is the schematic diagram of delivery device in Fig. 3;
图5是本发明中蜜瓜图像采集装置的俯视图; Fig. 5 is the top view of honeydew melon image acquisition device among the present invention;
图6是图5的侧视图; Fig. 6 is a side view of Fig. 5;
图7是本发明中漫透射光谱采集装置的俯视图; Fig. 7 is a top view of the diffuse transmission spectrum acquisition device in the present invention;
图8是图7的侧视图; Fig. 8 is a side view of Fig. 7;
图9是本发明中信号控制单元内PLC与外部设备连接示意图; Figure 9 is a schematic diagram of the connection between PLC and external equipment in the signal control unit of the present invention;
图10是计算蜜瓜体积的方法示意图; Figure 10 is a schematic diagram of the method for calculating the volume of honeydew melon;
图11是图10中Δh变的很小时的示意图; Figure 11 is a schematic diagram when Δh in Figure 10 becomes very small;
图12是计算蜜瓜果形指数的方法示意图。 Fig. 12 is a schematic diagram of a method for calculating the fruit shape index of honeydew melon. the
the
具体实施方式 Detailed ways
下面结合具体实施例来进一步描述本发明,本发明的优点和特点将会随着描述而更为清楚。但这些实施例仅是范例性的,并不对本发明的范围构成任何限制。本领域技术人员应该理解的是,在不偏离本发明的精神和范围下可以对本发明技术方案的细节和形式进行修改或替换,但这些修改和替换均落入本发明的保护范围内。 The present invention will be further described below in conjunction with specific embodiments, and the advantages and characteristics of the present invention will become clearer along with the description. However, these embodiments are only exemplary and do not constitute any limitation to the scope of the present invention. Those skilled in the art should understand that the details and forms of the technical solutions of the present invention can be modified or replaced without departing from the spirit and scope of the present invention, but these modifications and replacements all fall within the protection scope of the present invention. the
参见图1至图3,本发明涉及一种基于漫透射光谱与图像信息融合的蜜瓜内部品质在线检测方法,包括建立蜜瓜内部品质无损检测的模型和蜜瓜样品内部品质进行在线检测的步骤,具体如下: Referring to Figures 1 to 3, the present invention relates to an online detection method for the internal quality of honeydew melon based on the fusion of diffuse transmission spectrum and image information, including the steps of establishing a non-destructive detection model for the internal quality of honeydew melon and online detection of the internal quality of honeydew melon samples ,details as follows:
(1) 建立蜜瓜内部品质无损检测的模型: (1) Establish a model for non-destructive testing of the internal quality of honeydew melon:
a、对批量蜜瓜样品进行在线漫透射光谱以及蜜瓜正面与侧面的图像采集; a. Carry out online diffuse transmission spectroscopy and image acquisition of the front and side of honeydew melons for batches of honeydew melon samples;
b、对采集的样品光谱进行校正预处理,采用平滑、微分、多元散射校正、Norris滤波及基线进行校正预处理; b. Calibrate and preprocess the collected sample spectrum, using smoothing, differential, multivariate scattering correction, Norris filtering and baseline for correction preprocessing;
c、提取品质指标糖度、硬度敏感光谱信息,建立特征波段的模型;该步骤采用模拟退火法与遗传算法相结合的模拟遗传算法; c. Extract quality index sugar content and hardness sensitive spectral information, and establish a model of characteristic band; this step adopts the simulated genetic algorithm combining simulated annealing method and genetic algorithm;
d、对采集到的蜜瓜图像进行预处理,提取品质指标糖度、硬度敏感颜色特征子集;采用形态学去噪、阈值分割、图像标记对采集到的蜜瓜图像进行预处理,采用神经网络算法提取品质指标糖度、硬度敏感颜色特征子集(H、L*、a*、b*、 )。读取河套蜜瓜图像转化成二值图,针对蜜瓜图像特点通过对图像分别进行腐蚀、膨胀、开运算进行形态学去噪,采用比较成熟的Otsu方法计算图像的全局阈值,并且以此阈值将图像转换成二值图,然后对二值图进行填充,这样做的目的是按照灰度级对像素集合进行划分,得倒的每个子集形成一个与现实景物相对应的区域,各区域内部具有一致的属性,而相邻区域布局有这种一致属性,通过这种方法实现阈值分割,对蜜瓜图片进行完开运算后,并且找到蜜瓜的形心,以蜜瓜形心为基准在蜜瓜图片上标记出六个方形框,这六个框就是我们采集糖度的区域,对已标记的图像,通过MATLAB语句实现颜色平均值的提取,分别提取了R、G、B、H、S、I 、L*、a*、b*等九种颜色特征,对这九种颜色特征采用BP神经网络进行颜色最优特征值得选取,找到与蜜瓜内部品质相关性最高的特征子集作为输入量,为后续信息融合提供数据支持。 d. Preprocess the collected honeydew melon images, extract quality index sugar content, hardness-sensitive color feature subsets; use morphological denoising, threshold segmentation, and image labeling to preprocess the collected honeydew melon images, and use neural networks The algorithm extracts quality index sugar content, hardness-sensitive color feature subsets (H, L*, a*, b*, ). Read the Hetao honeydew melon image and convert it into a binary image. According to the characteristics of the honeydew melon image, the image is corroded, expanded, and opened to perform morphological denoising. The more mature Otsu method is used to calculate the global threshold of the image, and the threshold Convert the image into a binary image, and then fill the binary image. The purpose of this is to divide the pixel set according to the gray level, and each subset of the inverted image forms an area corresponding to the real scene. The interior of each area It has a consistent attribute, and the adjacent area layout has this consistent attribute. Through this method, the threshold segmentation is realized. After the honeydew picture is opened, and the centroid of the honeydew is found, the centroid of the honeydew is used as the benchmark in the Six square boxes are marked on the honeydew melon picture. These six boxes are the areas where we collect sugar content. For the marked image, the color average value is extracted through MATLAB statements, and R, G, B, H, and S are extracted respectively. , I , L*, a*, b* and other nine color features, use BP neural network to select the optimal color feature value for these nine color features, and find the feature subset with the highest correlation with the internal quality of honeydew melon as input Quantity, to provide data support for subsequent information fusion.
e、计算蜜瓜体积;由于蜜瓜近似椭圆,可以假设理想蜜瓜二维图像关于纵径对称,采用分层积分思想(理想蜜瓜的像素体积可以看作一系列圆台体积在纵径方向的积分)计算蜜瓜体积;假设理想蜜瓜是关于纵径对称的旋转体,下图是理想蜜瓜的轮廓,图中L是纵径,且为竖直方向,A是顶点,直线CD、EF与纵径垂直,与轮廓的左交点为C、E右交点为D、F,CD与EF之间的距离为Δh、=、=,如图10所示;当Δh逐渐变得很小时,由EF、CD所围部分可近似看成圆台,如图11所示,由此可计算圆台的体积为: e. Calculate the volume of the honeydew melon; since the honeydew melon is approximately elliptical, it can be assumed that the two-dimensional image of the ideal honeydew melon is symmetrical about the longitudinal diameter, and the idea of layered integration is adopted (the pixel volume of the ideal honeydew melon can be regarded as the volume of a series of conical frustums in the longitudinal direction) Integral) to calculate the volume of the honeydew melon; assuming that the ideal honeydew melon is a symmetric body of rotation about the longitudinal diameter, the following figure is the outline of the ideal honeydew melon, in the figure L is the longitudinal diameter, and is the vertical direction, A is the vertex, and the straight lines CD, EF It is perpendicular to the longitudinal diameter, the left intersection with the contour is C, the right intersection with E is D, F, the distance between CD and EF is Δh, = , = , as shown in Figure 10; when Δh gradually becomes very small, the part surrounded by EF and CD can be approximately regarded as a circular frustum, as shown in Figure 11, from which the volume of the circular frustum can be calculated as:
因此从微积分的角度看,理想蜜瓜的体积可以看作一系列圆台在纵径方向L上的积分 Therefore, from the perspective of calculus, the volume of an ideal honeydew melon can be regarded as the integral of a series of circular frustums in the longitudinal direction L
f、计算蜜瓜的果形指数;鉴于蜜瓜图像近似椭圆的特征,通过G通道截流法得到蜜瓜的外形,提取蜜瓜边缘信息,根据边缘信息找到蜜瓜的形心,然后采用软件卡尺法计算蜜瓜的果形指数;采用最小外接矩形法进行蜜瓜的纵横经检测,对已保存的图片进行预处理,选取RGB颜色空间,提取G分量图像,并且转换成二值图,采用cnny算子进行边缘检测,提取出蜜瓜边缘计算包含该边缘的最小外接矩形得出蜜瓜纵径横径,进而计算蜜瓜果形指数为:。 f. Calculate the fruit shape index of the honeydew melon; in view of the approximate elliptical characteristics of the honeydew melon image, the shape of the honeydew melon is obtained through the G channel interception method, the edge information of the honeydew melon is extracted, the centroid of the honeydew melon is found according to the edge information, and then the software caliper is used method to calculate the fruit shape index of honeydew melon; use the minimum circumscribed rectangle method to detect the vertical and horizontal of honeydew melon, preprocess the saved pictures, select the RGB color space, extract the G component image, and convert it into a binary image, using cnny The operator performs edge detection, extracts the edge of the honeydew melon and calculates the smallest circumscribed rectangle containing the edge to obtain the longitudinal diameter of the honeydew melon Diameter , and then calculate the fruit shape index of honeydew melon as: .
the
g、将颜色特征子集、体积、果形指数作为图像特征变量与光谱信息进行融合,建立蜜瓜内部品质的在线检测模型。 g. The color feature subset, volume, and fruit shape index are fused as image feature variables and spectral information to establish an online detection model for the internal quality of honeydew melons.
(2)建立好蜜瓜内部品质在线检测模型后,对未知蜜瓜样品内部品质进行在线检测: (2) After establishing the online detection model of the internal quality of honeydew melon, conduct online detection of the internal quality of unknown honeydew melon samples:
a、将蜜瓜水平放置在输送装置的拖环上,匀速平稳向前运动; a. Place the honeydew melon horizontally on the drag ring of the conveying device, and move forward at a constant speed;
b、当蜜瓜到达漫透射光谱采集室时,采集室内置的激光传感器输出一个蜜瓜到达反馈信号到信号控制单元,由信号控制单元发出命令触发光谱仪,光谱仪开始采集被测蜜瓜的光谱信息,蜜瓜通过后,激光传感器输出一个蜜瓜离开反馈信号到信号控制单元,由信号控制单元发出命令停止光谱仪工作; b. When the honeydew melon reaches the diffuse transmission spectrum collection room, the built-in laser sensor in the collection room outputs a honeydew melon arrival feedback signal to the signal control unit, and the signal control unit sends a command to trigger the spectrometer, and the spectrometer starts to collect the spectral information of the measured honeydew melon , after the melon passes, the laser sensor outputs a melon leaving feedback signal to the signal control unit, and the signal control unit issues a command to stop the spectrometer;
c、当蜜瓜到达蜜瓜图像采集室时,采集室内置的激光传感器输出一个蜜瓜到达反馈信号到信号控制单元,由信号控制单元发出命令触发两部工业相机,两部工业相机分别采集被测蜜瓜的正面图像信息与侧面图像信息,蜜瓜通过后,激光传感器输出一个蜜瓜离开反馈信号到信号控制单元,由信号控制单元发出命令停止工业相机工作; c. When the honeydew melon arrives at the honeydew melon image collection room, the built-in laser sensor in the collection room outputs a honeydew melon arrival feedback signal to the signal control unit, and the signal control unit sends a command to trigger two industrial cameras. Measure the front image information and side image information of the honeydew melon. After the honeydew melon passes, the laser sensor outputs a feedback signal of the honeydew melon leaving to the signal control unit, and the signal control unit issues an order to stop the industrial camera from working;
d、将采集到的光谱与图像信息输入到步骤(1)中所建立的蜜瓜内部品质在线检测模型中,得到被测蜜瓜的内部品质,进而判断和划分蜜瓜等级; d. Input the collected spectrum and image information into the online detection model of the internal quality of honeydew melon established in step (1), obtain the internal quality of the measured honeydew melon, and then judge and classify the honeydew melon;
参见图3至图9,一种实施基于漫透射光谱与图像信息融合的蜜瓜内部品质在线检测方法及装置,包括输送装置、信号控制单元14、漫透射光谱采集装置、蜜瓜图像采集装置和计算机,所述的输送装置的传送带上设置有盛放蜜瓜的拖环,每一拖环均依次穿过蜜瓜图像采集装置的图像采集室11和漫透射光谱采集装置的光谱采集室18;图像采集室内的激光传感器2和两个工业相机(第一工业相机1、第二工业相机4、光谱采集室内的激光传感器7、近红外光谱仪21均通过信号控制单元14与安装有蜜瓜内部品质检测软件系统的计算机24相连接。
Referring to Figures 3 to 9, a method and device for online detection of the internal quality of honeydew melon based on fusion of diffuse transmission spectrum and image information, including a conveying device, a
所述的输送装置19包括支撑连接架26以及安装在支撑连接架(26)上的第一皮带支撑辊27、第二皮带支撑辊28、第一驱动链轮29、驱动链条30、第二驱动链轮31、调速电机32、传送带5组成,第二驱动链轮31安装在调速电机32上,第一驱动链轮29安装在第一皮带支撑辊27上,所述的第一驱动链轮29和第二驱动链轮31通过驱动链条30进行连接,传送带5绕在支撑连接架上的第一皮带支承辊27和第二皮带支承辊28的外围,数个拖环6均匀的固定在传送带上。
The conveying
所述的传送带为两条,相互之间平行设置,中间形成空隙;两条传送带均通过第一皮带支承辊和第二皮带支承辊安装在支撑连接架上;拖环的两端分别固定安装在两条传送带上,当将蜜瓜放在托环上以后,蜜瓜的底部暴露,近红外光谱仪位于光谱采集室的外部,处于两传送带之间空隙的底部,用于对拖环内的蜜瓜进行光谱采集,其正面(即顶部)被位于正面的工业相机所拍摄。 There are two conveyor belts, which are arranged parallel to each other, and a gap is formed in the middle; the two conveyor belts are installed on the support connecting frame through the first belt support roller and the second belt support roller; the two ends of the drag ring are respectively fixed on the On the two conveyor belts, when the honeydew melons are placed on the support ring, the bottom of the honeydew melon is exposed. The near-infrared spectrometer is located outside the spectrum collection room, at the bottom of the gap between the two conveyor belts, and is used to check the honeydew melons in the drag ring. For spectral collection, its front (ie top) is photographed by an industrial camera located on the front. the
所述的漫透射光谱采装置包括光谱采集室18、圆弧状光源固定架8、卤素灯光源10、光谱采集室内的激光传感器7、光纤探头15、近红外光谱仪21,其中卤素灯光源10 、光谱采集室内的激光传感器7、圆弧状光源固定架8位于光谱采集室18内部,卤素灯光源10均匀分布在圆弧状光源固定架8上,两个圆弧状光源固定架8相对设置,拖环从两个圆弧状光源固定架中间穿过;在光谱采集室的上部设置有通风口,在通风口的上部安装有风扇9,光纤探头15位于托环的底部,通过光纤(16)与近红外光谱仪(21)连接。
Described diffuse transmission spectrum collecting device comprises
所述的蜜瓜图像采集装置包括蜜瓜图像采集室11、第一工业相机1、第二工业相机4、LED光源3、图像采集室内的激光传感器2,其中第一工业相机(1)、第二工业相机4、图像采集室内的激光传感器2和LED光源3位于蜜瓜图像采集室11内部,两个图像采集室内的激光传感器2相对设置,LED光源3分别设置在蜜瓜图像采集室的四角。第一工业相机1位于蜜瓜图像采集室11的内部一侧,用于采集被测蜜瓜的正面图像信息,即蜜瓜的两个端部的其中一端;第二工业相机4位于蜜瓜图像采集室11的底部,采集蜜瓜的侧面(由于蜜瓜类似椭圆,侧面即椭圆长轴方向所在的一面)图像信息。
Described honeydew image acquisition device comprises honeydew
所述的传送带(5)为两条,相互之间平行设置,中间形成空隙;两条传送带均通过第一皮带支承辊和第二皮带支承辊安装在支撑连接架上,拖环的两端分别固定安装在两条传送带上。 There are two conveyor belts (5), which are arranged parallel to each other, forming a gap in the middle; the two conveyor belts are installed on the support connecting frame through the first belt support roller and the second belt support roller, and the two ends of the drag ring are respectively Fixed installation on two conveyor belts. the
Claims (6)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410011464.2A CN103792235A (en) | 2014-01-10 | 2014-01-10 | Diffuse transmission spectrum and image information fusion method for detecting internal quality of honeydew melons on line and device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410011464.2A CN103792235A (en) | 2014-01-10 | 2014-01-10 | Diffuse transmission spectrum and image information fusion method for detecting internal quality of honeydew melons on line and device |
Publications (1)
Publication Number | Publication Date |
---|---|
CN103792235A true CN103792235A (en) | 2014-05-14 |
Family
ID=50668107
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201410011464.2A Pending CN103792235A (en) | 2014-01-10 | 2014-01-10 | Diffuse transmission spectrum and image information fusion method for detecting internal quality of honeydew melons on line and device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN103792235A (en) |
Cited By (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104251837A (en) * | 2014-10-17 | 2014-12-31 | 北京农业智能装备技术研究中心 | Near-infrared transmittance spectroscopy on-line detecting system and method for fruit internal quality |
CN104359856A (en) * | 2014-11-19 | 2015-02-18 | 天津市傲绿农副产品集团股份有限公司 | Near-infrared nondestructive testing device for fruits |
CN105021563A (en) * | 2015-07-14 | 2015-11-04 | 河南科技大学 | Tobacco information acquisition device based on near infrared spectroscopy |
CN105203543A (en) * | 2015-09-22 | 2015-12-30 | 华中农业大学 | Machine vision based whole case red grape fruit size grading device and method |
CN106770002A (en) * | 2016-11-21 | 2017-05-31 | 无锡艾科瑞思产品设计与研究有限公司 | A kind of near infrared ray domestic food detection means |
CN106770346A (en) * | 2016-11-29 | 2017-05-31 | 中国科学院合肥物质科学研究院 | One kind is based on near-infrared diffusing transmission solids on-line detecting system |
CN107860722A (en) * | 2017-10-30 | 2018-03-30 | 内蒙古农业大学 | A kind of honeydew melon inside quality online test method and system |
CN108776138A (en) * | 2018-07-16 | 2018-11-09 | 武汉理工大学 | One kind is accelerated the ripening fruit library fruit quality on-Line Monitor Device |
CN109158332A (en) * | 2018-10-21 | 2019-01-08 | 西北农林科技大学 | A kind of fruit automation hierarchy system |
CN109187373A (en) * | 2018-10-21 | 2019-01-11 | 西北农林科技大学 | A kind of Tomato Quality detection system and detection method based on machine vision |
CN110296992A (en) * | 2019-08-15 | 2019-10-01 | 西北农林科技大学 | A machine vision-based detection and evaluation device for internal and external quality of postharvest cabbage |
CN110501346A (en) * | 2019-09-24 | 2019-11-26 | 江南大学 | Quality Inspection System Based on Multispectral Image Acquisition Technology |
CN112505049A (en) * | 2020-10-14 | 2021-03-16 | 上海互觉科技有限公司 | Mask inhibition-based method and system for detecting surface defects of precision components |
CN113340823A (en) * | 2021-06-02 | 2021-09-03 | 浙江德菲洛智能机械制造有限公司 | Rapid nondestructive testing process for sugar content of strawberry |
CN113390801A (en) * | 2021-04-28 | 2021-09-14 | 中国农业科学院农产品加工研究所 | On-line detection system and method for optical nondestructive evaluation of quality of irregular meat |
CN113495039A (en) * | 2021-09-06 | 2021-10-12 | 广东省农业科学院农业质量标准与监测技术研究所 | Pipeline type fruit quality nondestructive testing device and nondestructive testing method |
CN113933305A (en) * | 2021-11-12 | 2022-01-14 | 江南大学 | Thin-skinned fruit sugar content nondestructive measurement method and system based on smart phone |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH03165879A (en) * | 1989-11-24 | 1991-07-17 | Mitsui Mining & Smelting Co Ltd | Method for sorting vegetable and fruit |
CN1430723A (en) * | 2000-03-13 | 2003-07-16 | 奥特莱有限公司 | Method and device for measuring and correlating characteristics of fruit with visible/near infra-red spectrum |
CN101055245A (en) * | 2007-05-24 | 2007-10-17 | 吉林大学 | Portable near infrared spectrometer for soybean quality detection |
CN101063662A (en) * | 2007-05-15 | 2007-10-31 | 广州市万世德包装机械有限公司 | Method for detecting empty bottle bottom defect and device for detecting empty bottle bottom defect based on DSP |
KR100838138B1 (en) * | 1998-05-15 | 2008-06-13 | 미쓰이 긴조꾸 고교 가부시키가이샤 | Measuring device for measuring the internal quality of objects |
CN201251553Y (en) * | 2008-07-19 | 2009-06-03 | 浙江永吉木业有限公司 | Wood floor checking work bench |
CN203658250U (en) * | 2014-01-10 | 2014-06-18 | 内蒙古农业大学 | Online honeydew melon internal quality detection device capable of combining diffuse transmission spectrum and image information |
-
2014
- 2014-01-10 CN CN201410011464.2A patent/CN103792235A/en active Pending
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH03165879A (en) * | 1989-11-24 | 1991-07-17 | Mitsui Mining & Smelting Co Ltd | Method for sorting vegetable and fruit |
KR100838138B1 (en) * | 1998-05-15 | 2008-06-13 | 미쓰이 긴조꾸 고교 가부시키가이샤 | Measuring device for measuring the internal quality of objects |
CN1430723A (en) * | 2000-03-13 | 2003-07-16 | 奥特莱有限公司 | Method and device for measuring and correlating characteristics of fruit with visible/near infra-red spectrum |
CN101063662A (en) * | 2007-05-15 | 2007-10-31 | 广州市万世德包装机械有限公司 | Method for detecting empty bottle bottom defect and device for detecting empty bottle bottom defect based on DSP |
CN101055245A (en) * | 2007-05-24 | 2007-10-17 | 吉林大学 | Portable near infrared spectrometer for soybean quality detection |
CN201251553Y (en) * | 2008-07-19 | 2009-06-03 | 浙江永吉木业有限公司 | Wood floor checking work bench |
CN203658250U (en) * | 2014-01-10 | 2014-06-18 | 内蒙古农业大学 | Online honeydew melon internal quality detection device capable of combining diffuse transmission spectrum and image information |
Non-Patent Citations (1)
Title |
---|
李军良: "基于机器视觉和近红外光谱的水果品质分级研究", 《中国优秀硕士学位论文全文数据库 农业科技辑》 * |
Cited By (24)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104251837A (en) * | 2014-10-17 | 2014-12-31 | 北京农业智能装备技术研究中心 | Near-infrared transmittance spectroscopy on-line detecting system and method for fruit internal quality |
CN104251837B (en) * | 2014-10-17 | 2016-08-31 | 北京农业智能装备技术研究中心 | Fruit internal quality NIR transmittance spectroscopy on-line detecting system and method |
CN104359856A (en) * | 2014-11-19 | 2015-02-18 | 天津市傲绿农副产品集团股份有限公司 | Near-infrared nondestructive testing device for fruits |
CN104359856B (en) * | 2014-11-19 | 2017-04-26 | 天津市傲绿农副产品集团股份有限公司 | Near-infrared nondestructive testing device for fruits |
CN105021563A (en) * | 2015-07-14 | 2015-11-04 | 河南科技大学 | Tobacco information acquisition device based on near infrared spectroscopy |
CN105203543A (en) * | 2015-09-22 | 2015-12-30 | 华中农业大学 | Machine vision based whole case red grape fruit size grading device and method |
CN106770002A (en) * | 2016-11-21 | 2017-05-31 | 无锡艾科瑞思产品设计与研究有限公司 | A kind of near infrared ray domestic food detection means |
CN106770346A (en) * | 2016-11-29 | 2017-05-31 | 中国科学院合肥物质科学研究院 | One kind is based on near-infrared diffusing transmission solids on-line detecting system |
CN106770346B (en) * | 2016-11-29 | 2019-10-22 | 中国科学院合肥物质科学研究院 | An on-line detection system for solid objects based on near-infrared diffuse transmission |
CN107860722A (en) * | 2017-10-30 | 2018-03-30 | 内蒙古农业大学 | A kind of honeydew melon inside quality online test method and system |
CN107860722B (en) * | 2017-10-30 | 2020-04-21 | 内蒙古农业大学 | A kind of on-line detection method and system of honeydew melon internal quality |
CN108776138A (en) * | 2018-07-16 | 2018-11-09 | 武汉理工大学 | One kind is accelerated the ripening fruit library fruit quality on-Line Monitor Device |
CN109158332A (en) * | 2018-10-21 | 2019-01-08 | 西北农林科技大学 | A kind of fruit automation hierarchy system |
CN109187373A (en) * | 2018-10-21 | 2019-01-11 | 西北农林科技大学 | A kind of Tomato Quality detection system and detection method based on machine vision |
CN110296992A (en) * | 2019-08-15 | 2019-10-01 | 西北农林科技大学 | A machine vision-based detection and evaluation device for internal and external quality of postharvest cabbage |
CN110501346A (en) * | 2019-09-24 | 2019-11-26 | 江南大学 | Quality Inspection System Based on Multispectral Image Acquisition Technology |
CN112505049A (en) * | 2020-10-14 | 2021-03-16 | 上海互觉科技有限公司 | Mask inhibition-based method and system for detecting surface defects of precision components |
CN113390801A (en) * | 2021-04-28 | 2021-09-14 | 中国农业科学院农产品加工研究所 | On-line detection system and method for optical nondestructive evaluation of quality of irregular meat |
CN113390801B (en) * | 2021-04-28 | 2023-03-14 | 中国农业科学院农产品加工研究所 | On-line detection system and method for optical nondestructive evaluation of quality of irregular meat |
CN113340823A (en) * | 2021-06-02 | 2021-09-03 | 浙江德菲洛智能机械制造有限公司 | Rapid nondestructive testing process for sugar content of strawberry |
CN113340823B (en) * | 2021-06-02 | 2023-06-27 | 浙江德菲洛智能机械制造有限公司 | Rapid nondestructive testing process for strawberry sugar |
CN113495039A (en) * | 2021-09-06 | 2021-10-12 | 广东省农业科学院农业质量标准与监测技术研究所 | Pipeline type fruit quality nondestructive testing device and nondestructive testing method |
CN113495039B (en) * | 2021-09-06 | 2021-11-12 | 广东省农业科学院农业质量标准与监测技术研究所 | Pipeline type fruit quality nondestructive testing device and nondestructive testing method |
CN113933305A (en) * | 2021-11-12 | 2022-01-14 | 江南大学 | Thin-skinned fruit sugar content nondestructive measurement method and system based on smart phone |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN103792235A (en) | Diffuse transmission spectrum and image information fusion method for detecting internal quality of honeydew melons on line and device | |
Makky et al. | Development of an automatic grading machine for oil palm fresh fruits bunches (FFBs) based on machine vision | |
CN104198324B (en) | Computer vision-based method for measuring proportion of cut leaves in cut tobacco | |
CN110403232A (en) | A cigarette quality detection method based on two-level algorithm | |
CN104198325B (en) | Stem ratio measuring method in pipe tobacco based on computer vision | |
CN104256882B (en) | Based on reconstituted tobacco ratio measuring method in the pipe tobacco of computer vision | |
CN104990892B (en) | The spectrum picture Undamaged determination method for establishing model and seeds idenmtification method of seed | |
CN101144780A (en) | Pork freshness intelligent detection device | |
CN101949686A (en) | Online nondestructive testing (NDT) method and device for comprehensive internal/external qualities of fruits | |
CN106442525B (en) | Online detection method for walnut internal shriveling defect | |
CN104949998A (en) | Online visual inspection device and method for surface dirt of group origin eggs | |
CN104297439B (en) | A method for automatic recognition and detection of double-yellow duck eggs based on computer vision | |
CN106483135A (en) | Corn kernel detection and identification device and method based on machine vision under complex background | |
CN203658250U (en) | Online honeydew melon internal quality detection device capable of combining diffuse transmission spectrum and image information | |
CN108152231B (en) | Internal defect detection method of jujube fruit based on visible/near-infrared spectroscopy | |
CN111896513A (en) | A Big Data Statistical Analysis System for Detection of Toxic and Hazardous Substances Residues | |
CN104318249A (en) | Grinding surface roughness grade identification method based on multi-classification support vector machine | |
PP et al. | Automated quality assessment of cocoons using a smart camera based system | |
CN114419311A (en) | A method and device for nondestructive testing of passion fruit maturity based on multi-source information | |
Pratibha et al. | Analysis and identification of rice granules using image processing and neural network | |
CN107891012A (en) | Pearl size and circularity sorting equipment based on equivalent algorithm | |
CN106940292A (en) | Bar denier wood raw material quick nondestructive discrimination method of damaging by worms based on multi-optical spectrum imaging technology | |
Yang et al. | A new automatic sugarcane seed cutting machine based on internet of things technology and RGB color sensor | |
CN104749126A (en) | Wheat hardness prediction method based on near infrared hyperspectral image analysis | |
Gong et al. | Recent developments of seeds quality inspection and grading based on machine vision |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C12 | Rejection of a patent application after its publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20140514 |