[go: up one dir, main page]

CN103514459A - Method and system for identifying crop diseases and pests based on Android mobile phone platform - Google Patents

Method and system for identifying crop diseases and pests based on Android mobile phone platform Download PDF

Info

Publication number
CN103514459A
CN103514459A CN201310472832.9A CN201310472832A CN103514459A CN 103514459 A CN103514459 A CN 103514459A CN 201310472832 A CN201310472832 A CN 201310472832A CN 103514459 A CN103514459 A CN 103514459A
Authority
CN
China
Prior art keywords
image
mobile phone
disease
feature
insect pests
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201310472832.9A
Other languages
Chinese (zh)
Inventor
张洁
李�瑞
谢成军
宋良图
王儒敬
周林立
黄河
董伟
郭书普
严曙
聂余满
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hefei Institutes of Physical Science of CAS
Original Assignee
INFORMATION INSTITUTE ANHUI ACADEMY OF AGRICULTURAL SCIENCES
Hefei Institutes of Physical Science of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by INFORMATION INSTITUTE ANHUI ACADEMY OF AGRICULTURAL SCIENCES, Hefei Institutes of Physical Science of CAS filed Critical INFORMATION INSTITUTE ANHUI ACADEMY OF AGRICULTURAL SCIENCES
Priority to CN201310472832.9A priority Critical patent/CN103514459A/en
Publication of CN103514459A publication Critical patent/CN103514459A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Catching Or Destruction (AREA)

Abstract

本发明涉及基于Android手机平台的识别农作物病虫害的方法,包括:通过摄像头拍摄病虫害图像,并将其存储在Android手机的SD卡中;对病虫害图像进行预处理;对经过预处理的病虫害图像进行特征提取;对特征集合进行特征训练,使用SVM统计向量机方法训练样本集数据,得到病虫害诊断模型;调用病虫害诊断模型进行SVM统计向量机分类,得到病害图片分类和诊断结果,并将防治方法反馈到手机用户。本发明还公开了基于Android手机平台的识别农作物病虫害系统。本发明通过对病害图像进行图像预处理及特征提取,利用统计向量机学习方法SVM对病害图像进行分类建立病害诊断模型,来达到病害图像识别目标,只需要手机用户对准拍照即可,识别效率高。

Figure 201310472832

The invention relates to a method for identifying crop diseases and insect pests based on an Android mobile phone platform, comprising: taking images of diseases and insect pests through a camera and storing them in an SD card of an Android mobile phone; preprocessing the images of disease and insect pests; Extraction; perform feature training on the feature set, use the SVM statistical vector machine method to train the sample set data, and obtain a pest diagnosis model; call the pest diagnosis model to perform SVM statistical vector machine classification, obtain disease picture classification and diagnosis results, and feed back the control methods to Mobile phone users. The invention also discloses a system for identifying crop diseases and insect pests based on an Android mobile phone platform. The present invention performs image preprocessing and feature extraction on the disease images, and uses the statistical vector machine learning method SVM to classify the disease images to establish a disease diagnosis model to achieve the disease image recognition target, and only needs the mobile phone user to align and take pictures, and the recognition efficiency is high. high.

Figure 201310472832

Description

一种基于Android手机平台的识别农作物病虫害的方法及系统A method and system for identifying crop diseases and insect pests based on an Android mobile phone platform

技术领域technical field

本发明涉及客户端图像识别领域,尤其是一种基于Android手机平台的识别农作物病虫害的方法及系统。The invention relates to the field of client image recognition, in particular to a method and system for identifying crop diseases and insect pests based on an Android mobile phone platform.

背景技术Background technique

传统的病虫害诊断采用人工观测的方式,这一方式存在主观性、局限性、模糊性等不足。随着计算机图像处理以及人工智能技术的发展,人们开始利用计算机代替人来进行农作物的病虫害诊断,提出了在计算机上实现病虫害的识别。移动计算领域新技术的发展赋予手机更广阔的应用前景,手机成为未来个人网络和计算服务的重要平台,Android作为目前最为流行的智能操作系统之一,突破了传统手机的概念和模式,手机计算能力更加突出,应用也日益广泛、多元化。The traditional way of diagnosis of diseases and insect pests adopts the method of manual observation, which has the disadvantages of subjectivity, limitation and ambiguity. With the development of computer image processing and artificial intelligence technology, people began to use computers instead of humans to diagnose crop diseases and insect pests, and proposed to realize the identification of diseases and insect pests on computers. The development of new technologies in the field of mobile computing has endowed mobile phones with broader application prospects. Mobile phones have become an important platform for personal network and computing services in the future. Android, as one of the most popular smart operating systems, has broken through the concept and mode of traditional mobile phones. Mobile computing The ability is more prominent, and the application is becoming more and more extensive and diversified.

目前,在Android平台上进行病虫害识别,有一种设计是:首先,Android客户端获取病虫害图片,此过程可以通过系统平台自带的照相机拍摄一张图片,也可以通过蓝牙等技术获取一张图片;其次,将获取到的病虫害图片通过网络传输到服务器上,服务器端先期对样本库病虫害图像进行训练,得到不同类别病害图像的特征参数,即生成病虫害识别的分类器,服务器端接收到病虫害图像,在服务器端的计算机上对图像进行处理,去噪声,对图像特征提取,并将提取的特征参数与对样本库进行训练得到的特征参数进行对比,以此得到病害图片的分析和结论;最后,将病害图片的结论通过网络发送和反馈到Android手机客户端告知用户病害图片结果和防治方法。上述这种识别方式需要联网,针对用户而言,使用十分不便;此外,需要通过网络服务器端的计算机进行接收、识别、处理,识别效率低。At present, there is a design for identifying pests and diseases on the Android platform: first, the Android client obtains pictures of pests and diseases. In this process, a picture can be taken by the camera that comes with the system platform, or a picture can be obtained through technologies such as Bluetooth; Secondly, the obtained pictures of diseases and insect pests are transmitted to the server through the network, and the server side first trains the pictures of disease and insect pests in the sample library to obtain the characteristic parameters of different types of disease images, that is, to generate a classifier for identifying diseases and insect pests, and the server receives the pictures of disease and insect pests, Process the image on the server-side computer, remove noise, extract image features, and compare the extracted feature parameters with the feature parameters obtained by training the sample library, so as to obtain the analysis and conclusion of the disease picture; finally, the The conclusion of the disease picture is sent and fed back to the Android mobile phone client through the network to inform the user of the result of the disease picture and the prevention and control method. The above-mentioned identification method needs to be connected to the Internet, which is very inconvenient for users; in addition, it needs to be received, identified, and processed by a computer at the server side of the network, and the identification efficiency is low.

发明内容Contents of the invention

本发明的首要目的在于提供一种使用方便、易于操作、识别效率高的基于Android手机平台的识别农作物病虫害的方法。The primary purpose of the present invention is to provide a method for identifying crop diseases and insect pests based on an Android mobile phone platform, which is convenient to use, easy to operate, and has high identification efficiency.

为实现上述目的,本发明采用了以下技术方案:一种基于Android手机平台的识别农作物病虫害的方法,该方法包括下列顺序的步骤:To achieve the above object, the present invention adopts the following technical solutions: a method for identifying crop diseases and insect pests based on the Android mobile phone platform, the method comprises the steps in the following order:

(1)手机用户通过Android手机自带的摄像头拍摄病虫害图像,并将其存储在Android手机的SD卡中;(1) Mobile phone users take images of pests and diseases through the camera that comes with the Android phone, and store them in the SD card of the Android phone;

(2)对病虫害图像进行预处理;(2) Preprocessing the images of pests and diseases;

(3)对经过预处理的病虫害图像进行特征提取;(3) Extract features from the preprocessed images of pests and diseases;

(4)对特征集合进行特征训练,使用SVM统计向量机方法训练样本集数据,得到病虫害诊断模型;(4) Perform feature training on the feature set, use the SVM statistical vector machine method to train the sample set data, and obtain the pest diagnosis model;

(5)调用病虫害诊断模型进行SVM统计向量机分类,得到病害图片分类和诊断结果,并将防治方法反馈到手机用户。(5) Call the pest diagnosis model for SVM statistical vector machine classification, obtain the classification and diagnosis results of disease pictures, and feedback the control methods to mobile phone users.

对病虫害图像进行预处理包括灰度变换、中值滤波、阀值分割、轮廓检测、病斑提取的处理。The preprocessing of the images of diseases and insect pests includes grayscale transformation, median filter, threshold segmentation, contour detection and lesion extraction.

对经过预处理的病虫害图像进行三个方面的特征提取,分别是:纹理特征、颜色特征和形状特征,通过提取病虫害图像的颜色特征、纹理特征、形状特征作为识别特征向量;Three aspects of feature extraction are carried out on the preprocessed pest image, namely: texture feature, color feature and shape feature, and the color feature, texture feature and shape feature of the disease and pest image are extracted as the recognition feature vector;

对颜色特征,分别提取彩色图像蓝色通道下的一阶矩、二阶矩和三阶矩三个颜色特征;For color features, three color features of the first-order moment, second-order moment and third-order moment under the blue channel of the color image are extracted respectively;

对纹理特征,构造七个纹理特征参数,即灰度共生矩阵特征中的能量、熵、对比度和同质性,以及灰度差分统计特征中的对比度、角二阶矩、熵作为识别特征向量;For texture features, construct seven texture feature parameters, namely, energy, entropy, contrast and homogeneity in gray-level co-occurrence matrix features, and contrast, angular second-order moment, and entropy in gray-level difference statistical features as identification feature vectors;

对于形状特征,构造圆度、矩形度、离心率、球状比、紧密度、广度、内切圆半径参数作为形状识别特征向量。For the shape features, the circularity, rectangularity, eccentricity, sphericity ratio, compactness, breadth, and inscribed circle radius parameters are constructed as shape recognition feature vectors.

对特征集合进行特征训练,使用SVM统计向量机方法训练样本集数据,得到病害图像特征数据模型,此训练过程中,选择径向基核函数来对样本向量进行训练,径向基核函数将样本映射到高维特征空间H中,并在此空间中运用原空间的函数来实现内积运算,将非线性问题转换成另一空间的线性问题来获得一个样本的归属,Carry out feature training on the feature set, use the SVM statistical vector machine method to train the sample set data, and obtain the disease image feature data model. It is mapped to the high-dimensional feature space H, and the function of the original space is used in this space to realize the inner product operation, and the nonlinear problem is converted into a linear problem in another space to obtain the attribution of a sample.

径向基核函数如下:The radial basis kernel function is as follows:

K(x,y)=exp{-|x-y|2/2σ2}K(x,y)=exp{-|xy| 2 /2σ 2 }

核函数K(x,y)为空间中任一点x到某一中心y之间欧氏距离的单调函数,其中y为核函数中心,σ为函数的宽度参数,此参数控制函数的径向作用范围;The kernel function K(x,y) is a monotone function of the Euclidean distance between any point x in space and a certain center y, where y is the center of the kernel function, and σ is the width parameter of the function, which controls the radial effect of the function scope;

在生成数据模型文件后,将此数据模型文件保存为.model类型的文件储存到客户端程序raw文件夹下,作为病虫害诊断模型;After generating the data model file, save the data model file as a .model file and store it in the raw folder of the client program as a pest diagnosis model;

对经过预处理的病虫害待识别图片通过特征向量提取和对比,调用.model病害诊断模型进行SVM统计向量机分类,得到病害图片分类和诊断结果,并将防治方法反馈到手机用户。Through the feature vector extraction and comparison of the preprocessed pictures of diseases and insect pests to be identified, the .model disease diagnosis model is called to perform SVM statistical vector machine classification, and the classification and diagnosis results of disease pictures are obtained, and the control methods are fed back to mobile phone users.

所述灰度变换是指,采集得到的病虫害图像均是彩色图像,首先需要将病虫害图像转换为对应的灰度图像,要将彩色图像转换为灰度图像,需要分解提取图像中的红(R)、绿(G)、蓝(B)三个图像通道,取像素的R、G、B颜色分量,利用如下公式计算灰度值:The gray-scale transformation means that the collected images of diseases and insect pests are all color images, firstly, the images of diseases and insect pests need to be converted into corresponding gray-scale images, and to convert the color images into gray-scale images, it is necessary to decompose and extract the red (R ), green (G), and blue (B) three image channels, take the R, G, and B color components of the pixel, and use the following formula to calculate the gray value:

Gray(灰度值)=R*0.3+G*0.59+B*0.11Gray (gray value)=R*0.3+G*0.59+B*0.11

在一张病虫害图像的每个像素上均做上述操作,便可得到病虫害图像的灰度变换图像。By performing the above operations on each pixel of a pest image, a gray scale transformed image of the pest image can be obtained.

所述平滑处理是指,使用非线性中值滤波方法对图像进行增强处理,其基本原理就是将图像中的每个像素点与其周围的像素点做邻域运算;由于病斑形状特征的提取要求边缘位置确定,选用中值滤波方法对图像进行处理。The smoothing process refers to the use of a nonlinear median filter method to enhance the image, and its basic principle is to perform a neighborhood operation between each pixel in the image and its surrounding pixels; The edge position is determined, and the median filter method is selected to process the image.

所述阀值分割是指,分割图像目标是将病虫害图像中病斑与背景叶片进行分离,以得到仅含有病斑的图像,以消除噪声,得到更精确的病斑特征,以便后续对病斑进行特征提取,在灰度直方图上选取阈值,进行分割,然而阀值分割性能取决于阈值的选取;The threshold segmentation means that the target of image segmentation is to separate the lesion in the image of diseases and insect pests from the background leaves, so as to obtain an image containing only lesion, to eliminate noise, to obtain more accurate features of lesion, so that the follow-up Perform feature extraction, select a threshold on the gray histogram, and perform segmentation, but the threshold segmentation performance depends on the selection of the threshold;

采用OTSU自适应阈值分割算法:Using OTSU adaptive threshold segmentation algorithm:

对于图像f(x,y),假设图像大小为M×N,用以分割图像的前景(目标)和背景的阈值为T,图像中像素的灰度值小于阈值T的个数记作N1,大于阈值T的像素个数记作N2;如果前景的像素点占图像的比例记为ω1,背景占图像的比例为ω2,前景像素的平均灰度为μ1,背景其平均灰度为μ2,且图像的总平均灰度为μ,类间方差记为g,则有:For an image f(x,y), assuming that the image size is M×N, the threshold used to segment the foreground (target) and background of the image is T, and the number of pixels whose gray value is less than the threshold T in the image is recorded as N 1 , the number of pixels greater than the threshold T is recorded as N 2 ; if the proportion of foreground pixels in the image is recorded as ω 1 , the proportion of background in the image is ω 2 , the average gray level of foreground pixels is μ 1 , and the average gray level of background pixels is degree is μ 2 , and the total average gray level of the image is μ, and the variance between classes is denoted as g, then:

ωω 11 == NN 11 Mm ×× NN

ωω 22 == NN 22 Mm ×× NN

N1+N2=M×NN 1 +N 2 =M×N

μ=μ1×ω12×ω2    1)μ=μ 1 ×ω 12 ×ω 2 1)

g=ω1×(μ-μ1)22×(μ-μ2)2    2)g=ω 1 ×(μ-μ 1 ) 22 ×(μ-μ 2 ) 2 2)

将式1)代入式2),得:Substituting formula 1) into formula 2), we get:

g=ω1×ω2×(μ12)2    3)g=ω 1 ×ω 2 ×(μ 12 ) 2 3)

如此得到最大类间方差,对应此最大方差的灰度值即为要找的阀值。In this way, the maximum inter-class variance is obtained, and the gray value corresponding to the maximum variance is the threshold value to be found.

所述轮廓提取是指,病害叶片的病斑含有丰富的形态信息,而病斑的一些形状特征蕴含在病斑轮廓里,而形状特征的参数依此来计算,因此需要进一步提取病斑的轮廓,采用Canny算法对病斑轮廓进行检测,具体方法为用高斯滤波器平滑病斑图像,用一阶偏导有限差分计算病斑图像梯度幅值和方向,在此基础上对梯度幅值进行非极大值抑制,最后用双阈值算法检测和连接边缘。The outline extraction means that the lesion of the diseased leaf contains rich morphological information, and some shape features of the lesion are contained in the outline of the lesion, and the parameters of the shape feature are calculated accordingly, so it is necessary to further extract the outline of the lesion , using the Canny algorithm to detect the lesion outline, the specific method is to use a Gaussian filter to smooth the lesion image, and use the first-order partial derivative finite difference to calculate the gradient magnitude and direction of the lesion image, and on this basis, the gradient magnitude Maximum suppression, and finally a dual-threshold algorithm to detect and connect edges.

所述病斑提取是指,将轮廓图像与原图叠加进行与运算,得到去除了叶片背景的病斑图像,病斑部位被清晰地分离出来。The lesion extraction refers to superimposing the contour image and the original image to perform an AND operation to obtain a lesion image with the leaf background removed, and the lesion parts are clearly separated.

本发明还公开了一种基于Android手机平台的识别农作物病虫害系统,包括:The invention also discloses a system for identifying crop diseases and insect pests based on an Android mobile phone platform, including:

病害图像获取模块,启动Android手机自带的摄像头拍摄病虫害图像,并将其存储在Android手机的SD卡中;The disease image acquisition module starts the camera that the Android mobile phone carries to shoot the disease and insect pest image, and stores it in the SD card of the Android mobile phone;

图像预处理模块,对病虫害图像进行灰度变换、中值滤波、阀值分割、轮廓检测、病斑提取的预处理;The image preprocessing module performs grayscale transformation, median filtering, threshold segmentation, contour detection, and disease spot extraction on the image of diseases and insect pests;

图像特征提取模块,对经预处理的病虫害图像进行纹理特征、颜色特征和形状特征的特征提取;The image feature extraction module is used to extract texture features, color features and shape features from the preprocessed images of pests and diseases;

图像模式识别模块,对经过预处理的病虫害待识别图片通过特征向量提取和对比,调用病虫害诊断模型进行SVM统计向量机分类,得到病害图片分类和诊断结果,并将防治方法反馈到手机用户。The image pattern recognition module extracts and compares the feature vectors of the preprocessed pictures of diseases and insect pests to be identified, calls the disease and insect pest diagnosis model to perform SVM statistical vector machine classification, obtains the classification and diagnosis results of disease pictures, and feeds back the control methods to mobile phone users.

由上述技术方案可知,本发明研究了Android系统平台上图像处理的特点,通过对病害图像进行图像预处理及特征提取,利用统计向量机学习方法SVM对病害图像进行分类建立病害诊断模型,来达到病害图像识别目标,只需要手机用户对准拍照即可,无需联网,也无需网络服务器端的计算机进行接收、识别、处理,识别效率高。本发明的界面采用人性化的设计,操作易懂,采用模块化编程,可扩充性好。As can be seen from the above technical scheme, the present invention has studied the characteristics of image processing on the Android system platform, by carrying out image preprocessing and feature extraction on diseased images, and using the statistical vector machine learning method SVM to classify the diseased images and establish a disease diagnosis model to achieve The disease image recognition target only needs the mobile phone user to point and take a picture, without the need for networking, and without the need for a computer on the network server side to receive, identify, and process, and the identification efficiency is high. The interface of the present invention adopts humanized design, is easy to operate, adopts modular programming, and has good expandability.

附图说明Description of drawings

图1为本发明的方法流程图;Fig. 1 is method flowchart of the present invention;

图2为本发明的系统结构框图。Fig. 2 is a system structure block diagram of the present invention.

具体实施方式Detailed ways

一种基于Android手机平台的识别农作物病虫害的方法,该方法包括下列顺序的步骤:(1)手机用户通过Android手机自带的摄像头拍摄病虫害图像,并将其存储在Android手机的SD卡中,这一步主要是通过调用Intent跳转到系统相机;(2)对病虫害图像进行预处理;(3)对经过预处理的病虫害图像进行特征提取;(4)对特征集合进行特征训练,使用SVM统计向量机方法训练样本集数据,得到病虫害诊断模型;(5)调用病虫害诊断模型进行SVM统计向量机分类,得到病害图片分类和诊断结果,并将防治方法反馈到手机用户。如图1所示。A method for identifying crop diseases and insect pests based on the Android mobile phone platform, the method includes the steps in the following order: (1) the mobile phone user takes pictures of plant diseases and insect pests through the camera of the Android mobile phone, and stores them in the SD card of the Android mobile phone, which The first step is mainly to jump to the system camera by calling Intent; (2) Preprocess the pest image; (3) Extract features from the preprocessed pest image; (4) Perform feature training on the feature set, using SVM statistical vector (5) Call the pest diagnosis model to perform SVM statistical vector machine classification, obtain disease picture classification and diagnosis results, and feedback the control methods to mobile phone users. As shown in Figure 1.

如图1所示,对病虫害图像进行预处理包括灰度变换、中值滤波、阀值分割、轮廓检测、病斑提取的处理。所述灰度变换是指,采集得到的病虫害图像均是彩色图像,首先需要将病虫害图像转换为对应的灰度图像,要将彩色图像转换为灰度图像,需要分解提取图像中的红(R)、绿(G)、蓝(B)三个图像通道,取像素的R、G、B颜色分量,利用如下公式计算灰度值:As shown in Figure 1, the preprocessing of pest images includes grayscale transformation, median filter, threshold segmentation, contour detection, and lesion extraction. The gray-scale transformation means that the collected images of diseases and insect pests are all color images, firstly, the images of diseases and insect pests need to be converted into corresponding gray-scale images, and to convert the color images into gray-scale images, it is necessary to decompose and extract the red (R ), green (G), and blue (B) three image channels, take the R, G, and B color components of the pixel, and use the following formula to calculate the gray value:

Gray(灰度值)=R*0.3+G*0.59+B*0.11Gray (gray value)=R*0.3+G*0.59+B*0.11

在一张病虫害图像的每个像素上均做上述操作,便可得到病虫害图像的灰度变换图像。By performing the above operations on each pixel of a pest image, a gray scale transformed image of the pest image can be obtained.

所述平滑处理是指,使用非线性中值滤波方法对图像进行增强处理,其基本原理就是将图像中的每个像素点与其周围的像素点做邻域运算。空间域滤波分为线性和非线性,线性滤波器一般具有低通特性,会使图像的边缘变模糊,而非线性滤波器则可以较好保证图像边缘清晰。由于病斑形状特征的提取要求边缘位置比较确定,因此选用中值滤波方法对图像进行处理。The smoothing process refers to using a nonlinear median filter method to enhance the image, and its basic principle is to perform a neighborhood operation between each pixel in the image and its surrounding pixels. Spatial domain filtering is divided into linear and nonlinear. Linear filters generally have low-pass characteristics, which will blur the edges of the image, while nonlinear filters can better ensure that the edges of the image are clear. Since the extraction of lesion shape features requires a relatively definite edge position, the median filter method is used to process the image.

所述阀值分割是指,分割图像目标是将病虫害图像中病斑与背景叶片进行分离,以得到仅含有病斑的图像,这样可以消除噪声,得到更精确的病斑特征,以便后续对病斑进行特征提取。通常,选取阈值是在图像的直方图上进行的。所以常常在灰度直方图上选取阈值,进行分割,然而阀值分割性能取决于阈值的选取。采用OTSU自适应阈值分割算法:The threshold segmentation means that the target of image segmentation is to separate the lesion in the image of diseases and insect pests from the background leaves, so as to obtain an image containing only lesion, which can eliminate noise and obtain more accurate features of lesion, so that the subsequent detection of disease spots for feature extraction. Usually, thresholding is performed on the histogram of the image. Therefore, the threshold is often selected on the gray histogram for segmentation, but the threshold segmentation performance depends on the selection of the threshold. Using OTSU adaptive threshold segmentation algorithm:

对于图像f(x,y),假设图像大小为M×N,用以分割图像的前景(目标)和背景的阈值为T,图像中像素的灰度值小于阈值T的个数记作N1,大于阈值T的像素个数记作N2;如果前景的像素点占图像的比例记为ω1,背景占图像的比例为ω2,前景像素的平均灰度为μ1,背景其平均灰度为μ2,且图像的总平均灰度为μ,类间方差记为g,则有:For an image f(x,y), assuming that the image size is M×N, the threshold used to segment the foreground (target) and background of the image is T, and the number of pixels whose gray value is less than the threshold T in the image is recorded as N 1 , the number of pixels greater than the threshold T is recorded as N 2 ; if the proportion of foreground pixels in the image is recorded as ω 1 , the proportion of background in the image is ω 2 , the average gray level of foreground pixels is μ 1 , and the average gray level of background pixels is degree is μ 2 , and the total average gray level of the image is μ, and the variance between classes is denoted as g, then:

ωω 11 == NN 11 Mm ×× NN

ωω 22 == NN 22 Mm ×× NN

N1+N2=M×NN 1 +N 2 =M×N

μ=μ1×ω12×ω2    1)μ=μ 1 ×ω 12 ×ω 2 1)

g=ω1×(μ-μ1)22×(μ-μ2)2    2)g=ω 1 ×(μ-μ 1 ) 22 ×(μ-μ 2 ) 2 2)

将式1)代入式2),得:Substituting formula 1) into formula 2), we get:

g=ω1×ω2×(μ12)2    3)g=ω 1 ×ω 2 ×(μ 12 ) 2 3)

如此得到最大类间方差,对应此最大方差的灰度值即为要找的阀值。In this way, the maximum inter-class variance is obtained, and the gray value corresponding to the maximum variance is the threshold value to be found.

所述轮廓提取是指,病害叶片的病斑含有丰富的形态信息,而病斑的一些形状特征蕴含在病斑轮廓里,而形状特征的参数依此来计算,因此需要进一步提取病斑的轮廓。Canny边缘算法是常用的边缘检测方法,实践证明,Canny检测具有良好的效果,因此采用Canny算法对病斑轮廓进行检测,具体方法为用高斯滤波器平滑病斑图像,用一阶偏导有限差分计算病斑图像梯度幅值和方向,在此基础上对梯度幅值进行非极大值抑制,最后用双阈值算法检测和连接边缘。The outline extraction means that the lesion of the diseased leaf contains rich morphological information, and some shape features of the lesion are contained in the outline of the lesion, and the parameters of the shape feature are calculated accordingly, so it is necessary to further extract the outline of the lesion . Canny edge algorithm is a commonly used edge detection method. Practice has proved that Canny detection has good results. Therefore, the Canny algorithm is used to detect the lesion contour. The specific method is to use a Gaussian filter to smooth the lesion image, and use the first-order partial derivative Calculate the gradient magnitude and direction of the lesion image, on this basis, carry out non-maximum suppression on the gradient magnitude, and finally use the double threshold algorithm to detect and connect the edges.

所述病斑提取是指,将轮廓图像与原图叠加进行与运算,得到去除了叶片背景的病斑图像,病斑部位被清晰地分离出来,至此整个预处理过程完成,得到的图像通过预处理消除了噪声,便于后续的病斑特征提取操作与计算。The lesion extraction refers to superimposing the contour image and the original image to perform an AND operation to obtain a lesion image with the background of the leaf removed, and the lesion part is clearly separated. So far, the entire preprocessing process is completed, and the obtained image is passed through the preprocessing process. The processing eliminates the noise, which is convenient for the subsequent lesion feature extraction operation and calculation.

如图1所示,对经过预处理的病虫害图像进行三个方面的特征提取,分别是:纹理特征、颜色特征和形状特征,通过提取病虫害图像的颜色特征、纹理特征、形状特征作为识别特征向量;对颜色特征,分别提取彩色图像蓝色通道下的一阶矩、二阶矩和三阶矩三个颜色特征;对纹理特征,构造七个纹理特征参数,即灰度共生矩阵特征中的能量、熵、对比度和同质性,以及灰度差分统计特征中的对比度、角二阶矩、熵作为识别特征向量;对于形状特征,构造圆度、矩形度、离心率、球状比、紧密度、广度、内切圆半径等参数作为形状识别特征向量。As shown in Figure 1, three aspects of feature extraction are performed on the preprocessed pest image, namely: texture feature, color feature and shape feature, and the color feature, texture feature and shape feature of the pest image are extracted as the recognition feature vector ; For color features, three color features of the first-order moment, second-order moment, and third-order moment under the blue channel of the color image are extracted respectively; for texture features, seven texture feature parameters are constructed, that is, the energy in the gray-level co-occurrence matrix feature , entropy, contrast and homogeneity, and the contrast, angular second moment, and entropy in the gray difference statistical features are used as the recognition feature vector; for the shape feature, the circularity, rectangularity, eccentricity, sphericity ratio, compactness, Parameters such as breadth and inscribed circle radius are used as feature vectors for shape recognition.

如图1所示,对特征集合进行特征训练,使用SVM统计向量机方法训练样本集数据,得到病害图像特征数据模型,此训练过程中,选择径向基核函数来对样本向量进行训练,径向基核函数将样本映射到高维特征空间H中,并在此空间中运用原空间的函数来实现内积运算,将非线性问题转换成另一空间的线性问题来获得一个样本的归属,As shown in Figure 1, the feature set is used for feature training, and the SVM statistical vector machine method is used to train the sample set data to obtain the disease image feature data model. During this training process, the radial basis kernel function is selected to train the sample vector. The basic kernel function maps the sample to the high-dimensional feature space H, and uses the function of the original space in this space to realize the inner product operation, and converts the nonlinear problem into a linear problem in another space to obtain the attribution of a sample.

径向基核函数如下:The radial basis kernel function is as follows:

K(x,y)=exp{-|x-y|2/2σ2}K(x,y)=exp{-|xy| 2 /2σ 2 }

核函数K(x,y)为空间中任一点x到某一中心y之间欧氏距离的单调函数,其中y为核函数中心,σ为函数的宽度参数,此参数控制函数的径向作用范围;The kernel function K(x,y) is a monotone function of the Euclidean distance between any point x in space and a certain center y, where y is the center of the kernel function, and σ is the width parameter of the function, which controls the radial effect of the function scope;

在生成数据模型文件后,将此数据模型文件保存为.model类型的文件储存到客户端程序raw文件夹下,作为病虫害诊断模型;After generating the data model file, save the data model file as a .model file and store it in the raw folder of the client program as a pest diagnosis model;

对经过预处理的病虫害待识别图片通过特征向量提取和对比,调用.model病害诊断模型进行SVM统计向量机分类,得到病害图片分类和诊断结果,并将防治方法反馈到手机用户。Through the feature vector extraction and comparison of the preprocessed pictures of diseases and insect pests to be identified, the .model disease diagnosis model is called to perform SVM statistical vector machine classification, and the classification and diagnosis results of disease pictures are obtained, and the control methods are fed back to mobile phone users.

如图2所示,本系统包括:病害图像获取模块,启动Android手机自带的摄像头拍摄病虫害图像,并将其存储在Android手机的SD卡中;图像预处理模块,对病虫害图像进行灰度变换、中值滤波、阀值分割、轮廓检测、病斑提取的预处理;图像特征提取模块,对经预处理的病虫害图像进行纹理特征、颜色特征和形状特征的特征提取;图像模式识别模块,对经过预处理的病虫害待识别图片通过特征向量提取和对比,调用病虫害诊断模型进行SVM统计向量机分类,得到病害图片分类和诊断结果,并将防治方法反馈到手机用户。As shown in Figure 2, the system includes: a disease image acquisition module, which starts the Android mobile phone’s own camera to take pictures of diseases and insect pests, and stores them in the SD card of the Android mobile phone; an image preprocessing module, which performs grayscale transformation on the disease and insect pest images , median filtering, threshold segmentation, contour detection, and preprocessing of lesion extraction; the image feature extraction module extracts texture features, color features, and shape features from the preprocessed images of diseases and insect pests; the image pattern recognition module The pre-processed pictures of diseases and insect pests to be identified are extracted and compared through feature vectors, and the diagnosis model of diseases and insect pests is called to perform SVM statistical vector machine classification, and the classification and diagnosis results of disease pictures are obtained, and the control methods are fed back to mobile phone users.

系统所需环境及搭建:本发明涉及到Android平台上的程序开发,尤其是底层JNI的调用。利用Android平台下Java和C++混合编程,对图像在Android平台下使用OpenCV图像处理库进行处理及后续相关的分类工作,因此所需开发环境不同于Android普通开发环境。Andriod普通开发环境为:Eclipse+Android SDK+ADT。本系统开发环境及搭建步骤大致如下:需搭建开发环境,安装Eclipse、Android SDK、ADT,这一步可通过下载Google提供的ADT Bundle集成开发工具包完成;其次,需下载安装NDK,Cygwin,CDT,需要这一步的原因是OpenCV的开发需要编写本地代码(C/C++),需使用NDK,Cygwin等建立交叉编译环境,调用本地代码;最后,安装OpenCV4Android,建立图像库处理开发环境,将OpenCV SDK引入到Eclipse工作空间。The required environment and construction of the system: the present invention relates to the program development on the Android platform, especially the calling of the underlying JNI. Using the mixed programming of Java and C++ under the Android platform, the image is processed under the Android platform using the OpenCV image processing library and the subsequent related classification work, so the required development environment is different from the normal Android development environment. The common development environment for Andriod is: Eclipse+Android SDK+ADT. The development environment and building steps of this system are roughly as follows: you need to build a development environment, install Eclipse, Android SDK, and ADT, and this step can be completed by downloading the ADT Bundle integrated development kit provided by Google; secondly, you need to download and install NDK, Cygwin, CDT, The reason for this step is that the development of OpenCV needs to write local code (C/C++), and it is necessary to use NDK, Cygwin, etc. to establish a cross-compilation environment and call local code; finally, install OpenCV4Android, establish an image library processing development environment, and introduce OpenCV SDK to the Eclipse workspace.

综上所述,本发明研究了Android系统平台上图像处理的特点,通过对病害图像进行图像预处理及特征提取,利用统计向量机学习方法SVM对病害图像进行分类建立病害诊断模型,来达到病害图像识别目标,只需要手机用户对准拍照即可,无需联网,也无需网络服务器端的计算机进行接收、识别、处理,识别效率高。本发明的界面采用人性化的设计,操作易懂,采用模块化编程,可扩充性好。In summary, the present invention has studied the characteristics of image processing on the Android system platform, by carrying out image preprocessing and feature extraction to disease images, and utilizing the statistical vector machine learning method SVM to classify disease images and establish disease diagnosis models to achieve disease The image recognition target only needs the mobile phone user to point and take a photo, without the need for networking, and without the need for a computer on the network server side to receive, identify, and process, and the identification efficiency is high. The interface of the present invention adopts humanized design, is easy to operate, adopts modular programming, and has good expandability.

Claims (10)

1.一种基于Android手机平台的识别农作物病虫害的方法,该方法包括下列顺序的步骤:1. a method for identifying crop diseases and insect pests based on the Android mobile phone platform, the method comprises the steps in the following order: (1)手机用户通过Android手机自带的摄像头拍摄病虫害图像,并将其存储在Android手机的SD卡中;(1) Mobile phone users take images of pests and diseases through the camera that comes with the Android phone, and store them in the SD card of the Android phone; (2)对病虫害图像进行预处理;(2) Preprocessing the images of pests and diseases; (3)对经过预处理的病虫害图像进行特征提取;(3) Extract features from the preprocessed images of pests and diseases; (4)对特征集合进行特征训练,使用SVM统计向量机方法训练样本集数据,得到病虫害诊断模型;(4) Perform feature training on the feature set, use the SVM statistical vector machine method to train the sample set data, and obtain the pest diagnosis model; (5)调用病虫害诊断模型进行SVM统计向量机分类,得到病害图片分类和诊断结果,并将防治方法反馈到手机用户。(5) Call the pest diagnosis model for SVM statistical vector machine classification, obtain the classification and diagnosis results of disease pictures, and feedback the control methods to mobile phone users. 2.根据权利要求1所述的基于Android手机平台的识别农作物病虫害的方法,其特征在于:对病虫害图像进行预处理包括灰度变换、中值滤波、阀值分割、轮廓检测、病斑提取的处理。2. the method for identifying crop diseases and insect pests based on the Android mobile phone platform according to claim 1, is characterized in that: carrying out pretreatment to disease and insect pest image comprises the steps of grayscale transformation, median filter, threshold segmentation, contour detection, lesion extraction deal with. 3.根据权利要求1所述的基于Android手机平台的识别农作物病虫害的方法,其特征在于:对经过预处理的病虫害图像进行三个方面的特征提取,分别是:纹理特征、颜色特征和形状特征,通过提取病虫害图像的颜色特征、纹理特征、形状特征作为识别特征向量;3. the method for identifying crop diseases and insect pests based on the Android mobile phone platform according to claim 1, is characterized in that: the feature extraction of three aspects is carried out to the image of diseases and insect pests through pretreatment, is respectively: texture feature, color feature and shape feature , by extracting the color features, texture features, and shape features of the pest image as the recognition feature vector; 对颜色特征,分别提取彩色图像蓝色通道下的一阶矩、二阶矩和三阶矩三个颜色特征;For color features, three color features of the first-order moment, second-order moment and third-order moment under the blue channel of the color image are extracted respectively; 对纹理特征,构造七个纹理特征参数,即灰度共生矩阵特征中的能量、熵、对比度和同质性,以及灰度差分统计特征中的对比度、角二阶矩、熵作为识别特征向量;For texture features, construct seven texture feature parameters, namely, energy, entropy, contrast and homogeneity in gray-level co-occurrence matrix features, and contrast, angular second-order moment, and entropy in gray-level difference statistical features as identification feature vectors; 对于形状特征,构造圆度、矩形度、离心率、球状比、紧密度、广度、内切圆半径参数作为形状识别特征向量。For the shape features, the circularity, rectangularity, eccentricity, sphericity ratio, compactness, breadth, and inscribed circle radius parameters are constructed as shape recognition feature vectors. 4.根据权利要求1所述的基于Android手机平台的识别农作物病虫害的方法,其特征在于:对特征集合进行特征训练,使用SVM统计向量机方法训练样本集数据,得到病害图像特征数据模型,此训练过程中,选择径向基核函数来对样本向量进行训练,径向基核函数将样本映射到高维特征空间H中,并在此空间中运用原空间的函数来实现内积运算,将非线性问题转换成另一空间的线性问题来获得一个样本的归属,4. the method for identifying crop diseases and insect pests based on Android mobile phone platform according to claim 1, is characterized in that: feature set is carried out feature training, uses SVM statistical vector machine method training sample set data, obtains disease image characteristic data model, here During the training process, the radial basis kernel function is selected to train the sample vector. The radial basis kernel function maps the sample to the high-dimensional feature space H, and uses the function of the original space in this space to realize the inner product operation. The nonlinear problem is transformed into a linear problem in another space to obtain the assignment of a sample, 径向基核函数如下:The radial basis kernel function is as follows: K(x,y)=exp{-|x-y|2/2σ2}K(x,y)=exp{-|xy| 2 /2σ 2 } 核函数K(x,y)为空间中任一点x到某一中心y之间欧氏距离的单调函数,其中y为核函数中心,σ为函数的宽度参数,此参数控制函数的径向作用范围;The kernel function K(x,y) is a monotone function of the Euclidean distance between any point x in space and a certain center y, where y is the center of the kernel function, and σ is the width parameter of the function, which controls the radial effect of the function scope; 在生成数据模型文件后,将此数据模型文件保存为.model类型的文件储存到客户端程序raw文件夹下,作为病虫害诊断模型;After generating the data model file, save the data model file as a .model file and store it in the raw folder of the client program as a pest diagnosis model; 对经过预处理的病虫害待识别图片通过特征向量提取和对比,调用.model病害诊断模型进行SVM统计向量机分类,得到病害图片分类和诊断结果,并将防治方法反馈到手机用户。Through the feature vector extraction and comparison of the preprocessed pictures of diseases and insect pests to be identified, the .model disease diagnosis model is called to perform SVM statistical vector machine classification, and the classification and diagnosis results of disease pictures are obtained, and the control methods are fed back to mobile phone users. 5.根据权利要求2所述的基于Android手机平台的识别农作物病虫害的方法,其特征在于:所述灰度变换是指,采集得到的病虫害图像均是彩色图像,首先需要将病虫害图像转换为对应的灰度图像,要将彩色图像转换为灰度图像,需要分解提取图像中的红(R)、绿(G)、蓝(B)三个图像通道,取像素的R、G、B颜色分量,利用如下公式计算灰度值:5. the method for identifying crop diseases and insect pests based on the Android mobile phone platform according to claim 2, is characterized in that: said grayscale transformation refers to that the images of diseases and insect pests that are collected are all color images, and at first it is necessary to convert the images of disease and insect pests into corresponding To convert a color image into a grayscale image, it is necessary to decompose and extract the three image channels of red (R), green (G), and blue (B) in the image, and take the R, G, and B color components of the pixel , use the following formula to calculate the gray value: Gray(灰度值)=R*0.3+G*0.59+B*0.11Gray (gray value)=R*0.3+G*0.59+B*0.11 在一张病虫害图像的每个像素上均做上述操作,便可得到病虫害图像的灰度变换图像。By performing the above operations on each pixel of a pest image, a gray scale transformed image of the pest image can be obtained. 6.根据权利要求2所述的基于Android手机平台的识别农作物病虫害的方法,其特征在于:所述平滑处理是指,使用非线性中值滤波方法对图像进行增强处理,其基本原理就是将图像中的每个像素点与其周围的像素点做邻域运算;由于病斑形状特征的提取要求边缘位置确定,选用中值滤波方法对图像进行处理。6. the method for identifying crop diseases and insect pests based on the Android mobile phone platform according to claim 2, is characterized in that: described smoothing process refers to, uses non-linear median filtering method to carry out enhancement process to image, and its basic principle is exactly to image Neighborhood operations are performed between each pixel in the image and its surrounding pixels; since the extraction of lesion shape features requires the determination of the edge position, the median filter method is used to process the image. 7.根据权利要求2所述的基于Android手机平台的识别农作物病虫害的方法,其特征在于:所述阀值分割是指,分割图像目标是将病虫害图像中病斑与背景叶片进行分离,以得到仅含有病斑的图像,以消除噪声,得到更精确的病斑特征,以便后续对病斑进行特征提取,在灰度直方图上选取阈值,进行分割,然而阀值分割性能取决于阈值的选取;7. the method for identifying crop diseases and insect pests based on the Android mobile phone platform according to claim 2, is characterized in that: the threshold segmentation refers to that the segmentation image target is to separate disease spots and background leaves in the disease and insect pest image, to obtain Images containing only lesions are used to eliminate noise and obtain more accurate lesion features for subsequent feature extraction of lesions, and select thresholds on the gray histogram for segmentation. However, the performance of threshold segmentation depends on the selection of thresholds ; 采用OTSU自适应阈值分割算法:Using OTSU adaptive threshold segmentation algorithm: 对于图像f(x,y),假设图像大小为M×N,用以分割图像的前景(目标)和背景的阈值为T,图像中像素的灰度值小于阈值T的个数记作N1,大于阈值T的像素个数记作N2;如果前景的像素点占图像的比例记为ω1,背景占图像的比例为ω2,前景像素的平均灰度为μ1,背景其平均灰度为μ2,且图像的总平均灰度为μ,类间方差记为g,则有:For an image f(x,y), assuming that the image size is M×N, the threshold used to segment the foreground (target) and background of the image is T, and the number of pixels whose gray value is less than the threshold T in the image is recorded as N 1 , the number of pixels greater than the threshold T is recorded as N 2 ; if the proportion of foreground pixels in the image is recorded as ω 1 , the proportion of background in the image is ω 2 , the average gray level of foreground pixels is μ 1 , and the average gray level of background pixels is degree is μ 2 , and the total average gray level of the image is μ, and the variance between classes is denoted as g, then: ωω 11 == NN 11 Mm ×× NN ωω 22 == NN 22 Mm ×× NN N1+N2=M×NN 1 +N 2 =M×N μ=μ1×ω12×ω2    1)μ=μ 1 ×ω 12 ×ω 2 1) g=ω1×(μ-μ1)22×(μ-μ2)2    2)g=ω 1 ×(μ-μ 1 ) 22 ×(μ-μ 2 ) 2 2) 将式1)代入式2),得:Substituting formula 1) into formula 2), we get: g=ω1×ω2×(μ12)2    3)g=ω 1 ×ω 2 ×(μ 12 ) 2 3) 如此得到最大类间方差,对应此最大方差的灰度值即为要找的阀值。In this way, the maximum inter-class variance is obtained, and the gray value corresponding to the maximum variance is the threshold value to be found. 8.根据权利要求2所述的基于Android手机平台的识别农作物病虫害的方法,其特征在于:所述轮廓提取是指,病害叶片的病斑含有丰富的形态信息,而病斑的一些形状特征蕴含在病斑轮廓里,而形状特征的参数依此来计算,因此需要进一步提取病斑的轮廓,采用Canny算法对病斑轮廓进行检测,具体方法为用高斯滤波器平滑病斑图像,用一阶偏导有限差分计算病斑图像梯度幅值和方向,在此基础上对梯度幅值进行非极大值抑制,最后用双阈值算法检测和连接边缘。8. the method for identifying crop diseases and insect pests based on the Android mobile phone platform according to claim 2, is characterized in that: the contour extraction refers to that the lesion of the diseased blade contains rich morphological information, and some shape features of the lesion contain In the lesion outline, the parameters of the shape feature are calculated accordingly, so it is necessary to further extract the lesion outline, and use the Canny algorithm to detect the lesion outline. The specific method is to smooth the lesion image with a Gaussian filter, and use the first-order The finite difference of partial derivatives calculates the gradient magnitude and direction of the lesion image, on this basis, the non-maximum suppression of the gradient magnitude is carried out, and finally the double threshold algorithm is used to detect and connect the edges. 9.根据权利要求2所述的基于Android手机平台的识别农作物病虫害的方法,其特征在于:所述病斑提取是指,将轮廓图像与原图叠加进行与运算,得到去除了叶片背景的病斑图像,病斑部位被清晰地分离出来。9. the method for identifying crop diseases and insect pests based on the Android mobile phone platform according to claim 2, is characterized in that: the lesion extraction refers to, the contour image and the original image are superimposed and carried out AND operation, obtain the diseased spot that has removed the leaf background. Spot image, the lesion site is clearly separated. 10.实现所权利要求1至9中任意一项所述的方法的系统,其特征在于:包括:10. A system for realizing the method according to any one of claims 1 to 9, characterized in that: comprising: 病害图像获取模块,启动Android手机自带的摄像头拍摄病虫害图像,并将其存储在Android手机的SD卡中;The disease image acquisition module starts the camera that the Android mobile phone carries to shoot the disease and insect pest image, and stores it in the SD card of the Android mobile phone; 图像预处理模块,对病虫害图像进行灰度变换、中值滤波、阀值分割、轮廓检测、病斑提取的预处理;The image preprocessing module performs grayscale transformation, median filtering, threshold segmentation, contour detection, and disease spot extraction on the images of diseases and insect pests; 图像特征提取模块,对经预处理的病虫害图像进行纹理特征、颜色特征和形状特征的特征提取;The image feature extraction module is used to extract texture features, color features and shape features from the preprocessed images of diseases and insect pests; 图像模式识别模块,对经过预处理的病虫害待识别图片通过特征向量提取和对比,调用病虫害诊断模型进行SVM统计向量机分类,得到病害图片分类和诊断结果,并将防治方法反馈到手机用户。The image pattern recognition module extracts and compares the feature vectors of the preprocessed pictures of diseases and insect pests to be identified, calls the disease and insect pest diagnosis model to perform SVM statistical vector machine classification, obtains the classification and diagnosis results of disease pictures, and feeds back the control methods to mobile phone users.
CN201310472832.9A 2013-10-11 2013-10-11 Method and system for identifying crop diseases and pests based on Android mobile phone platform Pending CN103514459A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310472832.9A CN103514459A (en) 2013-10-11 2013-10-11 Method and system for identifying crop diseases and pests based on Android mobile phone platform

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310472832.9A CN103514459A (en) 2013-10-11 2013-10-11 Method and system for identifying crop diseases and pests based on Android mobile phone platform

Publications (1)

Publication Number Publication Date
CN103514459A true CN103514459A (en) 2014-01-15

Family

ID=49897151

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310472832.9A Pending CN103514459A (en) 2013-10-11 2013-10-11 Method and system for identifying crop diseases and pests based on Android mobile phone platform

Country Status (1)

Country Link
CN (1) CN103514459A (en)

Cited By (51)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103778630A (en) * 2014-01-16 2014-05-07 中华人民共和国海南出入境检验检疫局 Field disease degree image identification method based on android
CN103886096A (en) * 2014-04-03 2014-06-25 江苏物联网研究发展中心 Remote insect pest identification method based on pictures
CN103903006A (en) * 2014-03-05 2014-07-02 中国科学院合肥物质科学研究院 Crop pest identification method and system based on Android platform
CN104063686A (en) * 2014-06-17 2014-09-24 中国科学院合肥物质科学研究院 System and method for performing interactive diagnosis on crop leaf segment disease images
CN104077612A (en) * 2014-07-15 2014-10-01 中国科学院合肥物质科学研究院 Pest image recognition method based on multi-feature sparse representation technology
CN104700108A (en) * 2015-02-13 2015-06-10 中国农业大学 Remote diagnosis method and system for celery disease
TWI490793B (en) * 2014-02-11 2015-07-01 亞洲大學 Plant diseases and insect pests identifying method and system thereof
CN104778686A (en) * 2015-03-23 2015-07-15 无锡中科智能农业发展有限责任公司 Tissue culture prewarning method and system based on scab monitoring
CN106446942A (en) * 2016-09-18 2017-02-22 兰州交通大学 Crop disease identification method based on incremental learning
CN106508513A (en) * 2016-09-05 2017-03-22 深圳市双赢伟业科技股份有限公司 Agricultural interconnected deinsectization weeding method
CN106778782A (en) * 2016-12-15 2017-05-31 盐城工学院 Identifying pest and prevention and controls and system
CN106874860A (en) * 2017-01-23 2017-06-20 中粮长城葡萄酒(烟台)有限公司 The quick, intelligent identifying system of the similar disease of grape and its method
CN106991449A (en) * 2017-04-10 2017-07-28 大连大学 A kind of living scene reconstruct assists in identifying the method for blueberry kind
CN107292874A (en) * 2017-06-29 2017-10-24 深圳前海弘稼科技有限公司 The control method and device of crop disease
CN107516311A (en) * 2017-08-08 2017-12-26 中国科学技术大学 A detection method of corn damage rate based on GPU embedded platform
CN108492295A (en) * 2018-03-30 2018-09-04 深圳春沐源控股有限公司 Fruit annesl control method and device
CN108537769A (en) * 2018-01-08 2018-09-14 黑龙江省农业科学院植物保护研究所 A kind of recognition methods of the leaf blight of corn, device, equipment and medium
CN108563979A (en) * 2017-12-29 2018-09-21 南京农业大学 A method of based on the farmland image discriminating rice blast state of an illness of taking photo by plane
CN108564124A (en) * 2018-04-13 2018-09-21 山东农业大学 A kind of magnaporthe grisea spore microimage detection recognition methods based on support vector machines
CN108596262A (en) * 2018-04-28 2018-09-28 北京麦飞科技有限公司 A kind of method and system carrying out plant disease spot classification based on computer vision
CN108805246A (en) * 2018-06-19 2018-11-13 江苏大学 A method of intelligence indicates Quick Response Code and using the Quick Response Code to food status monitoring
CN109101891A (en) * 2018-07-17 2018-12-28 哈尔滨理工大学 A kind of rice pest detection system and its detection method merging artificial intelligence
CN109308697A (en) * 2018-09-18 2019-02-05 安徽工业大学 A method of leaf disease identification based on machine learning algorithm
GB2565211A (en) * 2017-06-26 2019-02-06 Ibm Cognitive plant clinic
CN109346157A (en) * 2018-09-29 2019-02-15 中关云(北京)科技有限公司 A kind of remote machine image identifying and diagnosing system and method
CN109859212A (en) * 2019-01-16 2019-06-07 中国计量大学 A kind of unmanned plane image soybean crops row dividing method
CN109858416A (en) * 2019-01-21 2019-06-07 浙江科技学院 A kind of method of the identification pest and disease damage of insecticidal lamp
CN110287759A (en) * 2019-03-25 2019-09-27 广东工业大学 An eye fatigue detection method based on simplified input convolutional neural network O-CNN
WO2019184212A1 (en) * 2018-03-30 2019-10-03 深圳春沐源控股有限公司 Method and apparatus for analyzing pest trend, and computer-readable storage medium
CN110310291A (en) * 2019-06-25 2019-10-08 四川省农业科学院农业信息与农村经济研究所 A kind of rice blast hierarchy system and its method
CN110544237A (en) * 2019-08-06 2019-12-06 广州林猫物种自动识别技术有限公司 Oil tea pest model training method and recognition method based on image analysis
CN110689507A (en) * 2019-11-08 2020-01-14 北京软通智慧城市科技有限公司 Insect type identification device, system and method
CN110930447A (en) * 2019-12-09 2020-03-27 成都信息工程大学 Android-based unattended snow depth measurement method
CN111105393A (en) * 2019-11-25 2020-05-05 长安大学 Grape disease and pest identification method and device based on deep learning
CN111246734A (en) * 2017-10-18 2020-06-05 威里利生命科学有限责任公司 Insect sensing system and method
CN111539293A (en) * 2020-04-17 2020-08-14 北京派得伟业科技发展有限公司 Fruit tree disease diagnosis method and system
US10768584B2 (en) 2017-06-26 2020-09-08 International Business Machines Corporation Cognitive plant clinic
CN111695560A (en) * 2020-05-12 2020-09-22 浙江省农业科学院 Method for actively positioning and focusing crop diseases and insect pests based on convolutional neural network
CN111814866A (en) * 2020-07-02 2020-10-23 深圳市万物云科技有限公司 Disease and pest early warning method and device, computer equipment and storage medium
CN112036470A (en) * 2020-08-28 2020-12-04 扬州大学 Cloud transmission-based multi-sensor fusion cucumber bemisia tabaci identification method
CN112085032A (en) * 2020-09-14 2020-12-15 衢州学院 Dynamic monitoring model of Huyou Pomelo diseases and insect pests based on the combination of Internet of Things image processing and SVM
US10964009B2 (en) 2016-10-13 2021-03-30 Mccain Foods Limited Method, medium, and system for detecting potato virus in a crop image
CN112668404A (en) * 2020-12-10 2021-04-16 哈尔滨师范大学 Effective identification method for soybean diseases and insect pests
CN112750123A (en) * 2021-01-22 2021-05-04 武汉工程大学 Rice disease and insect pest monitoring method and system
JP2021099809A (en) * 2019-12-23 2021-07-01 住友化学株式会社 Image classification device, image classification method, and method of generating image classification model
CN113228047A (en) * 2018-10-24 2021-08-06 克莱米特公司 Plant disease detection using multi-stage, multi-scale deep learning
CN114972347A (en) * 2022-07-29 2022-08-30 中化现代农业有限公司 Crop pest detection method, system, equipment and medium
CN115471747A (en) * 2022-08-30 2022-12-13 广东省农业科学院环境园艺研究所 AI (artificial intelligence) rapid identification method for camellia diseases and insect pests and physiological diseases and application
CN116206741A (en) * 2023-05-05 2023-06-02 泰安市中心医院(青岛大学附属泰安市中心医院、泰山医养中心) Gastroenterology medical information processing system and method
CN117576571A (en) * 2024-01-16 2024-02-20 汉中中园农业科技发展(集团)有限公司 Multi-mode fruit and vegetable leaf disease identification method and system based on images and texts
CN118469927A (en) * 2024-04-30 2024-08-09 山东云智农农业科技有限公司 Pest detection and management system based on machine vision and AR

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101699511A (en) * 2009-10-30 2010-04-28 深圳创维数字技术股份有限公司 Color image segmentation method and system
CN102759528A (en) * 2012-07-09 2012-10-31 陕西科技大学 Method for detecting diseases of crop leaves
CN102915446A (en) * 2012-09-20 2013-02-06 复旦大学 Plant disease and pest detection method based on SVM (support vector machine) learning

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101699511A (en) * 2009-10-30 2010-04-28 深圳创维数字技术股份有限公司 Color image segmentation method and system
CN102759528A (en) * 2012-07-09 2012-10-31 陕西科技大学 Method for detecting diseases of crop leaves
CN102915446A (en) * 2012-09-20 2013-02-06 复旦大学 Plant disease and pest detection method based on SVM (support vector machine) learning

Cited By (64)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103778630A (en) * 2014-01-16 2014-05-07 中华人民共和国海南出入境检验检疫局 Field disease degree image identification method based on android
TWI490793B (en) * 2014-02-11 2015-07-01 亞洲大學 Plant diseases and insect pests identifying method and system thereof
CN103903006A (en) * 2014-03-05 2014-07-02 中国科学院合肥物质科学研究院 Crop pest identification method and system based on Android platform
CN103886096A (en) * 2014-04-03 2014-06-25 江苏物联网研究发展中心 Remote insect pest identification method based on pictures
CN104063686A (en) * 2014-06-17 2014-09-24 中国科学院合肥物质科学研究院 System and method for performing interactive diagnosis on crop leaf segment disease images
CN104063686B (en) * 2014-06-17 2017-08-29 中国科学院合肥物质科学研究院 Crop leaf diseases image interactive diagnostic system and method
CN104077612A (en) * 2014-07-15 2014-10-01 中国科学院合肥物质科学研究院 Pest image recognition method based on multi-feature sparse representation technology
CN104077612B (en) * 2014-07-15 2017-09-22 中国科学院合肥物质科学研究院 A kind of insect image-recognizing method based on multiple features rarefaction representation technology
CN104700108A (en) * 2015-02-13 2015-06-10 中国农业大学 Remote diagnosis method and system for celery disease
CN104778686A (en) * 2015-03-23 2015-07-15 无锡中科智能农业发展有限责任公司 Tissue culture prewarning method and system based on scab monitoring
CN104778686B (en) * 2015-03-23 2017-09-22 无锡中科智能农业发展有限责任公司 A kind of tissue culture method for early warning monitored based on scab
CN106508513A (en) * 2016-09-05 2017-03-22 深圳市双赢伟业科技股份有限公司 Agricultural interconnected deinsectization weeding method
CN106446942A (en) * 2016-09-18 2017-02-22 兰州交通大学 Crop disease identification method based on incremental learning
US10964009B2 (en) 2016-10-13 2021-03-30 Mccain Foods Limited Method, medium, and system for detecting potato virus in a crop image
US11645743B2 (en) 2016-10-13 2023-05-09 Resson Aerospace Corporation Method, medium, and system for detecting potato virus in a crop image
CN106778782A (en) * 2016-12-15 2017-05-31 盐城工学院 Identifying pest and prevention and controls and system
CN106874860A (en) * 2017-01-23 2017-06-20 中粮长城葡萄酒(烟台)有限公司 The quick, intelligent identifying system of the similar disease of grape and its method
CN106991449A (en) * 2017-04-10 2017-07-28 大连大学 A kind of living scene reconstruct assists in identifying the method for blueberry kind
CN108073947A (en) * 2017-04-10 2018-05-25 大连大学 A kind of method for identifying blueberry kind
CN108073947B (en) * 2017-04-10 2021-08-27 大连大学 Method for identifying blueberry varieties
US10768584B2 (en) 2017-06-26 2020-09-08 International Business Machines Corporation Cognitive plant clinic
GB2565211A (en) * 2017-06-26 2019-02-06 Ibm Cognitive plant clinic
CN107292874A (en) * 2017-06-29 2017-10-24 深圳前海弘稼科技有限公司 The control method and device of crop disease
CN107516311A (en) * 2017-08-08 2017-12-26 中国科学技术大学 A detection method of corn damage rate based on GPU embedded platform
CN111246734A (en) * 2017-10-18 2020-06-05 威里利生命科学有限责任公司 Insect sensing system and method
CN108563979A (en) * 2017-12-29 2018-09-21 南京农业大学 A method of based on the farmland image discriminating rice blast state of an illness of taking photo by plane
CN108563979B (en) * 2017-12-29 2021-09-07 南京农业大学 A method for judging the condition of rice blast disease based on aerial images of farmland
CN108537769A (en) * 2018-01-08 2018-09-14 黑龙江省农业科学院植物保护研究所 A kind of recognition methods of the leaf blight of corn, device, equipment and medium
CN108492295A (en) * 2018-03-30 2018-09-04 深圳春沐源控股有限公司 Fruit annesl control method and device
WO2019184212A1 (en) * 2018-03-30 2019-10-03 深圳春沐源控股有限公司 Method and apparatus for analyzing pest trend, and computer-readable storage medium
CN108564124A (en) * 2018-04-13 2018-09-21 山东农业大学 A kind of magnaporthe grisea spore microimage detection recognition methods based on support vector machines
CN108596262A (en) * 2018-04-28 2018-09-28 北京麦飞科技有限公司 A kind of method and system carrying out plant disease spot classification based on computer vision
CN108805246A (en) * 2018-06-19 2018-11-13 江苏大学 A method of intelligence indicates Quick Response Code and using the Quick Response Code to food status monitoring
CN108805246B (en) * 2018-06-19 2020-08-07 江苏大学 Intelligent indication two-dimensional code and method for monitoring food state by using same
CN109101891A (en) * 2018-07-17 2018-12-28 哈尔滨理工大学 A kind of rice pest detection system and its detection method merging artificial intelligence
CN109308697A (en) * 2018-09-18 2019-02-05 安徽工业大学 A method of leaf disease identification based on machine learning algorithm
CN109308697B (en) * 2018-09-18 2024-03-22 安徽工业大学 Leaf disease identification method based on machine learning algorithm
CN109346157A (en) * 2018-09-29 2019-02-15 中关云(北京)科技有限公司 A kind of remote machine image identifying and diagnosing system and method
CN113228047A (en) * 2018-10-24 2021-08-06 克莱米特公司 Plant disease detection using multi-stage, multi-scale deep learning
CN109859212A (en) * 2019-01-16 2019-06-07 中国计量大学 A kind of unmanned plane image soybean crops row dividing method
CN109858416A (en) * 2019-01-21 2019-06-07 浙江科技学院 A kind of method of the identification pest and disease damage of insecticidal lamp
CN110287759A (en) * 2019-03-25 2019-09-27 广东工业大学 An eye fatigue detection method based on simplified input convolutional neural network O-CNN
CN110310291A (en) * 2019-06-25 2019-10-08 四川省农业科学院农业信息与农村经济研究所 A kind of rice blast hierarchy system and its method
CN110544237B (en) * 2019-08-06 2023-04-25 广州林猫物种自动识别技术有限公司 Tea-oil tree plant disease and insect pest model training method and identification method based on image analysis
CN110544237A (en) * 2019-08-06 2019-12-06 广州林猫物种自动识别技术有限公司 Oil tea pest model training method and recognition method based on image analysis
CN110689507A (en) * 2019-11-08 2020-01-14 北京软通智慧城市科技有限公司 Insect type identification device, system and method
CN111105393A (en) * 2019-11-25 2020-05-05 长安大学 Grape disease and pest identification method and device based on deep learning
CN111105393B (en) * 2019-11-25 2023-04-18 长安大学 Grape disease and pest identification method and device based on deep learning
CN110930447A (en) * 2019-12-09 2020-03-27 成都信息工程大学 Android-based unattended snow depth measurement method
JP2021099809A (en) * 2019-12-23 2021-07-01 住友化学株式会社 Image classification device, image classification method, and method of generating image classification model
JP7339234B2 (en) 2019-12-23 2023-09-05 住友化学株式会社 Image classification device, image classification method, and image classification model generation method
CN111539293A (en) * 2020-04-17 2020-08-14 北京派得伟业科技发展有限公司 Fruit tree disease diagnosis method and system
CN111695560A (en) * 2020-05-12 2020-09-22 浙江省农业科学院 Method for actively positioning and focusing crop diseases and insect pests based on convolutional neural network
CN111814866A (en) * 2020-07-02 2020-10-23 深圳市万物云科技有限公司 Disease and pest early warning method and device, computer equipment and storage medium
CN112036470A (en) * 2020-08-28 2020-12-04 扬州大学 Cloud transmission-based multi-sensor fusion cucumber bemisia tabaci identification method
CN112085032A (en) * 2020-09-14 2020-12-15 衢州学院 Dynamic monitoring model of Huyou Pomelo diseases and insect pests based on the combination of Internet of Things image processing and SVM
CN112668404A (en) * 2020-12-10 2021-04-16 哈尔滨师范大学 Effective identification method for soybean diseases and insect pests
CN112750123A (en) * 2021-01-22 2021-05-04 武汉工程大学 Rice disease and insect pest monitoring method and system
CN114972347A (en) * 2022-07-29 2022-08-30 中化现代农业有限公司 Crop pest detection method, system, equipment and medium
CN115471747A (en) * 2022-08-30 2022-12-13 广东省农业科学院环境园艺研究所 AI (artificial intelligence) rapid identification method for camellia diseases and insect pests and physiological diseases and application
CN116206741A (en) * 2023-05-05 2023-06-02 泰安市中心医院(青岛大学附属泰安市中心医院、泰山医养中心) Gastroenterology medical information processing system and method
CN117576571A (en) * 2024-01-16 2024-02-20 汉中中园农业科技发展(集团)有限公司 Multi-mode fruit and vegetable leaf disease identification method and system based on images and texts
CN117576571B (en) * 2024-01-16 2024-04-26 汉中中园农业科技发展(集团)有限公司 Multi-mode fruit and vegetable leaf disease identification method and system based on images and texts
CN118469927A (en) * 2024-04-30 2024-08-09 山东云智农农业科技有限公司 Pest detection and management system based on machine vision and AR

Similar Documents

Publication Publication Date Title
CN103514459A (en) Method and system for identifying crop diseases and pests based on Android mobile phone platform
Zhou et al. Semantic-supervised infrared and visible image fusion via a dual-discriminator generative adversarial network
US12039454B2 (en) Microexpression-based image recognition method and apparatus, and related device
JP6956252B2 (en) Facial expression synthesis methods, devices, electronic devices and computer programs
Kliper-Gross et al. Motion interchange patterns for action recognition in unconstrained videos
WO2019245768A1 (en) System for predicting articulated object feature location
CN104077579B (en) Facial expression recognition method based on expert system
Vretos et al. 3D facial expression recognition using Zernike moments on depth images
CN111989689A (en) Method for recognizing objects in images and mobile device for performing the method
Chrysos et al. Deep face deblurring
Zhao et al. Fine-grained diabetic wound depth and granulation tissue amount assessment using bilinear convolutional neural network
CN108388882A (en) Based on the gesture identification method that the overall situation-part is multi-modal RGB-D
CN109325408A (en) A gesture judgment method and storage medium
CN110858277A (en) Method and device for obtaining attitude classification model
CN107886110A (en) Method for detecting human face, device and electronic equipment
CN115035581A (en) Facial expression recognition method, terminal device and storage medium
KR101141643B1 (en) Apparatus and Method for caricature function in mobile terminal using basis of detection feature-point
Nanni et al. A standardized approach for skin detection: analysis of the literature and case studies
Mosayyebi et al. Gender recognition in masked facial images using EfficientNet and transfer learning approach
Tasdizen et al. Improving the robustness of convolutional networks to appearance variability in biomedical images
CN118505731B (en) Medical image segmentation method, system, electronic device and storage medium
CN112580395A (en) Depth information-based 3D face living body recognition method, system, device and medium
Bharti et al. Novel error correction-based key frame extraction technique for dynamic hand gesture recognition
Jetley et al. 3D activity recognition using motion history and binary shape templates
CN108898059A (en) Flowers recognition methods and its equipment

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C53 Correction of patent of invention or patent application
CB03 Change of inventor or designer information

Inventor after: Guo Yuxian

Inventor after: Zhang Jian

Inventor after: Li Miao

Inventor after: Gao Huiyi

Inventor after: Dong Jun

Inventor after: Li Hualong

Inventor before: Zhang Jie

Inventor before: Yan Shu

Inventor before: Nie Yuman

Inventor before: Li Rui

Inventor before: Xie Chengjun

Inventor before: Song Liangtu

Inventor before: Wang Rujing

Inventor before: Zhou Linli

Inventor before: Huang He

Inventor before: Dong Wei

Inventor before: Guo Shupu

COR Change of bibliographic data

Free format text: CORRECT: INVENTOR; FROM: ZHANG JIE LI RUI XIE CHENGJUN SONG LIANGTU WANG RUJING ZHOU LINLI HUANG HE DONG WEI GUO SHUPU YAN SHU NIE YUMAN TO: GUO YUXIAN ZHANG JIAN LI MIAO GAO HUIYI DONG JUN LI HUALONG

ASS Succession or assignment of patent right

Free format text: FORMER OWNER: INFORMATION INSTITUTE, ANHUI ACADEMY OF AGRICULTURAL SCIENCES

Effective date: 20140513

C41 Transfer of patent application or patent right or utility model
TA01 Transfer of patent application right

Effective date of registration: 20140513

Address after: 230031 Shushan Lake Road, Anhui, China, No. 350, No.

Applicant after: Hefei Inst. of Matter Sciences, Chinese Academy of Sciences

Address before: 230031 Shushan Lake Road, Anhui, China, No. 350, No.

Applicant before: Hefei Inst. of Matter Sciences, Chinese Academy of Sciences

Applicant before: INFORMATION INSTITUTE, ANHUI ACADEMY OF AGRICULTURAL SCIENCES

WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20140115

WD01 Invention patent application deemed withdrawn after publication