CN116310489A - Agricultural pest monitoring system and method based on big data - Google Patents
Agricultural pest monitoring system and method based on big data Download PDFInfo
- Publication number
- CN116310489A CN116310489A CN202211706884.3A CN202211706884A CN116310489A CN 116310489 A CN116310489 A CN 116310489A CN 202211706884 A CN202211706884 A CN 202211706884A CN 116310489 A CN116310489 A CN 116310489A
- Authority
- CN
- China
- Prior art keywords
- image
- leaf
- crops
- diseases
- branch
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 241000607479 Yersinia pestis Species 0.000 title claims abstract description 112
- 238000012544 monitoring process Methods 0.000 title claims abstract description 13
- 238000000034 method Methods 0.000 title claims abstract description 10
- 201000010099 disease Diseases 0.000 claims abstract description 93
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 claims abstract description 93
- 241000238631 Hexapoda Species 0.000 claims abstract description 76
- 241000196324 Embryophyta Species 0.000 claims description 73
- 239000013598 vector Substances 0.000 claims description 21
- 240000004050 Pentaglottis sempervirens Species 0.000 claims description 19
- 235000004522 Pentaglottis sempervirens Nutrition 0.000 claims description 19
- 238000000605 extraction Methods 0.000 claims description 12
- 238000012549 training Methods 0.000 claims description 9
- 238000003062 neural network model Methods 0.000 claims description 4
- 230000011218 segmentation Effects 0.000 claims description 4
- 230000009286 beneficial effect Effects 0.000 description 7
- 238000007726 management method Methods 0.000 description 6
- SAZUGELZHZOXHB-UHFFFAOYSA-N acecarbromal Chemical compound CCC(Br)(CC)C(=O)NC(=O)NC(C)=O SAZUGELZHZOXHB-UHFFFAOYSA-N 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000005856 abnormality Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
- G06V10/761—Proximity, similarity or dissimilarity measures
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02A—TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
- Y02A40/00—Adaptation technologies in agriculture, forestry, livestock or agroalimentary production
- Y02A40/10—Adaptation technologies in agriculture, forestry, livestock or agroalimentary production in agriculture
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Multimedia (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Evolutionary Computation (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Software Systems (AREA)
- Health & Medical Sciences (AREA)
- Databases & Information Systems (AREA)
- Computing Systems (AREA)
- Artificial Intelligence (AREA)
- Image Processing (AREA)
Abstract
Description
技术领域technical field
本发明涉及数据处理技术领域,特别涉及一种基于大数据的农业病虫害监管系统及方法。The invention relates to the technical field of data processing, in particular to a system and method for monitoring agricultural diseases and insect pests based on big data.
背景技术Background technique
目前,农业园内种植有大量的农作物,需要安排多个有农作物病虫害判断经验的人员定期对农作物进行一一病虫害检查,人力成本较大。At present, there are a large number of crops planted in the agricultural park, and it is necessary to arrange a number of personnel with experience in judging crop diseases and insect pests to regularly inspect the crops one by one, and the labor cost is relatively high.
因此,亟需一种解决办法。Therefore, a solution is urgently needed.
发明内容Contents of the invention
本发明目的之一在于提供了一种基于大数据的农业病虫害监管系统,无需安排多个有农作物病虫害判断经验的人员定期对农作物进行一一病虫害检查,降低了人力成本。One of the purposes of the present invention is to provide a big data-based agricultural pest monitoring system, without arranging multiple personnel with experience in judging crop pests to regularly check crops one by one, reducing labor costs.
本发明实施例提供的一种基于大数据的农业病虫害监管系统,包括:A big data-based agricultural disease and insect pest supervision system provided by the embodiments of the present invention includes:
枝叶图像获取模块,用于通过摄像小车获取农业园内的农作物的枝叶图像;The branch and leaf image acquisition module is used to obtain the branch and leaf image of the crops in the agricultural garden by the camera dolly;
病虫害图像获取模块,用于从大数据平台上获取所述农作物的病虫害图像;The image acquisition module of diseases and insect pests is used to acquire the images of diseases and insect pests of the crops from the big data platform;
病虫害农作物确定模块,用于基于所述枝叶图像和所述病虫害图像,确定病虫害农作物;The crops with diseases and insect pests determination module is used to determine the crops with diseases and insect pests based on the images of branches and leaves and the images of diseases and insect pests;
预警模块,用于将所述病虫害农作物预警给所述农业园的管理人员。The early warning module is used to warn the management personnel of the agricultural garden of the crops of the diseases and insect pests.
优选的,所述枝叶图像获取模块通过摄像小车获取农业园内的农作物的枝叶图像,执行如下操作:Preferably, the branch and leaf image acquisition module obtains the branch and leaf images of the crops in the agricultural garden through the camera car, and performs the following operations:
获取所述农作物的鸟瞰图像;obtaining a bird's-eye view image of the crop;
基于所述鸟瞰图像,规划所述摄像小车的巡拍路线;Based on the bird's-eye view image, plan the patrol route of the camera car;
基于所述巡拍路线,控制所述摄像小车在所述农业园内进行移动;Controlling the camera trolley to move in the agricultural garden based on the patrol route;
当所述摄像小车抵达所述农作物中任一目标植株旁时,控制所述摄像小车拍摄所述目标植株的外部图像;When the camera car arrives at any target plant in the crop, control the camera car to take an external image of the target plant;
基于所述外部图像,确定所述目标植株的内部需要进行补拍的补拍位置;Based on the external image, determine the re-shooting position of the target plant that needs to be re-shot;
控制所述摄像小车拍摄所述补拍位置的内部图像;Controlling the camera dolly to capture the internal image of the supplementary shooting position;
将所述外部图像与所述内部图像作为枝叶图像。The external image and the internal image are used as branch and leaf images.
优选的,所述枝叶图像获取模块基于所述鸟瞰图像,规划所述摄像小车的巡拍路线,执行如下操作:Preferably, the branch and leaf image acquisition module plans the patrol route of the camera car based on the bird's-eye view image, and performs the following operations:
从所述鸟瞰图像中提取园区道路以及与所述园区道路连接的植株空隙;Extracting park roads and plant gaps connected to the park roads from the bird's-eye view image;
基于预设的分段模板,将所述植株空隙分成多个空隙段;dividing the plant gap into a plurality of gap segments based on a preset segmentation template;
按照所述空隙段与所述园区道路的位置关系由近到远依次遍历所述空隙段;According to the positional relationship between the gap segment and the road in the park, the gap segment is traversed from near to far;
每次遍历时,基于预设的第一特征提取模板,对遍历到的所述空隙段进行特征提取,获得空隙特征集;During each traversal, based on the preset first feature extraction template, perform feature extraction on the traversed gap segments to obtain a gap feature set;
将所述空隙特征集与所述农作物对应的预设的标准空隙特征集进行匹配,获取第一匹配度;matching the gap feature set with a preset standard gap feature set corresponding to the crop to obtain a first matching degree;
若所述第一匹配度小于预设的第一匹配度阈值,将之前遍历到的所述空隙段拼接作为最长移动空隙;If the first matching degree is less than the preset first matching degree threshold, splicing the previously traversed gap segments as the longest moving gap;
从所述鸟瞰图像中提取植株分布;Extracting plant distribution from the bird's-eye view image;
基于所述园区道路、最长移动空隙和所述植株分布,规划所述摄像小车的巡拍路线。Based on the road in the park, the longest moving gap and the distribution of the plants, the patrolling route of the camera car is planned.
优选的,所述枝叶图像获取模块基于所述外部图像,确定所述目标植株的内部需要进行补拍的补拍位置,执行如下操作:Preferably, based on the external image, the branch and leaf image acquisition module determines the re-shooting position of the target plant that needs to be re-shot, and performs the following operations:
基于所述外部图像,确定所述目标植株的叶子背面是否有必要进行图像采集;Based on the external image, determine whether image acquisition is necessary for the back of the leaf of the target plant;
若是,将所述目标植株的对应所述叶子背面的位置作为补拍位置;If so, use the position corresponding to the back of the leaf of the target plant as the supplementary shooting position;
和/或,and / or,
基于所述外部图像,确定所述目标植株的枝茎背面是否有必要进行图像采集;Based on the external image, determine whether image acquisition is necessary on the back of the stem of the target plant;
若是,将所述目标植株的对应所述枝茎背面的位置作为补拍位置;If so, the position corresponding to the back of the branch stem of the target plant is used as the supplementary shooting position;
和/或,and / or,
基于所述外部图像,确定所述目标植株的枝叶拍摄盲区,并将所述枝叶拍摄盲区的位置作为补拍位置。Based on the external image, a shooting blind area of branches and leaves of the target plant is determined, and the position of the blind shooting area of branches and leaves is used as a supplementary shooting position.
优选的,所述枝叶图像获取模块基于所述外部图像,确定所述目标植株的叶子背面是否有必要进行图像采集,执行如下操作:Preferably, the branch and leaf image acquisition module determines whether image acquisition is necessary on the back of the leaf of the target plant based on the external image, and performs the following operations:
从所述外部图像中提取叶子轮廓;extracting leaf outlines from said external image;
基于预设的第二特征提取模板,对所述叶子轮廓进行提取,获得第一轮廓特征集;Extracting the leaf outline based on a preset second feature extraction template to obtain a first outline feature set;
将所述第一轮廓特征集与所述农作物对应的预设的第一标准轮廓特征集进行匹配,获取第二匹配度;Matching the first profile feature set with a preset first standard profile feature set corresponding to the crop to obtain a second matching degree;
若所述第二匹配度小于等于预设的第二匹配度阈值,确定所述目标植株的叶子背面有必要进行图像采集。If the second matching degree is less than or equal to the preset second matching degree threshold, it is determined that image acquisition is necessary for the back of the leaf of the target plant.
优选的,所述枝叶图像获取模块基于所述外部图像,确定所述目标植株的枝茎背面是否有必要进行图像采集,包括:Preferably, the branch and leaf image acquisition module determines whether image acquisition is necessary on the back of the branch and stem of the target plant based on the external image, including:
从所述外部图像中提取枝茎轮廓;extracting stem outlines from said external image;
基于预设的第三特征提取模板,对所述枝茎轮廓进行提取,获得第二轮廓特征集;Extracting the stem outline based on a preset third feature extraction template to obtain a second outline feature set;
将所述第二轮廓特征集与所述农作物对应的预设的第二标准轮廓特征集进行匹配,获取第三匹配度;Matching the second profile feature set with the preset second standard profile feature set corresponding to the crops to obtain a third matching degree;
若所述第三匹配度小于等于预设的第三匹配度阈值,确定所述目标植株的枝茎背面有必要进行图像采集。If the third matching degree is less than or equal to the preset third matching degree threshold, it is determined that image acquisition is necessary on the back of the branch of the target plant.
优选的,所述枝叶图像获取模块控制所述摄像小车拍摄所述补拍位置的内部图像,执行如下操作:Preferably, the branch and leaf image acquisition module controls the camera trolley to capture the internal image of the supplementary shooting position, and performs the following operations:
从所述外部图像中提取枝叶空隙;extracting foliage voids from said external image;
确定所述枝叶空隙旁的所述补拍位置,并作为目标补拍位置;Determining the re-shooting position next to the gap between the branches and leaves, and using it as the target re-shooting position;
基于所述目标补拍位置和由所述目标补拍位置向所述枝叶空隙的空隙中心的直线方向,构建方向向量;Constructing a direction vector based on the target re-shooting position and the straight line direction from the target re-shooting position to the gap center of the foliage gap;
当连续N个所述方向向量两两之间的向量夹角落在预设的向量夹角区间内时,从连续N个所述方向向量对应的所述目标补拍位置中确定相对居中位置;When the vector angle between two consecutive N direction vectors is within the preset vector angle interval, determine the relative center position from the target supplementary shooting positions corresponding to the N consecutive direction vectors;
将由所述空隙中心向所述相对居中位置的直线方向作为镜头拍摄方向;Taking the straight line direction from the center of the gap to the relative middle position as the shooting direction of the lens;
控制所述摄像小车上的摄像头前往所述空隙中心以所述镜头拍摄方向拍摄所述补拍位置的内部图像。Controlling the camera on the camera trolley to go to the center of the gap to shoot the internal image of the supplementary shooting position in the shooting direction of the lens.
优选的,所述病虫害图像获取模块从大数据平台上获取所述农作物的病虫害图像,执行如下操作:Preferably, the image acquisition module of diseases and insect pests obtains the images of diseases and insect pests of the crops from the big data platform, and performs the following operations:
获取所述农作物对应的预设的病虫害图像检索模板;Acquiring a preset image retrieval template of diseases and insect pests corresponding to the crops;
基于所述病虫害图像检索模板,从大数据平台上检索出所述农作物的病虫害图像。Based on the image retrieval template of diseases and insect pests, the images of diseases and insect pests of the crops are retrieved from the big data platform.
优选的,所述病虫害农作物确定模块基于所述枝叶图像和所述病虫害图像,确定病虫害农作物,包括:Preferably, the crops with diseases and insect pests determining module determines the crops with diseases and insect pests based on the images of branches and leaves and the images of diseases and insect pests, including:
将所述病虫害图像作为训练样本输入至神经网络模型中进行训练获得病虫害识别模型;The pest image is input into the neural network model as a training sample for training to obtain a pest identification model;
将所述枝叶图像输入至所述病虫害识别模型,确定病虫害农作物。The branch and leaf images are input into the pest recognition model to determine crops with pests and diseases.
本发明实施例提供的一种基于大数据的农业病虫害监管方法,包括:A method for supervising agricultural diseases and insect pests based on big data provided by the embodiments of the present invention includes:
步骤S1:通过摄像小车获取农业园内的农作物的枝叶图像;Step S1: Obtain the branch and leaf images of the crops in the agricultural garden through the camera car;
步骤S2:从大数据平台上获取所述农作物的病虫害图像;Step S2: Obtaining images of diseases and insect pests of the crops from the big data platform;
步骤S3:基于所述枝叶图像和所述病虫害图像,确定病虫害农作物;Step S3: Based on the images of branches and leaves and the images of pests and diseases, determine crops with pests and diseases;
步骤S4:将所述病虫害农作物预警给所述农业园的管理人员。Step S4: Alerting the crops of the diseases and insect pests to the management personnel of the agricultural garden.
本发明的其它特征和优点将在随后的说明书中阐述,并且,部分地从说明书中变得显而易见,或者通过实施本发明而了解。本发明的目的和其他优点可通过在所写的说明书、权利要求书、以及附图中所特别指出的结构来实现和获得。Additional features and advantages of the invention will be set forth in the description which follows, and in part will be apparent from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention may be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
下面通过附图和实施例,对本发明的技术方案做进一步的详细描述。The technical solutions of the present invention will be described in further detail below with reference to the accompanying drawings and embodiments.
附图说明Description of drawings
附图用来提供对本发明的进一步理解,并且构成说明书的一部分,与本发明的实施例一起用于解释本发明,并不构成对本发明的限制。在附图中:The accompanying drawings are used to provide a further understanding of the present invention, and constitute a part of the description, and are used together with the embodiments of the present invention to explain the present invention, and do not constitute a limitation to the present invention. In the attached picture:
图1为本发明实施例中一种基于大数据的农业病虫害监管系统的示意图;Fig. 1 is the schematic diagram of a kind of agricultural disease and insect pest monitoring system based on big data in the embodiment of the present invention;
图2为本发明实施例中一种基于大数据的农业病虫害监管方法的示意图。Fig. 2 is a schematic diagram of a big data-based agricultural pest and disease supervision method in an embodiment of the present invention.
具体实施方式Detailed ways
以下结合附图对本发明的优选实施例进行说明,应当理解,此处所描述的优选实施例仅用于说明和解释本发明,并不用于限定本发明。The preferred embodiments of the present invention will be described below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described here are only used to illustrate and explain the present invention, and are not intended to limit the present invention.
本发明实施例提供了一种基于大数据的农业病虫害监管系统,如图1所示,包括:The embodiment of the present invention provides a big data-based agricultural disease and insect pest supervision system, as shown in Figure 1, including:
枝叶图像获取模块1,用于通过摄像小车获取农业园内的农作物的枝叶图像;The branch and leaf
病虫害图像获取模块2,用于从大数据平台上获取所述农作物的病虫害图像;Pest and disease
病虫害农作物确定模块3,用于基于所述枝叶图像和所述病虫害图像,确定病虫害农作物;The pest-damage
预警模块4,用于将所述病虫害农作物预警给所述农业园的管理人员。The
上述技术方案的工作原理及有益效果为:The working principle and beneficial effects of the above-mentioned technical scheme are:
摄像小车为带有摄像头的移动小车。大数据平台基于大数据技术收集农作物的病虫害图像。在具体应用的时候,摄像小车在农业园内移动,拍摄农作物的枝叶图像,基于枝叶图像与从数据平台上获取的病虫害图像,确定病虫害农作物,例如以两者图像比对的方式进行确定,将病虫害农作物预警给管理人员,例如以手机信息通知的方式通知管理人员。无需安排多个有农作物病虫害判断经验的人员定期对农作物进行一一病虫害检查,降低了人力成本。The camera car is a mobile car with a camera. The big data platform collects images of crop diseases and insect pests based on big data technology. In a specific application, the camera car moves in the agricultural garden, takes images of branches and leaves of crops, and determines crops with diseases and insect pests based on the images of branches and leaves and the images of diseases and insect pests obtained from the data platform, for example, by comparing the two images. Early warning of plant diseases and insect pests is given to management personnel, for example, notifying management personnel by means of mobile phone information notification. There is no need to arrange for multiple personnel with experience in judging crop diseases and insect pests to regularly inspect crops one by one for diseases and insect pests, which reduces labor costs.
在一个实施例中,所述枝叶图像获取模块1通过摄像小车获取农业园内的农作物的枝叶图像,执行如下操作:In one embodiment, the branch and leaf
获取所述农作物的鸟瞰图像;obtaining a bird's-eye view image of the crop;
基于所述鸟瞰图像,规划所述摄像小车的巡拍路线;Based on the bird's-eye view image, plan the patrol route of the camera car;
基于所述巡拍路线,控制所述摄像小车在所述农业园内进行移动;Controlling the camera trolley to move in the agricultural garden based on the patrol route;
当所述摄像小车抵达所述农作物中任一目标植株旁时,控制所述摄像小车拍摄所述目标植株的外部图像;When the camera car arrives at any target plant in the crop, control the camera car to take an external image of the target plant;
基于所述外部图像,确定所述目标植株的内部需要进行补拍的补拍位置;Based on the external image, determine the re-shooting position of the target plant that needs to be re-shot;
控制所述摄像小车拍摄所述补拍位置的内部图像;Controlling the camera dolly to capture the internal image of the supplementary shooting position;
将所述外部图像与所述内部图像作为枝叶图像。The external image and the internal image are used as branch and leaf images.
上述技术方案的工作原理及有益效果为:The working principle and beneficial effects of the above-mentioned technical scheme are:
鸟瞰图像可以通过设置于农业园内高处的鸟瞰摄像机向下拍摄获取。可以基于鸟瞰图像确定农业园内可供摄像小车移动的路线及农作物分布,因此,可用于巡拍路线的规划。基于巡拍路线,控制摄像小车在农业园内进行移动。正常的,植株的枝叶叠加错落,病虫害不仅会发生于枝叶正面,还会发生于枝叶背面,因此,单拍摄目标植株的外部图像,不足以进行病虫害确定,因此,基于外部图像,确定目标植株的内部需要进行补拍的补拍位置,例如枝叶背面和内部拍摄盲区等,控制摄像小车拍摄补拍位置的内部图像,将外部图像与内部图像作为枝叶图像,提升用于病虫害监测的枝叶图像获取的全面性和合理性。The bird's-eye view image can be obtained by shooting down from the bird's-eye camera set at a high place in the agricultural park. Based on the bird's-eye view image, the route for the camera trolley to move and the distribution of crops in the agricultural park can be determined, so it can be used for planning the patrolling route. Based on the patrol route, the camera car is controlled to move in the agricultural garden. Normally, the branches and leaves of the plant are superimposed and scattered, and the pests and diseases will not only occur on the front of the branches and leaves, but also on the back of the branches and leaves. Therefore, a single external image of the target plant is not enough to determine the pests and diseases. Therefore, based on the external image, determine the target plant. For locations that need to be re-shot internally, such as the back of branches and leaves and internal shooting blind spots, etc., control the camera car to take the internal images of the re-shoot positions, and use the external images and internal images as branch and leaf images to improve the acquisition of branch and leaf images for pest monitoring. comprehensive and reasonable.
在一个实施例中,所述枝叶图像获取模块1基于所述鸟瞰图像,规划所述摄像小车的巡拍路线,执行如下操作:In one embodiment, the branch and leaf
从所述鸟瞰图像中提取园区道路以及与所述园区道路连接的植株空隙;Extracting park roads and plant gaps connected to the park roads from the bird's-eye view image;
基于预设的分段模板,将所述植株空隙分成多个空隙段;dividing the plant gap into a plurality of gap segments based on a preset segmentation template;
按照所述空隙段与所述园区道路的位置关系由近到远依次遍历所述空隙段;According to the positional relationship between the gap segment and the road in the park, the gap segment is traversed from near to far;
每次遍历时,基于预设的第一特征提取模板,对遍历到的所述空隙段进行特征提取,获得空隙特征集;During each traversal, based on the preset first feature extraction template, perform feature extraction on the traversed gap segments to obtain a gap feature set;
将所述空隙特征集与所述农作物对应的预设的标准空隙特征集进行匹配,获取第一匹配度;matching the gap feature set with a preset standard gap feature set corresponding to the crop to obtain a first matching degree;
若所述第一匹配度小于预设的第一匹配度阈值,将之前遍历到的所述空隙段拼接作为最长移动空隙;If the first matching degree is less than the preset first matching degree threshold, splicing the previously traversed gap segments as the longest moving gap;
从所述鸟瞰图像中提取植株分布;Extracting plant distribution from the bird's-eye view image;
基于所述园区道路、最长移动空隙和所述植株分布,规划所述摄像小车的巡拍路线。Based on the road in the park, the longest moving gap and the distribution of the plants, the patrolling route of the camera car is planned.
上述技术方案的工作原理及有益效果为:The working principle and beneficial effects of the above-mentioned technical scheme are:
农业园内有园区道路,多在植株种植区域外围设置,可供摄像小车行驶。其次,正常的,植株在种植时,会以多列排布,因此,两列植株间会留有空隙,该空隙可供摄像小车行驶,但是,随着植株的生长植株会变得茂盛,空隙面积会变小,若硬将摄像小车控制在空隙中行驶,可能会破坏植株。因此,摄像小车只能在园区道路上以及由园区道路进去能够行驶的植株空隙进行枝叶图像拍摄。则提取与园区道路连接的植株空隙,基于预设的分段模板分成多个空隙端;预设的分段模板具体为:在植株空隙中植株空隙较长的方向上作中垂线,在中垂线上每隔0.5米作垂直于中垂线的垂线,撤销中垂线,各垂线将植株空隙分成多段。提取出空隙段的空隙特征集,空隙特征集包括:最小空隙宽度和空隙平均宽度等。农作物对应的预设的标准空隙特征集具体为该农作物种植呈两列时,两列之间的空隙区域能够容纳摄像小车行驶时,空隙区域外部呈现的图像特征,包括:最小空隙宽度0.35米和空隙平均宽度0.42米。将空隙特征集与标准空隙特征集进行匹配,若第一匹配度小于等于预设的第一匹配度阈值,说明空隙段无法容纳摄像小车行驶,将之前遍历到的空隙段拼接作为最长移动空隙。再从鸟瞰图像中提取植株分布,基于园区道路、最长移动空隙和植株分布,规划所述摄像小车的巡拍路线。本发明实施例自适应确定植株空隙中能够供拍摄小车行驶的最长移动空隙,提升了在植株种植区域中规划拍摄小车巡拍路线的适用性,同时,也更加智能化。There are park roads in the agricultural park, which are mostly set up outside the planting area, and can be used by camera trolleys. Secondly, normally, when the plants are planted, they will be arranged in multiple rows. Therefore, there will be a gap between the two rows of plants, which can be used by the camera trolley. However, as the plants grow, the plants will become lush and the gaps The area will become smaller, and if the camera car is forced to drive in the gap, it may damage the plants. Therefore, the camera car can only shoot images of branches and leaves on the roads of the park and the gaps of plants that can be driven by the roads of the park. Then extract the plant gaps connected with the roads in the park, and divide them into multiple gap ends based on the preset segmentation template; Make a vertical line perpendicular to the mid-perpendicular line every 0.5 meters on the vertical line, cancel the mid-perpendicular line, and each vertical line divides the plant gap into multiple sections. The gap feature set of the gap segment is extracted, and the gap feature set includes: the minimum gap width and the average gap width, etc. The preset standard gap feature set corresponding to the crop is specifically that when the crop is planted in two columns, the gap area between the two columns can accommodate the image features presented outside the gap area when the camera trolley is driving, including: the minimum gap width is 0.35 meters and The average width of the gap is 0.42 meters. Match the gap feature set with the standard gap feature set. If the first matching degree is less than or equal to the preset first matching degree threshold, it means that the gap segment cannot accommodate the camera car, and the previously traversed gap segments are stitched together as the longest moving gap . Then extract the plant distribution from the bird's-eye view image, and plan the patrolling route of the camera car based on the park road, the longest moving gap and the plant distribution. The embodiment of the present invention adaptively determines the longest moving gap that can be used by the shooting car in the plant gap, which improves the applicability of planning the patrol route of the shooting car in the plant planting area, and at the same time, it is more intelligent.
在一个实施例中,所述枝叶图像获取模块1基于所述外部图像,确定所述目标植株的内部需要进行补拍的补拍位置,执行如下操作:In one embodiment, the branch and leaf
基于所述外部图像,确定所述目标植株的叶子背面是否有必要进行图像采集;Based on the external image, determine whether image acquisition is necessary for the back of the leaf of the target plant;
若是,将所述目标植株的对应所述叶子背面的位置作为补拍位置;If so, use the position corresponding to the back of the leaf of the target plant as the supplementary shooting position;
和/或,and / or,
基于所述外部图像,确定所述目标植株的枝茎背面是否有必要进行图像采集;Based on the external image, determine whether image acquisition is necessary on the back of the stem of the target plant;
若是,将所述目标植株的对应所述枝茎背面的位置作为补拍位置;If so, the position corresponding to the back of the branch stem of the target plant is used as the supplementary shooting position;
和/或,and / or,
基于所述外部图像,确定所述目标植株的枝叶拍摄盲区,并将所述枝叶拍摄盲区的位置作为补拍位置。Based on the external image, a shooting blind area of branches and leaves of the target plant is determined, and the position of the blind shooting area of branches and leaves is used as a supplementary shooting position.
上述技术方案的工作原理及有益效果为:The working principle and beneficial effects of the above-mentioned technical scheme are:
植株的外部图像上呈现的多为植株枝叶的正面,但是,由于枝叶的生长角度和摄像小车拍摄外部图像的角度不同,一些枝叶的背面会露出一部分,而病虫害多以区域性出现,因此,若露出的一部分未有异常,则背面无需采集。因此,第一种和第二种方式首先确定目标植株的叶子背面/枝茎背面是否有必要进行图像采集,若是,将对应位置作为不拍位置。无需对每一叶子、每一枝茎的背面进行补拍,减少了拍摄资源,提升了枝叶图像的拍摄效率。第三种则将枝叶拍摄盲区的位置作为补拍位置。The external image of the plant mostly shows the front of the branches and leaves of the plant. However, because the growth angle of the branches and leaves is different from the angle of the external image taken by the camera trolley, a part of the back of some branches and leaves will be exposed, and the pests and diseases mostly appear regionally. Therefore, if If there is no abnormality in the exposed part, there is no need to collect the back side. Therefore, the first and second methods first determine whether image acquisition is necessary on the back of the leaf/stem of the target plant, and if so, use the corresponding position as the non-shooting position. There is no need to re-shoot the back of each leaf and each stem, which reduces shooting resources and improves the shooting efficiency of branch and leaf images. The third type uses the position of the blind spot in the shooting of branches and leaves as the supplementary shooting position.
在一个实施例中,所述枝叶图像获取模块1基于所述外部图像,确定所述目标植株的叶子背面是否有必要进行图像采集,执行如下操作:In one embodiment, the branch and leaf
从所述外部图像中提取叶子轮廓;extracting leaf outlines from said external image;
基于预设的第二特征提取模板,对所述叶子轮廓进行提取,获得第一轮廓特征集;Extracting the leaf outline based on a preset second feature extraction template to obtain a first outline feature set;
将所述第一轮廓特征集与所述农作物对应的预设的第一标准轮廓特征集进行匹配,获取第二匹配度;Matching the first profile feature set with a preset first standard profile feature set corresponding to the crop to obtain a second matching degree;
若所述第二匹配度小于等于预设的第二匹配度阈值,确定所述目标植株的叶子背面有必要进行图像采集。If the second matching degree is less than or equal to the preset second matching degree threshold, it is determined that image acquisition is necessary for the back of the leaf of the target plant.
上述技术方案的工作原理及有益效果为:The working principle and beneficial effects of the above-mentioned technical scheme are:
一般的,当叶子的背面有部分在外部图像上呈现时,叶子的轮廓越与叶子正面铺开时的轮廓不一致。因此,提取叶子轮廓的第一轮廓特征集,第一轮廓特征集包括:轮廓面积、轮廓最大长度和轮廓最小长度。农作物对应的预设的第一标准轮廓特征集具体为该农作物的叶子正面铺开时的轮廓的特征,例如包括:轮廓面积3.2平方厘米、轮廓最大长度3厘米和轮廓最小长度1.5厘米。将第一轮廓特征集与第一标准轮廓特征集进行匹配,若第二匹配度小于等于预设的第二匹配度阈值,说明该叶子的背面在外部图像上呈现的部分较少,应进行采集。提升了目标植株的叶子背面是否有必要进行图像采集的确定效率和确定精准性。Generally, when a part of the back of the leaf is presented on the external image, the outline of the leaf is more inconsistent with the outline of the leaf when it is spread out on the front. Therefore, the first contour feature set of the leaf contour is extracted, and the first contour feature set includes: contour area, contour maximum length and contour minimum length. The preset first standard outline feature set corresponding to the crops is specifically the features of the outline of the leaves of the crop when the front is spread out, for example, including: outline area of 3.2 square centimeters, maximum outline length of 3 cm and minimum outline length of 1.5 cm. Match the first contour feature set with the first standard contour feature set. If the second matching degree is less than or equal to the preset second matching degree threshold, it means that the back of the leaf is less in the external image and should be collected. . The efficiency and accuracy of determining whether image acquisition is necessary for the back of the leaf of the target plant is improved.
在一个实施例中,所述枝叶图像获取模块1基于所述外部图像,确定所述目标植株的枝茎背面是否有必要进行图像采集,包括:In one embodiment, the branch and leaf
从所述外部图像中提取枝茎轮廓;extracting stem outlines from said external image;
基于预设的第三特征提取模板,对所述枝茎轮廓进行提取,获得第二轮廓特征集;Extracting the stem outline based on a preset third feature extraction template to obtain a second outline feature set;
将所述第二轮廓特征集与所述农作物对应的预设的第二标准轮廓特征集进行匹配,获取第三匹配度;Matching the second profile feature set with the preset second standard profile feature set corresponding to the crops to obtain a third matching degree;
若所述第三匹配度小于等于预设的第三匹配度阈值,确定所述目标植株的枝茎背面有必要进行图像采集。If the third matching degree is less than or equal to the preset third matching degree threshold, it is determined that image acquisition is necessary on the back of the branch of the target plant.
上述技术方案的工作原理及有益效果为:The working principle and beneficial effects of the above-mentioned technical scheme are:
一般的,当枝茎的背面有部分在外部图像上呈现时,枝茎的轮廓越与枝茎正面铺开时的轮廓不一致。因此,提取枝茎轮廓的第二轮廓特征集,第二轮廓特征集包括:轮廓面积、轮廓最大长度和轮廓最小长度。农作物对应的预设的第二标准轮廓特征集具体为该农作物的枝茎正面铺开时的轮廓的特征,例如包括:轮廓面积5.1平方厘米、轮廓最大长度4厘米和轮廓最小长度1.1厘米。将第二轮廓特征集与第二标准轮廓特征集进行匹配,若第三匹配度小于等于预设的第三匹配度阈值,说明该枝茎的背面在外部图像上呈现的部分较少,应进行采集。提升了目标植株的枝茎背面是否有必要进行图像采集的确定效率和确定精准性。Generally, when part of the back of the stem is presented on the external image, the outline of the stem is more inconsistent with the outline of the stem when it is spread out on the front. Therefore, the second contour feature set of the branch stem contour is extracted, and the second contour feature set includes: contour area, contour maximum length and contour minimum length. The preset second standard contour feature set corresponding to the crops is specifically the characteristics of the contours of the branches and stems of the crops when they are spread out in front, for example, including: a contour area of 5.1 square centimeters, a maximum contour length of 4 cm, and a minimum contour length of 1.1 cm. Match the second profile feature set with the second standard profile feature set. If the third matching degree is less than or equal to the preset third matching degree threshold, it means that the back of the branch is less in the external image, and it should be collection. The determination efficiency and determination accuracy of whether the back of the branch stem of the target plant is necessary for image acquisition are improved.
在一个实施例中,所述枝叶图像获取模块1控制所述摄像小车拍摄所述补拍位置的内部图像,执行如下操作:In one embodiment, the branch and leaf
从所述外部图像中提取枝叶空隙;extracting foliage voids from said external image;
确定所述枝叶空隙旁的所述补拍位置,并作为目标补拍位置;Determining the re-shooting position next to the gap between the branches and leaves, and using it as the target re-shooting position;
基于所述目标补拍位置和由所述目标补拍位置向所述枝叶空隙的空隙中心的直线方向,构建方向向量;Constructing a direction vector based on the target re-shooting position and the straight line direction from the target re-shooting position to the gap center of the foliage gap;
当连续N个所述方向向量两两之间的向量夹角落在预设的向量夹角区间内时,从连续N个所述方向向量对应的所述目标补拍位置中确定相对居中位置;When the vector angle between two consecutive N direction vectors is within the preset vector angle interval, determine the relative center position from the target supplementary shooting positions corresponding to the N consecutive direction vectors;
将由所述空隙中心向所述相对居中位置的直线方向作为镜头拍摄方向;Taking the straight line direction from the center of the gap to the relative middle position as the shooting direction of the lens;
控制所述摄像小车上的摄像头前往所述空隙中心以所述镜头拍摄方向拍摄所述补拍位置的内部图像。Controlling the camera on the camera trolley to go to the center of the gap to shoot the internal image of the supplementary shooting position in the shooting direction of the lens.
上述技术方案的工作原理及有益效果为:The working principle and beneficial effects of the above-mentioned technical scheme are:
枝叶之间会存在空隙,摄像头可以进入空隙进行补拍。N为正整数。预设的向量夹角区间为0度到120度。当连续N个方向向量两两之间的向量夹角落在预设的向量夹角区间内时,则说明摄像头在目标补拍位置可以对这些连续N个方向向量对应的目标补拍位置进行一次性补拍,从这些连续N个方向向量对应的目标补拍位置中确定相对居中位置,空隙中心向相对居中位置的直线方向则可作为镜头拍摄方向,控制摄像小车上的摄像头前往空隙中心以镜头拍摄方向拍摄所述补拍位置的内部图像。提升了摄像小车拍照控制的合理性,减少补拍资源,提升了补拍效率。There will be gaps between the branches and leaves, and the camera can enter the gaps for supplementary shooting. N is a positive integer. The preset vector included angle ranges from 0° to 120°. When the vector angle between two consecutive N direction vectors is within the preset vector angle interval, it means that the camera can perform a one-time measurement of the target supplementary shooting position corresponding to these consecutive N direction vectors at the target supplementary shooting position. For re-shooting, determine the relative center position from the target re-shoot positions corresponding to these consecutive N direction vectors. The straight line direction from the center of the gap to the relative center position can be used as the shooting direction of the lens. Control the camera on the camera car to go to the center of the gap to shoot with the lens direction to shoot the internal image of the supplementary shooting position. Improve the rationality of the camera car's photo control, reduce re-shooting resources, and improve the efficiency of re-shooting.
在一个实施例中,所述病虫害图像获取模块2从大数据平台上获取所述农作物的病虫害图像,执行如下操作:In one embodiment, the
获取所述农作物对应的预设的病虫害图像检索模板;Obtaining a preset image retrieval template of diseases and insect pests corresponding to the crops;
基于所述病虫害图像检索模板,从大数据平台上检索出所述农作物的病虫害图像。Based on the image retrieval template of diseases and insect pests, the images of diseases and insect pests of the crops are retrieved from the big data platform.
农作物对应的预设的病虫害图像检索模板具体为:检索出该农作可能产生的病虫害类型的病虫害图像的检索条件。基于病虫害图像检索模板,从大数据平台上检索出农作物的病虫害图像。The preset image retrieval template of diseases and insect pests corresponding to the crops is specifically: the retrieval condition for retrieving the images of diseases and insect pests of the types of diseases and insect pests that may be produced by the crops. Based on the image retrieval template of diseases and insect pests, images of diseases and insect pests of crops are retrieved from the big data platform.
在一个实施例中,所述病虫害农作物确定模块3基于所述枝叶图像和所述病虫害图像,确定病虫害农作物,包括:In one embodiment, the crops with diseases and insect
将所述病虫害图像作为训练样本输入至神经网络模型中进行训练获得病虫害识别模型;The pest image is input into the neural network model as a training sample for training to obtain a pest identification model;
将所述枝叶图像输入至所述病虫害识别模型,确定病虫害农作物。The branch and leaf images are input into the pest recognition model to determine crops with pests and diseases.
病虫害图像作为训练样本输入至神经网络模型中进行训练,训练至收敛后获得病虫害识别模型,病虫害识别模型可以代替人工基于枝叶图像进行病虫害判定,将枝叶图像输入至所述病虫害识别模型,确定病虫害农作物。The images of diseases and insect pests are input into the neural network model as training samples for training, and the identification model of diseases and insect pests is obtained after the training reaches convergence. .
本发明实施例提供了一种基于大数据的农业病虫害监管方法,如图2所示,包括:The embodiment of the present invention provides a method for supervising agricultural diseases and insect pests based on big data, as shown in Figure 2, including:
步骤S1:通过摄像小车获取农业园内的农作物的枝叶图像;Step S1: Obtain the branch and leaf images of the crops in the agricultural garden through the camera car;
步骤S2:从大数据平台上获取所述农作物的病虫害图像;Step S2: Obtaining images of diseases and insect pests of the crops from the big data platform;
步骤S3:基于所述枝叶图像和所述病虫害图像,确定病虫害农作物;Step S3: Based on the images of branches and leaves and the images of pests and diseases, determine crops with pests and diseases;
步骤S4:将所述病虫害农作物预警给所述农业园的管理人员。Step S4: Alerting the crops of the diseases and insect pests to the management personnel of the agricultural garden.
显然,本领域的技术人员可以对本发明进行各种改动和变型而不脱离本发明的精神和范围。这样,倘若本发明的这些修改和变型属于本发明权利要求及其等同技术的范围之内,则本发明也意图包含这些改动和变型在内。Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalent technologies, the present invention also intends to include these modifications and variations.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211706884.3A CN116310489A (en) | 2022-12-29 | 2022-12-29 | Agricultural pest monitoring system and method based on big data |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211706884.3A CN116310489A (en) | 2022-12-29 | 2022-12-29 | Agricultural pest monitoring system and method based on big data |
Publications (1)
Publication Number | Publication Date |
---|---|
CN116310489A true CN116310489A (en) | 2023-06-23 |
Family
ID=86834843
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202211706884.3A Withdrawn CN116310489A (en) | 2022-12-29 | 2022-12-29 | Agricultural pest monitoring system and method based on big data |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN116310489A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN117541177A (en) * | 2023-11-09 | 2024-02-09 | 南京邮电大学 | A smart agricultural monitoring and management method and system based on big data |
-
2022
- 2022-12-29 CN CN202211706884.3A patent/CN116310489A/en not_active Withdrawn
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN117541177A (en) * | 2023-11-09 | 2024-02-09 | 南京邮电大学 | A smart agricultural monitoring and management method and system based on big data |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN111582055B (en) | Unmanned aerial vehicle aviation pesticide application route generation method and system | |
CN109197278B (en) | Method and device for determining operation strategy and method for determining drug spraying strategy | |
CN109726700B (en) | Insect pest recognition early warning method and device based on multiple features | |
US20220272907A1 (en) | Automated plant monitoring systems and methods | |
CN109446959B (en) | Target area dividing method and device and medicine spraying control method | |
CN114723667A (en) | Agricultural fine planting and disaster prevention control system | |
UA121213C2 (en) | Crop stand optimization systems, methods and apparatus | |
CN108140118A (en) | For identifying the method and information system of at least one plant plant being planted on arable land | |
CN116300608A (en) | Intelligent agriculture remote monitoring system based on big data | |
CN116310489A (en) | Agricultural pest monitoring system and method based on big data | |
CN108829762A (en) | The Small object recognition methods of view-based access control model and device | |
CN110188661B (en) | Boundary identification method and device | |
CN114913333A (en) | An intelligent robot for collecting field path information and its collecting method | |
CN118153811A (en) | Automatic maintenance monitoring in gardens and early warning device | |
Laursen et al. | RoboWeedSupport-sub millimeter weed image acquisition in cereal crops with speeds up till 50 Km/h | |
CN115251024A (en) | Weeding mode determining method and device, electronic equipment and weeding system | |
CN117218534A (en) | Crop leaf disease identification method | |
CN115187943A (en) | Air-ground integrated intelligent sensing system and method for plant growth state | |
CN111783726A (en) | Herding livestock outlier video acquisition method based on artificial intelligence and BIM | |
CN109598215A (en) | Orchard modeling analysis system and method based on positioning shooting of unmanned aerial vehicle | |
Bolouri et al. | CottonSense: A high-throughput field phenotyping system for cotton fruit segmentation and enumeration on edge devices | |
CN115061168A (en) | Mobile inspection type crop growth monitoring system and method | |
EP3559864B1 (en) | Method of selecting an ordered image subset for structure assessment | |
CN112906511B (en) | An intelligent monitoring method for wildlife combining individual images and footprint images | |
CN112001290A (en) | Rice planthopper migration flight path prediction method based on YOLO algorithm |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
WW01 | Invention patent application withdrawn after publication |
Application publication date: 20230623 |
|
WW01 | Invention patent application withdrawn after publication |