CN115269704A - Multi-element heterogeneous agricultural data management system - Google Patents
Multi-element heterogeneous agricultural data management system Download PDFInfo
- Publication number
- CN115269704A CN115269704A CN202210921941.3A CN202210921941A CN115269704A CN 115269704 A CN115269704 A CN 115269704A CN 202210921941 A CN202210921941 A CN 202210921941A CN 115269704 A CN115269704 A CN 115269704A
- Authority
- CN
- China
- Prior art keywords
- data
- agricultural
- unit
- analysis
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000013523 data management Methods 0.000 title claims abstract description 28
- 238000004458 analytical method Methods 0.000 claims abstract description 81
- 238000012545 processing Methods 0.000 claims abstract description 42
- 238000007418 data mining Methods 0.000 claims abstract description 34
- 238000013079 data visualisation Methods 0.000 claims abstract description 26
- 238000007781 pre-processing Methods 0.000 claims abstract description 25
- 238000012271 agricultural production Methods 0.000 claims abstract description 24
- 238000007726 management method Methods 0.000 claims description 49
- 238000003860 storage Methods 0.000 claims description 47
- 238000007405 data analysis Methods 0.000 claims description 39
- 238000004891 communication Methods 0.000 claims description 18
- 230000006855 networking Effects 0.000 claims description 15
- 238000010276 construction Methods 0.000 claims description 12
- 230000002159 abnormal effect Effects 0.000 claims description 10
- 238000013524 data verification Methods 0.000 claims description 10
- 238000004519 manufacturing process Methods 0.000 claims description 10
- 238000010219 correlation analysis Methods 0.000 claims description 9
- 238000012795 verification Methods 0.000 claims description 6
- 230000001364 causal effect Effects 0.000 claims description 5
- 230000004927 fusion Effects 0.000 claims description 4
- 238000000611 regression analysis Methods 0.000 claims description 4
- 230000011218 segmentation Effects 0.000 claims description 4
- 238000012916 structural analysis Methods 0.000 claims description 4
- 238000012800 visualization Methods 0.000 claims description 3
- 238000012098 association analyses Methods 0.000 claims 4
- 238000000034 method Methods 0.000 abstract description 8
- 238000005516 engineering process Methods 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 4
- QVFWZNCVPCJQOP-UHFFFAOYSA-N chloralodol Chemical compound CC(O)(C)CC(C)OC(O)C(Cl)(Cl)Cl QVFWZNCVPCJQOP-UHFFFAOYSA-N 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000013500 data storage Methods 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- 230000007246 mechanism Effects 0.000 description 3
- 230000001413 cellular effect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000010354 integration Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000035945 sensitivity Effects 0.000 description 2
- 239000012773 agricultural material Substances 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 230000008713 feedback mechanism Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 210000001503 joint Anatomy 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000005065 mining Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 239000000447 pesticide residue Substances 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000007306 turnover Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2465—Query processing support for facilitating data mining operations in structured databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/26—Visual data mining; Browsing structured data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
- G06F16/285—Clustering or classification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/02—Agriculture; Fishing; Forestry; Mining
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Economics (AREA)
- Strategic Management (AREA)
- Marine Sciences & Fisheries (AREA)
- Mining & Mineral Resources (AREA)
- Agronomy & Crop Science (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Human Resources & Organizations (AREA)
- Marketing (AREA)
- Primary Health Care (AREA)
- Animal Husbandry (AREA)
- Tourism & Hospitality (AREA)
- General Business, Economics & Management (AREA)
- Quality & Reliability (AREA)
- Fuzzy Systems (AREA)
- Mathematical Physics (AREA)
- Probability & Statistics with Applications (AREA)
- Software Systems (AREA)
- Computational Linguistics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses a multi-element heterogeneous agricultural data management system, which relates to the technical field of agricultural data management and comprises a main control module, and an agricultural data preprocessing module, an agricultural data mining module, an agricultural data matching module, an agricultural data application module and an agricultural data visualization module which are sequentially connected; performing primary processing, relevance analysis and rationality prediction on the multi-element heterogeneous agricultural data to obtain agricultural three-level data; an agricultural data visualization module is arranged to display agricultural three-level data; the method can manage the multivariate heterogeneous agricultural data, and reduce the situation of 'information islands' in the agricultural production and operation link.
Description
Technical Field
The invention relates to the technical field of agricultural data management, in particular to a multivariate heterogeneous agricultural data management system.
Background
With the continuous change of information Technology, agricultural informatization and scientific planting become foundation stones for quality and efficiency improvement of contemporary agriculture, and the application of modern information technologies such as internet of things, internet, big data, cloud computing, 5G (5 th Generation Mobile Communication Technology) and artificial intelligence in the agricultural modernization process is also receiving more attention.
However, the application of modern information technology enables the data Volume to increase by times in the agricultural production and operation process, an agricultural information data set with typical big data characteristics such as scale (Volume), high speed (Velocity), diversity (Variety) and Value (Value) is formed, and meanwhile, the multi-element heterogeneous data of cross-department, cross-equipment and cross-production links enables the information isolated island situation to occur in each link of agricultural production and operation. The construction of an information sharing mechanism and the management and application of the multi-element heterogeneous data can enable agricultural production and management to better utilize modern information technology, and agricultural industry development suggestions are refined according to production and management data according to local conditions, so that the construction of the multi-element heterogeneous agricultural data management system is particularly important.
Disclosure of Invention
The invention aims to provide a multivariate heterogeneous agricultural data management system which can manage multivariate heterogeneous agricultural data and reduce the situation of 'information isolated island' in the agricultural production and operation link.
In order to achieve the purpose, the invention provides the following scheme:
a multivariate heterogeneous agricultural data management system, comprising:
the agricultural data mining system comprises a main control module, an agricultural data preprocessing module, an agricultural data mining module, an agricultural data matching module, an agricultural data application module and an agricultural data visualization module which are sequentially connected;
the agricultural data preprocessing module, the agricultural data mining module, the agricultural data matching module, the agricultural data application module and the agricultural data visualization module are all connected with the main control module;
the agricultural data preprocessing module is used for acquiring multi-element heterogeneous agricultural data, carrying out primary processing on the multi-element heterogeneous agricultural data to obtain agricultural source data, and carrying out classified storage on the agricultural source data;
the agricultural data mining module is used for carrying out relevance analysis on the agricultural source data to obtain agricultural primary data;
the agricultural data matching module is used for carrying out structural networking processing on the agricultural primary data and coding the agricultural primary data subjected to structural networking processing to obtain agricultural secondary data;
the agricultural data application module is used for predicting the rationality of an agricultural production link based on the agricultural secondary data to obtain agricultural tertiary data; the agricultural three-level data is a rationality prediction result;
the agricultural data visualization module is used for displaying the agricultural secondary data and the agricultural tertiary data;
the main control module is used for storing the agricultural source data, the agricultural primary data, the agricultural secondary data and the agricultural tertiary data in a classified mode.
Optionally, the agricultural data preprocessing module includes:
the system comprises a classification data input unit, an invalid information deleting unit and a nearby storage processing unit which are connected in sequence;
the classified data input unit is used for acquiring multiple categories of multi-element heterogeneous agricultural data;
the invalid information deleting unit is used for standardizing the multi-element heterogeneous agricultural data and deleting redundant data in the standardized multi-element heterogeneous agricultural data to obtain agricultural source data;
the nearby storage processing unit is also connected with the agricultural data mining module and the main control module; the nearby storage processing unit is used for storing agricultural source data according to the type of the multi-element heterogeneous agricultural data during collection.
Optionally, the categories include planting production type data, quality management type data, warehouse logistics type data, business type data and marketing type data.
Optionally, the agricultural data mining module includes:
the system comprises a homogeneous data analysis unit, an abnormal metadata analysis unit and an abnormal data analysis unit;
the homogeneous data analysis unit, the heterogeneous data analysis unit and the heterogeneous data analysis unit are all connected with the agricultural data preprocessing module; the homogeneous data analysis unit, the heterogeneous data analysis unit and the heterogeneous data analysis unit are also connected with the agricultural data matching module; the heterogeneous data analysis unit and the heterogeneous data analysis unit are both connected with the main control module;
the homogeneous data analysis unit is used for carrying out relevance analysis on homogeneous data in the agricultural source data to obtain first agricultural primary data;
the different metadata analysis unit is used for carrying out relevance analysis on different metadata in the agricultural source data to obtain first agricultural primary data;
the heterogeneous data analysis unit is used for performing relevance analysis on heterogeneous data in the agricultural source data to obtain first agricultural primary data.
Optionally, the relevance analysis includes text data relevance analysis, numerical data relevance analysis and text numerical data relevance analysis;
the text data relevance analysis comprises the steps of analyzing the text data by adopting one of word segmentation, representation learning, text similarity analysis, high-frequency word analysis, structural analysis or empirical analysis;
the digital data correlation analysis comprises analyzing the digital data by one of correlation analysis, causal analysis or regression analysis;
the text-to-digital data correlation analysis comprises analysis of the text data and the digital data by one of multi-modal data fusion analysis, semantic analysis or symbiotic similarity analysis.
Optionally, the agricultural data matching module includes:
the data structure network construction unit and the data coding storage unit are connected in sequence;
the data structure network construction unit is connected with the agricultural data mining module; the data structure network construction unit is used for carrying out structural networking processing on the agricultural primary data;
the data coding and storing unit is connected with the agricultural data application module and the main control module, and is used for coding the agricultural primary data subjected to structural networking processing to obtain agricultural secondary data.
Optionally, the agricultural data application module includes:
the system comprises a sharing authority opening unit, a data prediction unit, a data early warning unit and a data verification unit;
the data prediction unit is respectively connected with the agricultural data matching module, the data early warning unit, the sharing authority opening unit, the data verification unit, the agricultural data visualization module and the main control module; the data prediction unit is used for predicting the rationality of an agricultural production link based on the agricultural secondary data to obtain agricultural tertiary data;
the data early warning unit is used for carrying out early warning according to the agricultural three-level data;
the data verification unit is used for carrying out integrity verification and actual verification on the agricultural three-level data;
the sharing authority opening unit is respectively connected with the data prediction unit and a plurality of user terminals; and the sharing permission opening unit is used for sending the agricultural three-level data to a corresponding user terminal when receiving a data request sent by the user terminal.
Optionally, the agricultural data visualization module includes:
the system comprises a chart generation unit, a data alarm unit and a data use feedback unit;
the chart generation unit, the data alarm unit and the data use feedback unit are all connected with the visualization module; the chart generation unit and the data alarm unit are both connected with the main control module;
the chart generation unit is used for displaying the agricultural secondary data in real time in a visualized manner;
and the data alarm unit is used for issuing alarm information in a mode of a mobile phone short message, a system popup window or an LED information display screen when the agricultural production and operation link is abnormal according to the agricultural three-level data.
The data use feedback unit refers to the use condition feedback information according to the agricultural secondary data and the agricultural tertiary data for analysis, and the multi-element heterogeneous agricultural data management system is overlapped according to the analysis result.
Optionally, the main control module includes:
the central processor, the communication unit and the total storage unit are connected in sequence;
the central processor is also connected with the agricultural data preprocessing module, the agricultural data mining module, the agricultural data matching module, the agricultural data application module and the agricultural data visualization module;
the central processor is used for carrying out clustering processing on the agricultural source data, the agricultural primary data, the agricultural secondary data and the agricultural tertiary data to obtain a clustering processing result;
the communication unit is used for transmitting the clustering processing result;
and the total storage unit is used for storing the agricultural source data, the agricultural primary data, the agricultural secondary data and the agricultural tertiary data according to the clustering processing result.
Optionally, the main control module further includes a background management unit;
the background management unit is connected with the central processor;
the background management unit is used for carrying out system management, authority management, system information management and product management on the data in the storage unit.
According to the specific embodiment provided by the invention, the invention discloses the following technical effects:
the invention discloses a multi-element heterogeneous agricultural data management system which comprises a main control module, and an agricultural data preprocessing module, an agricultural data mining module, an agricultural data matching module, an agricultural data application module and an agricultural data visualization module which are sequentially connected; the agricultural data preprocessing module is used for acquiring multi-element heterogeneous agricultural data, performing primary processing on the multi-element heterogeneous agricultural data to obtain agricultural source data, and performing classified storage on the agricultural source data; the agricultural data mining module is used for carrying out relevance analysis on agricultural source data to obtain agricultural first-level data; the agricultural data matching module is used for carrying out structural networking processing on the agricultural primary data and coding the agricultural primary data subjected to structural networking processing to obtain agricultural secondary data; the agricultural data application module is used for predicting the rationality of an agricultural production link based on agricultural secondary data to obtain agricultural tertiary data; the agricultural three-level data is a rationality prediction result; the agricultural data visualization module is used for displaying agricultural secondary data and agricultural tertiary data; the main control module is used for storing agricultural source data, agricultural first-level data, agricultural second-level data and agricultural third-level data in a classified manner; the method can manage the multivariate heterogeneous agricultural data, and reduce the situation of 'information islands' in the agricultural production and operation link.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings without inventive exercise.
FIG. 1 is a schematic diagram illustrating a partial classification of multivariate heterogeneous agricultural data according to example 1 of the present invention;
fig. 2 is a schematic structural diagram of a multivariate heterogeneous agricultural data management system in embodiment 1 of the present invention.
Reference numerals are as follows: 01-a main control module; 02-agricultural data preprocessing module; 03-an agricultural data mining module; 04-agricultural data matching module; 05-agricultural data application module; 06-agricultural data visualization module.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The invention aims to provide a multivariate heterogeneous agricultural data management system which can manage multivariate heterogeneous agricultural data and reduce the situation of 'information isolated island' in the agricultural production and operation link.
In order to make the aforementioned objects, features and advantages of the present invention more comprehensible, the present invention is described in detail with reference to the accompanying drawings and the detailed description thereof.
Example 1
In the multi-element heterogeneous agricultural data, the main dimension of the multi-element data representing the agricultural production and operation link has the diversity; the heterogeneity means that the physical storage source of the data is different architectures (including a PC, a workstation, a large-small computer, or the like), the data storage is from different operating systems (such as Window, unix, or Linux), the data storage management mechanisms (a relational database, file-type two-dimensional data) are different, and the logical model of the data storage is heterogeneous (which means that there is a logical difference between independent production and management rings). Referring to fig. 1, the multi-element heterogeneous agricultural data categories are primarily divided into planting production type data, quality management type data, warehouse logistics type data, business type data and marketing type data. The planting production data comprises planting picking data, environment monitoring data, agricultural material use condition data, planting personnel number and the like; the quality management data comprises microelement content data, quality standard data, pesticide residue detection data and quality personnel operation data; the warehouse logistics data comprises warehouse-out and warehouse-in data, warehouse environment monitoring data, logistics turnover data and warehouse logistics personnel operation data; the operation data comprises policy data, financial data, personnel data, operation data of management personnel and the like; marketing data includes marketing data, sales data, marketing preference data, and sales personnel operational data.
As shown in fig. 2, the present embodiment provides a multiple heterogeneous agricultural data management system, including: the system comprises a main control module 01, an agricultural data preprocessing module 02, an agricultural data mining module 03, an agricultural data matching module 04, an agricultural data application module 05 and an agricultural data visualization module 06 which are connected in sequence; the agricultural data preprocessing module, the agricultural data mining module, the agricultural data matching module, the agricultural data application module and the agricultural data visualization module are all connected with the main control module. The agricultural data preprocessing module is used for acquiring multi-element heterogeneous agricultural data, performing primary processing on the multi-element heterogeneous agricultural data to obtain agricultural source data, and performing classified storage on the agricultural source data; the agricultural data mining module is used for carrying out relevance analysis on agricultural source data to obtain agricultural first-level data; the agricultural data matching module is used for carrying out structural networking processing on the agricultural primary data and coding the agricultural primary data subjected to structural networking processing to obtain agricultural secondary data; the agricultural data application module is used for predicting the rationality of an agricultural production link based on agricultural secondary data to obtain agricultural tertiary data; the agricultural three-level data is a rationality prediction result; the agricultural data visualization module is used for displaying agricultural second-level data and agricultural third-level data; the main control module is used for storing agricultural source data, agricultural first-level data, agricultural second-level data and agricultural third-level data in a classified mode.
Wherein, agricultural data preprocessing module includes: the system comprises a classification data input unit, an invalid information deleting unit and a nearby storage processing unit which are connected in sequence; the classified data input unit is used for acquiring multiple types of multi-element heterogeneous agricultural data; the invalid information deleting unit is used for standardizing the multi-element heterogeneous agricultural data and deleting redundant data in the standardized multi-element heterogeneous agricultural data to obtain agricultural source data; the nearby storage processing unit is also connected with the agricultural data mining module and the main control module; and the nearby storage processing unit is used for storing the agricultural source data according to the category of the multi-element heterogeneous agricultural data during acquisition. The categories comprise planting production data, quality management data, warehouse logistics data, business data and marketing data.
Specifically, the agricultural data mining module comprises: the system comprises a homogeneous data analysis unit, an abnormal metadata analysis unit and an abnormal data analysis unit; the homogeneous data analysis unit, the heterogeneous data analysis unit and the heterogeneous data analysis unit are all connected with the agricultural data preprocessing module; the homogeneous data analysis unit, the heterogeneous data analysis unit and the heterogeneous data analysis unit are all connected with the agricultural data matching module; the heterogeneous data analysis unit and the heterogeneous data analysis unit are also connected with the main control module; the homogeneous data analysis unit is used for carrying out relevance analysis on homogeneous data in the agricultural source data to obtain first agricultural primary data; the different metadata analysis unit is used for carrying out relevance analysis on different metadata in the agricultural source data to obtain first agricultural primary data; the heterogeneous data analysis unit is used for performing relevance analysis on heterogeneous data in the agricultural source data to obtain first agricultural first-level data. The relevance analysis comprises text data relevance analysis, digital data relevance analysis and text digital data relevance analysis; the text data relevance analysis comprises the steps of analyzing the text data by adopting one of word segmentation, representation learning, text similarity analysis, high-frequency word analysis, structural analysis or empirical analysis; the digital data correlation analysis comprises analyzing the digital data by one of correlation analysis, causal analysis or regression analysis; the text-to-digital data correlation analysis comprises analyzing the text data and the digital data by one of multi-mode data fusion analysis, semantic analysis or symbiotic similarity analysis.
Further, the agricultural data matching module includes: the data structure network construction unit and the data coding storage unit are connected in sequence; the data structure network construction unit is connected with the agricultural data mining module; the data structure network construction unit is used for carrying out structural networking processing on the agricultural primary data; the data coding and storing unit is connected with the agricultural data application module and the main control module and used for coding the agricultural primary data subjected to structural networking processing to obtain agricultural secondary data.
In addition, the agricultural data application module includes: the system comprises a sharing authority opening unit, a data prediction unit, a data early warning unit and a data verification unit; the data prediction unit is respectively connected with the agricultural data matching module, the data early warning unit, the sharing authority opening unit, the data verification unit, the agricultural data visualization module and the main control module; the data prediction unit is used for predicting the rationality of an agricultural production link based on agricultural secondary data to obtain agricultural tertiary data; the data early warning unit is used for carrying out early warning according to the agricultural three-level data; the data verification unit is used for carrying out integrity verification and actual verification on the agricultural three-level data; the sharing authority opening unit is respectively connected with the data prediction unit and the plurality of user terminals; and the sharing permission opening unit is used for sending the agricultural three-level data to the corresponding user terminal when receiving a data request sent by the user terminal.
In the multiple heterogeneous agricultural data management system provided by this embodiment, the agricultural data visualization module includes: the system comprises a chart generation unit, a data alarm unit and a data use feedback unit; the chart generation unit, the data alarm unit and the data use feedback unit are all connected with the visualization module; the chart generation unit, the data alarm unit and the data use feedback unit are all connected with the main control module; the chart generation unit is used for displaying the agricultural secondary data in real time in a visual manner;
and the data alarm unit is used for issuing alarm information in a mode of a mobile phone short message, a system popup window or an LED information display screen when the agricultural production and operation link is abnormal according to the agricultural three-level data.
The data use feedback unit refers to the use condition feedback information according to the agricultural second-level data and the agricultural third-level data for analysis, and the multi-element heterogeneous agricultural data management system is changed according to the analysis result.
Specifically, the main control module includes: the system comprises a central processor, a communication unit, a background management unit and a total storage unit which are connected in sequence; the central processor is also connected with an agricultural data preprocessing module, an agricultural data mining module, an agricultural data matching module, an agricultural data application module and an agricultural data visualization module; the central processor is used for clustering the agricultural source data, the agricultural first-level data, the agricultural second-level data and the agricultural third-level data to obtain a clustering result; the communication unit is used for transmitting the clustering processing result; and the total storage unit is used for storing the agricultural source data, the agricultural first-level data, the agricultural second-level data and the agricultural third-level data according to the clustering processing result. The background management unit is connected with the central processor; the background management unit is used for performing system management, authority management, system information management and product management on the data in the storage unit. A central processor in the main control module classifies, clusters and analyzes the input data of each module; the main Control module includes at least one logic calculating device of MCU (Micro-programmed Control Unit), CPU (Central Processing Unit), DSP (Digital Signal Processor), single chip microcomputer and embedded equipment. The communication unit comprises at least one of a Lora communication unit, an NB-IoT communication unit and a ZigBee communication unit. The Lora communication unit has the advantages of high sensitivity, strong anti-interference performance, long transmission distance, low power consumption and the like; the NB-IoT communication unit is also called a narrow-band Internet of things based on a cellular network, needs small bandwidth, but has high connection efficiency and low power consumption; zigBee is also called Zifeng, is a popular wireless network protocol for short-distance transmission, has the advantages of low power consumption, low cost, support of a large number of network nodes, support of various network topologies, low complexity and high safety, and can communicate with a cloud server by arranging a gateway.
The total storage unit module comprises a central storage and a cloud server storage, the mass agricultural information can be managed and stored at a cloud server storage server side, and the storage forms comprise a relational database, a non-relational database, an object storage and a file storage. The background management module comprises system management, authority management, system information management, product management, issuing, updating, deleting and other operations of characters, pictures, videos and other daily use data, and statistics and management of data such as order information and visitor information, so that foreground content can be updated and adjusted in time.
Example 2
The embodiment provides a heterogeneous agricultural data management system of many units includes: the agricultural data mining system comprises a main control module, an agricultural data preprocessing module, an agricultural data mining module, an agricultural data matching module, an agricultural data application module and an agricultural data visualization module.
The main control module comprises a central processor, a communication unit, a total storage unit and a background management module, wherein the central processor in the main control module classifies, clusters and analyzes the input data of each module; the main Control module includes at least one logic calculating device of MCU (Micro-programmed Control Unit), CPU (Central Processing Unit), DSP (Digital Signal Processor), single chip microcomputer and embedded equipment. The communication module comprises at least one of a Lora communication module, an NB-IoT communication module and a ZigBee communication module. The Lora communication module has the advantages of high sensitivity, strong anti-interference performance, long transmission distance, low power consumption and the like; the NB-IoT is also called a narrow-band Internet of things based on a cellular network, and has the advantages of small required bandwidth, high connection efficiency and low power consumption; zigBee is also called Zifeng, is a popular wireless network protocol for short-distance transmission, has the advantages of low power consumption, low cost, support of a large number of network nodes, support of various network topologies, low complexity and high safety, and can communicate with a cloud server by arranging a gateway.
In addition, the total storage unit comprises a central storage and a cloud server storage, the mass agricultural information can be managed and stored at the cloud server storage server side, and the storage forms comprise a relational database, a non-relational database, an object storage and a file storage. The background management module comprises system management, authority management, system information management and product management, and comprises operations of issuing, updating, deleting and the like of characters, pictures, videos and other daily use data, and statistics and management of data such as order information, visitor information and the like, so that foreground content can be updated and adjusted in time.
In the data preprocessing module, a classified data input unit receives original data output by a data source and carries out data proximity processing according to different data sources. The invalid information deleting unit and the nearby storage processing unit preset standard formats, the data are cleaned and subjected to standardization conversion, redundant and miscellaneous data and missing part data are deleted, the original data are enabled to meet the actual requirement preset, the standard formats comprise structured, unstructured and semi-structured, and the processed data are defined as agricultural source data.
In the agricultural data mining module, the homogeneous data analysis unit performs data mining and relevance analysis among homogeneous data. The heterogeneous metadata analysis unit performs data mining and relevance analysis between different generation bodies and heterogeneous data. The heterogeneous data analysis unit performs data mining and relevance analysis on data with different physical storage sources of different architectures, different storage sources of different operating systems, different storage management mechanisms and different stored logic models.
Specifically, the text data is analyzed by adopting one of analysis methods such as word segmentation, representation learning, text similarity analysis, high-frequency word analysis, structural analysis, empirical analysis and the like. And analyzing the digital data by adopting one of analysis methods such as relevance analysis, causal analysis, regression analysis and the like. And analyzing the text data and the digital data by adopting one of analysis methods such as multi-mode data fusion analysis, semantic analysis, symbiotic similarity analysis and the like. Before mining and analyzing the data, integrating various data according to requirements. During integration, data integrity, time intervals and data content need to be checked, and finally, the integrated data are stored in a database. For the integration of multi-element heterogeneous data, a database can be mapped into files with formats such as XML, and the mapping process is divided into three steps: (1) extracting the relational schema from the database; (2) converting the flat relation mode into a directed graph type description; (3) and converting the directed graph structure into XML Schema and other format descriptions, and defining the analyzed data as agricultural primary data.
In the agricultural data matching module, a data similarity analysis unit analyzes the similarity between each piece of associated data and forms an analysis result; the data structure network construction unit constructs relevance and structurality among agricultural multi-element heterogeneous data based on each analysis link in the early stage. According to the method of root theory and the like, data are coded and classified from the actual situation of agricultural production, so that the classification of the data does not deviate from the actual application. The data coding storage unit is used for numbering and storing the data after the structure networking so as to be convenient for the application of the subsequent data, the matched data is defined as agricultural secondary data, and the data coding category is shown in the table 1-2.
TABLE 1 multivariate heterogeneous data coding Main Category Table
TABLE 2 Multi-element heterogeneous data coding subcategories Table
And the agricultural data application module applies the analyzed data to actual agricultural production and operation activities. The sharing authority opening unit is connected with each user terminal in a butt joint mode, configures the access authority of each user for inputting agricultural data, limits the authority of other parties for accessing the data, and outputs the processed agricultural data and analysis results for sharing. And the data prediction unit predicts the future agricultural production operation situation based on the existing data analysis. The data prediction unit can analyze by adopting at least one of methods such as analogy, function, qualitative prediction, quantitative prediction, time series prediction, causal relationship prediction and the like. The data early warning unit predicts based on the existing data and provides warning early warning when the predicted data obviously deviates from expectations. And the data verification unit is used for carrying out integrity and actual detection on the data, adjusting the analysis process according to the detection result and defining the matched data as agricultural three-level data.
The agricultural data visualization module visually embodies the processed data result and forms a feedback mechanism. The chart generation unit is used for visually displaying the processed and analyzed planting production data, quality management data, warehouse logistics data, operation data and marketing data in real time. The data alarm unit issues alarm information to the abnormal condition information of the agricultural production and operation key link in a mode of mobile phone short messages, system popup windows or LED information display screens. The data use feedback unit simulates the data use operation flow according to the data use feedback information, finds the problems and analyzes and solves the problems, and continuously changes the system.
The main control module, the agricultural data preprocessing module, the agricultural data mining module, the agricultural data matching module, the agricultural data application module and the agricultural data visualization module can enable agricultural growers, producers, managers and supervisors to manage and apply agricultural production multivariate heterogeneous data such as planting production data, quality management data, storage logistics data, management data, market sales data and the like, and effectively improve the phenomenon of 'information islanding' between all sections of agricultural production and operation.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. Meanwhile, for a person skilled in the art, according to the idea of the present invention, the specific embodiments and the application range may be changed. In view of the foregoing, the description is not to be taken in a limiting sense.
Claims (10)
1. A multivariate heterogeneous agricultural data management system, comprising:
the agricultural data mining system comprises a main control module, an agricultural data preprocessing module, an agricultural data mining module, an agricultural data matching module, an agricultural data application module and an agricultural data visualization module which are sequentially connected;
the agricultural data preprocessing module, the agricultural data mining module, the agricultural data matching module, the agricultural data application module and the agricultural data visualization module are all connected with the main control module;
the agricultural data preprocessing module is used for acquiring multi-element heterogeneous agricultural data, carrying out primary processing on the multi-element heterogeneous agricultural data to obtain agricultural source data, and carrying out classified storage on the agricultural source data;
the agricultural data mining module is used for carrying out relevance analysis on the agricultural source data to obtain agricultural first-level data;
the agricultural data matching module is used for carrying out structural networking processing on the agricultural primary data and coding the agricultural primary data subjected to structural networking processing to obtain agricultural secondary data;
the agricultural data application module is used for predicting the rationality of an agricultural production link based on the agricultural secondary data to obtain agricultural tertiary data; the agricultural three-level data is a rationality prediction result;
the agricultural data visualization module is used for displaying the agricultural secondary data and the agricultural tertiary data;
the main control module is used for storing the agricultural source data, the agricultural primary data, the agricultural secondary data and the agricultural tertiary data in a classified mode.
2. The multivariate heterogeneous agricultural data management system according to claim 1, wherein the agricultural data preprocessing module comprises:
the system comprises a classification data input unit, an invalid information deleting unit and a nearby storage processing unit which are connected in sequence;
the classified data input unit is used for acquiring multiple categories of multi-element heterogeneous agricultural data;
the invalid information deleting unit is used for standardizing the multi-element heterogeneous agricultural data and deleting redundant data in the standardized multi-element heterogeneous agricultural data to obtain agricultural source data;
the nearby storage processing unit is also connected with the agricultural data mining module and the main control module; the nearby storage processing unit is used for storing agricultural source data according to the type of the multi-element heterogeneous agricultural data during collection.
3. The diverse heterogeneous agricultural data management system according to claim 2, wherein the categories include plant production type data, quality management type data, warehouse logistics type data, business type data and marketing type data.
4. The multivariate heterogeneous agricultural data management system according to claim 1, wherein the agricultural data mining module comprises:
the system comprises a homogeneous data analysis unit, an abnormal metadata analysis unit and an abnormal data analysis unit;
the homogeneous data analysis unit, the heterogeneous data analysis unit and the heterogeneous data analysis unit are all connected with the agricultural data preprocessing module; the homogeneous data analysis unit, the heterogeneous data analysis unit and the heterogeneous data analysis unit are also connected with the agricultural data matching module; the heterogeneous data analysis unit and the heterogeneous data analysis unit are both connected with the main control module;
the homogeneous data analysis unit is used for performing relevance analysis on homogeneous data in the agricultural source data to obtain first agricultural primary data;
the different metadata analysis unit is used for carrying out relevance analysis on different metadata in the agricultural source data to obtain first agricultural primary data;
the heterogeneous data analysis unit is used for performing relevance analysis on heterogeneous data in the agricultural source data to obtain first agricultural primary data.
5. The multivariate heterogeneous agricultural data management system according to claim 1, wherein the association analysis comprises a text data association analysis, a numerical data association analysis, and a text numerical data association analysis;
the text data relevance analysis comprises the steps of analyzing the text data by adopting one analysis method of word segmentation, expression learning, text similarity analysis, high-frequency word analysis, structural analysis or empirical analysis;
the digital data correlation analysis comprises analyzing the digital data by one of correlation analysis, causal analysis or regression analysis;
the text-to-digital data correlation analysis comprises analysis of the text data and the digital data by one of multi-modal data fusion analysis, semantic analysis or symbiotic similarity analysis.
6. The diverse heterogeneous agricultural data management system of claim 1, wherein the agricultural data matching module comprises:
the data structure network construction unit and the data coding storage unit are connected in sequence;
the data structure network construction unit is connected with the agricultural data mining module; the data structure network construction unit is used for carrying out structural networking processing on the agricultural primary data;
the data coding and storing unit is connected with the agricultural data application module and the main control module, and is used for coding the agricultural primary data subjected to structural networking processing to obtain agricultural secondary data.
7. The multivariate heterogeneous agricultural data management system according to claim 1, wherein the agricultural data application module comprises:
the system comprises a sharing authority opening unit, a data prediction unit, a data early warning unit and a data verification unit;
the data prediction unit is respectively connected with the agricultural data matching module, the data early warning unit, the sharing authority opening unit, the data verification unit, the agricultural data visualization module and the main control module; the data prediction unit is used for predicting the rationality of an agricultural production link based on the agricultural secondary data to obtain agricultural tertiary data;
the data early warning unit is used for carrying out early warning according to the agricultural three-level data;
the data verification unit is used for carrying out integrity verification and actual verification on the agricultural three-level data;
the sharing authority opening unit is respectively connected with the data prediction unit and a plurality of user terminals; and the sharing permission opening unit is used for sending the agricultural three-level data to a corresponding user terminal when receiving a data request sent by the user terminal.
8. The diverse heterogeneous agricultural data management system of claim 3, wherein the agricultural data visualization module comprises:
the system comprises a chart generation unit, a data alarm unit and a data use feedback unit;
the chart generation unit, the data alarm unit and the data use feedback unit are all connected with the visualization module; the chart generation unit and the data alarm unit are both connected with the main control module;
the chart generation unit is used for displaying the agricultural secondary data in real time in a visualized manner;
and the data alarm unit is used for issuing alarm information in a mode of a mobile phone short message, a system popup window or an LED information display screen when the agricultural production and operation link is abnormal according to the agricultural three-level data.
The data use feedback unit refers to the use condition feedback information according to the agricultural secondary data and the agricultural tertiary data for analysis, and the multi-element heterogeneous agricultural data management system is overlapped according to the analysis result.
9. The multivariate heterogeneous agricultural data management system according to claim 1, wherein the master control module comprises:
the central processor, the communication unit and the total storage unit are connected in sequence;
the central processor is also connected with the agricultural data preprocessing module, the agricultural data mining module, the agricultural data matching module, the agricultural data application module and the agricultural data visualization module;
the central processor is used for carrying out clustering processing on the agricultural source data, the agricultural primary data, the agricultural secondary data and the agricultural tertiary data to obtain a clustering processing result;
the communication unit is used for transmitting the clustering processing result;
and the total storage unit is used for storing the agricultural source data, the agricultural primary data, the agricultural secondary data and the agricultural tertiary data according to the clustering processing result.
10. The multivariate heterogeneous agricultural data management system according to claim 9, wherein the master control module further comprises a background management unit;
the background management unit is connected with the central processor;
the background management unit is used for carrying out system management, authority management, system information management and product management on the data in the storage unit.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210921941.3A CN115269704B (en) | 2022-08-02 | 2022-08-02 | Multi-element heterogeneous agricultural data management system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210921941.3A CN115269704B (en) | 2022-08-02 | 2022-08-02 | Multi-element heterogeneous agricultural data management system |
Publications (2)
Publication Number | Publication Date |
---|---|
CN115269704A true CN115269704A (en) | 2022-11-01 |
CN115269704B CN115269704B (en) | 2023-08-18 |
Family
ID=83746140
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202210921941.3A Active CN115269704B (en) | 2022-08-02 | 2022-08-02 | Multi-element heterogeneous agricultural data management system |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN115269704B (en) |
Citations (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104732328A (en) * | 2015-02-03 | 2015-06-24 | 天津市农村工作委员会信息中心 | Agricultural Internet of Things platform system |
CN104852927A (en) * | 2015-06-01 | 2015-08-19 | 国家电网公司 | Safety comprehensive management system based on multi-source heterogeneous information |
CN107402976A (en) * | 2017-07-03 | 2017-11-28 | 国网山东省电力公司经济技术研究院 | Power grid multi-source data fusion method and system based on multi-element heterogeneous model |
WO2018214388A1 (en) * | 2017-05-23 | 2018-11-29 | 深圳大学 | Multi-platform big data system and method for aviation electronics |
CN109523446A (en) * | 2018-10-19 | 2019-03-26 | 北京北大软件工程股份有限公司 | A kind of big data processing analysis system towards price field |
CN110751508A (en) * | 2019-09-26 | 2020-02-04 | 中电万维信息技术有限责任公司 | Agricultural product market price early warning management system based on big data analysis |
CN112288317A (en) * | 2020-11-17 | 2021-01-29 | 北京三维天地科技股份有限公司 | Industrial big data analysis platform and method based on multi-source heterogeneous data governance |
CN112732670A (en) * | 2020-12-31 | 2021-04-30 | 石河子大学 | Agricultural resource integration method and system based on network big data |
CN113220911A (en) * | 2021-05-25 | 2021-08-06 | 中国农业科学院农业信息研究所 | Agricultural multi-source heterogeneous data analysis and mining method and application thereof |
CN113568928A (en) * | 2021-07-27 | 2021-10-29 | 广东电网有限责任公司 | Data management system applied to energy industry chain early warning system |
CN113778967A (en) * | 2021-09-14 | 2021-12-10 | 中国环境科学研究院 | Yangtze river basin data acquisition processing and resource sharing system |
CN114143352A (en) * | 2021-12-03 | 2022-03-04 | 江苏省农业科学院 | Wisdom pesticide monitoring device |
-
2022
- 2022-08-02 CN CN202210921941.3A patent/CN115269704B/en active Active
Patent Citations (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104732328A (en) * | 2015-02-03 | 2015-06-24 | 天津市农村工作委员会信息中心 | Agricultural Internet of Things platform system |
CN104852927A (en) * | 2015-06-01 | 2015-08-19 | 国家电网公司 | Safety comprehensive management system based on multi-source heterogeneous information |
WO2018214388A1 (en) * | 2017-05-23 | 2018-11-29 | 深圳大学 | Multi-platform big data system and method for aviation electronics |
CN107402976A (en) * | 2017-07-03 | 2017-11-28 | 国网山东省电力公司经济技术研究院 | Power grid multi-source data fusion method and system based on multi-element heterogeneous model |
CN109523446A (en) * | 2018-10-19 | 2019-03-26 | 北京北大软件工程股份有限公司 | A kind of big data processing analysis system towards price field |
CN110751508A (en) * | 2019-09-26 | 2020-02-04 | 中电万维信息技术有限责任公司 | Agricultural product market price early warning management system based on big data analysis |
CN112288317A (en) * | 2020-11-17 | 2021-01-29 | 北京三维天地科技股份有限公司 | Industrial big data analysis platform and method based on multi-source heterogeneous data governance |
CN112732670A (en) * | 2020-12-31 | 2021-04-30 | 石河子大学 | Agricultural resource integration method and system based on network big data |
CN113220911A (en) * | 2021-05-25 | 2021-08-06 | 中国农业科学院农业信息研究所 | Agricultural multi-source heterogeneous data analysis and mining method and application thereof |
CN113568928A (en) * | 2021-07-27 | 2021-10-29 | 广东电网有限责任公司 | Data management system applied to energy industry chain early warning system |
CN113778967A (en) * | 2021-09-14 | 2021-12-10 | 中国环境科学研究院 | Yangtze river basin data acquisition processing and resource sharing system |
CN114143352A (en) * | 2021-12-03 | 2022-03-04 | 江苏省农业科学院 | Wisdom pesticide monitoring device |
Non-Patent Citations (2)
Title |
---|
余万民;范蓓蕾;钱建平;: "基于云计算的农业大数据共享服务平台研发", 中国农业信息, no. 01 * |
李道亮;杨昊;: "农业物联网技术研究进展与发展趋势分析", 中国农业文摘-农业工程, no. 02 * |
Also Published As
Publication number | Publication date |
---|---|
CN115269704B (en) | 2023-08-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN111240662B (en) | Spark machine learning system and method based on task visual drag | |
US10977293B2 (en) | Technology incident management platform | |
US20220076165A1 (en) | Systems and methods for automating data science machine learning analytical workflows | |
US11823109B2 (en) | System and method for evaluating images to support multiple risk applications | |
CN107256219B (en) | Big data fusion analysis method applied to mass logs of automatic train control system | |
Chan et al. | The role of social media data in operations and production management | |
JP2023539284A (en) | Enterprise spend optimization and mapping model architecture | |
CN113656647B (en) | Intelligent operation and maintenance oriented engineering archive data management platform, method and system | |
CN116034369A (en) | Automated functional clustering of design project data with compliance verification | |
Zhang | Application of data mining technology in digital library. | |
CN113627784A (en) | Enterprise asset management intelligent decision-making system based on industrial internet | |
US20230385707A1 (en) | System for modelling a distributed computer system of an enterprise as a monolithic entity using a digital twin | |
CN116468460A (en) | Consumer finance customer image recognition system and method based on artificial intelligence | |
CN116629802A (en) | Big data platform system for railway port station | |
CN111353085A (en) | Cloud mining network public opinion analysis method based on feature model | |
US20230281541A1 (en) | Systems and methods for generating insights based on regulatory reporting and analysis | |
CN115269704B (en) | Multi-element heterogeneous agricultural data management system | |
CN113868322B (en) | Semantic structure analysis method, device and equipment, virtualization system and medium | |
CN116630052A (en) | Financial data AI analysis system and method | |
Kazemi | A survey of big data: challenges and specifications | |
Ben Sassi et al. | Data Science with Semantic Technologies: Application to Information Systems Development | |
Chen et al. | Design of Online Education Information Management System Based on Data Mining Algorithm | |
CN114266472A (en) | Subway station evacuation risk analysis method based on Spark | |
KR20230059364A (en) | Public opinion poll system using language model and method thereof | |
Luo et al. | Which is better? A modularized evaluation for topic popularity prediction |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |