CN115269704A - Multi-element heterogeneous agricultural data management system - Google Patents

Multi-element heterogeneous agricultural data management system Download PDF

Info

Publication number
CN115269704A
CN115269704A CN202210921941.3A CN202210921941A CN115269704A CN 115269704 A CN115269704 A CN 115269704A CN 202210921941 A CN202210921941 A CN 202210921941A CN 115269704 A CN115269704 A CN 115269704A
Authority
CN
China
Prior art keywords
data
agricultural
unit
analysis
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202210921941.3A
Other languages
Chinese (zh)
Other versions
CN115269704B (en
Inventor
邓明森
刘斌洁
喻曦
安冯竞
崔鹏
吴亨进
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guizhou University of Finance and Economics
Original Assignee
Guizhou University of Finance and Economics
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guizhou University of Finance and Economics filed Critical Guizhou University of Finance and Economics
Priority to CN202210921941.3A priority Critical patent/CN115269704B/en
Publication of CN115269704A publication Critical patent/CN115269704A/en
Application granted granted Critical
Publication of CN115269704B publication Critical patent/CN115269704B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases
    • G06F16/215Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2458Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
    • G06F16/2465Query processing support for facilitating data mining operations in structured databases
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/26Visual data mining; Browsing structured data
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28Databases characterised by their database models, e.g. relational or object models
    • G06F16/284Relational databases
    • G06F16/285Clustering or classification
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/02Agriculture; Fishing; Forestry; Mining
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/30Computing systems specially adapted for manufacturing

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Economics (AREA)
  • Strategic Management (AREA)
  • Marine Sciences & Fisheries (AREA)
  • Mining & Mineral Resources (AREA)
  • Agronomy & Crop Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Animal Husbandry (AREA)
  • Tourism & Hospitality (AREA)
  • General Business, Economics & Management (AREA)
  • Quality & Reliability (AREA)
  • Fuzzy Systems (AREA)
  • Mathematical Physics (AREA)
  • Probability & Statistics with Applications (AREA)
  • Software Systems (AREA)
  • Computational Linguistics (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The invention discloses a multi-element heterogeneous agricultural data management system, which relates to the technical field of agricultural data management and comprises a main control module, and an agricultural data preprocessing module, an agricultural data mining module, an agricultural data matching module, an agricultural data application module and an agricultural data visualization module which are sequentially connected; performing primary processing, relevance analysis and rationality prediction on the multi-element heterogeneous agricultural data to obtain agricultural three-level data; an agricultural data visualization module is arranged to display agricultural three-level data; the method can manage the multivariate heterogeneous agricultural data, and reduce the situation of 'information islands' in the agricultural production and operation link.

Description

Multi-element heterogeneous agricultural data management system
Technical Field
The invention relates to the technical field of agricultural data management, in particular to a multivariate heterogeneous agricultural data management system.
Background
With the continuous change of information Technology, agricultural informatization and scientific planting become foundation stones for quality and efficiency improvement of contemporary agriculture, and the application of modern information technologies such as internet of things, internet, big data, cloud computing, 5G (5 th Generation Mobile Communication Technology) and artificial intelligence in the agricultural modernization process is also receiving more attention.
However, the application of modern information technology enables the data Volume to increase by times in the agricultural production and operation process, an agricultural information data set with typical big data characteristics such as scale (Volume), high speed (Velocity), diversity (Variety) and Value (Value) is formed, and meanwhile, the multi-element heterogeneous data of cross-department, cross-equipment and cross-production links enables the information isolated island situation to occur in each link of agricultural production and operation. The construction of an information sharing mechanism and the management and application of the multi-element heterogeneous data can enable agricultural production and management to better utilize modern information technology, and agricultural industry development suggestions are refined according to production and management data according to local conditions, so that the construction of the multi-element heterogeneous agricultural data management system is particularly important.
Disclosure of Invention
The invention aims to provide a multivariate heterogeneous agricultural data management system which can manage multivariate heterogeneous agricultural data and reduce the situation of 'information isolated island' in the agricultural production and operation link.
In order to achieve the purpose, the invention provides the following scheme:
a multivariate heterogeneous agricultural data management system, comprising:
the agricultural data mining system comprises a main control module, an agricultural data preprocessing module, an agricultural data mining module, an agricultural data matching module, an agricultural data application module and an agricultural data visualization module which are sequentially connected;
the agricultural data preprocessing module, the agricultural data mining module, the agricultural data matching module, the agricultural data application module and the agricultural data visualization module are all connected with the main control module;
the agricultural data preprocessing module is used for acquiring multi-element heterogeneous agricultural data, carrying out primary processing on the multi-element heterogeneous agricultural data to obtain agricultural source data, and carrying out classified storage on the agricultural source data;
the agricultural data mining module is used for carrying out relevance analysis on the agricultural source data to obtain agricultural primary data;
the agricultural data matching module is used for carrying out structural networking processing on the agricultural primary data and coding the agricultural primary data subjected to structural networking processing to obtain agricultural secondary data;
the agricultural data application module is used for predicting the rationality of an agricultural production link based on the agricultural secondary data to obtain agricultural tertiary data; the agricultural three-level data is a rationality prediction result;
the agricultural data visualization module is used for displaying the agricultural secondary data and the agricultural tertiary data;
the main control module is used for storing the agricultural source data, the agricultural primary data, the agricultural secondary data and the agricultural tertiary data in a classified mode.
Optionally, the agricultural data preprocessing module includes:
the system comprises a classification data input unit, an invalid information deleting unit and a nearby storage processing unit which are connected in sequence;
the classified data input unit is used for acquiring multiple categories of multi-element heterogeneous agricultural data;
the invalid information deleting unit is used for standardizing the multi-element heterogeneous agricultural data and deleting redundant data in the standardized multi-element heterogeneous agricultural data to obtain agricultural source data;
the nearby storage processing unit is also connected with the agricultural data mining module and the main control module; the nearby storage processing unit is used for storing agricultural source data according to the type of the multi-element heterogeneous agricultural data during collection.
Optionally, the categories include planting production type data, quality management type data, warehouse logistics type data, business type data and marketing type data.
Optionally, the agricultural data mining module includes:
the system comprises a homogeneous data analysis unit, an abnormal metadata analysis unit and an abnormal data analysis unit;
the homogeneous data analysis unit, the heterogeneous data analysis unit and the heterogeneous data analysis unit are all connected with the agricultural data preprocessing module; the homogeneous data analysis unit, the heterogeneous data analysis unit and the heterogeneous data analysis unit are also connected with the agricultural data matching module; the heterogeneous data analysis unit and the heterogeneous data analysis unit are both connected with the main control module;
the homogeneous data analysis unit is used for carrying out relevance analysis on homogeneous data in the agricultural source data to obtain first agricultural primary data;
the different metadata analysis unit is used for carrying out relevance analysis on different metadata in the agricultural source data to obtain first agricultural primary data;
the heterogeneous data analysis unit is used for performing relevance analysis on heterogeneous data in the agricultural source data to obtain first agricultural primary data.
Optionally, the relevance analysis includes text data relevance analysis, numerical data relevance analysis and text numerical data relevance analysis;
the text data relevance analysis comprises the steps of analyzing the text data by adopting one of word segmentation, representation learning, text similarity analysis, high-frequency word analysis, structural analysis or empirical analysis;
the digital data correlation analysis comprises analyzing the digital data by one of correlation analysis, causal analysis or regression analysis;
the text-to-digital data correlation analysis comprises analysis of the text data and the digital data by one of multi-modal data fusion analysis, semantic analysis or symbiotic similarity analysis.
Optionally, the agricultural data matching module includes:
the data structure network construction unit and the data coding storage unit are connected in sequence;
the data structure network construction unit is connected with the agricultural data mining module; the data structure network construction unit is used for carrying out structural networking processing on the agricultural primary data;
the data coding and storing unit is connected with the agricultural data application module and the main control module, and is used for coding the agricultural primary data subjected to structural networking processing to obtain agricultural secondary data.
Optionally, the agricultural data application module includes:
the system comprises a sharing authority opening unit, a data prediction unit, a data early warning unit and a data verification unit;
the data prediction unit is respectively connected with the agricultural data matching module, the data early warning unit, the sharing authority opening unit, the data verification unit, the agricultural data visualization module and the main control module; the data prediction unit is used for predicting the rationality of an agricultural production link based on the agricultural secondary data to obtain agricultural tertiary data;
the data early warning unit is used for carrying out early warning according to the agricultural three-level data;
the data verification unit is used for carrying out integrity verification and actual verification on the agricultural three-level data;
the sharing authority opening unit is respectively connected with the data prediction unit and a plurality of user terminals; and the sharing permission opening unit is used for sending the agricultural three-level data to a corresponding user terminal when receiving a data request sent by the user terminal.
Optionally, the agricultural data visualization module includes:
the system comprises a chart generation unit, a data alarm unit and a data use feedback unit;
the chart generation unit, the data alarm unit and the data use feedback unit are all connected with the visualization module; the chart generation unit and the data alarm unit are both connected with the main control module;
the chart generation unit is used for displaying the agricultural secondary data in real time in a visualized manner;
and the data alarm unit is used for issuing alarm information in a mode of a mobile phone short message, a system popup window or an LED information display screen when the agricultural production and operation link is abnormal according to the agricultural three-level data.
The data use feedback unit refers to the use condition feedback information according to the agricultural secondary data and the agricultural tertiary data for analysis, and the multi-element heterogeneous agricultural data management system is overlapped according to the analysis result.
Optionally, the main control module includes:
the central processor, the communication unit and the total storage unit are connected in sequence;
the central processor is also connected with the agricultural data preprocessing module, the agricultural data mining module, the agricultural data matching module, the agricultural data application module and the agricultural data visualization module;
the central processor is used for carrying out clustering processing on the agricultural source data, the agricultural primary data, the agricultural secondary data and the agricultural tertiary data to obtain a clustering processing result;
the communication unit is used for transmitting the clustering processing result;
and the total storage unit is used for storing the agricultural source data, the agricultural primary data, the agricultural secondary data and the agricultural tertiary data according to the clustering processing result.
Optionally, the main control module further includes a background management unit;
the background management unit is connected with the central processor;
the background management unit is used for carrying out system management, authority management, system information management and product management on the data in the storage unit.
According to the specific embodiment provided by the invention, the invention discloses the following technical effects:
the invention discloses a multi-element heterogeneous agricultural data management system which comprises a main control module, and an agricultural data preprocessing module, an agricultural data mining module, an agricultural data matching module, an agricultural data application module and an agricultural data visualization module which are sequentially connected; the agricultural data preprocessing module is used for acquiring multi-element heterogeneous agricultural data, performing primary processing on the multi-element heterogeneous agricultural data to obtain agricultural source data, and performing classified storage on the agricultural source data; the agricultural data mining module is used for carrying out relevance analysis on agricultural source data to obtain agricultural first-level data; the agricultural data matching module is used for carrying out structural networking processing on the agricultural primary data and coding the agricultural primary data subjected to structural networking processing to obtain agricultural secondary data; the agricultural data application module is used for predicting the rationality of an agricultural production link based on agricultural secondary data to obtain agricultural tertiary data; the agricultural three-level data is a rationality prediction result; the agricultural data visualization module is used for displaying agricultural secondary data and agricultural tertiary data; the main control module is used for storing agricultural source data, agricultural first-level data, agricultural second-level data and agricultural third-level data in a classified manner; the method can manage the multivariate heterogeneous agricultural data, and reduce the situation of 'information islands' in the agricultural production and operation link.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings without inventive exercise.
FIG. 1 is a schematic diagram illustrating a partial classification of multivariate heterogeneous agricultural data according to example 1 of the present invention;
fig. 2 is a schematic structural diagram of a multivariate heterogeneous agricultural data management system in embodiment 1 of the present invention.
Reference numerals are as follows: 01-a main control module; 02-agricultural data preprocessing module; 03-an agricultural data mining module; 04-agricultural data matching module; 05-agricultural data application module; 06-agricultural data visualization module.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The invention aims to provide a multivariate heterogeneous agricultural data management system which can manage multivariate heterogeneous agricultural data and reduce the situation of 'information isolated island' in the agricultural production and operation link.
In order to make the aforementioned objects, features and advantages of the present invention more comprehensible, the present invention is described in detail with reference to the accompanying drawings and the detailed description thereof.
Example 1
In the multi-element heterogeneous agricultural data, the main dimension of the multi-element data representing the agricultural production and operation link has the diversity; the heterogeneity means that the physical storage source of the data is different architectures (including a PC, a workstation, a large-small computer, or the like), the data storage is from different operating systems (such as Window, unix, or Linux), the data storage management mechanisms (a relational database, file-type two-dimensional data) are different, and the logical model of the data storage is heterogeneous (which means that there is a logical difference between independent production and management rings). Referring to fig. 1, the multi-element heterogeneous agricultural data categories are primarily divided into planting production type data, quality management type data, warehouse logistics type data, business type data and marketing type data. The planting production data comprises planting picking data, environment monitoring data, agricultural material use condition data, planting personnel number and the like; the quality management data comprises microelement content data, quality standard data, pesticide residue detection data and quality personnel operation data; the warehouse logistics data comprises warehouse-out and warehouse-in data, warehouse environment monitoring data, logistics turnover data and warehouse logistics personnel operation data; the operation data comprises policy data, financial data, personnel data, operation data of management personnel and the like; marketing data includes marketing data, sales data, marketing preference data, and sales personnel operational data.
As shown in fig. 2, the present embodiment provides a multiple heterogeneous agricultural data management system, including: the system comprises a main control module 01, an agricultural data preprocessing module 02, an agricultural data mining module 03, an agricultural data matching module 04, an agricultural data application module 05 and an agricultural data visualization module 06 which are connected in sequence; the agricultural data preprocessing module, the agricultural data mining module, the agricultural data matching module, the agricultural data application module and the agricultural data visualization module are all connected with the main control module. The agricultural data preprocessing module is used for acquiring multi-element heterogeneous agricultural data, performing primary processing on the multi-element heterogeneous agricultural data to obtain agricultural source data, and performing classified storage on the agricultural source data; the agricultural data mining module is used for carrying out relevance analysis on agricultural source data to obtain agricultural first-level data; the agricultural data matching module is used for carrying out structural networking processing on the agricultural primary data and coding the agricultural primary data subjected to structural networking processing to obtain agricultural secondary data; the agricultural data application module is used for predicting the rationality of an agricultural production link based on agricultural secondary data to obtain agricultural tertiary data; the agricultural three-level data is a rationality prediction result; the agricultural data visualization module is used for displaying agricultural second-level data and agricultural third-level data; the main control module is used for storing agricultural source data, agricultural first-level data, agricultural second-level data and agricultural third-level data in a classified mode.
Wherein, agricultural data preprocessing module includes: the system comprises a classification data input unit, an invalid information deleting unit and a nearby storage processing unit which are connected in sequence; the classified data input unit is used for acquiring multiple types of multi-element heterogeneous agricultural data; the invalid information deleting unit is used for standardizing the multi-element heterogeneous agricultural data and deleting redundant data in the standardized multi-element heterogeneous agricultural data to obtain agricultural source data; the nearby storage processing unit is also connected with the agricultural data mining module and the main control module; and the nearby storage processing unit is used for storing the agricultural source data according to the category of the multi-element heterogeneous agricultural data during acquisition. The categories comprise planting production data, quality management data, warehouse logistics data, business data and marketing data.
Specifically, the agricultural data mining module comprises: the system comprises a homogeneous data analysis unit, an abnormal metadata analysis unit and an abnormal data analysis unit; the homogeneous data analysis unit, the heterogeneous data analysis unit and the heterogeneous data analysis unit are all connected with the agricultural data preprocessing module; the homogeneous data analysis unit, the heterogeneous data analysis unit and the heterogeneous data analysis unit are all connected with the agricultural data matching module; the heterogeneous data analysis unit and the heterogeneous data analysis unit are also connected with the main control module; the homogeneous data analysis unit is used for carrying out relevance analysis on homogeneous data in the agricultural source data to obtain first agricultural primary data; the different metadata analysis unit is used for carrying out relevance analysis on different metadata in the agricultural source data to obtain first agricultural primary data; the heterogeneous data analysis unit is used for performing relevance analysis on heterogeneous data in the agricultural source data to obtain first agricultural first-level data. The relevance analysis comprises text data relevance analysis, digital data relevance analysis and text digital data relevance analysis; the text data relevance analysis comprises the steps of analyzing the text data by adopting one of word segmentation, representation learning, text similarity analysis, high-frequency word analysis, structural analysis or empirical analysis; the digital data correlation analysis comprises analyzing the digital data by one of correlation analysis, causal analysis or regression analysis; the text-to-digital data correlation analysis comprises analyzing the text data and the digital data by one of multi-mode data fusion analysis, semantic analysis or symbiotic similarity analysis.
Further, the agricultural data matching module includes: the data structure network construction unit and the data coding storage unit are connected in sequence; the data structure network construction unit is connected with the agricultural data mining module; the data structure network construction unit is used for carrying out structural networking processing on the agricultural primary data; the data coding and storing unit is connected with the agricultural data application module and the main control module and used for coding the agricultural primary data subjected to structural networking processing to obtain agricultural secondary data.
In addition, the agricultural data application module includes: the system comprises a sharing authority opening unit, a data prediction unit, a data early warning unit and a data verification unit; the data prediction unit is respectively connected with the agricultural data matching module, the data early warning unit, the sharing authority opening unit, the data verification unit, the agricultural data visualization module and the main control module; the data prediction unit is used for predicting the rationality of an agricultural production link based on agricultural secondary data to obtain agricultural tertiary data; the data early warning unit is used for carrying out early warning according to the agricultural three-level data; the data verification unit is used for carrying out integrity verification and actual verification on the agricultural three-level data; the sharing authority opening unit is respectively connected with the data prediction unit and the plurality of user terminals; and the sharing permission opening unit is used for sending the agricultural three-level data to the corresponding user terminal when receiving a data request sent by the user terminal.
In the multiple heterogeneous agricultural data management system provided by this embodiment, the agricultural data visualization module includes: the system comprises a chart generation unit, a data alarm unit and a data use feedback unit; the chart generation unit, the data alarm unit and the data use feedback unit are all connected with the visualization module; the chart generation unit, the data alarm unit and the data use feedback unit are all connected with the main control module; the chart generation unit is used for displaying the agricultural secondary data in real time in a visual manner;
and the data alarm unit is used for issuing alarm information in a mode of a mobile phone short message, a system popup window or an LED information display screen when the agricultural production and operation link is abnormal according to the agricultural three-level data.
The data use feedback unit refers to the use condition feedback information according to the agricultural second-level data and the agricultural third-level data for analysis, and the multi-element heterogeneous agricultural data management system is changed according to the analysis result.
Specifically, the main control module includes: the system comprises a central processor, a communication unit, a background management unit and a total storage unit which are connected in sequence; the central processor is also connected with an agricultural data preprocessing module, an agricultural data mining module, an agricultural data matching module, an agricultural data application module and an agricultural data visualization module; the central processor is used for clustering the agricultural source data, the agricultural first-level data, the agricultural second-level data and the agricultural third-level data to obtain a clustering result; the communication unit is used for transmitting the clustering processing result; and the total storage unit is used for storing the agricultural source data, the agricultural first-level data, the agricultural second-level data and the agricultural third-level data according to the clustering processing result. The background management unit is connected with the central processor; the background management unit is used for performing system management, authority management, system information management and product management on the data in the storage unit. A central processor in the main control module classifies, clusters and analyzes the input data of each module; the main Control module includes at least one logic calculating device of MCU (Micro-programmed Control Unit), CPU (Central Processing Unit), DSP (Digital Signal Processor), single chip microcomputer and embedded equipment. The communication unit comprises at least one of a Lora communication unit, an NB-IoT communication unit and a ZigBee communication unit. The Lora communication unit has the advantages of high sensitivity, strong anti-interference performance, long transmission distance, low power consumption and the like; the NB-IoT communication unit is also called a narrow-band Internet of things based on a cellular network, needs small bandwidth, but has high connection efficiency and low power consumption; zigBee is also called Zifeng, is a popular wireless network protocol for short-distance transmission, has the advantages of low power consumption, low cost, support of a large number of network nodes, support of various network topologies, low complexity and high safety, and can communicate with a cloud server by arranging a gateway.
The total storage unit module comprises a central storage and a cloud server storage, the mass agricultural information can be managed and stored at a cloud server storage server side, and the storage forms comprise a relational database, a non-relational database, an object storage and a file storage. The background management module comprises system management, authority management, system information management, product management, issuing, updating, deleting and other operations of characters, pictures, videos and other daily use data, and statistics and management of data such as order information and visitor information, so that foreground content can be updated and adjusted in time.
Example 2
The embodiment provides a heterogeneous agricultural data management system of many units includes: the agricultural data mining system comprises a main control module, an agricultural data preprocessing module, an agricultural data mining module, an agricultural data matching module, an agricultural data application module and an agricultural data visualization module.
The main control module comprises a central processor, a communication unit, a total storage unit and a background management module, wherein the central processor in the main control module classifies, clusters and analyzes the input data of each module; the main Control module includes at least one logic calculating device of MCU (Micro-programmed Control Unit), CPU (Central Processing Unit), DSP (Digital Signal Processor), single chip microcomputer and embedded equipment. The communication module comprises at least one of a Lora communication module, an NB-IoT communication module and a ZigBee communication module. The Lora communication module has the advantages of high sensitivity, strong anti-interference performance, long transmission distance, low power consumption and the like; the NB-IoT is also called a narrow-band Internet of things based on a cellular network, and has the advantages of small required bandwidth, high connection efficiency and low power consumption; zigBee is also called Zifeng, is a popular wireless network protocol for short-distance transmission, has the advantages of low power consumption, low cost, support of a large number of network nodes, support of various network topologies, low complexity and high safety, and can communicate with a cloud server by arranging a gateway.
In addition, the total storage unit comprises a central storage and a cloud server storage, the mass agricultural information can be managed and stored at the cloud server storage server side, and the storage forms comprise a relational database, a non-relational database, an object storage and a file storage. The background management module comprises system management, authority management, system information management and product management, and comprises operations of issuing, updating, deleting and the like of characters, pictures, videos and other daily use data, and statistics and management of data such as order information, visitor information and the like, so that foreground content can be updated and adjusted in time.
In the data preprocessing module, a classified data input unit receives original data output by a data source and carries out data proximity processing according to different data sources. The invalid information deleting unit and the nearby storage processing unit preset standard formats, the data are cleaned and subjected to standardization conversion, redundant and miscellaneous data and missing part data are deleted, the original data are enabled to meet the actual requirement preset, the standard formats comprise structured, unstructured and semi-structured, and the processed data are defined as agricultural source data.
In the agricultural data mining module, the homogeneous data analysis unit performs data mining and relevance analysis among homogeneous data. The heterogeneous metadata analysis unit performs data mining and relevance analysis between different generation bodies and heterogeneous data. The heterogeneous data analysis unit performs data mining and relevance analysis on data with different physical storage sources of different architectures, different storage sources of different operating systems, different storage management mechanisms and different stored logic models.
Specifically, the text data is analyzed by adopting one of analysis methods such as word segmentation, representation learning, text similarity analysis, high-frequency word analysis, structural analysis, empirical analysis and the like. And analyzing the digital data by adopting one of analysis methods such as relevance analysis, causal analysis, regression analysis and the like. And analyzing the text data and the digital data by adopting one of analysis methods such as multi-mode data fusion analysis, semantic analysis, symbiotic similarity analysis and the like. Before mining and analyzing the data, integrating various data according to requirements. During integration, data integrity, time intervals and data content need to be checked, and finally, the integrated data are stored in a database. For the integration of multi-element heterogeneous data, a database can be mapped into files with formats such as XML, and the mapping process is divided into three steps: (1) extracting the relational schema from the database; (2) converting the flat relation mode into a directed graph type description; (3) and converting the directed graph structure into XML Schema and other format descriptions, and defining the analyzed data as agricultural primary data.
In the agricultural data matching module, a data similarity analysis unit analyzes the similarity between each piece of associated data and forms an analysis result; the data structure network construction unit constructs relevance and structurality among agricultural multi-element heterogeneous data based on each analysis link in the early stage. According to the method of root theory and the like, data are coded and classified from the actual situation of agricultural production, so that the classification of the data does not deviate from the actual application. The data coding storage unit is used for numbering and storing the data after the structure networking so as to be convenient for the application of the subsequent data, the matched data is defined as agricultural secondary data, and the data coding category is shown in the table 1-2.
TABLE 1 multivariate heterogeneous data coding Main Category Table
Figure BDA0003777924640000111
TABLE 2 Multi-element heterogeneous data coding subcategories Table
Figure BDA0003777924640000112
And the agricultural data application module applies the analyzed data to actual agricultural production and operation activities. The sharing authority opening unit is connected with each user terminal in a butt joint mode, configures the access authority of each user for inputting agricultural data, limits the authority of other parties for accessing the data, and outputs the processed agricultural data and analysis results for sharing. And the data prediction unit predicts the future agricultural production operation situation based on the existing data analysis. The data prediction unit can analyze by adopting at least one of methods such as analogy, function, qualitative prediction, quantitative prediction, time series prediction, causal relationship prediction and the like. The data early warning unit predicts based on the existing data and provides warning early warning when the predicted data obviously deviates from expectations. And the data verification unit is used for carrying out integrity and actual detection on the data, adjusting the analysis process according to the detection result and defining the matched data as agricultural three-level data.
The agricultural data visualization module visually embodies the processed data result and forms a feedback mechanism. The chart generation unit is used for visually displaying the processed and analyzed planting production data, quality management data, warehouse logistics data, operation data and marketing data in real time. The data alarm unit issues alarm information to the abnormal condition information of the agricultural production and operation key link in a mode of mobile phone short messages, system popup windows or LED information display screens. The data use feedback unit simulates the data use operation flow according to the data use feedback information, finds the problems and analyzes and solves the problems, and continuously changes the system.
The main control module, the agricultural data preprocessing module, the agricultural data mining module, the agricultural data matching module, the agricultural data application module and the agricultural data visualization module can enable agricultural growers, producers, managers and supervisors to manage and apply agricultural production multivariate heterogeneous data such as planting production data, quality management data, storage logistics data, management data, market sales data and the like, and effectively improve the phenomenon of 'information islanding' between all sections of agricultural production and operation.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. Meanwhile, for a person skilled in the art, according to the idea of the present invention, the specific embodiments and the application range may be changed. In view of the foregoing, the description is not to be taken in a limiting sense.

Claims (10)

1. A multivariate heterogeneous agricultural data management system, comprising:
the agricultural data mining system comprises a main control module, an agricultural data preprocessing module, an agricultural data mining module, an agricultural data matching module, an agricultural data application module and an agricultural data visualization module which are sequentially connected;
the agricultural data preprocessing module, the agricultural data mining module, the agricultural data matching module, the agricultural data application module and the agricultural data visualization module are all connected with the main control module;
the agricultural data preprocessing module is used for acquiring multi-element heterogeneous agricultural data, carrying out primary processing on the multi-element heterogeneous agricultural data to obtain agricultural source data, and carrying out classified storage on the agricultural source data;
the agricultural data mining module is used for carrying out relevance analysis on the agricultural source data to obtain agricultural first-level data;
the agricultural data matching module is used for carrying out structural networking processing on the agricultural primary data and coding the agricultural primary data subjected to structural networking processing to obtain agricultural secondary data;
the agricultural data application module is used for predicting the rationality of an agricultural production link based on the agricultural secondary data to obtain agricultural tertiary data; the agricultural three-level data is a rationality prediction result;
the agricultural data visualization module is used for displaying the agricultural secondary data and the agricultural tertiary data;
the main control module is used for storing the agricultural source data, the agricultural primary data, the agricultural secondary data and the agricultural tertiary data in a classified mode.
2. The multivariate heterogeneous agricultural data management system according to claim 1, wherein the agricultural data preprocessing module comprises:
the system comprises a classification data input unit, an invalid information deleting unit and a nearby storage processing unit which are connected in sequence;
the classified data input unit is used for acquiring multiple categories of multi-element heterogeneous agricultural data;
the invalid information deleting unit is used for standardizing the multi-element heterogeneous agricultural data and deleting redundant data in the standardized multi-element heterogeneous agricultural data to obtain agricultural source data;
the nearby storage processing unit is also connected with the agricultural data mining module and the main control module; the nearby storage processing unit is used for storing agricultural source data according to the type of the multi-element heterogeneous agricultural data during collection.
3. The diverse heterogeneous agricultural data management system according to claim 2, wherein the categories include plant production type data, quality management type data, warehouse logistics type data, business type data and marketing type data.
4. The multivariate heterogeneous agricultural data management system according to claim 1, wherein the agricultural data mining module comprises:
the system comprises a homogeneous data analysis unit, an abnormal metadata analysis unit and an abnormal data analysis unit;
the homogeneous data analysis unit, the heterogeneous data analysis unit and the heterogeneous data analysis unit are all connected with the agricultural data preprocessing module; the homogeneous data analysis unit, the heterogeneous data analysis unit and the heterogeneous data analysis unit are also connected with the agricultural data matching module; the heterogeneous data analysis unit and the heterogeneous data analysis unit are both connected with the main control module;
the homogeneous data analysis unit is used for performing relevance analysis on homogeneous data in the agricultural source data to obtain first agricultural primary data;
the different metadata analysis unit is used for carrying out relevance analysis on different metadata in the agricultural source data to obtain first agricultural primary data;
the heterogeneous data analysis unit is used for performing relevance analysis on heterogeneous data in the agricultural source data to obtain first agricultural primary data.
5. The multivariate heterogeneous agricultural data management system according to claim 1, wherein the association analysis comprises a text data association analysis, a numerical data association analysis, and a text numerical data association analysis;
the text data relevance analysis comprises the steps of analyzing the text data by adopting one analysis method of word segmentation, expression learning, text similarity analysis, high-frequency word analysis, structural analysis or empirical analysis;
the digital data correlation analysis comprises analyzing the digital data by one of correlation analysis, causal analysis or regression analysis;
the text-to-digital data correlation analysis comprises analysis of the text data and the digital data by one of multi-modal data fusion analysis, semantic analysis or symbiotic similarity analysis.
6. The diverse heterogeneous agricultural data management system of claim 1, wherein the agricultural data matching module comprises:
the data structure network construction unit and the data coding storage unit are connected in sequence;
the data structure network construction unit is connected with the agricultural data mining module; the data structure network construction unit is used for carrying out structural networking processing on the agricultural primary data;
the data coding and storing unit is connected with the agricultural data application module and the main control module, and is used for coding the agricultural primary data subjected to structural networking processing to obtain agricultural secondary data.
7. The multivariate heterogeneous agricultural data management system according to claim 1, wherein the agricultural data application module comprises:
the system comprises a sharing authority opening unit, a data prediction unit, a data early warning unit and a data verification unit;
the data prediction unit is respectively connected with the agricultural data matching module, the data early warning unit, the sharing authority opening unit, the data verification unit, the agricultural data visualization module and the main control module; the data prediction unit is used for predicting the rationality of an agricultural production link based on the agricultural secondary data to obtain agricultural tertiary data;
the data early warning unit is used for carrying out early warning according to the agricultural three-level data;
the data verification unit is used for carrying out integrity verification and actual verification on the agricultural three-level data;
the sharing authority opening unit is respectively connected with the data prediction unit and a plurality of user terminals; and the sharing permission opening unit is used for sending the agricultural three-level data to a corresponding user terminal when receiving a data request sent by the user terminal.
8. The diverse heterogeneous agricultural data management system of claim 3, wherein the agricultural data visualization module comprises:
the system comprises a chart generation unit, a data alarm unit and a data use feedback unit;
the chart generation unit, the data alarm unit and the data use feedback unit are all connected with the visualization module; the chart generation unit and the data alarm unit are both connected with the main control module;
the chart generation unit is used for displaying the agricultural secondary data in real time in a visualized manner;
and the data alarm unit is used for issuing alarm information in a mode of a mobile phone short message, a system popup window or an LED information display screen when the agricultural production and operation link is abnormal according to the agricultural three-level data.
The data use feedback unit refers to the use condition feedback information according to the agricultural secondary data and the agricultural tertiary data for analysis, and the multi-element heterogeneous agricultural data management system is overlapped according to the analysis result.
9. The multivariate heterogeneous agricultural data management system according to claim 1, wherein the master control module comprises:
the central processor, the communication unit and the total storage unit are connected in sequence;
the central processor is also connected with the agricultural data preprocessing module, the agricultural data mining module, the agricultural data matching module, the agricultural data application module and the agricultural data visualization module;
the central processor is used for carrying out clustering processing on the agricultural source data, the agricultural primary data, the agricultural secondary data and the agricultural tertiary data to obtain a clustering processing result;
the communication unit is used for transmitting the clustering processing result;
and the total storage unit is used for storing the agricultural source data, the agricultural primary data, the agricultural secondary data and the agricultural tertiary data according to the clustering processing result.
10. The multivariate heterogeneous agricultural data management system according to claim 9, wherein the master control module further comprises a background management unit;
the background management unit is connected with the central processor;
the background management unit is used for carrying out system management, authority management, system information management and product management on the data in the storage unit.
CN202210921941.3A 2022-08-02 2022-08-02 Multi-element heterogeneous agricultural data management system Active CN115269704B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210921941.3A CN115269704B (en) 2022-08-02 2022-08-02 Multi-element heterogeneous agricultural data management system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210921941.3A CN115269704B (en) 2022-08-02 2022-08-02 Multi-element heterogeneous agricultural data management system

Publications (2)

Publication Number Publication Date
CN115269704A true CN115269704A (en) 2022-11-01
CN115269704B CN115269704B (en) 2023-08-18

Family

ID=83746140

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210921941.3A Active CN115269704B (en) 2022-08-02 2022-08-02 Multi-element heterogeneous agricultural data management system

Country Status (1)

Country Link
CN (1) CN115269704B (en)

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104732328A (en) * 2015-02-03 2015-06-24 天津市农村工作委员会信息中心 Agricultural Internet of Things platform system
CN104852927A (en) * 2015-06-01 2015-08-19 国家电网公司 Safety comprehensive management system based on multi-source heterogeneous information
CN107402976A (en) * 2017-07-03 2017-11-28 国网山东省电力公司经济技术研究院 Power grid multi-source data fusion method and system based on multi-element heterogeneous model
WO2018214388A1 (en) * 2017-05-23 2018-11-29 深圳大学 Multi-platform big data system and method for aviation electronics
CN109523446A (en) * 2018-10-19 2019-03-26 北京北大软件工程股份有限公司 A kind of big data processing analysis system towards price field
CN110751508A (en) * 2019-09-26 2020-02-04 中电万维信息技术有限责任公司 Agricultural product market price early warning management system based on big data analysis
CN112288317A (en) * 2020-11-17 2021-01-29 北京三维天地科技股份有限公司 Industrial big data analysis platform and method based on multi-source heterogeneous data governance
CN112732670A (en) * 2020-12-31 2021-04-30 石河子大学 Agricultural resource integration method and system based on network big data
CN113220911A (en) * 2021-05-25 2021-08-06 中国农业科学院农业信息研究所 Agricultural multi-source heterogeneous data analysis and mining method and application thereof
CN113568928A (en) * 2021-07-27 2021-10-29 广东电网有限责任公司 Data management system applied to energy industry chain early warning system
CN113778967A (en) * 2021-09-14 2021-12-10 中国环境科学研究院 Yangtze river basin data acquisition processing and resource sharing system
CN114143352A (en) * 2021-12-03 2022-03-04 江苏省农业科学院 Wisdom pesticide monitoring device

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104732328A (en) * 2015-02-03 2015-06-24 天津市农村工作委员会信息中心 Agricultural Internet of Things platform system
CN104852927A (en) * 2015-06-01 2015-08-19 国家电网公司 Safety comprehensive management system based on multi-source heterogeneous information
WO2018214388A1 (en) * 2017-05-23 2018-11-29 深圳大学 Multi-platform big data system and method for aviation electronics
CN107402976A (en) * 2017-07-03 2017-11-28 国网山东省电力公司经济技术研究院 Power grid multi-source data fusion method and system based on multi-element heterogeneous model
CN109523446A (en) * 2018-10-19 2019-03-26 北京北大软件工程股份有限公司 A kind of big data processing analysis system towards price field
CN110751508A (en) * 2019-09-26 2020-02-04 中电万维信息技术有限责任公司 Agricultural product market price early warning management system based on big data analysis
CN112288317A (en) * 2020-11-17 2021-01-29 北京三维天地科技股份有限公司 Industrial big data analysis platform and method based on multi-source heterogeneous data governance
CN112732670A (en) * 2020-12-31 2021-04-30 石河子大学 Agricultural resource integration method and system based on network big data
CN113220911A (en) * 2021-05-25 2021-08-06 中国农业科学院农业信息研究所 Agricultural multi-source heterogeneous data analysis and mining method and application thereof
CN113568928A (en) * 2021-07-27 2021-10-29 广东电网有限责任公司 Data management system applied to energy industry chain early warning system
CN113778967A (en) * 2021-09-14 2021-12-10 中国环境科学研究院 Yangtze river basin data acquisition processing and resource sharing system
CN114143352A (en) * 2021-12-03 2022-03-04 江苏省农业科学院 Wisdom pesticide monitoring device

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
余万民;范蓓蕾;钱建平;: "基于云计算的农业大数据共享服务平台研发", 中国农业信息, no. 01 *
李道亮;杨昊;: "农业物联网技术研究进展与发展趋势分析", 中国农业文摘-农业工程, no. 02 *

Also Published As

Publication number Publication date
CN115269704B (en) 2023-08-18

Similar Documents

Publication Publication Date Title
CN111240662B (en) Spark machine learning system and method based on task visual drag
US10977293B2 (en) Technology incident management platform
US20220076165A1 (en) Systems and methods for automating data science machine learning analytical workflows
US11823109B2 (en) System and method for evaluating images to support multiple risk applications
CN107256219B (en) Big data fusion analysis method applied to mass logs of automatic train control system
Chan et al. The role of social media data in operations and production management
JP2023539284A (en) Enterprise spend optimization and mapping model architecture
CN113656647B (en) Intelligent operation and maintenance oriented engineering archive data management platform, method and system
CN116034369A (en) Automated functional clustering of design project data with compliance verification
Zhang Application of data mining technology in digital library.
CN113627784A (en) Enterprise asset management intelligent decision-making system based on industrial internet
US20230385707A1 (en) System for modelling a distributed computer system of an enterprise as a monolithic entity using a digital twin
CN116468460A (en) Consumer finance customer image recognition system and method based on artificial intelligence
CN116629802A (en) Big data platform system for railway port station
CN111353085A (en) Cloud mining network public opinion analysis method based on feature model
US20230281541A1 (en) Systems and methods for generating insights based on regulatory reporting and analysis
CN115269704B (en) Multi-element heterogeneous agricultural data management system
CN113868322B (en) Semantic structure analysis method, device and equipment, virtualization system and medium
CN116630052A (en) Financial data AI analysis system and method
Kazemi A survey of big data: challenges and specifications
Ben Sassi et al. Data Science with Semantic Technologies: Application to Information Systems Development
Chen et al. Design of Online Education Information Management System Based on Data Mining Algorithm
CN114266472A (en) Subway station evacuation risk analysis method based on Spark
KR20230059364A (en) Public opinion poll system using language model and method thereof
Luo et al. Which is better? A modularized evaluation for topic popularity prediction

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant