CN113486125A - Industrial internet big data information processing terminal - Google Patents
Industrial internet big data information processing terminal Download PDFInfo
- Publication number
- CN113486125A CN113486125A CN202110723813.3A CN202110723813A CN113486125A CN 113486125 A CN113486125 A CN 113486125A CN 202110723813 A CN202110723813 A CN 202110723813A CN 113486125 A CN113486125 A CN 113486125A
- Authority
- CN
- China
- Prior art keywords
- data
- information
- data information
- module
- integration
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
- G06F16/285—Clustering or classification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2477—Temporal data queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/044—Recurrent networks, e.g. Hopfield networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Computing Systems (AREA)
- Software Systems (AREA)
- Mathematical Physics (AREA)
- Computational Linguistics (AREA)
- Biomedical Technology (AREA)
- Molecular Biology (AREA)
- General Health & Medical Sciences (AREA)
- Evolutionary Computation (AREA)
- Biophysics (AREA)
- Artificial Intelligence (AREA)
- Life Sciences & Earth Sciences (AREA)
- Health & Medical Sciences (AREA)
- Fuzzy Systems (AREA)
- Probability & Statistics with Applications (AREA)
- Quality & Reliability (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses an industrial internet big data information processing terminal, comprising: the system comprises a data acquisition module, a data storage module, a data integration module and an intelligent analysis module; the data acquisition modules are distributed on different industrial equipment and used for acquiring different equipment data in real time; the data storage module stores the acquired data information on different equipment nodes; the data integration module is used for cleaning data of the data information scattered on the equipment nodes and converting and integrating the data information into information integration data; and the intelligent analysis module carries out classification prediction on the information integration data through a neural network. The invention can realize effective storage and intelligent analysis of dispersed industrial big data.
Description
Technical Field
The invention relates to the technical field of internet information processing, in particular to an industrial internet big data information processing terminal.
Background
The industrial internet is an industry and application ecology formed by the omnibearing deep fusion and integration of the internet, a new generation of information technology and a global industrial system, and the integration, processing and analysis of mass industrial data are realized through industrial cloud and industrial big data. In the era of industrial engineering and measured data explosion, the intelligent functions of data acquisition equipment and sensors are rapidly increased, so that industrial big data become more dispersed, and the traditional information processing terminal cannot effectively store and analyze all information data.
Therefore, providing an industrial internet big data information processing terminal, which is a problem that needs to be solved by those skilled in the art to effectively store and analyze the collected industrial big data.
Disclosure of Invention
In view of this, the present invention provides an industrial big data information processing terminal, which is used for effectively storing and intelligently analyzing scattered industrial big data.
In order to achieve the purpose, the invention adopts the following technical scheme: an industrial internet big data information processing terminal, comprising: the system comprises a data acquisition module, a data storage module, a data integration module and an intelligent analysis module;
the data acquisition modules are distributed on different industrial equipment and used for acquiring different equipment data in real time;
the data storage module stores the acquired data information on different equipment nodes;
the data integration module is used for cleaning data of the data information scattered on the equipment nodes and converting and integrating the data information into information integration data;
and the intelligent analysis module carries out classification prediction on the information integration data through a neural network.
Preferably, the industrial internet big data information processing terminal further comprises a cloud storage platform, and the cloud storage platform is connected with the data storage module and the data integration module, and is used for backing up data stored in the data storage module in real time and transmitting the data to the data integration module.
Preferably, the data integration module further includes data preprocessing before cleaning the data information, specifically including: inserting the incomplete data information into the missing data attributes to form complete data information; and carrying out normalization processing on the complete data information.
Preferably, the data storage module includes an MPP database.
Preferably, the specific step of the MPP database for data storage includes:
dividing the acquired data information into different data types, and storing the data information into different data nodes according to the data types, wherein the data nodes are positioned on corresponding equipment nodes.
Preferably, the intelligent analysis module performs classification prediction on the information integration data in the data integration module through a neural network, and specifically includes the following steps:
(1) extracting data information from the data integration module at regular intervals as training data, training and constructing a BP neural network model;
(2) and classifying the data information according to the equipment nodes according to the BP neural network model, and excluding edge data.
(3) And predicting the data information from which the edge data is eliminated to obtain predicted data information.
According to the technical scheme, compared with the prior art, the industrial internet big data information processing terminal is provided, distributed storage is carried out on scattered big data, meanwhile, the data information is classified and predicted by adopting the neural network, and storage and analysis efficiency of the scattered industrial big data is greatly improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a schematic structural diagram provided by the present invention.
Fig. 2 is a flow chart of classification and prediction of data information by the intelligent analysis module provided by the invention through a neural network.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The embodiment of the invention discloses an industrial big data information processing terminal, which comprises: the system comprises a data acquisition module, a data storage module, a data integration module and an intelligent analysis module.
The data acquisition module comprises various data sensors which are distributed on different industrial equipment and used for acquiring data such as operating voltage, operating current and the like of different equipment in real time.
The acquired data information is dispersed to different devices, corresponding data information is stored to different device nodes, and the data storage module internally comprises an MPP database. MPP (massively Parallel processing), namely large-scale Parallel processing, in a database non-shared cluster, each node is provided with an independent disk storage system and an independent memory system, service data are divided into the nodes according to a data model and application characteristics, and each data node is mutually connected through a special network or a commercial general network, is mutually calculated in a coordinated manner and provides database service as a whole. The data storage designed in this way can deal with the simultaneous storage of large-scale scattered data.
In another embodiment, a MongoDB database can be adopted in the data storage module, the MongoDB database is provided with a natural distributed storage system, and the MongoDB database is used for realizing distributed storage of data.
Because the acquired data information is located on different equipment nodes, and part of the acquired data information may be incomplete, for example, the voltage value or the current value of the equipment does not exist in different operation states, and the attribute of the voltage or the current in the acquired data is lost; in addition, even though the same kind of data acquisition module may contain different manufacturers, the acquired data information has differences. The data information of dispersed storage is cleaned, converted and integrated into information integration data through the data integration module so as to carry out analysis and application on the data information in the next step, and the data is firstly required to be preprocessed before being cleaned and converted, and the method specifically comprises the following steps: inserting the incomplete data information into the missing data attributes to form complete data information; and carrying out normalization processing on the complete data information.
The intelligent analysis module of the information processing terminal analyzes and processes the information integration data in the data integration module, the data information is commercialized, and the application of the data information is realized, wherein the BP neural network is adopted to classify and predict the stored data, and the intelligent analysis module specifically comprises the following steps:
(1) extracting data information from the data integration module at regular intervals as training data, training and constructing a BP neural network model, wherein the BP neural network structure comprises: in this embodiment, the operation data of different devices stored in the data storage module is used as input to output all the operation data included in the device type, the number of nodes of the input layer is determined according to the device type, the number of nodes of the output layer is set to be a fixed value 1, and the number of nodes l of the hidden layer is determined by the following formula:
where n represents the number of nodes of the input layer, m represents the number of nodes of the output layer, and a is a constant between [1,10 ].
(2) Classifying data information according to the device types according to a BP neural network model, setting weights for different device nodes according to importance degrees, and excluding edge node device data according to the weight;
(3) and predicting the data information from which the edge data is removed, wherein the terminal system can accurately judge the whole operation state of the equipment through the prediction information through information prediction.
In order to further optimize the technical scheme, the embodiments further include a cloud storage platform, the cloud storage platform is connected with the data storage module and the data integration module, and the data stored in the data storage module is automatically backed up every 10 seconds, so that the data in the data storage module is prevented from being lost.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (6)
1. An industrial internet big data information processing terminal, comprising: the system comprises a data acquisition module, a data storage module, a data integration module and an intelligent analysis module;
the data acquisition modules are distributed on different industrial equipment and used for acquiring different equipment data in real time;
the data storage module stores the acquired data information on different equipment nodes;
the data integration module is used for cleaning data of the data information scattered on the equipment nodes and converting and integrating the data information into information integration data;
and the intelligent analysis module carries out classification prediction on the information integration data through a neural network.
2. The industrial internet big data information processing terminal according to claim 1, further comprising a cloud storage platform, wherein the cloud storage platform, the data storage module and the data integration module are connected with each other, and are used for backing up data stored in the data storage module in real time and transmitting the data to the data integration module.
3. The industrial internet big data information processing terminal according to claim 1, wherein the data integration module further comprises data preprocessing before cleaning the data information, specifically comprising: inserting the incomplete data information into the missing data attributes to form complete data information; and carrying out normalization processing on the complete data information.
4. The industrial internet big data information processing terminal as claimed in claim 1, wherein the data storage module includes an MPP database.
5. The industrial internet big data information processing terminal as claimed in claim 4, wherein the specific steps of the MPP database for data storage include:
dividing the acquired data information into different data types, and storing the data information into different data nodes according to the data types, wherein the data nodes are positioned on corresponding equipment nodes.
6. The industrial internet big data information processing terminal according to claim 1, wherein the intelligent analysis module performs classification prediction on the information integration data in the data integration module through a neural network, and specifically comprises the following steps:
(1) extracting data information from the data integration module at regular intervals as training data, training and constructing a BP neural network model;
(2) and classifying the data information according to the equipment nodes according to the BP neural network model, and excluding edge data.
(3) And predicting the data information from which the edge data is eliminated to obtain predicted data information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110723813.3A CN113486125A (en) | 2021-06-29 | 2021-06-29 | Industrial internet big data information processing terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110723813.3A CN113486125A (en) | 2021-06-29 | 2021-06-29 | Industrial internet big data information processing terminal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113486125A true CN113486125A (en) | 2021-10-08 |
Family
ID=77936402
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110723813.3A Pending CN113486125A (en) | 2021-06-29 | 2021-06-29 | Industrial internet big data information processing terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113486125A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114399080A (en) * | 2021-12-14 | 2022-04-26 | 卫星化学股份有限公司 | Intelligent control method and system for acrylate production equipment |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106297291A (en) * | 2016-08-29 | 2017-01-04 | 苏州金螳螂怡和科技有限公司 | Urban expressway traffic information acquisition system |
| CN107942960A (en) * | 2017-10-23 | 2018-04-20 | 中国科学院地理科学与资源研究所 | A kind of intelligentized information processing system |
| CN108241343A (en) * | 2016-12-24 | 2018-07-03 | 青岛海尔模具有限公司 | A kind of intelligent plant management platform system |
| CN108900007A (en) * | 2018-08-30 | 2018-11-27 | 杭州电力设备制造有限公司 | A kind of energy Internet multi-point displaying Transmission system |
| CN109118764A (en) * | 2018-09-03 | 2019-01-01 | 山东交通学院 | A kind of car networking communication system based on ZigBee |
| CN109672577A (en) * | 2017-10-13 | 2019-04-23 | 南京唯实科技有限公司 | A kind of acquisition analysis system suitable for big data |
| CN109709914A (en) * | 2018-12-25 | 2019-05-03 | 安徽三马信息科技有限公司 | A kind of analysis of industrial energy consumption and management system |
| CN110032476A (en) * | 2019-04-17 | 2019-07-19 | 柳州铁道职业技术学院 | A kind of file storage intelligent backup system based on big data |
| CN111399436A (en) * | 2020-03-25 | 2020-07-10 | 安徽锦森环境科学有限公司 | Brick and tile factory smoke and dust gas detection processing system |
| CN111768280A (en) * | 2020-06-22 | 2020-10-13 | 南京恒信网络科技有限公司 | Enterprise financial data scheduling visualization platform system |
| CN112202243A (en) * | 2020-09-17 | 2021-01-08 | 许继集团有限公司 | Full-acquisition intelligent terminal for power transmission line state monitoring |
-
2021
- 2021-06-29 CN CN202110723813.3A patent/CN113486125A/en active Pending
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106297291A (en) * | 2016-08-29 | 2017-01-04 | 苏州金螳螂怡和科技有限公司 | Urban expressway traffic information acquisition system |
| CN108241343A (en) * | 2016-12-24 | 2018-07-03 | 青岛海尔模具有限公司 | A kind of intelligent plant management platform system |
| CN109672577A (en) * | 2017-10-13 | 2019-04-23 | 南京唯实科技有限公司 | A kind of acquisition analysis system suitable for big data |
| CN107942960A (en) * | 2017-10-23 | 2018-04-20 | 中国科学院地理科学与资源研究所 | A kind of intelligentized information processing system |
| CN108900007A (en) * | 2018-08-30 | 2018-11-27 | 杭州电力设备制造有限公司 | A kind of energy Internet multi-point displaying Transmission system |
| CN109118764A (en) * | 2018-09-03 | 2019-01-01 | 山东交通学院 | A kind of car networking communication system based on ZigBee |
| CN109709914A (en) * | 2018-12-25 | 2019-05-03 | 安徽三马信息科技有限公司 | A kind of analysis of industrial energy consumption and management system |
| CN110032476A (en) * | 2019-04-17 | 2019-07-19 | 柳州铁道职业技术学院 | A kind of file storage intelligent backup system based on big data |
| CN111399436A (en) * | 2020-03-25 | 2020-07-10 | 安徽锦森环境科学有限公司 | Brick and tile factory smoke and dust gas detection processing system |
| CN111768280A (en) * | 2020-06-22 | 2020-10-13 | 南京恒信网络科技有限公司 | Enterprise financial data scheduling visualization platform system |
| CN112202243A (en) * | 2020-09-17 | 2021-01-08 | 许继集团有限公司 | Full-acquisition intelligent terminal for power transmission line state monitoring |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114399080A (en) * | 2021-12-14 | 2022-04-26 | 卫星化学股份有限公司 | Intelligent control method and system for acrylate production equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111177095B (en) | Log analysis method, device, computer equipment and storage medium | |
| CN106294325B (en) | The optimization method and device of spatial term sentence | |
| CN111930526B (en) | Load prediction method, load prediction device, computer equipment and storage medium | |
| CN104778208A (en) | Method and system for optimally grasping search engine SEO (search engine optimization) website data | |
| CN112395289B (en) | Distributed photovoltaic data layered storage method and system | |
| CN110969198A (en) | Distributed training method, device, equipment and storage medium for deep learning model | |
| Zhang et al. | A streaming cloud platform for real-time video processing on embedded devices | |
| CN114356690A (en) | Application monitoring method, device, system, computer equipment and storage medium | |
| Mohamed et al. | A review on big data management and decision-making in smart grid | |
| CN113486125A (en) | Industrial internet big data information processing terminal | |
| CN117556369B (en) | Power theft detection method and system for dynamically generated residual error graph convolution neural network | |
| CN116826961A (en) | Intelligent power grid dispatching and operation and maintenance system, method and storage medium | |
| US20130335422A1 (en) | Selective learning for growing a graph lattice | |
| CN104636404A (en) | Method and device for generating large-scale data used for testing | |
| CN111581301A (en) | Big data classification system based on distributed data stream and algorithm thereof | |
| Chen et al. | Heterogeneous multiview crowdsensing based on half quadratic optimization for the visual internet of things | |
| CN112948660A (en) | Cluster electric bus monitoring website battery data continuous crawling and analyzing method | |
| Bonessio et al. | Structural health monitoring of bridges via energy harvesting sensor nodes | |
| CN107239796B (en) | System and method for distinguishing television attribution attributes based on using behaviors | |
| Nogueira et al. | pytwanalysis: Twitter data management and analysis at scale | |
| Zdravković et al. | Big Telemetry Data Analytics for Vehicle Fault Detection | |
| Jony et al. | An Evaluation of Data Processing Solutions Considering Preprocessing and" Special" Features | |
| Wu et al. | A dynamic spatial clustering for emergency response based on hierarchical-partition model | |
| Mavroudopoulos et al. | HARVEST: a complete solution for smart agriculture monitoring. | |
| Galimyanov et al. | Testing of streaming data clustering algorithm effectiveness |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB03 | Change of inventor or designer information | ||
| CB03 | Change of inventor or designer information |
Inventor after: Wang Qingjie Inventor after: Li Weiyi Inventor before: Wang Qingjie |