CN110727846A - Industrial Internet data acquisition and classification processing method - Google Patents
Industrial Internet data acquisition and classification processing method Download PDFInfo
- Publication number
- CN110727846A CN110727846A CN201910845661.7A CN201910845661A CN110727846A CN 110727846 A CN110727846 A CN 110727846A CN 201910845661 A CN201910845661 A CN 201910845661A CN 110727846 A CN110727846 A CN 110727846A
- Authority
- CN
- China
- Prior art keywords
- data
- industrial
- processing platform
- gateway
- internet
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/953—Querying, e.g. by the use of web search engines
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/35—Clustering; Classification
Abstract
The invention discloses a method for collecting and classifying industrial internet data, belongs to the field of industrial internet or industrial internet of things, and solves the problems that the type and the type of the collected data of an industrial gateway are fixed and inflexible, a new data source is added, the industrial gateway possibly needs to be modified, and a data processing platform possibly needs to be repaired every time one industrial gateway or one data type is added. The technical key points are as follows: acquiring data by taking the corresponding acquisition point as the acquisition point, acquiring the data of the acquisition point by a configuration background, acquiring the data by the configuration background through an industrial gateway, transmitting the data to a data processing platform for processing, modifying the information of the acquisition point of the industrial gateway, and only synchronously configuring the information to the data processing platform, wherein the processing software of the data processing platform does not need to be modified; the flexible configuration of the data acquired by the industrial gateway can be realized, the industrial gateway is generalized, and the cost of developing and maintaining the gateway is saved; the data processing platform flexibly processes data according to configuration, and the cost for developing and maintaining the data processing platform is saved.
Description
Technical Field
The invention relates to the field of industrial internet or industrial internet of things, in particular to a method for acquiring and classifying industrial internet data.
Background
Setting a certain acquisition frequency through an industrial gateway to acquire data according to the format and the type of a data source; the collected data are transmitted and summarized to a data processing platform through an internet of things protocol (such as MQTT); the data processing platform extracts, converts and loads various data, analyzes and processes the data and stores the data into a target database.
However, the current industrial internet data acquisition and classification process has the following defects:
1. the type and the kind of the data collected by the industrial gateway are fixed and inflexible. Adding new data sources may require modifications to the industrial gateway (software, hardware).
2. The data processing platform is not universal and flexible in the collected data classification processing method. The data processing platform may need to be modified for each additional industrial gateway or data class.
Therefore, it is desirable to provide a method for industrial internet data collection and classification processing, which aims to solve the above problems.
Disclosure of Invention
In view of the defects in the prior art, an embodiment of the present invention provides a method for collecting and classifying industrial internet data, so as to solve the problems in the background art.
In order to achieve the purpose, the invention provides the following technical scheme:
a method for collecting and classifying industrial Internet data comprises designing data addresses, protocols, data types, frequencies and names of collecting points, configuring the collecting points on industrial equipment, collecting data by the collecting points, acquiring relevant information of each collecting point by a configuration background, acquiring the data of the collecting points by the configuration background, transmitting the data information acquired by the configuration background to a data processing platform through an industrial gateway, processing the data information by the data processing platform according to the data information of each collecting point, only synchronously configuring the information to the data processing platform after the information of the collecting points of the industrial gateway is modified, and processing software of the data processing platform is not required to be modified.
As a further scheme of the invention, the data address, protocol, data type, frequency and name of the acquisition point are configured through a configuration background module supported by the industrial metering gateway.
As a further scheme of the invention, the data information collected by the collection point comprises a data address, a protocol, a data type, a frequency and a name.
As a further scheme of the invention, the data processing platform processes the data information, including extracting, converting, loading and analyzing.
As a further scheme of the present invention, each collection point further includes at least one collector, the collector includes a control CPU, a first interface connected to the industrial device, a second interface connected to the configuration background, and a storage unit, the first interface is a pluggable internet of things access component module, the second interface is a pluggable network component access component module, and the control CPU is respectively connected to the internet of things access component module, the network access component module, and the storage unit.
As a further scheme of the invention, the internet of things access component module is a pluggable general interface, and the control CPU is connected with the internet of things access component module, the network access component module and the storage unit.
As a further scheme of the invention, the collector is also provided with a cloud data collection module which is an interactive communication protocol encapsulated between the collector and the industrial gateway.
As a further scheme of the invention, the collector is connected with the industrial gateway, the collector sends collected data information to the industrial gateway through the cloud data collection module, the collector is activated on the industrial gateway, and then the collector can obtain equipment collection parameters so as to read the equipment data of the industrial equipment and directly transmit the equipment data to the data processing platform.
In summary, compared with the prior art, the embodiment of the invention has the following beneficial effects:
the method for collecting and classifying the industrial internet data comprises the steps that corresponding collecting points are used for collecting data, the collecting point data are obtained by a configuration background, the configuration background collects the data to a data processing platform through an industrial gateway and processes the data, after the collecting point information of the industrial gateway is modified, only information needs to be synchronously configured to the data processing platform, and the processing software of the data processing platform does not need to be modified; the flexible configuration of the data acquired by the industrial gateway can be realized, the industrial gateway is generalized, and the cost of developing and maintaining the gateway is saved; the data processing platform flexibly processes data according to configuration, and the cost for developing and maintaining the data processing platform is saved.
To more clearly illustrate the structural features and effects of the present invention, the present invention will be described in detail below with reference to the accompanying drawings and specific embodiments.
Drawings
Fig. 1 is a schematic diagram of a flexible configuration of data acquisition and processing in the method for acquiring and classifying data of the industrial internet according to the present invention.
Detailed Description
The technical solution of the present invention is further described with reference to the accompanying drawings and specific embodiments.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Example 1
Referring to fig. 1, a method for collecting and classifying industrial internet data includes collecting data at corresponding collection points, obtaining the data of the collection points by a configuration background, collecting the data to a data processing platform by the configuration background through an industrial gateway, processing the data by the configuration background, and only synchronously configuring information to the data processing platform after the information of the collection points of the industrial gateway is modified without modifying the processing software of the data processing platform.
The method comprises the steps of designing data addresses, protocols, data types, frequencies and names of acquisition points, flexibly configuring the acquisition points on the industrial equipment, configuring a background to acquire related information of each acquisition point, transmitting the data information acquired by the configuration background to a data processing platform through an industrial gateway, processing the data information by the data processing platform according to each acquisition point, and only synchronously configuring information to the data processing platform after the information of the acquisition points of the industrial gateway is modified without modifying processing software of the data processing platform.
The data address, protocol, data type, frequency and name of the acquisition point are configured through a configuration background module through the support of the industrial metering gateway.
The data information collected by the collecting point comprises a data address, a protocol, a data type, a frequency and a name.
The data processing platform processes the data information, including extraction, conversion, loading and analysis.
Example 2
Referring to fig. 1, a method for collecting and classifying industrial internet data includes collecting data at corresponding collection points, obtaining the data of the collection points by a configuration background, collecting the data to a data processing platform by the configuration background through an industrial gateway, processing the data by the configuration background, and only synchronously configuring information to the data processing platform after the information of the collection points of the industrial gateway is modified without modifying the processing software of the data processing platform.
The method comprises the steps of designing data addresses, protocols, data types, frequencies and names of acquisition points, flexibly configuring the acquisition points on the industrial equipment, configuring a background to acquire related information of each acquisition point, transmitting the data information acquired by the configuration background to a data processing platform through an industrial gateway, processing the data information by the data processing platform according to each acquisition point, and only synchronously configuring information to the data processing platform after the information of the acquisition points of the industrial gateway is modified without modifying processing software of the data processing platform.
Different from the embodiment 1, each collection point comprises at least one collector, each collector comprises a control CPU, a first interface connected with the industrial equipment, a second interface connected with the configuration background, and a storage unit, the first interface is a pluggable internet of things access component module, the second interface is a pluggable network component access component module, and the control CPU is respectively connected with the internet of things access component module, the network access component module, and the storage unit.
The Internet of things access assembly module is a pluggable universal interface, supports various industrial field bus technologies, comprises RS485, RS232, RS422, CAN, TCP/IP and Ethernet/IP, supports communication with industrial equipment with different interfaces, CAN be replaced according to the interface of the industrial equipment in a pluggable mode, and further reduces cost while meeting application requirements.
The network access component module provides network capability for remotely accessing the industrial gateway, realizes data uploading and configuration background of an acquisition point of the industrial equipment, and provides different network access modes according to needs in a pluggable mode.
The control CPU is connected with the Internet of things access component module, the network access component module and the storage unit, performs communication and conversion according to corresponding communication protocols, receives a command conversion protocol of the industrial gateway and then transmits the command conversion protocol to the industrial equipment, receives data of the industrial equipment, and transmits the data to the industrial gateway after the protocol conversion.
The storage unit is a data storage device used for the cache collector to collect.
Furthermore, the collector is also provided with a cloud data collection module which is software arranged in the collector, is stored in the storage unit, is encapsulated in a communication protocol interacted between the collector and the industrial gateway and has the functions of protocol conversion and data transmission; after the cloud data collection module is adopted, the collected data of the collector can be directly transmitted to the data processing platform through the gateway, and the data processing effect is improved.
After the collector is connected with the industrial gateway, the collector sends collected data information (data address, protocol, data type, frequency, name and the like) to the industrial gateway through the cloud data collection module, the collector is activated on the industrial gateway, and then the collector can obtain equipment collection parameters so as to read equipment data of industrial equipment and directly transmit the equipment data to the data processing platform.
By adopting the method for acquiring and classifying the industrial internet data, the flexible configuration of the data acquired by the industrial gateway can be realized, the industrial gateway is universal, and the cost of developing and maintaining the gateway is saved; the data processing platform flexibly processes data according to configuration, and the cost for developing and maintaining the data processing platform is saved.
The technical principle of the present invention has been described above with reference to specific embodiments, which are merely preferred embodiments of the present invention. The protection scope of the present invention is not limited to the above embodiments, and all technical solutions belonging to the idea of the present invention belong to the protection scope of the present invention. Other embodiments of the invention will occur to those skilled in the art without the exercise of inventive faculty, and such will fall within the scope of the invention.
Claims (8)
1. A method for collecting and classifying industrial Internet data is characterized by comprising the steps of designing a data collecting point address, a protocol, a data type, a frequency and a name, configuring collecting points on industrial equipment, collecting data by the collecting points, acquiring relevant information of each collecting point by a configuration background, acquiring the data collecting point data by the configuration background, transmitting the data information acquired by the configuration background to a data processing platform through an industrial gateway, processing the data processing platform according to the data information of each collecting point, only synchronously configuring the information to the data processing platform after the information of the collecting points of the industrial gateway is modified, and enabling processing software of the data processing platform not to be modified.
2. The method for industrial internet data collection and classification processing according to claim 1, wherein the collection point data address, protocol, data type and frequency and name are configured through a configuration background module supported by an industrial gateway.
3. The method for industrial internet data collection and classification processing according to claim 2, wherein the data information collected by the collection point includes data address, protocol, data type and frequency and name.
4. The method for industrial internet data collection and classification processing according to claim 3, wherein the processing of the data information by the data processing platform includes extraction, conversion, loading and analysis.
5. The industrial internet data acquisition and classification processing method according to any one of claims 1 to 4, wherein each acquisition point further comprises at least one acquisition unit, each acquisition unit comprises a control CPU, a first interface connected with the industrial equipment, a second interface connected with the configuration background, and a storage unit, the first interface is a pluggable internet of things access component module, the second interface is a pluggable network component access component module, and the control CPU is respectively connected with the internet of things access component module, the network access component module, and the storage unit.
6. The method for industrial internet data acquisition and classification processing according to claim 5, wherein the internet of things access component module is a pluggable universal interface, and the control CPU is connected with the internet of things access component module, the network access component module and the storage unit.
7. The industrial internet data acquisition and classification processing method according to claim 6, wherein the collector is further provided with a cloud data collection module which is a communication protocol encapsulated between the collector and the industrial gateway.
8. The industrial internet data acquisition and classification processing method according to claim 7, wherein the collector is connected with the industrial gateway, the collector sends collected data information to the industrial gateway through the cloud data collection module, the collector is activated on the industrial gateway, and then the collector acquires equipment collection parameters to read equipment data of the industrial equipment and directly transmit the equipment data to the data processing platform.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910845661.7A CN110727846A (en) | 2019-09-09 | 2019-09-09 | Industrial Internet data acquisition and classification processing method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910845661.7A CN110727846A (en) | 2019-09-09 | 2019-09-09 | Industrial Internet data acquisition and classification processing method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110727846A true CN110727846A (en) | 2020-01-24 |
Family
ID=69218012
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910845661.7A Pending CN110727846A (en) | 2019-09-09 | 2019-09-09 | Industrial Internet data acquisition and classification processing method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110727846A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111885164A (en) * | 2020-07-23 | 2020-11-03 | 广东电网有限责任公司 | Data management system |
| CN112839080A (en) * | 2020-12-31 | 2021-05-25 | 四川瑞霆电力科技有限公司 | Edge Internet of things agent device and method for realizing acquisition and calculation based on configuration |
| CN113382038A (en) * | 2021-04-25 | 2021-09-10 | 杭州玖欣物联科技有限公司 | Lwm2m protocol-based gateway equipment user remote management method |
| CN113422813A (en) * | 2021-06-15 | 2021-09-21 | 镇江高等职业技术学校 | Wireless communication operation platform of industrial Internet of things |
| CN114979218A (en) * | 2022-06-06 | 2022-08-30 | 合肥海拔网络科技有限公司 | Method for acquiring and storing industrial internet time sequence data |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150281356A1 (en) * | 2014-03-26 | 2015-10-01 | Rockwell Automation Technologies, Inc. | Unified data ingestion adapter for migration of industrial data to a cloud platform |
| CN105629790A (en) * | 2016-01-29 | 2016-06-01 | 广州能迪能源科技股份有限公司 | Data management platform and method based on industrial IOT (Internet of Things) |
| CN105785958A (en) * | 2016-05-08 | 2016-07-20 | 杭州集控软件有限公司 | Smart factory-based multi-function data acquisition device, acquisition system and method |
| CN108616506A (en) * | 2018-03-23 | 2018-10-02 | 中国科学院软件研究所 | A kind of intelligent building real time data distributed integeration control method |
| CN108769121A (en) * | 2018-04-24 | 2018-11-06 | 浙江正泰电器股份有限公司 | Intelligent industrial equips the method for uploading of internet of things data acquisition system and gathered data |
| CN109788034A (en) * | 2018-12-18 | 2019-05-21 | 珠海派诺科技股份有限公司 | For the configuration method of gateway access equipment, electronic equipment and storage medium |
-
2019
- 2019-09-09 CN CN201910845661.7A patent/CN110727846A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150281356A1 (en) * | 2014-03-26 | 2015-10-01 | Rockwell Automation Technologies, Inc. | Unified data ingestion adapter for migration of industrial data to a cloud platform |
| CN105629790A (en) * | 2016-01-29 | 2016-06-01 | 广州能迪能源科技股份有限公司 | Data management platform and method based on industrial IOT (Internet of Things) |
| CN105785958A (en) * | 2016-05-08 | 2016-07-20 | 杭州集控软件有限公司 | Smart factory-based multi-function data acquisition device, acquisition system and method |
| CN108616506A (en) * | 2018-03-23 | 2018-10-02 | 中国科学院软件研究所 | A kind of intelligent building real time data distributed integeration control method |
| CN108769121A (en) * | 2018-04-24 | 2018-11-06 | 浙江正泰电器股份有限公司 | Intelligent industrial equips the method for uploading of internet of things data acquisition system and gathered data |
| CN109788034A (en) * | 2018-12-18 | 2019-05-21 | 珠海派诺科技股份有限公司 | For the configuration method of gateway access equipment, electronic equipment and storage medium |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111885164A (en) * | 2020-07-23 | 2020-11-03 | 广东电网有限责任公司 | Data management system |
| CN111885164B (en) * | 2020-07-23 | 2023-08-25 | 广东电网有限责任公司 | Data management system |
| CN112839080A (en) * | 2020-12-31 | 2021-05-25 | 四川瑞霆电力科技有限公司 | Edge Internet of things agent device and method for realizing acquisition and calculation based on configuration |
| CN112839080B (en) * | 2020-12-31 | 2022-11-04 | 四川瑞霆智汇科技有限公司 | Edge Internet of things agent device and method for realizing acquisition and calculation based on configuration |
| CN113382038A (en) * | 2021-04-25 | 2021-09-10 | 杭州玖欣物联科技有限公司 | Lwm2m protocol-based gateway equipment user remote management method |
| CN113422813A (en) * | 2021-06-15 | 2021-09-21 | 镇江高等职业技术学校 | Wireless communication operation platform of industrial Internet of things |
| CN114979218A (en) * | 2022-06-06 | 2022-08-30 | 合肥海拔网络科技有限公司 | Method for acquiring and storing industrial internet time sequence data |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110727846A (en) | Industrial Internet data acquisition and classification processing method | |
| CN109600406B (en) | Environmental radiation monitoring station system | |
| US20120271962A1 (en) | Achieving Lossless Data Streaming in a Scan Based Industrial Process Control System | |
| CN103248512B (en) | The generation method and system of application layer topological structure in communication network | |
| CN101651707A (en) | Method for automatically acquiring user behavior log of network | |
| CN103546343B (en) | The network traffics methods of exhibiting of network traffic analysis system and system | |
| CN101605056A (en) | A kind of J2EE server monitoring device and adopt the method for supervising of this device | |
| CN105554163A (en) | Remote monitoring system based on cloud computing and remote monitoring method | |
| EP1812916A1 (en) | Data collector with wireless server connection | |
| CN108540584B (en) | Universal Modbus protocol address configuration method | |
| CN104184745A (en) | Intelligent front-end equipment communication system | |
| CN111813751A (en) | Application system log data processing method, application system, device and medium | |
| CN103996276A (en) | Remote transmission system and method for data of power plant | |
| CN1643463A (en) | Condition monitoring system for machines equipped with a machine control system and including rotating machine elements | |
| CN105180367A (en) | Data transmitting method and system for air conditioner unit | |
| CN110362055A (en) | A kind of industrial data acquisition system that terminal is expansible and method | |
| CN111212093A (en) | Data processing system and control device | |
| CN115174621B (en) | Edge internet of things proxy device for intelligent inspection of hydropower station | |
| CN109299069A (en) | A kind of big data acquisition management platform based on internet data acquisition | |
| KR20210096054A (en) | Energy management system | |
| US20180059651A1 (en) | Information collection system | |
| CN114390033A (en) | Loop state patrol instrument acquisition system and method based on extensible communication protocol | |
| CN209088989U (en) | A kind of data acquisition gateway | |
| CN204373772U (en) | A kind of wireless vibration sensor adopting WiFi communication technology | |
| CN110850824A (en) | Implementation method for acquiring data of distributed control system to Hadoop platform |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |