CN104539732A - Multi-level system architecture for massive independent equipment data flow - Google Patents
Multi-level system architecture for massive independent equipment data flow Download PDFInfo
- Publication number
- CN104539732A CN104539732A CN201510025450.0A CN201510025450A CN104539732A CN 104539732 A CN104539732 A CN 104539732A CN 201510025450 A CN201510025450 A CN 201510025450A CN 104539732 A CN104539732 A CN 104539732A
- Authority
- CN
- China
- Prior art keywords
- data
- gateway
- system architecture
- operation platform
- large amount
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2471—Distributed queries
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Probability & Statistics with Applications (AREA)
- Fuzzy Systems (AREA)
- Mathematical Physics (AREA)
- Signal Processing (AREA)
- Software Systems (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses multi-level system architecture for a massive independent equipment data flow. The architecture comprises a data collector, a gateway, a data center and an operating platform, wherein the data collector is connected with the gateway which is connected with the data center, the data center is connected with the operating platform, and the operating platform has a cloud computing function. The architecture disclosed by the invention realizes an industrial large data platform based on a PaaS mode and uses Hadoop as a basic architecture. Moreover, in order to support equipment in various shapes, the system architecture based on the collector-gateway-data center-operating platform is designed, so that changes of user demand can be extremely satisfied.
Description
Technical field
The present invention relates to a kind of device context solution, particularly relate to a kind of multi-tier system architecture towards a large amount of autonomous device flow data.
Background technology
Modern enterprise has a large amount of production equipments, for the centralized management of equipment, monitoring, maintenance, needs to gather and store, process a large amount of device datas, be referred to as flow data, flow data comes from the control system of equipment, transducer, produces based on seasonal effect in time series analog quantity and switching value.In this field, existing Technical Architecture is RTDB in Industry Control, and the data acquisition unit of customization, for realizing the collection of field data, and supporting industry application software.Current, along with large data technique, the development of cloud computing technology, the collection of equipment flow data and application are from the application of traditional scene to internet, applications development, and the pattern of traditional real-time data base+commercial Application software can not meet new demand for development.Existing mainstream technology is industrial real time historical database, the standard acquisition device that supporting database provides realizes control system as PLC, the data acquisition of DCS, realize the support of multiple commercial Application software based on real-time data base simultaneously, when equipment communications protocol can not support by the supporting collector of real-time data base time, need enforcement personnel to research and develop voluntarily.The level of factorys such as main commercial Application software comprises SCADA, MESS are applied.When user needs to realize other application software, existing mode is developed based on real time data bank interface.Existing solution, towards on-the-spot local area network (LAN), can not support internet, applications, and only can realize monitored picture and be published on the net, particularly for plant produced line, existing solution exists following defect:
1, be difficult to support to add equipment at random.
2, towards original point position, effectively equipment can not be distinguished.
3, when being applied to thousands of platform independent equipment, high from the enforcement development cost collecting application, changeability is extremely weak.
4, for level of factory scale, in the face of the data of a large amount of autonomous device, be difficult to effectively expand capacity and performance, by disposing multiple real-time data base to realize, but can only do not contact mutually between multiple real-time data base, the consistency of data cannot be ensured.Load balancing also can only rely on the artificial exploitation coordination system to realize.
5, be difficult to support Internet service, data cannot be accessed by the Internet.
6, a large amount of autonomous device is difficult to realize distributed capture, and independent mutually between multiple real-time data base, management difficulty is very large.
The collection of 7, different autonomous devices there is collection in worksite and high in the clouds gathers two kinds of patterns, and prior art is difficult to adapt to.
8, when large number quipments data, processing locality is limited in one's ability, is difficult to realize senior computation requirement.
Summary of the invention
The present invention aims to provide a kind of multi-tier system architecture towards a large amount of autonomous device flow data, achieves the large data platform of industry based on PaaS pattern, has used framework based on Hadoop.Meanwhile, in order to support the equipment of various form, devise the system architecture based on " collector-gateway-data center-operation platform ".Every one deck in system architecture of the present invention is support entity and virtual two kinds of patterns all simultaneously, the change that can greatly meet consumers' demand.
For achieving the above object, the present invention is that the technical scheme adopted is as follows:
Multi-tier system architecture towards a large amount of autonomous device flow data disclosed by the invention, comprising:
For the data acquisition unit of collecting device data;
For the gateway of adaptive different communication protocol;
For the data center of memory device historical data; Realized the storage of mass data by special data center, data center can effectively expand, and solves the limitation of existing level of factory real-time data base;
For the operation platform realizing intermediary service, encapsulate original point position, provide data-interface for operator;
Described data acquisition unit connects gateway, described gateway connection data center, and described data center connects operation platform, and described operation platform possesses cloud computing function.
Further, described operation platform connects at least 2 data centers, and described data center connects at least 2 gateways, and described gateway connects at least 2 data acquisition units.Increase equipment that can be random networks, a large amount of collectors can be created by gateway, random adds equipment, an operation platform can access multiple data center, each data center can access some collectors again, carries out effective distributed capture and management to a large amount of autonomous device by character.
Preferably, described data acquisition unit wired connection gateway, the wired and/or wireless connection data center of described gateway, the wired and/or wireless connections operation platform of described data center.
Preferably, described gateway is hypostazation gateway or virtual gateway, data center is hypostazation data center or Visualized data centre, operation platform is hypostazation operation platform or virtual operation platform.By gateway and collector, the collection for autonomous device provides specific aim scheme.When equipment must gather in this locality, independently can dispose gateway in this locality, carry out access device by the collector of gateway; When equipment is by linking Internet, cloud virtual gateway can be used, allow equipment by the Internet and gateway accessing.
Preferably, the described multi-tier system architecture towards a large amount of autonomous device flow data can be complete hypostazation networking mode, and field deployment is operation platform, data center and gateway independently.
Preferably, the described multi-tier system architecture towards a large amount of autonomous device flow data can be also Full-virtualization networking, by the cloud computing center of long-range operation, obtains virtual operation platform, creates Visualized data centre and virtual gateway.
Preferably, the described multi-tier system architecture towards a large amount of autonomous device flow data can also be mixed cloud networking mode: by the cloud computing center of long-range operation, obtain virtual operation platform, field deployment hypostazation data center, hypostazation gateway.Use virtual operation platform to commence business in the Internet, simultaneously by building data center in this locality, form mixed cloud pattern.With this in local management initial data, obtain the senior cloud computing ability of the Internet simultaneously.
Preferably, described virtual operation platform is PaaS pattern.
Preferably, the interface based on DDE, DCOM of the interface in the present invention and prior art is different, is the interface based on HTTP, can effectively supports that internet, applications is accessed.
The present invention has following beneficial effect:
1, can Rapid Implementation, user uses virtualization scheme, can build any local facility, can obtain cloud platform account fast, and the equipment that realizes networks, and gathers, application.
2, fully can tackle the flexibility of collection, gateway both can local disposition, and meeting must the local equipment requirement gathered, again can be virtual at cloud platform, meets the equipment requirement gathered by the Internet
3, multiple data center can effectively collect and manage, and meets classification collection and the management of large number quipments
4, by the virtual operation platform in local data center+high in the clouds, user both in local management data, can obtain again the high-performance calculation ability of cloud computing, realize the disposal ability that existing solution does not possess.
Accompanying drawing explanation
Fig. 1 is theory diagram of the present invention;
Fig. 2 is a kind of theory diagram of data center;
Fig. 3 is a kind of theory diagram of operation centre.
Embodiment
In order to make object of the present invention, technical scheme and advantage clearly understand, below in conjunction with accompanying drawing, the present invention is further elaborated.
As shown in Figure 1, multi-tier system architecture towards a large amount of autonomous device flow data disclosed by the invention adopts 4 level frameworks, the first order is operation platform, operation platform connects multiple data centers of the second level, comprise data center A, data center B, each data center connects multiple gateway, comprises data center A and connects gateway A1, gateway A 2 until gateway A n; Data center B connects gateway B1, gateway B2 until gateway Bn; Each gateway connects multiple data acquisition unit, and such as gateway A 2 connection data collector A21, data acquisition unit A22 are until data acquisition unit A2n; Each data acquisition unit connects corresponding equipment, such as: data acquisition unit A22 connection device A221, device A 222 are until device A 22n.Operation platform possesses cloud computing function, data acquisition unit wired connection gateway, described gateway wired connection data center, and described data center is wired and/or connect operation platform.
Gateway management person can create collector arbitrarily, and each gateway, towards a kind of device talk agreement, after creating collector, uses collector to get final product access device data-interface, realizes quick networking and the collection of equipment.
Gateway can be hypostazation gateway or virtual gateway, data center can be hypostazation data center or Visualized data centre, operation platform can be hypostazation operation platform or virtual operation platform, and thus, the present invention can adopt three kinds of networking modes:
1, complete hypostazation networking mode, field deployment is operation platform, data center and gateway independently.
2, Full-virtualization networking, by the cloud computing center of long-range operation, realizes virtual operation platform by PaaS pattern, creates Visualized data centre and virtual gateway.
3, mixed cloud networking mode: by the cloud computing center of long-range operation, realizes virtual operation platform by PaaS pattern, field deployment hypostazation data center, hypostazation gateway.
As shown in Figure 2, data center of the present invention can connect hypostazation gateway and virtual gateway respectively, hypostazation gateway connects multiple data acquisition unit, comprise data acquisition unit 1A, data acquisition unit 1B until data acquisition unit 1n, virtual gateway connects multiple data acquisition unit, comprises data acquisition unit 2A, data acquisition unit 2B until data acquisition unit 2n; In the manner, a data center not only can access multiple gateway, and gateway both can be disposed in device context, also can heart end Full-virtualization in the data.When device data interface does not support internet access (as OPC interface), gateway can be disposed at the scene, realize the access of device data source, then be pooled to data center.
When equipment interface is by internet access, as (Modbus Ethernet+3G communication), virtual gateway can be created by heart end in the data, carry out access device data source by the Internet.
As shown in Figure 3, operation centre of the present invention can connect hypostazation data center and Visualized data centre respectively, hypostazation data center connects multiple hypostazation gateway, comprise hypostazation gateway 1, hypostazation gateway 2 until hypostazation gateway n, Visualized data centre connects multiple virtual gateway, comprises virtual gateway 1, virtual gateway 2 until virtual gateway n; In the manner, an operation platform can access multiple data center, and each data center independently collects oneself gateway, and the classification realizing equipment in enormous quantities with this collects and manages, and the final heart in the data of all data stores; Realize the intensive of height by data center, consistency, high-performance, provide data for oneself and store.
Certainly; the present invention also can have other various embodiments; when not deviating from the present invention's spirit and essence thereof; those of ordinary skill in the art can make various corresponding change and distortion according to the present invention, but these change accordingly and are out of shape the protection range that all should belong to the claim appended by the present invention.
Claims (9)
1., towards a multi-tier system architecture for a large amount of autonomous device flow data, it is characterized in that, comprising:
For the data acquisition unit of collecting device data;
For the gateway of adaptive different communication protocol;
For the data center of memory device historical data;
For the operation platform realizing intermediary service, encapsulate original point position, provide data-interface for operator;
Described data acquisition unit connects gateway, described gateway connection data center, and described data center connects operation platform, and described operation platform possesses cloud computing function.
2. the multi-tier system architecture towards a large amount of autonomous device flow data according to claim 1, it is characterized in that, described operation platform connects at least 2 data centers, and described data center connects at least 2 gateways, and described gateway connects at least 2 data acquisition units.
3. the multi-tier system architecture towards a large amount of autonomous device flow data according to claim 1, it is characterized in that, described data acquisition unit wired connection gateway, the wired and/or wireless connection data center of described gateway, the wired and/or wireless connections operation platform of described data center.
4. the multi-tier system architecture towards a large amount of autonomous device flow data according to claim 1, it is characterized in that, described gateway is hypostazation gateway or virtual gateway, data center is hypostazation data center or Visualized data centre, operation platform are hypostazation operation platform or virtual operation platform.
5. the multi-tier system architecture towards a large amount of autonomous device flow data according to claim 4, it is characterized in that, the described multi-tier system architecture towards a large amount of autonomous device flow data is complete hypostazation networking mode, and field deployment is operation platform, data center and gateway independently.
6. the multi-tier system architecture towards a large amount of autonomous device flow data according to claim 4, it is characterized in that, the described multi-tier system architecture towards a large amount of autonomous device flow data is Full-virtualization networking, by the cloud computing center of long-range operation, obtain virtual operation platform, create Visualized data centre and virtual gateway.
7. the multi-tier system architecture towards a large amount of autonomous device flow data according to claim 4, it is characterized in that, the described multi-tier system architecture towards a large amount of autonomous device flow data is mixed cloud networking mode: by the cloud computing center of long-range operation, obtain virtual operation platform, field deployment hypostazation data center, hypostazation gateway.
8. the multi-tier system architecture towards a large amount of autonomous device flow data according to claim 6 or 7, is characterized in that, described virtual operation platform is PaaS pattern.
9. the multi-tier system architecture towards a large amount of autonomous device flow data according to claim 1, is characterized in that, described gateway and data center, interface between data center and operation centre are the interface based on HTTP.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510025450.0A CN104539732A (en) | 2015-01-19 | 2015-01-19 | Multi-level system architecture for massive independent equipment data flow |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510025450.0A CN104539732A (en) | 2015-01-19 | 2015-01-19 | Multi-level system architecture for massive independent equipment data flow |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104539732A true CN104539732A (en) | 2015-04-22 |
Family
ID=52855199
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510025450.0A Pending CN104539732A (en) | 2015-01-19 | 2015-01-19 | Multi-level system architecture for massive independent equipment data flow |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104539732A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109459987A (en) * | 2018-11-08 | 2019-03-12 | 内蒙古伊泰煤炭股份有限公司 | Intelligent plant operation platform and method |
| CN110098994A (en) * | 2019-05-08 | 2019-08-06 | 江苏泰源环保科技股份有限公司 | A kind of long-distance communicating method for data dispatch |
| WO2020143094A1 (en) * | 2019-01-09 | 2020-07-16 | 网宿科技股份有限公司 | Intelligent management method and system based on edge computing |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090216889A1 (en) * | 2003-01-28 | 2009-08-27 | Altaf Hadi | System and method for delivering last mile computing over light from a plurality of network edge locations |
| CN102882969A (en) * | 2012-09-25 | 2013-01-16 | 浙江图讯科技有限公司 | Safety production cloud service platform for industrial and mining enterprises |
-
2015
- 2015-01-19 CN CN201510025450.0A patent/CN104539732A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090216889A1 (en) * | 2003-01-28 | 2009-08-27 | Altaf Hadi | System and method for delivering last mile computing over light from a plurality of network edge locations |
| CN102882969A (en) * | 2012-09-25 | 2013-01-16 | 浙江图讯科技有限公司 | Safety production cloud service platform for industrial and mining enterprises |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109459987A (en) * | 2018-11-08 | 2019-03-12 | 内蒙古伊泰煤炭股份有限公司 | Intelligent plant operation platform and method |
| WO2020143094A1 (en) * | 2019-01-09 | 2020-07-16 | 网宿科技股份有限公司 | Intelligent management method and system based on edge computing |
| CN110098994A (en) * | 2019-05-08 | 2019-08-06 | 江苏泰源环保科技股份有限公司 | A kind of long-distance communicating method for data dispatch |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2017036244A1 (en) | Digital simulation system of power distribution network | |
| CN111062651A (en) | Safe power utilization management system and method based on edge calculation and big data analysis | |
| CN103283208B (en) | Based on the remote real-time monitoring system of cloud computing | |
| Shi et al. | The fog computing service for healthcare | |
| CN109379420B (en) | Comprehensive energy service platform system based on distributed architecture | |
| US11226614B2 (en) | Use of a smart node in a universal, smart system for monitoring industrial processes | |
| CN205485380U (en) | Industrial data collection system | |
| CN108769121A (en) | Intelligent industrial equips the method for uploading of internet of things data acquisition system and gathered data | |
| CN104794578A (en) | Could computing based smart water affair management system | |
| CN108107832A (en) | A kind of sewage disposal real time monitoring and optimization system based on data-driven | |
| CN104123134A (en) | Intelligent electricity use data management method and system based on AMI and J2EE | |
| CN103516051A (en) | Centralized monitoring system platform for wind power plants | |
| CN106054766A (en) | Remote monitoring, detection, maintenance and management method for fire control facilities and information system | |
| CN105446196B (en) | A kind of Intelligent spraying system and its control method with real-time monitoring and control | |
| CN106921702B (en) | It is a kind of based on service-oriented power distribution network information physical system | |
| CN104539732A (en) | Multi-level system architecture for massive independent equipment data flow | |
| Pizoń et al. | Perspectives for fog computing in manufacturing | |
| CN204740299U (en) | Electric energy quality intelligent monitoring system based on cloud calculates | |
| CN112131216A (en) | Power transmission line self-adaptive database creation method and device based on object model | |
| Harish et al. | A review on fog computing and its applications | |
| CN108572562A (en) | A kind of smart home wisdom energy management system based on Internet of Things and QT graphical interfaces | |
| CN208890843U (en) | A kind of edge calculations system based on mist node | |
| CN108710347A (en) | A kind of monitoring cloud platform | |
| CN114760318B (en) | Edge computing management method and system | |
| CN208874596U (en) | A kind of Internet of Things big data source digging tool |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20151103 Address after: 518000, Guangdong, Shenzhen, Nanshan District Province Road No. 8, 1 financial services technology innovation base, 4B-6 Applicant after: Tongfang (Shenzhen) Cloud Computing Technology Co., Ltd. Address before: 610000, No. 23, No. 2, building 88, 14, five road, hi tech Zone, Chengdu, Sichuan Applicant before: CHENGDU UNIMATIC TECHNOLOGY CO., LTD. |
|
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20150422 |