KR20120132878A - An Architecture of Real-time, Historical Database System for Industrial Process Control and Monitoring - Google Patents
An Architecture of Real-time, Historical Database System for Industrial Process Control and Monitoring Download PDFInfo
- Publication number
- KR20120132878A KR20120132878A KR1020110051265A KR20110051265A KR20120132878A KR 20120132878 A KR20120132878 A KR 20120132878A KR 1020110051265 A KR1020110051265 A KR 1020110051265A KR 20110051265 A KR20110051265 A KR 20110051265A KR 20120132878 A KR20120132878 A KR 20120132878A
- Authority
- KR
- South Korea
- Prior art keywords
- data
- layer
- process control
- database system
- sdt
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Testing And Monitoring For Control Systems (AREA)
Abstract
Description
The present invention relates to the structure of a process database, and to derive the characteristics of a process control transaction and analyze the existing process database to derive the requirements that the process database should have, and to a structure of a new process database that can reflect this well. will be.
1 illustrates a typical process control system architecture. Regarding the structure of the process control system, the process control system acquires data using a sensor unit which measures data such as temperature, pressure, voltage, etc., a programmable logic controller (PLC), a distributed communication system (DCS), a remote terminal unit (RTU), and the like. It consists of an input unit, a process database unit for storing the obtained information, and a HMI (Human Machine Interface) unit for the driver to detect and respond to abnormal conditions. The process database must efficiently manage the current, recent changes, and the entire historical data of the process data.
In the process control transaction, the characteristics of the process data compared to general data are shown in Table 1. The biggest feature is that the process data has a time continuity within 1 second. If one point is 10bytes and is stored in 1 second period, more than 31M should be stored.
The characteristics of the process control transaction for processing such process data are shown in Table 2.
Process database processes data in various ways such as self-developed, historian, memory DBMS, general purpose disk DBMS, etc. according to process data processing requirements of process control system. Historian is widely used for high performance and large data storage, and Memory DB which supports relational model is also used for real time data processing.
Regarding the system structure of the historian and the memory DB, FIG. 2 shows the system structure of the hyper historian, which is one of the historians. The main component, Real-time Data Logger, collects process data, provides information to MS-SQL server, and provides interface with various solutions of HMI.
3 shows McObject's ExtremeDB system architecture supporting a relational data model. Its main feature is to provide high performance by providing various programming APIs according to application and processing data in memory with DB memory pool.
As mentioned above, the process database is mostly relational DB using Historian and memory technology. However, each historian and relational DB has a trade-off between performance and flexibility. However, with the development of H / W and SW technology, a process database with high performance needs and flexibility is required. To this end, according to the present invention, it is an object of the present invention to efficiently manage a data model having flexibility, an improvement of a compression scheme, and an importance of stored data.
According to a feature of the present invention for achieving the above object, the structure of the process database,
Programming API Layer consisting of Light weight API and Query based API,
Data Model Layer composed of RBTDM,
Data Compression Layer composed of SDT-SC,
The configuration features include storage layers consisting of MLSM, MRMRF, and BWA.
In the Data Model Layer, RBTDM is configured to be extended to process process data in a relational data model such as ORDB (Object Relational Database).
In the Data Compression Layer, SDT-SC improves the storage space by giving another chance when the next data to be stored is determined in the swing door trending (SDT) [7], which is widely used as a data compression technique. .
In the storage layer, the MLSM divides the data to be stored into current, trend, and total, and applies a data compression method suitable for each, and improves the writing and reading of the data.
The MRMRF adjusts the amount of data to be copied according to each data request cycle and device of the HMI. The BWA is characterized by splitting, sending in bulk, and asynchronously recording the tasks of the target to be shared among clients.
According to the process database structure of the present invention, the process database structure includes a programming API layer, a data model layer, a data compression layer, and a storage layer. In the Data Model Layer, RBTDM can be extended to process process data in relational data models such as ORDB (Object Relational Database) .In the Data Compression Layer, SDT-SC is a swing door trending method that is widely used as a data compression technique. ), When the next data to be stored is decided, the storage space can be more efficient by giving another chance, and in the Storage Layer, MLSM divides the data to be stored into current, trend, and overall data compression methods. It can improve the writing and reading of data.
1 shows a typical process control system structure.
2 shows a system structure of Hyper Historian, which is one of Historian.
3 shows McObject's ExtremeDB system architecture supporting a relational data model.
4 shows two important measurement elements of the Process Database.
5 shows the overall architecture of the new process database.
Hereinafter, with reference to the accompanying drawings, it will be described in detail the characteristics of the structure of the process control database system of the present invention.
The main requirements to be supported in the new process database are:
Regarding flexible data model support, not only tag-based data models but also relational data models for general data processing are needed to efficiently perform real-time information analysis.
In addition, with regard to improving storage efficiency through improvements in compression techniques, a compression scheme suitable for both analog and digital data should be considered.
In addition, with regard to storage management according to the importance of data, the closer to the current time, the more important and real time is when the importance of the data is compared with time from present to past. Storage management considering this is necessary.
Regarding the improvement in the write performance in consideration of the multi-core or the multi-processor, the HW equipped with the multi-core and the multi-processor has become common. To improve the write performance of process data, we need to consider the characteristics of recent HW.
The overall architecture of the new process database is shown in FIG. 5 and consists of a programming API layer, a data model layer, a data compression layer, and a storage layer. In the Data Model Layer, RBTDM is an extended data model for processing process data in relational data models such as ORDB (Object Relational Database). In the Data Compression Layer, SDT-SC improves the storage space by giving another chance when the next data to be stored is decided in the swing door trending [7] [7], which is widely used as a data compression technique. In the storage layer, MLSM classifies data to be stored in current, trend, and total, and applies data compression method suitable for each, and improves data writing and reading. MRMRF adjusts the amount of data to be replicated according to each data request cycle and device of HMI. BWA splits, transfers in bulk, and records asynchronously so that the client's work can be shared by the client.
Claims (5)
Data Model Layer composed of RBTDM,
Data Compression Layer composed of SDT-SC,
Process control database system whose configuration features include storage layers consisting of MLSM, MRMRF, and BWA
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020110051265A KR20120132878A (en) | 2011-05-30 | 2011-05-30 | An Architecture of Real-time, Historical Database System for Industrial Process Control and Monitoring |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020110051265A KR20120132878A (en) | 2011-05-30 | 2011-05-30 | An Architecture of Real-time, Historical Database System for Industrial Process Control and Monitoring |
Publications (1)
Publication Number | Publication Date |
---|---|
KR20120132878A true KR20120132878A (en) | 2012-12-10 |
Family
ID=47516335
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020110051265A KR20120132878A (en) | 2011-05-30 | 2011-05-30 | An Architecture of Real-time, Historical Database System for Industrial Process Control and Monitoring |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR20120132878A (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106649026A (en) * | 2016-09-26 | 2017-05-10 | 国家电网公司北京电力医院 | Monitoring data compression method applicable to operation and maintenance automation system |
CN108543217A (en) * | 2018-03-16 | 2018-09-18 | 广东工业大学 | A kind of apparatus for curing insomnia and Insomnia therapy method |
CN109143974A (en) * | 2017-06-15 | 2019-01-04 | 沈阳高精数控智能技术股份有限公司 | A kind of SDT improved method applied to numerically-controlled machine tool monitoring field |
CN109936373A (en) * | 2019-02-28 | 2019-06-25 | 北京交通大学 | A kind of real-time data compression method for synchronized phasor DATA REASONING |
-
2011
- 2011-05-30 KR KR1020110051265A patent/KR20120132878A/en not_active Application Discontinuation
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106649026A (en) * | 2016-09-26 | 2017-05-10 | 国家电网公司北京电力医院 | Monitoring data compression method applicable to operation and maintenance automation system |
CN109143974A (en) * | 2017-06-15 | 2019-01-04 | 沈阳高精数控智能技术股份有限公司 | A kind of SDT improved method applied to numerically-controlled machine tool monitoring field |
CN108543217A (en) * | 2018-03-16 | 2018-09-18 | 广东工业大学 | A kind of apparatus for curing insomnia and Insomnia therapy method |
CN109936373A (en) * | 2019-02-28 | 2019-06-25 | 北京交通大学 | A kind of real-time data compression method for synchronized phasor DATA REASONING |
CN109936373B (en) * | 2019-02-28 | 2023-05-02 | 北京交通大学 | Real-time data compression method for synchronous phasor data measurement |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9767174B2 (en) | Efficient query processing using histograms in a columnar database | |
US9367574B2 (en) | Efficient query processing in columnar databases using bloom filters | |
CN102982085B (en) | Data mover system and method | |
CN102609360B (en) | Data processing method, data processing device and data processing system | |
EP3028137B1 (en) | Generating a multi-column index for relational databases by interleaving data bits for selectivity | |
US11494339B2 (en) | Multi-level compression for storing data in a data store | |
CN102073712B (en) | Holographic process data archiving and inverting method based on dynamic change frame | |
CN103955530A (en) | Data reconstruction and optimization method of on-line repeating data deletion system | |
CN100470429C (en) | Synchronization process of total distributed control system operator stations EMS memory database structure storage | |
WO2012083754A1 (en) | Method and device for processing dirty data | |
KR20120132878A (en) | An Architecture of Real-time, Historical Database System for Industrial Process Control and Monitoring | |
CN108182244B (en) | A kind of time series data storage method based on multi-level column storage organization | |
CN102929935B (en) | A kind of Large Volume Data reading/writing method based on affairs | |
CN110704442A (en) | Real-time acquisition method and device for big data | |
CN103258047B (en) | A kind of data organization method towards medicine enterprise Activity-Based Cost Control data warehouse | |
CN112000703B (en) | Data warehousing processing method and device, computer equipment and storage medium | |
US10095738B1 (en) | Dynamic assignment of logical partitions according to query predicate evaluations | |
CN110399396B (en) | Efficient data processing | |
CN107357915A (en) | A kind of date storage method and system | |
CN103455575A (en) | Method and device for statistic analysis of data | |
TWI522827B (en) | Real-time storage and real-time reading of huge amounts of data for non-related databases | |
US11663164B2 (en) | Performing file-based time series management | |
Han et al. | An architecture of real-time, historical database system for industrial process control and monitoring | |
CN112380783B (en) | Industrial big data real-time acquisition and analysis method based on three-dimensional modeling simulation software | |
CN206557772U (en) | A kind of time of things describes system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A201 | Request for examination | ||
E601 | Decision to refuse application | ||
E601 | Decision to refuse application |