KR20210055166A - Energy TOC platform distributed processing system - Google Patents

Abstract

The present invention relates to an integrated energy control system (TOC platform) distributed processing system and, more specifically, an integrated energy control system (TOC platform) distributed processing system which stores and processes various data such as energy IoT data, various sensor data, open data and the like in one system and generates and monitors a parallel data structure and stores it as big data so as to guarantee data access in the same environment as a single server.

Description

Energy TOC platform distributed processing system {Energy TOC platform distributed processing system}

The present invention relates to an energy integrated control system (TOC platform) distributed processing system, and more specifically, energy data, various sensor data, and open data, etc., by storing and processing various data in a single system and processing data in the same environment as a single server. It relates to an energy integrated control system (TOC platform) distributed processing system that can create and monitor a parallel data structure to ensure access and store it as big data.

IoT-based energy services are expected to evolve into intelligent services through interactive/user-centered/real-time data analysis.To support this smoothly, the scope of application of each technology for efficient collection, management, and analysis of information from the initial stage and It is important to develop a system that fully reflects the characteristics of energy IoT by understanding the characteristics.

However, the current domestic power system is operated as a closed network, and it is evolving through some smart grids, but it is currently stagnant due to the establishment and operation of a standardized service-oriented infrastructure.

In particular, it is necessary to fundamentally improve the power sector network, which is difficult to accommodate IoT technologies aimed at a hyperconnected society.

In addition, in order to develop an interactive energy IoT device that efficiently recognizes wasted energy using IoT technology, intelligent Energy Aware technology, IoT technology-based energy saving, user-oriented energy IoT reduction system construction, and collection from various IoT entities. The development of IoT energy big data analysis platform for real-time/intelligent processing/analysis of big data and IoT-Waste saving operation technology for energy-efficient operation of multiple IoT entities are key issues.

The present invention was conceived to solve the above-described problem, and an object of the present invention is to ensure data access in the same environment as a single server by storing and processing various data such as energy data, various sensor data, and open data in one system. It is to provide an energy integrated control system (TOC platform) distributed processing system that enables monitoring by creating parallel data structures.

In order to achieve the above object, the present invention includes a data collection module for receiving energy IoT data, sensor data, and open data and recording them as an MG data file; A pre-processing module for receiving the MG data file and recording it in an Hbase channel or a real-time analysis channel; A data storage module for receiving and storing MG data of the Hbase channel from the preprocessing module; And a real-time monitoring module that receives MG data of the real-time analysis channel from the pre-processing module and processes a real-time analysis message.

In a preferred embodiment, the data collection module includes: a front-end processor (FEP) for recording received sensor data in an MG data file in communication with a PDC; MG database for storing MG data; Change data collector that monitors MG data and collects changes when contents change; And an MG data collection agent that transmits the data received from the change data collector to the preprocessing module.

In a preferred embodiment, the preprocessing module includes: a message source collector for receiving an MG data file from the MG data collection agent and recording it in the Hbase channel or the real-time analysis channel; An Hbase storage unit for storing the MG data of the Hbase channel in the data storage module; And a real-time analyzer transmitter for transferring the MG data of the real-time analysis channel to the real-time monitoring module.

In order to achieve the above object, the present invention includes a data collection module for receiving energy IoT data, sensor data, and open data and recording them as an MG data file; A pre-processing module for receiving the MG data file and recording it in an Hbase channel or a real-time analysis channel; A data storage module for receiving and storing MG data of the Hbase channel from the preprocessing module; And a real-time monitoring module that receives MG data of the real-time analysis channel from the pre-processing module and processes a real-time analysis message.

In a preferred embodiment, the data collection module includes: a front-end processor (FEP) for recording received sensor data in an MG data file in communication with a PDC; MG database for storing MG data; Change data collector that monitors MG data and collects changes when contents change; And an MG data collection agent that transmits the data received from the change data collector to the preprocessing module.

In a preferred embodiment, the preprocessing module includes: a message source collector for receiving an MG data file from the MG data collection agent and recording it in the Hbase channel or the real-time analysis channel; An Hbase storage unit for storing the MG data of the Hbase channel in the data storage module; And a real-time analyzer transmitter for transferring the MG data of the real-time analysis channel to the real-time monitoring module.

The present invention has the following excellent effects.

According to the energy integrated control system (TOC platform) distributed processing system of the present invention, data such as energy IoT data, various sensor data, and open data are stored and processed in one system to ensure data access in the same environment as a single server. It has the advantage of being able to process parallel data.

1 is a diagram showing a connection environment of an integrated energy control system (TOC platform) distributed processing system according to an embodiment of the present invention;
2 is a configuration diagram of an integrated energy control system (TOC platform) distributed processing system according to an embodiment of the present invention,
3 is a configuration diagram of a data collection module of the integrated energy control system (TOC platform) distributed processing system according to an embodiment of the present invention,
4 is a block diagram of a pre-processing module of the integrated energy control system (TOC platform) distributed processing system according to an embodiment of the present invention.

As for the terms used in the present invention, general terms that are currently widely used are selected, but in certain cases, there are terms arbitrarily selected by the applicant.

Hereinafter, the technical configuration of the present invention will be described in detail with reference to preferred embodiments shown in the accompanying drawings.

However, the present invention is not limited to the embodiments described herein and may be embodied in other forms. The same reference numerals denote the same elements throughout the specification.

The integrated energy control system (TOC platform) distributed processing system according to an embodiment of the present invention is capable of storing and processing various data such as energy IoT data, sensor data, and open data in a single system in a parallel data structure to be monitored. System.

1 is a diagram showing a connection environment of an integrated energy control system (TOC platform) distributed processing system according to an embodiment of the present invention, and FIG. 2 is a diagram illustrating an integrated energy control system (TOC platform) distributed processing according to an embodiment of the present invention. Configuration diagram of the system, Figure 3 is a configuration diagram of a data collection module of the integrated energy control system (TOC platform) distributed processing system according to an embodiment of the present invention, Figure 4 is an integrated energy control system according to an embodiment of the present invention (TOC platform) This is the configuration diagram of the preprocessing module of the distributed processing system.

Referring to FIG. 1, the integrated energy control system (TOC platform) distributed processing system 100 according to an embodiment of the present invention receives various data such as collection and open data for collecting various data for energy field services.

In addition, referring to FIG. 2, the integrated energy control system (TOC platform) distributed processing system 100 includes a data collection module 110, a pre-processing module 120, a data storage module 130, and a real-time monitoring module 140. It is made including.

The data collection module 110 receives IoT data, sensor data, and open data from the collection nodes 10 and records them as an MG data file.

In addition, the data collection module 110 distributes collection targets to each node to simultaneously store the same table name and different table names between nodes, thereby enabling parallel data query processing.

In addition, it is possible to add parallel nodes during operation or delete and reconfigure the data source of a specific area from another node. When performing a summary or search for a specific period, queries are executed in a refined form for each node, and Only results can be sent.

In addition, when the data throughput itself is too large to perform processing, and when the accumulated data exceeds the physical expansion space of a single server, logically set the master node (query node) to which the user will access, and distribute the nodes.

Further, referring to FIG. 3 in more detail, the data collection module 110 includes a front-end processor (FEP) 111, an MG database 112, a change data collector 113, and an MG data collection agent 114. It is made including.

The data collection module 110 communicates with the PDC and records the received sensor data in the MG data file.

In addition, the MG database 112 is a storage for storing MG data.

In addition, the change data collector 113 monitors MG data, collects changes when contents change, and transmits them to the MG data collection agent 114.

In addition, the MG data collection agent 114 transmits the MG data received from the change data collector 113 to the preprocessing module 120 to be described below.

The preprocessing module 120 receives the MG data file from the data collection module 110 and records it in an Hbase channel or a real-time analysis channel.

Further, referring to FIG. 4, the preprocessing module 120 includes a message source collector 121, an Hbase channel 122, a real-time analysis channel 123, an Hbase storage 124, and a real-time analyzer transmitter 125. It is made including.

The message source collector 121 receives an MG data file from the MG data collection agent 114 and records it in the Hbase channel 122 or the real-time analysis channel 123.

In addition, the Hbase channel 122 is an MG data queue that needs to be stored.

In addition, the real-time analysis channel 123 is an MG data queue requiring real-time analysis.

In addition, the Hbase storage 124 transmits the data stored in the Hbase channel 122 to the data storage module below, and guarantees a multi-row transaction.

In addition, the real-time analyzer transmitter 125 transmits the MG data of the real-time analysis channel 123 to the real-time monitoring module below.

The data storage module 130 receives the MG data stored in the Hbase storage 124 from the preprocessing module 120 and stores it as big data.

In addition, the MG data is distributed and stored by accessing a queue and processing data of a corresponding topic in parallel.

The real-time monitoring module 140 receives MG data of the real-time analysis channel 122 from the pre-processing module 120 and processes a real-time analysis message.

Therefore, according to the energy integrated control system (TOC platform) distributed processing system according to an embodiment of the present invention, various data such as energy IoT data, various sensor data, and open data are stored and processed in one system to be used with a single server. There is an advantage of being able to process parallel data so that data access is guaranteed in the same environment.

As described above, the present invention has been illustrated and described by way of a preferred embodiment, but is not limited to the above-described embodiment, and those of ordinary skill in the technical field to which the present invention belongs within the scope not departing from the spirit of the present invention. Various changes and modifications will be possible.

100: Integrated energy control system (TOC platform) distributed processing system
110: data collection module 111: FEP (Front-End processor)
112: MG database 113: change data collector
114: MG data collection agent 120: pre-processing module
121: message source collector 122: Hbase channel
123: Real-time analysis channel 124: Hbase storage
125: real-time analyzer transmitter 130: data storage module
140: Real-time monitoring module

Claims (3)

A data collection module that receives energy IoT data, sensor data, and open data and records them in an MG data file;
A preprocessing module for receiving the MG data file and recording it in an Hbase channel or a real-time analysis channel;
A data storage module for receiving and storing MG data of the Hbase channel from the preprocessing module; And a real-time monitoring module that receives MG data of the real-time analysis channel from the pre-processing module and processes a real-time analysis message.
The method of claim 1,
The data collection module,
A front-end processor (FEP) that communicates with the PDC and records the received sensor data in an MG data file;
MG database for storing MG data;
Change data collector that monitors MG data and collects changes when contents change; And
Energy IoT TOC platform distributed processing system comprising a; MG data collection agent for transmitting the data received from the change data collector to the pre-processing module.
The method of claim 2, wherein the pretreatment module:
A message source collector for receiving an MG data file from the MG data collection agent and recording it in the Hbase channel or the real-time analysis channel;
An Hbase storage organ for storing the MG data of the Hbase channel in the data storage module; And
An energy integrated control system (TOC platform) distributed processing system comprising a; a real-time analyzer transmitter that transmits the MG data of the real-time analysis channel to the real-time monitoring module.

Images