CN112134927A - Power grid data exchange platform and data exchange method based on plug-in mode - Google Patents
Power grid data exchange platform and data exchange method based on plug-in mode Download PDFInfo
- Publication number
- CN112134927A CN112134927A CN202010871735.7A CN202010871735A CN112134927A CN 112134927 A CN112134927 A CN 112134927A CN 202010871735 A CN202010871735 A CN 202010871735A CN 112134927 A CN112134927 A CN 112134927A
- Authority
- CN
- China
- Prior art keywords
- data
- plug
- module
- power grid
- output
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 16
- 238000012545 processing Methods 0.000 claims abstract description 71
- 230000003993 interaction Effects 0.000 claims abstract description 10
- 238000007726 management method Methods 0.000 claims description 39
- 238000003860 storage Methods 0.000 claims description 16
- 230000002452 interceptive effect Effects 0.000 claims description 13
- 238000012544 monitoring process Methods 0.000 claims description 13
- 230000006870 function Effects 0.000 claims description 10
- 230000002159 abnormal effect Effects 0.000 claims description 9
- 238000004891 communication Methods 0.000 claims description 9
- 238000013500 data storage Methods 0.000 claims description 3
- 238000013439 planning Methods 0.000 claims description 2
- 238000006243 chemical reaction Methods 0.000 abstract description 13
- 238000001914 filtration Methods 0.000 abstract description 11
- 238000004140 cleaning Methods 0.000 abstract description 10
- 238000010586 diagram Methods 0.000 description 10
- 238000004590 computer program Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 238000012216 screening Methods 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013479 data entry Methods 0.000 description 1
- 238000013523 data management Methods 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/14—Details of searching files based on file metadata
- G06F16/148—File search processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
- G06Q50/06—Electricity, gas or water supply
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/51—Discovery or management thereof, e.g. service location protocol [SLP] or web services
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Economics (AREA)
- Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Human Resources & Organizations (AREA)
- Data Mining & Analysis (AREA)
- Library & Information Science (AREA)
- Public Health (AREA)
- Water Supply & Treatment (AREA)
- General Health & Medical Sciences (AREA)
- General Engineering & Computer Science (AREA)
- Marketing (AREA)
- Primary Health Care (AREA)
- Strategic Management (AREA)
- Tourism & Hospitality (AREA)
- General Business, Economics & Management (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses a power grid data exchange platform and a data exchange method based on a plug-in mode. The data input module of the invention provides different types of data input plug-ins aiming at different types of data sources, and the data output module provides different types of data output plug-ins aiming at different types of data output. The data processing module supports processing modes except filtering cleaning and correlation conversion. Through a plug-in mode, the data exchange platform has high expandability; the invention provides a unified data exchange service, forms a power grid service data exchange hub and meets the data interaction requirements among systems.
Description
Technical Field
The invention belongs to the technical field of automatic power grid data management of a power system, and relates to a power grid data exchange platform and a data exchange method based on a plug-in mode.
Background
After years of operation, the power grid regulation and control system accumulates abundant operation data including measurement data, event data, plan prediction data, electric quantity data and the like. Data of the power grid service system are isolated in different systems such as EMS, OMS, TMR and the like, and a data sharing mechanism of cross-specialty, cross-unit and cross-service is lacked, so that an information island is formed. The external interaction data of the regulation and control center lacks a uniform platform for external release, specific interaction interfaces need to be developed by each service system according to different requirements, the external interaction modes and data formats are different, the manual maintenance cost is increased, meanwhile, the interaction mechanism is not strong in generality and flexibility, the use and maintenance are not convenient enough, and the service cooperation efficiency is influenced.
Therefore, a data exchange platform needs to be established, a uniform data exchange service is provided, a power grid service data exchange hub is formed, and the data interaction requirements among systems are met.
Disclosure of Invention
The utility model provides a power grid data exchange method based on plug-in mode, to the data input of different type sources and different type data output, use different data input plug-in components and data output plug-in components, realize the exchange between the heterogeneous system of power grid data, promote the sharing service ability of power grid data, effectively provide all kinds of data supports for all kinds of power grid services.
In order to realize the technical scheme, the invention adopts the following technical scheme.
In one aspect, the present invention provides a power grid data exchange platform based on a plug-in mode, including: the system comprises a data processing module, a data input module, a data output module and a configuration management module;
the data input module comprises data input plug-ins respectively corresponding to different data input modes; the data input plug-in is used for connecting an external database to realize the data acquisition of an external service system; the data processing module comprises data processing plug-ins, and the data processing plug-ins are used for processing the data acquired by the data input module;
the data output module comprises data output plug-ins respectively corresponding to different data output modes, and the data output plug-ins are used for writing the data processed by the data processing module into a target system according to a preset data output rule;
the configuration management module is used for configuring data output rules, setting configuration information of storage positions and acquisition modes of various data sources, and setting configuration information of mutual correlation among the data input module, the data processing module, the data output module and interactive operation, and the configuration management module calls the data input module, the data processing module and the data output module to run data interactive tasks and manage the data interactive tasks according to the configuration information.
Further, processing the data comprises filtering and cleaning, converting the data of the same type and calculating a logic rule;
further, the data input mode comprises a message communication mode, a file exchange mode and a service calling mode.
Further, the power grid data exchange platform further comprises a storage module, wherein the storage module is used for storing the data of the external service system acquired by the data input module; and the data input module calls a data storage system interface to store data after acquiring and analyzing the data.
Further, the configuration management module is further configured to perform unified configuration management on various data sources, data topics, and data ranges, where the data topics are determined according to the service types of the data.
Still further, the service type of the data includes: model data, metrology data, electrical quantity data, alarm data, fault and event data, planning data, forecast data, and/or meteorological environment operating data.
Further, the configuration management module manages the interactive operation, specifically including monitoring the execution condition of the exchange work, the abnormal alarm condition and/or the operation statistical condition.
Further, the data input plug-in and the data output plug-in support an RDBMS database, a CIME file, a message and/or a service restful interface.
Further, the system also comprises an intermediate file management module which is used for managing the intermediate file
The system is used for managing intermediate files generated when the data input module, the data processing module and/or the data output module work, wherein the files belong to internal temporary files of system operation.
Furthermore, the data output module is also used for supporting functions of browsing and downloading data contents before data exchange.
In a second aspect, the invention provides a plug-in mode based power grid data exchange method, which comprises the following steps:
inputting configuration information of data output rules, storage positions and acquisition modes of various data sources, and inputting configuration information of mutual correlation among the data input module, the data processing module, the data output module and the interactive operation;
calling a data input plug-in according to the configuration information to connect an external database, and realizing data acquisition of an external service system; processing the data acquired by the data input module by using the data processing plug-in;
and writing the data processed by the data processing plug-in into the target system by using the data output plug-in according to a preset output rule.
The invention has the following beneficial technical effects:
1. the data input module of the invention provides different types of data input plug-ins aiming at different types of data sources, and the data output module provides different types of data output plug-ins aiming at different types of data output. The data processing module realizes data processing through various data processing plug-ins. Through the plug-in mode, the data exchange platform has high expandability, provides uniform data exchange service, forms a power grid service data exchange hub and meets the data interaction requirements among systems. (ii) a
2. The invention has the advantages that the data output mode except the relational database, the message communication, the file exchange and the service call is supported, the data input mode except the relational database, the message communication, the file exchange and the service call is supported, and the data exchange problem before the heterogeneous cross-platform system is solved through the technologies of relational database connection, the message communication, the file exchange, the service call and the like;
3. by means of the data exchange operation management function, the real-time monitoring of the operation states of the data input, data processing and data output links of data exchange is realized, and the stable and reliable operation of the data exchange is effectively improved.
Drawings
FIG. 1 is a system block diagram of an embodiment of the present invention;
fig. 2 is a flowchart of data exchange operation of the data exchange platform according to the embodiment of the present invention.
FIG. 3 is a flowchart of the operation of the data entry plug-in for the relational database according to the embodiment of the present invention.
FIG. 4 is a flowchart of the operation of a data processing plug-in according to an embodiment of the present invention.
FIG. 5 is a flowchart of the data export plug-in workflow of the relational database, as embodied by the invention.
Detailed Description
The invention is further described below with reference to the figures and the specific examples.
The first embodiment provides a power grid data exchange platform based on a plug-in mode, which includes: the system comprises a data processing module, a data input module, a data output module and a configuration management module;
the data input module comprises data input plug-ins respectively corresponding to different data input modes; the data input plug-in is used for connecting an external database to realize the data acquisition of an external service system; the data processing module comprises data processing plug-ins, and the data processing plug-ins are used for processing the data acquired by the data input module;
the data output module comprises data output plug-ins respectively corresponding to different data output modes, and the data output plug-ins are used for writing the data processed by the data processing module into a target system according to a preset data output rule;
the configuration management module is used for configuring data output rules, setting configuration information of storage positions and acquisition modes of various data sources, and setting configuration information of mutual correlation among the data input module, the data processing module, the data output module and interactive operation, and the configuration management module calls the data input module, the data processing module and the data output module to run data interactive tasks and manage the data interactive tasks according to the configuration information.
In a specific embodiment, the data input mode includes a message communication mode, a file exchange mode and a service calling mode. Different acquisition modes such as message communication, file exchange, service call and the like correspond to a plug-in, such as a message communication data input plug-in and a file exchange data input plug-in.
And message communication, wherein the data input end organizes the data to be exchanged into a message according to the specification, and the data output end subscribes to receive the message to complete data exchange.
And file exchange, wherein the data input end organizes the data to be exchanged into a common E file of the power system according to the specification, and the data output end receives the file to complete data exchange.
And (4) service calling, wherein the data source system provides data service, and the data target system calls the data service to acquire data to complete data exchange.
The data input plug-in realizes reading data from the source end system, can be connected with a source end system database through a connector, generates a data query SQL statement according to the configuration information of the data input plug-in, and simultaneously assembles a query execution return result into an abstract data set by using a self-defined data type to transmit the abstract data set to the data processing module.
In a specific embodiment, the data input plug-in can read data from the CIME file, read data from the specified CIME file line by line, and perform corresponding filtering condition screening to extract the data from the file.
The data input plug-in can obtain the data of the subscription theme from the message server, connect to the appointed message server cluster, consume the subscription data from the appointed theme, carry out corresponding filtering condition screening, extract the data from the message server.
The data input plug-in component can send an http request according to the specified request type, the request URL and the request body, and obtain the request return data. And screening according to the configured query conditions, and assembling a query execution return result into an abstract data set by using a self-defined data type (namely a file service internal data type structure) and transmitting the abstract data set to the data processing module.
The data processing plug-in processes the data acquired by the data input plug-in. Optionally, filtering cleaning and conversion of data of the same type and calculation of logic rules are implemented by different data processing plug-ins. In particular embodiments, the data processing plug-ins include a filter plug-in, a wash plug-in, an association plug-in, and a conversion plug-in (as shown in FIG. 4). The four types of data processing plug-ins are configured during task definition and are uniformly scheduled and executed by the switching platform. The filtering and cleaning plug-in filters out the data which do not meet the requirements according to certain conditions, wherein the data which do not meet the requirements mainly comprise three categories of incomplete data, wrong data and repeated data. Incomplete data, characterized by some missing information that should be; the error data is generated because the service system is not healthy enough and is not judged after receiving the input and is directly written into the background database; duplicate data, the system has the same data or the constraint primary key has the same data.
The association conversion plug-in mainly performs inconsistent data conversion, conversion of data granularity and calculation of some logic rules. Inconsistent data conversion is an integrated process, and unifies the data of the same type of different business systems. In the conversion of data granularity, the business system generally stores very detailed data, while the data in the target system is used for analysis, and the business system data is aggregated according to the data granularity of the target system without the need of the very detailed data. And (4) calculating the logic rule, wherein different systems have different business rules.
And the data output plug-in writes the data passing through the data processing plug-in into the target system. And the data output plug-in is connected with the target system database, and writes the processed data into the target system database according to a preset data output rule. The configured output rule is a rule for data output and is configured when task definitions are exchanged. The data to be output need not be stored. Each data output plug-in has a specific form, such as database output, file output and the like. And selecting a data output mode according to the target end system. Optionally, the data output rules are used to describe data ranges, output modes, output periods, and the like, and each rule may form a group of data sets. The output rule needs to meet the output requirements of different types of data, and an output rule basis is provided for data output. Optionally, the data output plug-in supports data query and downloading and browsing output data content, can show data exchange content in detail, and provides functions of data browsing and data downloading.
The data output plug-ins corresponding to different data output modes comprise a database output plug-in, a file output plug-in, a message output plug-in and the like. The data output plug-in supports the selection of a data output mode and the configuration of an exchange target address to send exchange data.
The data output plug-in can write the processed data into a CIME file of the target system.
The data output plug-in is connected with a target system file server (such as FTP and SFTP), creates a file on the server, and then writes the processed data into the file according to the configuration rule.
The data output plug-in can send the processed data to the target system message server through messages. The data output inquiry is connected with a target system message server through a message interface, and the processed data is sent to a specified message subject.
The data output plug-in may write data to the target system by invoking the data services of the target system. And the data output plug-in writes the data into the target system through the HTTP request according to the specified URL and the format of the request body.
In this embodiment, the configuration management implements unified configuration of information such as data input and data output, and provides unified management for data exchange. The data input realizes the expandability of the data sources, and the configuration management is carried out on the storage positions, the acquisition modes, the association relations and the like of various data sources.
The configuration management module configures the relevant information and then the exchange platform automatically schedules and executes the relevant information.
Optionally, in an embodiment, the configuration management module manages data interaction tasks (i.e., data interaction jobs). In a specific embodiment, the managing optionally includes: exchange monitoring, abnormal alarm and operation condition statistics.
And the data exchange platform records the running states of all links of data input, data processing and data output. The exchange monitoring includes functions of performance monitoring, abnormal alarming, operation statistics, and the like. The execution condition monitoring includes operation monitoring, control and the like on the data exchange condition. And monitoring and recording the data output and control conditions, and reflecting the data exchange operation conditions in real time.
The abnormal alarm is used for displaying the abnormal state of the data exchange platform in real time, and pushing and displaying various abnormal information of the data exchange platform in real time.
The running condition statistics can be carried out according to the execution condition of each data exchange task, and the running state, the abnormal condition and the like are analyzed.
Optionally, the configuration management module performs classification management on the data acquired by the data input module, and the types of the data include, but are not limited to, model data, measurements, power, alarms, faults and events, plans, forecasts, meteorological environment and other operation data.
The configuration management module is further configured to: firstly, all tasks in the system are managed according to the exchange tasks, and then different data input, data processing, data output and exchange jobs corresponding to different exchange tasks are managed.
Optionally, the power grid data exchange platform further includes a storage module, where the storage module is configured to store the data of the external service system, which is acquired by the data input module; and the data input module calls a data storage system interface to store data after acquiring and analyzing the data.
And the configuration management module manages the data exchange task of the data exchange operation. The data exchange operation comprises data input, data processing and data output, and the management of the exchange operation is to manage the relevant links of the data exchange. The exchange task management comprises the management of the exchange task configuration and the job running state, and the proposal, deletion, starting, stopping, suspending, resuming, the designation of a running node and the like of the job can be carried out. The exchange task monitoring information comprises the operation conditions of each link of data input, data processing and data output, and comprises operation logs, abnormal information and the like.
The invention adopts a cross-platform serialization technology to realize shared message, exchange files and data service among power grid heterogeneous systems. The data processing part in the data exchange provides functions of data cleaning, data filtering, data conversion, data association and the like in a plug-in mode, and the flexibility of data exchange processing is effectively improved.
On the basis of the above embodiment, the platform further includes an intermediate file management module (as shown in fig. 1), where the intermediate file management module is configured to manage intermediate files generated by the data input module, the data processing module, and the data output module during operation, and the files belong to internal temporary files of system operation.
The metadata of fig. 1 is internal configuration information related to data exchange, including information of input plug-ins, output plug-ins, and the like.
In a second embodiment, based on the power grid data exchange platform based on the plug-in mode provided in the above embodiments, the present embodiment provides a power grid data exchange method based on the plug-in mode, and a flow diagram is shown in fig. 2, and includes the following steps:
1. data exchange configuration management: inputting configuration information of data output rules, storage positions and acquisition modes of various data sources, and inputting configuration information of mutual association among the data input module, the data processing module, the data output module and the interactive operation. The data exchange configuration management comprises data input plug-in configuration, data processing plug-in configuration, data output plug-in configuration and exchange operation configuration. The exchange job management generates a data exchange job based on the data exchange configuration information.
2. And (3) generating exchange operation: the exchange job management generates a data exchange job based on the data exchange configuration information.
3. The swap job (i.e., swap task) runs: the exchange operation management calls a data input plug-in, a data processing plug-in and a data output plug-in according to the generated exchange operation and the related configuration parameters, and the exchange operation monitoring module monitors the operation condition of the exchange operation in real time.
Calling a data input plug-in according to the configuration information to connect an external database, and realizing data acquisition of an external service system; the data processing plug-in is used for filtering and cleaning the data acquired by the data input module, converting the data of the same type and calculating a logic rule;
and writing the data processed by the data processing plug-in into the target system by using the data output plug-in according to a preset output rule.
Fig. 3 is a data input plug-in workflow of the relational database, which mainly includes the following steps:
1) the data input Reader plug-in of the relational database is connected to a remote database through a JDBC connector; 2) generating a data query SQL statement according to the configuration information of the data input Reader plug-in; 3) the query SQL statement is mainly generated according to a table name, a domain name and a retrieval condition in the configuration information; 4) the data input Reader plug-in uses the generated SQL statement to search data in a database; 5) and assembling SQL execution return results into an abstract data set by using data types defined by a data exchange platform.
Fig. 4 is a data processing plug-in workflow, which mainly includes the following steps: 1) obtaining an internal abstract data set from a data input plug-in; 2) calling a data processing plug-in instance according to the configuration information of the data processing plug-in; 3) and transferring the new internal abstract data set processed by the data processing plug-in to the data output plug-in.
Fig. 5 is a workflow of a data output plug-in of a relational database, which mainly includes the following steps: 1) a data output plug-in of the relational database acquires an internal abstract data set of the data exchange platform; 2) converting the internal abstract data set into a submitted database SQL statement according to the configuration information of the data input plug-in; 3) establishing connection with a remote database according to a configuration system of a data input plug-in target end database; 4) and submitting and storing the data in a remote database through a database JDBC access interface.
The data exchange platform related to the invention is realized by combining with the independent development working in an application layer, does not depend on a specific operating system, and is suitable for various operating systems. The operation mode of the data exchange platform related by the invention ensures the portability, and can stably operate on the operation system platforms such as IBM AIX, Sun Solaris, Alpha Tru64, HPUX, Linux, Windows and the like; the system programming language adopts ANSI C/C + +/Java.
The exchange process provided by the method of the invention comprises the following steps: the data input plug-in supports a common RDBMS database, a CIME file, a message and a service restful interface.
Optionally, different plug-ins are provided to support different interfaces. And filling a data source and a cleaning conversion rule for the data in the page, issuing the data source and the cleaning conversion rule to a background, and starting data exchange operation by the background. And reading data from the source end system by using the data input plug-in, performing associated filtering, cleaning, filtering and conversion on the data according to a cleaning rule, a filtering rule, an association rule and a conversion rule of the data exchange task, and finally writing the final data into the target end by using the data output plug-in.
The invention provides a power grid data exchange method based on a plug-in mode, which utilizes a data input plug-in, a data processing plug-in, a data output plug-in and an exchange operation management technology to realize efficient and rapid exchange of power grid data and provide data exchange support for various power grid services.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (10)
1. Power grid data exchange platform based on plug-in mode, its characterized in that includes: the system comprises a data processing module, a data input module, a data output module and a configuration management module;
the data input module comprises data input plug-ins respectively corresponding to different data input modes; the data input plug-in is used for connecting an external database to realize the data acquisition of an external service system; the data processing module comprises data processing plug-ins which are respectively used for processing the data acquired by the data input module;
the data output module comprises data output plug-ins respectively corresponding to different data output modes, and the data output plug-ins are used for writing the data processed by the data processing module into a target system according to a preset data output rule;
the configuration management module is used for configuring data output rules, setting configuration information of storage positions and acquisition modes of various data sources, and setting configuration information of mutual correlation among the data input module, the data processing module, the data output module and interactive operation, and the configuration management module calls the data input module, the data processing module and the data output module to run data interactive tasks and manage the data interactive tasks according to the configuration information.
2. The plug-in based power grid data exchange platform according to claim 1, wherein the data input means comprises message communication, file exchange and service invocation means.
3. The power grid data exchange platform based on the plug-in mode according to claim 1, further comprising a storage module, wherein the storage module is used for storing the data of the external service system acquired by the data input module; and the data input module calls a data storage system interface to store data after acquiring and analyzing the data.
4. The plug-in based power grid data exchange platform according to claim 1, wherein the configuration management module is further configured to perform unified configuration management on various data sources, data themes, and data ranges, and the data themes are determined according to the service types of the data.
5. The plug-in based power grid data exchange platform according to claim 2, wherein the service type of the data includes: model data, metrology data, electrical quantity data, alarm data, fault and event data, planning data, forecast data, and/or meteorological environment operating data.
6. The plug-in based power grid data exchange platform according to claim 1, wherein the configuration management module is further configured to monitor a data interaction task, specifically including monitoring an exchange work execution condition, monitoring an abnormal alarm condition, and/or monitoring an operation statistic condition.
7. The plug-in based power grid data exchange platform according to claim 1, wherein the data input plug-in and the data output plug-in support an RDBMS database, a CIME file, a message or a service restful interface.
8. The plug-in based power grid data exchange platform according to claim 1, further comprising an intermediate file management module, wherein the intermediate file management module
The system comprises a data input module, a data processing module and a data output module, wherein the data input module is used for inputting data, the data processing module is used for processing the data, and the data output module is used for outputting the data.
9. The plug-in based power grid data exchange platform according to claim 1, wherein the data output module is further configured to support browsing and downloading functions on data content before data exchange.
10. The power grid data exchange method based on the plug-in mode is characterized by comprising the following steps:
inputting configuration information of data output rules, storage positions and acquisition modes of various data sources, and inputting configuration information of mutual correlation among the data input module, the data processing module, the data output module and the interactive operation;
calling a data input plug-in according to the configuration information to connect an external database, and realizing data acquisition of an external service system; processing the data acquired by the data input module by using the data processing plug-in;
and writing the data processed by the data processing plug-in into the target system by using the data output plug-in according to a preset output rule.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010871735.7A CN112134927A (en) | 2020-08-26 | 2020-08-26 | Power grid data exchange platform and data exchange method based on plug-in mode |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010871735.7A CN112134927A (en) | 2020-08-26 | 2020-08-26 | Power grid data exchange platform and data exchange method based on plug-in mode |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112134927A true CN112134927A (en) | 2020-12-25 |
Family
ID=73848549
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010871735.7A Pending CN112134927A (en) | 2020-08-26 | 2020-08-26 | Power grid data exchange platform and data exchange method based on plug-in mode |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112134927A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104699723A (en) * | 2013-12-10 | 2015-06-10 | 北京神州泰岳软件股份有限公司 | Data exchange adapter and system and method for synchronizing data among heterogeneous systems |
| CN106682036A (en) * | 2015-11-11 | 2017-05-17 | 上海汽车集团股份有限公司 | Data exchange system and exchange method thereof |
| CN108334547A (en) * | 2017-12-27 | 2018-07-27 | 中电科华云信息技术有限公司 | Data share exchange System and method for based on big data |
| CN109857808A (en) * | 2019-01-28 | 2019-06-07 | 南瑞集团有限公司 | Longitudinal data synchronization system and method based on neutral data structure |
| CN111061788A (en) * | 2019-11-26 | 2020-04-24 | 江苏瑞中数据股份有限公司 | Multi-source heterogeneous data conversion integration system based on cloud architecture and implementation method thereof |
-
2020
- 2020-08-26 CN CN202010871735.7A patent/CN112134927A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104699723A (en) * | 2013-12-10 | 2015-06-10 | 北京神州泰岳软件股份有限公司 | Data exchange adapter and system and method for synchronizing data among heterogeneous systems |
| CN106682036A (en) * | 2015-11-11 | 2017-05-17 | 上海汽车集团股份有限公司 | Data exchange system and exchange method thereof |
| CN108334547A (en) * | 2017-12-27 | 2018-07-27 | 中电科华云信息技术有限公司 | Data share exchange System and method for based on big data |
| CN109857808A (en) * | 2019-01-28 | 2019-06-07 | 南瑞集团有限公司 | Longitudinal data synchronization system and method based on neutral data structure |
| CN111061788A (en) * | 2019-11-26 | 2020-04-24 | 江苏瑞中数据股份有限公司 | Multi-source heterogeneous data conversion integration system based on cloud architecture and implementation method thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112396404A (en) | Data center system | |
| CN107103064B (en) | Data statistical method and device | |
| CN103441900A (en) | Centralization cross-platform automated testing system and control method thereof | |
| CN111694888A (en) | Distributed ETL data exchange system and method based on micro-service architecture | |
| CN114925045B (en) | PaaS platform for big data integration and management | |
| CN111881192A (en) | Method and system for generating visual configuration report, electronic equipment and storage medium | |
| CN111061788A (en) | Multi-source heterogeneous data conversion integration system based on cloud architecture and implementation method thereof | |
| CN115934680B (en) | One-stop big data analysis processing system | |
| CN111984709A (en) | Visual big data middle station-resource calling and algorithm | |
| CN115374102A (en) | Data processing method and system | |
| CN112379884A (en) | Spark and parallel memory computing-based process engine implementation method and system | |
| US8862637B2 (en) | Generating data access operations based on a data model using a data services model | |
| CN113642299A (en) | One-key generation method based on power grid statistical form | |
| CN112817958A (en) | Electric power planning data acquisition method and device and intelligent terminal | |
| CN111913933A (en) | Power grid historical data management method and system based on unified support platform | |
| CN101937334A (en) | Calculation support method and system | |
| CN117149873A (en) | Data lake service platform construction method based on flow batch integration | |
| CN111460772A (en) | Automatic report processing method and system | |
| CN112134927A (en) | Power grid data exchange platform and data exchange method based on plug-in mode | |
| CN115237989A (en) | Mine data acquisition system | |
| CN114218216A (en) | Resource management method, device, equipment and storage medium | |
| CN114661693A (en) | Data auditing realization method, storage medium, electronic equipment and system | |
| Mordinyi et al. | Evaluating software architectures using ontologies for storing and versioning of engineering data in heterogeneous systems engineering environments | |
| CN111435466A (en) | Integrated machine room operation and maintenance management system | |
| CN110928938B (en) | Interface middleware system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |