CN115757198A - Data set management tool in electric power market settlement system - Google Patents
Data set management tool in electric power market settlement system Download PDFInfo
- Publication number
- CN115757198A CN115757198A CN202211517168.0A CN202211517168A CN115757198A CN 115757198 A CN115757198 A CN 115757198A CN 202211517168 A CN202211517168 A CN 202211517168A CN 115757198 A CN115757198 A CN 115757198A
- Authority
- CN
- China
- Prior art keywords
- data
- data source
- electric power
- settlement system
- power market
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a data set management tool in an electric power market settlement system, which is applied to the design and development of an electric power business technology support system and comprises the following steps: a data source configuration module: the system is used for dynamically modeling basic, original and fine-grained settlement data in a database table of the electric power market settlement system according to actual settlement business or function needs to form a universal dynamic data model in the electric power market system; the data source field setting module: the method comprises the steps of defining fields of data in a configured data source and setting constraint conditions; the data source mapping module: and the method is used for storing the final result of the obtained data through the set mapping relation after the data source is analyzed, calculated and checked. The invention can realize dynamic modeling of settlement data by configuring the data set, and is suitable for the characteristic that the statistical analysis service requirement of the power information system is variable.
Description
Technical Field
The invention belongs to the field of electric power information systems, and particularly relates to a data set management tool in an electric power market settlement system.
Background
With the continuous construction of power information systems, more and more production and operation data are used for operation management and analysis decisions of power enterprises, and the processing, statistical analysis and the like of the primary data have increasingly significant influence on the management and the decisions of the power enterprises. In a common power service technical support system, a data structure is often designed for services, data formats are different, once a service is frequently changed, the previous data format may not be suitable for new service requirements, and an unnecessary workload is newly increased by redesigning a new data model.
Disclosure of Invention
The invention aims to provide a data set management tool in an electric power market settlement system, which aims to overcome the defects in the prior art.
In order to achieve the purpose, the invention adopts the following technical scheme:
a data set management tool in an electric power market settlement system is applied to the design and development of an electric power business technology support system and comprises the following steps:
a data source configuration module: the system is used for dynamically modeling basic, original and fine-grained settlement data in a database table of the electric power market settlement system according to actual settlement business or function needs to form a universal dynamic data model in the electric power market system;
a data source field setting module: the method comprises the steps of defining fields of data in a configured data source and setting constraint conditions;
a data source mapping module: and the method is used for storing the final result of the obtained data through the set mapping relation after the data source is analyzed, calculated and checked.
Further, in the data source configuration module, the dynamic modeling specifically includes: by means of SQL language, the transaction data is modeled uniformly in time dimension, physical dimension and business dimension.
Further, in the dynamic modeling process, the condition of the data source is embodied in the form of parameters, and the data content of the data source can be changed according to the change of different parameters.
Further, in the data source configuration module, after the data source configuration is completed, the configured data source data is read from the database and stored in the memory.
Further, in the data source configuration module, sub-data sources are derived on the basis of configured data sources, and data of the data sources are grouped according to different data in the sub-data sources as conditions.
Further, in the data source field setting module, data in the configured data source is in a form of a line-column two-dimensional table.
Further, the defining the fields of the data in the configured data source specifically includes: each column of data is defined, including a field name definition and a data type definition.
Further, the setting of the constraint condition specifically includes: selecting some fields in the data source to form the constraint condition of the data source.
Further, in the data source mapping module, mapping relationships of fields are established between the data source and between the data source and the storage target.
Furthermore, a plurality of storage targets are correspondingly defined for the same data source, and at least one storage target is defined for storing the data processed by the data source into the result table.
Compared with the prior art, the invention has the following beneficial technical effects:
the tool provided by the invention can realize dynamic modeling of settlement data by configuring the data set by depending on the configurable data source, the self-defined field information and the constraint condition and setting the mapping relation of the data source, and is suitable for the characteristic that the statistical analysis service requirement of the power information system is variable.
Furthermore, the dynamic modeling breaks through the limitation of the inherent data format, through the setting of the data source, a designer can assemble and model the actually required data according to the actual business scene requirement, and process the assembled data through other means such as formula calculation, data analysis and the like.
Furthermore, the invention dynamically models the scattered and fine-grained settlement data in the electric power market settlement system in three dimensions of time dimension, main dimension and business dimension to form a set of universal dynamic data model in the electric power market system. Subsequent formula calculation or other functional modules can directly process the data of the model, if the service or the function is changed, only the data source configuration is needed to be modified, the code is not needed to be frequently modified to change the access logic, and the later maintenance cost of the electric power market settlement system is greatly saved.
Further, after the data source configuration is completed, the data set management tool reads the configured data source data from the database and stores the data in the memory. Each functional module can directly read data in the memory in the operation process of the electric power market settlement system, compared with the traditional method of reading data from a database stored on a hard disk, the efficiency of the system is remarkably improved by reading data from the memory, and after other functional modules process the data, the system can automatically store the final data processing result in the hard disk according to the set mapping relation, so that the reading times of the data of the hard disk are greatly reduced.
Furthermore, the invention can derive the sub-data sources on the basis of the configured data sources besides configuring the data sources required by the service or the function, and the data content of the data sources can be grouped according to different data in the sub-data sources by configuring the sub-data sources, so that the application of the data set management tool becomes flexible and has rich scalability.
Drawings
The accompanying drawings are included to provide a further understanding of the invention, and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention, and together with the description serve to explain the invention and not to limit the invention.
FIG. 1 is a diagram of a data set management tool in the electric power market settlement system according to the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Moreover, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
The invention realizes a data set management tool for the configured data of the electric power market settlement system, namely, basic data support is provided for the application of modules such as formula calculation, data analysis and the like by configuring a data source, setting field definitions and constraint conditions of the data source and configuring mapping results.
The invention realizes the secondary modeling assembly and constraint of scattered operation data in the power system by a method for defining and configuring a data source, can only contain data information needing to be concerned, eliminates all irrelevant field items, reassembles scattered fine-grained settlement data needed in the system and stores the data in a memory, greatly improves the performance and the data processing speed of formula calculation or other data processing functions, and mainly comprises the following functional modules:
(1) And a data source configuration module. Reassembling and modeling (namely, dynamic modeling) basic, original and fine-grained settlement data in a database table in a memory in an SQL (structured query language) mode according to data required by actual settlement business or functions to form a universal dynamic data model in the power market system;
(2) The data source field setting module is used for defining and setting constraint conditions for fields in the data source field according to the set data source;
(3) And the data source mapping module is used for storing the final result of the obtained data in a database appointed table through the set mapping relation after the data source is analyzed, calculated and verified.
Specifically, the invention reduces the dependence on background code development by designing and developing a configurable data management tool based on flexible and variable ideas. The self-defined assembly of the data in the power information system is realized through the configuration of the data source, the definition and constraint condition setting of the data source field and the mapping setting of the data source. When the data processing requirement changes, the data can be assembled according to new logic by only adjusting the configuration information of the data set, and basic data support is provided for processing such as formula calculation, data verification, data quality analysis, settlement source data extraction and the like.
In the data source configuration module, a required data source is defined for settlement data in a database table by specifying the form of an SQL query statement, modeling and assembling are carried out on scattered transaction data with fine granularity again, the condition of the data source can be embodied in the form of parameters, and the data content of a data set can be changed according to the change of different parameters.
In the data source field setting module, data source data is original data and cannot be directly used for subsequent formula calculation and other processing, so that field information of the data needs to be defined and constraint conditions need to be set.
The actual data loaded by the data source is in the form of a row-column two-dimensional table, where each column of data is defined, and includes field names, data types and other information, so as to be used for reference of specified data source field data for subsequent formula definition or other data processing.
The constraint condition setting refers to selecting some fields of a data source to form a constraint condition of the data source (similar to the uniqueness constraint of a setting table in a database), and the setting of the constraint condition can realize the association between different data sets, and can associate a certain data in a data set a with a certain data in a data set b through the same constraint condition.
In the data source mapping module, data persistence is just an opposite process with respect to data loading of the data source. A field mapping relation is needed between the data source and the data source, and the field mapping relation is also needed between the data source and the storage target. Multiple storage targets can be defined under the same data source, but at least one storage target needs to be defined, and data processed by the data source can be saved in a result table.
Interpretation of related terms
Data set: the method is characterized in that data stored in different tables in a database are assembled into data to be used in a database SQL language mode, wherein the data may be a plurality of data or a plurality of data, and the data are collectively called as data sets in a system.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
Finally, it should be noted that: although the present invention has been described in detail with reference to the above embodiments, those skilled in the art will appreciate that various changes, modifications and equivalents can be made in the embodiments of the invention without departing from the scope of the invention as defined by the appended claims.
Claims (10)
1. A data set management tool in an electric power market settlement system is characterized in that the data set management tool is applied to the design and development of an electric power business technology support system and comprises the following components:
a data source configuration module: the system is used for dynamically modeling basic, original and fine-grained settlement data in a database table of the electric power market settlement system according to actual settlement business or function needs to form a universal dynamic data model in the electric power market system;
a data source field setting module: the method comprises the steps of defining fields of data in a configured data source and setting constraint conditions;
a data source mapping module: and the method is used for storing the final result of the obtained data through the set mapping relation after the data source is analyzed, calculated and checked.
2. The tool for managing data sets in a power market settlement system according to claim 1, wherein the dynamic modeling in the data source configuration module is specifically: by means of SQL language, transaction data is modeled uniformly in time dimension, physical dimension and business dimension.
3. The electric power market settlement system of claim 1, wherein in the dynamic modeling process, the condition of the data source is embodied in the form of parameters, and the data content of the data source can be changed according to the change of different parameters.
4. The tool for managing data sets in a power market settlement system of claim 1, wherein the data source configuration module reads configured data source data from the database and stores the data in the memory after completing the configuration of the data source.
5. The data set management tool in the electricity market settlement system according to claim 4, wherein in the data source configuration module, the sub data sources are derived based on the configured data sources, and the data of the data sources are grouped according to different data in the sub data sources as conditions.
6. The tool for managing data sets in a power market settlement system of claim 1, wherein in the data source field setting module, the data in the configured data source is in a form of a line-column two-dimensional table.
7. The data set management tool in the electricity market settlement system according to claim 6, wherein the defining the fields of the data in the configured data source is specifically: each column of data is defined, including a field name definition and a data type definition.
8. The data set management tool in the electricity market settlement system according to claim 7, wherein the setting constraint condition is specifically: selecting some fields in the data source to form the constraint condition of the data source.
9. The data set management tool in the electricity market settlement system according to claim 1, wherein a mapping relationship of fields is established between the data source and between the data source and the storage target in the data source mapping module.
10. The data set management tool in the electric power market settlement system according to claim 9, wherein a plurality of storage objects are correspondingly defined for a same data source, and at least one storage object is defined for storing data processed by the data source into the result table.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211517168.0A CN115757198A (en) | 2022-11-29 | 2022-11-29 | Data set management tool in electric power market settlement system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211517168.0A CN115757198A (en) | 2022-11-29 | 2022-11-29 | Data set management tool in electric power market settlement system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115757198A true CN115757198A (en) | 2023-03-07 |
Family
ID=85341414
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211517168.0A Pending CN115757198A (en) | 2022-11-29 | 2022-11-29 | Data set management tool in electric power market settlement system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115757198A (en) |
-
2022
- 2022-11-29 CN CN202211517168.0A patent/CN115757198A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107908672B (en) | Application report realization method, device and storage medium based on Hadoop platform | |
| CN111159191B (en) | Data processing method, device and interface | |
| CN109857755B (en) | Rule checking method and device | |
| CN102117306A (en) | Method and system for monitoring ETL (extract-transform-load) data processing process | |
| CN104268428A (en) | Visual configuration method for index calculation | |
| CN106293891B (en) | Multidimensional investment index monitoring method | |
| CN108415964A (en) | Tables of data querying method, device, terminal device and storage medium | |
| CN103903086A (en) | Method and system for developing management information system based on service model driving | |
| CN104423968A (en) | Method of designing business logic, server performing the same and storage medium storing the same | |
| CN109299074B (en) | Data verification method and system based on templated database view | |
| CN106886535A (en) | A kind of data pick-up method and apparatus for being adapted to multiple data sources | |
| CN105405070A (en) | Distributed memory power grid system construction method | |
| CN106919697B (en) | Method for simultaneously importing data into multiple Hadoop assemblies | |
| CN109885614A (en) | A kind of method and apparatus that data are synchronous | |
| US11615076B2 (en) | Monolith database to distributed database transformation | |
| CN109669975B (en) | Industrial big data processing system and method | |
| CN110490761A (en) | A kind of power grid distribution net equipment account data model modelling approach | |
| US9292405B2 (en) | HANA based multiple scenario simulation enabling automated decision making for complex business processes | |
| CN105573774A (en) | Application parameter managing and configuring method | |
| CN110599018B (en) | Production task configuration system and method based on MES system | |
| CN105405002A (en) | Formula data configuration method and system based on SAP platform | |
| CN103678591A (en) | Device and method for automatically executing multi-service receipt statistical treatment | |
| CN111190814A (en) | Software test case generation method and device, storage medium and terminal | |
| CN103186384A (en) | Business-component-oriented software designing and analyzing system and using method thereof | |
| CN104346378B (en) | A kind of method, apparatus and system for realizing complex data processing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |