CN105488632A - Method and device for analyzing electric data based on dimensional model - Google Patents

Abstract

The present invention relates to a power data analysis method and device based on a dimensional model, wherein the method includes: establishing a fact table based on fused power data; the fact table includes comprehensive indicators and fact data of the comprehensive indicators; the comprehensive indicators include substations, property rights belonging to Lines of the power supply company, property rights of lines belonging to the user belong to the transformer of the power supply company, transformers and metering boxes that belong to the user; use the fact table to establish a gradual change dimension table and a fast change dimension table corresponding to the comprehensive index; the gradual change dimension table includes stable attribute data and gradually changing attribute data; the fast-changing dimension table includes the identity number of the comprehensive indicator and the fast-changing attribute data; the fast-changing attribute data is the fact data that changes over time corresponding to the identity number of the comprehensive indicator, and the gradually changing attribute data is the identity of the comprehensive indicator The time-varying voltage level data and operating status data corresponding to the identification number; the power data is analyzed based on the gradually changing dimension table and the rapidly changing dimension table.

Description

A method and device for power data analysis based on dimensional model

technical field

The invention relates to the technical field of data processing, in particular to a method and device for analyzing power data based on a dimensional model.

Background technique

At present, the State Grid Corporation of China is carrying out the construction of the battalion, distribution, adjustment and penetration project, realizing the business of supporting fault location, power outage range location, real-time line loss statistics, business expansion report and installation with the sharing of business and distribution data, and promoting the business and distribution business with the integration of business and distribution information Integrate, establish a customer-oriented cross-departmental and cross-professional operation process and service mechanism, fully support 95598 full-service collection, and improve the quality of power supply services.

With the in-depth development of the construction of the marketing business application system and the equipment (asset) operation and maintenance lean management system PMS2.0, the construction of the current marketing business application system and the equipment (asset) operation and maintenance lean management system PMS2.0 has begun to take shape, and the coordinates and attributes of the marketing side and production side equipment have been initially collected Completed, there is still a large demand for data verification, management and timely maintenance of spatial data, attribute data and logical relationships of existing stations-lines-transformers-households. At present, electric power companies urgently need a set of standardized, accurate, safe and efficient data The quality verification tool ensures the integrity, completeness, accuracy and timeliness of the operation data, promotes the practical application of various business systems, and supports the company's integration of operation, allocation and deployment and the informatization construction of smart grids.

Dimension is an important way of data organization in data fusion of marketing and power distribution system. At present, in the data fusion of marketing and power distribution systems, in terms of dimension design, the dimension is generally not related to time, which will affect the query and analysis of historical data by business personnel. In the data fusion process of marketing and power distribution systems, it is necessary to grasp the changes in data dimensions and analyze and process accordingly.

In the marketing and power distribution system database, the fact table is the basic table of inter-system data fusion indicators, which is used to store the fact data of marketing and power distribution business indicators. The dimension table is the entry of the fact table. Through the dimension table, the facts in the fact table The factual data is cut and analyzed. In existing databases, dimensions are treated as time-independent attributes that can be used to classify data.

In the data fusion of marketing and power distribution systems, some dimensions will change over time. If the dimension table has nothing to do with time, only its current attribute value is retained in the dimension table, which will directly affect the initial data and historical change data in the fact table. The disadvantages of this technique are as follows:

(1) The evaluation angle is relatively monotonous and not comprehensive enough.

(2) The evaluation method is greatly influenced by subjective consciousness.

(3) Only the current data quality status is evaluated, without temporal comparison of historical data status, and it is impossible to analyze the marketing and power distribution system data governance status according to the changes of data dimension attributes.

Contents of the invention

In order to solve the problems in the prior art, the present invention proposes a method and device for analyzing power data based on a dimensional model.

To achieve the above object, the present invention provides a method for analyzing power data based on a dimensional model, including:

According to the power data index dimension attributes, use the fused power data to establish a fact table; wherein, the fact table includes comprehensive indicators and the fact data of the comprehensive indicators; the comprehensive indicators include substations, lines whose property rights belong to the power supply company, and property rights that belong to users The property right of the line belongs to the power supply company's transformer, and the property right belongs to the user's transformer and metering box;

Utilize the fact table to establish a gradually changing dimension table and a fast changing dimension table corresponding to the comprehensive index; wherein, the gradually changing dimension table includes stable attribute data and gradually changing attribute data; the fast changing dimension table includes the identification number of the comprehensive index and fast-changing attribute data; the fast-changing attribute data is the time-varying fact data corresponding to the identity identification number of the comprehensive index, and the gradual change attribute data is the voltage level data and the time-varying voltage level data corresponding to the identity identification number of the comprehensive index operating status data;

The power data is analyzed based on the gradually changing dimension table and the rapidly changing dimension table.

Preferably, the fact data of the comprehensive index includes verification progress index data, data integrity index data, data consistency index data, data repeatability index data and data irregularity index data.

Preferably, the stable attribute data includes a comprehensive index identifier and a comprehensive index name.

Preferably, the gradually changing attribute data is recorded through attribute columns or tuples, and combined with the stable attribute data, a gradually changing dimension table is formed.

Preferably, the fast-changing attribute data is converted in the form of preset bands, and the value ranges in the operational data environment are partitioned, and the fast-changing attribute data corresponding to each zone value range is stored together to form a fast-changing dimension table .

Preferably, the power data includes marketing data and power distribution data.

Correspondingly, in order to achieve the above purpose, the present invention also provides a power data analysis device based on a dimensional model, including:

The data quality fact table establishment unit is used to establish a data quality fact table according to the fused power data; wherein, the fact table includes comprehensive indicators and fact data of the comprehensive indicators; the comprehensive indicators include substations, lines whose property rights belong to the power supply company , The property right of the line belonging to the user belongs to the transformer of the power supply company, and the property right of the transformer and metering box belongs to the user;

A dimension table establishment unit, configured to use the fact table to establish a gradually changing dimension table and a rapidly changing dimension table corresponding to the comprehensive index; wherein, the gradually changing dimension table includes stable attribute data and gradually changing attribute data; the rapidly changing dimension table Including the identification number of the comprehensive indicator and fast-changing attribute data; the fast-changing attribute data is the fact data corresponding to the identification number of the comprehensive indicator that changes over time, and the gradually changing attribute data is the time-varying fact data corresponding to the identification number of the comprehensive indicator. Time-varying voltage level data and operating status data;

An analysis unit, configured to analyze the power data based on the gradually changing dimension table and the rapidly changing dimension table.

The above technical scheme has the following beneficial effects:

The technical solution can effectively reduce the impact of dimension update operations on the entire database. The change history of attribute values is kept in the changed data dimension table, and statistics can be collected from substations, lines whose property rights belong to power supply companies, lines whose property rights belong to users, transformers whose property rights belong to power supply companies, transformers whose property rights belong to users, and metering boxes The data is tracked in the whole process, which is convenient for in-depth mining and analysis of the index data, and improves the traceability and utilization rate of the historical data of the data fusion verification system. At the same time, through the dimensional model design technology, the shortcomings of data verification in different cities can be quickly discovered, which is convenient for business personnel to find the focus of the verification work, and timely adjust the phased data verification plan for weak links in data quality, thereby improving data verification and Governance efficiency.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. Those skilled in the art can also obtain other drawings based on these drawings without creative work.

Fig. 1 is a kind of flow chart of the electric power data analysis method based on dimensional model that the present invention proposes;

Fig. 2 is a block diagram of a power data analysis device based on a dimensional model proposed by the present invention;

Fig. 3 is the architecture diagram of the technical solution of the present embodiment;

FIG. 4 is a schematic diagram of a star structure of a database dimension model in this embodiment;

FIG. 5 is a schematic diagram of a gradually changing dimension table of a substation in this embodiment.

detailed description

The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

The working principle of this technical solution: this technical solution divides the power data into three categories according to the time-varying law of the dimension attribute of the power data index. The first category, which does not change with time, is called the stable dimension; the second category, which changes slowly with time, is called the gradually changing dimension; the third category, which changes quickly with time, is called the rapidly changing dimension. These three types of dimension attributes require different dimension model design techniques. In the process of designing the dimension model of the database, on the one hand, it is necessary to make full use of most time-independent dimension attributes to establish stable dimension tables, and at the same time, some time-varying Dimensional attributes, using gradually changing dimensions and rapidly changing dimensions to record the history of its dimensional attributes changing over time, and providing a comprehensive analysis platform for marketing and power distribution data fusion based on these two variable dimensions.

The technical objectives and technical characteristics of the project are:

(1) For gradually changing dimension data, when the data in the dimension table changes, in order to record its change history, it is necessary to add a new attribute column or tuple to the dimension table to record the changed tuple data, which can Perform data analysis and governance based on the change history of dimension attributes.

(2) For fast-changing dimensional data, the "preset band" method can be used to convert the power data, that is, the value range of the attribute in the operational data environment is mapped to a small set of discrete values. Using the "preset band" method can effectively reduce the change frequency of dimension attributes, and is also conducive to the execution of related analysis operations.

Based on the above working principle, the present invention proposes a power data analysis method based on a dimensional model, as shown in FIG. 1 . include:

Step S101): According to the dimension attribute of the power data index, use the fused power data to establish a fact table; wherein, the fact table includes the comprehensive index and the fact data of the comprehensive index; the comprehensive index includes substations, lines whose property rights belong to the power supply company The property rights of the line belonging to the user belong to the transformer of the power supply company, and the transformer and metering box of the user belong to the property right; the factual data of the comprehensive index includes the verification progress index data, data integrity index data, data consistency index data, and data repeatability Metric Data and Data Irregularity Metric Data.

Step S102): Using the fact table to establish a gradually changing dimension table and a rapidly changing dimension table corresponding to the comprehensive index; wherein, the gradually changing dimension table includes stable attribute data and gradually changing attribute data; the rapidly changing dimension table includes comprehensive indicators The identity identification number and fast-changing attribute data; the fast-changing attribute data is the time-varying fact data corresponding to the identity identification number of the comprehensive index, and the gradual change attribute data is the time-varying fact data corresponding to the identity identification number of the comprehensive index Voltage level data and operating status data;

Step S103): Analyze the power data based on the gradually changing dimension table and the rapidly changing dimension table.

Correspondingly, the present invention also proposes a power data analysis device based on a dimensional model, as shown in FIG. 2 . include:

The data quality fact table establishment unit 201 is used to establish a data quality fact table using the fused power data according to the dimension attribute of the power data index; wherein, the fact table includes comprehensive indicators and fact data of the comprehensive indicators; the comprehensive indicators include Substations, lines whose property rights belong to the power supply company, lines whose property rights belong to users, transformers whose property rights belong to the power supply company, transformers and metering boxes whose property rights belong to users;

Dimension table establishment unit 202, used to use the fact table to establish a gradually changing dimension table and a rapidly changing dimension table corresponding to the comprehensive index; wherein, the gradually changing dimension table includes stable attribute data and gradually changing attribute data; the rapidly changing dimension The table includes the identification number of the comprehensive indicator and the fast-changing attribute data; the fast-changing attribute data is the fact data corresponding to the identification number of the comprehensive indicator that changes with time, and the gradually changing attribute data is the corresponding to the identification number of the comprehensive indicator. Voltage level data and operating status data changing over time;

The analysis unit 203 is configured to analyze the power data based on the gradually changing dimension table and the rapidly changing dimension table.

The technical solution will be further described in detail below in conjunction with the embodiments.

This technical solution adopts database + online analysis and processing system (OLAP). The database realizes the integration, storage and management of the subject data of the marketing and power distribution system, and the OLAP realizes the multi-dimensional analysis of the subject data. The database is based on two data sources, the original marketing business application system database and the equipment (asset) operation and maintenance lean management system database, as shown in Figure 3.

The database dimension model adopts a star structure, as shown in Figure 4, the model includes a fact table and six dimension tables. The fact table is used to express the topic of data quality, and its granularity is that substations, lines whose property rights belong to power supply companies, lines whose property rights belong to users, transformers whose property rights belong to power supply companies, transformers whose property rights belong to users, and metering boxes are considered in each city. Composite indicators within. Since the data quality of various equipment will affect the comprehensive indicators of the prefecture and city, there are six substations, lines whose property rights belong to the power supply company, lines whose property rights belong to users, transformers whose property rights belong to the power supply company, transformers whose property rights belong to users, and metering boxes Dimensions to analyze comprehensive indicators. The factual data reflecting comprehensive indicators include: checking progress indicator data, data integrity indicator data, data consistency indicator data, data repeatability indicator data, and data irregularity indicator data. In the dimensional model of the database, the relationship between the fact table and the dimension table is established through keywords. The keywords in the dimension table adopt keywords, such as user number, equipment code, substation identification and so on. The new tuple has the same keyword as the old tuple. In the gradually changing dimension table, the keyword is a dimension value defined and assigned by the system to identify the tuple in the dimension table. Use the corresponding keyword in the fact table Create a link between the fact table and the slowly changing dimension table.

1. Gradual dimension scheme

In a gradually changing dimension table, when an attribute of a tuple changes, a tuple with the same key and a new attribute value can be added to the gradually changing dimension table, and the update history of the old data in the dimension table can be kept. New tuples in the fact table will use the same keys that the historical data still uses, so the fact table does not need to be modified. In a gradually changing dimension table, each keyword represents a unique attribute profile established within a specific time span, and the gradually changing dimension table completely records the change history of dimension attributes. Taking the substation dimension table as an example, it contains three types of attributes: stable dimension attributes, such as substation identification, substation name; gradually changing dimension attributes, such as voltage level, operating status; fast-changing dimension attributes, such as verification progress, data integrity, data Consistency, data repeatability, data irregularity. Remove the fast-changing attribute, and combine other attributes into a gradually changing dimension table—substation gradually changing dimension table, as shown in Figure 5. When the gradient attribute in the dimension table changes, for example, the voltage level changes from 35kV to 110kV, a new dimension tuple is added to the dimension table to reflect the new equal-voltage level attribute value. The transformer ID remains the same, representing the same substation, but different substation IDs represent the overview of the dimension attributes of the substation in different periods. In the data quality query analysis based on the attributes in the substation gradually changing dimension table, if constraints are given on the voltage level attribute, then we can accurately distinguish different voltage levels and compare the data quality and voltage level. relationship; if constraints are given on the substation identification attribute, all the data of the same substation will be obtained for analysis, so that the historical changes of the data quality of the same substation can be obtained. Similarly, the relationship between operating status and data quality can be analyzed.

2. Fast-changing dimension scheme

Extracting the attributes with fast changing frequency from the substation dimension table in Figure 4 can form an independent fast-changing dimension table, as shown in Figure 5, and distinguish each attribute in it by "band". The substation fast-changing dimension table is directly connected with the data quality fact table, and the "band" in the dimension table is shown in Table 1. The effect of this design scheme is the same as that of gradually changing dimensions, and it can also track the change of any attribute in the fast-changing dimension table in the fact table, and avoid the expansion of the entire dimension table due to rapid changes in attributes. Through the fast-changing dimension table, the influence of substation verification progress, data integrity, data consistency, data repeatability and data irregularity on data quality can be obtained.

Table 1

schedule/% Integrity/% consistency/% Repeatability/% Irregularity/% 0～20 0～20 0～20 0～20 0～20 20～40 20～40 20～40 20～40 20～40 40～60 40～60 40～60 40～60 40～60 60～80 60～80 60～80 60～80 60～80 80～100 80～100 80～100 80～100 80～100

Multi-dimensional data quality analysis through OLAP technology is of great significance for ensuring data quality, reasonably arranging the progress of data governance, and improving the efficiency of data fusion in marketing and power distribution systems.

The specific embodiments described above have further described the purpose, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above descriptions are only specific embodiments of the present invention and are not intended to limit the scope of the present invention. Protection scope, within the spirit and principles of the present invention, any modification, equivalent replacement, improvement, etc., shall be included in the protection scope of the present invention.

Claims (7)

1., based on an electric power data analytical approach for dimensional model, it is characterized in that, comprising:

According to electric power data index dimensional attribute, the electric power data after merging is utilized to set up fact table; Wherein, described fact table comprises the factual data of overall target and overall target; The circuit property right that the circuit that described overall target comprises transformer station, property right belongs to electric company, property right belong to user belongs to the transformer of electric company, property right belongs to user transformer and batch meter;

Described fact table is utilized to set up gradual change dimension table corresponding to described overall target and become dimension table soon; Wherein, described gradual change dimension table comprises stability property data and gradient attributes data; Described fast change dimension table comprises the identify label number of overall target and becomes attribute data soon; The identify label number corresponding time dependent factual data that described fast change attribute data is overall target, described gradient attributes data are identify label number corresponding time dependent electric pressure data and the running state data of overall target;

Based on described gradual change dimension table and the fast dimension table that becomes, electric power data is analyzed.

2. the method for claim 1, it is characterized in that, the factual data of described overall target comprises checks progress indicator data, data integrity achievement data, data consistency achievement data, data redundancy achievement data and data scrambling achievement data.

3. the method for claim 1, is characterized in that, described stability property comprises overall target mark and overall target title.

4. the method for claim 1, is characterized in that, described gradient attributes data carry out record by attribute column or tuple, in conjunction with described stability property data, forms gradual change dimension table.

5. the method for claim 1, it is characterized in that, described fast change attribute data is changed in the mode of default wave band, and the codomain in manipulation type data environment is carried out subregion, fast change attribute data corresponding to each zones values territory stores together, and forms and becomes dimension table soon.

6. the method as described in claim as arbitrary in Claims 1 to 5, is characterized in that, described electric power data comprises marketing data and power dispatching data.

7., based on an electric power data analytical equipment for dimensional model, it is characterized in that, comprising:

Quality of data fact table sets up unit, for according to electric power data index dimensional attribute, utilizes the electric power data after merging to set up quality of data fact table; Wherein, described fact table comprises the factual data of overall target and overall target; The circuit property right that the circuit that described overall target comprises transformer station, property right belongs to electric company, property right belong to user belongs to the transformer of electric company, property right belongs to user transformer and batch meter;

Dimension table sets up unit, sets up gradual change dimension table corresponding to described overall target for utilizing described fact table and becomes dimension table soon; Wherein, described gradual change dimension table comprises stability property data and gradient attributes data; Described fast change dimension table comprises the identify label number of overall target and becomes attribute data soon; The identify label number corresponding time dependent factual data that described fast change attribute data is overall target, described gradient attributes data are identify label number corresponding time dependent electric pressure data and the running state data of overall target;

Analytic unit, for analyzing electric power data based on described gradual change dimension table and the fast dimension table that becomes.