CN117271837A - Method, device, equipment and storage medium for processing power distribution network data - Google Patents
Method, device, equipment and storage medium for processing power distribution network data Download PDFInfo
- Publication number
- CN117271837A CN117271837A CN202311047807.6A CN202311047807A CN117271837A CN 117271837 A CN117271837 A CN 117271837A CN 202311047807 A CN202311047807 A CN 202311047807A CN 117271837 A CN117271837 A CN 117271837A
- Authority
- CN
- China
- Prior art keywords
- distribution network
- equipment entity
- network data
- equipment
- catalog
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims description 40
- 238000012545 processing Methods 0.000 title claims description 29
- 238000010586 diagram Methods 0.000 claims description 64
- 230000015654 memory Effects 0.000 claims description 27
- 238000009434 installation Methods 0.000 claims description 19
- 238000013507 mapping Methods 0.000 claims description 11
- 238000006243 chemical reaction Methods 0.000 claims description 7
- 238000010276 construction Methods 0.000 claims description 4
- 238000003672 processing method Methods 0.000 abstract description 8
- 238000013523 data management Methods 0.000 abstract description 6
- 238000007726 management method Methods 0.000 description 15
- 238000004458 analytical method Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 8
- 230000008569 process Effects 0.000 description 5
- 238000011161 development Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 238000012098 association analyses Methods 0.000 description 2
- 230000002708 enhancing effect Effects 0.000 description 2
- 239000000284 extract Substances 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 238000004146 energy storage Methods 0.000 description 1
- 238000005065 mining Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000003058 natural language processing Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000013439 planning Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/901—Indexing; Data structures therefor; Storage structures
- G06F16/9017—Indexing; Data structures therefor; Storage structures using directory or table look-up
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/901—Indexing; Data structures therefor; Storage structures
- G06F16/9024—Graphs; Linked lists
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/907—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/06—Energy or water supply
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Economics (AREA)
- Software Systems (AREA)
- Human Resources & Organizations (AREA)
- Public Health (AREA)
- Water Supply & Treatment (AREA)
- General Health & Medical Sciences (AREA)
- Library & Information Science (AREA)
- Marketing (AREA)
- Primary Health Care (AREA)
- Strategic Management (AREA)
- Tourism & Hospitality (AREA)
- General Business, Economics & Management (AREA)
- Supply And Distribution Of Alternating Current (AREA)
Abstract
The invention relates to the technical field of power distribution network data management, and discloses a power distribution network data processing method, a device, equipment and a storage medium.
Description
Technical Field
The invention relates to the technical field of power distribution network data management, in particular to a power distribution network data processing method, a device, equipment and a storage medium.
Background
With the development of social economy and the acceleration of the construction process of a novel power system, the form of a power distribution network is changed day by day. The distributed resources including distributed new energy sources, energy storage systems, electric vehicles, diversified loads and the like are accessed in a large scale, so that the power distribution network is larger and larger in scale and more complex in structure, and the power distribution network is converted from a traditional mode to a novel power distribution network due to the typical characteristics of strong interaction, multiple coupling and high randomness in the operation process. Under the combined action of factors such as novel distribution network, data monitoring equipment and data acquisition points are rapidly increased, data sampling range and sampling frequency are continuously improved, interaction modes and frequency of users and distribution network are continuously increased, digital transformation of the distribution network is realized, and the like, so that the data generated in the operation process of the distribution network has the characteristics of huge scale, various structures, complex sources, non-uniform time scale, various spatial scales and the like, and particularly, the space-time evolution characteristics of the distribution network data resources bring about various data management problems including insufficient space-time scale expression capability and the like. On the other hand, as more and more distributed resources with typical space-time evolution characteristics are accessed into a power distribution network in a large scale, business applications such as power distribution network planning, running, scheduling, overhauling, management, new energy consumption, load prediction and the like encounter new challenges, differential analysis of power distribution network data resources is urgently required to be carried out from time dimension and space dimension, and the current power distribution network data resources have insufficient time-space dimension processing capability, so that the problems of low pertinence, poor accuracy, poor instantaneity and the like of power distribution network data resource analysis application are caused, and the novel power distribution network business application level is restricted to a certain extent.
At present, the data processing method of the power distribution network mainly focuses on the aspects of centralized storage of data, quality management of the data, safety protection of the data, business association of the data, open sharing of the data and the like, and aims at safely sharing and using the data of the power distribution network, but is limited by the traditional data technology and has the characteristics of huge data scale, complex sources, various structures and the like, fine granularity division and management of the data of the power distribution network are not carried out in aspects of time, space dimension and the like, the problems of long time consumption of data searching, high data searching difficulty, low data application efficiency and the like exist, and the problems of low pertinence, poor accuracy and instantaneity of data resource analysis application of the power distribution network are not solved.
Disclosure of Invention
In view of the above, the invention provides a processing method of power distribution network data, which aims to solve the problems that the prior art does not develop fine granularity division and management of the power distribution network data in terms of time, space dimension and the like, and has long time consumption for searching the data, high difficulty for searching the data and low data application efficiency.
In a first aspect, the present invention provides a method for processing power distribution network data, where the method includes:
establishing a distribution network data resource catalog model based on a graph database, wherein the distribution network data resource catalog model comprises nodes, edges and attributes;
metadata information of the power distribution network data resources is collected, the metadata information of each equipment entity is associated to a power distribution network data resource catalog model, and a catalog network diagram with multiple time scales is generated;
extracting coordinate information of each equipment entity and a power supply area to which the coordinate information belongs in the power distribution network data resource, and re-associating the coordinate information of each equipment entity and the power supply area to the power distribution network data resource catalog model to generate a catalog network diagram with multiple spatial scales;
and matching metadata information, coordinate information and power supply areas of corresponding equipment entities based on the multi-time-scale directory network diagram and the multi-space-scale directory network diagram to generate the multi-time-space-scale directory network diagram.
According to the processing method of the power distribution network data, fine granularity division and multi-time space scale processing of the power distribution network data resources are realized from two aspects of time and space dimensions, and the problems of long time consumption, high data retrieval difficulty, low data application efficiency and the like of data search are solved according to the characteristics of huge scale, complex sources, multiple structures and the like of the power distribution network data resources, so that service analysis application of the power distribution network data resources is supported from the aspects of enhancing pertinence, improving accuracy, enhancing instantaneity and the like.
In an optional implementation manner, extracting coordinate information of each equipment entity and a power supply area to which each equipment entity belongs in the power distribution network data resource includes:
and extracting a set of all equipment entities in the power distribution network data resource, and acquiring coordinate information of each equipment entity and a power supply area of each equipment entity in the power distribution network data resource according to a power GIS system, wherein the power GIS system comprises position information of each equipment entity.
The method provided by the invention combines the electric GIS system to acquire the space coordinate information of the equipment entity and the power supply area to form a full-quantity equipment entity list, adds the full-quantity equipment entity list into the power distribution network data resource directory model, acquires the information of the data source where the equipment entity is positioned and the storage position, the storage mode, the access interface and the like of the data source according to the extracted metadata information, extracts the equipment entity data, combines the electric GIS data and acquires the coordinate information of the equipment and the power supply area to which the equipment belongs.
In an alternative embodiment, the method further comprises:
when the electric power GIS system cannot acquire the coordinate information, judging whether the installation address text information exists in the equipment entity or not;
when the text information of the installation address of the equipment entity exists, extracting coordinate information through text recognition and coordinate conversion, and generating the power supply area to which the equipment entity belongs.
The method provided by the invention extracts the coordinate information in various modes and generates the power supply area to which the coordinate information belongs. The accuracy and the instantaneity of the analysis and the processing of the data resources of the power distribution network are improved.
In an alternative embodiment, when the installation address text information of the device entity does not exist, the method further comprises:
and searching coordinates of adjacent equipment through the topology network for replacement, and acquiring coordinate information of equipment entities and a power supply area to which the equipment entities belong.
The method provided by the invention generates the power supply area by various modes. The accuracy and the instantaneity of the analysis and the processing of the data resources of the power distribution network are improved.
In an alternative embodiment, associating the coordinate information of each equipment entity and the power supply area to which the coordinate information belongs into the power distribution network data resource catalog model includes:
and adding the coordinate information and the power supply area corresponding to the equipment entity into a power distribution network data resource directory model, wherein the equipment entity and the power supply area which the equipment entity belongs to are used as nodes, the relationship of the equipment entity and the power supply area which the equipment entity belongs to is used as an edge, and the coordinate information of the equipment entity is used as an equipment entity attribute.
According to the method provided by the invention, the coordinate information of each equipment entity and the power supply area are associated to the power distribution network data resource catalog model, so that a catalog network diagram with multiple time scales is generated, the power distribution network data resources are processed from the time perspective, and the accuracy and the instantaneity of the analysis processing of the power distribution network data resources are improved.
In an alternative embodiment, a node of a power distribution network data resource catalog model includes: data catalogue, equipment entity, service type, time information and power supply area; the edges of the distribution network data resource catalog model comprise: the containing relation between the data catalogue and the equipment entity, the belonging relation between the data catalogue and the service type, and the containing relation between the data catalogue and the time information; the attributes of the distribution network data resource catalog model include: storage position, storage mode, access interface, data capacity, association mapping path of data directory and equipment entity, and space coordinates of equipment entity.
According to the method provided by the invention, through the distribution network data resource catalog model, the data catalog information and the attribute information containing multiple time and space are stored, the fine granularity division and the multiple time and space scale processing of the distribution network data resources are realized from two aspects of time and space dimensions, and the accuracy and the instantaneity of the distribution network data resource analysis processing are improved.
In a second aspect, the present invention provides a device for processing data of a power distribution network, where the device includes:
the power distribution network data resource catalog model construction module is used for building a power distribution network data resource catalog model based on a graph database, and the power distribution network data resource catalog model comprises nodes, edges and attributes;
the catalog network diagram generating module is used for collecting metadata information of the power distribution network data resources, correlating the metadata information of each equipment entity to the power distribution network data resource catalog model and generating a catalog network diagram with multiple time scales;
the system comprises a catalog network diagram generation module with multiple spatial scales, a storage network diagram generation module and a storage network diagram generation module, wherein the catalog network diagram generation module with multiple spatial scales is used for extracting coordinate information of each equipment entity and a power supply area to which the coordinate information of each equipment entity belongs in a power distribution network data resource, and re-associating the coordinate information of each equipment entity and the power supply area to the power distribution network data resource catalog model to generate the catalog network diagram with multiple spatial scales;
and the catalog network diagram generating module with multiple space-time scales is used for generating the catalog network diagram with multiple space-time scales based on the catalog network diagram with multiple time scales and the catalog network diagram with multiple space scales by matching metadata information, coordinate information and the power supply area of the corresponding equipment entity.
In an alternative embodiment, the multi-spatial scale catalog network diagram generation module includes:
the first acquisition unit is used for extracting a set of all equipment entities in the power distribution network data resource, and acquiring coordinate information of each equipment entity and a power supply area of each equipment entity in the power distribution network data resource according to a power GIS system, wherein the power GIS system comprises position information of each equipment entity.
In an alternative embodiment, the multi-spatial scale catalog network diagram generation module includes:
the second acquisition unit is used for judging whether the installation address text information exists in the equipment entity or not when the electric GIS system cannot acquire the coordinate information;
when the text information of the installation address of the equipment entity exists, extracting coordinate information through text recognition and coordinate conversion, and generating the power supply area to which the equipment entity belongs.
In an alternative embodiment, the second acquisition unit further comprises: and the third acquisition unit is used for searching coordinates of adjacent equipment through the topology network for replacement when the installation address text information of the equipment entity does not exist, and acquiring the coordinate information of the equipment entity and the power supply area to which the equipment entity belongs.
In an optional implementation manner, in the multi-space-scale catalog network diagram generation module, the method for associating the coordinate information of each equipment entity and the power supply area to the power distribution network data resource catalog model includes:
and adding the coordinate information and the power supply area corresponding to the equipment entity into a power distribution network data resource directory model, wherein the equipment entity and the power supply area which the equipment entity belongs to are used as nodes, the relationship of the equipment entity and the power supply area which the equipment entity belongs to is used as an edge, and the coordinate information of the equipment entity is used as an equipment entity attribute.
In an alternative embodiment, the node of the distribution network data resource catalog model in the distribution network data resource catalog model building module includes: data catalogue, equipment entity, service type, time information and power supply area; the edges of the distribution network data resource catalog model comprise: the containing relation between the data catalogue and the equipment entity, the belonging relation between the data catalogue and the service type, and the containing relation between the data catalogue and the time information; the attributes of the distribution network data resource catalog model include: storage position, storage mode, access interface, data capacity, association mapping path of data directory and equipment entity, and space coordinates of equipment entity.
In a third aspect, the present invention provides a computer device comprising: the power distribution network data processing method comprises a memory and a processor, wherein the memory and the processor are in communication connection, the memory stores computer instructions, and the processor executes the computer instructions, so that the power distribution network data processing method of the first aspect or any corresponding implementation mode is executed.
In a fourth aspect, the present invention provides a computer readable storage medium, on which computer instructions are stored, the computer instructions being configured to cause a computer to perform the method for processing power distribution network data according to the first aspect or any one of the embodiments corresponding to the first aspect.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings that are needed in the description of the embodiments or the prior art will be briefly described, and it is obvious that the drawings in the description below are some embodiments of the present invention, and other drawings can be obtained according to the drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of a method of processing power distribution network data according to an embodiment of the invention;
FIG. 2 is a diagram of a catalog model of power distribution network data resources according to an embodiment of the present invention;
FIG. 3 is a diagram of an exemplary network of data catalog graphs of a power distribution network containing multi-time scale information in accordance with an embodiment of the present invention;
fig. 4 is an exemplary diagram of an entity of a power distribution network device and an associated power supply area according to an embodiment of the present invention;
FIG. 5 is a diagram of an exemplary network of data catalog graphs containing multi-time scale information and spatial coordinate information in accordance with an embodiment of the present invention.
Fig. 6 is a block diagram of a processing apparatus for power distribution network data according to an embodiment of the present invention;
fig. 7 is a schematic diagram of a hardware structure of a computer device according to an embodiment of the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments of the present invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
According to an embodiment of the present invention, there is provided an embodiment of a method for processing distribution network data, it should be noted that the steps illustrated in the flowchart of the drawings may be performed in a computer system such as a set of computer executable instructions, and that although a logical order is illustrated in the flowchart, in some cases the steps illustrated or described may be performed in an order different from that herein.
In this embodiment, a method for processing power distribution network data is provided, which may be used in the above mobile terminal, such as a mobile phone, a tablet pc, etc. (the execution subject is described in connection with the actual situation), and fig. 1 is a flowchart of an XX method according to an embodiment of the present invention, as shown in fig. 1, where the flowchart includes the following steps:
step S101, a distribution network data resource catalog model is established based on a graph database, wherein the distribution network data resource catalog model comprises nodes, edges and attributes.
In the embodiment of the invention, the catalog model of the power distribution network data resources is constructed based on the neo4j graph database, and the catalog model of the power distribution network data resources is constructed by selecting corresponding means according to actual conditions in practical application by taking the example as an example and not limiting the example. The distribution network data resource catalog model is shown in fig. 2, and mainly comprises nodes, edges (relationships), attributes and the like. The main nodes of the model comprise a data catalog, equipment entities, service types, time information and a power supply area; the main side (relationship) of the model comprises the containing relationship of the data catalogue and the equipment entity, the belonging relationship of the data catalogue and the service type, the containing relationship of the data catalogue and the time information and the belonging relationship of the equipment entity and the space area; the main attributes of the model include: storage locations of data directories, storage modes, access interfaces, data capacities, associated mapping paths of the data directories and equipment entities, spatial coordinates of the equipment entities and the like.
In one embodiment, the definition of nodes and attributes is exemplified as follows:
data catalogue: (xxx: dataDir { name: 'xx data', storagePath: '10.10.0.1', torageType: 'hive', accessAPI: 'jdbc: hive2: xxx', dataSize: 'xxGB', mapPath: 'xxxID: deviceID' };
the device entity: (xxx: device { name: 'xx Device', pivot: 'x1, y1' };
service type: (xxx: business { name: 'xx Business' };
time information: (xxx: dateLable: 'xxxx-xx-xx' };
power supply area: (xxx: powerArea { name: 'xxx region' }).
The definition examples of edges (relationships) are as follows:
the inclusion relationship of the data directory and the device entity: (DataDir) - [ (his_device ] - > (Device);
the data directory and the service type belong to the relationship: (DataDir) - [ (beans_to ] - > (Business);
the data catalog contains relation with time information: (DataDir) - [: has_time ] - > (DateLable);
the device entity belongs to the relation with the space area: (Device) - [ (beans_to ] - > (PowerArea).
Step S102, metadata information of the power distribution network data resources is collected, the metadata information of each equipment entity is associated to a power distribution network data resource catalog model, and a catalog network diagram with multiple time scales is generated.
In the embodiment of the invention, metadata information of power distribution network data resources is collected, and a data catalog graph network containing multi-time scale information is established. Directly collecting metadata for the data resources with metadata information, and collecting the data resources without metadata information after metadata identification processing is carried out on the data resources without metadata information; and (3) associating and integrating the acquired metadata, extracting a data directory list and associated attribute information, such as service types, storage positions, storage modes, access interfaces, data capacity and the like of the data directory, analyzing and generating multi-time scale information contained in the data directory according to time labels of the metadata, and finally constructing a data directory map network based on the power distribution network data resource directory model proposed in the step (S101), wherein a multi-time scale directory network map is shown in fig. 3.
In a specific embodiment, metadata collection includes: according to a storage mode of the power distribution network data resources, establishing a metadata acquisition adapter through modes such as API direct connection or development connection program and the like, and acquiring metadata information of the power distribution network data resources; for data resources without metadata information, adopting natural language processing and other technologies to establish an automatic metadata discovery and extraction module, and identifying and collecting metadata information; the collected metadata establishes a metadata model according to the dimensions of service, technology, operation and the like, mainly comprises a data name, a service type, an access interface, a data table, a data file, data time, a storage path, operation information, a field list and the like, associates and integrates the metadata to form a data wide table, and stores the data wide table in a Mysql database.
Based on the service information of metadata, the association of the data directory and attribute information is realized, the data directory is generated according to the granularity of a data table or a data file, and a data directory node is generated in a graph database neo4j through a CREATE (xxx: dataDir { name: 'xx data', storagePath: '10.10.0.1', storageType: 'hive', access API: 'jdbc: hive2: xxx', dataSize: 'xx GB', mapPath: 'xxxID: deviceID' }) command; extracting time stamp information of the data catalogue according to a format of 'YYYY-MM-DD HH: MM: SS: XXXX', generating time information nodes in a graph database neo4j through a CREATE (xxx: dateLable { table: 'xx-xx-xx' }) command, and connecting the data catalogue with the time information in the graph database neo4j through a CREATE (DataDir) - [: has_time ] - > (DateLable) command; and repeating the steps according to the number of the data catalogues, and finally generating a data catalogue graph network containing multi-time scale information based on the distribution network data resource catalogue model in neo4 j.
And step S103, extracting coordinate information of each equipment entity and a power supply area to which the coordinate information of each equipment entity belongs in the power distribution network data resource, and re-associating the coordinate information of each equipment entity and the power supply area to the power distribution network data resource catalog model to generate a catalog network diagram with multiple spatial scales.
And extracting a device entity set covered by the power distribution network data resource, acquiring space coordinate information of the device entity and a power supply area to which the device entity belongs by combining with a power GIS system, forming a full-quantity device entity list, and adding the full-quantity device entity list into a data catalog graph network. According to the metadata information extracted in the step 2, acquiring a data source where the equipment entity is located, and information such as a storage position, a storage mode, an access interface and the like of the data source, extracting the equipment entity data, and acquiring coordinate information of the equipment and a power supply area to which the equipment entity belongs by combining the power GIS data; for a geographic entity incapable of acquiring coordinate information from a power GIS system, for a device entity capable of acquiring installation address text, extracting the coordinate information and generating a power supply area to which the device entity belongs through text recognition and coordinate conversion, and for the device entity incapable of acquiring the installation address text, acquiring the coordinate information of the device entity and dividing the power supply area to which the device entity belongs in a mode of searching adjacent devices through a topology network to perform coordinate replacement; according to the data directory model, adding the equipment entity, the coordinate information and the power supply area into the data directory map network, wherein the equipment entity and the power supply area are used as nodes, the affiliated relation between the equipment entity and the power supply area is used as an edge, and the coordinate of the equipment entity is used as an equipment entity attribute, as shown in fig. 4.
In a specific embodiment, the generating of the full device entity list of the power distribution network data resource includes: based on metadata information of the power distribution network data resources, information such as a data source where equipment entities are located, a storage position, a storage mode, an access interface and the like of the data source is obtained, extraction of equipment entity data is achieved, and coordinate information of equipment and a power supply area to which the equipment belongs are obtained in a mode of equipment matching by combining with power GIS data; for a geographic entity incapable of acquiring coordinate information from a power GIS system, for a device entity capable of acquiring installation address text, extracting the coordinate information and generating a power supply area to which the device entity belongs through text recognition and coordinate conversion, and for the device entity incapable of acquiring the installation address text, acquiring the coordinate information of the device entity and dividing the power supply area to which the device entity belongs in a mode of searching adjacent devices through a topology network to perform coordinate replacement; based on the above steps, a full Device entity list containing coordinate information and the power supply area to which the Device belongs is formed, device nodes are generated in the graph database neo4j through a CREATE (xxx: device { name: 'xx Device', chord: 'x1, y1' }), power supply area nodes are generated through CREATE (xxx: powerArea { name: 'xxx area' }), and connection of the Device and the power supply area to which the Device belongs is performed through CREATE (Device) - [: balls- > (PowerArea).
Step S104, based on the catalog network diagram with multiple time scales and the catalog network diagram with multiple space scales, the metadata information, the coordinate information and the power supply area of the corresponding equipment entity are matched, and the catalog network diagram with multiple time scales is generated.
Based on the catalog network diagram with multiple time scales and the catalog network diagram with multiple space scales, metadata information, coordinate information and power supply areas of corresponding equipment entities are matched, and an association relation between data catalog nodes and the equipment entity nodes is established, so that a data catalog diagram network containing the multiple time scale information and the space coordinate information is formed. For each data directory on the data directory map network, if the data directory contains equipment entity data, establishing an association relation between the data directory and equipment entity nodes in a matching mode, if the data directory does not contain the equipment entity data, searching for the association relation between a data directory main key field and the equipment entity based on the development association analysis of metadata information, establishing an association mapping path, and adding the association mapping path as an attribute of the data directory to the data directory map network; based on the association relation between the data directory node and the equipment entity node, the containing relation between the data directory and the equipment entity is taken as an edge to form a data directory map network containing multi-time scale information and space coordinate information, as shown in fig. 5.
For each data directory on the data directory graph network, if the data directory contains equipment entity data, establishing an association relation between the data directory and equipment entity nodes in a matching mode, if the data directory does not contain the equipment entity data, searching the association relation between a data directory primary key field and the equipment entity based on the development association analysis of metadata information, establishing an association mapping path, further realizing the association between the data directory nodes and the equipment entity nodes in a mode of equipment matching or primary key-equipment association mapping, and finally forming a multi-time-space-scale directory network graph containing multi-time scale information and space coordinate information by connecting the data directory nodes and the equipment entity nodes in a graph database neo4j through a CREATE (DataDir) - [: has_device ] - > (Device) command.
The processing method of the power distribution network data provided by the embodiment uses a multi-time space-scale processing technology based on a power distribution network data resource catalog model, correlates and fuses space position information and multi-time version information of the power distribution network data, is oriented to large-scale power distribution network data resources, builds a data catalog graph network covering service information, multi-time scale information and space coordinate information, realizes a rapid positioning function of the service-oriented and multi-time space-scale data resources, establishes a data set access path and method of information such as appointed service, time and space, and meets the multi-time space-scale processing requirements of the power distribution network data resources. The method improves the processing capacity of the power distribution network data resources under the multi-time space scale, solves the problems of long time consumption, high data retrieval difficulty, low data application efficiency and the like of data searching taking time and space dimension conditions into consideration, and supports the value mining and deepening application of the power distribution network data resources.
In the embodiment of the invention, a service management sub-module of the power distribution network data resource is constructed based on the service type of the data catalog, and the service type management capability of the data is provided; based on time information contained in the data catalogue, a time dimension management sub-module of the power distribution network data resource is constructed, and data management capacity of a time dimension is provided; based on the coordinate information of the equipment entity and the power supply area, a space dimension management sub-module of the power distribution network data resource based on the GIS is constructed, a multi-level space information display function is provided, and data space dimension management according to the power supply area and the custom space area is supported.
The method provided by the embodiment of the invention realizes the rapid positioning function of the data resources facing the service and having multiple time-space scales, and improves the data management capacity of the data resources of the power distribution network. Through the multi-time space-scale management module of the power distribution network data resource, an administrator or a user can select a data catalog meeting business requirements and time requirements, and then select or delimit a region on a multi-level space information display interface, the module automatically calculates a device entity set under the region, combines the associated mapping path of the data catalog index information and the device entity to generate data index information meeting the administrator or user selection, and constructs a data set access path and a method for specifying information such as business, time, space and the like, thereby meeting the multi-time space-scale processing requirements of the power distribution network data resource.
Based on the B/S architecture, developing a background function module by using Java language, and developing a front-end page by using HTML 5; based on the service type of the data catalog, constructing a service management sub-module of the power distribution network data resource, and providing service type management capability of data; based on time information contained in the data catalogue, a time dimension management sub-module of the power distribution network data resource is constructed, and data management capacity of a time dimension is provided; based on the coordinate information of the equipment entity and the power supply area, a space dimension management sub-module of the power distribution network data resource based on the GIS is constructed, a multi-level space information display function is provided, and data space dimension management according to the power supply area and the custom space area is supported.
The embodiment also provides a device for processing power distribution network data, which is used for implementing the foregoing embodiments and preferred embodiments, and is not described in detail. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. While the means described in the following embodiments are preferably implemented in software, implementation in hardware, or a combination of software and hardware, is also possible and contemplated.
The embodiment provides a processing device for power distribution network data, as shown in fig. 6, including:
the power distribution network data resource catalog model construction module 601 is configured to establish a power distribution network data resource catalog model based on a graph database, where the power distribution network data resource catalog model includes nodes, edges and attributes;
the catalog network diagram generating module 602 with multiple time scales is configured to collect metadata information of data resources of the power distribution network, and associate the metadata information of each device entity to a catalog model of the data resources of the power distribution network to generate a catalog network diagram with multiple time scales;
the catalog network diagram generating module 603 of multiple spatial scales is configured to extract coordinate information of each device entity and a power supply area to which the coordinate information of each device entity belongs in the power distribution network data resource, and re-associate the coordinate information of each device entity and the power supply area to the power distribution network data resource catalog model, so as to generate a catalog network diagram of multiple spatial scales;
the multi-space-time-scale catalog network diagram generation module 604 is configured to generate a multi-space-scale catalog network diagram based on the multi-time-scale catalog network diagram and the multi-space-scale catalog network diagram, and match metadata information, coordinate information and a power supply area of a corresponding device entity.
In some alternative embodiments, the multi-spatial scale catalog network diagram generation module 603 includes:
the first acquisition unit is used for extracting a set of all equipment entities in the power distribution network data resource, and acquiring coordinate information of each equipment entity and a power supply area of each equipment entity in the power distribution network data resource according to a power GIS system, wherein the power GIS system comprises position information of each equipment entity.
In some alternative embodiments, the multi-spatial scale catalog network diagram generation module 603 includes:
the second acquisition unit is used for judging whether the installation address text information exists in the equipment entity or not when the electric GIS system cannot acquire the coordinate information;
when the text information of the installation address of the equipment entity exists, extracting coordinate information through text recognition and coordinate conversion, and generating the power supply area to which the equipment entity belongs.
In some alternative embodiments, the second acquisition unit further comprises: and the third acquisition unit is used for searching coordinates of adjacent equipment through the topology network for replacement when the installation address text information of the equipment entity does not exist, and acquiring the coordinate information of the equipment entity and the power supply area to which the equipment entity belongs.
In some optional embodiments, the association of the coordinate information of each equipment entity and the power supply area to the power distribution network data resource catalog model in the catalog network diagram generating module 603 with multiple spatial scales includes:
and adding the coordinate information and the power supply area corresponding to the equipment entity into a power distribution network data resource directory model, wherein the equipment entity and the power supply area which the equipment entity belongs to are used as nodes, the relationship of the equipment entity and the power supply area which the equipment entity belongs to is used as an edge, and the coordinate information of the equipment entity is used as an equipment entity attribute.
In some alternative embodiments, the nodes of the distribution network data resource catalog model in the distribution network data resource catalog model building module 601 include: data catalogue, equipment entity, service type, time information and power supply area; the edges of the distribution network data resource catalog model comprise: the containing relation between the data catalogue and the equipment entity, the belonging relation between the data catalogue and the service type, and the containing relation between the data catalogue and the time information; the attributes of the distribution network data resource catalog model include: storage position, storage mode, access interface, data capacity, association mapping path of data directory and equipment entity, and space coordinates of equipment entity.
Further functional descriptions of the above respective modules and units are the same as those of the above corresponding embodiments, and are not repeated here.
The processing means of the distribution network data in this embodiment are presented in the form of functional units, where a unit refers to an ASIC (Application Specific Integrated Circuit ) circuit, a processor and a memory executing one or more software or fixed programs, and/or other devices that can provide the above functions.
The embodiment of the invention also provides computer equipment, which is provided with the processing device for the power distribution network data shown in the figure 6.
Referring to fig. 7, fig. 7 is a schematic structural diagram of a computer device according to an alternative embodiment of the present invention, as shown in fig. 7, the computer device includes: one or more processors 10, memory 20, and interfaces for connecting the various components, including high-speed interfaces and low-speed interfaces. The various components are communicatively coupled to each other using different buses and may be mounted on a common motherboard or in other manners as desired. The processor may process instructions executing within the computer device, including instructions stored in or on memory to display graphical information of the GUI on an external input/output device, such as a display device coupled to the interface. In some alternative embodiments, multiple processors and/or multiple buses may be used, if desired, along with multiple memories and multiple memories. Also, multiple computer devices may be connected, each providing a portion of the necessary operations (e.g., as a server array, a set of blade servers, or a multiprocessor system). One processor 10 is illustrated in fig. 7.
The processor 10 may be a central processor, a network processor, or a combination thereof. The processor 10 may further include a hardware chip, among others. The hardware chip may be an application specific integrated circuit, a programmable logic device, or a combination thereof. The programmable logic device may be a complex programmable logic device, a field programmable gate array, a general-purpose array logic, or any combination thereof.
Wherein the memory 20 stores instructions executable by the at least one processor 10 to cause the at least one processor 10 to perform the methods shown in implementing the above embodiments.
The memory 20 may include a storage program area that may store an operating system, at least one application program required for functions, and a storage data area; the storage data area may store data created according to the use of the computer device, etc. In addition, the memory 20 may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid-state storage device. In some alternative embodiments, memory 20 may optionally include memory located remotely from processor 10, which may be connected to the computer device via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
Memory 20 may include volatile memory, such as random access memory; the memory may also include non-volatile memory, such as flash memory, hard disk, or solid state disk; the memory 20 may also comprise a combination of the above types of memories.
The computer device also includes a communication interface 30 for the computer device to communicate with other devices or communication networks.
The embodiments of the present invention also provide a computer readable storage medium, and the method according to the embodiments of the present invention described above may be implemented in hardware, firmware, or as a computer code which may be recorded on a storage medium, or as original stored in a remote storage medium or a non-transitory machine readable storage medium downloaded through a network and to be stored in a local storage medium, so that the method described herein may be stored on such software process on a storage medium using a general purpose computer, a special purpose processor, or programmable or special purpose hardware. The storage medium can be a magnetic disk, an optical disk, a read-only memory, a random access memory, a flash memory, a hard disk, a solid state disk or the like; further, the storage medium may also comprise a combination of memories of the kind described above. It will be appreciated that a computer, processor, microprocessor controller or programmable hardware includes a storage element that can store or receive software or computer code that, when accessed and executed by the computer, processor or hardware, implements the methods illustrated by the above embodiments.
Although embodiments of the present invention have been described in connection with the accompanying drawings, various modifications and variations may be made by those skilled in the art without departing from the spirit and scope of the invention, and such modifications and variations fall within the scope of the invention as defined by the appended claims.
Claims (14)
1. A method for processing power distribution network data, the method comprising:
establishing a distribution network data resource catalog model based on a graph database, wherein the distribution network data resource catalog model comprises nodes, edges and attributes;
metadata information of the power distribution network data resources is collected, the metadata information of each equipment entity is associated to a power distribution network data resource catalog model, and a catalog network diagram with multiple time scales is generated;
extracting coordinate information of each equipment entity and a power supply area to which the coordinate information belongs in the power distribution network data resource, and re-associating the coordinate information of each equipment entity and the power supply area to the power distribution network data resource catalog model to generate a catalog network diagram with multiple spatial scales;
and matching metadata information, coordinate information and power supply areas of corresponding equipment entities based on the multi-time-scale directory network diagram and the multi-space-scale directory network diagram to generate the multi-time-space-scale directory network diagram.
2. The method according to claim 1, wherein extracting the coordinate information of each equipment entity in the power distribution network data resource and the power supply area to which the equipment entity belongs comprises:
and extracting a set of all equipment entities in the power distribution network data resource, and acquiring coordinate information of each equipment entity and a power supply area of each equipment entity in the power distribution network data resource according to a power GIS system, wherein the power GIS system comprises position information of each equipment entity.
3. The method according to claim 2, wherein the method further comprises:
when the electric power GIS system cannot acquire the coordinate information, judging whether the installation address text information exists in the equipment entity or not;
when the text information of the installation address of the equipment entity exists, extracting coordinate information through text recognition and coordinate conversion, and generating the power supply area to which the equipment entity belongs.
4. A method according to claim 3, wherein when the installation address text information of the device entity is not present, the method further comprises:
and searching coordinates of adjacent equipment through the topology network for replacement, and acquiring coordinate information of equipment entities and a power supply area to which the equipment entities belong.
5. The method according to claim 2, wherein associating the coordinate information of each equipment entity and the power supply area to which it belongs into the power distribution network data resource catalog model comprises:
and adding the coordinate information and the power supply area corresponding to the equipment entity into a power distribution network data resource directory model, wherein the equipment entity and the power supply area which the equipment entity belongs to are used as nodes, the relationship of the equipment entity and the power supply area which the equipment entity belongs to is used as an edge, and the coordinate information of the equipment entity is used as an equipment entity attribute.
6. The method of claim 1, wherein the nodes of the distribution network data resource inventory model comprise: data catalogue, equipment entity, service type, time information and power supply area; the edges of the distribution network data resource catalog model comprise: the containing relation between the data catalogue and the equipment entity, the belonging relation between the data catalogue and the service type, and the containing relation between the data catalogue and the time information; the attributes of the distribution network data resource catalog model include: storage position, storage mode, access interface, data capacity, association mapping path of data directory and equipment entity, and space coordinates of equipment entity.
7. A power distribution network data processing apparatus, the apparatus comprising:
the power distribution network data resource catalog model construction module is used for building a power distribution network data resource catalog model based on a graph database, and the power distribution network data resource catalog model comprises nodes, edges and attributes;
the catalog network diagram generating module is used for collecting metadata information of the power distribution network data resources, correlating the metadata information of each equipment entity to the power distribution network data resource catalog model and generating a catalog network diagram with multiple time scales;
the system comprises a catalog network diagram generation module with multiple spatial scales, a storage network diagram generation module and a storage network diagram generation module, wherein the catalog network diagram generation module with multiple spatial scales is used for extracting coordinate information of each equipment entity and a power supply area to which the coordinate information of each equipment entity belongs in a power distribution network data resource, and re-associating the coordinate information of each equipment entity and the power supply area to the power distribution network data resource catalog model to generate the catalog network diagram with multiple spatial scales;
and the catalog network diagram generating module with multiple space-time scales is used for generating the catalog network diagram with multiple space-time scales based on the catalog network diagram with multiple time scales and the catalog network diagram with multiple space scales by matching metadata information, coordinate information and the power supply area of the corresponding equipment entity.
8. The apparatus of claim 7, wherein the multi-spatial scale catalog network diagram generation module comprises:
the first acquisition unit is used for extracting a set of all equipment entities in the power distribution network data resource, and acquiring coordinate information of each equipment entity and a power supply area of each equipment entity in the power distribution network data resource according to a power GIS system, wherein the power GIS system comprises position information of each equipment entity.
9. The apparatus of claim 8, wherein the multi-spatial scale catalog network diagram generation module comprises:
the second acquisition unit is used for judging whether the installation address text information exists in the equipment entity or not when the electric GIS system cannot acquire the coordinate information;
when the text information of the installation address of the equipment entity exists, extracting coordinate information through text recognition and coordinate conversion, and generating the power supply area to which the equipment entity belongs.
10. The apparatus of claim 9, wherein the second acquisition unit further comprises: and the third acquisition unit is used for searching coordinates of adjacent equipment through the topology network for replacement when the installation address text information of the equipment entity does not exist, and acquiring the coordinate information of the equipment entity and the power supply area to which the equipment entity belongs.
11. The apparatus of claim 8, wherein the associating the coordinate information of each device entity and the power supply area in the catalog network map generating module with multiple spatial scales into the catalog model of the power distribution network data resource comprises:
and adding the coordinate information and the power supply area corresponding to the equipment entity into a power distribution network data resource directory model, wherein the equipment entity and the power supply area which the equipment entity belongs to are used as nodes, the relationship of the equipment entity and the power supply area which the equipment entity belongs to is used as an edge, and the coordinate information of the equipment entity is used as an equipment entity attribute.
12. The apparatus of claim 7, wherein the nodes of the distribution network data resource catalog model in the distribution network data resource catalog model building module comprise: data catalogue, equipment entity, service type, time information and power supply area; the edges of the distribution network data resource catalog model comprise: the containing relation between the data catalogue and the equipment entity, the belonging relation between the data catalogue and the service type, and the containing relation between the data catalogue and the time information; the attributes of the distribution network data resource catalog model include: storage position, storage mode, access interface, data capacity, association mapping path of data directory and equipment entity, and space coordinates of equipment entity.
13. A computer device, comprising:
a memory and a processor, the memory and the processor being communicatively connected to each other, the memory having stored therein computer instructions, the processor executing the computer instructions to perform the method of processing power distribution network data according to any one of claims 1 to 6.
14. A computer-readable storage medium, wherein computer instructions for causing a computer to execute the method of processing distribution network data according to any one of claims 1 to 6 are stored on the computer-readable storage medium.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311047807.6A CN117271837A (en) | 2023-08-18 | 2023-08-18 | Method, device, equipment and storage medium for processing power distribution network data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311047807.6A CN117271837A (en) | 2023-08-18 | 2023-08-18 | Method, device, equipment and storage medium for processing power distribution network data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117271837A true CN117271837A (en) | 2023-12-22 |
Family
ID=89214970
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311047807.6A Pending CN117271837A (en) | 2023-08-18 | 2023-08-18 | Method, device, equipment and storage medium for processing power distribution network data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117271837A (en) |
-
2023
- 2023-08-18 CN CN202311047807.6A patent/CN117271837A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Perera et al. | Context-aware sensor search, selection and ranking model for internet of things middleware | |
| CN111241078A (en) | Data analysis system, data analysis method and device | |
| CN104598557A (en) | Method and device for data rasterization and method and device for user behavior analysis | |
| CN114691786A (en) | Method and device for determining data blood relationship, storage medium and electronic device | |
| CN101944113B (en) | Cloud computing system-based data acquisition system | |
| CN101141370A (en) | Gridding service based electric power enterprise real-time data processing method | |
| CN110147470B (en) | Cross-machine-room data comparison system and method | |
| CN111400393B (en) | Data processing method and device based on multi-application platform and storage medium | |
| CN111309868A (en) | Knowledge graph construction and retrieval method and device | |
| CN112100402A (en) | Power grid knowledge graph construction method and device | |
| CN102750184A (en) | Cloud resource classification and identification system and cloud resource classification and identification method | |
| CN115081088A (en) | Digital base design method and device | |
| CN113868248A (en) | Index data pre-polymerization method | |
| CN113721856A (en) | Digital community management data storage system | |
| CN115439015B (en) | Local area power grid data management method, device and equipment based on data middleboxes | |
| KR101004798B1 (en) | Potential peer producing method and system thereof using P2P sensor network | |
| CN117271837A (en) | Method, device, equipment and storage medium for processing power distribution network data | |
| KR20130120899A (en) | Method for providing database history management and the database management system thereof | |
| CN114071515B (en) | Network optimization method, device, equipment and storage medium | |
| CN115408569A (en) | Process traceability tree simplification method, device, equipment and medium | |
| CN115309802A (en) | User distribution thermodynamic diagram acquisition method and device, electronic equipment and storage medium | |
| CN113407541B (en) | Data acquisition method, data acquisition equipment, storage medium and device | |
| CN113515715B (en) | Buried point event code generation method, buried point event code processing method and related equipment | |
| CN103023740A (en) | Information interaction bus system and electric power data transmission method | |
| CN113204592A (en) | Data processing method, system and device under scene of Internet of things and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |