CN105405070A - Distributed memory power grid system construction method - Google Patents
Distributed memory power grid system construction method Download PDFInfo
- Publication number
- CN105405070A CN105405070A CN201510881897.8A CN201510881897A CN105405070A CN 105405070 A CN105405070 A CN 105405070A CN 201510881897 A CN201510881897 A CN 201510881897A CN 105405070 A CN105405070 A CN 105405070A
- Authority
- CN
- China
- Prior art keywords
- data
- section
- internal memory
- memory
- electrical network
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
- G06Q50/06—Electricity, gas or water supply
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y04—INFORMATION OR COMMUNICATION TECHNOLOGIES HAVING AN IMPACT ON OTHER TECHNOLOGY AREAS
- Y04S—SYSTEMS INTEGRATING TECHNOLOGIES RELATED TO POWER NETWORK OPERATION, COMMUNICATION OR INFORMATION TECHNOLOGIES FOR IMPROVING THE ELECTRICAL POWER GENERATION, TRANSMISSION, DISTRIBUTION, MANAGEMENT OR USAGE, i.e. SMART GRIDS
- Y04S10/00—Systems supporting electrical power generation, transmission or distribution
- Y04S10/50—Systems or methods supporting the power network operation or management, involving a certain degree of interaction with the load-side end user applications
Abstract
The present invention discloses a distributed memory powergrid system construction method. The method specifically comprises the following steps: (1) building a memory power grid resource model, i.e. enabling modeling of a memory power grid resource to follow the public information model specification in the IEC61970 standard, and constructing the tree-type memory power grid resource model by using package, inheritance and object application oriented to an object; (2) determining a memory storage structure, i.e. storing all attribute data of the resource in an array manner, and determining positions of the attribute data in an array by defining a mapping relationship between attribute name identifiers and array subscripts so as to realize data access; (3) horizontally splitting power grid resource data; (4) loading and caching the power grid resource data; (5) synchronizing memory power grid data; (6) determining a memory power grid section; and (7) determining a memory power grid access interface. According to the method provided by the present invention, data transmission between distributed nodes can be reduced to the greatest degree when resource access and calculation are implemented, thereby greatly increasing efficiency.
Description
Technical field
The present invention relates to a kind of distributed memory network system construction method, belong to electric power network technique field.
Background technology
For solving storage, the analytic method problem of large data, Google company proposes distributed file system, towards the distributed data base, the distributed programmed model of MapReduce that arrange.The distributed storage of Google company, distributed computing technology are that the storage of Large-Scale Interconnected web station system big data quantity and analysis propose solution, improve performance.In large data real-time analysis, SAP is proposed HANA internal memory computing platform, and it passes through the all-in-one technology of internal memory computing technique and software and hardware combining, realizes high performance data query and analysis, meets the real-time demand of user to large data processing.In Large Copacity, high speed storing, Oracle is proposed Exadata database all-in-one, it is by high-performance hardware, high speed network interfaces, adopts the technology such as intelligent scanning, intelligent storage, intelligent index, the compression of mixing row, improves large data and how concurrent system treatment effeciency of answering under scene.Exadata database all-in-one can make the performance based on the existed system of oracle database obtain about 10 times performance boosts.In addition, also there are some memory database technology, as: for application program provides the OracleTimesTen product of summary responses and high-throughput; By the full transaction data storehouse engine based on internal memory and disk, the IBMSolidDB product that the data Replica function that availability is strong closely combines together; For the various eXtremeDB needing high-performance, small size, closely storage, zero Memory Allocation; Take resource low, can combine with a lot of program language, the SQLite memory database of lightweight; Adopt the Redis memory database of increasing income of high performance key-value storage, internal storage data mode set, be proposed the real-time storage scheme of data, avoid solving magnetic disc i/o operation frequently, data access efficiency is improved.
In Distributed Calculation field, common analytical approach utilizes Hadoop framework, due to the operation of a large amount of magnetic disc i/os and the MapReduce process of complexity, make system performance and operational efficiency low, the requirement of real-time can not be met, non real-time data analysis application scene can only be used for.In distributed caching field, the storage mode of usual employing Key-Value and the Data Placement mode based on Key Hash hash, when this mode makes several data Connection inquiring, cache node needs to exchange mass data, degraded performance, and be generally used for the simple data of structure, be difficult to the power network resources data of transaction module complexity.Distributed and the internal memory counting yield of current main flow, due to its cross-species transferability, makes it in the face of complex electric network resource model and vast resources data, cannot play sharpest edges, even there is insurmountable engineer applied problem.
Summary of the invention
For the deficiency that prior art exists, the object of the invention is to provide a kind of distributed memory network system construction method, at utmost can reduce the data transmission between distributed node, significantly raising efficiency when realizing resource access and calculating.
To achieve these goals, the present invention realizes by the following technical solutions:
A kind of distributed memory network system construction method of the present invention, specifically comprises following step:
(1) build internal memory power network resources model: the common information model specification in IEC61970 standard is followed in the modeling of internal memory power network resources, utilize OO encapsulation, succession and object application, set up the internal memory power network resources model of tree-shaped;
(2) determine memory structure: adopt array mode to store resource all properties data, by the mapping relations of defined attribute name identifiers and array index, determine the position of attribute data in array, realize data access;
(3) level splits power network resources data: will have the power network resources data-mapping of different business property value to different data blocks, by the power network resources data-mapping with identical services property value to together data block;
(4) also buffer memory power network resources data are loaded: when system first time starts, according to the horizontal division mode of data, data in power network resources database are loaded according to internal memory power network resources model, then in distributed caching to cluster in multiple server memory; After Data import completes, power network resources data in buffer memory are carried out serializing, forms binary file and be saved in disk, when start up system again, directly read electric network data from file, and read from serializing last time incremental data up till now from power network resources database; After power network resources distributed caching, by the area attribute value of cache server IP address, power network resources, power network resources electric pressure value, take up room, buffer memory temporal information used is sent in managing power network resources server and carries out unified management;
(5) isochronous memory electric network data: the resource data in electric network database is synchronized to internal memory electrical network, economizes the resource data of internal memory electrical network and be synchronized to general headquarters' internal memory electrical network, makes the data of ground electrical network and province's internal memory electrical network in database and internal memory electrical network, general headquarters be consistent;
(6) internal memory electrical network section is determined: internal memory electrical network section is using objectification parallel computation frame persistence function as support, all profile datas of each province and general headquarters are kept at respective internal memory grid service device, adopt the mode with internal memory grid service device shared drive, load local Historic Section data;
(7) internal memory electrical network access interface is determined: internal memory grid interface is used for the power network resources access mode providing Data Physical position irrelevant to electrical network operating information system, comprises electrical network section interface, electric network data statistical study interface, data-query interfaces.
In step (1), when carrying out tree-shaped displaying, first will determine the hierarchical relationship of power network resources in internal memory power network resources model, requirement must have a root node, and the father node of each child node is unique.
In step (2), the defining method that memory structure is concrete is as follows:
If resource data is A, comprise 4 attributes, record number is: 3, then distribute for every bar record the Object object array that a length is 4,
Attribute 1 attribute 2 attribute 3 attribute 4
| Array 1 | Value 11 | Value 12 | Value 13 | Value 14 |
| Array 2 | Value 21 | Value 22 | Value 23 | Value 24 |
| Array 3 | Value 31 | Value 32 | Value 33 | Value 34 |
The mapping relations that employing Key-Value mode sets up attribute-identifier and array index are as follows:
Attribute (key) corresponding array index (value)
| Attribute 1 | 1 |
| Attribute 2 | 2 |
| Attribute 3 | 3 |
| Attribute 4 | 4 |
When accessing certain property value of certain record, first find the array that this record is corresponding, then according to attribute-identifier and array index relation, find the array index that this attribute is corresponding, the property value corresponding according to array index access.
In step (3), power network resources data level method for splitting is as follows:
(3-1) by calculation task object model according to service logic and the data that use, analyze optimum N number of data cutting attribute field;
(3-2) by the type of N number of service data object attribute to be slit and attribute-value ranges, as the original input of data cutting;
(3-3) N number of attribute of object is regarded as the axle of N dimension space, reflect hyperspace region according to object attribute values scope, form the data lineoid of hyperspace;
(3-4) each data lineoid is mapped to the internal memory of the different computing nodes in Distributed Calculation cluster, and the distributed memory forming data stores.
In step (6), internal memory electrical network section utilizes that HDFS distributed file system is carried out forever, reliable memory, and serializing during data persistence adopts the Hession assembly of increasing income to realize.
In step (6), described internal memory electrical network section provides section management, section generates and multibreak loading; The formulation that described section management provides the inquiry of profile data, section generates plan target, section are loaded into assigning of instruction; Described section generates and regularly the data of internal memory electrical network is carried out persistence according to plan target, generates electric network data section; Described multibreak is loaded into according to section instruction, is loaded into multiple Historic Section to internal memory; Internal memory electrical network provides section management tool for inquiring about all Historic Section information, can initiate section simultaneously generate request and section load request to data section processor; Data section processor, after receiving association requests, performs section generation, section loading tasks.
In step (7), described internal memory electrical network access interface adopts PRC far call agreement, and the data of transmission are the binary stream after resource object serializing.
In step (7), by described electrical network section interface polls electrical network section information, and assign section load instructions, the electrical network profile data that loading is specified is to calculator memory; Obtain general headquarters by described electric network data statistical study interface and economize the statistic analysis result of power network resources many condition, various dimensions; Thered is provided the inquiry of the whole network power network resources to operation system by described data-query interfaces, operation system does not need source and the physical location of focused data.
Distributed memory electrical network of the present invention has taken into full account power network resources data and electrical network traffic performance, adopt unified power network resources model and brand-new storage mode, and make model can reflect the situation of power network resources accurately, possess the characteristics such as reusable, easy understanding, efficient resource storage and access simultaneously; Simultaneously by utilizing region characteristic and the electric pressure characteristic of power network resources, can well solve data level segmentation problem, the data transmission between distributed node can be reduced to the full extent when resource data being accessed and calculates, significantly raising efficiency, can support again the correlation inquiry of multiple resources data simultaneously; Distributed memory electrical network is the product of distributed computing technology, internal memory computing technique and electrical network integrated services, is a kind of distributed memory counting yield for electrical network customization, can effectively support electrical network operating information system to power network resources quick, efficiently process.
Accompanying drawing explanation
Fig. 1 is a kind of distributed memory network system construction method workflow diagram;
Fig. 2 is that power network resources data level splits schematic diagram;
Fig. 3 is internal memory electric network data method of synchronization schematic diagram;
Fig. 4 is data section general frame figure;
Fig. 5 is distributed memory network system Organization Chart;
Fig. 6 is distributed memory electrical network functional frame composition.
Embodiment
The technological means realized for making the present invention, creation characteristic, reaching object and effect is easy to understand, below in conjunction with embodiment, setting forth the present invention further.
See Fig. 1, distributed memory network system construction method of the present invention is as follows:
Step one, power network resources model construction
Common information model (CIM) specification in IEC61970 standard is followed in the modeling of internal memory power network resources, utilizes OO encapsulation, succession, object application etc., sets up the internal memory electric network model of tree-shaped.Carry out the hierarchical relationship first wanting power network resources in Confirming model when tree-shaped is shown, requirement must have a root node, and the father node of each child node is unique.Power system resource in electrical network has himself feature, such as in physical characteristics, there is certain pardon, as a certain sub-control zone contains multiple transformer station, comprise multiple electric pressure under a transformer station, an electric pressure contains again the power equipments such as bus, switch, disconnecting link, load.For meeting the requirement of pardon, when object-oriented modeling, the class having father node and child node for each adds father node and word nodal community, a parent attribute is set to the pointer to object of the power network resources parent of its subordinate, the list of the grid equipment subclass that another child node setup of attribute comprises for it.
Step 2, memory structural design
From ease for use and saving memory cost two aspect, internal memory storage organization is designed.Save memory cost aspect, given up the general fashions such as Key-Value key-value pair or Hash table, adopt array mode to store resource all properties data.By the mapping relations of defined attribute name identifiers and array index, realize data access, it is as follows that it realizes form:
Suppose certain resource data A, comprise 4 attributes, record number is: 3, then distribute for every bar record the Object object array that a length is 4.
Attribute 1 attribute 2 attribute 3 attribute 4
| Array 1 | Value 11 | Value 12 | Value 13 | Value 14 |
| Array 2 | Value 21 | Value 22 | Value 23 | Value 24 |
| Array 3 | Value 31 | Value 32 | Value 33 | Value 34 |
The mapping relations that employing Key-Value mode sets up attribute-identifier and array index are as follows:
Attribute (key) corresponding array index (value)
| Attribute 1 | 1 |
| Attribute 2 | 2 |
| Attribute 3 | 3 |
| Attribute 4 | 4 |
When accessing certain property value of certain record, first find the array that this record is corresponding, then according to attribute-identifier and array index relation, find the array index that this attribute is corresponding, the property value corresponding according to array index access.
Step 3, power network resources data level split
Service logic feature contained by service data object self, carry out various dimensions cutting according to the attribute of service data object, it realizes schematic diagram see Fig. 2.
(1) by calculation task object model according to service logic and the data that use, analyze optimum N number of data cutting attribute field.
(2) by the type of N number of service data object attribute to be slit and attribute-value ranges, as the original input of data cutting.
(3) N number of attribute of object is regarded as the axle of N dimension space, reflect hyperspace region according to object attribute values scope.Form the data lineoid of hyperspace.
(4) each data lineoid is mapped to the internal memory of the different computing nodes in Distributed Calculation cluster, and the distributed memory forming data stores.
Step 4, power network resources Data import and buffer memory
Load power network resources data, when system first time starts, according to the horizontal division mode of data, the data in power network resources database are loaded according to power network resources memory model, then in distributed caching to cluster in multiple server memory.After Data import completes, power network resources data in buffer memory are carried out serializing, forms binary file and be saved in disk, when start up system again, directly read electric network data from file, and read from serializing last time incremental data up till now from power network resources database.
After power network resources distributed caching, by the area attribute value of cache server IP address, power network resources, power network resources electric pressure value, take up room, the information such as buffer memory time used is sent in managing power network resources server and carries out unified management.
Step 5, the internal memory electric network data method of synchronization design
See Fig. 3, the resource data that data syn-chronization is used for the resource data in electric network database being synchronized to internal memory electrical network, economizing internal memory electrical network is synchronized to general headquarters' internal memory electrical network, and the data of ground electrical network and province's internal memory electrical network in database and internal memory electrical network, general headquarters are consistent.
Data syn-chronization comparison comprises that full dose is synchronous, increment synchronization.The data of disk relational database are synchronously synchronized in the target cache of internal memory electrical network with the form full dose of objectification by full dose, ensure the consistance of internal memory power network object data and disk relational database data source data; The data object model full dose that internal memory electrical network economized by each net is synchronized to Guo Wang general headquarters and completes splicing, ensures that the synchronous of internal memory electrical network economized by general headquarters' internal memory electrical network and each net.Internal memory electrical network completes object data increment renewal according to the metadata of data change record table economized by net.Produce object data change file after renewal simultaneously, economize the modification information of data model in internal memory electrical network in order to record net, and be stored in the modification information storer of contrast server.Guo Wang general headquarters internal memory electrical network economizes the object data change file in contrast server by each net of access, economized object server by the data object model of corresponding change and be uploaded to general headquarters' internal memory electrical network, complete the renewal of changing data object model from net.
Especially, because the buffer memory of internal memory electrical network is limited, disposable for full dose data being loaded in target cache can not be compared.Therefore, comparing module provides deblocking comparison technology.Data volume in some tables of data is very huge, if once just it all to be loaded the resource of the not only consuming time but also committed memory power network object buffer memory of comparing.First piecemeal process and priority level initializing will be carried out to all data.The division of data block is formulated according to business demand.A data block containing the data from different pieces of information table with logical communication link or business association, can not put under in same data block with uncorrelated data in a tables of data.Each data block sets priority level according to the real-time of corresponding business, the accuracy etc. of data again.The data block that during each comparison, first processing priority is high.It can be even the frequency that special data block increases comparison.Secondly in object server, comparing object pool is created, first the data block that part is specified is loaded into target cache during each comparison to compare, data object model after completing in release comparing object pool, then the specified data block next needing comparison is loaded from disk relational database.
Step 6, electrical network Section Design
Data section provides the functions such as section management, section generation, multibreak loading.The formulation that section management provides the inquiry of profile data, section generates plan target, section are loaded into assigning of instruction.Section generates and regularly the data of internal memory electrical network is carried out persistence according to plan target, generates electric network data section.Multibreak is loaded into according to section instruction, is loaded into multiple Historic Sections to internal memory.
Internal memory electrical network section is using objectification parallel computation frame persistence function as support, and all profile datas of each province and general headquarters are kept at respective internal memory grid service device.Adopt the mode with internal memory grid service device shared drive, load local Historic Section data.Data section general frame figure is as Fig. 4.
Internal memory electrical network provides section management tool for inquiring about all Historic Section information, can initiate section simultaneously generate request and section load request to data section processor.Data section processor, after receiving association requests, performs section generation, section loading tasks.
Especially, electrical network section utilizes that HDFS distributed file system is carried out forever, reliable memory, and serializing during data persistence adopts the Hession assembly of increasing income to realize, and the feature of this assembly is that serializing efficiency is high, and the byte stream after serializing is short.
Step 7, internal memory electrical network access interface design
Internal memory grid interface is used for the power network resources access mode providing Data Physical position irrelevant to electrical network operating information system, comprises electrical network section interface, electric network data statistical study interface, data-query interfaces.Can inquire about electrical network section information by electrical network section interface business system, and assign section load instructions, the electrical network profile data that loading is specified is to calculator memory.By statistical study interface, operation system can obtain general headquarters and economize the statistic analysis result of power network resources many condition, various dimensions.Data-query interfaces is used for the inquiry providing the whole network power network resources to operation system, and operation system does not need source and the physical location of focused data.Power network resources data access interface adopts PRC far call agreement, and the data of transmission are the binary stream after resource object serializing.
(1) internal memory network system framework
Internal memory electrical network is structured on objectification parallel computation frame.Between general headquarters' internal memory electrical network and each province's internal memory electrical network, economize internal memory electrical network and economize and contrast module by data syn-chronization between database and carry out data syn-chronization and copy.Self application function such as internal memory electrical network possesses data section, internal memory electrical network represents, the other systems such as internal memory power grid application interface is PMS2.0 provide the application programming interface such as statistical study, inquiry based on OPC, see Fig. 5.
(2) internal memory electrical network function structure
Internal memory electrical network is on OPC basis, with internal memory electric network model for core, build power network resources data object and task object pond, power network resources object pool basis builds related management and application function, mainly comprise: data syn-chronization comparison, data section management, internal memory electrical network query and statistical analysis, internal memory electrical network represent and internal memory power grid application interface etc., see Fig. 6.
Data syn-chronization comparison function is responsible for the resource data in electric network database to be synchronized to internal memory electrical network, economize the resource data of internal memory electrical network is synchronized to general headquarters' internal memory electrical network, and the data of ground electrical network and province's internal memory electrical network in database and internal memory electrical network, general headquarters are consistent.Data section function is responsible for the internal memory electric network data persistence in a certain moment to generate data section, provides the query statistic of section information, section task management functions etc.Internal memory administration of power networks comprises the management of electrical network memory model and the management of power network resources object.Internal memory electrical network represents provides the various dimensions to internal memory electrical network to show, comprise electrical network section summarize represent, electrical network profile data represents, the comparison of electrical network section represents subfunction.Internal memory power grid application interface is used for providing electrical network section interface, statistical study interface, data-query interfaces to operation system.
Therefore, when concrete design, the present invention takes into full account the problem of prior art, adopt brand-new weak object memory module, object model design is carried out by fused business logic, make model accurately can reflect the situation of power network resources, possess the characteristics such as reusable, easy understanding, efficient resource storage and access simultaneously.In addition, the Data distribution8 of distributed memory electrical network adopts based on service attribute Hash hash mode, and be used to the service attribute of Hash hash, then be optimized for electric network data and business characteristic and customize, the data transmission between distributed node at utmost can be reduced, significantly raising efficiency when realizing resource access and calculating.
More than show and describe ultimate principle of the present invention and principal character and advantage of the present invention.The technician of the industry should understand; the present invention is not restricted to the described embodiments; what describe in above-described embodiment and instructions just illustrates principle of the present invention; without departing from the spirit and scope of the present invention; the present invention also has various changes and modifications, and these changes and improvements all fall in the claimed scope of the invention.Application claims protection domain is defined by appending claims and equivalent thereof.
Claims (8)
1. a distributed memory network system construction method, is characterized in that, specifically comprises following step:
(1) build internal memory power network resources model: the common information model specification in IEC61970 standard is followed in the modeling of internal memory power network resources, utilize OO encapsulation, succession and object application, set up the internal memory power network resources model of tree-shaped;
(2) determine memory structure: adopt array mode to store resource all properties data, by the mapping relations of defined attribute name identifiers and array index, determine the position of attribute data in array, realize data access;
(3) level splits power network resources data: will have the power network resources data-mapping of different business property value to different data blocks, by the power network resources data-mapping with identical services property value to together data block;
(4) also buffer memory power network resources data are loaded: when system first time starts, according to the horizontal division mode of data, data in power network resources database are loaded according to internal memory power network resources model, then in distributed caching to cluster in multiple server memory; After Data import completes, power network resources data in buffer memory are carried out serializing, forms binary file and be saved in disk, when start up system again, directly read electric network data from file, and read from serializing last time incremental data up till now from power network resources database; After power network resources distributed caching, by the area attribute value of cache server IP address, power network resources, power network resources electric pressure value, take up room, buffer memory temporal information used is sent in managing power network resources server and carries out unified management;
(5) isochronous memory electric network data: the resource data in electric network database is synchronized to internal memory electrical network, economizes the resource data of internal memory electrical network and be synchronized to general headquarters' internal memory electrical network, makes the data of ground electrical network and province's internal memory electrical network in database and internal memory electrical network, general headquarters be consistent;
(6) internal memory electrical network section is determined: internal memory electrical network section is using objectification parallel computation frame persistence function as support, all profile datas of each province and general headquarters are kept at respective internal memory grid service device, adopt the mode with internal memory grid service device shared drive, load local Historic Section data;
(7) internal memory electrical network access interface is determined: internal memory grid interface is used for the power network resources access mode providing Data Physical position irrelevant to electrical network operating information system, comprises electrical network section interface, electric network data statistical study interface, data-query interfaces.
2. distributed memory network system construction method according to claim 1, it is characterized in that, in step (1), when carrying out tree-shaped displaying, first the hierarchical relationship of power network resources in internal memory power network resources model will be determined, requirement must have a root node, and the father node of each child node is unique.
3. distributed memory network system construction method according to claim 1, is characterized in that, in step (2), the defining method that memory structure is concrete is as follows:
If resource data is A, comprise 4 attributes, record number is: 3, then distribute for every bar record the Object object array that a length is 4,
The mapping relations that employing Key-Value mode sets up attribute-identifier and array index are as follows:
When accessing certain property value of certain record, first find the array that this record is corresponding, then according to attribute-identifier and array index relation, find the array index that this attribute is corresponding, the property value corresponding according to array index access.
4. distributed memory network system construction method according to claim 1, is characterized in that, in step (3), power network resources data level method for splitting is as follows:
(3-1) by calculation task object model according to service logic and the data that use, analyze optimum N number of data cutting attribute field;
(3-2) by the type of N number of service data object attribute to be slit and attribute-value ranges, as the original input of data cutting;
(3-3) N number of attribute of object is regarded as the axle of N dimension space, reflect hyperspace region according to object attribute values scope, form the data lineoid of hyperspace;
(3-4) each data lineoid is mapped to the internal memory of the different computing nodes in Distributed Calculation cluster, and the distributed memory forming data stores.
5. distributed memory network system construction method according to claim 1, it is characterized in that, in step (6), internal memory electrical network section utilizes that HDFS distributed file system is carried out forever, reliable memory, and serializing during data persistence adopts the Hession assembly of increasing income to realize.
6. distributed memory network system construction method according to claim 1, is characterized in that, in step (6), described internal memory electrical network section provides section management, section generates and multibreak loading; The formulation that described section management provides the inquiry of profile data, section generates plan target, section are loaded into assigning of instruction; Described section generates and regularly the data of internal memory electrical network is carried out persistence according to plan target, generates electric network data section; Described multibreak is loaded into according to section instruction, is loaded into multiple Historic Section to internal memory; Internal memory electrical network provides section management tool for inquiring about all Historic Section information, can initiate section simultaneously generate request and section load request to data section processor; Data section processor, after receiving association requests, performs section generation, section loading tasks.
7. distributed memory network system construction method according to claim 1, is characterized in that, in step (7), described internal memory electrical network access interface adopts PRC far call agreement, and the data of transmission are the binary stream after resource object serializing.
8. distributed memory network system construction method according to claim 1, it is characterized in that, in step (7), by described electrical network section interface polls electrical network section information, and assign section load instructions, the electrical network profile data that loading is specified is to calculator memory; Obtain general headquarters by described electric network data statistical study interface and economize the statistic analysis result of power network resources many condition, various dimensions; Thered is provided the inquiry of the whole network power network resources to operation system by described data-query interfaces, operation system does not need source and the physical location of focused data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510881897.8A CN105405070A (en) | 2015-12-03 | 2015-12-03 | Distributed memory power grid system construction method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510881897.8A CN105405070A (en) | 2015-12-03 | 2015-12-03 | Distributed memory power grid system construction method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105405070A true CN105405070A (en) | 2016-03-16 |
Family
ID=55470539
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510881897.8A Pending CN105405070A (en) | 2015-12-03 | 2015-12-03 | Distributed memory power grid system construction method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105405070A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107995051A (en) * | 2017-12-29 | 2018-05-04 | 国网安徽省电力有限公司 | Secondary equipment of intelligent converting station visualized O＆M module information interactive system and method |
| CN108647320A (en) * | 2018-05-10 | 2018-10-12 | 国网冀北电力有限公司秦皇岛供电公司 | Power distribution automation main station system based on GIS |
| CN109063980A (en) * | 2018-07-16 | 2018-12-21 | 北京科东电力控制系统有限责任公司 | Memory calculation method and system suitable for electrical network analysis |
| CN109977085A (en) * | 2019-03-21 | 2019-07-05 | 广联达科技股份有限公司 | A kind of duplicate method and apparatus of identification model component file |
| CN110263115A (en) * | 2019-06-17 | 2019-09-20 | 百度在线网络技术（北京）有限公司 | The method and its relevant device of accurately diagram data are stored based on distributed table |
| CN110851406A (en) * | 2019-11-19 | 2020-02-28 | 广东电网有限责任公司 | Power grid section storage method based on OSS distribution and back-end service platform |
| CN111581215A (en) * | 2020-05-07 | 2020-08-25 | 钟士平 | Array tree data storage method, fast search method and readable storage medium |
| CN112541036A (en) * | 2020-11-24 | 2021-03-23 | 南方电网数字电网研究院有限公司 | Power grid data synchronization method, system, device, computer equipment and storage medium |
| CN112905573A (en) * | 2021-01-29 | 2021-06-04 | 杭州市电力设计院有限公司余杭分公司 | Mass power grid data management and storage system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2189859A1 (en) * | 2008-11-21 | 2010-05-26 | SMA Solar Technology AG | Energy generation system with several power generators with several transformers, e.g. for PV and/or wind power systems |
| CN102184229A (en) * | 2011-05-11 | 2011-09-14 | 中国科学院软件研究所 | Memory data storage method of huge RFID (Radio Frequency Identification Device) label information |
| CN104599032A (en) * | 2014-11-28 | 2015-05-06 | 国家电网公司 | Distributed memory power grid construction method and system for resource management |
-
2015
- 2015-12-03 CN CN201510881897.8A patent/CN105405070A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2189859A1 (en) * | 2008-11-21 | 2010-05-26 | SMA Solar Technology AG | Energy generation system with several power generators with several transformers, e.g. for PV and/or wind power systems |
| CN102184229A (en) * | 2011-05-11 | 2011-09-14 | 中国科学院软件研究所 | Memory data storage method of huge RFID (Radio Frequency Identification Device) label information |
| CN104599032A (en) * | 2014-11-28 | 2015-05-06 | 国家电网公司 | Distributed memory power grid construction method and system for resource management |
Non-Patent Citations (1)
| Title |
|---|
| 唐云善等: "基于分布式对象缓存的电力信息系统任务调度方法", 《电力信息与通信技术》 * |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107995051A (en) * | 2017-12-29 | 2018-05-04 | 国网安徽省电力有限公司 | Secondary equipment of intelligent converting station visualized O＆M module information interactive system and method |
| CN107995051B (en) * | 2017-12-29 | 2021-03-02 | 国网安徽省电力有限公司 | Information interaction system and method for visual operation and maintenance module of secondary equipment of intelligent substation |
| CN108647320A (en) * | 2018-05-10 | 2018-10-12 | 国网冀北电力有限公司秦皇岛供电公司 | Power distribution automation main station system based on GIS |
| CN108647320B (en) * | 2018-05-10 | 2021-01-19 | 国网冀北电力有限公司秦皇岛供电公司 | GIS-based power distribution automation master station system |
| CN109063980A (en) * | 2018-07-16 | 2018-12-21 | 北京科东电力控制系统有限责任公司 | Memory calculation method and system suitable for electrical network analysis |
| CN109977085A (en) * | 2019-03-21 | 2019-07-05 | 广联达科技股份有限公司 | A kind of duplicate method and apparatus of identification model component file |
| CN110263115B (en) * | 2019-06-17 | 2022-05-20 | 百度在线网络技术（北京）有限公司 | Method for storing high-precision map data based on distributed table and related equipment thereof |
| CN110263115A (en) * | 2019-06-17 | 2019-09-20 | 百度在线网络技术（北京）有限公司 | The method and its relevant device of accurately diagram data are stored based on distributed table |
| CN110851406A (en) * | 2019-11-19 | 2020-02-28 | 广东电网有限责任公司 | Power grid section storage method based on OSS distribution and back-end service platform |
| CN111581215A (en) * | 2020-05-07 | 2020-08-25 | 钟士平 | Array tree data storage method, fast search method and readable storage medium |
| CN112541036A (en) * | 2020-11-24 | 2021-03-23 | 南方电网数字电网研究院有限公司 | Power grid data synchronization method, system, device, computer equipment and storage medium |
| CN112541036B (en) * | 2020-11-24 | 2023-12-12 | 南方电网数字电网研究院有限公司 | Power grid data synchronization method, system, device, computer equipment and storage medium |
| CN112905573A (en) * | 2021-01-29 | 2021-06-04 | 杭州市电力设计院有限公司余杭分公司 | Mass power grid data management and storage system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105405070A (en) | Distributed memory power grid system construction method | |
| CN110022226A (en) | A kind of data collection system and acquisition method based on object-oriented | |
| CN103246749B (en) | The matrix database system and its querying method that Based on Distributed calculates | |
| CN104599032A (en) | Distributed memory power grid construction method and system for resource management | |
| CN107038162A (en) | Real time data querying method and system based on database journal | |
| CN109491989B (en) | Data processing method and device, electronic equipment and storage medium | |
| US9104728B2 (en) | Query language to traverse a path in a graph | |
| Lai et al. | Towards a framework for large-scale multimedia data storage and processing on Hadoop platform | |
| CN109241159B (en) | Partition query method and system for data cube and terminal equipment | |
| CN105512336A (en) | Method and device for mass data processing based on Hadoop | |
| CN108052635A (en) | A kind of heterogeneous data source unifies conjunctive query method | |
| CN106951552A (en) | A kind of user behavior data processing method based on Hadoop | |
| US20230144100A1 (en) | Method and apparatus for managing and controlling resource, device and storage medium | |
| CN104933173A (en) | Data processing method and device used for heterogeneous multiple data sources, and server | |
| US20160224579A1 (en) | Workload aware data placement for join-based query processing in a cluster | |
| CN112685499A (en) | Method, device and equipment for synchronizing process data of work service flow | |
| CN110389967A (en) | Date storage method, device, server and storage medium | |
| CN108363741B (en) | Big data unified interface method, device, equipment and storage medium | |
| CN113901078A (en) | Business order association query method, device, equipment and storage medium | |
| CN114297173A (en) | Knowledge graph construction method and system for large-scale mass data | |
| US9256641B1 (en) | Dynamic optimization of data aggregation | |
| CN110704442A (en) | Real-time acquisition method and device for big data | |
| CN114443680A (en) | Database management system, related apparatus, method and medium | |
| CN114443615A (en) | Database management system, related apparatus, method and medium | |
| CN111049898A (en) | Method and system for realizing cross-domain architecture of computing cluster resources |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160316 |
|
| RJ01 | Rejection of invention patent application after publication |