CN113242146B - Distributed acquisition system for power grid data - Google Patents
Distributed acquisition system for power grid data Download PDFInfo
- Publication number
- CN113242146B CN113242146B CN202110495379.8A CN202110495379A CN113242146B CN 113242146 B CN113242146 B CN 113242146B CN 202110495379 A CN202110495379 A CN 202110495379A CN 113242146 B CN113242146 B CN 113242146B
- Authority
- CN
- China
- Prior art keywords
- processing
- transverse
- processing end
- module
- acquisition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- H—ELECTRICITY
- H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
- H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
- H02J13/00—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network
- H02J13/00006—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network characterised by information or instructions transport means between the monitoring, controlling or managing units and monitored, controlled or operated power network element or electrical equipment
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0893—Assignment of logical groups to network elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/12—Discovery or management of network topologies
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/14—Network analysis or design
- H04L41/145—Network analysis or design involving simulating, designing, planning or modelling of a network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0805—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability
- H04L43/0817—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability by checking functioning
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/16—Threshold monitoring
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L2212/00—Encapsulation of packets
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Computing Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Environmental & Geological Engineering (AREA)
- Power Engineering (AREA)
- Computer And Data Communications (AREA)
- Small-Scale Networks (AREA)
Abstract
The invention relates to a distributed acquisition system of power grid data, which is applied to a distributed acquisition network, wherein the distributed acquisition network is provided with a plurality of acquisition nodes and processing nodes corresponding to a power supply grid, the acquisition nodes are provided with acquisition ends, and the processing nodes are provided with processing ends, and the distributed acquisition system comprises an acquisition end configuration subsystem, a server configuration subsystem, a transverse scheduling subsystem, an up-switching subsystem and a downward packaging subsystem; the data format is unified through a distributed data management mode, the processing strategy and the acquisition protocol are normalized, so that mutual resource borrowing between servers and between storages can be completed, the whole system can achieve balance of calculation load and storage load by means of calculation resources of the servers, and the reasonable resource allocation of the whole system is completed in a horizontal calculation borrowing mode and a vertical calculation borrowing mode.
Description
Technical Field
The invention relates to the field of power grid data processing, in particular to a distributed power grid data acquisition system.
Background
The power network is divided into a production network and an information network, the power production network is expanded along with the gradual expansion of the construction scale of the power grid, the power production network is expanded synchronously and rapidly along with the synchronous expansion of the production service range and the service variety, and meanwhile, the power production network is independent of each other according to the current situation that a plurality of networks are isolated from the service application according to the regional division.
The huge network structure is needed to build a network management system to ensure the stability of network operation. The existing network operation monitoring mode is to deploy an independent network management system in each independent network to monitor and manage all network devices in the network architecture.
The network management systems are independently deployed between different networks, the data of each sub-network device is independently stored in the respective network management system by adopting a mode of collecting and processing single-network data in a centralized manner, and the network management system is only responsible for data analysis and application of network devices in the network. Therefore, from the aspect of investment construction, a plurality of sets of systems and servers are required to be constructed when a plurality of networks exist, and the resources cannot be fully shared; from the aspect of application construction, the system expansibility is poor, and fusion expansion of the application cannot be realized; from the aspect of data sharing, the model and the data are independently stored, so that overall business cannot be macroscopically mastered and comprehensively analyzed; and the operation and maintenance are difficult, and multiple sets of systems are required to be maintained simultaneously.
More importantly, because of different formats, different processing logic and different demands, the computing power resources and the storage resources cannot be coordinated and configured, so that when part of servers are busy, the servers are in an idle state, and serious waste of resources is caused.
Disclosure of Invention
In view of this, the present invention aims to provide a distributed collection system for grid data.
In order to solve the technical problems, the technical scheme of the invention is as follows: the distributed acquisition system for the power grid data is applied to a distributed acquisition network, the distributed acquisition network is provided with a plurality of acquisition nodes and processing nodes corresponding to a power supply grid, the acquisition nodes are provided with acquisition ends, and the processing nodes are provided with processing ends, and the distributed acquisition system comprises an acquisition end configuration subsystem, a server configuration subsystem, a transverse scheduling subsystem, an up-switching subsystem and a downward packaging subsystem;
the acquisition terminal configuration subsystem comprises an access management module and a protocol calling module; the acquisition terminal configuration subsystem is configured with an acquisition type database and a protocol association database, the acquisition type database stores identification conditions and acquisition type information corresponding to the identification conditions, the protocol association database is configured with a plurality of acquisition type information and acquisition communication protocols corresponding to the acquisition type information, the access management module is used for verifying identification characteristic information generated by the acquisition terminal, when the identification characteristic information accords with the corresponding identification conditions, the acquisition terminal acquires the corresponding acquisition type information and accesses the corresponding acquisition terminal into the distributed acquisition network, and the protocol retrieval module retrieves the corresponding acquisition communication protocols from the protocol association database according to the acquired acquisition type information;
the server configuration subsystem comprises a topology management module, a protocol configuration module and a processing strategy configuration module, wherein the topology management module is configured with a distributed network model of a distributed acquisition network, the distributed network model reflects the topological association relationship between an acquisition end and a processing end, and the topology management module configures a communication level for the processing end according to the distributed network model; the protocol configuration module configures a corresponding acquisition communication protocol for the processing end according to the topological association relationship between the acquisition end and the processing end; the processing strategy configuration module configures a corresponding processing strategy for the processing end according to the processing requirement of the processing end;
the transverse scheduling subsystem is configured with transverse scheduling triggering conditions, when the working state of the processing end meets the transverse scheduling triggering conditions, the transverse scheduling subsystem of the processing end works, the transverse scheduling subsystem is configured with a transverse relational database, the transverse relational database is configured with a plurality of transverse association groups, the transverse association groups are internally configured with numbers of the processing ends belonging to the same communication level, and each processing end in the distributed acquisition network at least belongs to one transverse association group; the transverse scheduling subsystem comprises a transverse positioning module, a preloading module and a transverse executing module, wherein the transverse positioning module is configured with an idle judgment strategy, a processing end in an idle state in a transverse association group is screened to be used as a transverse processing target through the idle judgment strategy, a transverse scheduling command is sent to the transverse processing target, and when the transverse processing target receives the transverse scheduling command, the preloading module loads a corresponding processing strategy from the processing end of the last communication level of the transverse processing target; the transverse execution module is configured with transverse scheduling screening conditions, and the transverse execution module sends the data tasks meeting the transverse scheduling screening conditions to corresponding transverse processing targets;
the up-switching subsystem is configured with up-switching trigger conditions, when the working state of a processing end meets the up-switching trigger conditions, the up-switching subsystem of the processing end works, the up-switching subsystem comprises a multiplexing determination module and a switching execution module, the processing strategy comprises a plurality of processing steps, the multiplexing determination module is configured with multiplexing characteristics and multiplexing screening conditions, the multiplexing determination module is used for marking the processing steps conforming to the multiplexing characteristics, the marked processing steps are screened through the multiplexing screening conditions to obtain target steps, and the switching execution module switches the target steps from the processing strategy to the processing strategy corresponding to the processing end of the last communication level to be executed;
the downward packaging subsystem is configured with downward packaging triggering conditions, when the working state of the processing end meets the downward triggering conditions, the downward packaging subsystem of the processing end works, the downward packaging subsystem comprises a task packaging module, a task downloading module and a channel expansion module, the task packaging module is configured with task judging conditions, the task packaging module packages a data task and a corresponding processing strategy which meet the task judging conditions into a downloading data packet, the task downloading module sends the downloading data packet to the processing end of the next communication level of the processing end, and the processing end which receives the downloading data packet processes the data task according to the corresponding processing strategy to generate a data result; the channel expansion module configures a forwarding strategy, the forwarding strategy comprises verification conditions, and when the received data result meets the verification conditions, the data result is forwarded through the forwarding strategy.
Further, the transverse scheduling triggering condition comprises a first local level triggering threshold and a first lower level triggering threshold, and the transverse scheduling subsystem obtains the load condition of the processing end and generates a first local level load value, and simultaneously obtains the load condition of the processing end of the next communication level of the processing end and generates a first lower level load value; when the first local level load value is higher than the first local level trigger threshold value and the first lower level load value is higher than the first lower level trigger threshold value, the processing end is considered to meet the transverse scheduling trigger condition;
the up-switch triggering condition comprises a second local triggering threshold value and a second upper triggering threshold value, the transverse scheduling subsystem obtains the load condition of the processing end and generates a second local load value, and simultaneously obtains the load condition of the processing end of the lower upper communication level of the processing end and generates a second upper load value; when the second local level load value is higher than the second local level trigger threshold and the second upper level load value is lower than the second upper level trigger threshold, the processing end is considered to meet the up-switch trigger condition;
the downward packaging triggering condition comprises a third local level triggering threshold value and a third lower level triggering threshold value, the downward packaging subsystem obtains the load condition of the processing end and generates a third local level load value, and simultaneously obtains the load condition of the processing end of the next communication level of the processing end and generates a third local level triggering threshold value; and when the third local level load value is higher than the third local level trigger threshold and the third lower level load value is lower than the third lower level trigger threshold, the processing end is considered to meet the downward package trigger condition.
Further, the server configuration subsystem further includes a transmission loss database, where the transmission loss database stores transmission loss characteristics of a topological association relationship between the processing ends, and the transmission loss characteristics reflect transmission loss of the processing ends for communication through the topological relationship.
Further, the transverse scheduling subsystem is configured with a transverse partitioning strategy and a partitioning database, the partitioning database is provided with a complementary relation for storing power consumption types, the complementary relation for the power consumption types comprises two power supply types and corresponding complementary values, the transverse partitioning strategy obtains processing ends with the same last communication level, and the processing ends with the complementary loss values smaller than complementary reference values are partitioned into the same transverse association group through a loss calculation algorithm according to complementary loss values between the complementary values and transmission loss characteristic calculation processing ends.
Further, the acquisition end configuration subsystem comprises a priority value configuration module, and the priority value configuration module is used for configuring a transmission priority value for a corresponding data task when the acquisition end generates the data task.
Further, the transverse scheduling screening condition is configured with a transverse priority reference value, and when the transmission priority value of the corresponding data task is smaller than the transverse priority reference value, the data task is judged to accord with the transverse scheduling screening condition, and the transverse priority reference value is generated according to the busy state of the corresponding processing end.
Further, the multiplexing filtering condition is configured with a multiplexing saturation reference value, the multiplexing saturation reference value is generated according to the busy state of the corresponding processing end, each processing step is configured with a multiplexing load value, and the processing step of determining that the sum of the multiplexing load values is smaller than the multiplexing saturation reference value by the multiplexing filtering condition is the target step.
Further, the multiplexing characteristic is that the result corresponding to the processing step needs to be sent to the processing end of the previous communication level.
Further, the task judgment condition comprises a storage characteristic and a transmission characteristic, wherein the storage characteristic is that the data result needs to be stored, and the transmission characteristic is that the data result needs to be transmitted to another processing end; and when the storage characteristics or the transmission characteristics of the storage task exist, the task judgment condition is met.
Further, the task packaging module configures an identification mark for the downloaded data packet, the channel expansion module is configured with a preset channel period, and when the processing end receives a data result with the identification mark in the channel period, the processing end judges that the data result meets the verification condition.
The technical effects of the invention are mainly as follows: the data format is unified through a distributed data management mode, the processing strategy and the acquisition protocol are normalized, so that mutual resource borrowing between servers and between storages can be completed, the whole system can achieve balance of calculation load and storage load by means of calculation resources of the servers, and the reasonable resource allocation of the whole system is completed in a horizontal calculation borrowing mode and a vertical calculation borrowing mode.
Drawings
Fig. 1: the invention relates to an architecture schematic diagram of a power grid data distributed acquisition system;
fig. 2: the invention collects the topological schematic diagram of the terminal configuration subsystem;
fig. 3: the invention discloses a topological schematic diagram of a server configuration subsystem;
fig. 4: the invention relates to a topological schematic diagram of a transverse scheduling subsystem;
fig. 5: the invention switches over the subsystem topological schematic diagram upwards;
fig. 6: the invention encapsulates subsystem topology diagrams downwards.
Reference numerals: 100. the acquisition end configures a subsystem; 101. a collection type database; 102. a protocol association database; 110. an access management module; 120. a protocol calling module; 130. a priority value configuration module; 200. a server configuration subsystem; 201. a transmission loss database; 210. a topology management module; 220. a protocol configuration module; 230. a processing strategy configuration module; 300. a lateral scheduling subsystem; 301. a lateral relationship database; 310. a lateral positioning module; 320. a pre-loading module; 330. a lateral execution module; 400. an up-switch subsystem; 410. a multiplexing determination module; 420. a switching execution module; 500. a downward encapsulation subsystem; 510. a task packaging module; 520. a task lowering module; 530. and a channel expansion module.
Detailed Description
The following detailed description of the invention is provided in connection with the accompanying drawings to facilitate understanding and grasping of the technical scheme of the invention.
The distributed power grid data acquisition system is applied to a distributed acquisition network, the distributed acquisition network is provided with a plurality of acquisition nodes and processing nodes corresponding to a power supply grid, the acquisition nodes are provided with acquisition ends, the processing nodes are provided with processing ends, and the distributed power grid data acquisition system comprises an acquisition end configuration subsystem 100, a server configuration subsystem 200, a transverse scheduling subsystem 300, an up-switching subsystem 400 and a downward packaging subsystem 500; firstly, a distributed acquisition network is arranged corresponding to a power supply grid, because the power supply grid has a plurality of acquisition points and a terminal is required to perform analysis processing so as to facilitate timely scheduling, maintenance and adjustment, the distributed acquisition network is a rudiment generated by a smart grid, but at present, because of the independent network, formats and information recording types among data are different, and a server and storage resources cannot be borrowed from each other.
The acquisition end configuration subsystem 100 includes an access management module 110 and a protocol retrieval module 120; the acquisition terminal configuration subsystem 100 is configured with an acquisition type database 101 and a protocol association database 102, the acquisition type database 101 stores identification conditions and acquisition type information corresponding to the identification conditions, the protocol association database 102 is configured with a plurality of acquisition type information and acquisition communication protocols corresponding to the acquisition type information, the access management module 110 is used for verifying identification characteristic information generated by an acquisition terminal, when the identification characteristic information accords with the corresponding identification conditions, the corresponding acquisition type information is acquired, the corresponding acquisition terminal is accessed to the distributed acquisition network, and the protocol acquisition module 120 acquires the corresponding acquisition communication protocols from the protocol association database 102 according to the acquired acquisition type information; for example, the processing end is replaced, the physical address is adjusted, a new acquisition end is integrated, and other matters have independent data retention and management, and correspondingly set access management, so that the acquisition type of each acquisition end is guaranteed to be recorded through a system, the uniformity of data format is guaranteed, the data is convenient to process, the protocol is uniformly configured through the background, the identification is carried out through the identification characteristic information, the identification characteristic information can be the product number of the product, whether the corresponding product passes through the recording is determined through the number, the acquisition system is accessed after the recording is carried out, the data format is unified, the acquisition system automatically invokes the corresponding protocol, and thus, the protocol is not required to be reconfigured for each processing end corresponding to the acquisition end, and the efficiency and the reliability are improved. In one embodiment, the collecting-end configuration subsystem 100 includes a priority value configuration module 130, where the priority value configuration module 130 is configured to configure a transmission priority value for a corresponding data task when the collecting-end generates the data task. The priority value configuration module 130 generates a corresponding transmission priority value according to the data task, so that a basis can be provided for scheduling the data task, and the processing end can determine a corresponding priority sequence when the data contends.
The server configuration subsystem 200 includes a topology management module 210, a protocol configuration module 220, and a processing policy configuration module 230, where the topology management module 210 configures a distributed network model of a distributed acquisition network, the distributed network model reflects a topology association relationship between an acquisition end and a processing end, and the topology management module 210 configures a communication hierarchy for the processing end according to the distributed network model; the protocol configuration module 220 configures a corresponding acquisition communication protocol for the processing end according to the topological association relationship between the acquisition end and the processing end; the processing policy configuration module 230 configures a corresponding processing policy for the processing end according to the processing requirement of the processing end; the server configuration subsystem 200 is aimed at configuring a server, so that the server configuration subsystem 200 aims at forming a corresponding distributed network model through the topology management module 210, so that the positions of the acquisition end and the processing end can be marked, more importantly, the relationship between the processing ends can be obtained, the independent acquisition end configuration subsystem 100 can determine the relative relationship through the network model configured by the topology management module 210 when adjusting the network structure, more importantly, the corresponding communication level is determined, that is, the basis is provided for the subsequent data processing call, the communication level is based on the acquisition end, the acquisition end is directly connected with the acquisition end and belongs to the first communication level, the communication level is connected with the first communication level and is connected with the second communication level, and in turn, if a processing end is connected with the acquisition end of the first communication level and the processing end of the second communication level, the relative relationship is the first communication level with the acquisition end, and the processing end is the third communication level. The processing strategy is generated according to the requirements of the processing end, generally follows two principles, if a communication level of a data and a communication level of a current level are required, the processing strategy is set at least at the current level, the processing strategy is a corresponding step reflecting how the processing end processes the data task so as to obtain the data result, and the requirements of the power grid data management system on the processing strategy and the data result are different, so that the processing strategy is not limited. In one embodiment, the server configuration subsystem 200 further includes a transmission loss database 201, where the transmission loss database 201 stores transmission loss characteristics of a topological association between processing ends, and the transmission loss characteristics reflect transmission loss of communications by the processing ends through the topological association. The transmission loss database 201 is used for judging the transmission loss result, the transmission loss characteristics are related to the information such as the communication type, the data transmission mode, the protocol, the physical distance of communication, the intermediate equipment and the like, and as the information is known information, the information is reflected in the data content by the transmission loss characteristics, and the transmission loss characteristics can judge the corresponding transmission loss, so that the quantification result is convenient.
The transverse scheduling subsystem 300 is configured with a transverse scheduling triggering condition, when the working state of a processing end meets the transverse scheduling triggering condition, the transverse scheduling subsystem 300 of the processing end works, the transverse scheduling subsystem 300 is configured with a transverse relation database 301, the transverse relation database 301 is configured with a plurality of transverse association groups, the transverse association groups are internally configured with numbers of the processing ends belonging to the same communication level, and each processing end in the distributed acquisition network at least belongs to one transverse association group; the lateral scheduling subsystem 300 includes a lateral positioning module 310, a preloading module 320, and a lateral execution module 330, where the lateral positioning module 310 is configured with an idle judgment policy, and the idle judgment policy screens a processing end in an idle state in a lateral association group as a lateral processing target and sends a lateral scheduling command to the lateral processing target, and when the lateral processing target receives the lateral scheduling command, the preloading module 320 loads a corresponding processing policy from a processing end of a previous communication level of the lateral processing target; the lateral execution module 330 is configured with a lateral scheduling screening condition, and the lateral execution module 330 sends the data task meeting the lateral scheduling screening condition to a corresponding lateral processing target; the transverse scheduling subsystem 300 is configured at the corresponding processing end, and determines whether the situation of the corresponding processing end meets the transverse scheduling triggering condition in real time, when the busyness of the processing end reaches the transverse scheduling triggering condition, the corresponding transverse association group is set to process the data, firstly, which transverse association group the data belongs to is judged in advance, then the load of the transverse association group is judged, the actual load situation of the target server in the transverse association group can be judged through the idle judgment strategy, if the corresponding server is in an idle state, the transverse scheduling command is sent to the transverse processing target, and the configuration logic of the processing strategy in the invention needs to be described, the last communication level server configures all the processing strategies of each relative next communication level, so that the scheduling of the processing strategies can be realized, for example, the processing end B2 comprises the processing strategies of the processing end A1 and the processing end A2, when the A1 sends the transverse scheduling command to the A2, the processing strategy can be loaded at the A2, and then the transverse execution module 330 of the A1 sends the data task to the A2, and the processing strategy and the data task can be processed simultaneously. The transverse scheduling triggering condition comprises a first local level triggering threshold value and a first lower level triggering threshold value, and the transverse scheduling subsystem 300 obtains the load condition of the processing end and generates a first local level load value, and simultaneously obtains the load condition of the processing end of the next communication level of the processing end and generates a first lower level load value; when the first local level load value is higher than the first local level trigger threshold value and the first lower level load value is higher than the first lower level trigger threshold value, the processing end is considered to meet the transverse scheduling trigger condition; the first is that the load of the present stage is higher, and the second is that the load of the lower stage is higher, because the resources of the transverse scheduling server and the storage resources are more lost from the perspective of resource priority configuration, the transverse scheduling strategy is triggered only when the present stage and the lower stage cannot be processed, particularly by setting two thresholds, the load value of the processing end is generated in real time, and the details are not repeated. In one embodiment, the transverse scheduling subsystem 300 is configured with a transverse partitioning strategy and a partitioning database, the partitioning database is provided with a complementary relation of stored electricity types, the complementary relation of electricity types includes two power supply types and corresponding complementary values, the transverse partitioning strategy obtains processing ends with the same last communication level, and the processing ends with complementary loss values smaller than complementary reference values are partitioned into the same transverse association group according to complementary loss values between the complementary values and transmission loss characteristic calculation processing ends by a loss calculation algorithm. Through the transverse division strategy and the division database of the transverse scheduling subsystem 300, firstly, the division logic is the type of power consumption, for example, idle state and transmission loss are required to be considered in transverse scheduling, and also is the type of a power supply area, the type of the power supply area determines the acquisition peak value of data to be acquired and the load habit of the system, so that the processing ends corresponding to the power supply areas corresponding to different types correspondingly set complementary values, for example, factories and residential areas according to complementary relations, the time nodes of the data acquisition peak value are different, the complementary values are relatively higher, the complementary values are lower if business houses and residential areas are different, and whether the data are lower than the reference is judged through the calculation of the complementary loss values, if the data are lower than the reference, the data burden of the transverse scheduling is smaller, and the transverse association group is divided. In one embodiment, the transverse scheduling screening condition is configured with a transverse priority reference value, and when the transmission priority value of the corresponding data task is smaller than the transverse priority reference value, the data task is judged to conform to the transverse scheduling screening condition, and the transverse priority reference value is generated according to the busy state of the corresponding processing end. And judging whether the data task is under a load scheduling condition or not through the configuration of the transverse priority value, and processing the data with lower priority value in a transverse scheduling mode.
The up-switch subsystem 400 is configured with an up-switch trigger condition, when the working state of a processing end meets the up-switch trigger condition, the up-switch subsystem 400 of the processing end works, the up-switch subsystem 400 comprises a multiplexing determination module 410 and a switch execution module 420, the processing strategy comprises a plurality of processing steps, the multiplexing determination module 410 is configured with multiplexing characteristics and multiplexing screening conditions, the multiplexing determination module 410 is used for marking the processing steps conforming to the multiplexing characteristics, and screening the marked processing steps through the multiplexing screening conditions to obtain a target step, and the switch execution module 420 switches the target step from the processing strategy to the processing strategy corresponding to the processing end of the previous communication level for execution; the up-switch subsystem 400 is configured to, when the processing end has a requirement of up-switch, for example, the processing end is busy, and as mentioned above, the upper processing end has a processing policy of the lower processing end, and if the data task meets the multiplexing feature, that is, the upper processing end also needs to use the data result, the multiplexing feature can be processed by the existing data of the upper processing end at this time, so as to buffer the communication pressure of the lower processing end, specifically, whether the data has the multiplexing feature is judged first, then the corresponding processing step is determined by multiplexing screening conditions, which step can be switched, and then a part of the processing steps are switched to the processing end of the upper communication level for processing. The up-switch triggering condition includes a second local triggering threshold and a second upper triggering threshold, and the transverse scheduling subsystem 300 obtains the load condition of the processing end and generates a second local load value, and simultaneously obtains the load condition of the processing end of the lower upper communication level of the processing end and generates a second upper load value; when the second local level load value is higher than the second local level trigger threshold and the second upper level load value is lower than the second upper level trigger threshold, the processing end is considered to meet the up-switch trigger condition; the up-switch triggering condition needs to consider the load of the upper level and the local load, and when the upper level load is lower and the local load is higher, the corresponding up-switch strategy can be triggered. In one embodiment, the multiplexing filtering condition is configured with a multiplexing saturation reference value, the multiplexing saturation reference value is generated according to the busy state of the corresponding processing end, each processing step is configured with a multiplexing load value, and the processing step of determining that the sum of the multiplexing load values is smaller than the multiplexing saturation reference value is the target step. By setting in this way, the load of single switching is judged, a multiplexing saturation reference value is set, then a corresponding load value is configured corresponding to each processing step, the sum of multiplexing load values reaches the standard, namely, the corresponding processing end reaches the configurable standard, the multiplexing load value is generated according to the data of the processing data quantity, the processing time, the transmission time and the like of the processing step, and the multiplexing saturation reference value changes along with the busy state of the processing end of the upper-level communication level. And the multiplexing characteristic is that the result corresponding to the processing step needs to be sent to the processing end of the previous communication level. That is, the step of switching is to use the data required by the processing end of the previous communication layer, so that the number of data transmission times during switching can be reduced.
The downward packaging subsystem 500 is configured with a downward packaging triggering condition, when the working state of the processing end meets the downward triggering condition, the downward packaging subsystem 500 of the processing end works, the downward packaging subsystem 500 comprises a task packaging module 510, a task downloading module 520 and a channel expanding module 530, the task packaging module 510 is configured with a task judging condition, the task packaging module 510 packages a data task and a corresponding processing strategy which meet the task judging condition into a downloading data packet, the task downloading module 520 sends the downloading data packet to the processing end of the next communication level of the processing end, and the processing end which receives the downloading data packet processes the data task according to the corresponding processing strategy to generate a data result; the channel expansion module 530 configures a forwarding policy, where the forwarding policy includes a verification condition, and when the received data result meets the verification condition, the data result is forwarded through the forwarding policy. The downward packaging subsystem 500 is configured to trigger a corresponding task by a downward packaging trigger condition when a busy condition occurs at a processing end of a previous communication level, and specifically packages a task, where the packaging content includes a processing policy and a corresponding data task, so as to form a processing data packet, process the processing end of the next communication level, and then, after the processing end processes the task through a configuration channel, determine corresponding result data, and directly forward the data, without the need of verifying and analyzing an original communication protocol, because the data format is the same, re-analyzing may cause an extra data burden, for example, when a C1 processing end issues a situation that a data packet is dropped to B1, and the data result is to be sent to D1, and at this time, the forwarding of the data may be directly performed by the channel expansion module 530, so as to improve the reliability of the data. The downward package triggering condition includes a third local level triggering threshold and a third lower level triggering threshold, where the downward package subsystem 500 obtains a load condition of the processing end and generates a third local level load value, and simultaneously obtains a load condition of the processing end of a next communication level of the processing end and generates a third local level triggering threshold; and when the third local level load value is higher than the third local level trigger threshold and the third lower level load value is lower than the third lower level trigger threshold, the processing end is considered to meet the downward package trigger condition. The downward packaging triggering condition is that the processing of the data task can be completed in a downward packaging mode when the load of the lower level is higher and the load of the lower level is smaller. The task judgment condition comprises a storage characteristic and a transmission characteristic, wherein the storage characteristic is that the data result needs to be stored, and the transmission characteristic is that the data result needs to be transmitted to another processing end; and when the storage characteristics or the transmission characteristics of the storage task exist, the task judgment condition is met. The data is stored or transmitted to other processing terminals through the storage characteristic and the transmission characteristic of the task judgment condition, the storage characteristic and the transmission characteristic are associated with the data in advance in the process of collecting information, the data has low requirements on the processing terminals, the key is that the processing efficiency can be greatly improved in parallel with the forwarding strategy, and if the data only needs to be processed locally, the data is preferably processed at the local processing terminals, and the data is not packaged and put down. In one embodiment, the task packaging module 510 configures an identification tag for the dropped data packet, and the channel expansion module 530 configures a preset channel period, and when the processing end receives the data result with the identification tag in the channel period, it is determined that the verification condition is met. Through the configuration of the identification mark, additional complex verification and processing logic is not needed, judgment is directly carried out, and processing efficiency is improved.
Of course, the above is only a typical example of the invention, and other embodiments of the invention are also possible, and all technical solutions formed by equivalent substitution or equivalent transformation fall within the scope of the invention claimed.
Claims (10)
1. The utility model provides a distributed collection system of electric wire netting data, is applied to distributed collection network, distributed collection network corresponds the power supply electric wire netting and disposes a plurality of collection nodes and processing node, collection node disposes the collection end, processing node disposes the processing end, its characterized in that: the system comprises a collection terminal configuration subsystem, a server configuration subsystem, a transverse scheduling subsystem, an up-switching subsystem and a down-packaging subsystem;
the acquisition terminal configuration subsystem comprises an access management module and a protocol calling module; the acquisition terminal configuration subsystem is configured with an acquisition type database and a protocol association database, the acquisition type database stores identification conditions and acquisition type information corresponding to the identification conditions, the protocol association database is configured with a plurality of acquisition type information and acquisition communication protocols corresponding to the acquisition type information, the access management module is used for verifying identification characteristic information generated by the acquisition terminal, when the identification characteristic information accords with the corresponding identification conditions, the acquisition terminal acquires the corresponding acquisition type information and accesses the corresponding acquisition terminal into the distributed acquisition network, and the protocol retrieval module retrieves the corresponding acquisition communication protocols from the protocol association database according to the acquired acquisition type information;
the server configuration subsystem comprises a topology management module, a protocol configuration module and a processing strategy configuration module, wherein the topology management module is configured with a distributed network model of a distributed acquisition network, the distributed network model reflects the topological association relationship between an acquisition end and a processing end, and the topology management module configures a communication level for the processing end according to the distributed network model; the protocol configuration module configures a corresponding acquisition communication protocol for the processing end according to the topological association relationship between the acquisition end and the processing end; the processing strategy configuration module configures a corresponding processing strategy for the processing end according to the processing requirement of the processing end;
the transverse scheduling subsystem is configured with transverse scheduling triggering conditions, when the working state of the processing end meets the transverse scheduling triggering conditions, the transverse scheduling subsystem of the processing end works, the transverse scheduling subsystem is configured with a transverse relational database, the transverse relational database is configured with a plurality of transverse association groups, the transverse association groups are internally configured with numbers of the processing ends belonging to the same communication level, and each processing end in the distributed acquisition network at least belongs to one transverse association group; the transverse scheduling subsystem comprises a transverse positioning module, a preloading module and a transverse executing module, wherein the transverse positioning module is configured with an idle judgment strategy, a processing end in an idle state in a transverse association group is screened to be used as a transverse processing target through the idle judgment strategy, a transverse scheduling command is sent to the transverse processing target, and when the transverse processing target receives the transverse scheduling command, the preloading module loads a corresponding processing strategy from the processing end of the last communication level of the transverse processing target; the transverse execution module is configured with transverse scheduling screening conditions, and the transverse execution module sends the data tasks meeting the transverse scheduling screening conditions to corresponding transverse processing targets;
the up-switching subsystem is configured with up-switching trigger conditions, when the working state of a processing end meets the up-switching trigger conditions, the up-switching subsystem of the processing end works, the up-switching subsystem comprises a multiplexing determination module and a switching execution module, the processing strategy comprises a plurality of processing steps, the multiplexing determination module is configured with multiplexing characteristics and multiplexing screening conditions, the multiplexing determination module is used for marking the processing steps conforming to the multiplexing characteristics, the marked processing steps are screened through the multiplexing screening conditions to obtain target steps, and the switching execution module switches the target steps from the processing strategy to the processing strategy corresponding to the processing end of the last communication level to be executed;
the downward packaging subsystem is configured with downward packaging triggering conditions, when the working state of the processing end meets the downward triggering conditions, the downward packaging subsystem of the processing end works, the downward packaging subsystem comprises a task packaging module, a task downloading module and a channel expansion module, the task packaging module is configured with task judging conditions, the task packaging module packages a data task and a corresponding processing strategy which meet the task judging conditions into a downloading data packet, the task downloading module sends the downloading data packet to the processing end of the next communication level of the processing end, and the processing end which receives the downloading data packet processes the data task according to the corresponding processing strategy to generate a data result; the channel expansion module configures a forwarding strategy, the forwarding strategy comprises verification conditions, and when the received data result meets the verification conditions, the data result is forwarded through the forwarding strategy.
2. A distributed grid data collection system according to claim 1, wherein: the transverse scheduling triggering condition comprises a first local triggering threshold and a first lower triggering threshold, the transverse scheduling subsystem obtains the load condition of the processing end and generates a first local load value, and simultaneously obtains the load condition of the processing end of the next communication level of the processing end and generates a first lower load value; when the first local level load value is higher than the first local level trigger threshold value and the first lower level load value is higher than the first lower level trigger threshold value, the processing end is considered to meet the transverse scheduling trigger condition;
the up-switch triggering condition comprises a second local triggering threshold value and a second upper triggering threshold value, the transverse scheduling subsystem obtains the load condition of the processing end and generates a second local load value, and simultaneously obtains the load condition of the processing end of the lower upper communication level of the processing end and generates a second upper load value; when the second local level load value is higher than the second local level trigger threshold and the second upper level load value is lower than the second upper level trigger threshold, the processing end is considered to meet the up-switch trigger condition;
the downward packaging triggering condition comprises a third local level triggering threshold value and a third lower level triggering threshold value, the downward packaging subsystem obtains the load condition of the processing end and generates a third local level load value, and simultaneously obtains the load condition of the processing end of the next communication level of the processing end and generates a third local level triggering threshold value; and when the third local level load value is higher than the third local level trigger threshold and the third lower level load value is lower than the third lower level trigger threshold, the processing end is considered to meet the downward package trigger condition.
3. A distributed grid data collection system according to claim 1, wherein: the server configuration subsystem further comprises a transmission loss database, wherein the transmission loss database stores transmission loss characteristics of topological association relations among the processing ends, and the transmission loss characteristics reflect transmission loss of communication of the processing ends through the topological association relations.
4. A distributed grid data collection system according to claim 3 wherein: the transverse scheduling subsystem is configured with a transverse partitioning strategy and a partitioning database, the partitioning database is provided with a complementary relation for storing power consumption types, the complementary relation for the power consumption types comprises two power supply types and corresponding complementary values, the transverse partitioning strategy obtains processing ends with the same last communication level, and the processing ends with the complementary values smaller than complementary reference values are partitioned into the same transverse association group according to complementary loss values among the complementary values and transmission loss characteristic calculation processing ends through a loss calculation algorithm.
5. A distributed grid data collection system according to claim 1, wherein: the acquisition end configuration subsystem comprises a priority value configuration module, wherein the priority value configuration module is used for configuring a transmission priority value for a corresponding data task when the acquisition end generates the data task.
6. A distributed grid data collection system according to claim 5 wherein: and the transverse scheduling screening conditions are configured with transverse priority reference values, and when the transmission priority value of the corresponding data task is smaller than the transverse priority reference value, the data task is judged to accord with the transverse scheduling screening conditions, and the transverse priority reference value is generated according to the busy state of the corresponding processing end.
7. A distributed grid data collection system according to claim 1, wherein: the multiplexing screening condition is configured with a multiplexing saturation reference value, the multiplexing saturation reference value is generated according to the busy state of the corresponding processing end, each processing step is configured with a multiplexing load value, and the processing step of determining that the sum of the multiplexing load values is smaller than the multiplexing saturation reference value is the target step.
8. A distributed grid data collection system according to claim 1, wherein: the multiplexing characteristic is that the result corresponding to the processing step needs to be sent to the processing end of the previous communication level.
9. A distributed grid data collection system according to claim 1, wherein: the task judgment condition comprises a storage characteristic and a transmission characteristic, wherein the storage characteristic is that the data result needs to be stored, and the transmission characteristic is that the data result needs to be transmitted to another processing end; and when the storage characteristics or the transmission characteristics of the storage task exist, the task judgment condition is met.
10. A distributed grid data collection system according to claim 1, wherein: the task packaging module configures an identification mark for the downloaded data packet, the channel expansion module is configured with a preset channel period, and when the processing end receives a data result with the identification mark in the channel period, the processing end judges that the data result meets the verification condition.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110495379.8A CN113242146B (en) | 2021-05-07 | 2021-05-07 | Distributed acquisition system for power grid data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110495379.8A CN113242146B (en) | 2021-05-07 | 2021-05-07 | Distributed acquisition system for power grid data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113242146A CN113242146A (en) | 2021-08-10 |
| CN113242146B true CN113242146B (en) | 2023-05-09 |
Family
ID=77132511
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110495379.8A Active CN113242146B (en) | 2021-05-07 | 2021-05-07 | Distributed acquisition system for power grid data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113242146B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113675853B (en) * | 2021-08-24 | 2023-06-20 | 国网福建省电力有限公司营销服务中心 | Energy internet-oriented electricity consumption information acquisition system |
| CN117856453B (en) * | 2024-03-05 | 2024-05-31 | 四川川能智网实业有限公司 | Smart power grids control and management system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101540505A (en) * | 2009-01-09 | 2009-09-23 | 南京南瑞继保电气有限公司 | Building method of multistage multi-region interconnected network data model |
| CN202166879U (en) * | 2011-03-18 | 2012-03-14 | 沈阳易讯科技股份有限公司 | Power intelligent dispatch management system |
| US8250131B1 (en) * | 2004-12-08 | 2012-08-21 | Cadence Design Systems, Inc. | Method and apparatus for managing a distributed computing environment |
| WO2017222763A2 (en) * | 2016-05-31 | 2017-12-28 | Vapor IO Inc. | Autonomous distributed workload and infrastructure scheduling |
| WO2018129829A1 (en) * | 2017-01-12 | 2018-07-19 | 沃太能源南通有限公司 | New type micro-network system and system-based networking and scheduling method |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9373960B2 (en) * | 2013-03-13 | 2016-06-21 | Oracle International Corporation | Computerized system and method for distributed energy resource scheduling |
| CN105205231B (en) * | 2015-09-06 | 2018-11-09 | 中国电力科学研究院 | A kind of power distribution network Digital Simulation System based on DCOM |
-
2021
- 2021-05-07 CN CN202110495379.8A patent/CN113242146B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8250131B1 (en) * | 2004-12-08 | 2012-08-21 | Cadence Design Systems, Inc. | Method and apparatus for managing a distributed computing environment |
| CN101540505A (en) * | 2009-01-09 | 2009-09-23 | 南京南瑞继保电气有限公司 | Building method of multistage multi-region interconnected network data model |
| CN202166879U (en) * | 2011-03-18 | 2012-03-14 | 沈阳易讯科技股份有限公司 | Power intelligent dispatch management system |
| WO2017222763A2 (en) * | 2016-05-31 | 2017-12-28 | Vapor IO Inc. | Autonomous distributed workload and infrastructure scheduling |
| WO2018129829A1 (en) * | 2017-01-12 | 2018-07-19 | 沃太能源南通有限公司 | New type micro-network system and system-based networking and scheduling method |
Non-Patent Citations (1)
| Title |
|---|
| 云技术在电网资源调度系统中的应用研究;王桂凤;耿向华;;电源技术(第11期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113242146A (en) | 2021-08-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113242146B (en) | Distributed acquisition system for power grid data | |
| CN106100999B (en) | Image network flow control methods in a kind of virtualized network environment | |
| CN102692897B (en) | Internet of Things based industrial equipment monitoring system and method thereof | |
| CN106341337B (en) | Flow detection and control mechanism and method capable of realizing application awareness under SDN | |
| CN109150604B (en) | SDN-based power communication network system and cross-domain slicing method | |
| CN110224944B (en) | Distributed network flow control method and device | |
| CN113708974A (en) | Edge cloud network system based on self-adaptive networking and cooperation method | |
| EP2179610A1 (en) | A method and apparatus for collecting performance management data in communication networks | |
| CN112165479A (en) | Cloud edge cooperative management and control system of power distribution network | |
| CN107248960B (en) | Internet of things data reporting control method based on transmission duration and forwarding node | |
| CN112804280A (en) | Electric power Internet of things system and data processing method thereof | |
| CN102045197A (en) | Alarm data synchronization method and network management system | |
| CN105306622A (en) | Cloud network convergence domain name analysis system and DNS service method thereof | |
| CN104283802A (en) | Neighbor discovery method and device | |
| CN102404760B (en) | Method and device for real-time measurement of system performance | |
| CN102082701B (en) | Method for storing network element positional information and apparatus for same | |
| CN113036930B (en) | Power grid data communication management system | |
| CN107612714B (en) | Automatic topological structure implementation method and system | |
| CN113595793B (en) | FPGA-based SDN network policy consistency segmentation verification method | |
| CN110035278A (en) | Digital video monitoring method, system and its monitoring device, monitoring center | |
| CN102082677A (en) | Alarm information processing method, device and system | |
| CN107360217B (en) | Data reporting method and system based on geographic position and time | |
| KR20230131169A (en) | System and method for enabling mobility load balancing in self-organizing networks | |
| CN101227326A (en) | Method and system for supplementary reporting of performance data | |
| CN102025622A (en) | Method for realizing low-power consumption routing based on cognitive network |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |