CN111798655B - Operation data minute-level acquisition method suitable for power Internet of things platform area - Google Patents
Operation data minute-level acquisition method suitable for power Internet of things platform area Download PDFInfo
- Publication number
- CN111798655B CN111798655B CN202010474131.9A CN202010474131A CN111798655B CN 111798655 B CN111798655 B CN 111798655B CN 202010474131 A CN202010474131 A CN 202010474131A CN 111798655 B CN111798655 B CN 111798655B
- Authority
- CN
- China
- Prior art keywords
- acquisition
- task
- level
- data
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
- G08C19/00—Electric signal transmission systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
Abstract
The invention discloses a minute-level acquisition method of operation data suitable for a power Internet of things platform area. On the basis of overall consideration of the requirements of the electricity utilization data acquisition system and the distribution automation system on the operation data of the electric meter, and on the premise of following the relevant standards according to the existing data acquisition and transmission processes, the basic architecture design of the power internet of things is combined, so that the data of intelligent terminal equipment for different services such as the electric meter, a gateway meter, a user meter, a meter box monitoring device and the like in the power internet of things area are uniformly acquired and used as required.
Description
Technical Field
The invention relates to a minute-level acquisition method of operation data suitable for a power Internet of things platform area, and belongs to the technical field of power Internet of things information processing.
Background
At present, data acquisition of an electric power internet of things platform area mainly comprises an electricity utilization data acquisition system belonging to an electric power marketing department and a power distribution automation system belonging to an electric power operation and inspection department. The two systems are respectively constructed and independently operated, and according to different requirements of respective professional applications, the acquired data content and the acquisition frequency are overlapped and different, so that the problems of complicated types, partial function overlapping, low utilization rate of established communication resources and the like of front-end acquisition devices are caused.
With the promotion of the construction of the power internet of things, the national network company provides the requirements for breaking the professional barrier, realizing the unified acquisition of operation data and the use as required and improving the utilization rate of the device. Therefore, on the basis of the integral architecture of the power internet of things of the state network company, the power companies of various provinces (cities and autonomous regions) actively develop an edge data acquisition subsystem which uniformly acquires the operation data of the terminal equipment and provides data for different background service systems according to requirements by taking an internet of things edge agent as a support.
In order to comprehensively consider the requirements of the electricity utilization data acquisition system and the power distribution automation system on the operation data of the electric meter, technical schemes for realizing unified acquisition and on-demand use of data of intelligent terminal equipment of different services such as the electric meter, a gateway meter, a user meter, a meter box monitoring device and the like in an electric power internet of things platform area are urgently needed to be developed by technical personnel in the field.
Disclosure of Invention
The purpose is as follows: in order to overcome the defects in the prior art, on the basis of comprehensively considering the requirements of an electricity consumption data acquisition system and a power distribution automation system on the operation data of an electric meter and on the premise of following the relevant standards based on the existing data acquisition and transmission process, the design of a basic architecture of the power internet of things is combined, the method for acquiring the operation data in minutes level in an electric power internet of things area is provided, and the data of the electric meter, a gateway meter, a user meter, a meter box monitoring device and other intelligent terminal equipment with different services in the electric power internet of things area are uniformly acquired and used as required.
The technical scheme is as follows: in order to solve the technical problems, the technical scheme adopted by the invention is as follows:
a method for acquiring operation data of a power Internet of things platform area in minute-level comprises the following steps:
the intelligent terminal collects operation data in the distribution room in real time and stores the operation data in a memory of the intelligent terminal;
a plurality of acquisition levels are connected in series through communication channels in sequence;
the lowest collection level is connected with the intelligent terminal through a communication channel, and the uppermost collection level is connected with the master station system through the communication channel;
each acquisition level acquires the operation data according to different service application requirements and different acquisition periods and stores the operation data in the memories of the respective acquisition levels;
and the master station system sends running data uploading requests to corresponding acquisition layers according to different service application requirements, and the corresponding acquisition layers upload the running data in the memory to the master station system layer by layer for service application uniform calling.
As a preferable scheme: the acquisition level is provided with a periodic acquisition task system, and the periodic acquisition task system comprises the following modules:
for the upper communication module: the system comprises a configuration management module, a superior acquisition request processing module, a superior acquisition layer and a superior acquisition layer, wherein the configuration management module is used for receiving data messages sent by the superior acquisition layer, respectively sending configuration request messages and acquisition task request messages to the configuration management module and the superior acquisition request processing module, receiving response messages returned by the configuration management module and the superior acquisition request processing module, and sending the response messages to the superior acquisition layer.
A configuration management module: the system comprises a pair of upper communication modules, a configuration request message, a local configuration file, a configuration request response message and a superior acquisition level, wherein the pair of upper communication modules are used for receiving the configuration request message sent by the pair of upper communication modules, generating a configuration information copy in a memory by analyzing the configuration request message, generating the local configuration file, generating the configuration request response message according to the processing result of the configuration request message, submitting the configuration request response message to the pair of upper communication modules and sending the configuration request response message to the superior acquisition level by the pair of upper communication modules. When the local program is restarted, the local configuration file is read, and a configuration information copy is generated in the memory. When receiving the configuration request message, judging whether the configuration information is changed, if so, informing the task engine module, and regenerating the periodic collection task template set.
A task engine module: the system is used for checking the updating condition of the local configuration file in real time, generating a periodic acquisition task template set according to the local configuration file, generating acquisition tasks to be executed by contrasting each task template in the periodic acquisition task template set by taking time information generated by a local real-time clock as a reference, and storing the acquisition tasks in a task queue. Each period of collecting the task template at least comprises the following steps: triggering the time condition of the collection task, the object to be collected, the collection task failure complementary collection rule, the collection task priority definition and the collection message template.
The task scheduling and executing module: and the method is used for realizing task scheduling by adopting a multi-dimensional state machine scheduling algorithm according to whether the task in the task queue is a complementary task, the task priority and the current task execution state, and selecting the current task for execution. For the current task which is selected to be executed, the acquisition message template in the task template is acquired according to the period each time the current task is executed, the acquisition time and the check bit in the message are re-filled, so that the rapid framing of the acquired message is realized, the message is submitted to a lower communication module, and the message is sent to a lower acquisition level by the lower communication module; and then, maintaining the execution condition of the current task by receiving and analyzing the condition of the response message of the lower acquisition level. If the task is normally completed, submitting the acquired running data and the corresponding timestamp to an acquired data local storage module, storing the acquired running data and the corresponding timestamp into a local database by the acquired data local storage module, and then deleting the current task from the task queue; if the task fails to be executed, the method enters a complementary collection stage and is rescheduled by the task scheduling and executing module. And when the complementary mining task cannot be completed for a long time and the running data to be acquired exceeds the local running data storage time limit of the lower acquisition level through calculation, deleting the task from the task queue.
For the following communication modules: the system is used for realizing communication with a lower-level acquisition level, receiving an acquisition task request message sent by a task scheduling and executing module, sending the acquisition task request message to the lower-level acquisition level, receiving an acquisition task request response message returned by the lower-level acquisition level, and returning the response message to the task scheduling and executing module.
The collected data local storage module: the system comprises a task scheduling and executing module, a local database and a data processing module, wherein the task scheduling and executing module is used for receiving collected data sent by the task scheduling and executing module and storing the collected data into the local database according to a preset format; and meanwhile, receiving a data query request sent by the superior acquisition request processing module, organizing local data according to the request, and returning the local data to the superior acquisition request processing module. The collected data local storage module is also responsible for maintaining stored and transported data locally and cleaning out the overdue data periodically.
The superior acquisition request processing module: the system comprises a local storage module, an upper communication module, a collection data local storage module, a collection task request message and a collection task response message, wherein the local storage module is used for storing the operation data of the collection data local storage module, the collection task request message is used for receiving the collection task request message sent by the upper communication module, analyzing the request, organizing the collection task request response message according to the query result, submitting the collection task request response message to the upper communication module, and sending the collection task request response message to a superior collection level by the upper communication module.
As a preferable scheme: the intelligent terminal at least comprises one of an electric meter, a gateway meter, a user meter and a meter box monitoring device.
As a preferable scheme: when the upper acquisition level sends an acquisition task request message to the lower acquisition level, the lower acquisition level already has the required operation data.
As a preferable scheme: the complementary mining task comprises the following steps:
(a) and the current-level acquisition level initiates a complementary acquisition task to the next-level acquisition level through the lower communication module.
(b) The next-level acquisition level receives a data complementary acquisition task of the upper-level acquisition level through the upper-level acquisition request processing module, retrieves the stored data in a memory of the next-level acquisition level and forms a request response; when no data is requested in the local memory, NULL is returned.
(c) When the current-stage acquisition level receives the complementary acquisition data returned by the next-stage acquisition level, storing and updating the acquired acquisition request response data in a self memory, and deleting the complementary acquisition task; when the current-level acquisition level does not receive the response of the next-level acquisition level or the response content is NULL, the current-level acquisition level terminates the current complementary acquisition process, but does not delete the current complementary acquisition task.
(d) And the current-level acquisition level initiates a supplementary acquisition task again or the time limit is expired, and the current-level acquisition task is deleted.
As a preferable scheme: the initiation time of the complementary collection task should be greater than the normal collection task time + SAT.
As a preferable scheme: SAT is set to 60 seconds.
As a preferable scheme: the time synchronization precision of each acquisition level is not more than 1s, and the time of the upper acquisition level set is taken as the synchronization basis of the lower acquisition level set.
Has the advantages that: the invention provides a minute-level acquisition method of operation data suitable for a power Internet of things platform area, which has the following advantages
1. The collection requirements of service systems such as distribution and power utilization link automation, power utilization information collection and the like on the operation data are collected into an operation data complete set, so that the system software and hardware function architecture which is independently collected by the existing marketing and operation inspection departments is optimized and adjusted into a system architecture which is collected in a unified way, and the service systems can collect and use the operation data in a unified way as required.
2. The acquisition scheme of 'hierarchical acquisition' provided by the invention can solve the problem of limited single-layer acquisition period caused by low field communication rate.
When the operation data of terminal equipment such as electric meters and the like are acquired in the conventional electric power distribution room, for improving the communication reliability, the 485 serial communication rate is generally defined as 2400bits/s, so that a long time is needed for completing the acquisition task of all the operation data of the electric meters in one distribution room, and the requirement of minute-level acquisition is difficult to meet. After the hierarchical collection is adopted, the electric meters can be grouped and collected, so that the collection period of each collection node is reduced.
3. The acquisition scheme of local storage provided by the invention can solve the problem of limited single-layer acquisition period caused by low field communication rate.
Meanwhile, the data of the ammeter acquired by the node is stored locally through each acquisition node, so that a higher node of the acquisition node does not need to directly access the ammeter, the communication load of a communication link of a lower acquisition link is reduced, and the communication resources of each acquisition level can fully bear the interaction of the acquisition message of the level.
4. The exception handling and data complementing mechanism provided by the invention can realize handling and data complementing under the condition of communication interruption or abnormal equipment operation.
When the data acquisition fails due to communication interruption or equipment abnormal operation, the acquisition party of each acquisition level can initiate a complementary acquisition process according to a preset strategy. Meanwhile, the real-time performance and the reliability of the data acquisition task are considered comprehensively, and the complementary acquisition task is executed by setting an SAT (short Anormal time) mode.
Drawings
Fig. 1 is a schematic diagram of a power distribution area operation data acquisition scheme capable of meeting the requirement of minute-scale adoption according to the invention.
Fig. 2 is a schematic diagram of a power distribution room operation data minute-level acquisition scheme deployment architecture according to the present invention.
FIG. 3 is a logic diagram of a periodic acquisition task system according to the present invention.
Detailed Description
The present invention will be further described with reference to the following examples.
Example 1:
a minute-level collection method of operation data suitable for a power Internet of things platform area is provided, wherein a plurality of collection levels at least comprise: a concentrator, a collector and an edge Internet of things agent; the method comprises the following specific steps:
the intelligent terminal collects operation data in the distribution room in real time and stores the operation data in a memory of the intelligent terminal; the intelligent terminal includes: ammeter, gate table, user's table, table case monitoring devices realize acquireing operating data through the sensing part of self.
The concentrator collects the operation data collected by the intelligent terminal in the transformer area according to the service application requirement and the collection period, and stores the operation data in the memory of the concentrator;
the collector collects the operation data in the memory of the concentrator according to the service application requirement and the collection period and stores the operation data in the memory of the collector;
the edge Internet of things agent collects the running data in the memory of the collector according to the service application requirement and the collection period and stores the running data in the memory of the edge Internet of things agent;
the acquisition period is generally preset to be: 1 minute task, 15 minute task, 60 minute task, daily freezing task, monthly freezing task; the priority of each period of collection task is as follows: daily freeze task > monthly freeze task >60 minute task >15 minute task >1 minute task.
The time conditions of triggering the collection tasks of the edge internet of things agent, the collector and the concentrator are considered comprehensively, so that when the collection level sends and receives the collection messages, required running data exist on a subordinate collection level, and by taking a daily freezing task as an example, the collection time of each collection level is as follows:
at 0 point every day, the electric meter generates operation data through a sensing part of the electric meter and stores the operation data in a memory of the electric meter;
when 0 point passes 5 seconds every day, the concentrator initiates a daily frozen data acquisition task to the electric meter;
when 0 point passes 10 seconds every day, the collector initiates a daily frozen data collection task to the concentrator;
and when 15 seconds pass at 0 point every day, the IoT edge agent initiates a daily frozen data acquisition task to the acquisition unit.
And planning the local storage capacity which can be supported by the concentrator, the collector and the edge Internet of things agent for each period of collection task according to the local storage resources of the concentrator, the collector and the Internet of things edge agent which are actually put into operation.
After the normal acquisition task fails, the task enters a complementary acquisition stage, a complementary acquisition task is initiated at a preset time according to a preset strategy, and the complementary acquisition initiation time is larger than the normal acquisition task plus SAT. Taking the complementary collection of daily period data acquisition as an example:
when the number of odd numbers (/ even numbers) is 0 minute and 5 seconds every day, the concentrator initiates a daily frozen data complementary collection task to the electric meter;
when the number of odd numbers (/ even numbers) is 0 minute and 10 seconds every day, the collector initiates a daily frozen data complementary collection task to the concentrator;
and when the number of the odd (/ even) times is 0 minute and 15 seconds, the IoT edge agent initiates a daily frozen data complementary collection task to the collector.
The normal acquisition task generally takes precedence over the complementary acquisition task.
The collection tasks of all collection levels from the electric meter, the concentrator, the collector to the edge Internet of things agent are all related to time, so that time synchronization of certain precision must be realized for all the collection levels, and the time synchronization precision is superior to 1 s. The time synchronization strategy among layers is as follows: the lower level collection layer set takes the time of the upper level collection layer set as the synchronization basis.
And the master station system sends running data uploading requests to the concentrator, the collector and the edge Internet of things agent according to different service application requirements, and the corresponding concentrator, collector and edge Internet of things agent upload the running data to the master station system layer by layer for uniform calling of service applications.
Example 2:
as shown in fig. 1, the demands of the marketing service system and the distribution service system on the operation data are summarized into an operation data corpus, different acquisition periods are set for different operation data subsets in the operation data corpus, and the data items corresponding to the operation data subsets in the high-frequency acquisition period are used for mapping the same data items of the operation data subsets in the low-frequency acquisition period, so that the acquisition and storage of different operation data subsets in different acquisition levels are realized, the acquisition granularity of the low-frequency acquisition period in a minute level can be realized, and the marketing service system and the distribution service system can uniformly acquire and use the operation data as required.
As shown in fig. 2, because the number of objects (devices and parameters) to be collected in the power distribution area is large and the collection frequency is high, if a first-level collection mode is adopted, the background of the service system directly performs on-site intelligent terminal such as: the ammeter, the gate table, the user table, table case monitoring devices etc. gather, communication mode to gathering the scene is in throughput, performance requirements such as reliability are higher, can't provide low cost, high speed, high reliable collection communication mode among the practical application, consequently, adopt a plurality of collection levels, and gather operating data respectively according to different collection periods, adopt the access mode of "subregion covers, hierarchical collection", realize ammeter in the electric power platform district of difference, the gate table, intelligent terminal's such as user table and table case monitoring devices full coverage.
And each acquisition level adopts a hierarchical acquisition and local storage acquisition strategy to realize the process of operating data acquisition. Remove intelligent terminal like: outside ammeter, customs table, user's table and the table case monitoring devices, each collection level is like: the concentrator, the collector and the edge Internet of things agent all comprise an upper-level collection request processing module, a lower-level communication module and a memory.
During data acquisition, the edge Internet of things agent, the collector and the concentrator receive a superior acquisition level data acquisition task through a superior acquisition request processing module, retrieve data stored in a memory of the edge Internet of things agent, the collector and the concentrator, and form a request response; when no data is requested in the local memory, NULL is returned.
The edge Internet of things agent and the collector initiate a data collection task to the lower-level equipment through the lower communication module, and store and update self memories of the acquired collection request response data.
The concentrator directly requests data from the ammeter, the gateway meter, the user meter and the meter box monitoring device through the lower communication module, and stores and updates the acquired acquisition request response data in a memory of the concentrator.
When the data acquisition fails due to communication interruption or abnormal equipment operation and the like, the edge Internet of things agent, the acquisition device and the concentrator all record and maintain a failed acquisition task list, and for the overdue complementary acquisition task, the complementary acquisition task is directly deleted. For the tasks within the replenishment period, the edge Internet of things agent, the collector and the concentrator initiate the replenishment tasks according to the following strategies.
(a) And the current-level acquisition level initiates a complementary acquisition task to the next-level acquisition level through the lower communication module.
(b) The next-level acquisition level receives a data complementary acquisition task of the upper-level acquisition level through the upper-level acquisition request processing module, retrieves the stored data in a memory of the next-level acquisition level and forms a request response; when no data is requested in the local memory, NULL is returned.
(c) When the current-stage acquisition level receives the complementary acquisition data returned by the next-stage acquisition level, storing and updating the acquired acquisition request response data in a self memory, and deleting the complementary acquisition task; when the current-level acquisition level does not receive the response of the next-level acquisition level or the response content is NULL, the current-level acquisition level terminates the current complementary acquisition process, but does not delete the current complementary acquisition task.
(d) And the current-level acquisition level initiates a supplementary acquisition task again or the time limit is expired, and the current-level acquisition task is deleted.
Considering the real-time performance and reliability of the data acquisition task overall, the complementary acquisition strategy of the complementary acquisition task must cover the situations of short-time communication interruption or equipment abnormal operation, and long-time communication interruption or equipment abnormal operation, and the SAT (short anatomical time) can be set to 60 seconds generally, and the SAT can be adjusted according to the actual situation.
Aiming at short-time abnormity, when each acquisition level initiates a complementary acquisition task, the real-time performance of the data acquisition task is ensured, and simultaneously, the data needing complementary acquisition is ensured to be stored in a local memory of a complementary acquisition receiver as far as possible. Generally, the initiation time of the complementary collection task should be greater than the normal collection task + SAT.
Example 3:
as shown in fig. 3, the collection hierarchy comprises three collection hierarchies, each collection hierarchy runs a periodic collection task system, so that a collection strategy of 'layered collection and local storage' is realized. The periodic collection task system comprises the following modules:
for the upper communication module:
and communication with a superior acquisition node is realized. And receiving a data message sent by a superior acquisition node, respectively sending a configuration request message and an acquisition task request message to a configuration management module and a superior acquisition request processing module, and then receiving a response message returned by the configuration management module and the superior acquisition request processing module and sending the response message to the superior acquisition node.
A configuration management module:
receiving a configuration request message sent by an upper communication module, generating a configuration information copy in a memory by analyzing the configuration requests, generating local configuration files (the local configuration files generated according to the configuration requests comprise basic information required by all local acquisition programs to execute acquisition tasks), then generating a configuration request response message according to a processing result of the configuration requests, submitting the configuration request response message to the upper communication module, and sending the configuration request response message to a superior acquisition node by the upper communication module. When the local program is restarted, the module generates a configuration information copy in the memory by reading the local configuration file. When receiving the configuration request message, judging whether the configuration information is changed, if so, informing the task engine module, and regenerating the periodic collection task template set.
A task engine module:
the updating condition of the local configuration files is checked in real time, a periodic acquisition task template set is generated according to the configuration files, the time information generated by a local real-time clock is used as a reference (time synchronization is realized in the whole acquisition system by referring to acquisition equipment and sensing equipment), acquisition tasks to be executed are generated by contrasting each task template in the periodic acquisition task template set, and the acquisition tasks are stored in a task queue.
Each period of collecting the task template at least comprises the following steps: the method comprises the steps of triggering time conditions of collection tasks, objects to be collected (collecting running data of which electric meters), collection task failure complementary collection rules, collection task priority definition, collection message templates (generally, collection messages of periodic collection tasks generated by a same periodic collection task template have basically unchanged data fields except collection time and check bits, so that collection message samples can be generated in advance), and other information.
The task scheduling and executing module:
aiming at the tasks in the task queue, according to the information such as whether the tasks are complementary tasks, task priorities (the task priorities can be set through a configuration file), the current task execution state and the like, a multi-dimensional state machine scheduling algorithm is adopted to realize task scheduling, and the current task is selected to be executed.
For the current task which is selected to be executed, the acquisition message template in the task template is acquired according to the period each time the current task is executed, the acquisition time and the check bit in the message are re-filled, so that the rapid framing of the acquisition message is realized, and the acquisition message is submitted to a next communication module and sent to a lower-level acquisition node; and then, maintaining the execution condition of the current task by receiving and analyzing the condition of the response message of the lower-level collection node. If the task is completed normally, the collected running data and the corresponding timestamp are submitted to a collected data local storage module, the collected running data and the corresponding timestamp are stored in a local database, and then the current task is deleted from the task queue; if the task fails to be executed, the task enters (or remains at) a complementary stage and is rescheduled by the task scheduling and executing module. And when the complementary acquisition task cannot be completed for a long time and the operation data required to be acquired exceeds the local operation data storage time limit of the lower-level acquisition node through calculation, deleting the task from the task queue.
For the following communication modules:
and communication with the lower-level collection node is realized. The system is responsible for receiving a collection task request message sent by the task scheduling and executing module and sending the collection task request message to a lower-level collection node, and then is responsible for receiving a collection task request response message returned by the lower-level collection node and returning the response message to the task scheduling and executing module.
The collected data local storage module:
the system is responsible for receiving the collected data sent by the task scheduling and executing module and storing the collected data into a local database according to a preset format; meanwhile, the data query request sent by the superior acquisition request processing module is received, local data is organized according to the request, and the local data is returned to the superior acquisition request processing module. The collected data local storage module is also responsible for maintaining stored and transported data locally and cleaning out the overdue data periodically.
The superior acquisition request processing module:
receiving an acquisition task request message sent by the upper communication module, analyzing the request, inquiring the locally stored running data from the acquisition data local storage module, organizing an acquisition task request response message according to the inquiry result, submitting the acquisition task request response message to the upper communication module, and sending the acquisition task request response message to the upper acquisition node.
Example 4:
the minute-level acquisition method of the operation data suitable for the power Internet of things platform area has the following beneficial effects:
1. on the basis of the electric power Internet of things system architecture, the system architecture independently acquired by the existing marketing and operation inspection departments is optimized and adjusted into the system architecture for unified acquisition. Different acquisition periods are set for different operation data subsets in the operation data full set, the data items of the operation data subsets corresponding to the high-frequency acquisition periods are used for mapping the same data items of the operation data subsets corresponding to the low-frequency acquisition periods, different acquisition levels are used for acquiring and storing different operation data subsets, the existing service requirements are compatible, and the marketing service system and the power distribution service system can uniformly acquire and use the operation data as required.
2. In the implementation method, for the intelligent terminal, a plurality of acquisition levels adopt an access mode of 'partition covering and graded acquisition', so that the intelligent terminal such as an electric meter in an electric power station area is fully covered;
3. in the implementation method, each acquisition level adopts an acquisition strategy of 'hierarchical acquisition and local storage' to realize the data acquisition process.
4. In the implementation method, each acquisition level adopts an exception handling mechanism. When the data acquisition fails due to communication interruption or equipment abnormal operation, the acquisition party of each acquisition level can initiate a complementary acquisition process according to a preset strategy.
5. In the implementation method, each acquisition level adopts a data complementary acquisition mechanism. The real-time performance and reliability of the data acquisition task are considered comprehensively, and a processing mechanism of the complementary acquisition task is executed by setting an SAT (short Anormal time).
The above description is only of the preferred embodiments of the present invention, and it should be noted that: it will be apparent to those skilled in the art that various modifications and adaptations can be made without departing from the principles of the invention and these are intended to be within the scope of the invention.
Claims (8)
1. A method for acquiring minute-level operation data suitable for a power Internet of things platform area is characterized by comprising the following steps of: the method comprises the following steps:
the intelligent terminal collects operation data in the distribution room in real time and stores the operation data in a memory of the intelligent terminal;
a plurality of acquisition levels are connected in series through communication channels in sequence;
the lowest collection level is connected with the intelligent terminal through a communication channel, and the uppermost collection level is connected with the master station system through the communication channel;
each acquisition level acquires the operation data according to different service application requirements and different acquisition periods and stores the operation data in the memories of the respective acquisition levels;
the master station system sends running data uploading requests to corresponding acquisition layers according to different service application requirements, and the corresponding acquisition layers upload the running data in the memory to the master station system layer by layer for uniform calling of service applications;
the acquisition level is provided with a periodic acquisition task system, and the periodic acquisition task system comprises the following modules:
for the upper communication module: the system comprises a configuration management module, a superior acquisition request processing module, a superior acquisition layer and a superior acquisition layer, wherein the configuration management module is used for receiving data messages sent by the superior acquisition layer, respectively sending configuration request messages and acquisition task request messages to the configuration management module and the superior acquisition request processing module, receiving response messages returned by the configuration management module and the superior acquisition request processing module, and sending the response messages to the superior acquisition layer;
a configuration management module: the system comprises a pair of upper communication modules, a configuration request message, a local configuration file, a configuration request response message and a superior acquisition level, wherein the pair of upper communication modules are used for receiving the configuration request message sent by the pair of upper communication modules, generating a configuration information copy in a memory by analyzing the configuration request message, generating the local configuration file, generating the configuration request response message according to the processing result of the configuration request message, submitting the configuration request response message to the pair of upper communication modules and sending the configuration request response message to the superior acquisition level by the pair of upper communication modules; when the local program is restarted, generating a configuration information copy in a memory by reading a local configuration file; when receiving a configuration request message, judging whether the configuration information is changed, if so, notifying a task engine module, and regenerating a periodic acquisition task template set;
a task engine module: the system comprises a periodic acquisition task template set, a task queue and a task management module, wherein the periodic acquisition task template set is used for checking the updating condition of a local configuration file in real time, generating a periodic acquisition task template set according to the local configuration file, generating acquisition tasks to be executed by contrasting each task template in the periodic acquisition task template set by taking time information generated by a local real-time clock as a reference, and storing the acquisition tasks in the task queue; each period of collecting the task template at least comprises the following steps: triggering the time condition of an acquisition task, an object to be acquired, an acquisition task failure complementary acquisition rule, an acquisition task priority definition and an acquisition message template;
the task scheduling and executing module: the task scheduling method comprises the steps that a multi-dimensional state machine scheduling algorithm is adopted to realize task scheduling according to whether a task in a task queue is a complementary task, the task priority and the current task execution state, and the current task is selected to be executed; for the current task which is selected to be executed, the acquisition message template in the task template is acquired according to the period each time the current task is executed, the acquisition time and the check bit in the message are re-filled, so that the rapid framing of the acquired message is realized, the message is submitted to a lower communication module, and the message is sent to a lower acquisition level by the lower communication module; then, maintaining the execution condition of the current task by receiving and analyzing the condition of the response message of the lower acquisition level; if the task is normally completed, submitting the acquired running data and the corresponding timestamp to an acquired data local storage module, storing the acquired running data and the corresponding timestamp into a local database by the acquired data local storage module, and then deleting the current task from the task queue; if the task execution fails, entering a complementary mining stage, and rescheduling by the task scheduling and executing module; when the complementary mining task cannot be completed for a long time and the running data to be acquired exceeds the local running data storage time limit of a lower acquisition level through calculation, deleting the task from the task queue;
for the following communication modules: the system comprises a task scheduling and executing module, a task scheduling and executing module and a task scheduling and executing module, wherein the task scheduling and executing module is used for realizing communication with a lower acquisition level, receiving an acquisition task request message sent by the task scheduling and executing module, sending the acquisition task request message to the lower acquisition level, receiving an acquisition task request response message returned by the lower acquisition level and returning the response message to the task scheduling and executing module;
the collected data local storage module: the system comprises a task scheduling and executing module, a local database and a data processing module, wherein the task scheduling and executing module is used for receiving collected data sent by the task scheduling and executing module and storing the collected data into the local database according to a preset format; meanwhile, a data query request sent by a superior acquisition request processing module is received, local data are organized according to the request, and the local data are returned to the superior acquisition request processing module;
the superior acquisition request processing module: the system comprises a local storage module, an upper communication module, a collection data local storage module, a collection task request message and a collection task response message, wherein the local storage module is used for storing the operation data of the collection data local storage module, the collection task request message is used for receiving the collection task request message sent by the upper communication module, analyzing the request, organizing the collection task request response message according to the query result, submitting the collection task request response message to the upper communication module, and sending the collection task request response message to a superior collection level by the upper communication module.
2. The method for acquiring minute-level operation data of the power internet of things area according to claim 1, wherein the method comprises the following steps: the data acquisition local storage module also comprises maintenance of locally stored data of storage and transportation, and regularly clears up the data in excess period.
3. The method for acquiring minute-level operation data of the power internet of things area according to claim 1, wherein the method comprises the following steps: the intelligent terminal at least comprises one of an electric meter, a gateway meter, a user meter and a meter box monitoring device.
4. The method for acquiring minute-level operation data of the power internet of things area according to claim 1, wherein the method comprises the following steps: and when the upper acquisition level sends an acquisition task request message to the lower acquisition level, the lower acquisition level has the required operation data.
5. The method for acquiring minute-level operation data of the power internet of things area according to claim 1, wherein the method comprises the following steps: the complementary mining task comprises the following steps:
(a) the current-level acquisition level initiates a complementary acquisition task to the next-level acquisition level through the downward communication module;
(b) the next-level acquisition level receives a data complementary acquisition task of the upper-level acquisition level through the upper-level acquisition request processing module, retrieves the stored data in a memory of the next-level acquisition level and forms a request response; returning NULL when the data required by the request is not in the local memory;
(c) when the current-stage acquisition level receives the complementary acquisition data returned by the next-stage acquisition level, storing and updating the acquired acquisition request response data in a self memory, and deleting the complementary acquisition task; when the current-level acquisition level does not receive the response of the next-level acquisition level or the response content is NULL, the current-level acquisition level terminates the current complementary acquisition process but does not delete the current complementary acquisition task;
(d) and the current-level acquisition level initiates a supplementary acquisition task again or the time limit is expired, and the current-level acquisition task is deleted.
6. The method for acquiring minute-level operation data suitable for the power internet of things area according to claim 5, wherein the method comprises the following steps: the initiation time of the complementary collection task is larger than the normal collection task time plus SAT.
7. The method for acquiring minute-level operation data of the power internet of things area according to claim 6, wherein the method comprises the following steps: SAT is set to 60 seconds.
8. The method for acquiring minute-level operation data of the power internet of things area according to claim 1, wherein the method comprises the following steps: the time synchronization precision of each acquisition level is not more than 1s, and the time of the upper acquisition level set is taken as the synchronization basis of the lower acquisition level set.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010474131.9A CN111798655B (en) | 2020-05-29 | 2020-05-29 | Operation data minute-level acquisition method suitable for power Internet of things platform area |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010474131.9A CN111798655B (en) | 2020-05-29 | 2020-05-29 | Operation data minute-level acquisition method suitable for power Internet of things platform area |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111798655A CN111798655A (en) | 2020-10-20 |
| CN111798655B true CN111798655B (en) | 2021-12-10 |
Family
ID=72806628
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010474131.9A Active CN111798655B (en) | 2020-05-29 | 2020-05-29 | Operation data minute-level acquisition method suitable for power Internet of things platform area |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111798655B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112839080B (en) * | 2020-12-31 | 2022-11-04 | 四川瑞霆智汇科技有限公司 | Edge Internet of things agent device and method for realizing acquisition and calculation based on configuration |
| CN113742271A (en) * | 2021-09-08 | 2021-12-03 | 南方电网数字电网研究院有限公司 | Electric power user meter information processing method, device, equipment and storage medium |
Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| AU2007294728A1 (en) * | 2006-09-15 | 2008-03-20 | Itron Global Sarl | Metering RF LAN protocol and cell/node utilization and management |
| CN201364350Y (en) * | 2008-07-31 | 2009-12-16 | 方建军 | Remote centralization meter checking system |
| CN101673457A (en) * | 2009-08-14 | 2010-03-17 | 深圳市科陆电子科技股份有限公司 | Method and system of data acquisition from data acquisition terminal |
| CN101738997A (en) * | 2009-10-30 | 2010-06-16 | 深圳市科陆电子科技股份有限公司 | Multithread electric negative control system and control method |
| CN101873005A (en) * | 2010-06-17 | 2010-10-27 | 深圳市科陆电子科技股份有限公司 | Method for realizing balanced acquisition of electric energy |
| CN102130759A (en) * | 2010-01-13 | 2011-07-20 | 中国移动通信集团公司 | Data collection method, data collection device cluster and data collection devices |
| CN103514277A (en) * | 2013-09-24 | 2014-01-15 | 国家电网公司 | Task parallel processing method for electricity utilization information collection system |
| CN203422836U (en) * | 2013-07-10 | 2014-02-05 | 天津创展同成科技发展有限公司 | Remote meter reading system |
| CN106504502A (en) * | 2016-12-06 | 2017-03-15 | 国网山东省电力公司鄄城县供电公司 | The method of intelligent electric meter, intelligent electric meter management system and centralized automatic meter-reading |
| CN108183869A (en) * | 2017-12-29 | 2018-06-19 | 国电南瑞科技股份有限公司 | A kind of electric quantity data acquisition system based on Distributed Message Queue |
| CN109743717A (en) * | 2019-03-06 | 2019-05-10 | 深圳市飞比电子科技有限公司 | Data processing method, device, terminal device and storage medium |
| CN110489407A (en) * | 2019-07-29 | 2019-11-22 | 南方电网数字电网研究院有限公司 | Data filling mining method, apparatus, computer equipment and storage medium |
| CN110535909A (en) * | 2019-07-29 | 2019-12-03 | 广东电网有限责任公司信息中心 | Big data and cloud computing unified platform system towards energy Internet application |
| CN110932917A (en) * | 2019-12-24 | 2020-03-27 | 深圳市国电科技通信有限公司 | High-frequency synchronous acquisition and edge calculation-based distribution room topology discovery method |
| CN111062651A (en) * | 2020-03-18 | 2020-04-24 | 南京中电科能技术有限公司 | Safe power utilization management system and method based on edge calculation and big data analysis |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8223654B2 (en) * | 2006-08-22 | 2012-07-17 | Embarq Holdings Company, Llc | Application-specific integrated circuit for monitoring and optimizing interlayer network performance |
| US8477610B2 (en) * | 2010-05-31 | 2013-07-02 | Microsoft Corporation | Applying policies to schedule network bandwidth among virtual machines |
-
2020
- 2020-05-29 CN CN202010474131.9A patent/CN111798655B/en active Active
Patent Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| AU2007294728A1 (en) * | 2006-09-15 | 2008-03-20 | Itron Global Sarl | Metering RF LAN protocol and cell/node utilization and management |
| CN201364350Y (en) * | 2008-07-31 | 2009-12-16 | 方建军 | Remote centralization meter checking system |
| CN101673457A (en) * | 2009-08-14 | 2010-03-17 | 深圳市科陆电子科技股份有限公司 | Method and system of data acquisition from data acquisition terminal |
| CN101738997A (en) * | 2009-10-30 | 2010-06-16 | 深圳市科陆电子科技股份有限公司 | Multithread electric negative control system and control method |
| CN102130759A (en) * | 2010-01-13 | 2011-07-20 | 中国移动通信集团公司 | Data collection method, data collection device cluster and data collection devices |
| CN101873005A (en) * | 2010-06-17 | 2010-10-27 | 深圳市科陆电子科技股份有限公司 | Method for realizing balanced acquisition of electric energy |
| CN203422836U (en) * | 2013-07-10 | 2014-02-05 | 天津创展同成科技发展有限公司 | Remote meter reading system |
| CN103514277A (en) * | 2013-09-24 | 2014-01-15 | 国家电网公司 | Task parallel processing method for electricity utilization information collection system |
| CN106504502A (en) * | 2016-12-06 | 2017-03-15 | 国网山东省电力公司鄄城县供电公司 | The method of intelligent electric meter, intelligent electric meter management system and centralized automatic meter-reading |
| CN108183869A (en) * | 2017-12-29 | 2018-06-19 | 国电南瑞科技股份有限公司 | A kind of electric quantity data acquisition system based on Distributed Message Queue |
| CN109743717A (en) * | 2019-03-06 | 2019-05-10 | 深圳市飞比电子科技有限公司 | Data processing method, device, terminal device and storage medium |
| CN110489407A (en) * | 2019-07-29 | 2019-11-22 | 南方电网数字电网研究院有限公司 | Data filling mining method, apparatus, computer equipment and storage medium |
| CN110535909A (en) * | 2019-07-29 | 2019-12-03 | 广东电网有限责任公司信息中心 | Big data and cloud computing unified platform system towards energy Internet application |
| CN110932917A (en) * | 2019-12-24 | 2020-03-27 | 深圳市国电科技通信有限公司 | High-frequency synchronous acquisition and edge calculation-based distribution room topology discovery method |
| CN111062651A (en) * | 2020-03-18 | 2020-04-24 | 南京中电科能技术有限公司 | Safe power utilization management system and method based on edge calculation and big data analysis |
Non-Patent Citations (2)
| Title |
|---|
| "无线远传集抄系统";沈曙明;《中国优秀硕士学位论文全文数据库》;20140715(第07期);全文 * |
| "用于缓存的补采策略在智能用电系统中的应用";陶晓峰等;《江苏电机工程》;20140131;第33卷(第1期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111798655A (en) | 2020-10-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7099879B2 (en) | Real-time monitoring of service performance through the use of relational database calculation clusters | |
| CN111798655B (en) | Operation data minute-level acquisition method suitable for power Internet of things platform area | |
| US20030212778A1 (en) | UML representation of parameter calculation expressions for service monitoring | |
| CN113179173B (en) | Operation and maintenance monitoring system for expressway system | |
| CN112698953A (en) | Power grid intelligent operation and detection platform based on micro-service | |
| CN104966330A (en) | Remote machine room intelligent inspection system based on cloud computer | |
| CN111506585B (en) | Power distribution network energy metering system based on block chain technology | |
| CN101135715A (en) | North direction interface data integrity verification method | |
| CN109391629A (en) | Track traffic synthetic monitoring system data processing method | |
| CN111008245A (en) | WAMS data sharing method for scheduling mechanism above provincial level based on regulation cloud | |
| CN116345698A (en) | Operation and maintenance control method, system, equipment and medium for energy storage power station | |
| CN112865311A (en) | Method and device for monitoring message bus of power system | |
| CN110555452A (en) | network problem processing method and device based on intelligent clustering | |
| CN102098170B (en) | Data acquisition optimization method and system | |
| CN101609454A (en) | A kind of data storage and report method and smart machine thereof | |
| CN117061580A (en) | Intelligent river data digital transmission system and method based on Internet of things | |
| CN112561409B (en) | Fault assessment method and system for ground receiving system of remote sensing satellite | |
| CN113780595B (en) | Method for first-aid repair of base station in power failure and data analysis server | |
| CN111625517B (en) | New energy real-time data processing method and device based on change storage | |
| CN114548690A (en) | Communication, cleaning and power supply joint scheduling method and system for delay tolerant data commuting traffic network | |
| CN109143878B (en) | Remote signaling message and SOE message processing method for multi-channel acquisition channel | |
| CN103279844A (en) | Method and system for data collection of legal person database based on ESB | |
| CN115374101A (en) | Rail transit station level data management system | |
| Zhao et al. | A real-time processing system for massive traffic sensor data | |
| CN112579552A (en) | Log storage and calling method, device and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |