CN111209271A

CN111209271A - Electric power data complementary acquisition method and device, computer equipment and storage medium

Info

Publication number: CN111209271A
Application number: CN201911355511.4A
Authority: CN
Inventors: 梁洪浩; 伍少成; 陈晓伟; 刘涛; 马越; 孙文龙; 李思鉴; 姜和芳
Original assignee: Shenzhen Power Supply Bureau Co Ltd
Current assignee: Shenzhen Power Supply Bureau Co Ltd
Priority date: 2019-12-25
Filing date: 2019-12-25
Publication date: 2020-05-29

Abstract

The application relates to a power data complementary acquisition method, a power data complementary acquisition device, computer equipment and a storage medium. The method comprises the following steps: determining leakage point information in a preset cache; the leakage point information is associated with the electric power acquisition data uploaded by the front-end processor; determining a preset data complementary collection condition corresponding to the missing point information; when the condition that the data supplementary mining condition is met is detected, generating a missing point supplementary mining task according to the missing point information; sending a missing point complementary mining task to a front-end processor; the leakage point complementary mining task is used for indicating the front-end processor to perform electric power data complementary mining; and receiving electric power supplementary acquisition data which are uploaded by the front-end processor and correspond to the leakage point information. By adopting the method, the electric power data complementary mining efficiency can be improved.

Description

Electric power data complementary acquisition method and device, computer equipment and storage medium

Technical Field

The present application relates to the field of power automation technologies, and in particular, to a power data complementary acquisition method, device, computer device, and storage medium.

Background

With the comprehensive online of a metering automation system, the collection of electric power data completely departs from the manual meter reading era, the meter reading efficiency is greatly improved by a remote automatic meter reading mode of metering automation, wherein the data collection success rate can embody the effect of remote meter reading, however, the improvement of the data collection success rate is restricted by a series of reasons such as planned power failure, fault power failure, network fault and the like at present, and the collection integrity rate of the electric power data can be effectively improved by data supplementary collection.

At present, the supplementary collection method of power data is to access a power system database, count the power data stored in the power system database with the power data not collected or the power data failed to be collected, and then supplement and collect the counted power data. However, frequent statistical access has a large pressure on the power system database, which seriously affects the performance of the power system database, and the supplement and the collection of the power data depend on the performance of the power system database, so that the supplement and the collection of the power data are difficult to be performed in time, and the supplement and the collection efficiency of the power data is low.

Disclosure of Invention

In view of the above, it is necessary to provide a power data complementary collection method, a device, a computer device, and a storage medium capable of improving power data complementary collection efficiency.

A method of electric power data replenishment, the method comprising:

determining leakage point information in a preset cache; the leakage point information is associated with the electric power acquisition data uploaded by the front-end processor;

determining a preset data complementary collection condition corresponding to the missing point information;

when the condition that the data supplementary mining condition is met is detected, generating a missing point supplementary mining task according to the missing point information;

sending a missing point complementary mining task to a front-end processor; the leakage point complementary mining task is used for indicating the front-end processor to perform electric power data complementary mining;

and receiving electric power supplementary acquisition data which are uploaded by the front-end processor and correspond to the leakage point information.

In one embodiment, before determining the leakage point information in the preset cache, the method further includes:

acquiring power acquisition data obtained by a front-end processor;

acquiring a power data acquisition task corresponding to the front-end processor;

when the preset leakage point initialization condition is met, leakage point information related to the electric power acquisition data is determined according to the electric power data acquisition task;

and updating the leakage point information to a preset cache.

In one embodiment, determining the leakage point information associated with the power collection data according to the power data collection task comprises:

determining global acquisition information according to the power data acquisition task;

determining global leakage point information in global acquisition information according to the power acquisition data;

and obtaining the leakage point information associated with the electric power acquisition data according to the global leakage point information.

In one embodiment, the cache includes a Redis database; updating the missing point information to a preset cache comprises:

obtaining a key of a Redis database according to the data type, the task number and the data time corresponding to the missing point information;

obtaining a first value of a Redis database according to the acquired data item corresponding to the leakage point information and the terminal address of the electric power terminal corresponding to the leakage point information;

obtaining a second value of the Redis database according to the missing number measuring points corresponding to the missing point information;

and constructing a key-value pair according to the key, the first value and the second value of the Redis database, and storing the key-value pair into the Redis database.

In one embodiment, determining that the missing point information corresponds to the preset data complementary acquisition condition includes:

determining an electric power terminal corresponding to the leakage point information;

acquiring a preset data complementary collection condition corresponding to the power terminal;

when the condition that the data supplementary mining condition is met is detected, generating a supplementary mining task of the missing point according to the missing point information comprises the following steps:

when the power terminal is detected to be in an online state or the power terminal is detected to be in the online state and a complementary acquisition triggering condition in the data complementary acquisition condition is met, acquiring leakage point information from a cache;

and generating a missing point complementary collection task according to the missing point information.

In one embodiment, the generating of the missing point complementary collection task according to the missing point information includes:

acquiring a task configuration template and a data complementary acquisition strategy which are preset correspondingly by the power terminal;

and performing task configuration on the task configuration template according to the missing point information and the data supplement and acquisition strategy to obtain a missing point supplement and acquisition task.

In one embodiment, the method further comprises:

performing supplementary mining verification on the electric power supplementary mining data;

and when the verification result of the additional adoption verification is that the verification is passed, deleting the missing point information in the cache.

An electrical data complementary mining device, the device comprising:

the leakage point information determining module is used for determining leakage point information in a preset cache; the leakage point information is associated with the electric power acquisition data uploaded by the front-end processor;

the data compensation and mining condition determining module is used for determining the preset data compensation and mining condition corresponding to the missing point information;

the compensation and collection task generation module is used for generating a leakage point compensation and collection task according to the leakage point information when the condition that the data compensation and collection is met is detected;

the supplementary mining task issuing module is used for sending the missing point supplementary mining task to the front-end processor; the leakage point complementary mining task is used for indicating the front-end processor to perform electric power data complementary mining;

and the supplementary acquisition data receiving module is used for receiving the electric power supplementary acquisition data which are uploaded by the front-end processor and correspond to the leakage point information.

A computer device comprising a memory and a processor, the memory storing a computer program, the processor implementing the following steps when executing the computer program:

A computer-readable storage medium, on which a computer program is stored which, when executed by a processor, carries out the steps of:

According to the electric power data complementary collection method, the electric power data complementary collection device, the computer equipment and the storage medium, when the data complementary collection condition corresponding to the leakage point information in the preset cache is met, a leakage point complementary collection task is generated and sent to the front-end processor to indicate the front-end processor to carry out electric power data complementary collection based on the leakage point information, and electric power complementary collection data corresponding to the leakage point information and uploaded by the front-end processor are received. The electric power data complementary collection is carried out by presetting the cache storage leakage point information, so that frequent access to the electric power system database can be avoided, the electric power data complementary collection is not limited by the performance of the electric power system database, and the complementary collection efficiency of the electric power data is improved.

Drawings

FIG. 1 is a diagram illustrating an exemplary embodiment of a method for supplementing power data;

FIG. 2 is a schematic flow chart illustrating a method for electric power data complementary mining according to an embodiment;

FIG. 3 is a flow diagram illustrating one embodiment of a statistical process for missing dot information;

FIG. 4 is a schematic block diagram of a specific storage structure for leakage point information in one embodiment;

FIG. 5 is a block diagram showing the structure of an electric power data complementary acquiring apparatus according to an embodiment;

FIG. 6 is a diagram illustrating an internal structure of a computer device according to an embodiment.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.

The electric power data complementary collection method provided by the application can be applied to the application environment of electric power data collection as shown in fig. 1. The terminal 102 communicates with the front-end device 104 through a network, and the front-end device 104 communicates with the server 106 through the network. The terminal 102 sends the collected power data to the front-end processor device 104, the front-end processor device 104 sends the received power data to the server 106, and the front-end processor device 104 may also receive control information of the server 106 and forward the control information to the corresponding terminal 102 to control the operation of the terminal 102. The server 106 performs statistics on the received power data, determines leakage point information, stores the leakage point information into a preset cache, generates a leakage point complementary collection task and sends the leakage point complementary collection task to the front-end processor device 104 to instruct the front-end processor device 104 to perform power data complementary collection based on the leakage point information when detecting that a data complementary collection condition corresponding to the leakage point information in the cache is met, and receives power complementary collection data corresponding to the leakage point information uploaded by the front-end processor device 104.

The terminal 102 may be, but not limited to, a metering terminal device in an electric power system, such as a power distribution terminal, an electric meter, and the like, the front-end processor device 104 may be an industrial personal computer, a repeater, and the like with a communication function, and the server 106 may be implemented by an independent server or a server cluster formed by a plurality of servers. Furthermore, in some embodiments, the front-end device 104 may also be integrated with the server 106.

In one embodiment, as shown in fig. 2, a power data complementary collecting method is provided, which is described by taking the method as an example applied to the server 106 in fig. 1, and includes the following steps:

step S201, determining leakage point information in a preset cache; the leakage point information is associated with the power acquisition data uploaded by the front-end processor.

The leakage point information is missing data in the power data that needs to be collected by the power system, and may specifically include, but is not limited to, power data that is collected by a front-end processor in a missing manner or power data that cannot be normally received by a server. The preset cache is a cache additionally arranged besides the power system database, and the cache can be specially used for the supplement and collection processing of the power data, such as statistics of the collected power data to determine leakage point information, storage of the leakage point information, supplement and collection of the power data based on the leakage point information, and the like. The front-end processor is connected with the terminal and the server respectively and used for realizing data transmission between the terminal and the server, specifically, the front-end processor controls the terminal to carry out data acquisition according to an acquisition instruction of the server, the terminal collects power acquisition data acquired by each test point, such as electric quantity, voltage and the like, to the front-end processor, the front-end processor uploads the power acquisition data to the server and the server stores the power acquisition data, and leakage point information related to the power acquisition data is determined so as to carry out power data additional acquisition processing.

Step S203, determining that the missing point information corresponds to a preset data complementary collection condition.

And after the missing point information is determined, further determining a data complementary collection condition corresponding to the missing point information, wherein the data complementary collection condition is used for triggering complementary processing aiming at the missing point information. In specific implementation, the data complementary acquisition condition may include that the terminal is on-line, i.e., complementary acquisition or timing complementary acquisition, and is preset according to actual requirements and conditions of each power terminal connected to the front-end processor. When the data complementary collection condition is that the terminal is on-line, namely complementary collection, according to the on-line state of the power terminal uploaded by the front-end processor, when the power terminal is determined to be changed from the off-line state to the on-line state, namely the data complementary collection condition is considered to be met, and power data complementary collection processing is carried out; and when the data supplementary mining condition is the timing supplementary mining, when the power terminal is monitored to be in an online state and a preset supplementary mining triggering condition is met, if the current time reaches a preset time value or reaches a preset supplementary mining period, the data supplementary mining condition is considered to be met, and power data supplementary mining processing is carried out.

And S205, when the condition that the data supplementary collection is met is detected, generating a supplementary collection task of the leakage point according to the leakage point information.

And monitoring whether a data supplementing and collecting condition is met or not to determine whether electric power data supplementing and collecting processing needs to be carried out on each electric power terminal connected with the front-end processor or not, when the data supplementing and collecting condition is detected to be met, if the electric power terminal connected with the front-end processor is detected to be on line and the data supplementing and collecting condition is met, carrying out the electric power data supplementing and collecting processing on the electric power terminal, and generating a leakage point supplementing and collecting task according to the leakage point information in the cache. During specific implementation, the corresponding power terminal can be determined from the leakage point information in the cache, whether power data complementary collection processing needs to be performed is judged based on the data complementary collection condition corresponding to the power terminal, and a corresponding leakage point complementary collection task is generated according to the leakage point information when the data complementary collection condition is met. The missing point compensation and acquisition task can be obtained by performing compensation and acquisition task configuration processing according to a preset task configuration template.

Step S207, sending a missing point complementary mining task to a front-end processor; and the missing point complementary collection task is used for indicating the front-end processor to perform electric power data complementary collection.

And after a leakage point complementary collection task corresponding to the leakage point information is obtained, the leakage point complementary collection task is issued to the front-end processor to indicate the front-end processor to carry out electric power data complementary collection. In specific application, the obtained leakage point complementary collection task is sent to the front-end processor, and the front-end processor forwards the received leakage point complementary collection task to the power terminal which is connected and meets the data complementary collection condition, so that the power terminal performs power data complementary collection, and receives power complementary collection data complementarily collected by the power terminal.

And step S209, receiving the electric power complementary acquisition data corresponding to the leakage point information uploaded by the front-end processor.

After the leakage point complementary collection task is issued to the front-end processor, the front-end processor forwards the received leakage point complementary collection task to the power terminal which is connected and meets the data complementary collection condition so that the power terminal can carry out power data complementary collection, and receives power complementary collection data complementarily collected by the power terminal, the front-end processor further forwards the power complementary collection data to the server, and the server receives the power complementary collection data which are uploaded by the front-end processor and correspond to the leakage point information, so that the complementary collection processing of the power data is realized.

In addition, if the electric power supplementary acquisition data uploaded by the front-end processor is not received within the preset supplementary acquisition task execution duration, or the received electric power supplementary acquisition data is wrong or has missing, the step of generating the missing point supplementary acquisition task according to the missing point information when the condition of data supplementary acquisition is detected to be met can be returned, repeated supplementary acquisition is carried out until the supplementary acquisition is successful, or the supplementary acquisition ending condition is reached, if the supplementary acquisition times of the missing point information reach a preset supplementary acquisition times threshold value, or the total consumption time of the supplementary acquisition processing exceeds a preset supplementary acquisition time-consuming threshold value, the electric power terminal is considered to be incapable of freezing the electric power data of the electric meter, namely the electric power data is incapable of being acquired, the supplementary acquisition of the electric power data is abandoned, and meanwhile the corresponding missing point information in the cache is deleted.

Due to the fact that the data volume of the electric power data which are automatically collected in the electric power system is large, the leakage point information is stored by utilizing the preset cache, compared with the case that the failure information is directly updated in the electric power system database, the leakage point information can be updated in time, the system overhead of updating the leakage point information is small, and the query speed is high; compared with the memory which is directly used for storing the failure information in the memory, the memory occupied by the failure information is greatly reduced, the query speed is almost the same as that of the direct query in the memory, and the complementary mining efficiency can be effectively improved when the power data of a large-scale acquisition system is complemented and mined.

In the electric power data supplementing and mining method, when the data supplementing and mining condition corresponding to the leakage point information in the preset cache is met, a leakage point supplementing and mining task is generated and is issued to the front-end processor to indicate the front-end processor to supplement and mine the electric power data based on the leakage point information, and the electric power supplementing and mining data corresponding to the leakage point information uploaded by the front-end processor are received. The electric power data complementary collection is carried out by presetting the cache storage leakage point information, so that frequent access to the electric power system database can be avoided, the electric power data complementary collection is not limited by the performance of the electric power system database, and the complementary collection efficiency of the electric power data is improved.

In one embodiment, as shown in fig. 3, before determining the leakage point information in the preset cache, the method further includes statistical processing of the leakage point information, specifically including:

and S301, acquiring the power acquisition data obtained by the front-end processor.

In this embodiment, the power data that is missing by the front-end processor and needs to be collected again, that is, the leakage point information associated with the power collection data, is determined according to the power data collection task corresponding to the front-end processor and the power collection data obtained by the front-end processor. Specifically, the power acquisition data obtained by the front-end processor is acquired. The front-end processor is generally connected with a plurality of power terminals, collects power acquisition data of the power terminals, and uploads the collected power acquisition data to the server. In specific application, the server is provided with a full-amount acquisition task corresponding to the front-end processor so as to control the front-end processor to acquire full-amount power data and upload the acquired power acquisition data to the server.

And step S303, acquiring a power data acquisition task corresponding to the front-end processor.

The power data collection task is set according to actual requirements of each power terminal connected with each front-end processor, for example, the power data collection task can be a full collection task, that is, power data of a plurality of terminals connected under the front-end processor are comprehensively collected. Generally, different front-end computers are connected to different power terminals, and are correspondingly provided with different power data acquisition tasks. The electric power data acquisition task records electric power data which need to be acquired by each electric power terminal connected with the front-end processor, and the electric power data acquisition task can analyze the electric power data actually obtained by the front-end processor, so that missing electric power data in the obtained electric power data is determined, namely leakage point information related to the electric power data is determined. When the electric power data acquisition task is applied specifically, the electric power data acquisition task can be obtained after task configuration processing is carried out according to a preset task configuration template, and after the electric power data acquisition task is forwarded to each electric power terminal through the front-end processor, the electric power terminals are controlled to carry out electric power data acquisition. The task configuration template can comprise items such as data freezing density, task template identification, task number, collected data item, power supply unit coding and effective state identification. In addition, the task configuration template can also be used for configuring the missing point complementary collection task.

Step S305, when the preset leakage point initialization condition is met, the leakage point information related to the electric power acquisition data is determined according to the electric power data acquisition task.

The leakage point initialization condition is set according to actual requirements of each power terminal connected with the front-end processor, and specifically, the leakage point information is determined when the current time reaches a preset time, for example, when the current time reaches a zero point moment, the leakage point initialization condition is considered to be met, and the leakage point information related to the power acquisition data is determined according to the power data acquisition task. In specific application, the actually obtained electric power acquisition data can be matched with the electric power data acquisition task to determine the missing electric power data in the electric power data acquisition task and obtain the leakage point information associated with the electric power acquisition data.

Step S307, updating the missing point information to a preset cache.

After the leakage point information is obtained, the leakage point information is stored in a preset cache, for example, the leakage point information can be stored in a preset Redis database. Redis is an open source API (Application Programming Interface) which is written by using ANSI C language, complies with BSD (Berkeley software distribution) protocol, supports network, can be based on a log type and can be persistent in memory, and provides multiple languages. It is commonly referred to as a data structure server because the value (value) can be of the type String (String), hash (Map), list (list), set (sets) or ordered set (sorted sets).

During specific implementation, the statistical processing of the leakage point information can be performed in a preset cache, that is, the electric power acquisition data obtained by the front-end processor is stored in the preset cache, the leakage point information of the electric power acquisition data in the cache is determined according to the electric power data acquisition task corresponding to the front-end processor, the determined leakage point information is retained in the cache, and other non-leakage point information is deleted.

In one embodiment, determining the leakage point information associated with the power collection data according to the power data collection task comprises: determining global acquisition information according to the power data acquisition task; determining global leakage point information in global acquisition information according to the power acquisition data; and obtaining the leakage point information associated with the electric power acquisition data according to the global leakage point information.

In this embodiment, the leakage point information associated with the power acquisition data is determined according to the power data acquisition task determination global acquisition information and the power acquisition data obtained through actual acquisition. Specifically, when the condition of leakage point initialization is met, global acquisition information is determined according to the power data acquisition task, the global acquisition information is various power data which are preset by the front-end processor and need to be acquired, and the front-end processors connected with different terminals correspond to different power data acquisition tasks, namely, different global acquisition information needs to be acquired. The electric power acquisition data is electric power data acquired by the front-end processor actually, global leakage point information in the global acquisition information is determined according to the electric power acquisition data, and the electric power acquisition data and the global acquisition information can be matched specifically, so that electric power data which are not acquired in the global acquisition information are determined, and the global leakage point information in the global acquisition information is obtained. The global acquisition information is electric power data which is preset by the front-end processor and needs to be acquired, the global leakage point information is data which is omitted from the last electric power acquisition data of the front-end processor, and complementary acquisition processing needs to be carried out on the part of electric power data. And obtaining the leakage point information associated with the electric power acquisition data according to the global leakage point information, and specifically, directly using the global leakage point information in the global acquisition information as the leakage point information associated with the electric power acquisition data.

In specific application, the overall collected information can be defaulted to be the leakage point information, the overall collected information is updated one by one according to the electric power collected data, and finally the overall leakage point information in the overall collected information is obtained, namely the leakage point information related to the electric power collected data is obtained.

In one embodiment, the cache includes a Redis database; updating the missing point information to a preset cache comprises: obtaining a key of a Redis database according to the data type, the task number and the data time corresponding to the missing point information; obtaining a first value of a Redis database according to the acquired data item corresponding to the leakage point information and the terminal address of the electric power terminal corresponding to the leakage point information; obtaining a second value of the Redis database according to the missing number measuring points corresponding to the missing point information; and constructing a key-value pair according to the key, the first value and the second value of the Redis database, and storing the key-value pair into the Redis database.

In this embodiment, the preset cache includes a Redis database, and the obtained leakage point information is updated to the Redis database. The storage of the leakage point information in the Redis requires a reasonable data storage and organization mode, and specifically, when the leakage point information is updated to a preset cache, a key (key) of the Redis database is obtained according to a data type, a task number and data time corresponding to the leakage point information, wherein the key represents the leakage point information of different task numbers at different times under each data type. The data type, the task number and the data time corresponding to the leakage point information correspond to the electric power data acquisition task and can be determined from the electric power data acquisition task. And obtaining a first value of the Redis database according to the acquired data item corresponding to the leakage point information and the terminal address of the electric power terminal corresponding to the leakage point information, wherein the first value can be the field of the Redis database, and the acquired data item and the terminal address of the electric power terminal corresponding to the leakage point information can also be determined from the electric power data acquisition task. And obtaining a second value of the Redis database according to the missing number measuring points corresponding to the missing point information, wherein the missing number measuring points are measuring points of missing data in the measuring points corresponding to the electric power terminals connected with the front-end processor, and specifically obtaining the second value of the Redis database according to a list of the missing number measuring points corresponding to the missing point information, and the second value can be a value of the Redis database. After the key, the first value and the second value according to the Redis database are obtained, the key value pair is constructed according to the key, the first value and the second value, specifically, the first value and the second value can be both used as the value of the key, so that the key value pair is constructed, the obtained key value pair is stored in the Redis database, and therefore, the missing point information is stored through the Redis database.

In a specific application, hash in the redis is adopted to store the missing point information of different task data, the duration of a missing point complementary task can be set according to experience, the validity period of the message in the redis is set, and the message is cleared after expiration, so that useless messages are prevented from occupying excessive memory of the redis. The hash of redis is a mapping table of string type field and value, and is particularly suitable for storing objects; based on the hash storage leakage point information, data with the same rule can be placed into a data container in the redis, so that the data can be conveniently searched; and the use of hash saves more memory than other storage structures of redis.

The specific storage structure design of the leakage point information in Redis can be as shown in FIG. 4. The key is a string character string consisting of data types, task numbers and data time and represents the missing point information of different task numbers at different times under each data type; the data type and the task number are taken from a task configuration template corresponding to the electric power data acquisition task, the precision of the data time depends on the specific data type in the task configuration template, for example, the day freezing data is accurate to the day, and the curve data is accurate to the corresponding point according to the data density. And storing corresponding filtered and value under each key, wherein the filtered content is a string character string consisting of the acquired data item and the terminal address, and the value is a list of the missing number measuring points. For each type of collected data items, dotting and recording the missing number information of the measuring points needing to be collected under each terminal, and deleting the corresponding missing point information until data comes from a certain measuring point.

In one embodiment, determining that the missing point information corresponds to the preset data complementary acquisition condition includes: determining an electric power terminal corresponding to the leakage point information; and acquiring a preset data complementary acquisition condition corresponding to the power terminal.

In this embodiment, the data complementary acquisition condition is preset correspondingly according to each power terminal connected to the front-end processor, and the data complementary acquisition condition corresponding to the missing point information is determined according to the data complementary acquisition condition of the power terminal. Specifically, when the data complementary collection condition of the leakage point information is determined, the power terminal corresponding to the leakage point information is determined. The front-end processor is connected with one or more electric power terminals to realize data transmission between the electric power terminals and the server, and the electric power terminals comprise one or more measuring points to acquire electric power data of the electric power system. For a front-end processor, when it is connected to multiple power terminals, the leakage point information determined according to the power acquisition data uploaded by the front-end processor may belong to multiple different power terminals, and the corresponding power terminals need to perform corresponding complementary acquisition processing. Different power terminals are provided with different data complementary collection conditions, so that the power terminals which need to perform power data complementary collection processing correspondingly need to be determined according to the leakage point information. And after the electric power terminal needing to perform electric power data complementary collection processing is determined, further acquiring a preset data complementary collection condition corresponding to the electric power terminal as a data complementary collection condition corresponding to the leakage point information. The data complementary collection conditions are preset according to the requirements and conditions of each power terminal, and generally include condition limitation on the online state of the power terminal, so that power data complementary collection processing is performed in time when the power terminal is determined to be in the online state.

Further, when it is detected that the data complementary mining condition is met, generating the missing point complementary mining task according to the missing point information includes: when the power terminal is detected to be in an online state or the power terminal is detected to be in the online state and a complementary acquisition triggering condition in the data complementary acquisition condition is met, acquiring leakage point information from a cache; and generating a missing point complementary collection task according to the missing point information.

In this embodiment, the condition for satisfying the data supplementary mining includes that the terminal is on-line, that is, supplementary mining or timed supplementary mining, the preset is specifically performed according to the actual requirements of each power terminal, and when it is detected that the preset condition for satisfying the data supplementary mining is satisfied, the processing for the power data supplementary mining is triggered. Specifically, when the data complementary collection condition is that the terminal is online, namely complementary collection, if the power terminal is detected to be in an online state, the missing point information is acquired from the cache, and a missing point complementary collection task is generated according to the acquired missing point information. On the other hand, when the data complementary collection condition is the timed complementary collection, if the power terminal is detected to be in the online state and the complementary collection triggering condition in the data complementary collection condition is met, for example, a preset complementary collection period is reached or the current time reaches a preset time value, the missing point information is acquired from the cache, and a missing point complementary collection task is generated according to the acquired missing point information. In addition, the data complementary acquisition condition may further include a complementary acquisition policy, a data priority, and the like corresponding to the power terminal.

In specific application, when it is detected that the power terminal meets the corresponding data complementary collection condition, the leakage point information corresponding to the power terminal can be obtained from the cache, and a leakage point complementary collection task for the power terminal is generated based on the leakage point information, and the leakage point complementary collection task can be forwarded to the power terminal through the front-end processor so as to control the power terminal to perform power data complementary collection processing.

In one embodiment, the generating of the missing point complementary collection task according to the missing point information includes: acquiring a task configuration template and a data complementary acquisition strategy which are preset by the power terminal correspondingly; and performing task configuration on the task configuration template according to the missing point information and the data supplement and acquisition strategy to obtain a missing point supplement and acquisition task.

In this embodiment, the missing point supplementary mining task is generated according to a preset task configuration template and the missing point information. Specifically, when the condition that the data complementary acquisition is met and the electric power data complementary acquisition processing is required is detected, a preset task configuration template and a data complementary acquisition strategy corresponding to the electric power terminal are obtained. The task configuration template can be a task table and is used for configuring an electric power data acquisition task and a missing point compensation task of an electric power terminal connected with the front-end processor. In a specific implementation, the task configuration template is described in a relational database as shown in table 1.

TABLE 1

By correspondingly configuring the task configuration template, specific information of tasks required to be collected by each power terminal and various leakage point information required to be collected in a supplementing mode can be stored. As shown in table 2 below, the task configuration template is a task for acquiring power data corresponding to the power terminal configured according to the task configuration template.

TABLE 2

The data complementary acquisition strategy is preset correspondingly based on each power terminal, and different power terminals can be provided with different data complementary acquisition strategies, such as complementary acquisition time length, complementary acquisition time, complementary acquisition frequency and the like. And performing task configuration on the task configuration template according to the data supplementary acquisition strategy and the missing point information corresponding to the power terminal to obtain a missing point supplementary acquisition task. For example, a task sequence, a task number, and the like in the task configuration template may be set. In one particular application, the missing point replenishment task may be as shown in table 3 below.

TABLE 3

The obtained leakage point supplement and collection task can be issued to the front-end processor by the server and forwarded to the corresponding power terminal by the front-end processor, so that the power terminal performs corresponding power data supplement and collection processing, the supplemented and collected power data is sent to the front-end processor and forwarded back to the server by the front-end processor, and the supplement and collection processing of the power data is achieved.

In one embodiment, the method further comprises the following steps: performing supplementary mining verification on the electric power supplementary mining data; and when the verification result of the supplementary collection and verification is that the verification is passed, deleting the missing point information in the cache.

In this embodiment, the complementary acquisition and verification of the received power complementary acquisition data is performed, and the leakage point information in the cache is updated. Specifically, after obtaining the electric power supplementary acquisition data corresponding to the leakage point information uploaded by the front-end processor, performing supplementary acquisition check on the electric power supplementary acquisition data, for example, checking whether the electric power supplementary acquisition data is the data which is correspondingly missing in the leakage point information, if so, considering that the supplementary acquisition is successful, that is, the supplementary acquisition check passes; otherwise, the supplementary mining fails, the supplementary mining verification fails, and the step of generating the missed point supplementary mining task according to the missed point information when the condition of data supplementary mining is detected can be returned to repeat the supplementary mining processing of the electric power data until the supplementary mining is successful. And when the verification result of the additional collection and verification is that the verification is passed, the electrical data is successfully additionally collected, the leakage point information in the cache is deleted if the leakage point information in the cache is invalid, and therefore the leakage point information in the cache is updated in time.

In one embodiment, an electric power data complementary mining method is provided, and the electric power data complementary mining method is based on Redis database cache leakage point information and performs electric power data complementary mining processing. Specifically, the online states of the power terminals connected to the front-end processor are monitored, the online states of the power terminals are cached in a Redis database, and the online states of the power terminals are initialized when the server starts a power data complementary acquisition function. On the other hand, the leakage point information in the preset cache is initialized, and due to the existence of the full-amount collection task in the morning every day, enough time exists for initializing the leakage point information, and the leakage point information related to the electric power collection data can be specifically determined at the zero point every day according to the electric power collection data obtained by the front-end processor and the electric power data collection task corresponding to the front-end processor. During initialization, all the measurement points of each power terminal are defaulted to have no data, the validity period of each key is set according to the complementary copying duration during initialization, if the data item corresponding to the key cannot acquire data after multiple complementary acquisition in the validity period, the power terminal is considered not to be frozen to the data item of the electric meter, and therefore useless dotting data are deleted, namely corresponding missing point information in a Redis database is deleted.

And detecting whether a data complementary collection condition is met or not so as to judge whether the power data complementary collection processing is triggered or not. Specifically, when the data supplementing and collecting condition includes that a terminal is online, namely supplementing and collecting, if the state of a certain power terminal is determined to be changed from offline to online according to the online state of the power terminal sent by the front-end processor, an online, namely supplementing and collecting strategy is executed, power data supplementing and collecting processing is performed on a leakage point corresponding to the power terminal, namely a leakage point supplementing and collecting task is generated according to the leakage point information of the power terminal, and the leakage point supplementing and collecting task is executed to achieve the supplementing and collecting processing of the power data. And when the data supplementing and collecting conditions comprise the timing supplementing and collecting, inquiring the leakage point information corresponding to the power terminals from the Redis according to the supplementing and copying time set corresponding to each power terminal, generating a leakage point supplementing and collecting task after inquiring the leakage point information, sending the generated leakage point supplementing and collecting task to the front-end processor, and forwarding the generated leakage point supplementing and collecting task to the power terminals by the front-end processor for power data collection. In addition, a data supplement and acquisition strategy corresponding to the power terminal can be monitored, and when the data supplement and acquisition strategy is changed, power data supplement and acquisition processing is carried out according to the updated data supplement and acquisition strategy.

And after a leakage point complementary acquisition task is issued to the front-end processor, monitoring electric power complementary acquisition data sent by the front-end processor, matching leakage point information in Redis according to the data type, task number, data time, data item, terminal address and measuring point number of the electric power complementary acquisition data sent by the front-end processor, deleting the information of the electric power terminal corresponding to the measuring point in a leakage point information table after matching, and updating the data leakage point information stored in the Redis.

In this embodiment, the online state of the power terminal is cached in the Redis, and is used as a basis for determining whether to issue a task. And meanwhile, dynamically monitoring the data supplement and acquisition conditions and the data supplement and acquisition strategies corresponding to the power terminals, and updating in time. The method comprises the steps that leakage point information of different data types of different power terminals is initialized in a Redis cache every zero point every day, power acquisition data returned by a front-end processor are received, the leakage point information in the cache is updated after the power acquisition data are received, power data complementary acquisition is carried out by adopting a data complementary acquisition condition that the terminal is on-line, namely complementary acquisition or timing complementary acquisition, specifically, a leakage point complementary acquisition task is generated according to the leakage point information and is sent to the front-end processor to carry out power data complementary acquisition, and finally, the power complementary acquisition data corresponding to the leakage point information and transmitted by the front-end processor are received. By utilizing the characteristic of high Redis query writing speed and adopting the data additional collection condition of online, namely additional collection and timing additional collection, the dotting additional collection of the missing point information is carried out, the load of the database can be greatly reduced, the failure list information is not required to be frequently counted in the database in the storage process, and the system pressure is greatly reduced; meanwhile, the query speed of the failure list information can be greatly improved, and the data acquisition efficiency is improved; compared with the method of directly dotting in the memory, the method of dotting and supplementing by using Redis can greatly save the memory space used by programs on the premise of ensuring the supplementing and mining efficiency. In addition, the statistics of failure information in the storage process of the database of the power system is matched, so that the acquisition success rate of power data can be greatly improved.

It should be understood that although the various steps in the flow charts of fig. 2-3 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 2-3 may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performance of the sub-steps or stages is not necessarily sequential, but may be performed in turn or alternating with other steps or at least some of the sub-steps or stages of other steps.

In one embodiment, as shown in fig. 5, there is provided a power data complementary acquiring apparatus, including: a leakage point information determining module 501, a complementary mining condition determining module 503, a complementary mining task generating module 505, a complementary mining task issuing module 507 and a complementary mining data receiving module 509, wherein:

a leakage point information determining module 501, configured to determine leakage point information in a preset cache; the leakage point information is associated with the electric power acquisition data uploaded by the front-end processor;

the complementary mining condition determining module 503 is configured to determine that the missing point information corresponds to a preset data complementary mining condition;

a complementary collection task generating module 505, configured to generate a missing point complementary collection task according to the missing point information when it is detected that the data complementary collection condition is met;

a supplementary mining task issuing module 507, configured to send a missing point supplementary mining task to the front-end processor; the leakage point complementary collection task is used for indicating the front-end processor to carry out electric power data complementary collection;

and a supplementary data receiving module 509, configured to receive the electric power supplementary data corresponding to the leakage point information, which is uploaded by the front-end processor.

In one embodiment, the system further comprises a collected data acquisition module, a collected task acquisition module, a collected data processing module and a leakage point information caching module; wherein: the acquisition data acquisition module is used for acquiring the electric power acquisition data acquired by the front-end unit; the acquisition task acquisition module is used for acquiring the electric power data acquisition task corresponding to the front-end processor; the acquisition data processing module is used for determining the leakage point information related to the electric power acquisition data according to the electric power data acquisition task when the preset leakage point initialization condition is detected to be met; and the leakage point information caching module is used for updating the leakage point information to a preset cache.

In one embodiment, the collected data processing module comprises a global information determining module, a global information processing module and a global leakage point information processing module; wherein: the global information determining module is used for determining global acquisition information according to the electric power data acquisition task; the global information processing module is used for determining global leakage point information in the global acquisition information according to the power acquisition data; and the global leakage point information processing module is used for obtaining leakage point information related to the power acquisition data according to the whole local leakage point information.

In one embodiment, the cache includes a Redis database; the leakage point information caching module comprises a key determining module, a first value determining module, a second value determining module and a key value pair module; wherein: the key determining module is used for obtaining keys of the Redis database according to the data types, the task numbers and the data time corresponding to the missing point information; the first value determining module is used for obtaining a first value of a Redis database according to the acquired data item corresponding to the leakage point information and the terminal address of the electric power terminal corresponding to the leakage point information; the second value determining module is used for obtaining a second value of the Redis database according to the missing number measuring point corresponding to the missing point information; and the key value pair module is used for constructing a key value pair according to the key, the first value and the second value of the Redis database and storing the key value pair into the Redis database.

In one embodiment, the feeding and mining condition determining module 503 includes an electric power terminal determining module and a terminal feeding and mining condition module, and the feeding and mining task generating module 505 includes a leakage point information obtaining module and a feeding and mining task obtaining module; wherein: the electric power terminal determining module is used for determining the electric power terminal corresponding to the leakage point information; the terminal complementary collection condition module is used for acquiring a preset data complementary collection condition corresponding to the power terminal; the leakage point information acquisition module is used for acquiring leakage point information from the cache when the electric power terminal is detected to be in an online state or the electric power terminal is detected to be in the online state and the complementary acquisition triggering condition in the data complementary acquisition condition is met; and the supplementary collection task obtaining module is used for generating the missing point supplementary collection task according to the missing point information.

In one embodiment, the complementary acquisition task obtaining module comprises a template strategy obtaining module and a template strategy processing module; wherein: the system comprises a template strategy acquisition module, a task configuration module and a data complementary acquisition strategy, wherein the template strategy acquisition module is used for acquiring a task configuration template and a data complementary acquisition strategy which are preset correspondingly by the power terminal; and the template strategy processing module is used for carrying out task configuration on the task configuration template according to the missing point information and the data complementary acquisition strategy to obtain the missing point complementary acquisition task.

In one embodiment, the system further comprises a complementary collection checking module and a missing point information updating module; wherein: the supplementary mining checking module is used for performing supplementary mining checking on the electric power supplementary mining data; and the missing point information updating module is used for deleting the missing point information in the cache when the verification result of the additional collection and verification is that the verification is passed.

For specific limitations of the electric power data complementary collection device, reference may be made to the above limitations of the electric power data complementary collection method, which is not described herein again. All or part of the modules in the electric power data supplementary device can be realized by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.

In one embodiment, a computer device is provided, which may be a server, and its internal structure diagram may be as shown in fig. 6. The computer device includes a processor, a memory, a network interface, and a database connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The database of the computer device is used for storing data. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a power data complementary collection method.

Those skilled in the art will appreciate that the architecture shown in fig. 6 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.

In one embodiment, there is provided a computer device comprising a memory and a processor, the memory storing a computer program, the processor implementing the following steps when executing the computer program:

In one embodiment, the processor, when executing the computer program, further performs the steps of: acquiring power acquisition data obtained by a front-end processor; acquiring a power data acquisition task corresponding to the front-end processor; when the preset leakage point initialization condition is met, determining leakage point information related to the electric power acquisition data according to the electric power data acquisition task; and updating the leakage point information to a preset cache.

In one embodiment, the processor, when executing the computer program, further performs the steps of: determining global acquisition information according to the power data acquisition task; determining global leakage point information in global acquisition information according to the power acquisition data; and obtaining the leakage point information associated with the electric power acquisition data according to the global leakage point information.

In one embodiment, the cache includes a Redis database; the processor, when executing the computer program, further performs the steps of: obtaining a key of a Redis database according to the data type, the task number and the data time corresponding to the missing point information; obtaining a first value of a Redis database according to the acquired data item corresponding to the leakage point information and the terminal address of the electric power terminal corresponding to the leakage point information; obtaining a second value of the Redis database according to the missing number measuring points corresponding to the missing point information; and constructing a key-value pair according to the key, the first value and the second value of the Redis database, and storing the key-value pair into the Redis database.

In one embodiment, the processor, when executing the computer program, further performs the steps of: determining a power terminal corresponding to the leakage point information; acquiring a preset data complementary collection condition corresponding to the power terminal; when the power terminal is detected to be in an online state or the power terminal is detected to be in the online state and meets a complementary acquisition triggering condition in the data complementary acquisition condition, acquiring leakage point information from a cache; and generating a missing point complementary collection task according to the missing point information.

In one embodiment, the processor, when executing the computer program, further performs the steps of: acquiring a task configuration template and a data complementary acquisition strategy which are preset by the power terminal correspondingly; and performing task configuration on the task configuration template according to the missing point information and the data supplement and acquisition strategy to obtain a missing point supplement and acquisition task.

In one embodiment, the processor, when executing the computer program, further performs the steps of: performing supplementary mining verification on the electric power supplementary mining data; and when the verification result of the additional adoption verification is that the verification is passed, deleting the missing point information in the cache.

In one embodiment, a computer-readable storage medium is provided, having stored thereon a computer program which, when executed by a processor, performs the steps of:

In one embodiment, the computer program when executed by the processor further performs the steps of: acquiring power acquisition data obtained by a front-end unit; acquiring a power data acquisition task corresponding to the front-end processor; when the preset leakage point initialization condition is met, determining leakage point information related to the electric power acquisition data according to the electric power data acquisition task; and updating the leakage point information to a preset cache.

In one embodiment, the computer program when executed by the processor further performs the steps of: determining global acquisition information according to the power data acquisition task; determining the whole local leakage point information in the global acquisition information according to the power acquisition data; and obtaining the leakage point information associated with the electric power acquisition data according to the global leakage point information.

In one embodiment, the cache includes a Redis database; the computer program when executed by the processor further performs the steps of: obtaining a key of a Redis database according to the data type, the task number and the data time corresponding to the missing point information; obtaining a first value of a Redis database according to the acquired data item corresponding to the leakage point information and the terminal address of the electric power terminal corresponding to the leakage point information; obtaining a second value of the Redis database according to the missing number measuring points corresponding to the missing point information; and constructing a key-value pair according to the key, the first value and the second value of the Redis database, and storing the key-value pair into the Redis database.

In one embodiment, the computer program when executed by the processor further performs the steps of: determining an electric power terminal corresponding to the leakage point information; acquiring a preset data complementary collection condition corresponding to the power terminal; when the power terminal is detected to be in an online state or the power terminal is detected to be in the online state and a complementary acquisition triggering condition in the data complementary acquisition condition is met, acquiring leakage point information from a cache; and generating a missing point supplementary task according to the missing point information.

In one embodiment, the computer program when executed by the processor further performs the steps of: acquiring a task configuration template and a data complementary acquisition strategy which are preset correspondingly by the power terminal; and performing task configuration on the task configuration template according to the missing point information and the data supplement and acquisition strategy to obtain a missing point supplement and acquisition task.

In one embodiment, the computer program when executed by the processor further performs the steps of: performing supplementary mining verification on the electric power supplementary mining data; and when the verification result of the additional adoption verification is that the verification is passed, deleting the missing point information in the cache.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.

The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent application shall be subject to the appended claims.

Claims

1. A method of electric power data replenishment, the method comprising:

sending the missing point complementary mining task to the front-end processor; the leakage point complementary mining task is used for indicating the front-end processor to perform electric power data complementary mining;

2. The method of claim 1, further comprising, before the determining the missing point information in the predetermined buffer:

acquiring power acquisition data obtained by a front-end processor;

when the condition that a preset leakage point initialization condition is met is detected, leakage point information related to the electric power acquisition data is determined according to the electric power data acquisition task;

and updating the leakage point information to a preset cache.

3. The method of claim 2, wherein determining the electrical power collection data associated leakage point information from the electrical power data collection task comprises:

determining global leakage point information in the global acquisition information according to the power acquisition data;

4. The method of claim 2, wherein the cache comprises a Redis database; the updating the missing point information to a preset cache comprises:

obtaining a key of the Redis database according to the data type, the task number and the data time corresponding to the missing point information;

obtaining a first value of the Redis database according to a collected data item corresponding to the leakage point information and a terminal address of an electric power terminal corresponding to the leakage point information;

obtaining a second value of the Redis database according to the missing number measuring point corresponding to the missing point information;

5. The method according to claim 1, wherein the determining that the missing point information corresponds to a preset data complementary acquisition condition comprises:

when the electric power terminal is detected to be in an online state or the electric power terminal is detected to be in the online state and meets a complementary acquisition triggering condition in the data complementary acquisition conditions, acquiring the leakage point information from the cache;

and generating a missing point supplementary collection task according to the missing point information.

6. The method of claim 5, wherein generating a missing point replenishment task according to the missing point information comprises:

acquiring a task configuration template and a data complementary acquisition strategy which are preset correspondingly to the power terminal;

7. The method of any one of claims 1 to 6, further comprising:

and when the verification result of the additional collection verification is that the verification is passed, deleting the missing point information in the cache.

8. An electric power data complementary mining device, characterized in that the device comprises:

the supplementary mining condition determining module is used for determining the preset data supplementary mining condition corresponding to the missing point information;

the supplementary collection task generating module is used for generating a missing point supplementary collection task according to the missing point information when the condition that the data supplementary collection is met is detected;

9. A computer device comprising a memory and a processor, the memory storing a computer program, wherein the processor implements the steps of the method of any one of claims 1 to 7 when executing the computer program.

10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 7.